Assignment 4¶

  • a) We will be working with the AFHQ (Animal Faces-HQ) dataset: https://github.com/clovaai/stargan-v2
    • Approx 15.000 images of animal faces (cat, dog, tiger, ...)
    • Downsample the images to 64x64
  • b) Write Convolutional Variational Autoencoder (ConvVAE)
    • Use Conv. layers for encoder and Transposed-Conv. layers for decoder.
    • You are only allowed to use linear layers for estimating the mean and standard deviation. Everything else should be convolutional.
  • c) Investigate the importance of the KL-divergence weight. For this purpose, train multiple models (at least 4) using different weighting values and investigate how this value affects the generation performance.
  • d) Generate new images by sampling latent vectors, investigate latent space and visualize some interpolations.
  • e) Compare the models from b) and c)
    • Qualitative comparison. Which images look better?
    • Quantitative comparison between models using the Fréchet Inception Distance: https://arxiv.org/abs/1706.08500
    • Log generated images and losses into the Tensorboard/W&B

Extra Point:

  • Extend your ConvVAE for Image generation conditioned on a given class. The AFHQ dataset has 3 classes: 'cat', 'dog', and 'wildlife'
  • Train your Conditional-ConvVAE
  • Show that you can generate images conditioned on a label
  • Tutorial: https://ijdykeman.github.io/ml/2016/12/21/cvae.html

Team name:¶

No description has been provided for this image

Members:¶

  1. Aidin Masroor
  2. Moein Taherkhani
  3. Amirhossein Soltani

Date : 02.06.2025

In [ ]:
import os  
import shutil
from tqdm import tqdm
import numpy as np
from sklearn.decomposition import PCA
from sklearn.manifold import TSNE
import matplotlib.pyplot as plt
from pytorch_lightning import seed_everything
import torch
import torch.nn as nn
import torch.nn.functional as F
import torchvision
from torchvision import datasets, models, transforms
from torchvision.utils import save_image
from torch.utils.data import DataLoader
from utils import *

from torch.utils.tensorboard import SummaryWriter
In [2]:
%load_ext autoreload
%autoreload 1
  1. Experiment with KLD = 1e_3¶

In [3]:
configs = {   
    "model_name" : "CVAE",
    "exp" : "1",  
    "latent_dim" : 64,
    "batch_size" : 64,
    "num_epochs" : 50,
    "lr" : 1e-3,
    "scheduler" : "ReduceLROnPlateau",
    "use_scheduler" : True,
    "lambda_kld" : 1e-3,
    }
In [4]:
dataset_root = './data/AFHQ/'

transform = transforms.Compose([transforms.Resize((64,64)),
                                      transforms.ToTensor(),
                                      transforms.Normalize([0.5]*3 , [0.5]*3)])

BS = configs["batch_size"]

train_dataset = datasets.ImageFolder(root= dataset_root+'train', transform= transform )
test_dataset = datasets.ImageFolder(root= dataset_root+'test', transform= transform )

# print(train_dataset.classes)  
print(train_dataset.class_to_idx)  

train_loader = DataLoader(dataset= train_dataset, 
                          batch_size= BS, 
                          shuffle= True, 
                          drop_last= True )

test_loader = DataLoader(dataset= test_dataset, 
                          batch_size= BS, 
                          shuffle= False, 
                          drop_last= True )
{'cat': 0, 'dog': 1, 'wild': 2}
In [5]:
imgs, labels = next(iter(train_loader))
fig, ax = plt.subplots(1, 8)
fig.set_size_inches(18, 5)
for i in range(8):
    img_np = imgs[i].permute(1, 2, 0).numpy()
    # Denormalize the image
    img_np = (img_np * 0.5 + 0.5).clip(0, 1)
    ax[i].imshow(img_np)
    ax[i].axis("off")
    ax[i].set_title(f"{train_dataset.classes[labels[i]]}")
plt.tight_layout()
plt.show()
No description has been provided for this image
In [6]:
imgs.shape
Out[6]:
torch.Size([64, 3, 64, 64])
In [7]:
class CVAE(nn.Module):
    def __init__(self, in_channels=3, latent_dim=64):
        super(CVAE, self).__init__()
        
        self.latent_dim = latent_dim
        self.in_channels = in_channels
        
        # Encoder
        self.encoder = self.make_encoder()
        
        # Fully connected layers for mu and sigma
        self.fc_mu = nn.Linear(2048, latent_dim)
        self.fc_sigma = nn.Linear(2048, latent_dim)
        
        '''
        Also called projection layer, projects latent vector to  original dimensionality.
        maps the latent variable into a space compatible with the decoder input
        '''
        self.decoder_input = nn.Sequential(
            nn.Linear(latent_dim, 2048),
            nn.LeakyReLU(0.2)
        )
        
        # Decoder
        self.decoder = self.make_decoder()

    def make_encoder(self):
        
        return nn.Sequential(
            # Input: (3, 64, 64)
            nn.Conv2d(self.in_channels, 16, kernel_size=4, stride=2, padding=1),  # (16, 32, 32)
            nn.BatchNorm2d(16),
            nn.LeakyReLU(0.2),
            
            nn.Conv2d(16, 32, kernel_size=4, stride=2, padding=1),  # (32, 16, 16)
            nn.BatchNorm2d(32),
            nn.LeakyReLU(0.2),
            
            nn.Conv2d(32, 64, kernel_size=4, stride=2, padding=1),  # (64, 8, 8)
            nn.BatchNorm2d(64),
            nn.LeakyReLU(0.2),
            
            nn.Conv2d(64, 128, kernel_size=4, stride=2, padding=1),  # (128, 4, 4)
            nn.BatchNorm2d(128),
            nn.LeakyReLU(0.2),
            
            nn.Flatten()  # 128 * 4 * 4 = 2048
        )
        
    def make_decoder(self):
        return nn.Sequential(
            # Input: (128, 4, 4)
            nn.ConvTranspose2d(128, 64, kernel_size=4, stride=2, padding=1),  # (64, 8, 8)
            nn.BatchNorm2d(64),
            nn.LeakyReLU(0.2),
            
            nn.ConvTranspose2d(64, 32, kernel_size=4, stride=2, padding=1),  # (32, 16, 16)
            nn.BatchNorm2d(32),
            nn.LeakyReLU(0.2),
            
            nn.ConvTranspose2d(32, 16, kernel_size=4, stride=2, padding=1),  # (16, 32, 32)
            nn.BatchNorm2d(16),
            nn.LeakyReLU(0.2),
            
            nn.ConvTranspose2d(16, self.in_channels, kernel_size=4, stride=2, padding=1),  # (3, 64, 64)
            nn.Sigmoid()
        )

    def reparameterize(self, mu, log_var):
        """Reparameterization trick"""
        std = torch.exp(0.5 * log_var)
        eps = torch.randn_like(std)
        return mu + eps * std
        
    def forward(self, x):
        # Encode
        x_encoded = self.encoder(x)
        
        # Get mu and log_var
        mu = self.fc_mu(x_encoded)  # [batch_size, latent_dim]
        log_var = self.fc_sigma(x_encoded)  # [batch_size, latent_dim]
        
        # Reparameterization trick
        z = self.reparameterize(mu, log_var)  # [batch_size, latent_dim]
        
        # Project and reshape for decoder
        z = self.decoder_input(z)
        z = z.view(-1, 128, 4, 4)
        x_hat = self.decoder(z)
        
        return x_hat, (z, mu, log_var) 
    

$Note\ on\ network\ architecture$¶

  • We experimented with various network configs. From increasing the latent space dimention up to 512, to more powerfun CNN endoder/decoders, to linear layers up to 8192 neurons.

  • As discussed per email, we also tried with latent space 128 and encoder layers [64, 128, 256, 512]. Results can be found under CVAE_new1_KLD_0.0001.

  • Nevertheless, the recons, altough marginal, were not noticeably improved! Therefor, we kept out network to the current settings, with parameters being significantly fewer.

In [9]:
device = "cuda" if torch.cuda.is_available() else "cpu"

seed_everything(42)

model = CVAE(latent_dim=configs["latent_dim"]).to(device)
Seed set to 42
In [53]:
model
Out[53]:
CVAE(
  (encoder): Sequential(
    (0): Conv2d(3, 16, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (1): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (2): LeakyReLU(negative_slope=0.2)
    (3): Conv2d(16, 32, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (4): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (5): LeakyReLU(negative_slope=0.2)
    (6): Conv2d(32, 64, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (7): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (8): LeakyReLU(negative_slope=0.2)
    (9): Conv2d(64, 128, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (10): BatchNorm2d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (11): LeakyReLU(negative_slope=0.2)
    (12): Flatten(start_dim=1, end_dim=-1)
  )
  (fc_mu): Linear(in_features=2048, out_features=64, bias=True)
  (fc_sigma): Linear(in_features=2048, out_features=64, bias=True)
  (decoder_input): Sequential(
    (0): Linear(in_features=64, out_features=2048, bias=True)
    (1): LeakyReLU(negative_slope=0.2)
  )
  (decoder): Sequential(
    (0): ConvTranspose2d(128, 64, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (1): BatchNorm2d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (2): LeakyReLU(negative_slope=0.2)
    (3): ConvTranspose2d(64, 32, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (4): BatchNorm2d(32, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (5): LeakyReLU(negative_slope=0.2)
    (6): ConvTranspose2d(32, 16, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (7): BatchNorm2d(16, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (8): LeakyReLU(negative_slope=0.2)
    (9): ConvTranspose2d(16, 3, kernel_size=(4, 4), stride=(2, 2), padding=(1, 1))
    (10): Sigmoid()
  )
)
In [11]:
count_model_params(model.encoder)
Out[11]:
173520
In [12]:
count_model_params(model.decoder)
Out[12]:
173139
In [13]:
count_model_params(model.fc_mu) + count_model_params(model.fc_sigma) 
Out[13]:
262272
In [14]:
count_model_params(model)
Out[14]:
742051
In [ ]:
optimizer = torch.optim.AdamW(model.parameters(), lr=configs["lr"], weight_decay=1e-5)

scheduler = torch.optim.lr_scheduler.ReduceLROnPlateau(optimizer, patience=7, factor=0.5, verbose=True)
/home/user/soltania1/.local/lib/python3.8/site-packages/torch/optim/lr_scheduler.py:60: UserWarning: The verbose parameter is deprecated. Please use get_last_lr() to access the learning rate.
  warnings.warn(
In [16]:
def makedires(configs):
    model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
    savepath = f"imgs/{model_name}"
    if os.path.exists(savepath):
        shutil.rmtree(savepath)
    os.makedirs(savepath,exist_ok=True)

    TBOARD_LOGS = os.path.join(os.getcwd(), "tboard_logs", model_name+f"_KLD_{configs['lambda_kld']}")
    if os.path.exists(TBOARD_LOGS):
        shutil.rmtree(TBOARD_LOGS)
    os.makedirs(TBOARD_LOGS)
    writer = SummaryWriter(TBOARD_LOGS)
    return savepath, writer

savepath, writer = makedires(configs)
In [17]:
def vae_loss_function(recons, target, mu, log_var, lambda_kld=configs["lambda_kld"]):
    """
    Combined loss function for joint optimization of 
    reconstruction and ELBO
    """
    recons_loss = F.mse_loss(recons, target)
    kld = (-0.5 * (1 + log_var - mu**2 - log_var.exp()).sum(dim=1)).mean(dim=0)  # closed-form solution of KLD in Gaussian
    loss = recons_loss + lambda_kld * kld

    return loss, (recons_loss, kld)
In [18]:
model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"

train_loss, val_loss, loss_iters, val_loss_recons, val_loss_kld = train_model(
        model=model, 
        model_name=model_name,
        optimizer=optimizer,
        scheduler=scheduler if configs["use_scheduler"] else None, 
        criterion=vae_loss_function,
        lambda_kld=configs["lambda_kld"],
        train_loader=train_loader, 
        valid_loader=test_loader, 
        num_epochs=configs["num_epochs"],
        save_frequency= 10, 
        savepath=savepath,
        writer=writer
    )
Epoch 1 Iter 224: loss 0.22007. : 100%|██████████| 224/224 [01:43<00:00,  2.17it/s]
    Train loss: 0.29521
    Valid loss: 0.60873
       Valid loss recons: 0.60871
       Valid loss KL-D:   0.01345
Epoch 2 Iter 224: loss 0.19876. : 100%|██████████| 224/224 [01:43<00:00,  2.17it/s]
Epoch 3 Iter 224: loss 0.20027. : 100%|██████████| 224/224 [01:41<00:00,  2.21it/s]
    Train loss: 0.20983
    Valid loss: 0.21243
       Valid loss recons: 0.20206
       Valid loss KL-D:   10.3759
Epoch 4 Iter 224: loss 0.21310. : 100%|██████████| 224/224 [01:43<00:00,  2.17it/s]
Epoch 5 Iter 224: loss 0.20445. : 100%|██████████| 224/224 [01:39<00:00,  2.24it/s]
    Train loss: 0.20653
    Valid loss: 0.20849
       Valid loss recons: 0.19666
       Valid loss KL-D:   11.8341
Epoch 6 Iter 224: loss 0.20707. : 100%|██████████| 224/224 [01:40<00:00,  2.24it/s]
Epoch 7 Iter 224: loss 0.18920. : 100%|██████████| 224/224 [01:41<00:00,  2.21it/s]
    Train loss: 0.20498
    Valid loss: 0.20621
       Valid loss recons: 0.19423
       Valid loss KL-D:   11.98574
Epoch 8 Iter 224: loss 0.21119. : 100%|██████████| 224/224 [01:40<00:00,  2.24it/s]
Epoch 9 Iter 224: loss 0.19564. : 100%|██████████| 224/224 [01:40<00:00,  2.22it/s]
    Train loss: 0.20419
    Valid loss: 0.20548
       Valid loss recons: 0.19329
       Valid loss KL-D:   12.1849
Epoch 10 Iter 224: loss 0.20840. : 100%|██████████| 224/224 [01:40<00:00,  2.24it/s]
Epoch 11 Iter 224: loss 0.20068. : 100%|██████████| 224/224 [01:42<00:00,  2.18it/s]
    Train loss: 0.20363
    Valid loss: 0.20485
       Valid loss recons: 0.19282
       Valid loss KL-D:   12.03094
Epoch 12 Iter 224: loss 0.20297. : 100%|██████████| 224/224 [01:43<00:00,  2.17it/s]
Epoch 13 Iter 224: loss 0.19077. : 100%|██████████| 224/224 [01:41<00:00,  2.21it/s]
    Train loss: 0.2031
    Valid loss: 0.20432
       Valid loss recons: 0.1916
       Valid loss KL-D:   12.71991
Epoch 14 Iter 224: loss 0.21432. : 100%|██████████| 224/224 [01:41<00:00,  2.21it/s]
Epoch 15 Iter 224: loss 0.21657. : 100%|██████████| 224/224 [01:47<00:00,  2.08it/s]
    Train loss: 0.20265
    Valid loss: 0.20398
       Valid loss recons: 0.19198
       Valid loss KL-D:   12.00709
Epoch 16 Iter 224: loss 0.20357. : 100%|██████████| 224/224 [01:42<00:00,  2.18it/s]
Epoch 17 Iter 224: loss 0.21152. : 100%|██████████| 224/224 [01:47<00:00,  2.09it/s]
    Train loss: 0.20246
    Valid loss: 0.20382
       Valid loss recons: 0.19116
       Valid loss KL-D:   12.66502
Epoch 18 Iter 224: loss 0.20592. : 100%|██████████| 224/224 [01:49<00:00,  2.04it/s]
Epoch 19 Iter 224: loss 0.18069. : 100%|██████████| 224/224 [01:40<00:00,  2.24it/s]
    Train loss: 0.2022
    Valid loss: 0.20374
       Valid loss recons: 0.19137
       Valid loss KL-D:   12.36959
Epoch 20 Iter 224: loss 0.21266. : 100%|██████████| 224/224 [01:40<00:00,  2.24it/s]
Epoch 21 Iter 224: loss 0.18017. : 100%|██████████| 224/224 [01:43<00:00,  2.16it/s]
    Train loss: 0.20206
    Valid loss: 0.20321
       Valid loss recons: 0.19097
       Valid loss KL-D:   12.23689
Epoch 22 Iter 224: loss 0.19398. : 100%|██████████| 224/224 [01:45<00:00,  2.12it/s]
Epoch 23 Iter 224: loss 0.18865. : 100%|██████████| 224/224 [01:55<00:00,  1.94it/s]
    Train loss: 0.20185
    Valid loss: 0.20303
       Valid loss recons: 0.19116
       Valid loss KL-D:   11.87272
Epoch 24 Iter 224: loss 0.20496. : 100%|██████████| 224/224 [01:58<00:00,  1.88it/s]
Epoch 25 Iter 224: loss 0.24171. : 100%|██████████| 224/224 [01:50<00:00,  2.02it/s]
    Train loss: 0.20173
    Valid loss: 0.20325
       Valid loss recons: 0.19076
       Valid loss KL-D:   12.48229
Epoch 26 Iter 224: loss 0.19523. : 100%|██████████| 224/224 [01:52<00:00,  2.00it/s]
Epoch 27 Iter 224: loss 0.20461. : 100%|██████████| 224/224 [01:56<00:00,  1.93it/s]
    Train loss: 0.20156
    Valid loss: 0.20299
       Valid loss recons: 0.1906
       Valid loss KL-D:   12.38847
Epoch 28 Iter 224: loss 0.22861. : 100%|██████████| 224/224 [01:44<00:00,  2.13it/s]
Epoch 29 Iter 224: loss 0.21013. : 100%|██████████| 224/224 [01:51<00:00,  2.01it/s]
    Train loss: 0.20152
    Valid loss: 0.20288
       Valid loss recons: 0.19076
       Valid loss KL-D:   12.11463
Epoch 30 Iter 224: loss 0.19113. : 100%|██████████| 224/224 [01:51<00:00,  2.02it/s]
Epoch 31 Iter 224: loss 0.18924. : 100%|██████████| 224/224 [02:04<00:00,  1.80it/s]
    Train loss: 0.20138
    Valid loss: 0.20274
       Valid loss recons: 0.19012
       Valid loss KL-D:   12.62622
Epoch 32 Iter 224: loss 0.19771. : 100%|██████████| 224/224 [01:44<00:00,  2.14it/s]
Epoch 33 Iter 224: loss 0.19112. : 100%|██████████| 224/224 [02:01<00:00,  1.85it/s]
    Train loss: 0.20122
    Valid loss: 0.20274
       Valid loss recons: 0.19017
       Valid loss KL-D:   12.56707
Epoch 34 Iter 224: loss 0.20373. : 100%|██████████| 224/224 [01:47<00:00,  2.08it/s]
Epoch 35 Iter 224: loss 0.19207. : 100%|██████████| 224/224 [01:44<00:00,  2.14it/s]
    Train loss: 0.20116
    Valid loss: 0.20256
       Valid loss recons: 0.18998
       Valid loss KL-D:   12.57888
Epoch 36 Iter 224: loss 0.20918. : 100%|██████████| 224/224 [02:19<00:00,  1.60it/s]
Epoch 37 Iter 224: loss 0.19288. : 100%|██████████| 224/224 [01:52<00:00,  1.98it/s]
    Train loss: 0.20113
    Valid loss: 0.20251
       Valid loss recons: 0.19013
       Valid loss KL-D:   12.38542
Epoch 38 Iter 224: loss 0.19881. : 100%|██████████| 224/224 [01:52<00:00,  1.98it/s]
Epoch 39 Iter 224: loss 0.20271. : 100%|██████████| 224/224 [01:51<00:00,  2.00it/s]
    Train loss: 0.20101
    Valid loss: 0.2024
       Valid loss recons: 0.18982
       Valid loss KL-D:   12.5745
Epoch 40 Iter 224: loss 0.19427. : 100%|██████████| 224/224 [01:52<00:00,  2.00it/s]
Epoch 41 Iter 224: loss 0.20196. : 100%|██████████| 224/224 [01:51<00:00,  2.01it/s]
    Train loss: 0.20081
    Valid loss: 0.2024
       Valid loss recons: 0.18948
       Valid loss KL-D:   12.92324
Epoch 42 Iter 224: loss 0.19977. : 100%|██████████| 224/224 [01:54<00:00,  1.96it/s]
Epoch 43 Iter 224: loss 0.20173. : 100%|██████████| 224/224 [02:37<00:00,  1.42it/s]
    Train loss: 0.20089
    Valid loss: 0.20246
       Valid loss recons: 0.18934
       Valid loss KL-D:   13.12361
Epoch 44 Iter 224: loss 0.20650. : 100%|██████████| 224/224 [01:52<00:00,  1.99it/s]
Epoch 45 Iter 224: loss 0.19702. : 100%|██████████| 224/224 [01:51<00:00,  2.01it/s]
    Train loss: 0.20069
    Valid loss: 0.20273
       Valid loss recons: 0.18982
       Valid loss KL-D:   12.90565
Epoch 46 Iter 224: loss 0.20445. : 100%|██████████| 224/224 [02:18<00:00,  1.62it/s]
Epoch 47 Iter 224: loss 0.18952. : 100%|██████████| 224/224 [02:19<00:00,  1.60it/s]
    Train loss: 0.20062
    Valid loss: 0.20232
       Valid loss recons: 0.19002
       Valid loss KL-D:   12.30277
Epoch 48 Iter 224: loss 0.19414. : 100%|██████████| 224/224 [02:02<00:00,  1.83it/s]
Epoch 49 Iter 224: loss 0.21704. : 100%|██████████| 224/224 [02:24<00:00,  1.55it/s]
    Train loss: 0.20061
    Valid loss: 0.20233
       Valid loss recons: 0.18936
       Valid loss KL-D:   12.97243
Epoch 50 Iter 224: loss 0.19021. : 100%|██████████| 224/224 [01:55<00:00,  1.94it/s]
    Train loss: 0.20065
    Valid loss: 0.20212
       Valid loss recons: 0.18948
       Valid loss KL-D:   12.64455
Training completed

Saving model and training configs¶

In [19]:
def save_config(configs):
    model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
    configs_dir = f"./configs/{model_name}/"
    if not os.path.exists(configs_dir):
        os.makedirs(configs_dir,exist_ok=True)
    configs_path = configs_dir + "/config.yaml"

    with open(configs_path, 'w') as f:
        yaml.dump(configs, f)

epoch = configs["num_epochs"]
lambda_kld = configs["lambda_kld"]

save_model(model, model_name, optimizer, epoch = epoch,lambda_kld = lambda_kld, stats = configs )
save_config(configs)
In [20]:
img_vs_recons(model, test_loader, device)
No description has been provided for this image
In [27]:
def compute_encoder_output_size(batch_size, input_shape, model):
    """
    Compute the un/flattened output size of the encoder given an input shape.
    """
    with torch.no_grad():

        enc_input = torch.zeros(batch_size, *input_shape).to(device)  # (BS, 3, 64, 64)
        
        # Get encoder output
        output = model.encoder(enc_input)
        
        enc_out_shape = output.view(batch_size,-1,4,4).shape[1:]
        # Get flattened size
        flattened_size = output.view(1, -1).shape[1]
        return enc_out_shape, flattened_size
        
In [28]:
compute_encoder_output_size(BS, (3, 64, 64), model)
Out[28]:
(torch.Size([128, 4, 4]), 131072)

Inference¶

Sampling random tensors from a normal districution and investigating if the model has learnt to map any random vercor with normal distribution to a meaningful resresentation

In [29]:
def inference(configs, model):
    model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
    BS = configs["batch_size"]
    if not os.path.exists(f"imgs/inference/{model_name}"):
        os.makedirs(f"imgs/inference/{model_name}")

    latent_dim = configs["latent_dim"]

    enc_output_shape, _ = compute_encoder_output_size(BS, (3, 64, 64), model)
    # print(enc_output_shape)
    with torch.no_grad():
        for i in range(5):
            z = torch.randn(BS, latent_dim).to(device)

            z = model.decoder_input(z)
            z = z.view(-1, *enc_output_shape)

            recons = model.decoder(z)
            recons = recons.view(BS, 3, 64, 64)
            save_image(recons, f"imgs/inference/{model_name}/inference_{i}.png")
            return recons

def plot_recons(recons):
    plt.figure(figsize=(8*2, 4*2))
    for i in range(32):
        plt.subplot(4,8,i+1)
        recon_img = denormalize_images(recons[i].cpu())
        # recon_img = recons[i].cpu()
        recon_img = recon_img.permute(1, 2, 0)
        plt.imshow(recon_img)  
        plt.axis("off")
    plt.tight_layout()
    plt.show()
    
    
plot_recons(inference(configs,model))
No description has been provided for this image

Latent space visualization¶

In [25]:
def vis_latent(test_loader, model, test_dataset):
    imgs_flat, latents, labels = [], [], []
    with torch.no_grad():
        for imgs, lbls in test_loader:
            imgs = imgs.to(device)
            _, (z, _, _) = model(imgs)
            imgs_flat.append(imgs.cpu().view(imgs.shape[0],-1))
            latents.append(z.cpu())
            labels.append(lbls)
            
    imgs_flat = np.concatenate(imgs_flat)    
    latents = np.concatenate(latents)
    labels = np.concatenate(labels)

    latents_reshaped = latents.reshape(latents.shape[0], -1)

    pca_imgs = PCA(n_components=2).fit_transform(imgs_flat)
    pca_latents = PCA(n_components=2).fit_transform(latents_reshaped)

    N = 2000
    fig,ax = plt.subplots(1,2,figsize=(26,8))
    display_projections(pca_imgs[:N], labels[:N], ax=ax[0], legend=test_dataset.classes)
    ax[0].set_title("PCA Proj. of Images")
    display_projections(pca_latents[:N], labels[:N], ax=ax[1], legend=test_dataset.classes)
    ax[1].set_title("Encoded Representations")
    plt.show()
In [26]:
vis_latent(test_loader, model, test_dataset)
No description has been provided for this image

Interpolation¶

  1. The latent space is a compressed representation of images By sampling different points, we can see how the decoder maps these points to images

  2. Interpolation helps us understand what the model has learned and to verify if the model has learned meaningful features

  3. Can be used for visualization of the Model's Behavior, how the model generalizes to new inputs

  4. Reveals the structure of the learned latent space

  5. Interpolation and Generation: By sampling normal distributions with linspace mean and std values, we can move through the latent space and realize how the model generate new images.

In [50]:
@torch.no_grad()
def plot_reconstructed(model, xrange=(-3, 3), yrange=(-10, 10), N=12):
    """
    Sampling equispaced points from the latent space given the xrange and yrange, 
    decoding latents and visualizing distribution of the space
    """
    # Project points to decoder input dimension (same as in forward pass)
    SIZE = 64  # Image size
    grid = np.empty((N*SIZE, N*SIZE, 3))  # 3 channels for RGB
    
    for i, y in enumerate(np.linspace(*yrange, N)):
        for j, x in enumerate(np.linspace(*xrange, N)):
            # mean
            mu = torch.zeros(model.latent_dim, device=device)
            mu[0] = x
            mu[1] = y
            
            # standard deviation
            # Create a vector of stds the same shape as mu
            sigma = 1 
            std = torch.full_like(mu, sigma)
            z = torch.normal(mean=mu, std=std)
            
            # Passing through the decoder 
            z = model.decoder_input(z)
            z = z.view(-1, 128, 4, 4)  # Reshape to match decoder input
            
            # Getting recons
            x_hat = model.decoder(z)
            
            # To visualize
            x_hat = x_hat.squeeze(0).cpu()  # Remove batch dimension
            x_hat = x_hat.permute(1, 2, 0)  # (C,H,W) to (H,W,C)
            recon_img = x_hat.numpy()
            
            # Prepare the image for visualization
            recon_img = denormalize_images(recon_img[i])
            
            grid[(N-1-i)*SIZE:(N-i)*SIZE, j*SIZE:(j+1)*SIZE] = recon_img
           
    plt.figure(figsize=(12,20))
    plt.imshow(grid, extent=[*yrange, *xrange])
    plt.axis("off")
    plt.show()
In [52]:
plot_reconstructed(model, xrange=(-10, 10), yrange=(-10, 10), N=15)
No description has been provided for this image

Investigating the importance of the KL-divergence¶

In VAEs, the loss is: Total Loss = Reconstruction Loss + λ * KLD

Reconstruction Loss (e.g. MSE): Measures how well the VAE reconstructs the input.

KLD: Encourages the latent space distribution to be close to a standard normal (regularization).

However, there is a the trade-off between:

  1. Accurate reconstructions (low MSE)
  2. Structured latent space (low KLD)

If:

lambda_kld is too low → poor latent structure (overfit to data, bad generative quality)

lambda_kld is too high → poor reconstructions (model ignores input to match prior)

For this assignment we chose following values to experiment with:

lambda_kld_values = [0.0, 1e-4, 1e-3, 1e-2]

λ (KLD weight) Effect
0.0 Pure autoencoder (no latent regularization)
1e-4 Very weak KLD → good reconstructions, weak latent structure
1e-3 Balanced trade-off
1e-2 Strong KLD → worse recons, better sampling and latent space
  1. Experiment with KLD = 0.0¶

In [4]:
seed_everything(42)

model = CVAE(latent_dim=configs["latent_dim"]).to(device)

optimizer = torch.optim.AdamW(model.parameters(), lr=configs["lr"], weight_decay=1e-5)
scheduler = torch.optim.lr_scheduler.ReduceLROnPlateau(optimizer, patience=7, factor=0.5, verbose=True)
model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
savepath, writer = makedires(configs)

train_loss, val_loss, loss_iters, val_loss_recons, val_loss_kld = train_model(
        model=model, 
        model_name=model_name,
        optimizer=optimizer,
        scheduler=scheduler if configs["use_scheduler"] else None, 
        criterion=vae_loss_function,
        lambda_kld=configs["lambda_kld"],
        train_loader=train_loader, 
        valid_loader=test_loader, 
        num_epochs=configs["num_epochs"],
        save_frequency= 10, 
        savepath=savepath,
        writer=writer
    )

epoch = configs["num_epochs"]
lambda_kld = configs["lambda_kld"]

save_model(model, model_name, optimizer, epoch = epoch,lambda_kld = lambda_kld, stats = configs )
save_config(configs)
Seed set to 42
/home/user/soltania1/.local/lib/python3.8/site-packages/torch/optim/lr_scheduler.py:60: UserWarning: The verbose parameter is deprecated. Please use get_last_lr() to access the learning rate.
  warnings.warn(
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.53192. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.53192. :   0%|▏                                               | 1/224 [00:00<02:01,  1.84it/s]
Epoch 1 Iter 2: loss 0.52736. :   0%|▏                                               | 1/224 [00:01<02:01,  1.84it/s]
Epoch 1 Iter 2: loss 0.52736. :   1%|▍                                               | 2/224 [00:01<01:51,  1.98it/s]
Epoch 1 Iter 3: loss 0.56549. :   1%|▍                                               | 2/224 [00:01<01:51,  1.98it/s]
Epoch 1 Iter 3: loss 0.56549. :   1%|▋                                               | 3/224 [00:01<01:46,  2.07it/s]
Epoch 1 Iter 4: loss 0.49826. :   1%|▋                                               | 3/224 [00:01<01:46,  2.07it/s]
Epoch 1 Iter 4: loss 0.49826. :   2%|▊                                               | 4/224 [00:01<01:44,  2.11it/s]
Epoch 1 Iter 5: loss 0.55181. :   2%|▊                                               | 4/224 [00:02<01:44,  2.11it/s]
Epoch 1 Iter 5: loss 0.55181. :   2%|█                                               | 5/224 [00:02<01:42,  2.13it/s]
Epoch 1 Iter 6: loss 0.54025. :   2%|█                                               | 5/224 [00:02<01:42,  2.13it/s]
Epoch 1 Iter 6: loss 0.54025. :   3%|█▎                                              | 6/224 [00:02<01:41,  2.14it/s]
Epoch 1 Iter 7: loss 0.49496. :   3%|█▎                                              | 6/224 [00:03<01:41,  2.14it/s]
Epoch 1 Iter 7: loss 0.49496. :   3%|█▌                                              | 7/224 [00:03<01:40,  2.15it/s]
Epoch 1 Iter 8: loss 0.46740. :   3%|█▌                                              | 7/224 [00:03<01:40,  2.15it/s]
Epoch 1 Iter 8: loss 0.46740. :   4%|█▋                                              | 8/224 [00:03<01:40,  2.15it/s]
Epoch 1 Iter 9: loss 0.43176. :   4%|█▋                                              | 8/224 [00:04<01:40,  2.15it/s]
Epoch 1 Iter 9: loss 0.43176. :   4%|█▉                                              | 9/224 [00:04<01:40,  2.14it/s]
Epoch 1 Iter 10: loss 0.47716. :   4%|█▉                                             | 9/224 [00:04<01:40,  2.14it/s]
Epoch 1 Iter 10: loss 0.47716. :   4%|██                                            | 10/224 [00:04<01:39,  2.15it/s]
Epoch 1 Iter 11: loss 0.44012. :   4%|██                                            | 10/224 [00:05<01:39,  2.15it/s]
Epoch 1 Iter 11: loss 0.44012. :   5%|██▎                                           | 11/224 [00:05<01:39,  2.15it/s]
Epoch 1 Iter 12: loss 0.41105. :   5%|██▎                                           | 11/224 [00:05<01:39,  2.15it/s]
Epoch 1 Iter 12: loss 0.41105. :   5%|██▍                                           | 12/224 [00:05<01:38,  2.16it/s]
Epoch 1 Iter 13: loss 0.40918. :   5%|██▍                                           | 12/224 [00:06<01:38,  2.16it/s]
Epoch 1 Iter 13: loss 0.40918. :   6%|██▋                                           | 13/224 [00:06<01:37,  2.17it/s]
Epoch 1 Iter 14: loss 0.38975. :   6%|██▋                                           | 13/224 [00:06<01:37,  2.17it/s]
Epoch 1 Iter 14: loss 0.38975. :   6%|██▉                                           | 14/224 [00:06<01:37,  2.16it/s]
Epoch 1 Iter 15: loss 0.39846. :   6%|██▉                                           | 14/224 [00:07<01:37,  2.16it/s]
Epoch 1 Iter 15: loss 0.39846. :   7%|███                                           | 15/224 [00:07<01:37,  2.14it/s]
Epoch 1 Iter 16: loss 0.35527. :   7%|███                                           | 15/224 [00:07<01:37,  2.14it/s]
Epoch 1 Iter 16: loss 0.35527. :   7%|███▎                                          | 16/224 [00:07<01:36,  2.15it/s]
Epoch 1 Iter 17: loss 0.34557. :   7%|███▎                                          | 16/224 [00:07<01:36,  2.15it/s]
Epoch 1 Iter 17: loss 0.34557. :   8%|███▍                                          | 17/224 [00:07<01:35,  2.17it/s]
Epoch 1 Iter 18: loss 0.35276. :   8%|███▍                                          | 17/224 [00:08<01:35,  2.17it/s]
Epoch 1 Iter 18: loss 0.35276. :   8%|███▋                                          | 18/224 [00:08<01:35,  2.16it/s]
Epoch 1 Iter 19: loss 0.32189. :   8%|███▋                                          | 18/224 [00:08<01:35,  2.16it/s]
Epoch 1 Iter 19: loss 0.32189. :   8%|███▉                                          | 19/224 [00:08<01:34,  2.17it/s]
Epoch 1 Iter 20: loss 0.34684. :   8%|███▉                                          | 19/224 [00:09<01:34,  2.17it/s]
Epoch 1 Iter 20: loss 0.34684. :   9%|████                                          | 20/224 [00:09<01:34,  2.17it/s]
Epoch 1 Iter 21: loss 0.31927. :   9%|████                                          | 20/224 [00:09<01:34,  2.17it/s]
Epoch 1 Iter 21: loss 0.31927. :   9%|████▎                                         | 21/224 [00:09<01:33,  2.17it/s]
Epoch 1 Iter 22: loss 0.31746. :   9%|████▎                                         | 21/224 [00:10<01:33,  2.17it/s]
Epoch 1 Iter 22: loss 0.31746. :  10%|████▌                                         | 22/224 [00:10<01:32,  2.18it/s]
Epoch 1 Iter 23: loss 0.30270. :  10%|████▌                                         | 22/224 [00:10<01:32,  2.18it/s]
Epoch 1 Iter 23: loss 0.30270. :  10%|████▋                                         | 23/224 [00:10<01:32,  2.18it/s]
Epoch 1 Iter 24: loss 0.32806. :  10%|████▋                                         | 23/224 [00:11<01:32,  2.18it/s]
Epoch 1 Iter 24: loss 0.32806. :  11%|████▉                                         | 24/224 [00:11<01:31,  2.18it/s]
Epoch 1 Iter 25: loss 0.30305. :  11%|████▉                                         | 24/224 [00:11<01:31,  2.18it/s]
Epoch 1 Iter 25: loss 0.30305. :  11%|█████▏                                        | 25/224 [00:11<01:32,  2.16it/s]
Epoch 1 Iter 26: loss 0.32688. :  11%|█████▏                                        | 25/224 [00:12<01:32,  2.16it/s]
Epoch 1 Iter 26: loss 0.32688. :  12%|█████▎                                        | 26/224 [00:12<01:31,  2.15it/s]
Epoch 1 Iter 27: loss 0.27134. :  12%|█████▎                                        | 26/224 [00:12<01:31,  2.15it/s]
Epoch 1 Iter 27: loss 0.27134. :  12%|█████▌                                        | 27/224 [00:12<01:31,  2.15it/s]
Epoch 1 Iter 28: loss 0.24979. :  12%|█████▌                                        | 27/224 [00:13<01:31,  2.15it/s]
Epoch 1 Iter 28: loss 0.24979. :  12%|█████▊                                        | 28/224 [00:13<01:30,  2.16it/s]
Epoch 1 Iter 29: loss 0.29460. :  12%|█████▊                                        | 28/224 [00:13<01:30,  2.16it/s]
Epoch 1 Iter 29: loss 0.29460. :  13%|█████▉                                        | 29/224 [00:13<01:30,  2.15it/s]
Epoch 1 Iter 30: loss 0.28273. :  13%|█████▉                                        | 29/224 [00:13<01:30,  2.15it/s]
Epoch 1 Iter 30: loss 0.28273. :  13%|██████▏                                       | 30/224 [00:13<01:29,  2.17it/s]
Epoch 1 Iter 31: loss 0.27450. :  13%|██████▏                                       | 30/224 [00:14<01:29,  2.17it/s]
Epoch 1 Iter 31: loss 0.27450. :  14%|██████▎                                       | 31/224 [00:14<01:28,  2.17it/s]
Epoch 1 Iter 32: loss 0.25617. :  14%|██████▎                                       | 31/224 [00:14<01:28,  2.17it/s]
Epoch 1 Iter 32: loss 0.25617. :  14%|██████▌                                       | 32/224 [00:14<01:28,  2.17it/s]
Epoch 1 Iter 33: loss 0.25674. :  14%|██████▌                                       | 32/224 [00:15<01:28,  2.17it/s]
Epoch 1 Iter 33: loss 0.25674. :  15%|██████▊                                       | 33/224 [00:15<01:28,  2.16it/s]
Epoch 1 Iter 34: loss 0.27061. :  15%|██████▊                                       | 33/224 [00:15<01:28,  2.16it/s]
Epoch 1 Iter 34: loss 0.27061. :  15%|██████▉                                       | 34/224 [00:15<01:28,  2.15it/s]
Epoch 1 Iter 35: loss 0.25932. :  15%|██████▉                                       | 34/224 [00:16<01:28,  2.15it/s]
Epoch 1 Iter 35: loss 0.25932. :  16%|███████▏                                      | 35/224 [00:16<01:27,  2.16it/s]
Epoch 1 Iter 36: loss 0.24360. :  16%|███████▏                                      | 35/224 [00:16<01:27,  2.16it/s]
Epoch 1 Iter 36: loss 0.24360. :  16%|███████▍                                      | 36/224 [00:16<01:27,  2.15it/s]
Epoch 1 Iter 37: loss 0.23885. :  16%|███████▍                                      | 36/224 [00:17<01:27,  2.15it/s]
Epoch 1 Iter 37: loss 0.23885. :  17%|███████▌                                      | 37/224 [00:17<01:26,  2.16it/s]
Epoch 1 Iter 38: loss 0.26896. :  17%|███████▌                                      | 37/224 [00:17<01:26,  2.16it/s]
Epoch 1 Iter 38: loss 0.26896. :  17%|███████▊                                      | 38/224 [00:17<01:26,  2.16it/s]
Epoch 1 Iter 39: loss 0.28399. :  17%|███████▊                                      | 38/224 [00:18<01:26,  2.16it/s]
Epoch 1 Iter 39: loss 0.28399. :  17%|████████                                      | 39/224 [00:18<01:25,  2.17it/s]
Epoch 1 Iter 40: loss 0.23592. :  17%|████████                                      | 39/224 [00:18<01:25,  2.17it/s]
Epoch 1 Iter 40: loss 0.23592. :  18%|████████▏                                     | 40/224 [00:18<01:24,  2.18it/s]
Epoch 1 Iter 41: loss 0.26047. :  18%|████████▏                                     | 40/224 [00:19<01:24,  2.18it/s]
Epoch 1 Iter 41: loss 0.26047. :  18%|████████▍                                     | 41/224 [00:19<01:24,  2.17it/s]
Epoch 1 Iter 42: loss 0.23520. :  18%|████████▍                                     | 41/224 [00:19<01:24,  2.17it/s]
Epoch 1 Iter 42: loss 0.23520. :  19%|████████▋                                     | 42/224 [00:19<01:23,  2.18it/s]
Epoch 1 Iter 43: loss 0.23269. :  19%|████████▋                                     | 42/224 [00:19<01:23,  2.18it/s]
Epoch 1 Iter 43: loss 0.23269. :  19%|████████▊                                     | 43/224 [00:19<01:23,  2.16it/s]
Epoch 1 Iter 44: loss 0.21974. :  19%|████████▊                                     | 43/224 [00:20<01:23,  2.16it/s]
Epoch 1 Iter 44: loss 0.21974. :  20%|█████████                                     | 44/224 [00:20<01:22,  2.18it/s]
Epoch 1 Iter 45: loss 0.24892. :  20%|█████████                                     | 44/224 [00:20<01:22,  2.18it/s]
Epoch 1 Iter 45: loss 0.24892. :  20%|█████████▏                                    | 45/224 [00:20<01:22,  2.16it/s]
Epoch 1 Iter 46: loss 0.24252. :  20%|█████████▏                                    | 45/224 [00:21<01:22,  2.16it/s]
Epoch 1 Iter 46: loss 0.24252. :  21%|█████████▍                                    | 46/224 [00:21<01:22,  2.16it/s]
Epoch 1 Iter 47: loss 0.23295. :  21%|█████████▍                                    | 46/224 [00:21<01:22,  2.16it/s]
Epoch 1 Iter 47: loss 0.23295. :  21%|█████████▋                                    | 47/224 [00:21<01:22,  2.15it/s]
Epoch 1 Iter 48: loss 0.23201. :  21%|█████████▋                                    | 47/224 [00:22<01:22,  2.15it/s]
Epoch 1 Iter 48: loss 0.23201. :  21%|█████████▊                                    | 48/224 [00:22<01:22,  2.13it/s]
Epoch 1 Iter 49: loss 0.22305. :  21%|█████████▊                                    | 48/224 [00:22<01:22,  2.13it/s]
Epoch 1 Iter 49: loss 0.22305. :  22%|██████████                                    | 49/224 [00:22<01:22,  2.12it/s]
Epoch 1 Iter 50: loss 0.22660. :  22%|██████████                                    | 49/224 [00:23<01:22,  2.12it/s]
Epoch 1 Iter 50: loss 0.22660. :  22%|██████████▎                                   | 50/224 [00:23<01:21,  2.13it/s]
Epoch 1 Iter 51: loss 0.22830. :  22%|██████████▎                                   | 50/224 [00:23<01:21,  2.13it/s]
Epoch 1 Iter 51: loss 0.22830. :  23%|██████████▍                                   | 51/224 [00:23<01:20,  2.15it/s]
Epoch 1 Iter 52: loss 0.25102. :  23%|██████████▍                                   | 51/224 [00:24<01:20,  2.15it/s]
Epoch 1 Iter 52: loss 0.25102. :  23%|██████████▋                                   | 52/224 [00:24<01:19,  2.16it/s]
Epoch 1 Iter 53: loss 0.23988. :  23%|██████████▋                                   | 52/224 [00:24<01:19,  2.16it/s]
Epoch 1 Iter 53: loss 0.23988. :  24%|██████████▉                                   | 53/224 [00:24<01:20,  2.14it/s]
Epoch 1 Iter 54: loss 0.23686. :  24%|██████████▉                                   | 53/224 [00:25<01:20,  2.14it/s]
Epoch 1 Iter 54: loss 0.23686. :  24%|███████████                                   | 54/224 [00:25<01:20,  2.12it/s]
Epoch 1 Iter 55: loss 0.22696. :  24%|███████████                                   | 54/224 [00:25<01:20,  2.12it/s]
Epoch 1 Iter 55: loss 0.22696. :  25%|███████████▎                                  | 55/224 [00:25<01:19,  2.11it/s]
Epoch 1 Iter 56: loss 0.23271. :  25%|███████████▎                                  | 55/224 [00:26<01:19,  2.11it/s]
Epoch 1 Iter 56: loss 0.23271. :  25%|███████████▌                                  | 56/224 [00:26<01:21,  2.06it/s]
Epoch 1 Iter 57: loss 0.23510. :  25%|███████████▌                                  | 56/224 [00:26<01:21,  2.06it/s]
Epoch 1 Iter 57: loss 0.23510. :  25%|███████████▋                                  | 57/224 [00:26<01:22,  2.01it/s]
Epoch 1 Iter 58: loss 0.20952. :  25%|███████████▋                                  | 57/224 [00:27<01:22,  2.01it/s]
Epoch 1 Iter 58: loss 0.20952. :  26%|███████████▉                                  | 58/224 [00:27<01:22,  2.01it/s]
Epoch 1 Iter 59: loss 0.20531. :  26%|███████████▉                                  | 58/224 [00:27<01:22,  2.01it/s]
Epoch 1 Iter 59: loss 0.20531. :  26%|████████████                                  | 59/224 [00:27<01:20,  2.04it/s]
Epoch 1 Iter 60: loss 0.21145. :  26%|████████████                                  | 59/224 [00:28<01:20,  2.04it/s]
Epoch 1 Iter 60: loss 0.21145. :  27%|████████████▎                                 | 60/224 [00:28<01:20,  2.04it/s]
Epoch 1 Iter 61: loss 0.23013. :  27%|████████████▎                                 | 60/224 [00:28<01:20,  2.04it/s]
Epoch 1 Iter 61: loss 0.23013. :  27%|████████████▌                                 | 61/224 [00:28<01:19,  2.06it/s]
Epoch 1 Iter 62: loss 0.21752. :  27%|████████████▌                                 | 61/224 [00:29<01:19,  2.06it/s]
Epoch 1 Iter 62: loss 0.21752. :  28%|████████████▋                                 | 62/224 [00:29<01:18,  2.07it/s]
Epoch 1 Iter 63: loss 0.23088. :  28%|████████████▋                                 | 62/224 [00:29<01:18,  2.07it/s]
Epoch 1 Iter 63: loss 0.23088. :  28%|████████████▉                                 | 63/224 [00:29<01:17,  2.09it/s]
Epoch 1 Iter 64: loss 0.22973. :  28%|████████████▉                                 | 63/224 [00:29<01:17,  2.09it/s]
Epoch 1 Iter 64: loss 0.22973. :  29%|█████████████▏                                | 64/224 [00:29<01:16,  2.10it/s]
Epoch 1 Iter 65: loss 0.23446. :  29%|█████████████▏                                | 64/224 [00:30<01:16,  2.10it/s]
Epoch 1 Iter 65: loss 0.23446. :  29%|█████████████▎                                | 65/224 [00:30<01:15,  2.09it/s]
Epoch 1 Iter 66: loss 0.22326. :  29%|█████████████▎                                | 65/224 [00:30<01:15,  2.09it/s]
Epoch 1 Iter 66: loss 0.22326. :  29%|█████████████▌                                | 66/224 [00:30<01:15,  2.10it/s]
Epoch 1 Iter 67: loss 0.23720. :  29%|█████████████▌                                | 66/224 [00:31<01:15,  2.10it/s]
Epoch 1 Iter 67: loss 0.23720. :  30%|█████████████▊                                | 67/224 [00:31<01:15,  2.08it/s]
Epoch 1 Iter 68: loss 0.21674. :  30%|█████████████▊                                | 67/224 [00:31<01:15,  2.08it/s]
Epoch 1 Iter 68: loss 0.21674. :  30%|█████████████▉                                | 68/224 [00:31<01:14,  2.09it/s]
Epoch 1 Iter 69: loss 0.21360. :  30%|█████████████▉                                | 68/224 [00:32<01:14,  2.09it/s]
Epoch 1 Iter 69: loss 0.21360. :  31%|██████████████▏                               | 69/224 [00:32<01:14,  2.08it/s]
Epoch 1 Iter 70: loss 0.22567. :  31%|██████████████▏                               | 69/224 [00:32<01:14,  2.08it/s]
Epoch 1 Iter 70: loss 0.22567. :  31%|██████████████▍                               | 70/224 [00:32<01:13,  2.09it/s]
Epoch 1 Iter 71: loss 0.23489. :  31%|██████████████▍                               | 70/224 [00:33<01:13,  2.09it/s]
Epoch 1 Iter 71: loss 0.23489. :  32%|██████████████▌                               | 71/224 [00:33<01:13,  2.09it/s]
Epoch 1 Iter 72: loss 0.19996. :  32%|██████████████▌                               | 71/224 [00:33<01:13,  2.09it/s]
Epoch 1 Iter 72: loss 0.19996. :  32%|██████████████▊                               | 72/224 [00:33<01:12,  2.10it/s]
Epoch 1 Iter 73: loss 0.20717. :  32%|██████████████▊                               | 72/224 [00:34<01:12,  2.10it/s]
Epoch 1 Iter 73: loss 0.20717. :  33%|██████████████▉                               | 73/224 [00:34<01:12,  2.09it/s]
Epoch 1 Iter 74: loss 0.20901. :  33%|██████████████▉                               | 73/224 [00:34<01:12,  2.09it/s]
Epoch 1 Iter 74: loss 0.20901. :  33%|███████████████▏                              | 74/224 [00:34<01:10,  2.11it/s]
Epoch 1 Iter 75: loss 0.22581. :  33%|███████████████▏                              | 74/224 [00:35<01:10,  2.11it/s]
Epoch 1 Iter 75: loss 0.22581. :  33%|███████████████▍                              | 75/224 [00:35<01:14,  2.01it/s]
Epoch 1 Iter 76: loss 0.21242. :  33%|███████████████▍                              | 75/224 [00:35<01:14,  2.01it/s]
Epoch 1 Iter 76: loss 0.21242. :  34%|███████████████▌                              | 76/224 [00:35<01:14,  1.98it/s]
Epoch 1 Iter 77: loss 0.20860. :  34%|███████████████▌                              | 76/224 [00:36<01:14,  1.98it/s]
Epoch 1 Iter 77: loss 0.20860. :  34%|███████████████▊                              | 77/224 [00:36<01:13,  1.99it/s]
Epoch 1 Iter 78: loss 0.22061. :  34%|███████████████▊                              | 77/224 [00:36<01:13,  1.99it/s]
Epoch 1 Iter 78: loss 0.22061. :  35%|████████████████                              | 78/224 [00:36<01:13,  1.99it/s]
Epoch 1 Iter 79: loss 0.23857. :  35%|████████████████                              | 78/224 [00:37<01:13,  1.99it/s]
Epoch 1 Iter 79: loss 0.23857. :  35%|████████████████▏                             | 79/224 [00:37<01:12,  2.00it/s]
Epoch 1 Iter 80: loss 0.22929. :  35%|████████████████▏                             | 79/224 [00:37<01:12,  2.00it/s]
Epoch 1 Iter 80: loss 0.22929. :  36%|████████████████▍                             | 80/224 [00:37<01:12,  1.99it/s]
Epoch 1 Iter 81: loss 0.21358. :  36%|████████████████▍                             | 80/224 [00:38<01:12,  1.99it/s]
Epoch 1 Iter 81: loss 0.21358. :  36%|████████████████▋                             | 81/224 [00:38<01:10,  2.02it/s]
Epoch 1 Iter 82: loss 0.22549. :  36%|████████████████▋                             | 81/224 [00:38<01:10,  2.02it/s]
Epoch 1 Iter 82: loss 0.22549. :  37%|████████████████▊                             | 82/224 [00:38<01:09,  2.03it/s]
Epoch 1 Iter 83: loss 0.19581. :  37%|████████████████▊                             | 82/224 [00:39<01:09,  2.03it/s]
Epoch 1 Iter 83: loss 0.19581. :  37%|█████████████████                             | 83/224 [00:39<01:08,  2.06it/s]
Epoch 1 Iter 84: loss 0.21687. :  37%|█████████████████                             | 83/224 [00:39<01:08,  2.06it/s]
Epoch 1 Iter 84: loss 0.21687. :  38%|█████████████████▎                            | 84/224 [00:39<01:08,  2.06it/s]
Epoch 1 Iter 85: loss 0.21324. :  38%|█████████████████▎                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 1 Iter 85: loss 0.21324. :  38%|█████████████████▍                            | 85/224 [00:40<01:08,  2.03it/s]
Epoch 1 Iter 86: loss 0.21914. :  38%|█████████████████▍                            | 85/224 [00:40<01:08,  2.03it/s]
Epoch 1 Iter 86: loss 0.21914. :  38%|█████████████████▋                            | 86/224 [00:40<01:07,  2.03it/s]
Epoch 1 Iter 87: loss 0.19811. :  38%|█████████████████▋                            | 86/224 [00:41<01:07,  2.03it/s]
Epoch 1 Iter 87: loss 0.19811. :  39%|█████████████████▊                            | 87/224 [00:41<01:06,  2.05it/s]
Epoch 1 Iter 88: loss 0.21693. :  39%|█████████████████▊                            | 87/224 [00:41<01:06,  2.05it/s]
Epoch 1 Iter 88: loss 0.21693. :  39%|██████████████████                            | 88/224 [00:41<01:06,  2.05it/s]
Epoch 1 Iter 89: loss 0.21538. :  39%|██████████████████                            | 88/224 [00:42<01:06,  2.05it/s]
Epoch 1 Iter 89: loss 0.21538. :  40%|██████████████████▎                           | 89/224 [00:42<01:05,  2.06it/s]
Epoch 1 Iter 90: loss 0.19827. :  40%|██████████████████▎                           | 89/224 [00:42<01:05,  2.06it/s]
Epoch 1 Iter 90: loss 0.19827. :  40%|██████████████████▍                           | 90/224 [00:42<01:04,  2.06it/s]
Epoch 1 Iter 91: loss 0.21981. :  40%|██████████████████▍                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 1 Iter 91: loss 0.21981. :  41%|██████████████████▋                           | 91/224 [00:43<01:04,  2.06it/s]
Epoch 1 Iter 92: loss 0.19651. :  41%|██████████████████▋                           | 91/224 [00:43<01:04,  2.06it/s]
Epoch 1 Iter 92: loss 0.19651. :  41%|██████████████████▉                           | 92/224 [00:43<01:04,  2.06it/s]
Epoch 1 Iter 93: loss 0.20687. :  41%|██████████████████▉                           | 92/224 [00:44<01:04,  2.06it/s]
Epoch 1 Iter 93: loss 0.20687. :  42%|███████████████████                           | 93/224 [00:44<01:03,  2.05it/s]
Epoch 1 Iter 94: loss 0.21208. :  42%|███████████████████                           | 93/224 [00:44<01:03,  2.05it/s]
Epoch 1 Iter 94: loss 0.21208. :  42%|███████████████████▎                          | 94/224 [00:44<01:05,  1.99it/s]
Epoch 1 Iter 95: loss 0.18923. :  42%|███████████████████▎                          | 94/224 [00:45<01:05,  1.99it/s]
Epoch 1 Iter 95: loss 0.18923. :  42%|███████████████████▌                          | 95/224 [00:45<01:04,  2.01it/s]
Epoch 1 Iter 96: loss 0.20371. :  42%|███████████████████▌                          | 95/224 [00:45<01:04,  2.01it/s]
Epoch 1 Iter 96: loss 0.20371. :  43%|███████████████████▋                          | 96/224 [00:45<01:03,  2.03it/s]
Epoch 1 Iter 97: loss 0.19592. :  43%|███████████████████▋                          | 96/224 [00:46<01:03,  2.03it/s]
Epoch 1 Iter 97: loss 0.19592. :  43%|███████████████████▉                          | 97/224 [00:46<01:01,  2.05it/s]
Epoch 1 Iter 98: loss 0.20933. :  43%|███████████████████▉                          | 97/224 [00:46<01:01,  2.05it/s]
Epoch 1 Iter 98: loss 0.20933. :  44%|████████████████████▏                         | 98/224 [00:46<01:01,  2.06it/s]
Epoch 1 Iter 99: loss 0.21166. :  44%|████████████████████▏                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 1 Iter 99: loss 0.21166. :  44%|████████████████████▎                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 1 Iter 100: loss 0.18346. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 1 Iter 100: loss 0.18346. :  45%|███████████████████▋                        | 100/224 [00:47<01:00,  2.06it/s]
Epoch 1 Iter 101: loss 0.19678. :  45%|███████████████████▋                        | 100/224 [00:48<01:00,  2.06it/s]
Epoch 1 Iter 101: loss 0.19678. :  45%|███████████████████▊                        | 101/224 [00:48<01:00,  2.05it/s]
Epoch 1 Iter 102: loss 0.18893. :  45%|███████████████████▊                        | 101/224 [00:48<01:00,  2.05it/s]
Epoch 1 Iter 102: loss 0.18893. :  46%|████████████████████                        | 102/224 [00:48<00:59,  2.04it/s]
Epoch 1 Iter 103: loss 0.20074. :  46%|████████████████████                        | 102/224 [00:49<00:59,  2.04it/s]
Epoch 1 Iter 103: loss 0.20074. :  46%|████████████████████▏                       | 103/224 [00:49<00:59,  2.05it/s]
Epoch 1 Iter 104: loss 0.20844. :  46%|████████████████████▏                       | 103/224 [00:49<00:59,  2.05it/s]
Epoch 1 Iter 104: loss 0.20844. :  46%|████████████████████▍                       | 104/224 [00:49<00:58,  2.05it/s]
Epoch 1 Iter 105: loss 0.19574. :  46%|████████████████████▍                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 1 Iter 105: loss 0.19574. :  47%|████████████████████▋                       | 105/224 [00:50<00:57,  2.05it/s]
Epoch 1 Iter 106: loss 0.20140. :  47%|████████████████████▋                       | 105/224 [00:50<00:57,  2.05it/s]
Epoch 1 Iter 106: loss 0.20140. :  47%|████████████████████▊                       | 106/224 [00:50<00:57,  2.05it/s]
Epoch 1 Iter 107: loss 0.21464. :  47%|████████████████████▊                       | 106/224 [00:51<00:57,  2.05it/s]
Epoch 1 Iter 107: loss 0.21464. :  48%|█████████████████████                       | 107/224 [00:51<00:56,  2.05it/s]
Epoch 1 Iter 108: loss 0.18285. :  48%|█████████████████████                       | 107/224 [00:51<00:56,  2.05it/s]
Epoch 1 Iter 108: loss 0.18285. :  48%|█████████████████████▏                      | 108/224 [00:51<00:56,  2.06it/s]
Epoch 1 Iter 109: loss 0.18586. :  48%|█████████████████████▏                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 1 Iter 109: loss 0.18586. :  49%|█████████████████████▍                      | 109/224 [00:52<00:57,  1.99it/s]
Epoch 1 Iter 110: loss 0.20164. :  49%|█████████████████████▍                      | 109/224 [00:52<00:57,  1.99it/s]
Epoch 1 Iter 110: loss 0.20164. :  49%|█████████████████████▌                      | 110/224 [00:52<00:56,  2.02it/s]
Epoch 1 Iter 111: loss 0.17795. :  49%|█████████████████████▌                      | 110/224 [00:52<00:56,  2.02it/s]
Epoch 1 Iter 111: loss 0.17795. :  50%|█████████████████████▊                      | 111/224 [00:52<00:54,  2.06it/s]
Epoch 1 Iter 112: loss 0.19169. :  50%|█████████████████████▊                      | 111/224 [00:53<00:54,  2.06it/s]
Epoch 1 Iter 112: loss 0.19169. :  50%|██████████████████████                      | 112/224 [00:53<00:53,  2.08it/s]
Epoch 1 Iter 113: loss 0.21105. :  50%|██████████████████████                      | 112/224 [00:53<00:53,  2.08it/s]
Epoch 1 Iter 113: loss 0.21105. :  50%|██████████████████████▏                     | 113/224 [00:53<00:53,  2.09it/s]
Epoch 1 Iter 114: loss 0.20878. :  50%|██████████████████████▏                     | 113/224 [00:54<00:53,  2.09it/s]
Epoch 1 Iter 114: loss 0.20878. :  51%|██████████████████████▍                     | 114/224 [00:54<00:52,  2.08it/s]
Epoch 1 Iter 115: loss 0.22275. :  51%|██████████████████████▍                     | 114/224 [00:54<00:52,  2.08it/s]
Epoch 1 Iter 115: loss 0.22275. :  51%|██████████████████████▌                     | 115/224 [00:54<00:52,  2.09it/s]
Epoch 1 Iter 116: loss 0.22361. :  51%|██████████████████████▌                     | 115/224 [00:55<00:52,  2.09it/s]
Epoch 1 Iter 116: loss 0.22361. :  52%|██████████████████████▊                     | 116/224 [00:55<00:51,  2.08it/s]
Epoch 1 Iter 117: loss 0.18746. :  52%|██████████████████████▊                     | 116/224 [00:55<00:51,  2.08it/s]
Epoch 1 Iter 117: loss 0.18746. :  52%|██████████████████████▉                     | 117/224 [00:55<00:51,  2.08it/s]
Epoch 1 Iter 118: loss 0.19740. :  52%|██████████████████████▉                     | 117/224 [00:56<00:51,  2.08it/s]
Epoch 1 Iter 118: loss 0.19740. :  53%|███████████████████████▏                    | 118/224 [00:56<00:51,  2.08it/s]
Epoch 1 Iter 119: loss 0.20343. :  53%|███████████████████████▏                    | 118/224 [00:56<00:51,  2.08it/s]
Epoch 1 Iter 119: loss 0.20343. :  53%|███████████████████████▍                    | 119/224 [00:56<00:50,  2.07it/s]
Epoch 1 Iter 120: loss 0.18404. :  53%|███████████████████████▍                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 1 Iter 120: loss 0.18404. :  54%|███████████████████████▌                    | 120/224 [00:57<00:50,  2.06it/s]
Epoch 1 Iter 121: loss 0.19128. :  54%|███████████████████████▌                    | 120/224 [00:57<00:50,  2.06it/s]
Epoch 1 Iter 121: loss 0.19128. :  54%|███████████████████████▊                    | 121/224 [00:57<00:49,  2.07it/s]
Epoch 1 Iter 122: loss 0.19919. :  54%|███████████████████████▊                    | 121/224 [00:58<00:49,  2.07it/s]
Epoch 1 Iter 122: loss 0.19919. :  54%|███████████████████████▉                    | 122/224 [00:58<00:48,  2.09it/s]
Epoch 1 Iter 123: loss 0.18268. :  54%|███████████████████████▉                    | 122/224 [00:58<00:48,  2.09it/s]
Epoch 1 Iter 123: loss 0.18268. :  55%|████████████████████████▏                   | 123/224 [00:58<00:47,  2.11it/s]
Epoch 1 Iter 124: loss 0.20372. :  55%|████████████████████████▏                   | 123/224 [00:59<00:47,  2.11it/s]
Epoch 1 Iter 124: loss 0.20372. :  55%|████████████████████████▎                   | 124/224 [00:59<00:47,  2.12it/s]
Epoch 1 Iter 125: loss 0.20765. :  55%|████████████████████████▎                   | 124/224 [00:59<00:47,  2.12it/s]
Epoch 1 Iter 125: loss 0.20765. :  56%|████████████████████████▌                   | 125/224 [00:59<00:46,  2.14it/s]
Epoch 1 Iter 126: loss 0.18684. :  56%|████████████████████████▌                   | 125/224 [01:00<00:46,  2.14it/s]
Epoch 1 Iter 126: loss 0.18684. :  56%|████████████████████████▊                   | 126/224 [01:00<00:45,  2.14it/s]
Epoch 1 Iter 127: loss 0.19715. :  56%|████████████████████████▊                   | 126/224 [01:00<00:45,  2.14it/s]
Epoch 1 Iter 127: loss 0.19715. :  57%|████████████████████████▉                   | 127/224 [01:00<00:45,  2.15it/s]
Epoch 1 Iter 128: loss 0.20362. :  57%|████████████████████████▉                   | 127/224 [01:01<00:45,  2.15it/s]
Epoch 1 Iter 128: loss 0.20362. :  57%|█████████████████████████▏                  | 128/224 [01:01<00:44,  2.17it/s]
Epoch 1 Iter 129: loss 0.18695. :  57%|█████████████████████████▏                  | 128/224 [01:01<00:44,  2.17it/s]
Epoch 1 Iter 129: loss 0.18695. :  58%|█████████████████████████▎                  | 129/224 [01:01<00:43,  2.17it/s]
Epoch 1 Iter 130: loss 0.18162. :  58%|█████████████████████████▎                  | 129/224 [01:01<00:43,  2.17it/s]
Epoch 1 Iter 130: loss 0.18162. :  58%|█████████████████████████▌                  | 130/224 [01:01<00:43,  2.16it/s]
Epoch 1 Iter 131: loss 0.20743. :  58%|█████████████████████████▌                  | 130/224 [01:02<00:43,  2.16it/s]
Epoch 1 Iter 131: loss 0.20743. :  58%|█████████████████████████▋                  | 131/224 [01:02<00:43,  2.15it/s]
Epoch 1 Iter 132: loss 0.18276. :  58%|█████████████████████████▋                  | 131/224 [01:02<00:43,  2.15it/s]
Epoch 1 Iter 132: loss 0.18276. :  59%|█████████████████████████▉                  | 132/224 [01:02<00:42,  2.16it/s]
Epoch 1 Iter 133: loss 0.20017. :  59%|█████████████████████████▉                  | 132/224 [01:03<00:42,  2.16it/s]
Epoch 1 Iter 133: loss 0.20017. :  59%|██████████████████████████▏                 | 133/224 [01:03<00:41,  2.17it/s]
Epoch 1 Iter 134: loss 0.18736. :  59%|██████████████████████████▏                 | 133/224 [01:03<00:41,  2.17it/s]
Epoch 1 Iter 134: loss 0.18736. :  60%|██████████████████████████▎                 | 134/224 [01:03<00:41,  2.17it/s]
Epoch 1 Iter 135: loss 0.18707. :  60%|██████████████████████████▎                 | 134/224 [01:04<00:41,  2.17it/s]
Epoch 1 Iter 135: loss 0.18707. :  60%|██████████████████████████▌                 | 135/224 [01:04<00:41,  2.16it/s]
Epoch 1 Iter 136: loss 0.18403. :  60%|██████████████████████████▌                 | 135/224 [01:04<00:41,  2.16it/s]
Epoch 1 Iter 136: loss 0.18403. :  61%|██████████████████████████▋                 | 136/224 [01:04<00:40,  2.16it/s]
Epoch 1 Iter 137: loss 0.19946. :  61%|██████████████████████████▋                 | 136/224 [01:05<00:40,  2.16it/s]
Epoch 1 Iter 137: loss 0.19946. :  61%|██████████████████████████▉                 | 137/224 [01:05<00:40,  2.16it/s]
Epoch 1 Iter 138: loss 0.19104. :  61%|██████████████████████████▉                 | 137/224 [01:05<00:40,  2.16it/s]
Epoch 1 Iter 138: loss 0.19104. :  62%|███████████████████████████                 | 138/224 [01:05<00:39,  2.17it/s]
Epoch 1 Iter 139: loss 0.21630. :  62%|███████████████████████████                 | 138/224 [01:06<00:39,  2.17it/s]
Epoch 1 Iter 139: loss 0.21630. :  62%|███████████████████████████▎                | 139/224 [01:06<00:38,  2.18it/s]
Epoch 1 Iter 140: loss 0.19171. :  62%|███████████████████████████▎                | 139/224 [01:06<00:38,  2.18it/s]
Epoch 1 Iter 140: loss 0.19171. :  62%|███████████████████████████▌                | 140/224 [01:06<00:38,  2.17it/s]
Epoch 1 Iter 141: loss 0.20368. :  62%|███████████████████████████▌                | 140/224 [01:07<00:38,  2.17it/s]
Epoch 1 Iter 141: loss 0.20368. :  63%|███████████████████████████▋                | 141/224 [01:07<00:38,  2.17it/s]
Epoch 1 Iter 142: loss 0.17364. :  63%|███████████████████████████▋                | 141/224 [01:07<00:38,  2.17it/s]
Epoch 1 Iter 142: loss 0.17364. :  63%|███████████████████████████▉                | 142/224 [01:07<00:37,  2.18it/s]
Epoch 1 Iter 143: loss 0.20277. :  63%|███████████████████████████▉                | 142/224 [01:07<00:37,  2.18it/s]
Epoch 1 Iter 143: loss 0.20277. :  64%|████████████████████████████                | 143/224 [01:07<00:37,  2.16it/s]
Epoch 1 Iter 144: loss 0.21213. :  64%|████████████████████████████                | 143/224 [01:08<00:37,  2.16it/s]
Epoch 1 Iter 144: loss 0.21213. :  64%|████████████████████████████▎               | 144/224 [01:08<00:37,  2.15it/s]
Epoch 1 Iter 145: loss 0.19284. :  64%|████████████████████████████▎               | 144/224 [01:08<00:37,  2.15it/s]
Epoch 1 Iter 145: loss 0.19284. :  65%|████████████████████████████▍               | 145/224 [01:08<00:36,  2.14it/s]
Epoch 1 Iter 146: loss 0.22170. :  65%|████████████████████████████▍               | 145/224 [01:09<00:36,  2.14it/s]
Epoch 1 Iter 146: loss 0.22170. :  65%|████████████████████████████▋               | 146/224 [01:09<00:36,  2.14it/s]
Epoch 1 Iter 147: loss 0.19057. :  65%|████████████████████████████▋               | 146/224 [01:09<00:36,  2.14it/s]
Epoch 1 Iter 147: loss 0.19057. :  66%|████████████████████████████▉               | 147/224 [01:09<00:35,  2.15it/s]
Epoch 1 Iter 148: loss 0.23659. :  66%|████████████████████████████▉               | 147/224 [01:10<00:35,  2.15it/s]
Epoch 1 Iter 148: loss 0.23659. :  66%|█████████████████████████████               | 148/224 [01:10<00:35,  2.16it/s]
Epoch 1 Iter 149: loss 0.19728. :  66%|█████████████████████████████               | 148/224 [01:10<00:35,  2.16it/s]
Epoch 1 Iter 149: loss 0.19728. :  67%|█████████████████████████████▎              | 149/224 [01:10<00:34,  2.15it/s]
Epoch 1 Iter 150: loss 0.21015. :  67%|█████████████████████████████▎              | 149/224 [01:11<00:34,  2.15it/s]
Epoch 1 Iter 150: loss 0.21015. :  67%|█████████████████████████████▍              | 150/224 [01:11<00:34,  2.16it/s]
Epoch 1 Iter 151: loss 0.21112. :  67%|█████████████████████████████▍              | 150/224 [01:11<00:34,  2.16it/s]
Epoch 1 Iter 151: loss 0.21112. :  67%|█████████████████████████████▋              | 151/224 [01:11<00:33,  2.18it/s]
Epoch 1 Iter 152: loss 0.20427. :  67%|█████████████████████████████▋              | 151/224 [01:12<00:33,  2.18it/s]
Epoch 1 Iter 152: loss 0.20427. :  68%|█████████████████████████████▊              | 152/224 [01:12<00:32,  2.19it/s]
Epoch 1 Iter 153: loss 0.20147. :  68%|█████████████████████████████▊              | 152/224 [01:12<00:32,  2.19it/s]
Epoch 1 Iter 153: loss 0.20147. :  68%|██████████████████████████████              | 153/224 [01:12<00:32,  2.17it/s]
Epoch 1 Iter 154: loss 0.17711. :  68%|██████████████████████████████              | 153/224 [01:13<00:32,  2.17it/s]
Epoch 1 Iter 154: loss 0.17711. :  69%|██████████████████████████████▎             | 154/224 [01:13<00:32,  2.17it/s]
Epoch 1 Iter 155: loss 0.18053. :  69%|██████████████████████████████▎             | 154/224 [01:13<00:32,  2.17it/s]
Epoch 1 Iter 155: loss 0.18053. :  69%|██████████████████████████████▍             | 155/224 [01:13<00:31,  2.18it/s]
Epoch 1 Iter 156: loss 0.19509. :  69%|██████████████████████████████▍             | 155/224 [01:13<00:31,  2.18it/s]
Epoch 1 Iter 156: loss 0.19509. :  70%|██████████████████████████████▋             | 156/224 [01:13<00:31,  2.19it/s]
Epoch 1 Iter 157: loss 0.22434. :  70%|██████████████████████████████▋             | 156/224 [01:14<00:31,  2.19it/s]
Epoch 1 Iter 157: loss 0.22434. :  70%|██████████████████████████████▊             | 157/224 [01:14<00:30,  2.19it/s]
Epoch 1 Iter 158: loss 0.17930. :  70%|██████████████████████████████▊             | 157/224 [01:14<00:30,  2.19it/s]
Epoch 1 Iter 158: loss 0.17930. :  71%|███████████████████████████████             | 158/224 [01:14<00:30,  2.16it/s]
Epoch 1 Iter 159: loss 0.19320. :  71%|███████████████████████████████             | 158/224 [01:15<00:30,  2.16it/s]
Epoch 1 Iter 159: loss 0.19320. :  71%|███████████████████████████████▏            | 159/224 [01:15<00:29,  2.19it/s]
Epoch 1 Iter 160: loss 0.20548. :  71%|███████████████████████████████▏            | 159/224 [01:15<00:29,  2.19it/s]
Epoch 1 Iter 160: loss 0.20548. :  71%|███████████████████████████████▍            | 160/224 [01:15<00:29,  2.19it/s]
Epoch 1 Iter 161: loss 0.17628. :  71%|███████████████████████████████▍            | 160/224 [01:16<00:29,  2.19it/s]
Epoch 1 Iter 161: loss 0.17628. :  72%|███████████████████████████████▋            | 161/224 [01:16<00:28,  2.19it/s]
Epoch 1 Iter 162: loss 0.19150. :  72%|███████████████████████████████▋            | 161/224 [01:16<00:28,  2.19it/s]
Epoch 1 Iter 162: loss 0.19150. :  72%|███████████████████████████████▊            | 162/224 [01:16<00:28,  2.17it/s]
Epoch 1 Iter 163: loss 0.17453. :  72%|███████████████████████████████▊            | 162/224 [01:17<00:28,  2.17it/s]
Epoch 1 Iter 163: loss 0.17453. :  73%|████████████████████████████████            | 163/224 [01:17<00:28,  2.17it/s]
Epoch 1 Iter 164: loss 0.19591. :  73%|████████████████████████████████            | 163/224 [01:17<00:28,  2.17it/s]
Epoch 1 Iter 164: loss 0.19591. :  73%|████████████████████████████████▏           | 164/224 [01:17<00:27,  2.19it/s]
Epoch 1 Iter 165: loss 0.19185. :  73%|████████████████████████████████▏           | 164/224 [01:18<00:27,  2.19it/s]
Epoch 1 Iter 165: loss 0.19185. :  74%|████████████████████████████████▍           | 165/224 [01:18<00:26,  2.19it/s]
Epoch 1 Iter 166: loss 0.20122. :  74%|████████████████████████████████▍           | 165/224 [01:18<00:26,  2.19it/s]
Epoch 1 Iter 166: loss 0.20122. :  74%|████████████████████████████████▌           | 166/224 [01:18<00:26,  2.19it/s]
Epoch 1 Iter 167: loss 0.20465. :  74%|████████████████████████████████▌           | 166/224 [01:18<00:26,  2.19it/s]
Epoch 1 Iter 167: loss 0.20465. :  75%|████████████████████████████████▊           | 167/224 [01:18<00:26,  2.17it/s]
Epoch 1 Iter 168: loss 0.20348. :  75%|████████████████████████████████▊           | 167/224 [01:19<00:26,  2.17it/s]
Epoch 1 Iter 168: loss 0.20348. :  75%|█████████████████████████████████           | 168/224 [01:19<00:25,  2.19it/s]
Epoch 1 Iter 169: loss 0.18630. :  75%|█████████████████████████████████           | 168/224 [01:19<00:25,  2.19it/s]
Epoch 1 Iter 169: loss 0.18630. :  75%|█████████████████████████████████▏          | 169/224 [01:19<00:25,  2.20it/s]
Epoch 1 Iter 170: loss 0.22256. :  75%|█████████████████████████████████▏          | 169/224 [01:20<00:25,  2.20it/s]
Epoch 1 Iter 170: loss 0.22256. :  76%|█████████████████████████████████▍          | 170/224 [01:20<00:24,  2.20it/s]
Epoch 1 Iter 171: loss 0.22553. :  76%|█████████████████████████████████▍          | 170/224 [01:20<00:24,  2.20it/s]
Epoch 1 Iter 171: loss 0.22553. :  76%|█████████████████████████████████▌          | 171/224 [01:20<00:24,  2.19it/s]
Epoch 1 Iter 172: loss 0.18776. :  76%|█████████████████████████████████▌          | 171/224 [01:21<00:24,  2.19it/s]
Epoch 1 Iter 172: loss 0.18776. :  77%|█████████████████████████████████▊          | 172/224 [01:21<00:23,  2.18it/s]
Epoch 1 Iter 173: loss 0.19989. :  77%|█████████████████████████████████▊          | 172/224 [01:21<00:23,  2.18it/s]
Epoch 1 Iter 173: loss 0.19989. :  77%|█████████████████████████████████▉          | 173/224 [01:21<00:23,  2.17it/s]
Epoch 1 Iter 174: loss 0.19494. :  77%|█████████████████████████████████▉          | 173/224 [01:22<00:23,  2.17it/s]
Epoch 1 Iter 174: loss 0.19494. :  78%|██████████████████████████████████▏         | 174/224 [01:22<00:23,  2.17it/s]
Epoch 1 Iter 175: loss 0.18064. :  78%|██████████████████████████████████▏         | 174/224 [01:22<00:23,  2.17it/s]
Epoch 1 Iter 175: loss 0.18064. :  78%|██████████████████████████████████▍         | 175/224 [01:22<00:22,  2.18it/s]
Epoch 1 Iter 176: loss 0.18874. :  78%|██████████████████████████████████▍         | 175/224 [01:23<00:22,  2.18it/s]
Epoch 1 Iter 176: loss 0.18874. :  79%|██████████████████████████████████▌         | 176/224 [01:23<00:22,  2.15it/s]
Epoch 1 Iter 177: loss 0.19006. :  79%|██████████████████████████████████▌         | 176/224 [01:23<00:22,  2.15it/s]
Epoch 1 Iter 177: loss 0.19006. :  79%|██████████████████████████████████▊         | 177/224 [01:23<00:21,  2.17it/s]
Epoch 1 Iter 178: loss 0.19488. :  79%|██████████████████████████████████▊         | 177/224 [01:24<00:21,  2.17it/s]
Epoch 1 Iter 178: loss 0.19488. :  79%|██████████████████████████████████▉         | 178/224 [01:24<00:21,  2.17it/s]
Epoch 1 Iter 179: loss 0.20191. :  79%|██████████████████████████████████▉         | 178/224 [01:24<00:21,  2.17it/s]
Epoch 1 Iter 179: loss 0.20191. :  80%|███████████████████████████████████▏        | 179/224 [01:24<00:20,  2.17it/s]
Epoch 1 Iter 180: loss 0.19788. :  80%|███████████████████████████████████▏        | 179/224 [01:24<00:20,  2.17it/s]
Epoch 1 Iter 180: loss 0.19788. :  80%|███████████████████████████████████▎        | 180/224 [01:24<00:20,  2.17it/s]
Epoch 1 Iter 181: loss 0.21183. :  80%|███████████████████████████████████▎        | 180/224 [01:25<00:20,  2.17it/s]
Epoch 1 Iter 181: loss 0.21183. :  81%|███████████████████████████████████▌        | 181/224 [01:25<00:19,  2.16it/s]
Epoch 1 Iter 182: loss 0.20684. :  81%|███████████████████████████████████▌        | 181/224 [01:25<00:19,  2.16it/s]
Epoch 1 Iter 182: loss 0.20684. :  81%|███████████████████████████████████▊        | 182/224 [01:25<00:19,  2.18it/s]
Epoch 1 Iter 183: loss 0.19566. :  81%|███████████████████████████████████▊        | 182/224 [01:26<00:19,  2.18it/s]
Epoch 1 Iter 183: loss 0.19566. :  82%|███████████████████████████████████▉        | 183/224 [01:26<00:18,  2.18it/s]
Epoch 1 Iter 184: loss 0.18434. :  82%|███████████████████████████████████▉        | 183/224 [01:26<00:18,  2.18it/s]
Epoch 1 Iter 184: loss 0.18434. :  82%|████████████████████████████████████▏       | 184/224 [01:26<00:18,  2.19it/s]
Epoch 1 Iter 185: loss 0.18224. :  82%|████████████████████████████████████▏       | 184/224 [01:27<00:18,  2.19it/s]
Epoch 1 Iter 185: loss 0.18224. :  83%|████████████████████████████████████▎       | 185/224 [01:27<00:17,  2.17it/s]
Epoch 1 Iter 186: loss 0.19795. :  83%|████████████████████████████████████▎       | 185/224 [01:27<00:17,  2.17it/s]
Epoch 1 Iter 186: loss 0.19795. :  83%|████████████████████████████████████▌       | 186/224 [01:27<00:17,  2.17it/s]
Epoch 1 Iter 187: loss 0.18501. :  83%|████████████████████████████████████▌       | 186/224 [01:28<00:17,  2.17it/s]
Epoch 1 Iter 187: loss 0.18501. :  83%|████████████████████████████████████▋       | 187/224 [01:28<00:17,  2.18it/s]
Epoch 1 Iter 188: loss 0.20239. :  83%|████████████████████████████████████▋       | 187/224 [01:28<00:17,  2.18it/s]
Epoch 1 Iter 188: loss 0.20239. :  84%|████████████████████████████████████▉       | 188/224 [01:28<00:16,  2.18it/s]
Epoch 1 Iter 189: loss 0.19676. :  84%|████████████████████████████████████▉       | 188/224 [01:29<00:16,  2.18it/s]
Epoch 1 Iter 189: loss 0.19676. :  84%|█████████████████████████████████████▏      | 189/224 [01:29<00:16,  2.18it/s]
Epoch 1 Iter 190: loss 0.16336. :  84%|█████████████████████████████████████▏      | 189/224 [01:29<00:16,  2.18it/s]
Epoch 1 Iter 190: loss 0.16336. :  85%|█████████████████████████████████████▎      | 190/224 [01:29<00:15,  2.16it/s]
Epoch 1 Iter 191: loss 0.19429. :  85%|█████████████████████████████████████▎      | 190/224 [01:30<00:15,  2.16it/s]
Epoch 1 Iter 191: loss 0.19429. :  85%|█████████████████████████████████████▌      | 191/224 [01:30<00:15,  2.17it/s]
Epoch 1 Iter 192: loss 0.17654. :  85%|█████████████████████████████████████▌      | 191/224 [01:30<00:15,  2.17it/s]
Epoch 1 Iter 192: loss 0.17654. :  86%|█████████████████████████████████████▋      | 192/224 [01:30<00:14,  2.17it/s]
Epoch 1 Iter 193: loss 0.18154. :  86%|█████████████████████████████████████▋      | 192/224 [01:30<00:14,  2.17it/s]
Epoch 1 Iter 193: loss 0.18154. :  86%|█████████████████████████████████████▉      | 193/224 [01:30<00:14,  2.18it/s]
Epoch 1 Iter 194: loss 0.19010. :  86%|█████████████████████████████████████▉      | 193/224 [01:31<00:14,  2.18it/s]
Epoch 1 Iter 194: loss 0.19010. :  87%|██████████████████████████████████████      | 194/224 [01:31<00:13,  2.17it/s]
Epoch 1 Iter 195: loss 0.18907. :  87%|██████████████████████████████████████      | 194/224 [01:31<00:13,  2.17it/s]
Epoch 1 Iter 195: loss 0.18907. :  87%|██████████████████████████████████████▎     | 195/224 [01:31<00:13,  2.17it/s]
Epoch 1 Iter 196: loss 0.18402. :  87%|██████████████████████████████████████▎     | 195/224 [01:32<00:13,  2.17it/s]
Epoch 1 Iter 196: loss 0.18402. :  88%|██████████████████████████████████████▌     | 196/224 [01:32<00:12,  2.20it/s]
Epoch 1 Iter 197: loss 0.20829. :  88%|██████████████████████████████████████▌     | 196/224 [01:32<00:12,  2.20it/s]
Epoch 1 Iter 197: loss 0.20829. :  88%|██████████████████████████████████████▋     | 197/224 [01:32<00:12,  2.20it/s]
Epoch 1 Iter 198: loss 0.20911. :  88%|██████████████████████████████████████▋     | 197/224 [01:33<00:12,  2.20it/s]
Epoch 1 Iter 198: loss 0.20911. :  88%|██████████████████████████████████████▉     | 198/224 [01:33<00:11,  2.21it/s]
Epoch 1 Iter 199: loss 0.18375. :  88%|██████████████████████████████████████▉     | 198/224 [01:33<00:11,  2.21it/s]
Epoch 1 Iter 199: loss 0.18375. :  89%|███████████████████████████████████████     | 199/224 [01:33<00:11,  2.19it/s]
Epoch 1 Iter 200: loss 0.20395. :  89%|███████████████████████████████████████     | 199/224 [01:34<00:11,  2.19it/s]
Epoch 1 Iter 200: loss 0.20395. :  89%|███████████████████████████████████████▎    | 200/224 [01:34<00:10,  2.20it/s]
Epoch 1 Iter 201: loss 0.17395. :  89%|███████████████████████████████████████▎    | 200/224 [01:34<00:10,  2.20it/s]
Epoch 1 Iter 201: loss 0.17395. :  90%|███████████████████████████████████████▍    | 201/224 [01:34<00:10,  2.19it/s]
Epoch 1 Iter 202: loss 0.22612. :  90%|███████████████████████████████████████▍    | 201/224 [01:35<00:10,  2.19it/s]
Epoch 1 Iter 202: loss 0.22612. :  90%|███████████████████████████████████████▋    | 202/224 [01:35<00:09,  2.20it/s]
Epoch 1 Iter 203: loss 0.19392. :  90%|███████████████████████████████████████▋    | 202/224 [01:35<00:09,  2.20it/s]
Epoch 1 Iter 203: loss 0.19392. :  91%|███████████████████████████████████████▉    | 203/224 [01:35<00:09,  2.19it/s]
Epoch 1 Iter 204: loss 0.18914. :  91%|███████████████████████████████████████▉    | 203/224 [01:35<00:09,  2.19it/s]
Epoch 1 Iter 204: loss 0.18914. :  91%|████████████████████████████████████████    | 204/224 [01:35<00:09,  2.19it/s]
Epoch 1 Iter 205: loss 0.17896. :  91%|████████████████████████████████████████    | 204/224 [01:36<00:09,  2.19it/s]
Epoch 1 Iter 205: loss 0.17896. :  92%|████████████████████████████████████████▎   | 205/224 [01:36<00:08,  2.16it/s]
Epoch 1 Iter 206: loss 0.19486. :  92%|████████████████████████████████████████▎   | 205/224 [01:36<00:08,  2.16it/s]
Epoch 1 Iter 206: loss 0.19486. :  92%|████████████████████████████████████████▍   | 206/224 [01:36<00:08,  2.16it/s]
Epoch 1 Iter 207: loss 0.18820. :  92%|████████████████████████████████████████▍   | 206/224 [01:37<00:08,  2.16it/s]
Epoch 1 Iter 207: loss 0.18820. :  92%|████████████████████████████████████████▋   | 207/224 [01:37<00:07,  2.18it/s]
Epoch 1 Iter 208: loss 0.18945. :  92%|████████████████████████████████████████▋   | 207/224 [01:37<00:07,  2.18it/s]
Epoch 1 Iter 208: loss 0.18945. :  93%|████████████████████████████████████████▊   | 208/224 [01:37<00:07,  2.16it/s]
Epoch 1 Iter 209: loss 0.19543. :  93%|████████████████████████████████████████▊   | 208/224 [01:38<00:07,  2.16it/s]
Epoch 1 Iter 209: loss 0.19543. :  93%|█████████████████████████████████████████   | 209/224 [01:38<00:06,  2.17it/s]
Epoch 1 Iter 210: loss 0.18500. :  93%|█████████████████████████████████████████   | 209/224 [01:38<00:06,  2.17it/s]
Epoch 1 Iter 210: loss 0.18500. :  94%|█████████████████████████████████████████▎  | 210/224 [01:38<00:06,  2.12it/s]
Epoch 1 Iter 211: loss 0.19300. :  94%|█████████████████████████████████████████▎  | 210/224 [01:39<00:06,  2.12it/s]
Epoch 1 Iter 211: loss 0.19300. :  94%|█████████████████████████████████████████▍  | 211/224 [01:39<00:06,  2.14it/s]
Epoch 1 Iter 212: loss 0.19726. :  94%|█████████████████████████████████████████▍  | 211/224 [01:39<00:06,  2.14it/s]
Epoch 1 Iter 212: loss 0.19726. :  95%|█████████████████████████████████████████▋  | 212/224 [01:39<00:05,  2.13it/s]
Epoch 1 Iter 213: loss 0.20341. :  95%|█████████████████████████████████████████▋  | 212/224 [01:40<00:05,  2.13it/s]
Epoch 1 Iter 213: loss 0.20341. :  95%|█████████████████████████████████████████▊  | 213/224 [01:40<00:05,  2.14it/s]
Epoch 1 Iter 214: loss 0.18626. :  95%|█████████████████████████████████████████▊  | 213/224 [01:40<00:05,  2.14it/s]
Epoch 1 Iter 214: loss 0.18626. :  96%|██████████████████████████████████████████  | 214/224 [01:40<00:04,  2.17it/s]
Epoch 1 Iter 215: loss 0.17579. :  96%|██████████████████████████████████████████  | 214/224 [01:41<00:04,  2.17it/s]
Epoch 1 Iter 215: loss 0.17579. :  96%|██████████████████████████████████████████▏ | 215/224 [01:41<00:04,  2.18it/s]
Epoch 1 Iter 216: loss 0.19914. :  96%|██████████████████████████████████████████▏ | 215/224 [01:41<00:04,  2.18it/s]
Epoch 1 Iter 216: loss 0.19914. :  96%|██████████████████████████████████████████▍ | 216/224 [01:41<00:03,  2.17it/s]
Epoch 1 Iter 217: loss 0.18421. :  96%|██████████████████████████████████████████▍ | 216/224 [01:41<00:03,  2.17it/s]
Epoch 1 Iter 217: loss 0.18421. :  97%|██████████████████████████████████████████▋ | 217/224 [01:41<00:03,  2.15it/s]
Epoch 1 Iter 218: loss 0.20574. :  97%|██████████████████████████████████████████▋ | 217/224 [01:42<00:03,  2.15it/s]
Epoch 1 Iter 218: loss 0.20574. :  97%|██████████████████████████████████████████▊ | 218/224 [01:42<00:02,  2.16it/s]
Epoch 1 Iter 219: loss 0.20333. :  97%|██████████████████████████████████████████▊ | 218/224 [01:42<00:02,  2.16it/s]
Epoch 1 Iter 219: loss 0.20333. :  98%|███████████████████████████████████████████ | 219/224 [01:42<00:02,  2.18it/s]
Epoch 1 Iter 220: loss 0.21264. :  98%|███████████████████████████████████████████ | 219/224 [01:43<00:02,  2.18it/s]
Epoch 1 Iter 220: loss 0.21264. :  98%|███████████████████████████████████████████▏| 220/224 [01:43<00:01,  2.19it/s]
Epoch 1 Iter 221: loss 0.18887. :  98%|███████████████████████████████████████████▏| 220/224 [01:43<00:01,  2.19it/s]
Epoch 1 Iter 221: loss 0.18887. :  99%|███████████████████████████████████████████▍| 221/224 [01:43<00:01,  2.19it/s]
Epoch 1 Iter 222: loss 0.17236. :  99%|███████████████████████████████████████████▍| 221/224 [01:44<00:01,  2.19it/s]
Epoch 1 Iter 222: loss 0.17236. :  99%|███████████████████████████████████████████▌| 222/224 [01:44<00:00,  2.14it/s]
Epoch 1 Iter 223: loss 0.17354. :  99%|███████████████████████████████████████████▌| 222/224 [01:44<00:00,  2.14it/s]
Epoch 1 Iter 223: loss 0.17354. : 100%|███████████████████████████████████████████▊| 223/224 [01:44<00:00,  2.15it/s]
Epoch 1 Iter 224: loss 0.19563. : 100%|███████████████████████████████████████████▊| 223/224 [01:45<00:00,  2.15it/s]
Epoch 1 Iter 224: loss 0.19563. : 100%|████████████████████████████████████████████| 224/224 [01:45<00:00,  2.17it/s]
Epoch 1 Iter 224: loss 0.19563. : 100%|████████████████████████████████████████████| 224/224 [01:45<00:00,  2.13it/s]

    Train loss: 0.23174
    Valid loss: 0.59439
       Valid loss recons: 0.59439
       Valid loss KL-D:   0.01889
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.18996. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.18996. :   0%|▏                                               | 1/224 [00:00<01:40,  2.21it/s]
Epoch 2 Iter 2: loss 0.19057. :   0%|▏                                               | 1/224 [00:00<01:40,  2.21it/s]
Epoch 2 Iter 2: loss 0.19057. :   1%|▍                                               | 2/224 [00:00<01:41,  2.19it/s]
Epoch 2 Iter 3: loss 0.18492. :   1%|▍                                               | 2/224 [00:01<01:41,  2.19it/s]
Epoch 2 Iter 3: loss 0.18492. :   1%|▋                                               | 3/224 [00:01<01:42,  2.15it/s]
Epoch 2 Iter 4: loss 0.20280. :   1%|▋                                               | 3/224 [00:01<01:42,  2.15it/s]
Epoch 2 Iter 4: loss 0.20280. :   2%|▊                                               | 4/224 [00:01<01:41,  2.17it/s]
Epoch 2 Iter 5: loss 0.17386. :   2%|▊                                               | 4/224 [00:02<01:41,  2.17it/s]
Epoch 2 Iter 5: loss 0.17386. :   2%|█                                               | 5/224 [00:02<01:40,  2.19it/s]
Epoch 2 Iter 6: loss 0.19480. :   2%|█                                               | 5/224 [00:02<01:40,  2.19it/s]
Epoch 2 Iter 6: loss 0.19480. :   3%|█▎                                              | 6/224 [00:02<01:39,  2.19it/s]
Epoch 2 Iter 7: loss 0.22410. :   3%|█▎                                              | 6/224 [00:03<01:39,  2.19it/s]
Epoch 2 Iter 7: loss 0.22410. :   3%|█▌                                              | 7/224 [00:03<01:40,  2.16it/s]
Epoch 2 Iter 8: loss 0.17885. :   3%|█▌                                              | 7/224 [00:03<01:40,  2.16it/s]
Epoch 2 Iter 8: loss 0.17885. :   4%|█▋                                              | 8/224 [00:03<01:39,  2.16it/s]
Epoch 2 Iter 9: loss 0.20061. :   4%|█▋                                              | 8/224 [00:04<01:39,  2.16it/s]
Epoch 2 Iter 9: loss 0.20061. :   4%|█▉                                              | 9/224 [00:04<01:39,  2.17it/s]
Epoch 2 Iter 10: loss 0.18925. :   4%|█▉                                             | 9/224 [00:04<01:39,  2.17it/s]
Epoch 2 Iter 10: loss 0.18925. :   4%|██                                            | 10/224 [00:04<01:38,  2.17it/s]
Epoch 2 Iter 11: loss 0.18031. :   4%|██                                            | 10/224 [00:05<01:38,  2.17it/s]
Epoch 2 Iter 11: loss 0.18031. :   5%|██▎                                           | 11/224 [00:05<01:37,  2.18it/s]
Epoch 2 Iter 12: loss 0.19427. :   5%|██▎                                           | 11/224 [00:05<01:37,  2.18it/s]
Epoch 2 Iter 12: loss 0.19427. :   5%|██▍                                           | 12/224 [00:05<01:37,  2.17it/s]
Epoch 2 Iter 13: loss 0.18621. :   5%|██▍                                           | 12/224 [00:05<01:37,  2.17it/s]
Epoch 2 Iter 13: loss 0.18621. :   6%|██▋                                           | 13/224 [00:05<01:37,  2.17it/s]
Epoch 2 Iter 14: loss 0.18709. :   6%|██▋                                           | 13/224 [00:06<01:37,  2.17it/s]
Epoch 2 Iter 14: loss 0.18709. :   6%|██▉                                           | 14/224 [00:06<01:36,  2.17it/s]
Epoch 2 Iter 15: loss 0.19861. :   6%|██▉                                           | 14/224 [00:06<01:36,  2.17it/s]
Epoch 2 Iter 15: loss 0.19861. :   7%|███                                           | 15/224 [00:06<01:36,  2.17it/s]
Epoch 2 Iter 16: loss 0.20280. :   7%|███                                           | 15/224 [00:07<01:36,  2.17it/s]
Epoch 2 Iter 16: loss 0.20280. :   7%|███▎                                          | 16/224 [00:07<01:36,  2.16it/s]
Epoch 2 Iter 17: loss 0.18856. :   7%|███▎                                          | 16/224 [00:07<01:36,  2.16it/s]
Epoch 2 Iter 17: loss 0.18856. :   8%|███▍                                          | 17/224 [00:07<01:35,  2.16it/s]
Epoch 2 Iter 18: loss 0.18775. :   8%|███▍                                          | 17/224 [00:08<01:35,  2.16it/s]
Epoch 2 Iter 18: loss 0.18775. :   8%|███▋                                          | 18/224 [00:08<01:34,  2.17it/s]
Epoch 2 Iter 19: loss 0.20347. :   8%|███▋                                          | 18/224 [00:08<01:34,  2.17it/s]
Epoch 2 Iter 19: loss 0.20347. :   8%|███▉                                          | 19/224 [00:08<01:34,  2.18it/s]
Epoch 2 Iter 20: loss 0.18499. :   8%|███▉                                          | 19/224 [00:09<01:34,  2.18it/s]
Epoch 2 Iter 20: loss 0.18499. :   9%|████                                          | 20/224 [00:09<01:33,  2.18it/s]
Epoch 2 Iter 21: loss 0.18305. :   9%|████                                          | 20/224 [00:09<01:33,  2.18it/s]
Epoch 2 Iter 21: loss 0.18305. :   9%|████▎                                         | 21/224 [00:09<01:33,  2.17it/s]
Epoch 2 Iter 22: loss 0.17556. :   9%|████▎                                         | 21/224 [00:10<01:33,  2.17it/s]
Epoch 2 Iter 22: loss 0.17556. :  10%|████▌                                         | 22/224 [00:10<01:33,  2.16it/s]
Epoch 2 Iter 23: loss 0.19247. :  10%|████▌                                         | 22/224 [00:10<01:33,  2.16it/s]
Epoch 2 Iter 23: loss 0.19247. :  10%|████▋                                         | 23/224 [00:10<01:32,  2.18it/s]
Epoch 2 Iter 24: loss 0.18265. :  10%|████▋                                         | 23/224 [00:11<01:32,  2.18it/s]
Epoch 2 Iter 24: loss 0.18265. :  11%|████▉                                         | 24/224 [00:11<01:31,  2.18it/s]
Epoch 2 Iter 25: loss 0.20299. :  11%|████▉                                         | 24/224 [00:11<01:31,  2.18it/s]
Epoch 2 Iter 25: loss 0.20299. :  11%|█████▏                                        | 25/224 [00:11<01:31,  2.18it/s]
Epoch 2 Iter 26: loss 0.19658. :  11%|█████▏                                        | 25/224 [00:11<01:31,  2.18it/s]
Epoch 2 Iter 26: loss 0.19658. :  12%|█████▎                                        | 26/224 [00:11<01:31,  2.16it/s]
Epoch 2 Iter 27: loss 0.19339. :  12%|█████▎                                        | 26/224 [00:12<01:31,  2.16it/s]
Epoch 2 Iter 27: loss 0.19339. :  12%|█████▌                                        | 27/224 [00:12<01:30,  2.17it/s]
Epoch 2 Iter 28: loss 0.17543. :  12%|█████▌                                        | 27/224 [00:12<01:30,  2.17it/s]
Epoch 2 Iter 28: loss 0.17543. :  12%|█████▊                                        | 28/224 [00:12<01:30,  2.17it/s]
Epoch 2 Iter 29: loss 0.17764. :  12%|█████▊                                        | 28/224 [00:13<01:30,  2.17it/s]
Epoch 2 Iter 29: loss 0.17764. :  13%|█████▉                                        | 29/224 [00:13<01:29,  2.19it/s]
Epoch 2 Iter 30: loss 0.19529. :  13%|█████▉                                        | 29/224 [00:13<01:29,  2.19it/s]
Epoch 2 Iter 30: loss 0.19529. :  13%|██████▏                                       | 30/224 [00:13<01:29,  2.17it/s]
Epoch 2 Iter 31: loss 0.19572. :  13%|██████▏                                       | 30/224 [00:14<01:29,  2.17it/s]
Epoch 2 Iter 31: loss 0.19572. :  14%|██████▎                                       | 31/224 [00:14<01:28,  2.18it/s]
Epoch 2 Iter 32: loss 0.18216. :  14%|██████▎                                       | 31/224 [00:14<01:28,  2.18it/s]
Epoch 2 Iter 32: loss 0.18216. :  14%|██████▌                                       | 32/224 [00:14<01:28,  2.16it/s]
Epoch 2 Iter 33: loss 0.20785. :  14%|██████▌                                       | 32/224 [00:15<01:28,  2.16it/s]
Epoch 2 Iter 33: loss 0.20785. :  15%|██████▊                                       | 33/224 [00:15<01:29,  2.12it/s]
Epoch 2 Iter 34: loss 0.19665. :  15%|██████▊                                       | 33/224 [00:15<01:29,  2.12it/s]
Epoch 2 Iter 34: loss 0.19665. :  15%|██████▉                                       | 34/224 [00:15<01:30,  2.10it/s]
Epoch 2 Iter 35: loss 0.18559. :  15%|██████▉                                       | 34/224 [00:16<01:30,  2.10it/s]
Epoch 2 Iter 35: loss 0.18559. :  16%|███████▏                                      | 35/224 [00:16<01:34,  1.99it/s]
Epoch 2 Iter 36: loss 0.17730. :  16%|███████▏                                      | 35/224 [00:16<01:34,  1.99it/s]
Epoch 2 Iter 36: loss 0.17730. :  16%|███████▍                                      | 36/224 [00:16<01:33,  2.01it/s]
Epoch 2 Iter 37: loss 0.20724. :  16%|███████▍                                      | 36/224 [00:17<01:33,  2.01it/s]
Epoch 2 Iter 37: loss 0.20724. :  17%|███████▌                                      | 37/224 [00:17<01:31,  2.04it/s]
Epoch 2 Iter 38: loss 0.18805. :  17%|███████▌                                      | 37/224 [00:17<01:31,  2.04it/s]
Epoch 2 Iter 38: loss 0.18805. :  17%|███████▊                                      | 38/224 [00:17<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.16270. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.16270. :  17%|████████                                      | 39/224 [00:18<01:30,  2.04it/s]
Epoch 2 Iter 40: loss 0.19157. :  17%|████████                                      | 39/224 [00:18<01:30,  2.04it/s]
Epoch 2 Iter 40: loss 0.19157. :  18%|████████▏                                     | 40/224 [00:18<01:30,  2.04it/s]
Epoch 2 Iter 41: loss 0.18128. :  18%|████████▏                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 2 Iter 41: loss 0.18128. :  18%|████████▍                                     | 41/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 42: loss 0.18321. :  18%|████████▍                                     | 41/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 42: loss 0.18321. :  19%|████████▋                                     | 42/224 [00:19<01:29,  2.03it/s]
Epoch 2 Iter 43: loss 0.19099. :  19%|████████▋                                     | 42/224 [00:20<01:29,  2.03it/s]
Epoch 2 Iter 43: loss 0.19099. :  19%|████████▊                                     | 43/224 [00:20<01:28,  2.04it/s]
Epoch 2 Iter 44: loss 0.19234. :  19%|████████▊                                     | 43/224 [00:20<01:28,  2.04it/s]
Epoch 2 Iter 44: loss 0.19234. :  20%|█████████                                     | 44/224 [00:20<01:28,  2.04it/s]
Epoch 2 Iter 45: loss 0.17638. :  20%|█████████                                     | 44/224 [00:21<01:28,  2.04it/s]
Epoch 2 Iter 45: loss 0.17638. :  20%|█████████▏                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 2 Iter 46: loss 0.19026. :  20%|█████████▏                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 2 Iter 46: loss 0.19026. :  21%|█████████▍                                    | 46/224 [00:21<01:26,  2.06it/s]
Epoch 2 Iter 47: loss 0.18332. :  21%|█████████▍                                    | 46/224 [00:22<01:26,  2.06it/s]
Epoch 2 Iter 47: loss 0.18332. :  21%|█████████▋                                    | 47/224 [00:22<01:26,  2.04it/s]
Epoch 2 Iter 48: loss 0.18464. :  21%|█████████▋                                    | 47/224 [00:22<01:26,  2.04it/s]
Epoch 2 Iter 48: loss 0.18464. :  21%|█████████▊                                    | 48/224 [00:22<01:26,  2.04it/s]
Epoch 2 Iter 49: loss 0.20093. :  21%|█████████▊                                    | 48/224 [00:23<01:26,  2.04it/s]
Epoch 2 Iter 49: loss 0.20093. :  22%|██████████                                    | 49/224 [00:23<01:25,  2.05it/s]
Epoch 2 Iter 50: loss 0.19880. :  22%|██████████                                    | 49/224 [00:23<01:25,  2.05it/s]
Epoch 2 Iter 50: loss 0.19880. :  22%|██████████▎                                   | 50/224 [00:23<01:24,  2.07it/s]
Epoch 2 Iter 51: loss 0.20649. :  22%|██████████▎                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 2 Iter 51: loss 0.20649. :  23%|██████████▍                                   | 51/224 [00:24<01:23,  2.07it/s]
Epoch 2 Iter 52: loss 0.18576. :  23%|██████████▍                                   | 51/224 [00:24<01:23,  2.07it/s]
Epoch 2 Iter 52: loss 0.18576. :  23%|██████████▋                                   | 52/224 [00:24<01:23,  2.06it/s]
Epoch 2 Iter 53: loss 0.19389. :  23%|██████████▋                                   | 52/224 [00:25<01:23,  2.06it/s]
Epoch 2 Iter 53: loss 0.19389. :  24%|██████████▉                                   | 53/224 [00:25<01:23,  2.06it/s]
Epoch 2 Iter 54: loss 0.18377. :  24%|██████████▉                                   | 53/224 [00:25<01:23,  2.06it/s]
Epoch 2 Iter 54: loss 0.18377. :  24%|███████████                                   | 54/224 [00:25<01:22,  2.06it/s]
Epoch 2 Iter 55: loss 0.19989. :  24%|███████████                                   | 54/224 [00:26<01:22,  2.06it/s]
Epoch 2 Iter 55: loss 0.19989. :  25%|███████████▎                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 2 Iter 56: loss 0.19795. :  25%|███████████▎                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 2 Iter 56: loss 0.19795. :  25%|███████████▌                                  | 56/224 [00:26<01:21,  2.07it/s]
Epoch 2 Iter 57: loss 0.19295. :  25%|███████████▌                                  | 56/224 [00:26<01:21,  2.07it/s]
Epoch 2 Iter 57: loss 0.19295. :  25%|███████████▋                                  | 57/224 [00:26<01:20,  2.07it/s]
Epoch 2 Iter 58: loss 0.21071. :  25%|███████████▋                                  | 57/224 [00:27<01:20,  2.07it/s]
Epoch 2 Iter 58: loss 0.21071. :  26%|███████████▉                                  | 58/224 [00:27<01:20,  2.05it/s]
Epoch 2 Iter 59: loss 0.17949. :  26%|███████████▉                                  | 58/224 [00:27<01:20,  2.05it/s]
Epoch 2 Iter 59: loss 0.17949. :  26%|████████████                                  | 59/224 [00:27<01:19,  2.07it/s]
Epoch 2 Iter 60: loss 0.19012. :  26%|████████████                                  | 59/224 [00:28<01:19,  2.07it/s]
Epoch 2 Iter 60: loss 0.19012. :  27%|████████████▎                                 | 60/224 [00:28<01:18,  2.08it/s]
Epoch 2 Iter 61: loss 0.18971. :  27%|████████████▎                                 | 60/224 [00:28<01:18,  2.08it/s]
Epoch 2 Iter 61: loss 0.18971. :  27%|████████████▌                                 | 61/224 [00:28<01:18,  2.07it/s]
Epoch 2 Iter 62: loss 0.17559. :  27%|████████████▌                                 | 61/224 [00:29<01:18,  2.07it/s]
Epoch 2 Iter 62: loss 0.17559. :  28%|████████████▋                                 | 62/224 [00:29<01:17,  2.08it/s]
Epoch 2 Iter 63: loss 0.18553. :  28%|████████████▋                                 | 62/224 [00:29<01:17,  2.08it/s]
Epoch 2 Iter 63: loss 0.18553. :  28%|████████████▉                                 | 63/224 [00:29<01:16,  2.09it/s]
Epoch 2 Iter 64: loss 0.18785. :  28%|████████████▉                                 | 63/224 [00:30<01:16,  2.09it/s]
Epoch 2 Iter 64: loss 0.18785. :  29%|█████████████▏                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 2 Iter 65: loss 0.18607. :  29%|█████████████▏                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 2 Iter 65: loss 0.18607. :  29%|█████████████▎                                | 65/224 [00:30<01:16,  2.07it/s]
Epoch 2 Iter 66: loss 0.20416. :  29%|█████████████▎                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 2 Iter 66: loss 0.20416. :  29%|█████████████▌                                | 66/224 [00:31<01:16,  2.06it/s]
Epoch 2 Iter 67: loss 0.16651. :  29%|█████████████▌                                | 66/224 [00:31<01:16,  2.06it/s]
Epoch 2 Iter 67: loss 0.16651. :  30%|█████████████▊                                | 67/224 [00:31<01:16,  2.06it/s]
Epoch 2 Iter 68: loss 0.20339. :  30%|█████████████▊                                | 67/224 [00:32<01:16,  2.06it/s]
Epoch 2 Iter 68: loss 0.20339. :  30%|█████████████▉                                | 68/224 [00:32<01:16,  2.04it/s]
Epoch 2 Iter 69: loss 0.18911. :  30%|█████████████▉                                | 68/224 [00:32<01:16,  2.04it/s]
Epoch 2 Iter 69: loss 0.18911. :  31%|██████████████▏                               | 69/224 [00:32<01:15,  2.05it/s]
Epoch 2 Iter 70: loss 0.18359. :  31%|██████████████▏                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 2 Iter 70: loss 0.18359. :  31%|██████████████▍                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 2 Iter 71: loss 0.17640. :  31%|██████████████▍                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 2 Iter 71: loss 0.17640. :  32%|██████████████▌                               | 71/224 [00:33<01:14,  2.05it/s]
Epoch 2 Iter 72: loss 0.17977. :  32%|██████████████▌                               | 71/224 [00:34<01:14,  2.05it/s]
Epoch 2 Iter 72: loss 0.17977. :  32%|██████████████▊                               | 72/224 [00:34<01:14,  2.05it/s]
Epoch 2 Iter 73: loss 0.19838. :  32%|██████████████▊                               | 72/224 [00:34<01:14,  2.05it/s]
Epoch 2 Iter 73: loss 0.19838. :  33%|██████████████▉                               | 73/224 [00:34<01:13,  2.06it/s]
Epoch 2 Iter 74: loss 0.18053. :  33%|██████████████▉                               | 73/224 [00:35<01:13,  2.06it/s]
Epoch 2 Iter 74: loss 0.18053. :  33%|███████████████▏                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 2 Iter 75: loss 0.20346. :  33%|███████████████▏                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 2 Iter 75: loss 0.20346. :  33%|███████████████▍                              | 75/224 [00:35<01:12,  2.06it/s]
Epoch 2 Iter 76: loss 0.19918. :  33%|███████████████▍                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 2 Iter 76: loss 0.19918. :  34%|███████████████▌                              | 76/224 [00:36<01:11,  2.07it/s]
Epoch 2 Iter 77: loss 0.18535. :  34%|███████████████▌                              | 76/224 [00:36<01:11,  2.07it/s]
Epoch 2 Iter 77: loss 0.18535. :  34%|███████████████▊                              | 77/224 [00:36<01:11,  2.07it/s]
Epoch 2 Iter 78: loss 0.17739. :  34%|███████████████▊                              | 77/224 [00:37<01:11,  2.07it/s]
Epoch 2 Iter 78: loss 0.17739. :  35%|████████████████                              | 78/224 [00:37<01:10,  2.07it/s]
Epoch 2 Iter 79: loss 0.18841. :  35%|████████████████                              | 78/224 [00:37<01:10,  2.07it/s]
Epoch 2 Iter 79: loss 0.18841. :  35%|████████████████▏                             | 79/224 [00:37<01:10,  2.05it/s]
Epoch 2 Iter 80: loss 0.18023. :  35%|████████████████▏                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 2 Iter 80: loss 0.18023. :  36%|████████████████▍                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 2 Iter 81: loss 0.18412. :  36%|████████████████▍                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 2 Iter 81: loss 0.18412. :  36%|████████████████▋                             | 81/224 [00:38<01:09,  2.06it/s]
Epoch 2 Iter 82: loss 0.19537. :  36%|████████████████▋                             | 81/224 [00:39<01:09,  2.06it/s]
Epoch 2 Iter 82: loss 0.19537. :  37%|████████████████▊                             | 82/224 [00:39<01:08,  2.07it/s]
Epoch 2 Iter 83: loss 0.18617. :  37%|████████████████▊                             | 82/224 [00:39<01:08,  2.07it/s]
Epoch 2 Iter 83: loss 0.18617. :  37%|█████████████████                             | 83/224 [00:39<01:08,  2.07it/s]
Epoch 2 Iter 84: loss 0.18424. :  37%|█████████████████                             | 83/224 [00:40<01:08,  2.07it/s]
Epoch 2 Iter 84: loss 0.18424. :  38%|█████████████████▎                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 2 Iter 85: loss 0.18560. :  38%|█████████████████▎                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 2 Iter 85: loss 0.18560. :  38%|█████████████████▍                            | 85/224 [00:40<01:07,  2.06it/s]
Epoch 2 Iter 86: loss 0.18087. :  38%|█████████████████▍                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 2 Iter 86: loss 0.18087. :  38%|█████████████████▋                            | 86/224 [00:41<01:07,  2.06it/s]
Epoch 2 Iter 87: loss 0.18987. :  38%|█████████████████▋                            | 86/224 [00:41<01:07,  2.06it/s]
Epoch 2 Iter 87: loss 0.18987. :  39%|█████████████████▊                            | 87/224 [00:41<01:06,  2.05it/s]
Epoch 2 Iter 88: loss 0.19395. :  39%|█████████████████▊                            | 87/224 [00:42<01:06,  2.05it/s]
Epoch 2 Iter 88: loss 0.19395. :  39%|██████████████████                            | 88/224 [00:42<01:06,  2.06it/s]
Epoch 2 Iter 89: loss 0.17171. :  39%|██████████████████                            | 88/224 [00:42<01:06,  2.06it/s]
Epoch 2 Iter 89: loss 0.17171. :  40%|██████████████████▎                           | 89/224 [00:42<01:05,  2.05it/s]
Epoch 2 Iter 90: loss 0.18486. :  40%|██████████████████▎                           | 89/224 [00:42<01:05,  2.05it/s]
Epoch 2 Iter 90: loss 0.18486. :  40%|██████████████████▍                           | 90/224 [00:42<01:05,  2.05it/s]
Epoch 2 Iter 91: loss 0.16487. :  40%|██████████████████▍                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 2 Iter 91: loss 0.16487. :  41%|██████████████████▋                           | 91/224 [00:43<01:04,  2.06it/s]
Epoch 2 Iter 92: loss 0.20079. :  41%|██████████████████▋                           | 91/224 [00:43<01:04,  2.06it/s]
Epoch 2 Iter 92: loss 0.20079. :  41%|██████████████████▉                           | 92/224 [00:43<01:04,  2.05it/s]
Epoch 2 Iter 93: loss 0.20945. :  41%|██████████████████▉                           | 92/224 [00:44<01:04,  2.05it/s]
Epoch 2 Iter 93: loss 0.20945. :  42%|███████████████████                           | 93/224 [00:44<01:03,  2.06it/s]
Epoch 2 Iter 94: loss 0.20087. :  42%|███████████████████                           | 93/224 [00:44<01:03,  2.06it/s]
Epoch 2 Iter 94: loss 0.20087. :  42%|███████████████████▎                          | 94/224 [00:44<01:03,  2.06it/s]
Epoch 2 Iter 95: loss 0.18722. :  42%|███████████████████▎                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 2 Iter 95: loss 0.18722. :  42%|███████████████████▌                          | 95/224 [00:45<01:02,  2.06it/s]
Epoch 2 Iter 96: loss 0.18718. :  42%|███████████████████▌                          | 95/224 [00:45<01:02,  2.06it/s]
Epoch 2 Iter 96: loss 0.18718. :  43%|███████████████████▋                          | 96/224 [00:45<01:01,  2.07it/s]
Epoch 2 Iter 97: loss 0.17191. :  43%|███████████████████▋                          | 96/224 [00:46<01:01,  2.07it/s]
Epoch 2 Iter 97: loss 0.17191. :  43%|███████████████████▉                          | 97/224 [00:46<01:01,  2.08it/s]
Epoch 2 Iter 98: loss 0.17880. :  43%|███████████████████▉                          | 97/224 [00:46<01:01,  2.08it/s]
Epoch 2 Iter 98: loss 0.17880. :  44%|████████████████████▏                         | 98/224 [00:46<01:00,  2.08it/s]
Epoch 2 Iter 99: loss 0.18079. :  44%|████████████████████▏                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 2 Iter 99: loss 0.18079. :  44%|████████████████████▎                         | 99/224 [00:47<01:00,  2.08it/s]
Epoch 2 Iter 100: loss 0.19731. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.08it/s]
Epoch 2 Iter 100: loss 0.19731. :  45%|███████████████████▋                        | 100/224 [00:47<01:00,  2.06it/s]
Epoch 2 Iter 101: loss 0.19777. :  45%|███████████████████▋                        | 100/224 [00:48<01:00,  2.06it/s]
Epoch 2 Iter 101: loss 0.19777. :  45%|███████████████████▊                        | 101/224 [00:48<00:59,  2.06it/s]
Epoch 2 Iter 102: loss 0.17904. :  45%|███████████████████▊                        | 101/224 [00:48<00:59,  2.06it/s]
Epoch 2 Iter 102: loss 0.17904. :  46%|████████████████████                        | 102/224 [00:48<00:59,  2.06it/s]
Epoch 2 Iter 103: loss 0.20172. :  46%|████████████████████                        | 102/224 [00:49<00:59,  2.06it/s]
Epoch 2 Iter 103: loss 0.20172. :  46%|████████████████████▏                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 2 Iter 104: loss 0.18730. :  46%|████████████████████▏                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 2 Iter 104: loss 0.18730. :  46%|████████████████████▍                       | 104/224 [00:49<00:57,  2.08it/s]
Epoch 2 Iter 105: loss 0.20269. :  46%|████████████████████▍                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 2 Iter 105: loss 0.20269. :  47%|████████████████████▋                       | 105/224 [00:50<00:57,  2.06it/s]
Epoch 2 Iter 106: loss 0.18157. :  47%|████████████████████▋                       | 105/224 [00:50<00:57,  2.06it/s]
Epoch 2 Iter 106: loss 0.18157. :  47%|████████████████████▊                       | 106/224 [00:50<00:57,  2.06it/s]
Epoch 2 Iter 107: loss 0.17815. :  47%|████████████████████▊                       | 106/224 [00:51<00:57,  2.06it/s]
Epoch 2 Iter 107: loss 0.17815. :  48%|█████████████████████                       | 107/224 [00:51<00:56,  2.06it/s]
Epoch 2 Iter 108: loss 0.18194. :  48%|█████████████████████                       | 107/224 [00:51<00:56,  2.06it/s]
Epoch 2 Iter 108: loss 0.18194. :  48%|█████████████████████▏                      | 108/224 [00:51<00:56,  2.07it/s]
Epoch 2 Iter 109: loss 0.18056. :  48%|█████████████████████▏                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 2 Iter 109: loss 0.18056. :  49%|█████████████████████▍                      | 109/224 [00:52<00:55,  2.05it/s]
Epoch 2 Iter 110: loss 0.17768. :  49%|█████████████████████▍                      | 109/224 [00:52<00:55,  2.05it/s]
Epoch 2 Iter 110: loss 0.17768. :  49%|█████████████████████▌                      | 110/224 [00:52<00:55,  2.05it/s]
Epoch 2 Iter 111: loss 0.16681. :  49%|█████████████████████▌                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 2 Iter 111: loss 0.16681. :  50%|█████████████████████▊                      | 111/224 [00:53<00:55,  2.04it/s]
Epoch 2 Iter 112: loss 0.22067. :  50%|█████████████████████▊                      | 111/224 [00:53<00:55,  2.04it/s]
Epoch 2 Iter 112: loss 0.22067. :  50%|██████████████████████                      | 112/224 [00:53<00:55,  2.03it/s]
Epoch 2 Iter 113: loss 0.18919. :  50%|██████████████████████                      | 112/224 [00:54<00:55,  2.03it/s]
Epoch 2 Iter 113: loss 0.18919. :  50%|██████████████████████▏                     | 113/224 [00:54<00:55,  2.02it/s]
Epoch 2 Iter 114: loss 0.18081. :  50%|██████████████████████▏                     | 113/224 [00:54<00:55,  2.02it/s]
Epoch 2 Iter 114: loss 0.18081. :  51%|██████████████████████▍                     | 114/224 [00:54<00:55,  1.97it/s]
Epoch 2 Iter 115: loss 0.17746. :  51%|██████████████████████▍                     | 114/224 [00:55<00:55,  1.97it/s]
Epoch 2 Iter 115: loss 0.17746. :  51%|██████████████████████▌                     | 115/224 [00:55<00:54,  1.99it/s]
Epoch 2 Iter 116: loss 0.19759. :  51%|██████████████████████▌                     | 115/224 [00:55<00:54,  1.99it/s]
Epoch 2 Iter 116: loss 0.19759. :  52%|██████████████████████▊                     | 116/224 [00:55<00:54,  2.00it/s]
Epoch 2 Iter 117: loss 0.19015. :  52%|██████████████████████▊                     | 116/224 [00:56<00:54,  2.00it/s]
Epoch 2 Iter 117: loss 0.19015. :  52%|██████████████████████▉                     | 117/224 [00:56<00:53,  2.01it/s]
Epoch 2 Iter 118: loss 0.18622. :  52%|██████████████████████▉                     | 117/224 [00:56<00:53,  2.01it/s]
Epoch 2 Iter 118: loss 0.18622. :  53%|███████████████████████▏                    | 118/224 [00:56<00:52,  2.03it/s]
Epoch 2 Iter 119: loss 0.17482. :  53%|███████████████████████▏                    | 118/224 [00:57<00:52,  2.03it/s]
Epoch 2 Iter 119: loss 0.17482. :  53%|███████████████████████▍                    | 119/224 [00:57<00:51,  2.04it/s]
Epoch 2 Iter 120: loss 0.20535. :  53%|███████████████████████▍                    | 119/224 [00:57<00:51,  2.04it/s]
Epoch 2 Iter 120: loss 0.20535. :  54%|███████████████████████▌                    | 120/224 [00:57<00:50,  2.04it/s]
Epoch 2 Iter 121: loss 0.17091. :  54%|███████████████████████▌                    | 120/224 [00:58<00:50,  2.04it/s]
Epoch 2 Iter 121: loss 0.17091. :  54%|███████████████████████▊                    | 121/224 [00:58<00:50,  2.03it/s]
Epoch 2 Iter 122: loss 0.18536. :  54%|███████████████████████▊                    | 121/224 [00:58<00:50,  2.03it/s]
Epoch 2 Iter 122: loss 0.18536. :  54%|███████████████████████▉                    | 122/224 [00:58<00:52,  1.95it/s]
Epoch 2 Iter 123: loss 0.17459. :  54%|███████████████████████▉                    | 122/224 [00:59<00:52,  1.95it/s]
Epoch 2 Iter 123: loss 0.17459. :  55%|████████████████████████▏                   | 123/224 [00:59<00:53,  1.90it/s]
Epoch 2 Iter 124: loss 0.17117. :  55%|████████████████████████▏                   | 123/224 [01:00<00:53,  1.90it/s]
Epoch 2 Iter 124: loss 0.17117. :  55%|████████████████████████▎                   | 124/224 [01:00<01:04,  1.56it/s]
Epoch 2 Iter 125: loss 0.19611. :  55%|████████████████████████▎                   | 124/224 [01:01<01:04,  1.56it/s]
Epoch 2 Iter 125: loss 0.19611. :  56%|████████████████████████▌                   | 125/224 [01:01<01:21,  1.22it/s]
Epoch 2 Iter 126: loss 0.17279. :  56%|████████████████████████▌                   | 125/224 [01:02<01:21,  1.22it/s]
Epoch 2 Iter 126: loss 0.17279. :  56%|████████████████████████▊                   | 126/224 [01:02<01:30,  1.08it/s]
Epoch 2 Iter 127: loss 0.15731. :  56%|████████████████████████▊                   | 126/224 [01:04<01:30,  1.08it/s]
Epoch 2 Iter 127: loss 0.15731. :  57%|████████████████████████▉                   | 127/224 [01:04<01:54,  1.18s/it]
Epoch 2 Iter 128: loss 0.19589. :  57%|████████████████████████▉                   | 127/224 [01:05<01:54,  1.18s/it]
Epoch 2 Iter 128: loss 0.19589. :  57%|█████████████████████████▏                  | 128/224 [01:05<01:46,  1.11s/it]
Epoch 2 Iter 129: loss 0.17078. :  57%|█████████████████████████▏                  | 128/224 [01:06<01:46,  1.11s/it]
Epoch 2 Iter 129: loss 0.17078. :  58%|█████████████████████████▎                  | 129/224 [01:06<01:37,  1.02s/it]
Epoch 2 Iter 130: loss 0.19192. :  58%|█████████████████████████▎                  | 129/224 [01:07<01:37,  1.02s/it]
Epoch 2 Iter 130: loss 0.19192. :  58%|█████████████████████████▌                  | 130/224 [01:07<01:45,  1.12s/it]
Epoch 2 Iter 131: loss 0.18133. :  58%|█████████████████████████▌                  | 130/224 [01:08<01:45,  1.12s/it]
Epoch 2 Iter 131: loss 0.18133. :  58%|█████████████████████████▋                  | 131/224 [01:08<01:36,  1.04s/it]
Epoch 2 Iter 132: loss 0.17989. :  58%|█████████████████████████▋                  | 131/224 [01:09<01:36,  1.04s/it]
Epoch 2 Iter 132: loss 0.17989. :  59%|█████████████████████████▉                  | 132/224 [01:09<01:33,  1.02s/it]
Epoch 2 Iter 133: loss 0.17090. :  59%|█████████████████████████▉                  | 132/224 [01:10<01:33,  1.02s/it]
Epoch 2 Iter 133: loss 0.17090. :  59%|██████████████████████████▏                 | 133/224 [01:10<01:34,  1.04s/it]
Epoch 2 Iter 134: loss 0.19713. :  59%|██████████████████████████▏                 | 133/224 [01:10<01:34,  1.04s/it]
Epoch 2 Iter 134: loss 0.19713. :  60%|██████████████████████████▎                 | 134/224 [01:10<01:20,  1.12it/s]
Epoch 2 Iter 135: loss 0.19088. :  60%|██████████████████████████▎                 | 134/224 [01:11<01:20,  1.12it/s]
Epoch 2 Iter 135: loss 0.19088. :  60%|██████████████████████████▌                 | 135/224 [01:11<01:18,  1.14it/s]
Epoch 2 Iter 136: loss 0.16731. :  60%|██████████████████████████▌                 | 135/224 [01:12<01:18,  1.14it/s]
Epoch 2 Iter 136: loss 0.16731. :  61%|██████████████████████████▋                 | 136/224 [01:12<01:23,  1.05it/s]
Epoch 2 Iter 137: loss 0.19208. :  61%|██████████████████████████▋                 | 136/224 [01:13<01:23,  1.05it/s]
Epoch 2 Iter 137: loss 0.19208. :  61%|██████████████████████████▉                 | 137/224 [01:13<01:24,  1.03it/s]
Epoch 2 Iter 138: loss 0.18768. :  61%|██████████████████████████▉                 | 137/224 [01:14<01:24,  1.03it/s]
Epoch 2 Iter 138: loss 0.18768. :  62%|███████████████████████████                 | 138/224 [01:14<01:25,  1.00it/s]
Epoch 2 Iter 139: loss 0.18310. :  62%|███████████████████████████                 | 138/224 [01:16<01:25,  1.00it/s]
Epoch 2 Iter 139: loss 0.18310. :  62%|███████████████████████████▎                | 139/224 [01:16<01:36,  1.14s/it]
Epoch 2 Iter 140: loss 0.16747. :  62%|███████████████████████████▎                | 139/224 [01:18<01:36,  1.14s/it]
Epoch 2 Iter 140: loss 0.16747. :  62%|███████████████████████████▌                | 140/224 [01:18<01:53,  1.35s/it]
Epoch 2 Iter 141: loss 0.17000. :  62%|███████████████████████████▌                | 140/224 [01:19<01:53,  1.35s/it]
Epoch 2 Iter 141: loss 0.17000. :  63%|███████████████████████████▋                | 141/224 [01:19<01:50,  1.33s/it]
Epoch 2 Iter 142: loss 0.17449. :  63%|███████████████████████████▋                | 141/224 [01:20<01:50,  1.33s/it]
Epoch 2 Iter 142: loss 0.17449. :  63%|███████████████████████████▉                | 142/224 [01:20<01:44,  1.28s/it]
Epoch 2 Iter 143: loss 0.18044. :  63%|███████████████████████████▉                | 142/224 [01:22<01:44,  1.28s/it]
Epoch 2 Iter 143: loss 0.18044. :  64%|████████████████████████████                | 143/224 [01:22<01:44,  1.29s/it]
Epoch 2 Iter 144: loss 0.16603. :  64%|████████████████████████████                | 143/224 [01:23<01:44,  1.29s/it]
Epoch 2 Iter 144: loss 0.16603. :  64%|████████████████████████████▎               | 144/224 [01:23<01:38,  1.23s/it]
Epoch 2 Iter 145: loss 0.17647. :  64%|████████████████████████████▎               | 144/224 [01:24<01:38,  1.23s/it]
Epoch 2 Iter 145: loss 0.17647. :  65%|████████████████████████████▍               | 145/224 [01:24<01:34,  1.20s/it]
Epoch 2 Iter 146: loss 0.19716. :  65%|████████████████████████████▍               | 145/224 [01:25<01:34,  1.20s/it]
Epoch 2 Iter 146: loss 0.19716. :  65%|████████████████████████████▋               | 146/224 [01:25<01:27,  1.12s/it]
Epoch 2 Iter 147: loss 0.18163. :  65%|████████████████████████████▋               | 146/224 [01:25<01:27,  1.12s/it]
Epoch 2 Iter 147: loss 0.18163. :  66%|████████████████████████████▉               | 147/224 [01:25<01:14,  1.04it/s]
Epoch 2 Iter 148: loss 0.17690. :  66%|████████████████████████████▉               | 147/224 [01:26<01:14,  1.04it/s]
Epoch 2 Iter 148: loss 0.17690. :  66%|█████████████████████████████               | 148/224 [01:26<01:11,  1.06it/s]
Epoch 2 Iter 149: loss 0.18648. :  66%|█████████████████████████████               | 148/224 [01:28<01:11,  1.06it/s]
Epoch 2 Iter 149: loss 0.18648. :  67%|█████████████████████████████▎              | 149/224 [01:28<01:21,  1.09s/it]
Epoch 2 Iter 150: loss 0.18633. :  67%|█████████████████████████████▎              | 149/224 [01:29<01:21,  1.09s/it]
Epoch 2 Iter 150: loss 0.18633. :  67%|█████████████████████████████▍              | 150/224 [01:29<01:24,  1.15s/it]
Epoch 2 Iter 151: loss 0.17344. :  67%|█████████████████████████████▍              | 150/224 [01:30<01:24,  1.15s/it]
Epoch 2 Iter 151: loss 0.17344. :  67%|█████████████████████████████▋              | 151/224 [01:30<01:22,  1.12s/it]
Epoch 2 Iter 152: loss 0.16092. :  67%|█████████████████████████████▋              | 151/224 [01:31<01:22,  1.12s/it]
Epoch 2 Iter 152: loss 0.16092. :  68%|█████████████████████████████▊              | 152/224 [01:31<01:25,  1.19s/it]
Epoch 2 Iter 153: loss 0.21139. :  68%|█████████████████████████████▊              | 152/224 [01:32<01:25,  1.19s/it]
Epoch 2 Iter 153: loss 0.21139. :  68%|██████████████████████████████              | 153/224 [01:32<01:23,  1.18s/it]
Epoch 2 Iter 154: loss 0.19543. :  68%|██████████████████████████████              | 153/224 [01:33<01:23,  1.18s/it]
Epoch 2 Iter 154: loss 0.19543. :  69%|██████████████████████████████▎             | 154/224 [01:33<01:18,  1.13s/it]
Epoch 2 Iter 155: loss 0.20240. :  69%|██████████████████████████████▎             | 154/224 [01:35<01:18,  1.13s/it]
Epoch 2 Iter 155: loss 0.20240. :  69%|██████████████████████████████▍             | 155/224 [01:35<01:18,  1.13s/it]
Epoch 2 Iter 156: loss 0.19323. :  69%|██████████████████████████████▍             | 155/224 [01:36<01:18,  1.13s/it]
Epoch 2 Iter 156: loss 0.19323. :  70%|██████████████████████████████▋             | 156/224 [01:36<01:15,  1.12s/it]
Epoch 2 Iter 157: loss 0.18872. :  70%|██████████████████████████████▋             | 156/224 [01:37<01:15,  1.12s/it]
Epoch 2 Iter 157: loss 0.18872. :  70%|██████████████████████████████▊             | 157/224 [01:37<01:11,  1.07s/it]
Epoch 2 Iter 158: loss 0.19800. :  70%|██████████████████████████████▊             | 157/224 [01:37<01:11,  1.07s/it]
Epoch 2 Iter 158: loss 0.19800. :  71%|███████████████████████████████             | 158/224 [01:37<01:02,  1.05it/s]
Epoch 2 Iter 159: loss 0.20114. :  71%|███████████████████████████████             | 158/224 [01:38<01:02,  1.05it/s]
Epoch 2 Iter 159: loss 0.20114. :  71%|███████████████████████████████▏            | 159/224 [01:38<00:56,  1.14it/s]
Epoch 2 Iter 160: loss 0.17422. :  71%|███████████████████████████████▏            | 159/224 [01:39<00:56,  1.14it/s]
Epoch 2 Iter 160: loss 0.17422. :  71%|███████████████████████████████▍            | 160/224 [01:39<01:01,  1.04it/s]
Epoch 2 Iter 161: loss 0.19072. :  71%|███████████████████████████████▍            | 160/224 [01:41<01:01,  1.04it/s]
Epoch 2 Iter 161: loss 0.19072. :  72%|███████████████████████████████▋            | 161/224 [01:41<01:15,  1.20s/it]
Epoch 2 Iter 162: loss 0.17652. :  72%|███████████████████████████████▋            | 161/224 [01:42<01:15,  1.20s/it]
Epoch 2 Iter 162: loss 0.17652. :  72%|███████████████████████████████▊            | 162/224 [01:42<01:15,  1.21s/it]
Epoch 2 Iter 163: loss 0.21055. :  72%|███████████████████████████████▊            | 162/224 [01:43<01:15,  1.21s/it]
Epoch 2 Iter 163: loss 0.21055. :  73%|████████████████████████████████            | 163/224 [01:43<01:09,  1.13s/it]
Epoch 2 Iter 164: loss 0.16214. :  73%|████████████████████████████████            | 163/224 [01:45<01:09,  1.13s/it]
Epoch 2 Iter 164: loss 0.16214. :  73%|████████████████████████████████▏           | 164/224 [01:45<01:16,  1.28s/it]
Epoch 2 Iter 165: loss 0.18612. :  73%|████████████████████████████████▏           | 164/224 [01:46<01:16,  1.28s/it]
Epoch 2 Iter 165: loss 0.18612. :  74%|████████████████████████████████▍           | 165/224 [01:46<01:21,  1.39s/it]
Epoch 2 Iter 166: loss 0.17874. :  74%|████████████████████████████████▍           | 165/224 [01:48<01:21,  1.39s/it]
Epoch 2 Iter 166: loss 0.17874. :  74%|████████████████████████████████▌           | 166/224 [01:48<01:15,  1.30s/it]
Epoch 2 Iter 167: loss 0.18417. :  74%|████████████████████████████████▌           | 166/224 [01:48<01:15,  1.30s/it]
Epoch 2 Iter 167: loss 0.18417. :  75%|████████████████████████████████▊           | 167/224 [01:48<01:06,  1.17s/it]
Epoch 2 Iter 168: loss 0.16293. :  75%|████████████████████████████████▊           | 167/224 [01:49<01:06,  1.17s/it]
Epoch 2 Iter 168: loss 0.16293. :  75%|█████████████████████████████████           | 168/224 [01:49<01:01,  1.10s/it]
Epoch 2 Iter 169: loss 0.16759. :  75%|█████████████████████████████████           | 168/224 [01:50<01:01,  1.10s/it]
Epoch 2 Iter 169: loss 0.16759. :  75%|█████████████████████████████████▏          | 169/224 [01:50<00:58,  1.07s/it]
Epoch 2 Iter 170: loss 0.17322. :  75%|█████████████████████████████████▏          | 169/224 [01:51<00:58,  1.07s/it]
Epoch 2 Iter 170: loss 0.17322. :  76%|█████████████████████████████████▍          | 170/224 [01:51<00:48,  1.12it/s]
Epoch 2 Iter 171: loss 0.17880. :  76%|█████████████████████████████████▍          | 170/224 [01:51<00:48,  1.12it/s]
Epoch 2 Iter 171: loss 0.17880. :  76%|█████████████████████████████████▌          | 171/224 [01:51<00:41,  1.29it/s]
Epoch 2 Iter 172: loss 0.16258. :  76%|█████████████████████████████████▌          | 171/224 [01:52<00:41,  1.29it/s]
Epoch 2 Iter 172: loss 0.16258. :  77%|█████████████████████████████████▊          | 172/224 [01:52<00:35,  1.45it/s]
Epoch 2 Iter 173: loss 0.16447. :  77%|█████████████████████████████████▊          | 172/224 [01:52<00:35,  1.45it/s]
Epoch 2 Iter 173: loss 0.16447. :  77%|█████████████████████████████████▉          | 173/224 [01:52<00:32,  1.59it/s]
Epoch 2 Iter 174: loss 0.17802. :  77%|█████████████████████████████████▉          | 173/224 [01:53<00:32,  1.59it/s]
Epoch 2 Iter 174: loss 0.17802. :  78%|██████████████████████████████████▏         | 174/224 [01:53<00:29,  1.69it/s]
Epoch 2 Iter 175: loss 0.19155. :  78%|██████████████████████████████████▏         | 174/224 [01:53<00:29,  1.69it/s]
Epoch 2 Iter 175: loss 0.19155. :  78%|██████████████████████████████████▍         | 175/224 [01:53<00:27,  1.77it/s]
Epoch 2 Iter 176: loss 0.17733. :  78%|██████████████████████████████████▍         | 175/224 [01:54<00:27,  1.77it/s]
Epoch 2 Iter 176: loss 0.17733. :  79%|██████████████████████████████████▌         | 176/224 [01:54<00:26,  1.84it/s]
Epoch 2 Iter 177: loss 0.15783. :  79%|██████████████████████████████████▌         | 176/224 [01:54<00:26,  1.84it/s]
Epoch 2 Iter 177: loss 0.15783. :  79%|██████████████████████████████████▊         | 177/224 [01:54<00:24,  1.90it/s]
Epoch 2 Iter 178: loss 0.15903. :  79%|██████████████████████████████████▊         | 177/224 [01:55<00:24,  1.90it/s]
Epoch 2 Iter 178: loss 0.15903. :  79%|██████████████████████████████████▉         | 178/224 [01:55<00:23,  1.93it/s]
Epoch 2 Iter 179: loss 0.18389. :  79%|██████████████████████████████████▉         | 178/224 [01:55<00:23,  1.93it/s]
Epoch 2 Iter 179: loss 0.18389. :  80%|███████████████████████████████████▏        | 179/224 [01:55<00:23,  1.92it/s]
Epoch 2 Iter 180: loss 0.21414. :  80%|███████████████████████████████████▏        | 179/224 [01:56<00:23,  1.92it/s]
Epoch 2 Iter 180: loss 0.21414. :  80%|███████████████████████████████████▎        | 180/224 [01:56<00:22,  1.95it/s]
Epoch 2 Iter 181: loss 0.18883. :  80%|███████████████████████████████████▎        | 180/224 [01:56<00:22,  1.95it/s]
Epoch 2 Iter 181: loss 0.18883. :  81%|███████████████████████████████████▌        | 181/224 [01:56<00:21,  1.97it/s]
Epoch 2 Iter 182: loss 0.18251. :  81%|███████████████████████████████████▌        | 181/224 [01:57<00:21,  1.97it/s]
Epoch 2 Iter 182: loss 0.18251. :  81%|███████████████████████████████████▊        | 182/224 [01:57<00:21,  1.98it/s]
Epoch 2 Iter 183: loss 0.17048. :  81%|███████████████████████████████████▊        | 182/224 [01:57<00:21,  1.98it/s]
Epoch 2 Iter 183: loss 0.17048. :  82%|███████████████████████████████████▉        | 183/224 [01:57<00:20,  1.99it/s]
Epoch 2 Iter 184: loss 0.18376. :  82%|███████████████████████████████████▉        | 183/224 [01:58<00:20,  1.99it/s]
Epoch 2 Iter 184: loss 0.18376. :  82%|████████████████████████████████████▏       | 184/224 [01:58<00:20,  1.98it/s]
Epoch 2 Iter 185: loss 0.20116. :  82%|████████████████████████████████████▏       | 184/224 [01:58<00:20,  1.98it/s]
Epoch 2 Iter 185: loss 0.20116. :  83%|████████████████████████████████████▎       | 185/224 [01:58<00:19,  1.97it/s]
Epoch 2 Iter 186: loss 0.16742. :  83%|████████████████████████████████████▎       | 185/224 [01:59<00:19,  1.97it/s]
Epoch 2 Iter 186: loss 0.16742. :  83%|████████████████████████████████████▌       | 186/224 [01:59<00:19,  1.96it/s]
Epoch 2 Iter 187: loss 0.17867. :  83%|████████████████████████████████████▌       | 186/224 [01:59<00:19,  1.96it/s]
Epoch 2 Iter 187: loss 0.17867. :  83%|████████████████████████████████████▋       | 187/224 [01:59<00:18,  1.97it/s]
Epoch 2 Iter 188: loss 0.19645. :  83%|████████████████████████████████████▋       | 187/224 [02:00<00:18,  1.97it/s]
Epoch 2 Iter 188: loss 0.19645. :  84%|████████████████████████████████████▉       | 188/224 [02:00<00:18,  1.98it/s]
Epoch 2 Iter 189: loss 0.19093. :  84%|████████████████████████████████████▉       | 188/224 [02:00<00:18,  1.98it/s]
Epoch 2 Iter 189: loss 0.19093. :  84%|█████████████████████████████████████▏      | 189/224 [02:00<00:17,  1.99it/s]
Epoch 2 Iter 190: loss 0.17724. :  84%|█████████████████████████████████████▏      | 189/224 [02:01<00:17,  1.99it/s]
Epoch 2 Iter 190: loss 0.17724. :  85%|█████████████████████████████████████▎      | 190/224 [02:01<00:17,  2.00it/s]
Epoch 2 Iter 191: loss 0.20403. :  85%|█████████████████████████████████████▎      | 190/224 [02:01<00:17,  2.00it/s]
Epoch 2 Iter 191: loss 0.20403. :  85%|█████████████████████████████████████▌      | 191/224 [02:01<00:16,  2.01it/s]
Epoch 2 Iter 192: loss 0.18760. :  85%|█████████████████████████████████████▌      | 191/224 [02:02<00:16,  2.01it/s]
Epoch 2 Iter 192: loss 0.18760. :  86%|█████████████████████████████████████▋      | 192/224 [02:02<00:15,  2.02it/s]
Epoch 2 Iter 193: loss 0.17405. :  86%|█████████████████████████████████████▋      | 192/224 [02:02<00:15,  2.02it/s]
Epoch 2 Iter 193: loss 0.17405. :  86%|█████████████████████████████████████▉      | 193/224 [02:02<00:15,  2.03it/s]
Epoch 2 Iter 194: loss 0.17656. :  86%|█████████████████████████████████████▉      | 193/224 [02:03<00:15,  2.03it/s]
Epoch 2 Iter 194: loss 0.17656. :  87%|██████████████████████████████████████      | 194/224 [02:03<00:14,  2.03it/s]
Epoch 2 Iter 195: loss 0.19119. :  87%|██████████████████████████████████████      | 194/224 [02:03<00:14,  2.03it/s]
Epoch 2 Iter 195: loss 0.19119. :  87%|██████████████████████████████████████▎     | 195/224 [02:03<00:14,  2.03it/s]
Epoch 2 Iter 196: loss 0.19487. :  87%|██████████████████████████████████████▎     | 195/224 [02:04<00:14,  2.03it/s]
Epoch 2 Iter 196: loss 0.19487. :  88%|██████████████████████████████████████▌     | 196/224 [02:04<00:13,  2.03it/s]
Epoch 2 Iter 197: loss 0.18051. :  88%|██████████████████████████████████████▌     | 196/224 [02:04<00:13,  2.03it/s]
Epoch 2 Iter 197: loss 0.18051. :  88%|██████████████████████████████████████▋     | 197/224 [02:04<00:13,  2.04it/s]
Epoch 2 Iter 198: loss 0.18571. :  88%|██████████████████████████████████████▋     | 197/224 [02:05<00:13,  2.04it/s]
Epoch 2 Iter 198: loss 0.18571. :  88%|██████████████████████████████████████▉     | 198/224 [02:05<00:12,  2.04it/s]
Epoch 2 Iter 199: loss 0.17557. :  88%|██████████████████████████████████████▉     | 198/224 [02:05<00:12,  2.04it/s]
Epoch 2 Iter 199: loss 0.17557. :  89%|███████████████████████████████████████     | 199/224 [02:05<00:12,  2.05it/s]
Epoch 2 Iter 200: loss 0.20724. :  89%|███████████████████████████████████████     | 199/224 [02:06<00:12,  2.05it/s]
Epoch 2 Iter 200: loss 0.20724. :  89%|███████████████████████████████████████▎    | 200/224 [02:06<00:11,  2.05it/s]
Epoch 2 Iter 201: loss 0.17989. :  89%|███████████████████████████████████████▎    | 200/224 [02:06<00:11,  2.05it/s]
Epoch 2 Iter 201: loss 0.17989. :  90%|███████████████████████████████████████▍    | 201/224 [02:06<00:11,  2.05it/s]
Epoch 2 Iter 202: loss 0.18219. :  90%|███████████████████████████████████████▍    | 201/224 [02:07<00:11,  2.05it/s]
Epoch 2 Iter 202: loss 0.18219. :  90%|███████████████████████████████████████▋    | 202/224 [02:07<00:10,  2.04it/s]
Epoch 2 Iter 203: loss 0.17805. :  90%|███████████████████████████████████████▋    | 202/224 [02:07<00:10,  2.04it/s]
Epoch 2 Iter 203: loss 0.17805. :  91%|███████████████████████████████████████▉    | 203/224 [02:07<00:10,  2.01it/s]
Epoch 2 Iter 204: loss 0.20965. :  91%|███████████████████████████████████████▉    | 203/224 [02:08<00:10,  2.01it/s]
Epoch 2 Iter 204: loss 0.20965. :  91%|████████████████████████████████████████    | 204/224 [02:08<00:10,  1.99it/s]
Epoch 2 Iter 205: loss 0.18328. :  91%|████████████████████████████████████████    | 204/224 [02:08<00:10,  1.99it/s]
Epoch 2 Iter 205: loss 0.18328. :  92%|████████████████████████████████████████▎   | 205/224 [02:08<00:09,  1.94it/s]
Epoch 2 Iter 206: loss 0.18163. :  92%|████████████████████████████████████████▎   | 205/224 [02:09<00:09,  1.94it/s]
Epoch 2 Iter 206: loss 0.18163. :  92%|████████████████████████████████████████▍   | 206/224 [02:09<00:09,  1.92it/s]
Epoch 2 Iter 207: loss 0.20770. :  92%|████████████████████████████████████████▍   | 206/224 [02:09<00:09,  1.92it/s]
Epoch 2 Iter 207: loss 0.20770. :  92%|████████████████████████████████████████▋   | 207/224 [02:09<00:08,  1.91it/s]
Epoch 2 Iter 208: loss 0.15858. :  92%|████████████████████████████████████████▋   | 207/224 [02:10<00:08,  1.91it/s]
Epoch 2 Iter 208: loss 0.15858. :  93%|████████████████████████████████████████▊   | 208/224 [02:10<00:08,  1.92it/s]
Epoch 2 Iter 209: loss 0.16987. :  93%|████████████████████████████████████████▊   | 208/224 [02:10<00:08,  1.92it/s]
Epoch 2 Iter 209: loss 0.16987. :  93%|█████████████████████████████████████████   | 209/224 [02:10<00:08,  1.86it/s]
Epoch 2 Iter 210: loss 0.20386. :  93%|█████████████████████████████████████████   | 209/224 [02:11<00:08,  1.86it/s]
Epoch 2 Iter 210: loss 0.20386. :  94%|█████████████████████████████████████████▎  | 210/224 [02:11<00:07,  1.90it/s]
Epoch 2 Iter 211: loss 0.16455. :  94%|█████████████████████████████████████████▎  | 210/224 [02:11<00:07,  1.90it/s]
Epoch 2 Iter 211: loss 0.16455. :  94%|█████████████████████████████████████████▍  | 211/224 [02:11<00:06,  1.92it/s]
Epoch 2 Iter 212: loss 0.17777. :  94%|█████████████████████████████████████████▍  | 211/224 [02:12<00:06,  1.92it/s]
Epoch 2 Iter 212: loss 0.17777. :  95%|█████████████████████████████████████████▋  | 212/224 [02:12<00:06,  1.94it/s]
Epoch 2 Iter 213: loss 0.19426. :  95%|█████████████████████████████████████████▋  | 212/224 [02:12<00:06,  1.94it/s]
Epoch 2 Iter 213: loss 0.19426. :  95%|█████████████████████████████████████████▊  | 213/224 [02:12<00:05,  1.96it/s]
Epoch 2 Iter 214: loss 0.16408. :  95%|█████████████████████████████████████████▊  | 213/224 [02:13<00:05,  1.96it/s]
Epoch 2 Iter 214: loss 0.16408. :  96%|██████████████████████████████████████████  | 214/224 [02:13<00:05,  1.98it/s]
Epoch 2 Iter 215: loss 0.20603. :  96%|██████████████████████████████████████████  | 214/224 [02:14<00:05,  1.98it/s]
Epoch 2 Iter 215: loss 0.20603. :  96%|██████████████████████████████████████████▏ | 215/224 [02:14<00:05,  1.79it/s]
Epoch 2 Iter 216: loss 0.18345. :  96%|██████████████████████████████████████████▏ | 215/224 [02:14<00:05,  1.79it/s]
Epoch 2 Iter 216: loss 0.18345. :  96%|██████████████████████████████████████████▍ | 216/224 [02:14<00:04,  1.81it/s]
Epoch 2 Iter 217: loss 0.16528. :  96%|██████████████████████████████████████████▍ | 216/224 [02:15<00:04,  1.81it/s]
Epoch 2 Iter 217: loss 0.16528. :  97%|██████████████████████████████████████████▋ | 217/224 [02:15<00:03,  1.87it/s]
Epoch 2 Iter 218: loss 0.18990. :  97%|██████████████████████████████████████████▋ | 217/224 [02:15<00:03,  1.87it/s]
Epoch 2 Iter 218: loss 0.18990. :  97%|██████████████████████████████████████████▊ | 218/224 [02:15<00:03,  1.91it/s]
Epoch 2 Iter 219: loss 0.15839. :  97%|██████████████████████████████████████████▊ | 218/224 [02:16<00:03,  1.91it/s]
Epoch 2 Iter 219: loss 0.15839. :  98%|███████████████████████████████████████████ | 219/224 [02:16<00:02,  1.91it/s]
Epoch 2 Iter 220: loss 0.17531. :  98%|███████████████████████████████████████████ | 219/224 [02:16<00:02,  1.91it/s]
Epoch 2 Iter 220: loss 0.17531. :  98%|███████████████████████████████████████████▏| 220/224 [02:16<00:02,  1.94it/s]
Epoch 2 Iter 221: loss 0.19255. :  98%|███████████████████████████████████████████▏| 220/224 [02:17<00:02,  1.94it/s]
Epoch 2 Iter 221: loss 0.19255. :  99%|███████████████████████████████████████████▍| 221/224 [02:17<00:01,  1.97it/s]
Epoch 2 Iter 222: loss 0.17616. :  99%|███████████████████████████████████████████▍| 221/224 [02:17<00:01,  1.97it/s]
Epoch 2 Iter 222: loss 0.17616. :  99%|███████████████████████████████████████████▌| 222/224 [02:17<00:01,  1.97it/s]
Epoch 2 Iter 223: loss 0.19332. :  99%|███████████████████████████████████████████▌| 222/224 [02:18<00:01,  1.97it/s]
Epoch 2 Iter 223: loss 0.19332. : 100%|███████████████████████████████████████████▊| 223/224 [02:18<00:00,  1.97it/s]
Epoch 2 Iter 224: loss 0.17845. : 100%|███████████████████████████████████████████▊| 223/224 [02:18<00:00,  1.97it/s]
Epoch 2 Iter 224: loss 0.17845. : 100%|████████████████████████████████████████████| 224/224 [02:18<00:00,  1.98it/s]
Epoch 2 Iter 224: loss 0.17845. : 100%|████████████████████████████████████████████| 224/224 [02:18<00:00,  1.62it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.18344. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.18344. :   0%|▏                                               | 1/224 [00:00<01:48,  2.05it/s]
Epoch 3 Iter 2: loss 0.20140. :   0%|▏                                               | 1/224 [00:00<01:48,  2.05it/s]
Epoch 3 Iter 2: loss 0.20140. :   1%|▍                                               | 2/224 [00:00<01:49,  2.02it/s]
Epoch 3 Iter 3: loss 0.18398. :   1%|▍                                               | 2/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 3: loss 0.18398. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 4: loss 0.18315. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 4: loss 0.18315. :   2%|▊                                               | 4/224 [00:01<01:49,  2.01it/s]
Epoch 3 Iter 5: loss 0.18025. :   2%|▊                                               | 4/224 [00:02<01:49,  2.01it/s]
Epoch 3 Iter 5: loss 0.18025. :   2%|█                                               | 5/224 [00:02<01:48,  2.02it/s]
Epoch 3 Iter 6: loss 0.18811. :   2%|█                                               | 5/224 [00:02<01:48,  2.02it/s]
Epoch 3 Iter 6: loss 0.18811. :   3%|█▎                                              | 6/224 [00:02<01:47,  2.02it/s]
Epoch 3 Iter 7: loss 0.19300. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.02it/s]
Epoch 3 Iter 7: loss 0.19300. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.01it/s]
Epoch 3 Iter 8: loss 0.17170. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.01it/s]
Epoch 3 Iter 8: loss 0.17170. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.01it/s]
Epoch 3 Iter 9: loss 0.17748. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 3 Iter 9: loss 0.17748. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.01it/s]
Epoch 3 Iter 10: loss 0.16489. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.01it/s]
Epoch 3 Iter 10: loss 0.16489. :   4%|██                                            | 10/224 [00:04<01:45,  2.02it/s]
Epoch 3 Iter 11: loss 0.21978. :   4%|██                                            | 10/224 [00:05<01:45,  2.02it/s]
Epoch 3 Iter 11: loss 0.21978. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 3 Iter 12: loss 0.16361. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 3 Iter 12: loss 0.16361. :   5%|██▍                                           | 12/224 [00:05<01:45,  2.02it/s]
Epoch 3 Iter 13: loss 0.17660. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.02it/s]
Epoch 3 Iter 13: loss 0.17660. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.03it/s]
Epoch 3 Iter 14: loss 0.16874. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.03it/s]
Epoch 3 Iter 14: loss 0.16874. :   6%|██▉                                           | 14/224 [00:06<01:44,  2.01it/s]
Epoch 3 Iter 15: loss 0.19246. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.01it/s]
Epoch 3 Iter 15: loss 0.19246. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 3 Iter 16: loss 0.20626. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 3 Iter 16: loss 0.20626. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.03it/s]
Epoch 3 Iter 17: loss 0.16415. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.03it/s]
Epoch 3 Iter 17: loss 0.16415. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 3 Iter 18: loss 0.15782. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 3 Iter 18: loss 0.15782. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.01it/s]
Epoch 3 Iter 19: loss 0.18470. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.01it/s]
Epoch 3 Iter 19: loss 0.18470. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 3 Iter 20: loss 0.17127. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 3 Iter 20: loss 0.17127. :   9%|████                                          | 20/224 [00:09<01:41,  2.00it/s]
Epoch 3 Iter 21: loss 0.19873. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 3 Iter 21: loss 0.19873. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 3 Iter 22: loss 0.17430. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 3 Iter 22: loss 0.17430. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.03it/s]
Epoch 3 Iter 23: loss 0.18963. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.03it/s]
Epoch 3 Iter 23: loss 0.18963. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.01it/s]
Epoch 3 Iter 24: loss 0.16644. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.01it/s]
Epoch 3 Iter 24: loss 0.16644. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.01it/s]
Epoch 3 Iter 25: loss 0.18396. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 3 Iter 25: loss 0.18396. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 3 Iter 26: loss 0.19190. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 3 Iter 26: loss 0.19190. :  12%|█████▎                                        | 26/224 [00:12<01:39,  2.00it/s]
Epoch 3 Iter 27: loss 0.17855. :  12%|█████▎                                        | 26/224 [00:13<01:39,  2.00it/s]
Epoch 3 Iter 27: loss 0.17855. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.00it/s]
Epoch 3 Iter 28: loss 0.17273. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.00it/s]
Epoch 3 Iter 28: loss 0.17273. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.01it/s]
Epoch 3 Iter 29: loss 0.16503. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.01it/s]
Epoch 3 Iter 29: loss 0.16503. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 3 Iter 30: loss 0.18951. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 3 Iter 30: loss 0.18951. :  13%|██████▏                                       | 30/224 [00:14<01:37,  2.00it/s]
Epoch 3 Iter 31: loss 0.18980. :  13%|██████▏                                       | 30/224 [00:15<01:37,  2.00it/s]
Epoch 3 Iter 31: loss 0.18980. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.01it/s]
Epoch 3 Iter 32: loss 0.16442. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.01it/s]
Epoch 3 Iter 32: loss 0.16442. :  14%|██████▌                                       | 32/224 [00:15<01:35,  2.01it/s]
Epoch 3 Iter 33: loss 0.16123. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.01it/s]
Epoch 3 Iter 33: loss 0.16123. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 3 Iter 34: loss 0.18527. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 3 Iter 34: loss 0.18527. :  15%|██████▉                                       | 34/224 [00:16<01:33,  2.03it/s]
Epoch 3 Iter 35: loss 0.15377. :  15%|██████▉                                       | 34/224 [00:17<01:33,  2.03it/s]
Epoch 3 Iter 35: loss 0.15377. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 3 Iter 36: loss 0.18413. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 3 Iter 36: loss 0.18413. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.03it/s]
Epoch 3 Iter 37: loss 0.18916. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.03it/s]
Epoch 3 Iter 37: loss 0.18916. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.04it/s]
Epoch 3 Iter 38: loss 0.18943. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.04it/s]
Epoch 3 Iter 38: loss 0.18943. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.03it/s]
Epoch 3 Iter 39: loss 0.17532. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.03it/s]
Epoch 3 Iter 39: loss 0.17532. :  17%|████████                                      | 39/224 [00:19<01:30,  2.04it/s]
Epoch 3 Iter 40: loss 0.18602. :  17%|████████                                      | 39/224 [00:19<01:30,  2.04it/s]
Epoch 3 Iter 40: loss 0.18602. :  18%|████████▏                                     | 40/224 [00:19<01:31,  2.02it/s]
Epoch 3 Iter 41: loss 0.19281. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.02it/s]
Epoch 3 Iter 41: loss 0.19281. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 3 Iter 42: loss 0.17682. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 3 Iter 42: loss 0.17682. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 3 Iter 43: loss 0.18559. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 3 Iter 43: loss 0.18559. :  19%|████████▊                                     | 43/224 [00:21<01:33,  1.93it/s]
Epoch 3 Iter 44: loss 0.18213. :  19%|████████▊                                     | 43/224 [00:21<01:33,  1.93it/s]
Epoch 3 Iter 44: loss 0.18213. :  20%|█████████                                     | 44/224 [00:21<01:34,  1.91it/s]
Epoch 3 Iter 45: loss 0.18154. :  20%|█████████                                     | 44/224 [00:22<01:34,  1.91it/s]
Epoch 3 Iter 45: loss 0.18154. :  20%|█████████▏                                    | 45/224 [00:22<01:33,  1.92it/s]
Epoch 3 Iter 46: loss 0.18389. :  20%|█████████▏                                    | 45/224 [00:22<01:33,  1.92it/s]
Epoch 3 Iter 46: loss 0.18389. :  21%|█████████▍                                    | 46/224 [00:22<01:31,  1.94it/s]
Epoch 3 Iter 47: loss 0.17491. :  21%|█████████▍                                    | 46/224 [00:23<01:31,  1.94it/s]
Epoch 3 Iter 47: loss 0.17491. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 3 Iter 48: loss 0.20863. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 3 Iter 48: loss 0.20863. :  21%|█████████▊                                    | 48/224 [00:23<01:30,  1.95it/s]
Epoch 3 Iter 49: loss 0.18794. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 3 Iter 49: loss 0.18794. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.96it/s]
Epoch 3 Iter 50: loss 0.16701. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.96it/s]
Epoch 3 Iter 50: loss 0.16701. :  22%|██████████▎                                   | 50/224 [00:24<01:27,  1.98it/s]
Epoch 3 Iter 51: loss 0.18020. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.98it/s]
Epoch 3 Iter 51: loss 0.18020. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.98it/s]
Epoch 3 Iter 52: loss 0.20091. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.98it/s]
Epoch 3 Iter 52: loss 0.20091. :  23%|██████████▋                                   | 52/224 [00:26<01:28,  1.93it/s]
Epoch 3 Iter 53: loss 0.17817. :  23%|██████████▋                                   | 52/224 [00:26<01:28,  1.93it/s]
Epoch 3 Iter 53: loss 0.17817. :  24%|██████████▉                                   | 53/224 [00:26<01:28,  1.94it/s]
Epoch 3 Iter 54: loss 0.18460. :  24%|██████████▉                                   | 53/224 [00:27<01:28,  1.94it/s]
Epoch 3 Iter 54: loss 0.18460. :  24%|███████████                                   | 54/224 [00:27<01:27,  1.95it/s]
Epoch 3 Iter 55: loss 0.16464. :  24%|███████████                                   | 54/224 [00:27<01:27,  1.95it/s]
Epoch 3 Iter 55: loss 0.16464. :  25%|███████████▎                                  | 55/224 [00:27<01:26,  1.96it/s]
Epoch 3 Iter 56: loss 0.17926. :  25%|███████████▎                                  | 55/224 [00:28<01:26,  1.96it/s]
Epoch 3 Iter 56: loss 0.17926. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.96it/s]
Epoch 3 Iter 57: loss 0.17694. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.96it/s]
Epoch 3 Iter 57: loss 0.17694. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.97it/s]
Epoch 3 Iter 58: loss 0.17851. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 3 Iter 58: loss 0.17851. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 3 Iter 59: loss 0.18558. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 3 Iter 59: loss 0.18558. :  26%|████████████                                  | 59/224 [00:29<01:23,  1.98it/s]
Epoch 3 Iter 60: loss 0.18856. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.98it/s]
Epoch 3 Iter 60: loss 0.18856. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 3 Iter 61: loss 0.16978. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 3 Iter 61: loss 0.16978. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  1.99it/s]
Epoch 3 Iter 62: loss 0.18487. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  1.99it/s]
Epoch 3 Iter 62: loss 0.18487. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  2.00it/s]
Epoch 3 Iter 63: loss 0.18920. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  2.00it/s]
Epoch 3 Iter 63: loss 0.18920. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.00it/s]
Epoch 3 Iter 64: loss 0.19171. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.00it/s]
Epoch 3 Iter 64: loss 0.19171. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 3 Iter 65: loss 0.19462. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 3 Iter 65: loss 0.19462. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.97it/s]
Epoch 3 Iter 66: loss 0.16097. :  29%|█████████████▎                                | 65/224 [00:33<01:20,  1.97it/s]
Epoch 3 Iter 66: loss 0.16097. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.97it/s]
Epoch 3 Iter 67: loss 0.18244. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.97it/s]
Epoch 3 Iter 67: loss 0.18244. :  30%|█████████████▊                                | 67/224 [00:33<01:20,  1.96it/s]
Epoch 3 Iter 68: loss 0.17774. :  30%|█████████████▊                                | 67/224 [00:34<01:20,  1.96it/s]
Epoch 3 Iter 68: loss 0.17774. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.97it/s]
Epoch 3 Iter 69: loss 0.17974. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.97it/s]
Epoch 3 Iter 69: loss 0.17974. :  31%|██████████████▏                               | 69/224 [00:34<01:19,  1.96it/s]
Epoch 3 Iter 70: loss 0.15635. :  31%|██████████████▏                               | 69/224 [00:35<01:19,  1.96it/s]
Epoch 3 Iter 70: loss 0.15635. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 3 Iter 71: loss 0.17522. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 3 Iter 71: loss 0.17522. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  1.99it/s]
Epoch 3 Iter 72: loss 0.17828. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  1.99it/s]
Epoch 3 Iter 72: loss 0.17828. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 3 Iter 73: loss 0.17477. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 3 Iter 73: loss 0.17477. :  33%|██████████████▉                               | 73/224 [00:36<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.16820. :  33%|██████████████▉                               | 73/224 [00:37<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.16820. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 3 Iter 75: loss 0.17460. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 3 Iter 75: loss 0.17460. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 3 Iter 76: loss 0.19991. :  33%|███████████████▍                              | 75/224 [00:38<01:13,  2.02it/s]
Epoch 3 Iter 76: loss 0.19991. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 3 Iter 77: loss 0.18417. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 3 Iter 77: loss 0.18417. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 3 Iter 78: loss 0.18386. :  34%|███████████████▊                              | 77/224 [00:39<01:12,  2.02it/s]
Epoch 3 Iter 78: loss 0.18386. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 3 Iter 79: loss 0.19950. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 3 Iter 79: loss 0.19950. :  35%|████████████████▏                             | 79/224 [00:39<01:12,  2.01it/s]
Epoch 3 Iter 80: loss 0.20016. :  35%|████████████████▏                             | 79/224 [00:40<01:12,  2.01it/s]
Epoch 3 Iter 80: loss 0.20016. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 3 Iter 81: loss 0.19131. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 3 Iter 81: loss 0.19131. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.02it/s]
Epoch 3 Iter 82: loss 0.16678. :  36%|████████████████▋                             | 81/224 [00:41<01:10,  2.02it/s]
Epoch 3 Iter 82: loss 0.16678. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.97it/s]
Epoch 3 Iter 83: loss 0.17654. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.97it/s]
Epoch 3 Iter 83: loss 0.17654. :  37%|█████████████████                             | 83/224 [00:41<01:10,  1.99it/s]
Epoch 3 Iter 84: loss 0.16910. :  37%|█████████████████                             | 83/224 [00:42<01:10,  1.99it/s]
Epoch 3 Iter 84: loss 0.16910. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 3 Iter 85: loss 0.18629. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 3 Iter 85: loss 0.18629. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  1.99it/s]
Epoch 3 Iter 86: loss 0.18465. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  1.99it/s]
Epoch 3 Iter 86: loss 0.18465. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 3 Iter 87: loss 0.17744. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 3 Iter 87: loss 0.17744. :  39%|█████████████████▊                            | 87/224 [00:43<01:08,  2.01it/s]
Epoch 3 Iter 88: loss 0.17473. :  39%|█████████████████▊                            | 87/224 [00:44<01:08,  2.01it/s]
Epoch 3 Iter 88: loss 0.17473. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.99it/s]
Epoch 3 Iter 89: loss 0.17898. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.99it/s]
Epoch 3 Iter 89: loss 0.17898. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  1.99it/s]
Epoch 3 Iter 90: loss 0.17799. :  40%|██████████████████▎                           | 89/224 [00:45<01:07,  1.99it/s]
Epoch 3 Iter 90: loss 0.17799. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 3 Iter 91: loss 0.18807. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 3 Iter 91: loss 0.18807. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.00it/s]
Epoch 3 Iter 92: loss 0.16938. :  41%|██████████████████▋                           | 91/224 [00:46<01:06,  2.00it/s]
Epoch 3 Iter 92: loss 0.16938. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.01it/s]
Epoch 3 Iter 93: loss 0.16681. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.01it/s]
Epoch 3 Iter 93: loss 0.16681. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.02it/s]
Epoch 3 Iter 94: loss 0.17723. :  42%|███████████████████                           | 93/224 [00:47<01:04,  2.02it/s]
Epoch 3 Iter 94: loss 0.17723. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 3 Iter 95: loss 0.18383. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 3 Iter 95: loss 0.18383. :  42%|███████████████████▌                          | 95/224 [00:47<01:03,  2.03it/s]
Epoch 3 Iter 96: loss 0.18982. :  42%|███████████████████▌                          | 95/224 [00:48<01:03,  2.03it/s]
Epoch 3 Iter 96: loss 0.18982. :  43%|███████████████████▋                          | 96/224 [00:48<01:02,  2.03it/s]
Epoch 3 Iter 97: loss 0.17573. :  43%|███████████████████▋                          | 96/224 [00:48<01:02,  2.03it/s]
Epoch 3 Iter 97: loss 0.17573. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 3 Iter 98: loss 0.19921. :  43%|███████████████████▉                          | 97/224 [00:49<01:02,  2.03it/s]
Epoch 3 Iter 98: loss 0.19921. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.03it/s]
Epoch 3 Iter 99: loss 0.18708. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.03it/s]
Epoch 3 Iter 99: loss 0.18708. :  44%|████████████████████▎                         | 99/224 [00:49<01:01,  2.03it/s]
Epoch 3 Iter 100: loss 0.20693. :  44%|███████████████████▉                         | 99/224 [00:50<01:01,  2.03it/s]
Epoch 3 Iter 100: loss 0.20693. :  45%|███████████████████▋                        | 100/224 [00:50<01:00,  2.04it/s]
Epoch 3 Iter 101: loss 0.18082. :  45%|███████████████████▋                        | 100/224 [00:50<01:00,  2.04it/s]
Epoch 3 Iter 101: loss 0.18082. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.02it/s]
Epoch 3 Iter 102: loss 0.20133. :  45%|███████████████████▊                        | 101/224 [00:51<01:00,  2.02it/s]
Epoch 3 Iter 102: loss 0.20133. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.02it/s]
Epoch 3 Iter 103: loss 0.17656. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.02it/s]
Epoch 3 Iter 103: loss 0.17656. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.03it/s]
Epoch 3 Iter 104: loss 0.17647. :  46%|████████████████████▏                       | 103/224 [00:52<00:59,  2.03it/s]
Epoch 3 Iter 104: loss 0.17647. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 3 Iter 105: loss 0.18435. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 3 Iter 105: loss 0.18435. :  47%|████████████████████▋                       | 105/224 [00:52<00:58,  2.02it/s]
Epoch 3 Iter 106: loss 0.16989. :  47%|████████████████████▋                       | 105/224 [00:53<00:58,  2.02it/s]
Epoch 3 Iter 106: loss 0.16989. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.01it/s]
Epoch 3 Iter 107: loss 0.18881. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.01it/s]
Epoch 3 Iter 107: loss 0.18881. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 3 Iter 108: loss 0.19247. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 3 Iter 108: loss 0.19247. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.02it/s]
Epoch 3 Iter 109: loss 0.17292. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 3 Iter 109: loss 0.17292. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 110: loss 0.20560. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 110: loss 0.20560. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 111: loss 0.16407. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 3 Iter 111: loss 0.16407. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.03it/s]
Epoch 3 Iter 112: loss 0.16357. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.03it/s]
Epoch 3 Iter 112: loss 0.16357. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.03it/s]
Epoch 3 Iter 113: loss 0.18052. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.03it/s]
Epoch 3 Iter 113: loss 0.18052. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 3 Iter 114: loss 0.17483. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 3 Iter 114: loss 0.17483. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 3 Iter 115: loss 0.19059. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.03it/s]
Epoch 3 Iter 115: loss 0.19059. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  1.99it/s]
Epoch 3 Iter 116: loss 0.17717. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  1.99it/s]
Epoch 3 Iter 116: loss 0.17717. :  52%|██████████████████████▊                     | 116/224 [00:57<00:54,  2.00it/s]
Epoch 3 Iter 117: loss 0.18287. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  2.00it/s]
Epoch 3 Iter 117: loss 0.18287. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.00it/s]
Epoch 3 Iter 118: loss 0.17992. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.00it/s]
Epoch 3 Iter 118: loss 0.17992. :  53%|███████████████████████▏                    | 118/224 [00:58<00:53,  2.00it/s]
Epoch 3 Iter 119: loss 0.16684. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  2.00it/s]
Epoch 3 Iter 119: loss 0.16684. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.00it/s]
Epoch 3 Iter 120: loss 0.17458. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.00it/s]
Epoch 3 Iter 120: loss 0.17458. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.00it/s]
Epoch 3 Iter 121: loss 0.18573. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.00it/s]
Epoch 3 Iter 121: loss 0.18573. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 3 Iter 122: loss 0.19486. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 3 Iter 122: loss 0.19486. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.01it/s]
Epoch 3 Iter 123: loss 0.19336. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.01it/s]
Epoch 3 Iter 123: loss 0.19336. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 3 Iter 124: loss 0.16257. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 3 Iter 124: loss 0.16257. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.02it/s]
Epoch 3 Iter 125: loss 0.17577. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.02it/s]
Epoch 3 Iter 125: loss 0.17577. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  1.99it/s]
Epoch 3 Iter 126: loss 0.16813. :  56%|████████████████████████▌                   | 125/224 [01:03<00:49,  1.99it/s]
Epoch 3 Iter 126: loss 0.16813. :  56%|████████████████████████▊                   | 126/224 [01:03<00:50,  1.93it/s]
Epoch 3 Iter 127: loss 0.15294. :  56%|████████████████████████▊                   | 126/224 [01:03<00:50,  1.93it/s]
Epoch 3 Iter 127: loss 0.15294. :  57%|████████████████████████▉                   | 127/224 [01:03<00:51,  1.88it/s]
Epoch 3 Iter 128: loss 0.17833. :  57%|████████████████████████▉                   | 127/224 [01:04<00:51,  1.88it/s]
Epoch 3 Iter 128: loss 0.17833. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:50,  1.91it/s]
Epoch 3 Iter 129: loss 0.18896. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:50,  1.91it/s]
Epoch 3 Iter 129: loss 0.18896. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:48,  1.94it/s]
Epoch 3 Iter 130: loss 0.19607. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:48,  1.94it/s]
Epoch 3 Iter 130: loss 0.19607. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  1.98it/s]
Epoch 3 Iter 131: loss 0.17875. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  1.98it/s]
Epoch 3 Iter 131: loss 0.17875. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  1.98it/s]
Epoch 3 Iter 132: loss 0.16576. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  1.98it/s]
Epoch 3 Iter 132: loss 0.16576. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:46,  1.98it/s]
Epoch 3 Iter 133: loss 0.17389. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:46,  1.98it/s]
Epoch 3 Iter 133: loss 0.17389. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  1.99it/s]
Epoch 3 Iter 134: loss 0.18221. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.99it/s]
Epoch 3 Iter 134: loss 0.18221. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.99it/s]
Epoch 3 Iter 135: loss 0.18290. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.99it/s]
Epoch 3 Iter 135: loss 0.18290. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:45,  1.98it/s]
Epoch 3 Iter 136: loss 0.18161. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:45,  1.98it/s]
Epoch 3 Iter 136: loss 0.18161. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:46,  1.90it/s]
Epoch 3 Iter 137: loss 0.18051. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:46,  1.90it/s]
Epoch 3 Iter 137: loss 0.18051. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:48,  1.78it/s]
Epoch 3 Iter 138: loss 0.18152. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:48,  1.78it/s]
Epoch 3 Iter 138: loss 0.18152. :  62%|███████████████████████████                 | 138/224 [01:09<00:52,  1.65it/s]
Epoch 3 Iter 139: loss 0.18935. :  62%|███████████████████████████                 | 138/224 [01:10<00:52,  1.65it/s]
Epoch 3 Iter 139: loss 0.18935. :  62%|███████████████████████████▎                | 139/224 [01:10<00:50,  1.67it/s]
Epoch 3 Iter 140: loss 0.20305. :  62%|███████████████████████████▎                | 139/224 [01:10<00:50,  1.67it/s]
Epoch 3 Iter 140: loss 0.20305. :  62%|███████████████████████████▌                | 140/224 [01:10<00:52,  1.61it/s]
Epoch 3 Iter 141: loss 0.19684. :  62%|███████████████████████████▌                | 140/224 [01:11<00:52,  1.61it/s]
Epoch 3 Iter 141: loss 0.19684. :  63%|███████████████████████████▋                | 141/224 [01:11<00:52,  1.57it/s]
Epoch 3 Iter 142: loss 0.19289. :  63%|███████████████████████████▋                | 141/224 [01:11<00:52,  1.57it/s]
Epoch 3 Iter 142: loss 0.19289. :  63%|███████████████████████████▉                | 142/224 [01:11<00:49,  1.65it/s]
Epoch 3 Iter 143: loss 0.17398. :  63%|███████████████████████████▉                | 142/224 [01:12<00:49,  1.65it/s]
Epoch 3 Iter 143: loss 0.17398. :  64%|████████████████████████████                | 143/224 [01:12<00:46,  1.73it/s]
Epoch 3 Iter 144: loss 0.17508. :  64%|████████████████████████████                | 143/224 [01:12<00:46,  1.73it/s]
Epoch 3 Iter 144: loss 0.17508. :  64%|████████████████████████████▎               | 144/224 [01:12<00:44,  1.80it/s]
Epoch 3 Iter 145: loss 0.16692. :  64%|████████████████████████████▎               | 144/224 [01:13<00:44,  1.80it/s]
Epoch 3 Iter 145: loss 0.16692. :  65%|████████████████████████████▍               | 145/224 [01:13<00:42,  1.84it/s]
Epoch 3 Iter 146: loss 0.17663. :  65%|████████████████████████████▍               | 145/224 [01:14<00:42,  1.84it/s]
Epoch 3 Iter 146: loss 0.17663. :  65%|████████████████████████████▋               | 146/224 [01:14<00:41,  1.88it/s]
Epoch 3 Iter 147: loss 0.18978. :  65%|████████████████████████████▋               | 146/224 [01:14<00:41,  1.88it/s]
Epoch 3 Iter 147: loss 0.18978. :  66%|████████████████████████████▉               | 147/224 [01:14<00:40,  1.91it/s]
Epoch 3 Iter 148: loss 0.18072. :  66%|████████████████████████████▉               | 147/224 [01:15<00:40,  1.91it/s]
Epoch 3 Iter 148: loss 0.18072. :  66%|█████████████████████████████               | 148/224 [01:15<00:39,  1.93it/s]
Epoch 3 Iter 149: loss 0.18513. :  66%|█████████████████████████████               | 148/224 [01:15<00:39,  1.93it/s]
Epoch 3 Iter 149: loss 0.18513. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:38,  1.95it/s]
Epoch 3 Iter 150: loss 0.20238. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:38,  1.95it/s]
Epoch 3 Iter 150: loss 0.20238. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:37,  1.96it/s]
Epoch 3 Iter 151: loss 0.17549. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:37,  1.96it/s]
Epoch 3 Iter 151: loss 0.17549. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:37,  1.97it/s]
Epoch 3 Iter 152: loss 0.18109. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:37,  1.97it/s]
Epoch 3 Iter 152: loss 0.18109. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.98it/s]
Epoch 3 Iter 153: loss 0.20786. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.98it/s]
Epoch 3 Iter 153: loss 0.20786. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.98it/s]
Epoch 3 Iter 154: loss 0.17586. :  68%|██████████████████████████████              | 153/224 [01:18<00:35,  1.98it/s]
Epoch 3 Iter 154: loss 0.17586. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  1.98it/s]
Epoch 3 Iter 155: loss 0.16230. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  1.98it/s]
Epoch 3 Iter 155: loss 0.16230. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  1.98it/s]
Epoch 3 Iter 156: loss 0.15702. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:34,  1.98it/s]
Epoch 3 Iter 156: loss 0.15702. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.00it/s]
Epoch 3 Iter 157: loss 0.17505. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.00it/s]
Epoch 3 Iter 157: loss 0.17505. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.01it/s]
Epoch 3 Iter 158: loss 0.17316. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:33,  2.01it/s]
Epoch 3 Iter 158: loss 0.17316. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.01it/s]
Epoch 3 Iter 159: loss 0.16030. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.01it/s]
Epoch 3 Iter 159: loss 0.16030. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:33,  1.95it/s]
Epoch 3 Iter 160: loss 0.17636. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:33,  1.95it/s]
Epoch 3 Iter 160: loss 0.17636. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.96it/s]
Epoch 3 Iter 161: loss 0.17334. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.96it/s]
Epoch 3 Iter 161: loss 0.17334. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.98it/s]
Epoch 3 Iter 162: loss 0.18757. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:31,  1.98it/s]
Epoch 3 Iter 162: loss 0.18757. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.98it/s]
Epoch 3 Iter 163: loss 0.18187. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.98it/s]
Epoch 3 Iter 163: loss 0.18187. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  1.98it/s]
Epoch 3 Iter 164: loss 0.18580. :  73%|████████████████████████████████            | 163/224 [01:23<00:30,  1.98it/s]
Epoch 3 Iter 164: loss 0.18580. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.98it/s]
Epoch 3 Iter 165: loss 0.16588. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.98it/s]
Epoch 3 Iter 165: loss 0.16588. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  1.99it/s]
Epoch 3 Iter 166: loss 0.14967. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:29,  1.99it/s]
Epoch 3 Iter 166: loss 0.14967. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  2.00it/s]
Epoch 3 Iter 167: loss 0.19097. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  2.00it/s]
Epoch 3 Iter 167: loss 0.19097. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.96it/s]
Epoch 3 Iter 168: loss 0.17515. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.96it/s]
Epoch 3 Iter 168: loss 0.17515. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.98it/s]
Epoch 3 Iter 169: loss 0.18210. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.98it/s]
Epoch 3 Iter 169: loss 0.18210. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  1.99it/s]
Epoch 3 Iter 170: loss 0.19718. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:27,  1.99it/s]
Epoch 3 Iter 170: loss 0.19718. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  2.00it/s]
Epoch 3 Iter 171: loss 0.17057. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  2.00it/s]
Epoch 3 Iter 171: loss 0.17057. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.17082. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.17082. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  2.00it/s]
Epoch 3 Iter 173: loss 0.16904. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  2.00it/s]
Epoch 3 Iter 173: loss 0.16904. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  1.97it/s]
Epoch 3 Iter 174: loss 0.17067. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  1.97it/s]
Epoch 3 Iter 174: loss 0.17067. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.97it/s]
Epoch 3 Iter 175: loss 0.16329. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.97it/s]
Epoch 3 Iter 175: loss 0.16329. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  1.97it/s]
Epoch 3 Iter 176: loss 0.16597. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  1.97it/s]
Epoch 3 Iter 176: loss 0.16597. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.98it/s]
Epoch 3 Iter 177: loss 0.20074. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.98it/s]
Epoch 3 Iter 177: loss 0.20074. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  1.99it/s]
Epoch 3 Iter 178: loss 0.18665. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  1.99it/s]
Epoch 3 Iter 178: loss 0.18665. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.99it/s]
Epoch 3 Iter 179: loss 0.18399. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.99it/s]
Epoch 3 Iter 179: loss 0.18399. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  1.97it/s]
Epoch 3 Iter 180: loss 0.18814. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  1.97it/s]
Epoch 3 Iter 180: loss 0.18814. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.97it/s]
Epoch 3 Iter 181: loss 0.18865. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.97it/s]
Epoch 3 Iter 181: loss 0.18865. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  1.97it/s]
Epoch 3 Iter 182: loss 0.16936. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  1.97it/s]
Epoch 3 Iter 182: loss 0.16936. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.99it/s]
Epoch 3 Iter 183: loss 0.15978. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.99it/s]
Epoch 3 Iter 183: loss 0.15978. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  1.99it/s]
Epoch 3 Iter 184: loss 0.17240. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  1.99it/s]
Epoch 3 Iter 184: loss 0.17240. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.97it/s]
Epoch 3 Iter 185: loss 0.17309. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.97it/s]
Epoch 3 Iter 185: loss 0.17309. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.97it/s]
Epoch 3 Iter 186: loss 0.18339. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  1.97it/s]
Epoch 3 Iter 186: loss 0.18339. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.95it/s]
Epoch 3 Iter 187: loss 0.20945. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.95it/s]
Epoch 3 Iter 187: loss 0.20945. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.97it/s]
Epoch 3 Iter 188: loss 0.17032. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.97it/s]
Epoch 3 Iter 188: loss 0.17032. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.98it/s]
Epoch 3 Iter 189: loss 0.16600. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.98it/s]
Epoch 3 Iter 189: loss 0.16600. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  2.00it/s]
Epoch 3 Iter 190: loss 0.17142. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  2.00it/s]
Epoch 3 Iter 190: loss 0.17142. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  2.00it/s]
Epoch 3 Iter 191: loss 0.18262. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  2.00it/s]
Epoch 3 Iter 191: loss 0.18262. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  2.00it/s]
Epoch 3 Iter 192: loss 0.18857. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  2.00it/s]
Epoch 3 Iter 192: loss 0.18857. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.99it/s]
Epoch 3 Iter 193: loss 0.17389. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.99it/s]
Epoch 3 Iter 193: loss 0.17389. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.16905. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.16905. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.01it/s]
Epoch 3 Iter 195: loss 0.17155. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.01it/s]
Epoch 3 Iter 195: loss 0.17155. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.00it/s]
Epoch 3 Iter 196: loss 0.17434. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  2.00it/s]
Epoch 3 Iter 196: loss 0.17434. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.00it/s]
Epoch 3 Iter 197: loss 0.18002. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.00it/s]
Epoch 3 Iter 197: loss 0.18002. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.00it/s]
Epoch 3 Iter 198: loss 0.17868. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  2.00it/s]
Epoch 3 Iter 198: loss 0.17868. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.01it/s]
Epoch 3 Iter 199: loss 0.18884. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.01it/s]
Epoch 3 Iter 199: loss 0.18884. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.02it/s]
Epoch 3 Iter 200: loss 0.17779. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  2.02it/s]
Epoch 3 Iter 200: loss 0.17779. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.99it/s]
Epoch 3 Iter 201: loss 0.16465. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.99it/s]
Epoch 3 Iter 201: loss 0.16465. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 3 Iter 202: loss 0.17709. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.99it/s]
Epoch 3 Iter 202: loss 0.17709. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 3 Iter 203: loss 0.19688. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 3 Iter 203: loss 0.19688. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.19918. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.19918. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.99it/s]
Epoch 3 Iter 205: loss 0.17238. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.99it/s]
Epoch 3 Iter 205: loss 0.17238. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.00it/s]
Epoch 3 Iter 206: loss 0.17014. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.00it/s]
Epoch 3 Iter 206: loss 0.17014. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.02it/s]
Epoch 3 Iter 207: loss 0.17589. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.02it/s]
Epoch 3 Iter 207: loss 0.17589. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.02it/s]
Epoch 3 Iter 208: loss 0.18064. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.02it/s]
Epoch 3 Iter 208: loss 0.18064. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 3 Iter 209: loss 0.17566. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 3 Iter 209: loss 0.17566. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.02it/s]
Epoch 3 Iter 210: loss 0.19176. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.02it/s]
Epoch 3 Iter 210: loss 0.19176. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.02it/s]
Epoch 3 Iter 211: loss 0.17144. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.02it/s]
Epoch 3 Iter 211: loss 0.17144. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.03it/s]
Epoch 3 Iter 212: loss 0.16384. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.03it/s]
Epoch 3 Iter 212: loss 0.16384. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 3 Iter 213: loss 0.16110. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 3 Iter 213: loss 0.16110. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.03it/s]
Epoch 3 Iter 214: loss 0.18785. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.03it/s]
Epoch 3 Iter 214: loss 0.18785. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.03it/s]
Epoch 3 Iter 215: loss 0.17750. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.03it/s]
Epoch 3 Iter 215: loss 0.17750. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.03it/s]
Epoch 3 Iter 216: loss 0.19526. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.03it/s]
Epoch 3 Iter 216: loss 0.19526. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 3 Iter 217: loss 0.15801. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 3 Iter 217: loss 0.15801. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.02it/s]
Epoch 3 Iter 218: loss 0.16844. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.02it/s]
Epoch 3 Iter 218: loss 0.16844. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.03it/s]
Epoch 3 Iter 219: loss 0.15815. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.03it/s]
Epoch 3 Iter 219: loss 0.15815. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.03it/s]
Epoch 3 Iter 220: loss 0.16239. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.03it/s]
Epoch 3 Iter 220: loss 0.16239. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.03it/s]
Epoch 3 Iter 221: loss 0.19455. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.03it/s]
Epoch 3 Iter 221: loss 0.19455. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.03it/s]
Epoch 3 Iter 222: loss 0.18276. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.03it/s]
Epoch 3 Iter 222: loss 0.18276. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 3 Iter 223: loss 0.18737. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 3 Iter 223: loss 0.18737. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.01it/s]
Epoch 3 Iter 224: loss 0.16821. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.01it/s]
Epoch 3 Iter 224: loss 0.16821. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]
Epoch 3 Iter 224: loss 0.16821. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

    Train loss: 0.17987
    Valid loss: 0.18415
       Valid loss recons: 0.18415
       Valid loss KL-D:   6879.50646
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.17601. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.17601. :   0%|▏                                               | 1/224 [00:00<01:50,  2.03it/s]
Epoch 4 Iter 2: loss 0.17566. :   0%|▏                                               | 1/224 [00:00<01:50,  2.03it/s]
Epoch 4 Iter 2: loss 0.17566. :   1%|▍                                               | 2/224 [00:00<01:49,  2.03it/s]
Epoch 4 Iter 3: loss 0.19856. :   1%|▍                                               | 2/224 [00:01<01:49,  2.03it/s]
Epoch 4 Iter 3: loss 0.19856. :   1%|▋                                               | 3/224 [00:01<01:49,  2.03it/s]
Epoch 4 Iter 4: loss 0.15720. :   1%|▋                                               | 3/224 [00:01<01:49,  2.03it/s]
Epoch 4 Iter 4: loss 0.15720. :   2%|▊                                               | 4/224 [00:01<01:48,  2.02it/s]
Epoch 4 Iter 5: loss 0.19075. :   2%|▊                                               | 4/224 [00:02<01:48,  2.02it/s]
Epoch 4 Iter 5: loss 0.19075. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 4 Iter 6: loss 0.18805. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 4 Iter 6: loss 0.18805. :   3%|█▎                                              | 6/224 [00:02<01:46,  2.04it/s]
Epoch 4 Iter 7: loss 0.16423. :   3%|█▎                                              | 6/224 [00:03<01:46,  2.04it/s]
Epoch 4 Iter 7: loss 0.16423. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 4 Iter 8: loss 0.18799. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 4 Iter 8: loss 0.18799. :   4%|█▋                                              | 8/224 [00:03<01:46,  2.03it/s]
Epoch 4 Iter 9: loss 0.18582. :   4%|█▋                                              | 8/224 [00:04<01:46,  2.03it/s]
Epoch 4 Iter 9: loss 0.18582. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.02it/s]
Epoch 4 Iter 10: loss 0.19471. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 4 Iter 10: loss 0.19471. :   4%|██                                            | 10/224 [00:04<01:46,  2.02it/s]
Epoch 4 Iter 11: loss 0.17714. :   4%|██                                            | 10/224 [00:05<01:46,  2.02it/s]
Epoch 4 Iter 11: loss 0.17714. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.02it/s]
Epoch 4 Iter 12: loss 0.17734. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.02it/s]
Epoch 4 Iter 12: loss 0.17734. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.02it/s]
Epoch 4 Iter 13: loss 0.15829. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 4 Iter 13: loss 0.15829. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 4 Iter 14: loss 0.18110. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 4 Iter 14: loss 0.18110. :   6%|██▉                                           | 14/224 [00:06<01:46,  1.96it/s]
Epoch 4 Iter 15: loss 0.16075. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.96it/s]
Epoch 4 Iter 15: loss 0.16075. :   7%|███                                           | 15/224 [00:07<01:46,  1.97it/s]
Epoch 4 Iter 16: loss 0.17746. :   7%|███                                           | 15/224 [00:07<01:46,  1.97it/s]
Epoch 4 Iter 16: loss 0.17746. :   7%|███▎                                          | 16/224 [00:07<01:45,  1.97it/s]
Epoch 4 Iter 17: loss 0.17956. :   7%|███▎                                          | 16/224 [00:08<01:45,  1.97it/s]
Epoch 4 Iter 17: loss 0.17956. :   8%|███▍                                          | 17/224 [00:08<01:44,  1.98it/s]
Epoch 4 Iter 18: loss 0.18298. :   8%|███▍                                          | 17/224 [00:08<01:44,  1.98it/s]
Epoch 4 Iter 18: loss 0.18298. :   8%|███▋                                          | 18/224 [00:08<01:43,  1.99it/s]
Epoch 4 Iter 19: loss 0.18340. :   8%|███▋                                          | 18/224 [00:09<01:43,  1.99it/s]
Epoch 4 Iter 19: loss 0.18340. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.00it/s]
Epoch 4 Iter 20: loss 0.15962. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.00it/s]
Epoch 4 Iter 20: loss 0.15962. :   9%|████                                          | 20/224 [00:09<01:42,  2.00it/s]
Epoch 4 Iter 21: loss 0.16069. :   9%|████                                          | 20/224 [00:10<01:42,  2.00it/s]
Epoch 4 Iter 21: loss 0.16069. :   9%|████▎                                         | 21/224 [00:10<01:41,  2.01it/s]
Epoch 4 Iter 22: loss 0.18659. :   9%|████▎                                         | 21/224 [00:10<01:41,  2.01it/s]
Epoch 4 Iter 22: loss 0.18659. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.02it/s]
Epoch 4 Iter 23: loss 0.19970. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 4 Iter 23: loss 0.19970. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.01it/s]
Epoch 4 Iter 24: loss 0.18035. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.01it/s]
Epoch 4 Iter 24: loss 0.18035. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.01it/s]
Epoch 4 Iter 25: loss 0.17142. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 4 Iter 25: loss 0.17142. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 4 Iter 26: loss 0.17792. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 4 Iter 26: loss 0.17792. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.02it/s]
Epoch 4 Iter 27: loss 0.15766. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.02it/s]
Epoch 4 Iter 27: loss 0.15766. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.01it/s]
Epoch 4 Iter 28: loss 0.17372. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.01it/s]
Epoch 4 Iter 28: loss 0.17372. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.01it/s]
Epoch 4 Iter 29: loss 0.18455. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.01it/s]
Epoch 4 Iter 29: loss 0.18455. :  13%|█████▉                                        | 29/224 [00:14<01:37,  2.01it/s]
Epoch 4 Iter 30: loss 0.16911. :  13%|█████▉                                        | 29/224 [00:14<01:37,  2.01it/s]
Epoch 4 Iter 30: loss 0.16911. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 4 Iter 31: loss 0.19210. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 4 Iter 31: loss 0.19210. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 4 Iter 32: loss 0.18576. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 4 Iter 32: loss 0.18576. :  14%|██████▌                                       | 32/224 [00:15<01:36,  1.99it/s]
Epoch 4 Iter 33: loss 0.18766. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 4 Iter 33: loss 0.18766. :  15%|██████▊                                       | 33/224 [00:16<01:35,  2.00it/s]
Epoch 4 Iter 34: loss 0.17354. :  15%|██████▊                                       | 33/224 [00:16<01:35,  2.00it/s]
Epoch 4 Iter 34: loss 0.17354. :  15%|██████▉                                       | 34/224 [00:16<01:35,  1.99it/s]
Epoch 4 Iter 35: loss 0.16487. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 4 Iter 35: loss 0.16487. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.01it/s]
Epoch 4 Iter 36: loss 0.18261. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.01it/s]
Epoch 4 Iter 36: loss 0.18261. :  16%|███████▍                                      | 36/224 [00:17<01:34,  1.99it/s]
Epoch 4 Iter 37: loss 0.17219. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.99it/s]
Epoch 4 Iter 37: loss 0.17219. :  17%|███████▌                                      | 37/224 [00:18<01:36,  1.93it/s]
Epoch 4 Iter 38: loss 0.17313. :  17%|███████▌                                      | 37/224 [00:19<01:36,  1.93it/s]
Epoch 4 Iter 38: loss 0.17313. :  17%|███████▊                                      | 38/224 [00:19<01:35,  1.95it/s]
Epoch 4 Iter 39: loss 0.16783. :  17%|███████▊                                      | 38/224 [00:19<01:35,  1.95it/s]
Epoch 4 Iter 39: loss 0.16783. :  17%|████████                                      | 39/224 [00:19<01:34,  1.96it/s]
Epoch 4 Iter 40: loss 0.15348. :  17%|████████                                      | 39/224 [00:20<01:34,  1.96it/s]
Epoch 4 Iter 40: loss 0.15348. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 4 Iter 41: loss 0.19377. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 4 Iter 41: loss 0.19377. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 4 Iter 42: loss 0.17956. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 4 Iter 42: loss 0.17956. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 4 Iter 43: loss 0.17552. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 4 Iter 43: loss 0.17552. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 4 Iter 44: loss 0.16229. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 4 Iter 44: loss 0.16229. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.02it/s]
Epoch 4 Iter 45: loss 0.14772. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.02it/s]
Epoch 4 Iter 45: loss 0.14772. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 4 Iter 46: loss 0.17478. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 4 Iter 46: loss 0.17478. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.01it/s]
Epoch 4 Iter 47: loss 0.17949. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 4 Iter 47: loss 0.17949. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.02it/s]
Epoch 4 Iter 48: loss 0.19715. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.02it/s]
Epoch 4 Iter 48: loss 0.19715. :  21%|█████████▊                                    | 48/224 [00:23<01:26,  2.02it/s]
Epoch 4 Iter 49: loss 0.16075. :  21%|█████████▊                                    | 48/224 [00:24<01:26,  2.02it/s]
Epoch 4 Iter 49: loss 0.16075. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.03it/s]
Epoch 4 Iter 50: loss 0.18180. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.03it/s]
Epoch 4 Iter 50: loss 0.18180. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.02it/s]
Epoch 4 Iter 51: loss 0.17497. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.02it/s]
Epoch 4 Iter 51: loss 0.17497. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.03it/s]
Epoch 4 Iter 52: loss 0.18031. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.03it/s]
Epoch 4 Iter 52: loss 0.18031. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 4 Iter 53: loss 0.18212. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.02it/s]
Epoch 4 Iter 53: loss 0.18212. :  24%|██████████▉                                   | 53/224 [00:26<01:31,  1.88it/s]
Epoch 4 Iter 54: loss 0.16802. :  24%|██████████▉                                   | 53/224 [00:27<01:31,  1.88it/s]
Epoch 4 Iter 54: loss 0.16802. :  24%|███████████                                   | 54/224 [00:27<01:30,  1.89it/s]
Epoch 4 Iter 55: loss 0.18028. :  24%|███████████                                   | 54/224 [00:27<01:30,  1.89it/s]
Epoch 4 Iter 55: loss 0.18028. :  25%|███████████▎                                  | 55/224 [00:27<01:27,  1.93it/s]
Epoch 4 Iter 56: loss 0.16816. :  25%|███████████▎                                  | 55/224 [00:28<01:27,  1.93it/s]
Epoch 4 Iter 56: loss 0.16816. :  25%|███████████▌                                  | 56/224 [00:28<01:26,  1.95it/s]
Epoch 4 Iter 57: loss 0.18192. :  25%|███████████▌                                  | 56/224 [00:28<01:26,  1.95it/s]
Epoch 4 Iter 57: loss 0.18192. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.97it/s]
Epoch 4 Iter 58: loss 0.19242. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 4 Iter 58: loss 0.19242. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 4 Iter 59: loss 0.16305. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 4 Iter 59: loss 0.16305. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.00it/s]
Epoch 4 Iter 60: loss 0.17858. :  26%|████████████                                  | 59/224 [00:30<01:22,  2.00it/s]
Epoch 4 Iter 60: loss 0.17858. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 4 Iter 61: loss 0.18089. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 4 Iter 61: loss 0.18089. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.01it/s]
Epoch 4 Iter 62: loss 0.18136. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.01it/s]
Epoch 4 Iter 62: loss 0.18136. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.99it/s]
Epoch 4 Iter 63: loss 0.16705. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.99it/s]
Epoch 4 Iter 63: loss 0.16705. :  28%|████████████▉                                 | 63/224 [00:31<01:23,  1.93it/s]
Epoch 4 Iter 64: loss 0.17222. :  28%|████████████▉                                 | 63/224 [00:32<01:23,  1.93it/s]
Epoch 4 Iter 64: loss 0.17222. :  29%|█████████████▏                                | 64/224 [00:32<01:22,  1.94it/s]
Epoch 4 Iter 65: loss 0.17714. :  29%|█████████████▏                                | 64/224 [00:32<01:22,  1.94it/s]
Epoch 4 Iter 65: loss 0.17714. :  29%|█████████████▎                                | 65/224 [00:32<01:23,  1.91it/s]
Epoch 4 Iter 66: loss 0.18003. :  29%|█████████████▎                                | 65/224 [00:33<01:23,  1.91it/s]
Epoch 4 Iter 66: loss 0.18003. :  29%|█████████████▌                                | 66/224 [00:33<01:22,  1.91it/s]
Epoch 4 Iter 67: loss 0.16898. :  29%|█████████████▌                                | 66/224 [00:33<01:22,  1.91it/s]
Epoch 4 Iter 67: loss 0.16898. :  30%|█████████████▊                                | 67/224 [00:33<01:22,  1.91it/s]
Epoch 4 Iter 68: loss 0.18276. :  30%|█████████████▊                                | 67/224 [00:34<01:22,  1.91it/s]
Epoch 4 Iter 68: loss 0.18276. :  30%|█████████████▉                                | 68/224 [00:34<01:21,  1.91it/s]
Epoch 4 Iter 69: loss 0.16827. :  30%|█████████████▉                                | 68/224 [00:34<01:21,  1.91it/s]
Epoch 4 Iter 69: loss 0.16827. :  31%|██████████████▏                               | 69/224 [00:34<01:20,  1.93it/s]
Epoch 4 Iter 70: loss 0.17940. :  31%|██████████████▏                               | 69/224 [00:35<01:20,  1.93it/s]
Epoch 4 Iter 70: loss 0.17940. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.94it/s]
Epoch 4 Iter 71: loss 0.17174. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.94it/s]
Epoch 4 Iter 71: loss 0.17174. :  32%|██████████████▌                               | 71/224 [00:35<01:18,  1.96it/s]
Epoch 4 Iter 72: loss 0.17578. :  32%|██████████████▌                               | 71/224 [00:36<01:18,  1.96it/s]
Epoch 4 Iter 72: loss 0.17578. :  32%|██████████████▊                               | 72/224 [00:36<01:18,  1.95it/s]
Epoch 4 Iter 73: loss 0.16508. :  32%|██████████████▊                               | 72/224 [00:36<01:18,  1.95it/s]
Epoch 4 Iter 73: loss 0.16508. :  33%|██████████████▉                               | 73/224 [00:36<01:17,  1.94it/s]
Epoch 4 Iter 74: loss 0.19006. :  33%|██████████████▉                               | 73/224 [00:37<01:17,  1.94it/s]
Epoch 4 Iter 74: loss 0.19006. :  33%|███████████████▏                              | 74/224 [00:37<01:18,  1.91it/s]
Epoch 4 Iter 75: loss 0.17183. :  33%|███████████████▏                              | 74/224 [00:37<01:18,  1.91it/s]
Epoch 4 Iter 75: loss 0.17183. :  33%|███████████████▍                              | 75/224 [00:37<01:17,  1.93it/s]
Epoch 4 Iter 76: loss 0.18477. :  33%|███████████████▍                              | 75/224 [00:38<01:17,  1.93it/s]
Epoch 4 Iter 76: loss 0.18477. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.94it/s]
Epoch 4 Iter 77: loss 0.16922. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.94it/s]
Epoch 4 Iter 77: loss 0.16922. :  34%|███████████████▊                              | 77/224 [00:38<01:15,  1.95it/s]
Epoch 4 Iter 78: loss 0.17057. :  34%|███████████████▊                              | 77/224 [00:39<01:15,  1.95it/s]
Epoch 4 Iter 78: loss 0.17057. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.96it/s]
Epoch 4 Iter 79: loss 0.18232. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.96it/s]
Epoch 4 Iter 79: loss 0.18232. :  35%|████████████████▏                             | 79/224 [00:39<01:13,  1.96it/s]
Epoch 4 Iter 80: loss 0.17038. :  35%|████████████████▏                             | 79/224 [00:40<01:13,  1.96it/s]
Epoch 4 Iter 80: loss 0.17038. :  36%|████████████████▍                             | 80/224 [00:40<01:13,  1.95it/s]
Epoch 4 Iter 81: loss 0.16235. :  36%|████████████████▍                             | 80/224 [00:40<01:13,  1.95it/s]
Epoch 4 Iter 81: loss 0.16235. :  36%|████████████████▋                             | 81/224 [00:40<01:14,  1.91it/s]
Epoch 4 Iter 82: loss 0.17057. :  36%|████████████████▋                             | 81/224 [00:41<01:14,  1.91it/s]
Epoch 4 Iter 82: loss 0.17057. :  37%|████████████████▊                             | 82/224 [00:41<01:12,  1.95it/s]
Epoch 4 Iter 83: loss 0.17855. :  37%|████████████████▊                             | 82/224 [00:41<01:12,  1.95it/s]
Epoch 4 Iter 83: loss 0.17855. :  37%|█████████████████                             | 83/224 [00:41<01:12,  1.95it/s]
Epoch 4 Iter 84: loss 0.17842. :  37%|█████████████████                             | 83/224 [00:42<01:12,  1.95it/s]
Epoch 4 Iter 84: loss 0.17842. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.97it/s]
Epoch 4 Iter 85: loss 0.17582. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.97it/s]
Epoch 4 Iter 85: loss 0.17582. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  1.99it/s]
Epoch 4 Iter 86: loss 0.18998. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  1.99it/s]
Epoch 4 Iter 86: loss 0.18998. :  38%|█████████████████▋                            | 86/224 [00:43<01:10,  1.97it/s]
Epoch 4 Iter 87: loss 0.18145. :  38%|█████████████████▋                            | 86/224 [00:43<01:10,  1.97it/s]
Epoch 4 Iter 87: loss 0.18145. :  39%|█████████████████▊                            | 87/224 [00:43<01:09,  1.97it/s]
Epoch 4 Iter 88: loss 0.18274. :  39%|█████████████████▊                            | 87/224 [00:44<01:09,  1.97it/s]
Epoch 4 Iter 88: loss 0.18274. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.97it/s]
Epoch 4 Iter 89: loss 0.17265. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.97it/s]
Epoch 4 Iter 89: loss 0.17265. :  40%|██████████████████▎                           | 89/224 [00:44<01:08,  1.96it/s]
Epoch 4 Iter 90: loss 0.17095. :  40%|██████████████████▎                           | 89/224 [00:45<01:08,  1.96it/s]
Epoch 4 Iter 90: loss 0.17095. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 4 Iter 91: loss 0.18325. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 4 Iter 91: loss 0.18325. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.00it/s]
Epoch 4 Iter 92: loss 0.19166. :  41%|██████████████████▋                           | 91/224 [00:46<01:06,  2.00it/s]
Epoch 4 Iter 92: loss 0.19166. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.99it/s]
Epoch 4 Iter 93: loss 0.17642. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.99it/s]
Epoch 4 Iter 93: loss 0.17642. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.00it/s]
Epoch 4 Iter 94: loss 0.19428. :  42%|███████████████████                           | 93/224 [00:47<01:05,  2.00it/s]
Epoch 4 Iter 94: loss 0.19428. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.00it/s]
Epoch 4 Iter 95: loss 0.18056. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.00it/s]
Epoch 4 Iter 95: loss 0.18056. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  1.99it/s]
Epoch 4 Iter 96: loss 0.20745. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 4 Iter 96: loss 0.20745. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 4 Iter 97: loss 0.16996. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 4 Iter 97: loss 0.16996. :  43%|███████████████████▉                          | 97/224 [00:48<01:05,  1.95it/s]
Epoch 4 Iter 98: loss 0.18216. :  43%|███████████████████▉                          | 97/224 [00:49<01:05,  1.95it/s]
Epoch 4 Iter 98: loss 0.18216. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.96it/s]
Epoch 4 Iter 99: loss 0.17100. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.96it/s]
Epoch 4 Iter 99: loss 0.17100. :  44%|████████████████████▎                         | 99/224 [00:49<01:03,  1.97it/s]
Epoch 4 Iter 100: loss 0.17086. :  44%|███████████████████▉                         | 99/224 [00:50<01:03,  1.97it/s]
Epoch 4 Iter 100: loss 0.17086. :  45%|███████████████████▋                        | 100/224 [00:50<01:02,  1.99it/s]
Epoch 4 Iter 101: loss 0.20459. :  45%|███████████████████▋                        | 100/224 [00:51<01:02,  1.99it/s]
Epoch 4 Iter 101: loss 0.20459. :  45%|███████████████████▊                        | 101/224 [00:51<01:03,  1.95it/s]
Epoch 4 Iter 102: loss 0.20386. :  45%|███████████████████▊                        | 101/224 [00:51<01:03,  1.95it/s]
Epoch 4 Iter 102: loss 0.20386. :  46%|████████████████████                        | 102/224 [00:51<01:04,  1.90it/s]
Epoch 4 Iter 103: loss 0.15045. :  46%|████████████████████                        | 102/224 [00:52<01:04,  1.90it/s]
Epoch 4 Iter 103: loss 0.15045. :  46%|████████████████████▏                       | 103/224 [00:52<01:07,  1.79it/s]
Epoch 4 Iter 104: loss 0.17937. :  46%|████████████████████▏                       | 103/224 [00:52<01:07,  1.79it/s]
Epoch 4 Iter 104: loss 0.17937. :  46%|████████████████████▍                       | 104/224 [00:52<01:06,  1.82it/s]
Epoch 4 Iter 105: loss 0.18566. :  46%|████████████████████▍                       | 104/224 [00:53<01:06,  1.82it/s]
Epoch 4 Iter 105: loss 0.18566. :  47%|████████████████████▋                       | 105/224 [00:53<01:04,  1.86it/s]
Epoch 4 Iter 106: loss 0.18474. :  47%|████████████████████▋                       | 105/224 [00:53<01:04,  1.86it/s]
Epoch 4 Iter 106: loss 0.18474. :  47%|████████████████████▊                       | 106/224 [00:53<01:02,  1.88it/s]
Epoch 4 Iter 107: loss 0.19507. :  47%|████████████████████▊                       | 106/224 [00:54<01:02,  1.88it/s]
Epoch 4 Iter 107: loss 0.19507. :  48%|█████████████████████                       | 107/224 [00:54<01:01,  1.91it/s]
Epoch 4 Iter 108: loss 0.17485. :  48%|█████████████████████                       | 107/224 [00:54<01:01,  1.91it/s]
Epoch 4 Iter 108: loss 0.17485. :  48%|█████████████████████▏                      | 108/224 [00:54<00:59,  1.93it/s]
Epoch 4 Iter 109: loss 0.19510. :  48%|█████████████████████▏                      | 108/224 [00:55<00:59,  1.93it/s]
Epoch 4 Iter 109: loss 0.19510. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.95it/s]
Epoch 4 Iter 110: loss 0.16178. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.95it/s]
Epoch 4 Iter 110: loss 0.16178. :  49%|█████████████████████▌                      | 110/224 [00:55<00:58,  1.95it/s]
Epoch 4 Iter 111: loss 0.17840. :  49%|█████████████████████▌                      | 110/224 [00:56<00:58,  1.95it/s]
Epoch 4 Iter 111: loss 0.17840. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.97it/s]
Epoch 4 Iter 112: loss 0.18565. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.97it/s]
Epoch 4 Iter 112: loss 0.18565. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.99it/s]
Epoch 4 Iter 113: loss 0.17023. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.99it/s]
Epoch 4 Iter 113: loss 0.17023. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  2.00it/s]
Epoch 4 Iter 114: loss 0.16395. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  2.00it/s]
Epoch 4 Iter 114: loss 0.16395. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.99it/s]
Epoch 4 Iter 115: loss 0.16152. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.99it/s]
Epoch 4 Iter 115: loss 0.16152. :  51%|██████████████████████▌                     | 115/224 [00:58<00:54,  2.00it/s]
Epoch 4 Iter 116: loss 0.17287. :  51%|██████████████████████▌                     | 115/224 [00:58<00:54,  2.00it/s]
Epoch 4 Iter 116: loss 0.17287. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.01it/s]
Epoch 4 Iter 117: loss 0.19033. :  52%|██████████████████████▊                     | 116/224 [00:59<00:53,  2.01it/s]
Epoch 4 Iter 117: loss 0.19033. :  52%|██████████████████████▉                     | 117/224 [00:59<00:53,  2.01it/s]
Epoch 4 Iter 118: loss 0.18537. :  52%|██████████████████████▉                     | 117/224 [00:59<00:53,  2.01it/s]
Epoch 4 Iter 118: loss 0.18537. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.01it/s]
Epoch 4 Iter 119: loss 0.14871. :  53%|███████████████████████▏                    | 118/224 [01:00<00:52,  2.01it/s]
Epoch 4 Iter 119: loss 0.14871. :  53%|███████████████████████▍                    | 119/224 [01:00<00:52,  2.01it/s]
Epoch 4 Iter 120: loss 0.16798. :  53%|███████████████████████▍                    | 119/224 [01:00<00:52,  2.01it/s]
Epoch 4 Iter 120: loss 0.16798. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 4 Iter 121: loss 0.17183. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.98it/s]
Epoch 4 Iter 121: loss 0.17183. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  1.98it/s]
Epoch 4 Iter 122: loss 0.17834. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  1.98it/s]
Epoch 4 Iter 122: loss 0.17834. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.99it/s]
Epoch 4 Iter 123: loss 0.17027. :  54%|███████████████████████▉                    | 122/224 [01:02<00:51,  1.99it/s]
Epoch 4 Iter 123: loss 0.17027. :  55%|████████████████████████▏                   | 123/224 [01:02<00:50,  2.00it/s]
Epoch 4 Iter 124: loss 0.19181. :  55%|████████████████████████▏                   | 123/224 [01:02<00:50,  2.00it/s]
Epoch 4 Iter 124: loss 0.19181. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.00it/s]
Epoch 4 Iter 125: loss 0.17575. :  55%|████████████████████████▎                   | 124/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 125: loss 0.17575. :  56%|████████████████████████▌                   | 125/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 126: loss 0.18047. :  56%|████████████████████████▌                   | 125/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 126: loss 0.18047. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.00it/s]
Epoch 4 Iter 127: loss 0.16266. :  56%|████████████████████████▊                   | 126/224 [01:04<00:48,  2.00it/s]
Epoch 4 Iter 127: loss 0.16266. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.01it/s]
Epoch 4 Iter 128: loss 0.15923. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.01it/s]
Epoch 4 Iter 128: loss 0.15923. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 4 Iter 129: loss 0.18487. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:47,  2.01it/s]
Epoch 4 Iter 129: loss 0.18487. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  2.02it/s]
Epoch 4 Iter 130: loss 0.19995. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  2.02it/s]
Epoch 4 Iter 130: loss 0.19995. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.02it/s]
Epoch 4 Iter 131: loss 0.19581. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:46,  2.02it/s]
Epoch 4 Iter 131: loss 0.19581. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.00it/s]
Epoch 4 Iter 132: loss 0.18119. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.00it/s]
Epoch 4 Iter 132: loss 0.18119. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.00it/s]
Epoch 4 Iter 133: loss 0.16219. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:45,  2.00it/s]
Epoch 4 Iter 133: loss 0.16219. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.99it/s]
Epoch 4 Iter 134: loss 0.18561. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.99it/s]
Epoch 4 Iter 134: loss 0.18561. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.98it/s]
Epoch 4 Iter 135: loss 0.18628. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 4 Iter 135: loss 0.18628. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.98it/s]
Epoch 4 Iter 136: loss 0.18004. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.98it/s]
Epoch 4 Iter 136: loss 0.18004. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.98it/s]
Epoch 4 Iter 137: loss 0.16678. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:44,  1.98it/s]
Epoch 4 Iter 137: loss 0.16678. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:44,  1.96it/s]
Epoch 4 Iter 138: loss 0.19166. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:44,  1.96it/s]
Epoch 4 Iter 138: loss 0.19166. :  62%|███████████████████████████                 | 138/224 [01:09<00:47,  1.83it/s]
Epoch 4 Iter 139: loss 0.15742. :  62%|███████████████████████████                 | 138/224 [01:10<00:47,  1.83it/s]
Epoch 4 Iter 139: loss 0.15742. :  62%|███████████████████████████▎                | 139/224 [01:10<00:45,  1.85it/s]
Epoch 4 Iter 140: loss 0.17189. :  62%|███████████████████████████▎                | 139/224 [01:10<00:45,  1.85it/s]
Epoch 4 Iter 140: loss 0.17189. :  62%|███████████████████████████▌                | 140/224 [01:10<00:44,  1.89it/s]
Epoch 4 Iter 141: loss 0.17153. :  62%|███████████████████████████▌                | 140/224 [01:11<00:44,  1.89it/s]
Epoch 4 Iter 141: loss 0.17153. :  63%|███████████████████████████▋                | 141/224 [01:11<00:43,  1.93it/s]
Epoch 4 Iter 142: loss 0.16191. :  63%|███████████████████████████▋                | 141/224 [01:11<00:43,  1.93it/s]
Epoch 4 Iter 142: loss 0.16191. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  1.95it/s]
Epoch 4 Iter 143: loss 0.16446. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.95it/s]
Epoch 4 Iter 143: loss 0.16446. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  1.98it/s]
Epoch 4 Iter 144: loss 0.18577. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  1.98it/s]
Epoch 4 Iter 144: loss 0.18577. :  64%|████████████████████████████▎               | 144/224 [01:12<00:40,  1.99it/s]
Epoch 4 Iter 145: loss 0.17093. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.99it/s]
Epoch 4 Iter 145: loss 0.17093. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.00it/s]
Epoch 4 Iter 146: loss 0.17228. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.00it/s]
Epoch 4 Iter 146: loss 0.17228. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.02it/s]
Epoch 4 Iter 147: loss 0.17962. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.02it/s]
Epoch 4 Iter 147: loss 0.17962. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.02it/s]
Epoch 4 Iter 148: loss 0.16881. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.02it/s]
Epoch 4 Iter 148: loss 0.16881. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.01it/s]
Epoch 4 Iter 149: loss 0.18927. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.01it/s]
Epoch 4 Iter 149: loss 0.18927. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.01it/s]
Epoch 4 Iter 150: loss 0.17238. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.01it/s]
Epoch 4 Iter 150: loss 0.17238. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.02it/s]
Epoch 4 Iter 151: loss 0.18953. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.02it/s]
Epoch 4 Iter 151: loss 0.18953. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.03it/s]
Epoch 4 Iter 152: loss 0.17209. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.03it/s]
Epoch 4 Iter 152: loss 0.17209. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.02it/s]
Epoch 4 Iter 153: loss 0.17716. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.02it/s]
Epoch 4 Iter 153: loss 0.17716. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  2.02it/s]
Epoch 4 Iter 154: loss 0.17944. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  2.02it/s]
Epoch 4 Iter 154: loss 0.17944. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.03it/s]
Epoch 4 Iter 155: loss 0.17787. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:34,  2.03it/s]
Epoch 4 Iter 155: loss 0.17787. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.02it/s]
Epoch 4 Iter 156: loss 0.18585. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.02it/s]
Epoch 4 Iter 156: loss 0.18585. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.03it/s]
Epoch 4 Iter 157: loss 0.19411. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.03it/s]
Epoch 4 Iter 157: loss 0.19411. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.03it/s]
Epoch 4 Iter 158: loss 0.16780. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.03it/s]
Epoch 4 Iter 158: loss 0.16780. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.02it/s]
Epoch 4 Iter 159: loss 0.15605. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.02it/s]
Epoch 4 Iter 159: loss 0.15605. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:35,  1.81it/s]
Epoch 4 Iter 160: loss 0.18075. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:35,  1.81it/s]
Epoch 4 Iter 160: loss 0.18075. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:34,  1.84it/s]
Epoch 4 Iter 161: loss 0.17400. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:34,  1.84it/s]
Epoch 4 Iter 161: loss 0.17400. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:34,  1.82it/s]
Epoch 4 Iter 162: loss 0.18692. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:34,  1.82it/s]
Epoch 4 Iter 162: loss 0.18692. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.88it/s]
Epoch 4 Iter 163: loss 0.17721. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.88it/s]
Epoch 4 Iter 163: loss 0.17721. :  73%|████████████████████████████████            | 163/224 [01:22<00:31,  1.92it/s]
Epoch 4 Iter 164: loss 0.17099. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.92it/s]
Epoch 4 Iter 164: loss 0.17099. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.94it/s]
Epoch 4 Iter 165: loss 0.19915. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.94it/s]
Epoch 4 Iter 165: loss 0.19915. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.96it/s]
Epoch 4 Iter 166: loss 0.17627. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:30,  1.96it/s]
Epoch 4 Iter 166: loss 0.17627. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.99it/s]
Epoch 4 Iter 167: loss 0.18075. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.99it/s]
Epoch 4 Iter 167: loss 0.18075. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  2.01it/s]
Epoch 4 Iter 168: loss 0.19758. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:28,  2.01it/s]
Epoch 4 Iter 168: loss 0.19758. :  75%|█████████████████████████████████           | 168/224 [01:25<00:27,  2.02it/s]
Epoch 4 Iter 169: loss 0.15827. :  75%|█████████████████████████████████           | 168/224 [01:25<00:27,  2.02it/s]
Epoch 4 Iter 169: loss 0.15827. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  2.01it/s]
Epoch 4 Iter 170: loss 0.17922. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:27,  2.01it/s]
Epoch 4 Iter 170: loss 0.17922. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.02it/s]
Epoch 4 Iter 171: loss 0.15031. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.02it/s]
Epoch 4 Iter 171: loss 0.15031. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  2.02it/s]
Epoch 4 Iter 172: loss 0.17838. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  2.02it/s]
Epoch 4 Iter 172: loss 0.17838. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.03it/s]
Epoch 4 Iter 173: loss 0.17346. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.03it/s]
Epoch 4 Iter 173: loss 0.17346. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.02it/s]
Epoch 4 Iter 174: loss 0.19109. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  2.02it/s]
Epoch 4 Iter 174: loss 0.19109. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.01it/s]
Epoch 4 Iter 175: loss 0.15999. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.01it/s]
Epoch 4 Iter 175: loss 0.15999. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.01it/s]
Epoch 4 Iter 176: loss 0.15396. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  2.01it/s]
Epoch 4 Iter 176: loss 0.15396. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.01it/s]
Epoch 4 Iter 177: loss 0.19304. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.01it/s]
Epoch 4 Iter 177: loss 0.19304. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:24,  1.95it/s]
Epoch 4 Iter 178: loss 0.19793. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:24,  1.95it/s]
Epoch 4 Iter 178: loss 0.19793. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:24,  1.84it/s]
Epoch 4 Iter 179: loss 0.18668. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:24,  1.84it/s]
Epoch 4 Iter 179: loss 0.18668. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:24,  1.81it/s]
Epoch 4 Iter 180: loss 0.17589. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:24,  1.81it/s]
Epoch 4 Iter 180: loss 0.17589. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:24,  1.78it/s]
Epoch 4 Iter 181: loss 0.18753. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:24,  1.78it/s]
Epoch 4 Iter 181: loss 0.18753. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:24,  1.79it/s]
Epoch 4 Iter 182: loss 0.16176. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:24,  1.79it/s]
Epoch 4 Iter 182: loss 0.16176. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:22,  1.83it/s]
Epoch 4 Iter 183: loss 0.18898. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:22,  1.83it/s]
Epoch 4 Iter 183: loss 0.18898. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:21,  1.87it/s]
Epoch 4 Iter 184: loss 0.17191. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:21,  1.87it/s]
Epoch 4 Iter 184: loss 0.17191. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.91it/s]
Epoch 4 Iter 185: loss 0.17020. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.91it/s]
Epoch 4 Iter 185: loss 0.17020. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:20,  1.93it/s]
Epoch 4 Iter 186: loss 0.17067. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:20,  1.93it/s]
Epoch 4 Iter 186: loss 0.17067. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.94it/s]
Epoch 4 Iter 187: loss 0.15931. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.94it/s]
Epoch 4 Iter 187: loss 0.15931. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.97it/s]
Epoch 4 Iter 188: loss 0.17606. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.97it/s]
Epoch 4 Iter 188: loss 0.17606. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.97it/s]
Epoch 4 Iter 189: loss 0.18836. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.97it/s]
Epoch 4 Iter 189: loss 0.18836. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.99it/s]
Epoch 4 Iter 190: loss 0.17074. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  1.99it/s]
Epoch 4 Iter 190: loss 0.17074. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.96it/s]
Epoch 4 Iter 191: loss 0.15634. :  85%|█████████████████████████████████████▎      | 190/224 [01:37<00:17,  1.96it/s]
Epoch 4 Iter 191: loss 0.15634. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:18,  1.82it/s]
Epoch 4 Iter 192: loss 0.18813. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:18,  1.82it/s]
Epoch 4 Iter 192: loss 0.18813. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:17,  1.78it/s]
Epoch 4 Iter 193: loss 0.16538. :  86%|█████████████████████████████████████▋      | 192/224 [01:38<00:17,  1.78it/s]
Epoch 4 Iter 193: loss 0.16538. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:16,  1.83it/s]
Epoch 4 Iter 194: loss 0.18201. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:16,  1.83it/s]
Epoch 4 Iter 194: loss 0.18201. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:16,  1.83it/s]
Epoch 4 Iter 195: loss 0.16529. :  87%|██████████████████████████████████████      | 194/224 [01:39<00:16,  1.83it/s]
Epoch 4 Iter 195: loss 0.16529. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:15,  1.88it/s]
Epoch 4 Iter 196: loss 0.16845. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:15,  1.88it/s]
Epoch 4 Iter 196: loss 0.16845. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.92it/s]
Epoch 4 Iter 197: loss 0.17158. :  88%|██████████████████████████████████████▌     | 196/224 [01:40<00:14,  1.92it/s]
Epoch 4 Iter 197: loss 0.17158. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.94it/s]
Epoch 4 Iter 198: loss 0.15871. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.94it/s]
Epoch 4 Iter 198: loss 0.15871. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.97it/s]
Epoch 4 Iter 199: loss 0.18834. :  88%|██████████████████████████████████████▉     | 198/224 [01:41<00:13,  1.97it/s]
Epoch 4 Iter 199: loss 0.18834. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  1.97it/s]
Epoch 4 Iter 200: loss 0.19137. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  1.97it/s]
Epoch 4 Iter 200: loss 0.19137. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.99it/s]
Epoch 4 Iter 201: loss 0.16634. :  89%|███████████████████████████████████████▎    | 200/224 [01:42<00:12,  1.99it/s]
Epoch 4 Iter 201: loss 0.16634. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.98it/s]
Epoch 4 Iter 202: loss 0.17348. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.98it/s]
Epoch 4 Iter 202: loss 0.17348. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  1.95it/s]
Epoch 4 Iter 203: loss 0.16806. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.95it/s]
Epoch 4 Iter 203: loss 0.16806. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.95it/s]
Epoch 4 Iter 204: loss 0.16406. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.95it/s]
Epoch 4 Iter 204: loss 0.16406. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.95it/s]
Epoch 4 Iter 205: loss 0.18169. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.95it/s]
Epoch 4 Iter 205: loss 0.18169. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.97it/s]
Epoch 4 Iter 206: loss 0.17270. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.97it/s]
Epoch 4 Iter 206: loss 0.17270. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  1.99it/s]
Epoch 4 Iter 207: loss 0.14605. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.99it/s]
Epoch 4 Iter 207: loss 0.14605. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.00it/s]
Epoch 4 Iter 208: loss 0.17645. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.00it/s]
Epoch 4 Iter 208: loss 0.17645. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 4 Iter 209: loss 0.20018. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:07,  2.01it/s]
Epoch 4 Iter 209: loss 0.20018. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 4 Iter 210: loss 0.16622. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 4 Iter 210: loss 0.16622. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 4 Iter 211: loss 0.18069. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:06,  2.01it/s]
Epoch 4 Iter 211: loss 0.18069. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.01it/s]
Epoch 4 Iter 212: loss 0.16381. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.01it/s]
Epoch 4 Iter 212: loss 0.16381. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.01it/s]
Epoch 4 Iter 213: loss 0.19733. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:05,  2.01it/s]
Epoch 4 Iter 213: loss 0.19733. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.01it/s]
Epoch 4 Iter 214: loss 0.16909. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.01it/s]
Epoch 4 Iter 214: loss 0.16909. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.00it/s]
Epoch 4 Iter 215: loss 0.17654. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:04,  2.00it/s]
Epoch 4 Iter 215: loss 0.17654. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.01it/s]
Epoch 4 Iter 216: loss 0.17313. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.01it/s]
Epoch 4 Iter 216: loss 0.17313. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.01it/s]
Epoch 4 Iter 217: loss 0.16130. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:03,  2.01it/s]
Epoch 4 Iter 217: loss 0.16130. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.01it/s]
Epoch 4 Iter 218: loss 0.18052. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.01it/s]
Epoch 4 Iter 218: loss 0.18052. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.99it/s]
Epoch 4 Iter 219: loss 0.17259. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.99it/s]
Epoch 4 Iter 219: loss 0.17259. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.00it/s]
Epoch 4 Iter 220: loss 0.16819. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.00it/s]
Epoch 4 Iter 220: loss 0.16819. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.00it/s]
Epoch 4 Iter 221: loss 0.17418. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:01,  2.00it/s]
Epoch 4 Iter 221: loss 0.17418. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.00it/s]
Epoch 4 Iter 222: loss 0.17733. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.00it/s]
Epoch 4 Iter 222: loss 0.17733. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.01it/s]
Epoch 4 Iter 223: loss 0.17571. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:00,  2.01it/s]
Epoch 4 Iter 223: loss 0.17571. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.91it/s]
Epoch 4 Iter 224: loss 0.17013. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.91it/s]
Epoch 4 Iter 224: loss 0.17013. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.86it/s]
Epoch 4 Iter 224: loss 0.17013. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.97it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.16243. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.16243. :   0%|▏                                               | 1/224 [00:00<01:49,  2.05it/s]
Epoch 5 Iter 2: loss 0.18619. :   0%|▏                                               | 1/224 [00:00<01:49,  2.05it/s]
Epoch 5 Iter 2: loss 0.18619. :   1%|▍                                               | 2/224 [00:00<01:49,  2.04it/s]
Epoch 5 Iter 3: loss 0.19208. :   1%|▍                                               | 2/224 [00:01<01:49,  2.04it/s]
Epoch 5 Iter 3: loss 0.19208. :   1%|▋                                               | 3/224 [00:01<01:48,  2.04it/s]
Epoch 5 Iter 4: loss 0.16918. :   1%|▋                                               | 3/224 [00:01<01:48,  2.04it/s]
Epoch 5 Iter 4: loss 0.16918. :   2%|▊                                               | 4/224 [00:01<01:47,  2.04it/s]
Epoch 5 Iter 5: loss 0.16419. :   2%|▊                                               | 4/224 [00:02<01:47,  2.04it/s]
Epoch 5 Iter 5: loss 0.16419. :   2%|█                                               | 5/224 [00:02<01:48,  2.03it/s]
Epoch 5 Iter 6: loss 0.17599. :   2%|█                                               | 5/224 [00:02<01:48,  2.03it/s]
Epoch 5 Iter 6: loss 0.17599. :   3%|█▎                                              | 6/224 [00:02<01:48,  2.01it/s]
Epoch 5 Iter 7: loss 0.16519. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 5 Iter 7: loss 0.16519. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 5 Iter 8: loss 0.17238. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 5 Iter 8: loss 0.17238. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.01it/s]
Epoch 5 Iter 9: loss 0.18386. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 5 Iter 9: loss 0.18386. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 5 Iter 10: loss 0.18782. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.00it/s]
Epoch 5 Iter 10: loss 0.18782. :   4%|██                                            | 10/224 [00:04<01:46,  2.00it/s]
Epoch 5 Iter 11: loss 0.16052. :   4%|██                                            | 10/224 [00:05<01:46,  2.00it/s]
Epoch 5 Iter 11: loss 0.16052. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 5 Iter 12: loss 0.16052. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 5 Iter 12: loss 0.16052. :   5%|██▍                                           | 12/224 [00:05<01:45,  2.00it/s]
Epoch 5 Iter 13: loss 0.18048. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.00it/s]
Epoch 5 Iter 13: loss 0.18048. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 5 Iter 14: loss 0.15512. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 5 Iter 14: loss 0.15512. :   6%|██▉                                           | 14/224 [00:06<01:45,  2.00it/s]
Epoch 5 Iter 15: loss 0.17264. :   6%|██▉                                           | 14/224 [00:07<01:45,  2.00it/s]
Epoch 5 Iter 15: loss 0.17264. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 5 Iter 16: loss 0.18499. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 5 Iter 16: loss 0.18499. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.01it/s]
Epoch 5 Iter 17: loss 0.17959. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.01it/s]
Epoch 5 Iter 17: loss 0.17959. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 5 Iter 18: loss 0.16802. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 5 Iter 18: loss 0.16802. :   8%|███▋                                          | 18/224 [00:08<01:41,  2.03it/s]
Epoch 5 Iter 19: loss 0.17407. :   8%|███▋                                          | 18/224 [00:09<01:41,  2.03it/s]
Epoch 5 Iter 19: loss 0.17407. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 5 Iter 20: loss 0.16873. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 5 Iter 20: loss 0.16873. :   9%|████                                          | 20/224 [00:09<01:40,  2.02it/s]
Epoch 5 Iter 21: loss 0.18197. :   9%|████                                          | 20/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 21: loss 0.18197. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 22: loss 0.18295. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 22: loss 0.18295. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.03it/s]
Epoch 5 Iter 23: loss 0.18832. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 23: loss 0.18832. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 24: loss 0.18075. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 24: loss 0.18075. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.01it/s]
Epoch 5 Iter 25: loss 0.17974. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 5 Iter 25: loss 0.17974. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 5 Iter 26: loss 0.16791. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 5 Iter 26: loss 0.16791. :  12%|█████▎                                        | 26/224 [00:12<01:41,  1.94it/s]
Epoch 5 Iter 27: loss 0.16465. :  12%|█████▎                                        | 26/224 [00:13<01:41,  1.94it/s]
Epoch 5 Iter 27: loss 0.16465. :  12%|█████▌                                        | 27/224 [00:13<01:42,  1.92it/s]
Epoch 5 Iter 28: loss 0.18188. :  12%|█████▌                                        | 27/224 [00:13<01:42,  1.92it/s]
Epoch 5 Iter 28: loss 0.18188. :  12%|█████▊                                        | 28/224 [00:13<01:40,  1.95it/s]
Epoch 5 Iter 29: loss 0.17296. :  12%|█████▊                                        | 28/224 [00:14<01:40,  1.95it/s]
Epoch 5 Iter 29: loss 0.17296. :  13%|█████▉                                        | 29/224 [00:14<01:42,  1.91it/s]
Epoch 5 Iter 30: loss 0.17580. :  13%|█████▉                                        | 29/224 [00:15<01:42,  1.91it/s]
Epoch 5 Iter 30: loss 0.17580. :  13%|██████▏                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 5 Iter 31: loss 0.17319. :  13%|██████▏                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 5 Iter 31: loss 0.17319. :  14%|██████▎                                       | 31/224 [00:15<01:40,  1.92it/s]
Epoch 5 Iter 32: loss 0.17065. :  14%|██████▎                                       | 31/224 [00:16<01:40,  1.92it/s]
Epoch 5 Iter 32: loss 0.17065. :  14%|██████▌                                       | 32/224 [00:16<01:43,  1.86it/s]
Epoch 5 Iter 33: loss 0.18670. :  14%|██████▌                                       | 32/224 [00:16<01:43,  1.86it/s]
Epoch 5 Iter 33: loss 0.18670. :  15%|██████▊                                       | 33/224 [00:16<01:40,  1.91it/s]
Epoch 5 Iter 34: loss 0.16780. :  15%|██████▊                                       | 33/224 [00:17<01:40,  1.91it/s]
Epoch 5 Iter 34: loss 0.16780. :  15%|██████▉                                       | 34/224 [00:17<01:37,  1.94it/s]
Epoch 5 Iter 35: loss 0.17600. :  15%|██████▉                                       | 34/224 [00:17<01:37,  1.94it/s]
Epoch 5 Iter 35: loss 0.17600. :  16%|███████▏                                      | 35/224 [00:17<01:36,  1.96it/s]
Epoch 5 Iter 36: loss 0.18512. :  16%|███████▏                                      | 35/224 [00:18<01:36,  1.96it/s]
Epoch 5 Iter 36: loss 0.18512. :  16%|███████▍                                      | 36/224 [00:18<01:35,  1.98it/s]
Epoch 5 Iter 37: loss 0.16164. :  16%|███████▍                                      | 36/224 [00:18<01:35,  1.98it/s]
Epoch 5 Iter 37: loss 0.16164. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.99it/s]
Epoch 5 Iter 38: loss 0.16909. :  17%|███████▌                                      | 37/224 [00:19<01:34,  1.99it/s]
Epoch 5 Iter 38: loss 0.16909. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 5 Iter 39: loss 0.18386. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 5 Iter 39: loss 0.18386. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 5 Iter 40: loss 0.16484. :  17%|████████                                      | 39/224 [00:20<01:32,  2.00it/s]
Epoch 5 Iter 40: loss 0.16484. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 5 Iter 41: loss 0.18512. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 5 Iter 41: loss 0.18512. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.01it/s]
Epoch 5 Iter 42: loss 0.16805. :  18%|████████▍                                     | 41/224 [00:21<01:30,  2.01it/s]
Epoch 5 Iter 42: loss 0.16805. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.00it/s]
Epoch 5 Iter 43: loss 0.16811. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.00it/s]
Epoch 5 Iter 43: loss 0.16811. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.00it/s]
Epoch 5 Iter 44: loss 0.15888. :  19%|████████▊                                     | 43/224 [00:22<01:30,  2.00it/s]
Epoch 5 Iter 44: loss 0.15888. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 5 Iter 45: loss 0.15789. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 5 Iter 45: loss 0.15789. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 5 Iter 46: loss 0.16726. :  20%|█████████▏                                    | 45/224 [00:23<01:29,  2.00it/s]
Epoch 5 Iter 46: loss 0.16726. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  1.99it/s]
Epoch 5 Iter 47: loss 0.16933. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  1.99it/s]
Epoch 5 Iter 47: loss 0.16933. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 5 Iter 48: loss 0.18279. :  21%|█████████▋                                    | 47/224 [00:24<01:28,  2.00it/s]
Epoch 5 Iter 48: loss 0.18279. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.98it/s]
Epoch 5 Iter 49: loss 0.17336. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.98it/s]
Epoch 5 Iter 49: loss 0.17336. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 5 Iter 50: loss 0.16025. :  22%|██████████                                    | 49/224 [00:25<01:27,  2.00it/s]
Epoch 5 Iter 50: loss 0.16025. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 5 Iter 51: loss 0.18273. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 5 Iter 51: loss 0.18273. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 5 Iter 52: loss 0.17906. :  23%|██████████▍                                   | 51/224 [00:26<01:26,  2.00it/s]
Epoch 5 Iter 52: loss 0.17906. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 5 Iter 53: loss 0.17943. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 5 Iter 53: loss 0.17943. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.01it/s]
Epoch 5 Iter 54: loss 0.16138. :  24%|██████████▉                                   | 53/224 [00:27<01:24,  2.01it/s]
Epoch 5 Iter 54: loss 0.16138. :  24%|███████████                                   | 54/224 [00:27<01:25,  2.00it/s]
Epoch 5 Iter 55: loss 0.15887. :  24%|███████████                                   | 54/224 [00:27<01:25,  2.00it/s]
Epoch 5 Iter 55: loss 0.15887. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 5 Iter 56: loss 0.16459. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  2.00it/s]
Epoch 5 Iter 56: loss 0.16459. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 5 Iter 57: loss 0.16972. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 5 Iter 57: loss 0.16972. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  2.01it/s]
Epoch 5 Iter 58: loss 0.17926. :  25%|███████████▋                                  | 57/224 [00:29<01:23,  2.01it/s]
Epoch 5 Iter 58: loss 0.17926. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 5 Iter 59: loss 0.15390. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 5 Iter 59: loss 0.15390. :  26%|████████████                                  | 59/224 [00:29<01:21,  2.01it/s]
Epoch 5 Iter 60: loss 0.16912. :  26%|████████████                                  | 59/224 [00:30<01:21,  2.01it/s]
Epoch 5 Iter 60: loss 0.16912. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 5 Iter 61: loss 0.17140. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 5 Iter 61: loss 0.17140. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 5 Iter 62: loss 0.19086. :  27%|████████████▌                                 | 61/224 [00:31<01:20,  2.02it/s]
Epoch 5 Iter 62: loss 0.19086. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.02it/s]
Epoch 5 Iter 63: loss 0.19770. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.02it/s]
Epoch 5 Iter 63: loss 0.19770. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.99it/s]
Epoch 5 Iter 64: loss 0.14601. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.99it/s]
Epoch 5 Iter 64: loss 0.14601. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 5 Iter 65: loss 0.18086. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 5 Iter 65: loss 0.18086. :  29%|█████████████▎                                | 65/224 [00:32<01:22,  1.93it/s]
Epoch 5 Iter 66: loss 0.18832. :  29%|█████████████▎                                | 65/224 [00:33<01:22,  1.93it/s]
Epoch 5 Iter 66: loss 0.18832. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.95it/s]
Epoch 5 Iter 67: loss 0.15456. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.95it/s]
Epoch 5 Iter 67: loss 0.15456. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.97it/s]
Epoch 5 Iter 68: loss 0.19346. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.97it/s]
Epoch 5 Iter 68: loss 0.19346. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  2.00it/s]
Epoch 5 Iter 69: loss 0.16257. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  2.00it/s]
Epoch 5 Iter 69: loss 0.16257. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  1.99it/s]
Epoch 5 Iter 70: loss 0.18900. :  31%|██████████████▏                               | 69/224 [00:35<01:17,  1.99it/s]
Epoch 5 Iter 70: loss 0.18900. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 5 Iter 71: loss 0.17460. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 5 Iter 71: loss 0.17460. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.01it/s]
Epoch 5 Iter 72: loss 0.17454. :  32%|██████████████▌                               | 71/224 [00:36<01:15,  2.01it/s]
Epoch 5 Iter 72: loss 0.17454. :  32%|██████████████▊                               | 72/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 73: loss 0.18481. :  32%|██████████████▊                               | 72/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 73: loss 0.18481. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 74: loss 0.17176. :  33%|██████████████▉                               | 73/224 [00:37<01:14,  2.03it/s]
Epoch 5 Iter 74: loss 0.17176. :  33%|███████████████▏                              | 74/224 [00:37<01:13,  2.04it/s]
Epoch 5 Iter 75: loss 0.18953. :  33%|███████████████▏                              | 74/224 [00:37<01:13,  2.04it/s]
Epoch 5 Iter 75: loss 0.18953. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 5 Iter 76: loss 0.16518. :  33%|███████████████▍                              | 75/224 [00:38<01:13,  2.03it/s]
Epoch 5 Iter 76: loss 0.16518. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 5 Iter 77: loss 0.17654. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 5 Iter 77: loss 0.17654. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.03it/s]
Epoch 5 Iter 78: loss 0.19299. :  34%|███████████████▊                              | 77/224 [00:39<01:12,  2.03it/s]
Epoch 5 Iter 78: loss 0.19299. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 5 Iter 79: loss 0.17540. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 5 Iter 79: loss 0.17540. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 5 Iter 80: loss 0.17209. :  35%|████████████████▏                             | 79/224 [00:40<01:11,  2.02it/s]
Epoch 5 Iter 80: loss 0.17209. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 5 Iter 81: loss 0.16516. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 5 Iter 81: loss 0.16516. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.02it/s]
Epoch 5 Iter 82: loss 0.18184. :  36%|████████████████▋                             | 81/224 [00:41<01:10,  2.02it/s]
Epoch 5 Iter 82: loss 0.18184. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 5 Iter 83: loss 0.15850. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 5 Iter 83: loss 0.15850. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 5 Iter 84: loss 0.18726. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.02it/s]
Epoch 5 Iter 84: loss 0.18726. :  38%|█████████████████▎                            | 84/224 [00:42<01:08,  2.03it/s]
Epoch 5 Iter 85: loss 0.16776. :  38%|█████████████████▎                            | 84/224 [00:42<01:08,  2.03it/s]
Epoch 5 Iter 85: loss 0.16776. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.03it/s]
Epoch 5 Iter 86: loss 0.16608. :  38%|█████████████████▍                            | 85/224 [00:43<01:08,  2.03it/s]
Epoch 5 Iter 86: loss 0.16608. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.03it/s]
Epoch 5 Iter 87: loss 0.17226. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.03it/s]
Epoch 5 Iter 87: loss 0.17226. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.04it/s]
Epoch 5 Iter 88: loss 0.16044. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.04it/s]
Epoch 5 Iter 88: loss 0.16044. :  39%|██████████████████                            | 88/224 [00:43<01:06,  2.03it/s]
Epoch 5 Iter 89: loss 0.16770. :  39%|██████████████████                            | 88/224 [00:44<01:06,  2.03it/s]
Epoch 5 Iter 89: loss 0.16770. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 5 Iter 90: loss 0.16600. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 5 Iter 90: loss 0.16600. :  40%|██████████████████▍                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 5 Iter 91: loss 0.16949. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.02it/s]
Epoch 5 Iter 91: loss 0.16949. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.01it/s]
Epoch 5 Iter 92: loss 0.17388. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.01it/s]
Epoch 5 Iter 92: loss 0.17388. :  41%|██████████████████▉                           | 92/224 [00:45<01:05,  2.02it/s]
Epoch 5 Iter 93: loss 0.16038. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.02it/s]
Epoch 5 Iter 93: loss 0.16038. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 5 Iter 94: loss 0.20068. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 5 Iter 94: loss 0.20068. :  42%|███████████████████▎                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 5 Iter 95: loss 0.18054. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 5 Iter 95: loss 0.18054. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.01it/s]
Epoch 5 Iter 96: loss 0.17898. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.01it/s]
Epoch 5 Iter 96: loss 0.17898. :  43%|███████████████████▋                          | 96/224 [00:47<01:03,  2.02it/s]
Epoch 5 Iter 97: loss 0.18950. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.02it/s]
Epoch 5 Iter 97: loss 0.18950. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.02it/s]
Epoch 5 Iter 98: loss 0.16494. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.02it/s]
Epoch 5 Iter 98: loss 0.16494. :  44%|████████████████████▏                         | 98/224 [00:48<01:02,  2.03it/s]
Epoch 5 Iter 99: loss 0.18142. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.03it/s]
Epoch 5 Iter 99: loss 0.18142. :  44%|████████████████████▎                         | 99/224 [00:49<01:01,  2.03it/s]
Epoch 5 Iter 100: loss 0.16117. :  44%|███████████████████▉                         | 99/224 [00:49<01:01,  2.03it/s]
Epoch 5 Iter 100: loss 0.16117. :  45%|███████████████████▋                        | 100/224 [00:49<01:00,  2.04it/s]
Epoch 5 Iter 101: loss 0.15741. :  45%|███████████████████▋                        | 100/224 [00:50<01:00,  2.04it/s]
Epoch 5 Iter 101: loss 0.15741. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.03it/s]
Epoch 5 Iter 102: loss 0.17565. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.03it/s]
Epoch 5 Iter 102: loss 0.17565. :  46%|████████████████████                        | 102/224 [00:50<01:00,  2.03it/s]
Epoch 5 Iter 103: loss 0.16816. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.03it/s]
Epoch 5 Iter 103: loss 0.16816. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 5 Iter 104: loss 0.19169. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 5 Iter 104: loss 0.19169. :  46%|████████████████████▍                       | 104/224 [00:51<00:59,  2.02it/s]
Epoch 5 Iter 105: loss 0.17866. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 5 Iter 105: loss 0.17866. :  47%|████████████████████▋                       | 105/224 [00:52<01:00,  1.96it/s]
Epoch 5 Iter 106: loss 0.16329. :  47%|████████████████████▋                       | 105/224 [00:52<01:00,  1.96it/s]
Epoch 5 Iter 106: loss 0.16329. :  47%|████████████████████▊                       | 106/224 [00:52<00:59,  1.97it/s]
Epoch 5 Iter 107: loss 0.16937. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.97it/s]
Epoch 5 Iter 107: loss 0.16937. :  48%|█████████████████████                       | 107/224 [00:53<00:59,  1.98it/s]
Epoch 5 Iter 108: loss 0.20734. :  48%|█████████████████████                       | 107/224 [00:53<00:59,  1.98it/s]
Epoch 5 Iter 108: loss 0.20734. :  48%|█████████████████████▏                      | 108/224 [00:53<00:58,  1.97it/s]
Epoch 5 Iter 109: loss 0.19125. :  48%|█████████████████████▏                      | 108/224 [00:54<00:58,  1.97it/s]
Epoch 5 Iter 109: loss 0.19125. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  1.99it/s]
Epoch 5 Iter 110: loss 0.19252. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  1.99it/s]
Epoch 5 Iter 110: loss 0.19252. :  49%|█████████████████████▌                      | 110/224 [00:54<00:57,  1.99it/s]
Epoch 5 Iter 111: loss 0.17261. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.99it/s]
Epoch 5 Iter 111: loss 0.17261. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.01it/s]
Epoch 5 Iter 112: loss 0.20026. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.01it/s]
Epoch 5 Iter 112: loss 0.20026. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.01it/s]
Epoch 5 Iter 113: loss 0.15052. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.01it/s]
Epoch 5 Iter 113: loss 0.15052. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.01it/s]
Epoch 5 Iter 114: loss 0.17173. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.01it/s]
Epoch 5 Iter 114: loss 0.17173. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 5 Iter 115: loss 0.17683. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.02it/s]
Epoch 5 Iter 115: loss 0.17683. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 5 Iter 116: loss 0.18041. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 5 Iter 116: loss 0.18041. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.01it/s]
Epoch 5 Iter 117: loss 0.17216. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.01it/s]
Epoch 5 Iter 117: loss 0.17216. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.01it/s]
Epoch 5 Iter 118: loss 0.15350. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.01it/s]
Epoch 5 Iter 118: loss 0.15350. :  53%|███████████████████████▏                    | 118/224 [00:58<00:53,  2.00it/s]
Epoch 5 Iter 119: loss 0.18327. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  2.00it/s]
Epoch 5 Iter 119: loss 0.18327. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.00it/s]
Epoch 5 Iter 120: loss 0.18829. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.00it/s]
Epoch 5 Iter 120: loss 0.18829. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.00it/s]
Epoch 5 Iter 121: loss 0.17042. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.00it/s]
Epoch 5 Iter 121: loss 0.17042. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 5 Iter 122: loss 0.16901. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 5 Iter 122: loss 0.16901. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.01it/s]
Epoch 5 Iter 123: loss 0.16540. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.01it/s]
Epoch 5 Iter 123: loss 0.16540. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.00it/s]
Epoch 5 Iter 124: loss 0.18361. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.00it/s]
Epoch 5 Iter 124: loss 0.18361. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.01it/s]
Epoch 5 Iter 125: loss 0.17521. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 5 Iter 125: loss 0.17521. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 5 Iter 126: loss 0.18271. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 5 Iter 126: loss 0.18271. :  56%|████████████████████████▊                   | 126/224 [01:02<00:48,  2.01it/s]
Epoch 5 Iter 127: loss 0.16242. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.01it/s]
Epoch 5 Iter 127: loss 0.16242. :  57%|████████████████████████▉                   | 127/224 [01:03<00:47,  2.02it/s]
Epoch 5 Iter 128: loss 0.18099. :  57%|████████████████████████▉                   | 127/224 [01:03<00:47,  2.02it/s]
Epoch 5 Iter 128: loss 0.18099. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:47,  2.02it/s]
Epoch 5 Iter 129: loss 0.17097. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 129: loss 0.17097. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.19247. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.19247. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.02it/s]
Epoch 5 Iter 131: loss 0.16417. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 131: loss 0.16417. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.16738. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.16738. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.01it/s]
Epoch 5 Iter 133: loss 0.17172. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.01it/s]
Epoch 5 Iter 133: loss 0.17172. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:47,  1.93it/s]
Epoch 5 Iter 134: loss 0.18587. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:47,  1.93it/s]
Epoch 5 Iter 134: loss 0.18587. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:46,  1.94it/s]
Epoch 5 Iter 135: loss 0.17966. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:46,  1.94it/s]
Epoch 5 Iter 135: loss 0.17966. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:45,  1.95it/s]
Epoch 5 Iter 136: loss 0.17478. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:45,  1.95it/s]
Epoch 5 Iter 136: loss 0.17478. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:44,  1.98it/s]
Epoch 5 Iter 137: loss 0.18216. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.98it/s]
Epoch 5 Iter 137: loss 0.18216. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.00it/s]
Epoch 5 Iter 138: loss 0.19010. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.00it/s]
Epoch 5 Iter 138: loss 0.19010. :  62%|███████████████████████████                 | 138/224 [01:08<00:42,  2.00it/s]
Epoch 5 Iter 139: loss 0.17079. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.00it/s]
Epoch 5 Iter 139: loss 0.17079. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 5 Iter 140: loss 0.16075. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 5 Iter 140: loss 0.16075. :  62%|███████████████████████████▌                | 140/224 [01:09<00:41,  2.01it/s]
Epoch 5 Iter 141: loss 0.17904. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 141: loss 0.17904. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.00it/s]
Epoch 5 Iter 142: loss 0.15727. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.00it/s]
Epoch 5 Iter 142: loss 0.15727. :  63%|███████████████████████████▉                | 142/224 [01:10<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.18193. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.18193. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 144: loss 0.16221. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 144: loss 0.16221. :  64%|████████████████████████████▎               | 144/224 [01:11<00:39,  2.03it/s]
Epoch 5 Iter 145: loss 0.17953. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.03it/s]
Epoch 5 Iter 145: loss 0.17953. :  65%|████████████████████████████▍               | 145/224 [01:12<00:38,  2.03it/s]
Epoch 5 Iter 146: loss 0.18116. :  65%|████████████████████████████▍               | 145/224 [01:12<00:38,  2.03it/s]
Epoch 5 Iter 146: loss 0.18116. :  65%|████████████████████████████▋               | 146/224 [01:12<00:38,  2.01it/s]
Epoch 5 Iter 147: loss 0.17802. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 5 Iter 147: loss 0.17802. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 5 Iter 148: loss 0.18675. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 5 Iter 148: loss 0.18675. :  66%|█████████████████████████████               | 148/224 [01:13<00:37,  2.03it/s]
Epoch 5 Iter 149: loss 0.19649. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.03it/s]
Epoch 5 Iter 149: loss 0.19649. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.01it/s]
Epoch 5 Iter 150: loss 0.17791. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.01it/s]
Epoch 5 Iter 150: loss 0.17791. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:36,  2.00it/s]
Epoch 5 Iter 151: loss 0.17618. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 151: loss 0.17618. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 152: loss 0.17194. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 152: loss 0.17194. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:36,  1.99it/s]
Epoch 5 Iter 153: loss 0.17942. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 5 Iter 153: loss 0.17942. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 5 Iter 154: loss 0.14994. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 5 Iter 154: loss 0.14994. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:35,  1.99it/s]
Epoch 5 Iter 155: loss 0.17915. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:35,  1.99it/s]
Epoch 5 Iter 155: loss 0.17915. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.00it/s]
Epoch 5 Iter 156: loss 0.18149. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.00it/s]
Epoch 5 Iter 156: loss 0.18149. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:34,  1.99it/s]
Epoch 5 Iter 157: loss 0.18899. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  1.99it/s]
Epoch 5 Iter 157: loss 0.18899. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 5 Iter 158: loss 0.17864. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 5 Iter 158: loss 0.17864. :  71%|███████████████████████████████             | 158/224 [01:18<00:33,  2.00it/s]
Epoch 5 Iter 159: loss 0.18176. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  2.00it/s]
Epoch 5 Iter 159: loss 0.18176. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:33,  1.96it/s]
Epoch 5 Iter 160: loss 0.17681. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:33,  1.96it/s]
Epoch 5 Iter 160: loss 0.17681. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:32,  1.96it/s]
Epoch 5 Iter 161: loss 0.15490. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  1.96it/s]
Epoch 5 Iter 161: loss 0.15490. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:32,  1.96it/s]
Epoch 5 Iter 162: loss 0.16151. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:32,  1.96it/s]
Epoch 5 Iter 162: loss 0.16151. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:31,  1.98it/s]
Epoch 5 Iter 163: loss 0.17266. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:31,  1.98it/s]
Epoch 5 Iter 163: loss 0.17266. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  1.97it/s]
Epoch 5 Iter 164: loss 0.16560. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  1.97it/s]
Epoch 5 Iter 164: loss 0.16560. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:30,  1.98it/s]
Epoch 5 Iter 165: loss 0.14809. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.98it/s]
Epoch 5 Iter 165: loss 0.14809. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.99it/s]
Epoch 5 Iter 166: loss 0.16785. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.99it/s]
Epoch 5 Iter 166: loss 0.16785. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:29,  1.99it/s]
Epoch 5 Iter 167: loss 0.15522. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:29,  1.99it/s]
Epoch 5 Iter 167: loss 0.15522. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  1.97it/s]
Epoch 5 Iter 168: loss 0.17530. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  1.97it/s]
Epoch 5 Iter 168: loss 0.17530. :  75%|█████████████████████████████████           | 168/224 [01:23<00:28,  1.98it/s]
Epoch 5 Iter 169: loss 0.17533. :  75%|█████████████████████████████████           | 168/224 [01:24<00:28,  1.98it/s]
Epoch 5 Iter 169: loss 0.17533. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.99it/s]
Epoch 5 Iter 170: loss 0.16946. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.99it/s]
Epoch 5 Iter 170: loss 0.16946. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:26,  2.00it/s]
Epoch 5 Iter 171: loss 0.17855. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.00it/s]
Epoch 5 Iter 171: loss 0.17855. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.01it/s]
Epoch 5 Iter 172: loss 0.17524. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.01it/s]
Epoch 5 Iter 172: loss 0.17524. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:26,  2.00it/s]
Epoch 5 Iter 173: loss 0.18343. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:26,  2.00it/s]
Epoch 5 Iter 173: loss 0.18343. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 5 Iter 174: loss 0.19197. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 5 Iter 174: loss 0.19197. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.01it/s]
Epoch 5 Iter 175: loss 0.19972. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.01it/s]
Epoch 5 Iter 175: loss 0.19972. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 5 Iter 176: loss 0.19044. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 5 Iter 176: loss 0.19044. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.01it/s]
Epoch 5 Iter 177: loss 0.16810. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.01it/s]
Epoch 5 Iter 177: loss 0.16810. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 5 Iter 178: loss 0.18484. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 5 Iter 178: loss 0.18484. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.02it/s]
Epoch 5 Iter 179: loss 0.16802. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 179: loss 0.16802. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 180: loss 0.17846. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 180: loss 0.17846. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:21,  2.01it/s]
Epoch 5 Iter 181: loss 0.17291. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.01it/s]
Epoch 5 Iter 181: loss 0.17291. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.01it/s]
Epoch 5 Iter 182: loss 0.17625. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.01it/s]
Epoch 5 Iter 182: loss 0.17625. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.01it/s]
Epoch 5 Iter 183: loss 0.17363. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.01it/s]
Epoch 5 Iter 183: loss 0.17363. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.98it/s]
Epoch 5 Iter 184: loss 0.17045. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.98it/s]
Epoch 5 Iter 184: loss 0.17045. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:20,  1.97it/s]
Epoch 5 Iter 185: loss 0.17919. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:20,  1.97it/s]
Epoch 5 Iter 185: loss 0.17919. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  1.98it/s]
Epoch 5 Iter 186: loss 0.17433. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  1.98it/s]
Epoch 5 Iter 186: loss 0.17433. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:19,  1.99it/s]
Epoch 5 Iter 187: loss 0.15325. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:19,  1.99it/s]
Epoch 5 Iter 187: loss 0.15325. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 5 Iter 188: loss 0.16866. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 5 Iter 188: loss 0.16866. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:18,  1.99it/s]
Epoch 5 Iter 189: loss 0.19329. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.99it/s]
Epoch 5 Iter 189: loss 0.19329. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.99it/s]
Epoch 5 Iter 190: loss 0.18471. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.99it/s]
Epoch 5 Iter 190: loss 0.18471. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  1.99it/s]
Epoch 5 Iter 191: loss 0.18994. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  1.99it/s]
Epoch 5 Iter 191: loss 0.18994. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.00it/s]
Epoch 5 Iter 192: loss 0.15211. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.00it/s]
Epoch 5 Iter 192: loss 0.15211. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:16,  1.99it/s]
Epoch 5 Iter 193: loss 0.16396. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  1.99it/s]
Epoch 5 Iter 193: loss 0.16396. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.00it/s]
Epoch 5 Iter 194: loss 0.17289. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.00it/s]
Epoch 5 Iter 194: loss 0.17289. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:14,  2.00it/s]
Epoch 5 Iter 195: loss 0.17354. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.00it/s]
Epoch 5 Iter 195: loss 0.17354. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.02it/s]
Epoch 5 Iter 196: loss 0.16769. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.02it/s]
Epoch 5 Iter 196: loss 0.16769. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:13,  2.00it/s]
Epoch 5 Iter 197: loss 0.15530. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.00it/s]
Epoch 5 Iter 197: loss 0.15530. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 5 Iter 198: loss 0.16591. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 5 Iter 198: loss 0.16591. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.01it/s]
Epoch 5 Iter 199: loss 0.17862. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.01it/s]
Epoch 5 Iter 199: loss 0.17862. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.02it/s]
Epoch 5 Iter 200: loss 0.17232. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.02it/s]
Epoch 5 Iter 200: loss 0.17232. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:11,  2.02it/s]
Epoch 5 Iter 201: loss 0.17057. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.02it/s]
Epoch 5 Iter 201: loss 0.17057. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 5 Iter 202: loss 0.18223. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 5 Iter 202: loss 0.18223. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:10,  2.03it/s]
Epoch 5 Iter 203: loss 0.15637. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.03it/s]
Epoch 5 Iter 203: loss 0.15637. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.03it/s]
Epoch 5 Iter 204: loss 0.15464. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.03it/s]
Epoch 5 Iter 204: loss 0.15464. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.17937. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.17937. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.14960. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.14960. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.17586. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.17586. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.00it/s]
Epoch 5 Iter 208: loss 0.20080. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.00it/s]
Epoch 5 Iter 208: loss 0.20080. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.92it/s]
Epoch 5 Iter 209: loss 0.18226. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.92it/s]
Epoch 5 Iter 209: loss 0.18226. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  1.95it/s]
Epoch 5 Iter 210: loss 0.17085. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  1.95it/s]
Epoch 5 Iter 210: loss 0.17085. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:07,  1.98it/s]
Epoch 5 Iter 211: loss 0.19001. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.98it/s]
Epoch 5 Iter 211: loss 0.19001. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.00it/s]
Epoch 5 Iter 212: loss 0.18081. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.00it/s]
Epoch 5 Iter 212: loss 0.18081. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.01it/s]
Epoch 5 Iter 213: loss 0.15974. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.01it/s]
Epoch 5 Iter 213: loss 0.15974. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.00it/s]
Epoch 5 Iter 214: loss 0.17214. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.00it/s]
Epoch 5 Iter 214: loss 0.17214. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:04,  2.01it/s]
Epoch 5 Iter 215: loss 0.18602. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:04,  2.01it/s]
Epoch 5 Iter 215: loss 0.18602. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.02it/s]
Epoch 5 Iter 216: loss 0.18876. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.02it/s]
Epoch 5 Iter 216: loss 0.18876. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.03it/s]
Epoch 5 Iter 217: loss 0.15618. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:03,  2.03it/s]
Epoch 5 Iter 217: loss 0.15618. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.02it/s]
Epoch 5 Iter 218: loss 0.17457. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.02it/s]
Epoch 5 Iter 218: loss 0.17457. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.02it/s]
Epoch 5 Iter 219: loss 0.17261. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.02it/s]
Epoch 5 Iter 219: loss 0.17261. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.02it/s]
Epoch 5 Iter 220: loss 0.18313. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.02it/s]
Epoch 5 Iter 220: loss 0.18313. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:01,  2.02it/s]
Epoch 5 Iter 221: loss 0.17999. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:01,  2.02it/s]
Epoch 5 Iter 221: loss 0.17999. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.03it/s]
Epoch 5 Iter 222: loss 0.18921. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.03it/s]
Epoch 5 Iter 222: loss 0.18921. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.02it/s]
Epoch 5 Iter 223: loss 0.15882. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.02it/s]
Epoch 5 Iter 223: loss 0.15882. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.02it/s]
Epoch 5 Iter 224: loss 0.17313. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.02it/s]
Epoch 5 Iter 224: loss 0.17313. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.01it/s]
Epoch 5 Iter 224: loss 0.17313. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

    Train loss: 0.17436
    Valid loss: 0.17664
       Valid loss recons: 0.17664
       Valid loss KL-D:   9665.69391
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.17465. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.17465. :   0%|▏                                               | 1/224 [00:00<01:52,  1.99it/s]
Epoch 6 Iter 2: loss 0.17951. :   0%|▏                                               | 1/224 [00:00<01:52,  1.99it/s]
Epoch 6 Iter 2: loss 0.17951. :   1%|▍                                               | 2/224 [00:00<01:49,  2.03it/s]
Epoch 6 Iter 3: loss 0.19419. :   1%|▍                                               | 2/224 [00:01<01:49,  2.03it/s]
Epoch 6 Iter 3: loss 0.19419. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 6 Iter 4: loss 0.17373. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 6 Iter 4: loss 0.17373. :   2%|▊                                               | 4/224 [00:01<01:48,  2.03it/s]
Epoch 6 Iter 5: loss 0.15957. :   2%|▊                                               | 4/224 [00:02<01:48,  2.03it/s]
Epoch 6 Iter 5: loss 0.15957. :   2%|█                                               | 5/224 [00:02<01:47,  2.04it/s]
Epoch 6 Iter 6: loss 0.17020. :   2%|█                                               | 5/224 [00:02<01:47,  2.04it/s]
Epoch 6 Iter 6: loss 0.17020. :   3%|█▎                                              | 6/224 [00:02<01:46,  2.04it/s]
Epoch 6 Iter 7: loss 0.17522. :   3%|█▎                                              | 6/224 [00:03<01:46,  2.04it/s]
Epoch 6 Iter 7: loss 0.17522. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 8: loss 0.16229. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 8: loss 0.16229. :   4%|█▋                                              | 8/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 9: loss 0.17463. :   4%|█▋                                              | 8/224 [00:04<01:46,  2.03it/s]
Epoch 6 Iter 9: loss 0.17463. :   4%|█▉                                              | 9/224 [00:04<01:45,  2.03it/s]
Epoch 6 Iter 10: loss 0.16664. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.03it/s]
Epoch 6 Iter 10: loss 0.16664. :   4%|██                                            | 10/224 [00:04<01:45,  2.02it/s]
Epoch 6 Iter 11: loss 0.19145. :   4%|██                                            | 10/224 [00:05<01:45,  2.02it/s]
Epoch 6 Iter 11: loss 0.19145. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 6 Iter 12: loss 0.16645. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 6 Iter 12: loss 0.16645. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.02it/s]
Epoch 6 Iter 13: loss 0.19206. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 6 Iter 13: loss 0.19206. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 6 Iter 14: loss 0.16925. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 6 Iter 14: loss 0.16925. :   6%|██▉                                           | 14/224 [00:06<01:45,  2.00it/s]
Epoch 6 Iter 15: loss 0.15382. :   6%|██▉                                           | 14/224 [00:07<01:45,  2.00it/s]
Epoch 6 Iter 15: loss 0.15382. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 6 Iter 16: loss 0.17193. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 6 Iter 16: loss 0.17193. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.00it/s]
Epoch 6 Iter 17: loss 0.17811. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.00it/s]
Epoch 6 Iter 17: loss 0.17811. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 6 Iter 18: loss 0.15792. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 6 Iter 18: loss 0.15792. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.01it/s]
Epoch 6 Iter 19: loss 0.16824. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.01it/s]
Epoch 6 Iter 19: loss 0.16824. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.16784. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.16784. :   9%|████                                          | 20/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 21: loss 0.17329. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 6 Iter 21: loss 0.17329. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 22: loss 0.17084. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 22: loss 0.17084. :  10%|████▌                                         | 22/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 23: loss 0.17880. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.02it/s]
Epoch 6 Iter 23: loss 0.17880. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.17296. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.17296. :  11%|████▉                                         | 24/224 [00:11<01:38,  2.02it/s]
Epoch 6 Iter 25: loss 0.15721. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.02it/s]
Epoch 6 Iter 25: loss 0.15721. :  11%|█████▏                                        | 25/224 [00:12<01:40,  1.98it/s]
Epoch 6 Iter 26: loss 0.16955. :  11%|█████▏                                        | 25/224 [00:12<01:40,  1.98it/s]
Epoch 6 Iter 26: loss 0.16955. :  12%|█████▎                                        | 26/224 [00:12<01:42,  1.93it/s]
Epoch 6 Iter 27: loss 0.17038. :  12%|█████▎                                        | 26/224 [00:13<01:42,  1.93it/s]
Epoch 6 Iter 27: loss 0.17038. :  12%|█████▌                                        | 27/224 [00:13<01:40,  1.95it/s]
Epoch 6 Iter 28: loss 0.17782. :  12%|█████▌                                        | 27/224 [00:13<01:40,  1.95it/s]
Epoch 6 Iter 28: loss 0.17782. :  12%|█████▊                                        | 28/224 [00:13<01:39,  1.98it/s]
Epoch 6 Iter 29: loss 0.15499. :  12%|█████▊                                        | 28/224 [00:14<01:39,  1.98it/s]
Epoch 6 Iter 29: loss 0.15499. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 6 Iter 30: loss 0.17091. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 6 Iter 30: loss 0.17091. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.00it/s]
Epoch 6 Iter 31: loss 0.18799. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.00it/s]
Epoch 6 Iter 31: loss 0.18799. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.01it/s]
Epoch 6 Iter 32: loss 0.17898. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.01it/s]
Epoch 6 Iter 32: loss 0.17898. :  14%|██████▌                                       | 32/224 [00:15<01:35,  2.02it/s]
Epoch 6 Iter 33: loss 0.19286. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.02it/s]
Epoch 6 Iter 33: loss 0.19286. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 34: loss 0.17210. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 34: loss 0.17210. :  15%|██████▉                                       | 34/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 35: loss 0.16470. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.02it/s]
Epoch 6 Iter 35: loss 0.16470. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 6 Iter 36: loss 0.17810. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 6 Iter 36: loss 0.17810. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.03it/s]
Epoch 6 Iter 37: loss 0.17520. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.03it/s]
Epoch 6 Iter 37: loss 0.17520. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.03it/s]
Epoch 6 Iter 38: loss 0.17623. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.03it/s]
Epoch 6 Iter 38: loss 0.17623. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.02it/s]
Epoch 6 Iter 39: loss 0.18628. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.02it/s]
Epoch 6 Iter 39: loss 0.18628. :  17%|████████                                      | 39/224 [00:19<01:31,  2.02it/s]
Epoch 6 Iter 40: loss 0.16313. :  17%|████████                                      | 39/224 [00:19<01:31,  2.02it/s]
Epoch 6 Iter 40: loss 0.16313. :  18%|████████▏                                     | 40/224 [00:19<01:31,  2.01it/s]
Epoch 6 Iter 41: loss 0.16684. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 6 Iter 41: loss 0.16684. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 6 Iter 42: loss 0.18317. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 6 Iter 42: loss 0.18317. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.01it/s]
Epoch 6 Iter 43: loss 0.16635. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.01it/s]
Epoch 6 Iter 43: loss 0.16635. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.18689. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.18689. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.01it/s]
Epoch 6 Iter 45: loss 0.15442. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 6 Iter 45: loss 0.15442. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 46: loss 0.19113. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 46: loss 0.19113. :  21%|█████████▍                                    | 46/224 [00:22<01:27,  2.02it/s]
Epoch 6 Iter 47: loss 0.16917. :  21%|█████████▍                                    | 46/224 [00:23<01:27,  2.02it/s]
Epoch 6 Iter 47: loss 0.16917. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.03it/s]
Epoch 6 Iter 48: loss 0.17603. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.03it/s]
Epoch 6 Iter 48: loss 0.17603. :  21%|█████████▊                                    | 48/224 [00:23<01:26,  2.03it/s]
Epoch 6 Iter 49: loss 0.17973. :  21%|█████████▊                                    | 48/224 [00:24<01:26,  2.03it/s]
Epoch 6 Iter 49: loss 0.17973. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.03it/s]
Epoch 6 Iter 50: loss 0.16200. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.03it/s]
Epoch 6 Iter 50: loss 0.16200. :  22%|██████████▎                                   | 50/224 [00:24<01:25,  2.02it/s]
Epoch 6 Iter 51: loss 0.16395. :  22%|██████████▎                                   | 50/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 51: loss 0.16395. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 52: loss 0.18874. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 52: loss 0.18874. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 53: loss 0.16732. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.02it/s]
Epoch 6 Iter 53: loss 0.16732. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.03it/s]
Epoch 6 Iter 54: loss 0.17667. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.03it/s]
Epoch 6 Iter 54: loss 0.17667. :  24%|███████████                                   | 54/224 [00:26<01:23,  2.02it/s]
Epoch 6 Iter 55: loss 0.18548. :  24%|███████████                                   | 54/224 [00:27<01:23,  2.02it/s]
Epoch 6 Iter 55: loss 0.18548. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 6 Iter 56: loss 0.19436. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 6 Iter 56: loss 0.19436. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.02it/s]
Epoch 6 Iter 57: loss 0.17418. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 6 Iter 57: loss 0.17418. :  25%|███████████▋                                  | 57/224 [00:28<01:25,  1.95it/s]
Epoch 6 Iter 58: loss 0.15633. :  25%|███████████▋                                  | 57/224 [00:28<01:25,  1.95it/s]
Epoch 6 Iter 58: loss 0.15633. :  26%|███████████▉                                  | 58/224 [00:28<01:24,  1.97it/s]
Epoch 6 Iter 59: loss 0.17469. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.97it/s]
Epoch 6 Iter 59: loss 0.17469. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 6 Iter 60: loss 0.17541. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 6 Iter 60: loss 0.17541. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.01it/s]
Epoch 6 Iter 61: loss 0.17337. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 61: loss 0.17337. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 62: loss 0.18532. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 62: loss 0.18532. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.00it/s]
Epoch 6 Iter 63: loss 0.14362. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.00it/s]
Epoch 6 Iter 63: loss 0.14362. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.00it/s]
Epoch 6 Iter 64: loss 0.15513. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.00it/s]
Epoch 6 Iter 64: loss 0.15513. :  29%|█████████████▏                                | 64/224 [00:31<01:19,  2.00it/s]
Epoch 6 Iter 65: loss 0.16721. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.00it/s]
Epoch 6 Iter 65: loss 0.16721. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 6 Iter 66: loss 0.16709. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 6 Iter 66: loss 0.16709. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.01it/s]
Epoch 6 Iter 67: loss 0.18550. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 6 Iter 67: loss 0.18550. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 6 Iter 68: loss 0.16574. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 6 Iter 68: loss 0.16574. :  30%|█████████████▉                                | 68/224 [00:33<01:16,  2.03it/s]
Epoch 6 Iter 69: loss 0.18438. :  30%|█████████████▉                                | 68/224 [00:34<01:16,  2.03it/s]
Epoch 6 Iter 69: loss 0.18438. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.03it/s]
Epoch 6 Iter 70: loss 0.16909. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.03it/s]
Epoch 6 Iter 70: loss 0.16909. :  31%|██████████████▍                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 6 Iter 71: loss 0.15686. :  31%|██████████████▍                               | 70/224 [00:35<01:15,  2.04it/s]
Epoch 6 Iter 71: loss 0.15686. :  32%|██████████████▌                               | 71/224 [00:35<01:14,  2.04it/s]
Epoch 6 Iter 72: loss 0.17209. :  32%|██████████████▌                               | 71/224 [00:35<01:14,  2.04it/s]
Epoch 6 Iter 72: loss 0.17209. :  32%|██████████████▊                               | 72/224 [00:35<01:14,  2.03it/s]
Epoch 6 Iter 73: loss 0.18519. :  32%|██████████████▊                               | 72/224 [00:36<01:14,  2.03it/s]
Epoch 6 Iter 73: loss 0.18519. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 6 Iter 74: loss 0.18745. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 6 Iter 74: loss 0.18745. :  33%|███████████████▏                              | 74/224 [00:36<01:14,  2.02it/s]
Epoch 6 Iter 75: loss 0.19449. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 6 Iter 75: loss 0.19449. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.04it/s]
Epoch 6 Iter 76: loss 0.16885. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.04it/s]
Epoch 6 Iter 76: loss 0.16885. :  34%|███████████████▌                              | 76/224 [00:37<01:12,  2.03it/s]
Epoch 6 Iter 77: loss 0.21185. :  34%|███████████████▌                              | 76/224 [00:38<01:12,  2.03it/s]
Epoch 6 Iter 77: loss 0.21185. :  34%|███████████████▊                              | 77/224 [00:38<01:11,  2.05it/s]
Epoch 6 Iter 78: loss 0.18024. :  34%|███████████████▊                              | 77/224 [00:38<01:11,  2.05it/s]
Epoch 6 Iter 78: loss 0.18024. :  35%|████████████████                              | 78/224 [00:38<01:11,  2.05it/s]
Epoch 6 Iter 79: loss 0.18631. :  35%|████████████████                              | 78/224 [00:39<01:11,  2.05it/s]
Epoch 6 Iter 79: loss 0.18631. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.04it/s]
Epoch 6 Iter 80: loss 0.26538. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.04it/s]
Epoch 6 Iter 80: loss 0.26538. :  36%|████████████████▍                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 6 Iter 81: loss 0.20952. :  36%|████████████████▍                             | 80/224 [00:40<01:10,  2.03it/s]
Epoch 6 Iter 81: loss 0.20952. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.03it/s]
Epoch 6 Iter 82: loss 0.19740. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.03it/s]
Epoch 6 Iter 82: loss 0.19740. :  37%|████████████████▊                             | 82/224 [00:40<01:09,  2.03it/s]
Epoch 6 Iter 83: loss 0.20140. :  37%|████████████████▊                             | 82/224 [00:41<01:09,  2.03it/s]
Epoch 6 Iter 83: loss 0.20140. :  37%|█████████████████                             | 83/224 [00:41<01:08,  2.04it/s]
Epoch 6 Iter 84: loss 0.20964. :  37%|█████████████████                             | 83/224 [00:41<01:08,  2.04it/s]
Epoch 6 Iter 84: loss 0.20964. :  38%|█████████████████▎                            | 84/224 [00:41<01:09,  2.03it/s]
Epoch 6 Iter 85: loss 0.20667. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.03it/s]
Epoch 6 Iter 85: loss 0.20667. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 6 Iter 86: loss 0.19347. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 6 Iter 86: loss 0.19347. :  38%|█████████████████▋                            | 86/224 [00:42<01:08,  2.02it/s]
Epoch 6 Iter 87: loss 0.19169. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 6 Iter 87: loss 0.19169. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.03it/s]
Epoch 6 Iter 88: loss 0.18842. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.03it/s]
Epoch 6 Iter 88: loss 0.18842. :  39%|██████████████████                            | 88/224 [00:43<01:07,  2.02it/s]
Epoch 6 Iter 89: loss 0.20280. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.02it/s]
Epoch 6 Iter 89: loss 0.20280. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 6 Iter 90: loss 0.19825. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 6 Iter 90: loss 0.19825. :  40%|██████████████████▍                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 6 Iter 91: loss 0.18795. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.02it/s]
Epoch 6 Iter 91: loss 0.18795. :  41%|██████████████████▋                           | 91/224 [00:45<01:05,  2.02it/s]
Epoch 6 Iter 92: loss 0.18976. :  41%|██████████████████▋                           | 91/224 [00:45<01:05,  2.02it/s]
Epoch 6 Iter 92: loss 0.18976. :  41%|██████████████████▉                           | 92/224 [00:45<01:05,  2.02it/s]
Epoch 6 Iter 93: loss 0.19203. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.02it/s]
Epoch 6 Iter 93: loss 0.19203. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.02it/s]
Epoch 6 Iter 94: loss 0.19022. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.02it/s]
Epoch 6 Iter 94: loss 0.19022. :  42%|███████████████████▎                          | 94/224 [00:46<01:04,  2.01it/s]
Epoch 6 Iter 95: loss 0.19279. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.01it/s]
Epoch 6 Iter 95: loss 0.19279. :  42%|███████████████████▌                          | 95/224 [00:47<01:03,  2.02it/s]
Epoch 6 Iter 96: loss 0.22043. :  42%|███████████████████▌                          | 95/224 [00:47<01:03,  2.02it/s]
Epoch 6 Iter 96: loss 0.22043. :  43%|███████████████████▋                          | 96/224 [00:47<01:03,  2.03it/s]
Epoch 6 Iter 97: loss 0.17975. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.03it/s]
Epoch 6 Iter 97: loss 0.17975. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 6 Iter 98: loss 0.21191. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 6 Iter 98: loss 0.21191. :  44%|████████████████████▏                         | 98/224 [00:48<01:02,  2.03it/s]
Epoch 6 Iter 99: loss 0.20496. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.03it/s]
Epoch 6 Iter 99: loss 0.20496. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 6 Iter 100: loss 0.19750. :  44%|███████████████████▉                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 6 Iter 100: loss 0.19750. :  45%|███████████████████▋                        | 100/224 [00:49<01:01,  2.02it/s]
Epoch 6 Iter 101: loss 0.19885. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.02it/s]
Epoch 6 Iter 101: loss 0.19885. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.03it/s]
Epoch 6 Iter 102: loss 0.20817. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.03it/s]
Epoch 6 Iter 102: loss 0.20817. :  46%|████████████████████                        | 102/224 [00:50<01:00,  2.03it/s]
Epoch 6 Iter 103: loss 0.19908. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.03it/s]
Epoch 6 Iter 103: loss 0.19908. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 6 Iter 104: loss 0.19274. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 6 Iter 104: loss 0.19274. :  46%|████████████████████▍                       | 104/224 [00:51<00:59,  2.03it/s]
Epoch 6 Iter 105: loss 0.18837. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.03it/s]
Epoch 6 Iter 105: loss 0.18837. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.02it/s]
Epoch 6 Iter 106: loss 0.18997. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.02it/s]
Epoch 6 Iter 106: loss 0.18997. :  47%|████████████████████▊                       | 106/224 [00:52<00:59,  2.00it/s]
Epoch 6 Iter 107: loss 0.19690. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  2.00it/s]
Epoch 6 Iter 107: loss 0.19690. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.00it/s]
Epoch 6 Iter 108: loss 0.21135. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.00it/s]
Epoch 6 Iter 108: loss 0.21135. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.00it/s]
Epoch 6 Iter 109: loss 0.19298. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.00it/s]
Epoch 6 Iter 109: loss 0.19298. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.01it/s]
Epoch 6 Iter 110: loss 0.19180. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.01it/s]
Epoch 6 Iter 110: loss 0.19180. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.02it/s]
Epoch 6 Iter 111: loss 0.17634. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.02it/s]
Epoch 6 Iter 111: loss 0.17634. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 112: loss 0.20095. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 112: loss 0.20095. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 113: loss 0.19504. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.02it/s]
Epoch 6 Iter 113: loss 0.19504. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.02it/s]
Epoch 6 Iter 114: loss 0.19364. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.02it/s]
Epoch 6 Iter 114: loss 0.19364. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 6 Iter 115: loss 0.20067. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 6 Iter 115: loss 0.20067. :  51%|██████████████████████▌                     | 115/224 [00:56<00:53,  2.02it/s]
Epoch 6 Iter 116: loss 0.19029. :  51%|██████████████████████▌                     | 115/224 [00:57<00:53,  2.02it/s]
Epoch 6 Iter 116: loss 0.19029. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.02it/s]
Epoch 6 Iter 117: loss 0.18465. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.02it/s]
Epoch 6 Iter 117: loss 0.18465. :  52%|██████████████████████▉                     | 117/224 [00:57<00:52,  2.02it/s]
Epoch 6 Iter 118: loss 0.18962. :  52%|██████████████████████▉                     | 117/224 [00:58<00:52,  2.02it/s]
Epoch 6 Iter 118: loss 0.18962. :  53%|███████████████████████▏                    | 118/224 [00:58<00:52,  2.02it/s]
Epoch 6 Iter 119: loss 0.18382. :  53%|███████████████████████▏                    | 118/224 [00:58<00:52,  2.02it/s]
Epoch 6 Iter 119: loss 0.18382. :  53%|███████████████████████▍                    | 119/224 [00:58<00:51,  2.02it/s]
Epoch 6 Iter 120: loss 0.18187. :  53%|███████████████████████▍                    | 119/224 [00:59<00:51,  2.02it/s]
Epoch 6 Iter 120: loss 0.18187. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 6 Iter 121: loss 0.17847. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 6 Iter 121: loss 0.17847. :  54%|███████████████████████▊                    | 121/224 [00:59<00:50,  2.03it/s]
Epoch 6 Iter 122: loss 0.18800. :  54%|███████████████████████▊                    | 121/224 [01:00<00:50,  2.03it/s]
Epoch 6 Iter 122: loss 0.18800. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.03it/s]
Epoch 6 Iter 123: loss 0.18544. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.03it/s]
Epoch 6 Iter 123: loss 0.18544. :  55%|████████████████████████▏                   | 123/224 [01:00<00:49,  2.03it/s]
Epoch 6 Iter 124: loss 0.19283. :  55%|████████████████████████▏                   | 123/224 [01:01<00:49,  2.03it/s]
Epoch 6 Iter 124: loss 0.19283. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.03it/s]
Epoch 6 Iter 125: loss 0.17795. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.03it/s]
Epoch 6 Iter 125: loss 0.17795. :  56%|████████████████████████▌                   | 125/224 [01:01<00:48,  2.02it/s]
Epoch 6 Iter 126: loss 0.18502. :  56%|████████████████████████▌                   | 125/224 [01:02<00:48,  2.02it/s]
Epoch 6 Iter 126: loss 0.18502. :  56%|████████████████████████▊                   | 126/224 [01:02<00:50,  1.95it/s]
Epoch 6 Iter 127: loss 0.18640. :  56%|████████████████████████▊                   | 126/224 [01:02<00:50,  1.95it/s]
Epoch 6 Iter 127: loss 0.18640. :  57%|████████████████████████▉                   | 127/224 [01:02<00:49,  1.97it/s]
Epoch 6 Iter 128: loss 0.19627. :  57%|████████████████████████▉                   | 127/224 [01:03<00:49,  1.97it/s]
Epoch 6 Iter 128: loss 0.19627. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:48,  1.98it/s]
Epoch 6 Iter 129: loss 0.19809. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:48,  1.98it/s]
Epoch 6 Iter 129: loss 0.19809. :  58%|█████████████████████████▎                  | 129/224 [01:03<00:47,  1.98it/s]
Epoch 6 Iter 130: loss 0.18419. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  1.98it/s]
Epoch 6 Iter 130: loss 0.18419. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.00it/s]
Epoch 6 Iter 131: loss 0.20529. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.00it/s]
Epoch 6 Iter 131: loss 0.20529. :  58%|█████████████████████████▋                  | 131/224 [01:04<00:46,  2.01it/s]
Epoch 6 Iter 132: loss 0.17537. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 6 Iter 132: loss 0.17537. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.03it/s]
Epoch 6 Iter 133: loss 0.18602. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.03it/s]
Epoch 6 Iter 133: loss 0.18602. :  59%|██████████████████████████▏                 | 133/224 [01:05<00:45,  2.02it/s]
Epoch 6 Iter 134: loss 0.18358. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.02it/s]
Epoch 6 Iter 134: loss 0.18358. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:44,  2.02it/s]
Epoch 6 Iter 135: loss 0.18208. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:44,  2.02it/s]
Epoch 6 Iter 135: loss 0.18208. :  60%|██████████████████████████▌                 | 135/224 [01:06<00:43,  2.03it/s]
Epoch 6 Iter 136: loss 0.17127. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:43,  2.03it/s]
Epoch 6 Iter 136: loss 0.17127. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:43,  2.02it/s]
Epoch 6 Iter 137: loss 0.17221. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:43,  2.02it/s]
Epoch 6 Iter 137: loss 0.17221. :  61%|██████████████████████████▉                 | 137/224 [01:07<00:43,  2.02it/s]
Epoch 6 Iter 138: loss 0.15318. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 6 Iter 138: loss 0.15318. :  62%|███████████████████████████                 | 138/224 [01:08<00:43,  2.00it/s]
Epoch 6 Iter 139: loss 0.21537. :  62%|███████████████████████████                 | 138/224 [01:08<00:43,  2.00it/s]
Epoch 6 Iter 139: loss 0.21537. :  62%|███████████████████████████▎                | 139/224 [01:08<00:42,  2.00it/s]
Epoch 6 Iter 140: loss 0.18039. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.00it/s]
Epoch 6 Iter 140: loss 0.18039. :  62%|███████████████████████████▌                | 140/224 [01:09<00:42,  1.98it/s]
Epoch 6 Iter 141: loss 0.16421. :  62%|███████████████████████████▌                | 140/224 [01:09<00:42,  1.98it/s]
Epoch 6 Iter 141: loss 0.16421. :  63%|███████████████████████████▋                | 141/224 [01:09<00:41,  1.99it/s]
Epoch 6 Iter 142: loss 0.19138. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  1.99it/s]
Epoch 6 Iter 142: loss 0.19138. :  63%|███████████████████████████▉                | 142/224 [01:10<00:41,  1.99it/s]
Epoch 6 Iter 143: loss 0.15160. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  1.99it/s]
Epoch 6 Iter 143: loss 0.15160. :  64%|████████████████████████████                | 143/224 [01:11<00:43,  1.87it/s]
Epoch 6 Iter 144: loss 0.19837. :  64%|████████████████████████████                | 143/224 [01:11<00:43,  1.87it/s]
Epoch 6 Iter 144: loss 0.19837. :  64%|████████████████████████████▎               | 144/224 [01:11<00:43,  1.84it/s]
Epoch 6 Iter 145: loss 0.16641. :  64%|████████████████████████████▎               | 144/224 [01:12<00:43,  1.84it/s]
Epoch 6 Iter 145: loss 0.16641. :  65%|████████████████████████████▍               | 145/224 [01:12<00:42,  1.87it/s]
Epoch 6 Iter 146: loss 0.17719. :  65%|████████████████████████████▍               | 145/224 [01:12<00:42,  1.87it/s]
Epoch 6 Iter 146: loss 0.17719. :  65%|████████████████████████████▋               | 146/224 [01:12<00:40,  1.91it/s]
Epoch 6 Iter 147: loss 0.18839. :  65%|████████████████████████████▋               | 146/224 [01:13<00:40,  1.91it/s]
Epoch 6 Iter 147: loss 0.18839. :  66%|████████████████████████████▉               | 147/224 [01:13<00:39,  1.93it/s]
Epoch 6 Iter 148: loss 0.17691. :  66%|████████████████████████████▉               | 147/224 [01:13<00:39,  1.93it/s]
Epoch 6 Iter 148: loss 0.17691. :  66%|█████████████████████████████               | 148/224 [01:13<00:38,  1.96it/s]
Epoch 6 Iter 149: loss 0.16806. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.96it/s]
Epoch 6 Iter 149: loss 0.16806. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  1.98it/s]
Epoch 6 Iter 150: loss 0.17763. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  1.98it/s]
Epoch 6 Iter 150: loss 0.17763. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:37,  1.99it/s]
Epoch 6 Iter 151: loss 0.17356. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  1.99it/s]
Epoch 6 Iter 151: loss 0.17356. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.01it/s]
Epoch 6 Iter 152: loss 0.18523. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.01it/s]
Epoch 6 Iter 152: loss 0.18523. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:35,  2.01it/s]
Epoch 6 Iter 153: loss 0.17823. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.01it/s]
Epoch 6 Iter 153: loss 0.17823. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.01it/s]
Epoch 6 Iter 154: loss 0.18442. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.01it/s]
Epoch 6 Iter 154: loss 0.18442. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:34,  2.01it/s]
Epoch 6 Iter 155: loss 0.18572. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.01it/s]
Epoch 6 Iter 155: loss 0.18572. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.01it/s]
Epoch 6 Iter 156: loss 0.17424. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.01it/s]
Epoch 6 Iter 156: loss 0.17424. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:33,  2.02it/s]
Epoch 6 Iter 157: loss 0.15604. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.02it/s]
Epoch 6 Iter 157: loss 0.15604. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.03it/s]
Epoch 6 Iter 158: loss 0.17513. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.03it/s]
Epoch 6 Iter 158: loss 0.17513. :  71%|███████████████████████████████             | 158/224 [01:18<00:32,  2.02it/s]
Epoch 6 Iter 159: loss 0.18587. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.02it/s]
Epoch 6 Iter 159: loss 0.18587. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.19557. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.19557. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:33,  1.90it/s]
Epoch 6 Iter 161: loss 0.18641. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:33,  1.90it/s]
Epoch 6 Iter 161: loss 0.18641. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:32,  1.93it/s]
Epoch 6 Iter 162: loss 0.17347. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:32,  1.93it/s]
Epoch 6 Iter 162: loss 0.17347. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:31,  1.95it/s]
Epoch 6 Iter 163: loss 0.15993. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:31,  1.95it/s]
Epoch 6 Iter 163: loss 0.15993. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  1.98it/s]
Epoch 6 Iter 164: loss 0.17878. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  1.98it/s]
Epoch 6 Iter 164: loss 0.17878. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:29,  2.01it/s]
Epoch 6 Iter 165: loss 0.16991. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.01it/s]
Epoch 6 Iter 165: loss 0.16991. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.00it/s]
Epoch 6 Iter 166: loss 0.16448. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.00it/s]
Epoch 6 Iter 166: loss 0.16448. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:28,  2.01it/s]
Epoch 6 Iter 167: loss 0.16895. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.01it/s]
Epoch 6 Iter 167: loss 0.16895. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 6 Iter 168: loss 0.17368. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 6 Iter 168: loss 0.17368. :  75%|█████████████████████████████████           | 168/224 [01:23<00:27,  2.02it/s]
Epoch 6 Iter 169: loss 0.17096. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.02it/s]
Epoch 6 Iter 169: loss 0.17096. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 6 Iter 170: loss 0.16835. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 6 Iter 170: loss 0.16835. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:27,  1.99it/s]
Epoch 6 Iter 171: loss 0.18063. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:27,  1.99it/s]
Epoch 6 Iter 171: loss 0.18063. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.00it/s]
Epoch 6 Iter 172: loss 0.18603. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.00it/s]
Epoch 6 Iter 172: loss 0.18603. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.01it/s]
Epoch 6 Iter 173: loss 0.18216. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.01it/s]
Epoch 6 Iter 173: loss 0.18216. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 6 Iter 174: loss 0.18102. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 6 Iter 174: loss 0.18102. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.01it/s]
Epoch 6 Iter 175: loss 0.18511. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.01it/s]
Epoch 6 Iter 175: loss 0.18511. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 6 Iter 176: loss 0.18733. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 6 Iter 176: loss 0.18733. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.00it/s]
Epoch 6 Iter 177: loss 0.18348. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.00it/s]
Epoch 6 Iter 177: loss 0.18348. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  1.97it/s]
Epoch 6 Iter 178: loss 0.18175. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  1.97it/s]
Epoch 6 Iter 178: loss 0.18175. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:23,  1.99it/s]
Epoch 6 Iter 179: loss 0.17882. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:23,  1.99it/s]
Epoch 6 Iter 179: loss 0.17882. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  1.99it/s]
Epoch 6 Iter 180: loss 0.17781. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  1.99it/s]
Epoch 6 Iter 180: loss 0.17781. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:22,  1.98it/s]
Epoch 6 Iter 181: loss 0.16242. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:22,  1.98it/s]
Epoch 6 Iter 181: loss 0.16242. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:23,  1.85it/s]
Epoch 6 Iter 182: loss 0.17142. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:23,  1.85it/s]
Epoch 6 Iter 182: loss 0.17142. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:22,  1.89it/s]
Epoch 6 Iter 183: loss 0.18731. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:22,  1.89it/s]
Epoch 6 Iter 183: loss 0.18731. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:21,  1.92it/s]
Epoch 6 Iter 184: loss 0.18565. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:21,  1.92it/s]
Epoch 6 Iter 184: loss 0.18565. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:20,  1.91it/s]
Epoch 6 Iter 185: loss 0.18802. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:20,  1.91it/s]
Epoch 6 Iter 185: loss 0.18802. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:20,  1.93it/s]
Epoch 6 Iter 186: loss 0.17611. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:20,  1.93it/s]
Epoch 6 Iter 186: loss 0.17611. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:19,  1.95it/s]
Epoch 6 Iter 187: loss 0.18164. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:19,  1.95it/s]
Epoch 6 Iter 187: loss 0.18164. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.96it/s]
Epoch 6 Iter 188: loss 0.18488. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.96it/s]
Epoch 6 Iter 188: loss 0.18488. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:18,  1.98it/s]
Epoch 6 Iter 189: loss 0.17796. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.98it/s]
Epoch 6 Iter 189: loss 0.17796. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.98it/s]
Epoch 6 Iter 190: loss 0.16948. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.98it/s]
Epoch 6 Iter 190: loss 0.16948. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  1.99it/s]
Epoch 6 Iter 191: loss 0.18192. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  1.99it/s]
Epoch 6 Iter 191: loss 0.18192. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 6 Iter 192: loss 0.17046. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 6 Iter 192: loss 0.17046. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:16,  2.00it/s]
Epoch 6 Iter 193: loss 0.20479. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  2.00it/s]
Epoch 6 Iter 193: loss 0.20479. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 6 Iter 194: loss 0.16696. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 6 Iter 194: loss 0.16696. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:15,  2.00it/s]
Epoch 6 Iter 195: loss 0.14986. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:15,  2.00it/s]
Epoch 6 Iter 195: loss 0.14986. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.00it/s]
Epoch 6 Iter 196: loss 0.15905. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.00it/s]
Epoch 6 Iter 196: loss 0.15905. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:14,  2.00it/s]
Epoch 6 Iter 197: loss 0.17168. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:14,  2.00it/s]
Epoch 6 Iter 197: loss 0.17168. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 6 Iter 198: loss 0.19018. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 6 Iter 198: loss 0.19018. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.01it/s]
Epoch 6 Iter 199: loss 0.16387. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.01it/s]
Epoch 6 Iter 199: loss 0.16387. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 6 Iter 200: loss 0.18023. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 6 Iter 200: loss 0.18023. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:12,  1.99it/s]
Epoch 6 Iter 201: loss 0.17253. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  1.99it/s]
Epoch 6 Iter 201: loss 0.17253. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.96it/s]
Epoch 6 Iter 202: loss 0.17768. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.96it/s]
Epoch 6 Iter 202: loss 0.17768. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:11,  1.98it/s]
Epoch 6 Iter 203: loss 0.16757. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:11,  1.98it/s]
Epoch 6 Iter 203: loss 0.16757. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.99it/s]
Epoch 6 Iter 204: loss 0.19571. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.99it/s]
Epoch 6 Iter 204: loss 0.19571. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:10,  1.99it/s]
Epoch 6 Iter 205: loss 0.17695. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:10,  1.99it/s]
Epoch 6 Iter 205: loss 0.17695. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.97it/s]
Epoch 6 Iter 206: loss 0.17511. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.97it/s]
Epoch 6 Iter 206: loss 0.17511. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:09,  1.92it/s]
Epoch 6 Iter 207: loss 0.15678. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:09,  1.92it/s]
Epoch 6 Iter 207: loss 0.15678. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.94it/s]
Epoch 6 Iter 208: loss 0.15942. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.94it/s]
Epoch 6 Iter 208: loss 0.15942. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:08,  1.96it/s]
Epoch 6 Iter 209: loss 0.17770. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.96it/s]
Epoch 6 Iter 209: loss 0.17770. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  1.98it/s]
Epoch 6 Iter 210: loss 0.19551. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  1.98it/s]
Epoch 6 Iter 210: loss 0.19551. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:07,  1.99it/s]
Epoch 6 Iter 211: loss 0.16629. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.99it/s]
Epoch 6 Iter 211: loss 0.16629. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.00it/s]
Epoch 6 Iter 212: loss 0.16293. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.00it/s]
Epoch 6 Iter 212: loss 0.16293. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.00it/s]
Epoch 6 Iter 213: loss 0.17121. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.00it/s]
Epoch 6 Iter 213: loss 0.17121. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 6 Iter 214: loss 0.18459. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 6 Iter 214: loss 0.18459. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:05,  1.99it/s]
Epoch 6 Iter 215: loss 0.18331. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.99it/s]
Epoch 6 Iter 215: loss 0.18331. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.00it/s]
Epoch 6 Iter 216: loss 0.17053. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.00it/s]
Epoch 6 Iter 216: loss 0.17053. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.01it/s]
Epoch 6 Iter 217: loss 0.18718. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:03,  2.01it/s]
Epoch 6 Iter 217: loss 0.18718. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.01it/s]
Epoch 6 Iter 218: loss 0.16771. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.01it/s]
Epoch 6 Iter 218: loss 0.16771. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.00it/s]
Epoch 6 Iter 219: loss 0.17591. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.00it/s]
Epoch 6 Iter 219: loss 0.17591. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.00it/s]
Epoch 6 Iter 220: loss 0.19395. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.00it/s]
Epoch 6 Iter 220: loss 0.19395. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:01,  2.00it/s]
Epoch 6 Iter 221: loss 0.17174. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:01,  2.00it/s]
Epoch 6 Iter 221: loss 0.17174. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.00it/s]
Epoch 6 Iter 222: loss 0.17471. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.00it/s]
Epoch 6 Iter 222: loss 0.17471. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:01,  2.00it/s]
Epoch 6 Iter 223: loss 0.18913. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:01,  2.00it/s]
Epoch 6 Iter 223: loss 0.18913. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.01it/s]
Epoch 6 Iter 224: loss 0.18311. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.01it/s]
Epoch 6 Iter 224: loss 0.18311. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.01it/s]
Epoch 6 Iter 224: loss 0.18311. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.16891. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.16891. :   0%|▏                                               | 1/224 [00:00<01:48,  2.06it/s]
Epoch 7 Iter 2: loss 0.17455. :   0%|▏                                               | 1/224 [00:00<01:48,  2.06it/s]
Epoch 7 Iter 2: loss 0.17455. :   1%|▍                                               | 2/224 [00:00<01:49,  2.04it/s]
Epoch 7 Iter 3: loss 0.18552. :   1%|▍                                               | 2/224 [00:01<01:49,  2.04it/s]
Epoch 7 Iter 3: loss 0.18552. :   1%|▋                                               | 3/224 [00:01<01:48,  2.04it/s]
Epoch 7 Iter 4: loss 0.18890. :   1%|▋                                               | 3/224 [00:01<01:48,  2.04it/s]
Epoch 7 Iter 4: loss 0.18890. :   2%|▊                                               | 4/224 [00:01<01:48,  2.03it/s]
Epoch 7 Iter 5: loss 0.18136. :   2%|▊                                               | 4/224 [00:02<01:48,  2.03it/s]
Epoch 7 Iter 5: loss 0.18136. :   2%|█                                               | 5/224 [00:02<01:48,  2.02it/s]
Epoch 7 Iter 6: loss 0.17485. :   2%|█                                               | 5/224 [00:02<01:48,  2.02it/s]
Epoch 7 Iter 6: loss 0.17485. :   3%|█▎                                              | 6/224 [00:02<01:47,  2.03it/s]
Epoch 7 Iter 7: loss 0.17380. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.03it/s]
Epoch 7 Iter 7: loss 0.17380. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.03it/s]
Epoch 7 Iter 8: loss 0.18607. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.03it/s]
Epoch 7 Iter 8: loss 0.18607. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.01it/s]
Epoch 7 Iter 9: loss 0.16527. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 7 Iter 9: loss 0.16527. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.02it/s]
Epoch 7 Iter 10: loss 0.19127. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 7 Iter 10: loss 0.19127. :   4%|██                                            | 10/224 [00:04<01:46,  2.02it/s]
Epoch 7 Iter 11: loss 0.19793. :   4%|██                                            | 10/224 [00:05<01:46,  2.02it/s]
Epoch 7 Iter 11: loss 0.19793. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 7 Iter 12: loss 0.16843. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 7 Iter 12: loss 0.16843. :   5%|██▍                                           | 12/224 [00:05<01:45,  2.01it/s]
Epoch 7 Iter 13: loss 0.17105. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.01it/s]
Epoch 7 Iter 13: loss 0.17105. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 7 Iter 14: loss 0.16062. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 7 Iter 14: loss 0.16062. :   6%|██▉                                           | 14/224 [00:06<01:44,  2.01it/s]
Epoch 7 Iter 15: loss 0.17990. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.01it/s]
Epoch 7 Iter 15: loss 0.17990. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 7 Iter 16: loss 0.16932. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 7 Iter 16: loss 0.16932. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.01it/s]
Epoch 7 Iter 17: loss 0.16247. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.01it/s]
Epoch 7 Iter 17: loss 0.16247. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.01it/s]
Epoch 7 Iter 18: loss 0.17597. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.01it/s]
Epoch 7 Iter 18: loss 0.17597. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.01it/s]
Epoch 7 Iter 19: loss 0.15946. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.01it/s]
Epoch 7 Iter 19: loss 0.15946. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 7 Iter 20: loss 0.15243. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 7 Iter 20: loss 0.15243. :   9%|████                                          | 20/224 [00:09<01:41,  2.02it/s]
Epoch 7 Iter 21: loss 0.19455. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 7 Iter 21: loss 0.19455. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 7 Iter 22: loss 0.18605. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 7 Iter 22: loss 0.18605. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.02it/s]
Epoch 7 Iter 23: loss 0.19129. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 7 Iter 23: loss 0.19129. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 7 Iter 24: loss 0.17668. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 7 Iter 24: loss 0.17668. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.01it/s]
Epoch 7 Iter 25: loss 0.18031. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 7 Iter 25: loss 0.18031. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.01it/s]
Epoch 7 Iter 26: loss 0.16006. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.01it/s]
Epoch 7 Iter 26: loss 0.16006. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.01it/s]
Epoch 7 Iter 27: loss 0.16942. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.01it/s]
Epoch 7 Iter 27: loss 0.16942. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 7 Iter 28: loss 0.18065. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 7 Iter 28: loss 0.18065. :  12%|█████▊                                        | 28/224 [00:13<01:36,  2.03it/s]
Epoch 7 Iter 29: loss 0.17987. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.03it/s]
Epoch 7 Iter 29: loss 0.17987. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 7 Iter 30: loss 0.17214. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 7 Iter 30: loss 0.17214. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 7 Iter 31: loss 0.19101. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 7 Iter 31: loss 0.19101. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.01it/s]
Epoch 7 Iter 32: loss 0.17393. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.01it/s]
Epoch 7 Iter 32: loss 0.17393. :  14%|██████▌                                       | 32/224 [00:15<01:36,  1.99it/s]
Epoch 7 Iter 33: loss 0.17823. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 7 Iter 33: loss 0.17823. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.98it/s]
Epoch 7 Iter 34: loss 0.16746. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.98it/s]
Epoch 7 Iter 34: loss 0.16746. :  15%|██████▉                                       | 34/224 [00:16<01:35,  1.98it/s]
Epoch 7 Iter 35: loss 0.18145. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.98it/s]
Epoch 7 Iter 35: loss 0.18145. :  16%|███████▏                                      | 35/224 [00:17<01:35,  1.97it/s]
Epoch 7 Iter 36: loss 0.16698. :  16%|███████▏                                      | 35/224 [00:17<01:35,  1.97it/s]
Epoch 7 Iter 36: loss 0.16698. :  16%|███████▍                                      | 36/224 [00:17<01:34,  1.98it/s]
Epoch 7 Iter 37: loss 0.18484. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.98it/s]
Epoch 7 Iter 37: loss 0.18484. :  17%|███████▌                                      | 37/224 [00:18<01:35,  1.96it/s]
Epoch 7 Iter 38: loss 0.16906. :  17%|███████▌                                      | 37/224 [00:18<01:35,  1.96it/s]
Epoch 7 Iter 38: loss 0.16906. :  17%|███████▊                                      | 38/224 [00:18<01:34,  1.96it/s]
Epoch 7 Iter 39: loss 0.17757. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.96it/s]
Epoch 7 Iter 39: loss 0.17757. :  17%|████████                                      | 39/224 [00:19<01:33,  1.97it/s]
Epoch 7 Iter 40: loss 0.17015. :  17%|████████                                      | 39/224 [00:19<01:33,  1.97it/s]
Epoch 7 Iter 40: loss 0.17015. :  18%|████████▏                                     | 40/224 [00:19<01:32,  1.98it/s]
Epoch 7 Iter 41: loss 0.15834. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.98it/s]
Epoch 7 Iter 41: loss 0.15834. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 7 Iter 42: loss 0.16358. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 7 Iter 42: loss 0.16358. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 7 Iter 43: loss 0.18151. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 7 Iter 43: loss 0.18151. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 7 Iter 44: loss 0.16122. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 7 Iter 44: loss 0.16122. :  20%|█████████                                     | 44/224 [00:21<01:28,  2.03it/s]
Epoch 7 Iter 45: loss 0.16870. :  20%|█████████                                     | 44/224 [00:22<01:28,  2.03it/s]
Epoch 7 Iter 45: loss 0.16870. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 7 Iter 46: loss 0.17025. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 7 Iter 46: loss 0.17025. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.01it/s]
Epoch 7 Iter 47: loss 0.16654. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 7 Iter 47: loss 0.16654. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 7 Iter 48: loss 0.16942. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 7 Iter 48: loss 0.16942. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.00it/s]
Epoch 7 Iter 49: loss 0.15645. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 7 Iter 49: loss 0.15645. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.01it/s]
Epoch 7 Iter 50: loss 0.16806. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.01it/s]
Epoch 7 Iter 50: loss 0.16806. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.02it/s]
Epoch 7 Iter 51: loss 0.17225. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.02it/s]
Epoch 7 Iter 51: loss 0.17225. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 7 Iter 52: loss 0.16620. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 7 Iter 52: loss 0.16620. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 7 Iter 53: loss 0.20322. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.02it/s]
Epoch 7 Iter 53: loss 0.20322. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 7 Iter 54: loss 0.18341. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 7 Iter 54: loss 0.18341. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.01it/s]
Epoch 7 Iter 55: loss 0.19854. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 7 Iter 55: loss 0.19854. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 7 Iter 56: loss 0.18106. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 7 Iter 56: loss 0.18106. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.02it/s]
Epoch 7 Iter 57: loss 0.18392. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 7 Iter 57: loss 0.18392. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 7 Iter 58: loss 0.16816. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 7 Iter 58: loss 0.16816. :  26%|███████████▉                                  | 58/224 [00:28<01:23,  1.98it/s]
Epoch 7 Iter 59: loss 0.16136. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.98it/s]
Epoch 7 Iter 59: loss 0.16136. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 7 Iter 60: loss 0.16069. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 7 Iter 60: loss 0.16069. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.00it/s]
Epoch 7 Iter 61: loss 0.18524. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 7 Iter 61: loss 0.18524. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 7 Iter 62: loss 0.16199. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 7 Iter 62: loss 0.16199. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.00it/s]
Epoch 7 Iter 63: loss 0.20025. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.00it/s]
Epoch 7 Iter 63: loss 0.20025. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.98it/s]
Epoch 7 Iter 64: loss 0.16090. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.98it/s]
Epoch 7 Iter 64: loss 0.16090. :  29%|█████████████▏                                | 64/224 [00:31<01:21,  1.96it/s]
Epoch 7 Iter 65: loss 0.16998. :  29%|█████████████▏                                | 64/224 [00:32<01:21,  1.96it/s]
Epoch 7 Iter 65: loss 0.16998. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.98it/s]
Epoch 7 Iter 66: loss 0.16786. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.98it/s]
Epoch 7 Iter 66: loss 0.16786. :  29%|█████████████▌                                | 66/224 [00:32<01:19,  1.98it/s]
Epoch 7 Iter 67: loss 0.18470. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.98it/s]
Epoch 7 Iter 67: loss 0.18470. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.00it/s]
Epoch 7 Iter 68: loss 0.17977. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.00it/s]
Epoch 7 Iter 68: loss 0.17977. :  30%|█████████████▉                                | 68/224 [00:33<01:17,  2.01it/s]
Epoch 7 Iter 69: loss 0.17833. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.01it/s]
Epoch 7 Iter 69: loss 0.17833. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 7 Iter 70: loss 0.16940. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 7 Iter 70: loss 0.16940. :  31%|██████████████▍                               | 70/224 [00:34<01:16,  2.01it/s]
Epoch 7 Iter 71: loss 0.17348. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.01it/s]
Epoch 7 Iter 71: loss 0.17348. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.03it/s]
Epoch 7 Iter 72: loss 0.18320. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.03it/s]
Epoch 7 Iter 72: loss 0.18320. :  32%|██████████████▊                               | 72/224 [00:35<01:15,  2.02it/s]
Epoch 7 Iter 73: loss 0.18513. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.02it/s]
Epoch 7 Iter 73: loss 0.18513. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 7 Iter 74: loss 0.18960. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 7 Iter 74: loss 0.18960. :  33%|███████████████▏                              | 74/224 [00:36<01:14,  2.02it/s]
Epoch 7 Iter 75: loss 0.14166. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 7 Iter 75: loss 0.14166. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 7 Iter 76: loss 0.18438. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 7 Iter 76: loss 0.18438. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.03it/s]
Epoch 7 Iter 77: loss 0.17263. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.03it/s]
Epoch 7 Iter 77: loss 0.17263. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 7 Iter 78: loss 0.16000. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 7 Iter 78: loss 0.16000. :  35%|████████████████                              | 78/224 [00:38<01:13,  1.98it/s]
Epoch 7 Iter 79: loss 0.17461. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.98it/s]
Epoch 7 Iter 79: loss 0.17461. :  35%|████████████████▏                             | 79/224 [00:39<01:13,  1.99it/s]
Epoch 7 Iter 80: loss 0.16911. :  35%|████████████████▏                             | 79/224 [00:39<01:13,  1.99it/s]
Epoch 7 Iter 80: loss 0.16911. :  36%|████████████████▍                             | 80/224 [00:39<01:12,  1.98it/s]
Epoch 7 Iter 81: loss 0.14484. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  1.98it/s]
Epoch 7 Iter 81: loss 0.14484. :  36%|████████████████▋                             | 81/224 [00:40<01:12,  1.98it/s]
Epoch 7 Iter 82: loss 0.17554. :  36%|████████████████▋                             | 81/224 [00:40<01:12,  1.98it/s]
Epoch 7 Iter 82: loss 0.17554. :  37%|████████████████▊                             | 82/224 [00:40<01:10,  2.00it/s]
Epoch 7 Iter 83: loss 0.15966. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.00it/s]
Epoch 7 Iter 83: loss 0.15966. :  37%|█████████████████                             | 83/224 [00:41<01:10,  2.00it/s]
Epoch 7 Iter 84: loss 0.18759. :  37%|█████████████████                             | 83/224 [00:41<01:10,  2.00it/s]
Epoch 7 Iter 84: loss 0.18759. :  38%|█████████████████▎                            | 84/224 [00:41<01:09,  2.02it/s]
Epoch 7 Iter 85: loss 0.17425. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.02it/s]
Epoch 7 Iter 85: loss 0.17425. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  2.01it/s]
Epoch 7 Iter 86: loss 0.15941. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  2.01it/s]
Epoch 7 Iter 86: loss 0.15941. :  38%|█████████████████▋                            | 86/224 [00:42<01:08,  2.01it/s]
Epoch 7 Iter 87: loss 0.15601. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.01it/s]
Epoch 7 Iter 87: loss 0.15601. :  39%|█████████████████▊                            | 87/224 [00:43<01:08,  2.01it/s]
Epoch 7 Iter 88: loss 0.17587. :  39%|█████████████████▊                            | 87/224 [00:43<01:08,  2.01it/s]
Epoch 7 Iter 88: loss 0.17587. :  39%|██████████████████                            | 88/224 [00:43<01:07,  2.00it/s]
Epoch 7 Iter 89: loss 0.17403. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.00it/s]
Epoch 7 Iter 89: loss 0.17403. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  2.01it/s]
Epoch 7 Iter 90: loss 0.17013. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  2.01it/s]
Epoch 7 Iter 90: loss 0.17013. :  40%|██████████████████▍                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 7 Iter 91: loss 0.16919. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 7 Iter 91: loss 0.16919. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.00it/s]
Epoch 7 Iter 92: loss 0.17315. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.00it/s]
Epoch 7 Iter 92: loss 0.17315. :  41%|██████████████████▉                           | 92/224 [00:45<01:05,  2.01it/s]
Epoch 7 Iter 93: loss 0.16599. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.01it/s]
Epoch 7 Iter 93: loss 0.16599. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.00it/s]
Epoch 7 Iter 94: loss 0.17408. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.00it/s]
Epoch 7 Iter 94: loss 0.17408. :  42%|███████████████████▎                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 7 Iter 95: loss 0.17456. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 7 Iter 95: loss 0.17456. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 7 Iter 96: loss 0.15316. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 7 Iter 96: loss 0.15316. :  43%|███████████████████▋                          | 96/224 [00:47<01:04,  1.98it/s]
Epoch 7 Iter 97: loss 0.18015. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 7 Iter 97: loss 0.18015. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.97it/s]
Epoch 7 Iter 98: loss 0.18952. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.97it/s]
Epoch 7 Iter 98: loss 0.18952. :  44%|████████████████████▏                         | 98/224 [00:48<01:04,  1.97it/s]
Epoch 7 Iter 99: loss 0.16915. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.97it/s]
Epoch 7 Iter 99: loss 0.16915. :  44%|████████████████████▎                         | 99/224 [00:49<01:03,  1.97it/s]
Epoch 7 Iter 100: loss 0.16602. :  44%|███████████████████▉                         | 99/224 [00:49<01:03,  1.97it/s]
Epoch 7 Iter 100: loss 0.16602. :  45%|███████████████████▋                        | 100/224 [00:49<01:02,  1.98it/s]
Epoch 7 Iter 101: loss 0.16245. :  45%|███████████████████▋                        | 100/224 [00:50<01:02,  1.98it/s]
Epoch 7 Iter 101: loss 0.16245. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  1.99it/s]
Epoch 7 Iter 102: loss 0.19199. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  1.99it/s]
Epoch 7 Iter 102: loss 0.19199. :  46%|████████████████████                        | 102/224 [00:50<01:01,  1.99it/s]
Epoch 7 Iter 103: loss 0.16386. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.99it/s]
Epoch 7 Iter 103: loss 0.16386. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 7 Iter 104: loss 0.17684. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 7 Iter 104: loss 0.17684. :  46%|████████████████████▍                       | 104/224 [00:51<01:00,  1.99it/s]
Epoch 7 Iter 105: loss 0.18415. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.99it/s]
Epoch 7 Iter 105: loss 0.18415. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  1.99it/s]
Epoch 7 Iter 106: loss 0.18116. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  1.99it/s]
Epoch 7 Iter 106: loss 0.18116. :  47%|████████████████████▊                       | 106/224 [00:52<00:59,  2.00it/s]
Epoch 7 Iter 107: loss 0.19220. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  2.00it/s]
Epoch 7 Iter 107: loss 0.19220. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 7 Iter 108: loss 0.18587. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 7 Iter 108: loss 0.18587. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.02it/s]
Epoch 7 Iter 109: loss 0.18223. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 7 Iter 109: loss 0.18223. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.01it/s]
Epoch 7 Iter 110: loss 0.16613. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.01it/s]
Epoch 7 Iter 110: loss 0.16613. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.01it/s]
Epoch 7 Iter 111: loss 0.19277. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.01it/s]
Epoch 7 Iter 111: loss 0.19277. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.02it/s]
Epoch 7 Iter 112: loss 0.16997. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.02it/s]
Epoch 7 Iter 112: loss 0.16997. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.01it/s]
Epoch 7 Iter 113: loss 0.14888. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.01it/s]
Epoch 7 Iter 113: loss 0.14888. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.01it/s]
Epoch 7 Iter 114: loss 0.15532. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.01it/s]
Epoch 7 Iter 114: loss 0.15532. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.00it/s]
Epoch 7 Iter 115: loss 0.17067. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.00it/s]
Epoch 7 Iter 115: loss 0.17067. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.00it/s]
Epoch 7 Iter 116: loss 0.17333. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.00it/s]
Epoch 7 Iter 116: loss 0.17333. :  52%|██████████████████████▊                     | 116/224 [00:57<00:54,  1.99it/s]
Epoch 7 Iter 117: loss 0.17857. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.99it/s]
Epoch 7 Iter 117: loss 0.17857. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  1.99it/s]
Epoch 7 Iter 118: loss 0.17825. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  1.99it/s]
Epoch 7 Iter 118: loss 0.17825. :  53%|███████████████████████▏                    | 118/224 [00:58<00:53,  1.98it/s]
Epoch 7 Iter 119: loss 0.16427. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.98it/s]
Epoch 7 Iter 119: loss 0.16427. :  53%|███████████████████████▍                    | 119/224 [00:59<00:53,  1.98it/s]
Epoch 7 Iter 120: loss 0.17763. :  53%|███████████████████████▍                    | 119/224 [00:59<00:53,  1.98it/s]
Epoch 7 Iter 120: loss 0.17763. :  54%|███████████████████████▌                    | 120/224 [00:59<00:52,  1.98it/s]
Epoch 7 Iter 121: loss 0.18247. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 7 Iter 121: loss 0.18247. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  1.99it/s]
Epoch 7 Iter 122: loss 0.18852. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  1.99it/s]
Epoch 7 Iter 122: loss 0.18852. :  54%|███████████████████████▉                    | 122/224 [01:00<00:51,  1.98it/s]
Epoch 7 Iter 123: loss 0.18886. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.98it/s]
Epoch 7 Iter 123: loss 0.18886. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  1.98it/s]
Epoch 7 Iter 124: loss 0.18009. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  1.98it/s]
Epoch 7 Iter 124: loss 0.18009. :  55%|████████████████████████▎                   | 124/224 [01:01<00:50,  1.99it/s]
Epoch 7 Iter 125: loss 0.17070. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.99it/s]
Epoch 7 Iter 125: loss 0.17070. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 7 Iter 126: loss 0.15501. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 7 Iter 126: loss 0.15501. :  56%|████████████████████████▊                   | 126/224 [01:02<00:48,  2.01it/s]
Epoch 7 Iter 127: loss 0.17430. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.01it/s]
Epoch 7 Iter 127: loss 0.17430. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.00it/s]
Epoch 7 Iter 128: loss 0.16982. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.00it/s]
Epoch 7 Iter 128: loss 0.16982. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:47,  2.01it/s]
Epoch 7 Iter 129: loss 0.16769. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 7 Iter 129: loss 0.16769. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.01it/s]
Epoch 7 Iter 130: loss 0.17191. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.01it/s]
Epoch 7 Iter 130: loss 0.17191. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.01it/s]
Epoch 7 Iter 131: loss 0.17455. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 7 Iter 131: loss 0.17455. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 7 Iter 132: loss 0.18197. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 7 Iter 132: loss 0.18197. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.01it/s]
Epoch 7 Iter 133: loss 0.14547. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.01it/s]
Epoch 7 Iter 133: loss 0.14547. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:44,  2.02it/s]
Epoch 7 Iter 134: loss 0.18766. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:44,  2.02it/s]
Epoch 7 Iter 134: loss 0.18766. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:44,  2.02it/s]
Epoch 7 Iter 135: loss 0.16993. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.02it/s]
Epoch 7 Iter 135: loss 0.16993. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 7 Iter 136: loss 0.18001. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 7 Iter 136: loss 0.18001. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:43,  2.01it/s]
Epoch 7 Iter 137: loss 0.16772. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.01it/s]
Epoch 7 Iter 137: loss 0.16772. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.01it/s]
Epoch 7 Iter 138: loss 0.18810. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.01it/s]
Epoch 7 Iter 138: loss 0.18810. :  62%|███████████████████████████                 | 138/224 [01:08<00:42,  2.01it/s]
Epoch 7 Iter 139: loss 0.18433. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.01it/s]
Epoch 7 Iter 139: loss 0.18433. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 7 Iter 140: loss 0.17034. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 7 Iter 140: loss 0.17034. :  62%|███████████████████████████▌                | 140/224 [01:09<00:41,  2.01it/s]
Epoch 7 Iter 141: loss 0.18880. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 7 Iter 141: loss 0.18880. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 7 Iter 142: loss 0.17189. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 7 Iter 142: loss 0.17189. :  63%|███████████████████████████▉                | 142/224 [01:10<00:40,  2.02it/s]
Epoch 7 Iter 143: loss 0.18564. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 7 Iter 143: loss 0.18564. :  64%|████████████████████████████                | 143/224 [01:11<00:39,  2.03it/s]
Epoch 7 Iter 144: loss 0.16492. :  64%|████████████████████████████                | 143/224 [01:11<00:39,  2.03it/s]
Epoch 7 Iter 144: loss 0.16492. :  64%|████████████████████████████▎               | 144/224 [01:11<00:39,  2.03it/s]
Epoch 7 Iter 145: loss 0.14335. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.03it/s]
Epoch 7 Iter 145: loss 0.14335. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.02it/s]
Epoch 7 Iter 146: loss 0.17994. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.02it/s]
Epoch 7 Iter 146: loss 0.17994. :  65%|████████████████████████████▋               | 146/224 [01:12<00:38,  2.02it/s]
Epoch 7 Iter 147: loss 0.21064. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.02it/s]
Epoch 7 Iter 147: loss 0.21064. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 7 Iter 148: loss 0.16234. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 7 Iter 148: loss 0.16234. :  66%|█████████████████████████████               | 148/224 [01:13<00:38,  2.00it/s]
Epoch 7 Iter 149: loss 0.18333. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  2.00it/s]
Epoch 7 Iter 149: loss 0.18333. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:38,  1.96it/s]
Epoch 7 Iter 150: loss 0.17936. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:38,  1.96it/s]
Epoch 7 Iter 150: loss 0.17936. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:37,  1.97it/s]
Epoch 7 Iter 151: loss 0.17913. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  1.97it/s]
Epoch 7 Iter 151: loss 0.17913. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 7 Iter 152: loss 0.17737. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 7 Iter 152: loss 0.17737. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:36,  1.99it/s]
Epoch 7 Iter 153: loss 0.16197. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 7 Iter 153: loss 0.16197. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 7 Iter 154: loss 0.19023. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 7 Iter 154: loss 0.19023. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:35,  2.00it/s]
Epoch 7 Iter 155: loss 0.20055. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:35,  2.00it/s]
Epoch 7 Iter 155: loss 0.20055. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.00it/s]
Epoch 7 Iter 156: loss 0.18369. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.00it/s]
Epoch 7 Iter 156: loss 0.18369. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:33,  2.02it/s]
Epoch 7 Iter 157: loss 0.17776. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.02it/s]
Epoch 7 Iter 157: loss 0.17776. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 7 Iter 158: loss 0.16531. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 7 Iter 158: loss 0.16531. :  71%|███████████████████████████████             | 158/224 [01:18<00:32,  2.01it/s]
Epoch 7 Iter 159: loss 0.18094. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.01it/s]
Epoch 7 Iter 159: loss 0.18094. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.02it/s]
Epoch 7 Iter 160: loss 0.16690. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.02it/s]
Epoch 7 Iter 160: loss 0.16690. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:31,  2.02it/s]
Epoch 7 Iter 161: loss 0.18990. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.02it/s]
Epoch 7 Iter 161: loss 0.18990. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  1.99it/s]
Epoch 7 Iter 162: loss 0.18604. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  1.99it/s]
Epoch 7 Iter 162: loss 0.18604. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:31,  2.00it/s]
Epoch 7 Iter 163: loss 0.19300. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:31,  2.00it/s]
Epoch 7 Iter 163: loss 0.19300. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.00it/s]
Epoch 7 Iter 164: loss 0.18092. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.00it/s]
Epoch 7 Iter 164: loss 0.18092. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:29,  2.01it/s]
Epoch 7 Iter 165: loss 0.18086. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.01it/s]
Epoch 7 Iter 165: loss 0.18086. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.01it/s]
Epoch 7 Iter 166: loss 0.17929. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.01it/s]
Epoch 7 Iter 166: loss 0.17929. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:28,  2.02it/s]
Epoch 7 Iter 167: loss 0.17450. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.02it/s]
Epoch 7 Iter 167: loss 0.17450. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 7 Iter 168: loss 0.16649. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 7 Iter 168: loss 0.16649. :  75%|█████████████████████████████████           | 168/224 [01:23<00:27,  2.03it/s]
Epoch 7 Iter 169: loss 0.19423. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.03it/s]
Epoch 7 Iter 169: loss 0.19423. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 7 Iter 170: loss 0.16789. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 7 Iter 170: loss 0.16789. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:26,  2.03it/s]
Epoch 7 Iter 171: loss 0.17561. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.03it/s]
Epoch 7 Iter 171: loss 0.17561. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.03it/s]
Epoch 7 Iter 172: loss 0.16873. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.03it/s]
Epoch 7 Iter 172: loss 0.16873. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.04it/s]
Epoch 7 Iter 173: loss 0.17259. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.04it/s]
Epoch 7 Iter 173: loss 0.17259. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.03it/s]
Epoch 7 Iter 174: loss 0.19119. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.03it/s]
Epoch 7 Iter 174: loss 0.19119. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.01it/s]
Epoch 7 Iter 175: loss 0.15386. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.01it/s]
Epoch 7 Iter 175: loss 0.15386. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 7 Iter 176: loss 0.15482. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 7 Iter 176: loss 0.15482. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.00it/s]
Epoch 7 Iter 177: loss 0.17292. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.00it/s]
Epoch 7 Iter 177: loss 0.17292. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.00it/s]
Epoch 7 Iter 178: loss 0.16616. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.00it/s]
Epoch 7 Iter 178: loss 0.16616. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.00it/s]
Epoch 7 Iter 179: loss 0.17084. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.00it/s]
Epoch 7 Iter 179: loss 0.17084. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.00it/s]
Epoch 7 Iter 180: loss 0.19310. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.00it/s]
Epoch 7 Iter 180: loss 0.19310. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:22,  1.98it/s]
Epoch 7 Iter 181: loss 0.18971. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:22,  1.98it/s]
Epoch 7 Iter 181: loss 0.18971. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  1.99it/s]
Epoch 7 Iter 182: loss 0.15806. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  1.99it/s]
Epoch 7 Iter 182: loss 0.15806. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:21,  1.99it/s]
Epoch 7 Iter 183: loss 0.18514. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:21,  1.99it/s]
Epoch 7 Iter 183: loss 0.18514. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.97it/s]
Epoch 7 Iter 184: loss 0.17223. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.97it/s]
Epoch 7 Iter 184: loss 0.17223. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:20,  1.99it/s]
Epoch 7 Iter 185: loss 0.17235. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:20,  1.99it/s]
Epoch 7 Iter 185: loss 0.17235. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.00it/s]
Epoch 7 Iter 186: loss 0.17579. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.00it/s]
Epoch 7 Iter 186: loss 0.17579. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:19,  1.97it/s]
Epoch 7 Iter 187: loss 0.15438. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:19,  1.97it/s]
Epoch 7 Iter 187: loss 0.15438. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.98it/s]
Epoch 7 Iter 188: loss 0.17401. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.98it/s]
Epoch 7 Iter 188: loss 0.17401. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:18,  1.99it/s]
Epoch 7 Iter 189: loss 0.15885. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.99it/s]
Epoch 7 Iter 189: loss 0.15885. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.00it/s]
Epoch 7 Iter 190: loss 0.18078. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.00it/s]
Epoch 7 Iter 190: loss 0.18078. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  2.00it/s]
Epoch 7 Iter 191: loss 0.15385. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  2.00it/s]
Epoch 7 Iter 191: loss 0.15385. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 7 Iter 192: loss 0.18962. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 7 Iter 192: loss 0.18962. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:16,  2.00it/s]
Epoch 7 Iter 193: loss 0.17439. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  2.00it/s]
Epoch 7 Iter 193: loss 0.17439. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 7 Iter 194: loss 0.17014. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 7 Iter 194: loss 0.17014. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:14,  2.00it/s]
Epoch 7 Iter 195: loss 0.16164. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.00it/s]
Epoch 7 Iter 195: loss 0.16164. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  1.99it/s]
Epoch 7 Iter 196: loss 0.16390. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  1.99it/s]
Epoch 7 Iter 196: loss 0.16390. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:14,  1.99it/s]
Epoch 7 Iter 197: loss 0.15645. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:14,  1.99it/s]
Epoch 7 Iter 197: loss 0.15645. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  1.99it/s]
Epoch 7 Iter 198: loss 0.16098. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  1.99it/s]
Epoch 7 Iter 198: loss 0.16098. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:13,  1.98it/s]
Epoch 7 Iter 199: loss 0.17871. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:13,  1.98it/s]
Epoch 7 Iter 199: loss 0.17871. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  1.98it/s]
Epoch 7 Iter 200: loss 0.15775. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  1.98it/s]
Epoch 7 Iter 200: loss 0.15775. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:12,  2.00it/s]
Epoch 7 Iter 201: loss 0.18168. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  2.00it/s]
Epoch 7 Iter 201: loss 0.18168. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 7 Iter 202: loss 0.16714. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 7 Iter 202: loss 0.16714. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:11,  1.99it/s]
Epoch 7 Iter 203: loss 0.17148. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:11,  1.99it/s]
Epoch 7 Iter 203: loss 0.17148. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.98it/s]
Epoch 7 Iter 204: loss 0.17841. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.98it/s]
Epoch 7 Iter 204: loss 0.17841. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:10,  2.00it/s]
Epoch 7 Iter 205: loss 0.18556. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:10,  2.00it/s]
Epoch 7 Iter 205: loss 0.18556. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 7 Iter 206: loss 0.17387. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 7 Iter 206: loss 0.17387. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.01it/s]
Epoch 7 Iter 207: loss 0.16964. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.01it/s]
Epoch 7 Iter 207: loss 0.16964. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.00it/s]
Epoch 7 Iter 208: loss 0.17918. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.00it/s]
Epoch 7 Iter 208: loss 0.17918. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.00it/s]
Epoch 7 Iter 209: loss 0.16434. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:07,  2.00it/s]
Epoch 7 Iter 209: loss 0.16434. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 7 Iter 210: loss 0.14077. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 7 Iter 210: loss 0.14077. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.00it/s]
Epoch 7 Iter 211: loss 0.16585. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:06,  2.00it/s]
Epoch 7 Iter 211: loss 0.16585. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.99it/s]
Epoch 7 Iter 212: loss 0.18650. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.99it/s]
Epoch 7 Iter 212: loss 0.18650. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:06,  1.99it/s]
Epoch 7 Iter 213: loss 0.17127. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:06,  1.99it/s]
Epoch 7 Iter 213: loss 0.17127. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 7 Iter 214: loss 0.17104. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 7 Iter 214: loss 0.17104. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:05,  1.98it/s]
Epoch 7 Iter 215: loss 0.18266. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.98it/s]
Epoch 7 Iter 215: loss 0.18266. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.98it/s]
Epoch 7 Iter 216: loss 0.18221. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.98it/s]
Epoch 7 Iter 216: loss 0.18221. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:04,  1.99it/s]
Epoch 7 Iter 217: loss 0.16784. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.99it/s]
Epoch 7 Iter 217: loss 0.16784. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 7 Iter 218: loss 0.18295. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 7 Iter 218: loss 0.18295. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.00it/s]
Epoch 7 Iter 219: loss 0.17466. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.00it/s]
Epoch 7 Iter 219: loss 0.17466. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.98it/s]
Epoch 7 Iter 220: loss 0.16793. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.98it/s]
Epoch 7 Iter 220: loss 0.16793. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:02,  1.99it/s]
Epoch 7 Iter 221: loss 0.18324. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 7 Iter 221: loss 0.18324. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.00it/s]
Epoch 7 Iter 222: loss 0.18626. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.00it/s]
Epoch 7 Iter 222: loss 0.18626. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.00it/s]
Epoch 7 Iter 223: loss 0.17918. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.00it/s]
Epoch 7 Iter 223: loss 0.17918. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.01it/s]
Epoch 7 Iter 224: loss 0.18300. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.01it/s]
Epoch 7 Iter 224: loss 0.18300. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.01it/s]
Epoch 7 Iter 224: loss 0.18300. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

    Train loss: 0.17427
    Valid loss: 0.24305
       Valid loss recons: 0.24305
       Valid loss KL-D:   14772.82839
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.18015. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.18015. :   0%|▏                                               | 1/224 [00:00<01:47,  2.07it/s]
Epoch 8 Iter 2: loss 0.15424. :   0%|▏                                               | 1/224 [00:00<01:47,  2.07it/s]
Epoch 8 Iter 2: loss 0.15424. :   1%|▍                                               | 2/224 [00:00<01:48,  2.04it/s]
Epoch 8 Iter 3: loss 0.17392. :   1%|▍                                               | 2/224 [00:01<01:48,  2.04it/s]
Epoch 8 Iter 3: loss 0.17392. :   1%|▋                                               | 3/224 [00:01<01:48,  2.03it/s]
Epoch 8 Iter 4: loss 0.16499. :   1%|▋                                               | 3/224 [00:01<01:48,  2.03it/s]
Epoch 8 Iter 4: loss 0.16499. :   2%|▊                                               | 4/224 [00:01<01:49,  2.01it/s]
Epoch 8 Iter 5: loss 0.17333. :   2%|▊                                               | 4/224 [00:02<01:49,  2.01it/s]
Epoch 8 Iter 5: loss 0.17333. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 8 Iter 6: loss 0.15880. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 8 Iter 6: loss 0.15880. :   3%|█▎                                              | 6/224 [00:02<01:49,  1.98it/s]
Epoch 8 Iter 7: loss 0.19662. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.98it/s]
Epoch 8 Iter 7: loss 0.19662. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 8 Iter 8: loss 0.16889. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 8 Iter 8: loss 0.16889. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.00it/s]
Epoch 8 Iter 9: loss 0.16539. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.00it/s]
Epoch 8 Iter 9: loss 0.16539. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 8 Iter 10: loss 0.15623. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.00it/s]
Epoch 8 Iter 10: loss 0.15623. :   4%|██                                            | 10/224 [00:04<01:46,  2.02it/s]
Epoch 8 Iter 11: loss 0.16970. :   4%|██                                            | 10/224 [00:05<01:46,  2.02it/s]
Epoch 8 Iter 11: loss 0.16970. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 8 Iter 12: loss 0.17477. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 8 Iter 12: loss 0.17477. :   5%|██▍                                           | 12/224 [00:05<01:45,  2.01it/s]
Epoch 8 Iter 13: loss 0.17678. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.01it/s]
Epoch 8 Iter 13: loss 0.17678. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 8 Iter 14: loss 0.17020. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 8 Iter 14: loss 0.17020. :   6%|██▉                                           | 14/224 [00:06<01:44,  2.02it/s]
Epoch 8 Iter 15: loss 0.17909. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.02it/s]
Epoch 8 Iter 15: loss 0.17909. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 8 Iter 16: loss 0.18292. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 8 Iter 16: loss 0.18292. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.03it/s]
Epoch 8 Iter 17: loss 0.17757. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.03it/s]
Epoch 8 Iter 17: loss 0.17757. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 8 Iter 18: loss 0.17450. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 8 Iter 18: loss 0.17450. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.02it/s]
Epoch 8 Iter 19: loss 0.17217. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 8 Iter 19: loss 0.17217. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 8 Iter 20: loss 0.18560. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 8 Iter 20: loss 0.18560. :   9%|████                                          | 20/224 [00:09<01:41,  2.01it/s]
Epoch 8 Iter 21: loss 0.17600. :   9%|████                                          | 20/224 [00:10<01:41,  2.01it/s]
Epoch 8 Iter 21: loss 0.17600. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 8 Iter 22: loss 0.16993. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 8 Iter 22: loss 0.16993. :  10%|████▌                                         | 22/224 [00:10<01:40,  2.01it/s]
Epoch 8 Iter 23: loss 0.17627. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.01it/s]
Epoch 8 Iter 23: loss 0.17627. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 8 Iter 24: loss 0.15540. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 8 Iter 24: loss 0.15540. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.01it/s]
Epoch 8 Iter 25: loss 0.17308. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 8 Iter 25: loss 0.17308. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 8 Iter 26: loss 0.16879. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 8 Iter 26: loss 0.16879. :  12%|█████▎                                        | 26/224 [00:12<01:39,  1.99it/s]
Epoch 8 Iter 27: loss 0.17298. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 8 Iter 27: loss 0.17298. :  12%|█████▌                                        | 27/224 [00:13<01:39,  1.99it/s]
Epoch 8 Iter 28: loss 0.17556. :  12%|█████▌                                        | 27/224 [00:13<01:39,  1.99it/s]
Epoch 8 Iter 28: loss 0.17556. :  12%|█████▊                                        | 28/224 [00:13<01:38,  1.98it/s]
Epoch 8 Iter 29: loss 0.16928. :  12%|█████▊                                        | 28/224 [00:14<01:38,  1.98it/s]
Epoch 8 Iter 29: loss 0.16928. :  13%|█████▉                                        | 29/224 [00:14<01:40,  1.94it/s]
Epoch 8 Iter 30: loss 0.15895. :  13%|█████▉                                        | 29/224 [00:15<01:40,  1.94it/s]
Epoch 8 Iter 30: loss 0.15895. :  13%|██████▏                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 8 Iter 31: loss 0.17585. :  13%|██████▏                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 8 Iter 31: loss 0.17585. :  14%|██████▎                                       | 31/224 [00:15<01:38,  1.96it/s]
Epoch 8 Iter 32: loss 0.16516. :  14%|██████▎                                       | 31/224 [00:16<01:38,  1.96it/s]
Epoch 8 Iter 32: loss 0.16516. :  14%|██████▌                                       | 32/224 [00:16<01:37,  1.97it/s]
Epoch 8 Iter 33: loss 0.19687. :  14%|██████▌                                       | 32/224 [00:16<01:37,  1.97it/s]
Epoch 8 Iter 33: loss 0.19687. :  15%|██████▊                                       | 33/224 [00:16<01:37,  1.96it/s]
Epoch 8 Iter 34: loss 0.19576. :  15%|██████▊                                       | 33/224 [00:17<01:37,  1.96it/s]
Epoch 8 Iter 34: loss 0.19576. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 8 Iter 35: loss 0.17235. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 8 Iter 35: loss 0.17235. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 8 Iter 36: loss 0.15342. :  16%|███████▏                                      | 35/224 [00:18<01:34,  2.00it/s]
Epoch 8 Iter 36: loss 0.15342. :  16%|███████▍                                      | 36/224 [00:18<01:34,  2.00it/s]
Epoch 8 Iter 37: loss 0.17329. :  16%|███████▍                                      | 36/224 [00:18<01:34,  2.00it/s]
Epoch 8 Iter 37: loss 0.17329. :  17%|███████▌                                      | 37/224 [00:18<01:33,  2.00it/s]
Epoch 8 Iter 38: loss 0.15442. :  17%|███████▌                                      | 37/224 [00:19<01:33,  2.00it/s]
Epoch 8 Iter 38: loss 0.15442. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.01it/s]
Epoch 8 Iter 39: loss 0.16387. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.01it/s]
Epoch 8 Iter 39: loss 0.16387. :  17%|████████                                      | 39/224 [00:19<01:32,  2.01it/s]
Epoch 8 Iter 40: loss 0.15271. :  17%|████████                                      | 39/224 [00:20<01:32,  2.01it/s]
Epoch 8 Iter 40: loss 0.15271. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.00it/s]
Epoch 8 Iter 41: loss 0.16536. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.00it/s]
Epoch 8 Iter 41: loss 0.16536. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 8 Iter 42: loss 0.17389. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 8 Iter 42: loss 0.17389. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 8 Iter 43: loss 0.17724. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 8 Iter 43: loss 0.17724. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.01it/s]
Epoch 8 Iter 44: loss 0.15547. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.01it/s]
Epoch 8 Iter 44: loss 0.15547. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.00it/s]
Epoch 8 Iter 45: loss 0.17810. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.00it/s]
Epoch 8 Iter 45: loss 0.17810. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 8 Iter 46: loss 0.18116. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 8 Iter 46: loss 0.18116. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.00it/s]
Epoch 8 Iter 47: loss 0.18632. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.00it/s]
Epoch 8 Iter 47: loss 0.18632. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  1.99it/s]
Epoch 8 Iter 48: loss 0.18348. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  1.99it/s]
Epoch 8 Iter 48: loss 0.18348. :  21%|█████████▊                                    | 48/224 [00:23<01:28,  2.00it/s]
Epoch 8 Iter 49: loss 0.18793. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  2.00it/s]
Epoch 8 Iter 49: loss 0.18793. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.01it/s]
Epoch 8 Iter 50: loss 0.17017. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.01it/s]
Epoch 8 Iter 50: loss 0.17017. :  22%|██████████▎                                   | 50/224 [00:24<01:27,  2.00it/s]
Epoch 8 Iter 51: loss 0.17220. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  2.00it/s]
Epoch 8 Iter 51: loss 0.17220. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 8 Iter 52: loss 0.15732. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 8 Iter 52: loss 0.15732. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.01it/s]
Epoch 8 Iter 53: loss 0.17422. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 8 Iter 53: loss 0.17422. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 8 Iter 54: loss 0.17715. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 8 Iter 54: loss 0.17715. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.01it/s]
Epoch 8 Iter 55: loss 0.17330. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 8 Iter 55: loss 0.17330. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.01it/s]
Epoch 8 Iter 56: loss 0.18110. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.01it/s]
Epoch 8 Iter 56: loss 0.18110. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.02it/s]
Epoch 8 Iter 57: loss 0.17216. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 8 Iter 57: loss 0.17216. :  25%|███████████▋                                  | 57/224 [00:28<01:25,  1.94it/s]
Epoch 8 Iter 58: loss 0.18082. :  25%|███████████▋                                  | 57/224 [00:29<01:25,  1.94it/s]
Epoch 8 Iter 58: loss 0.18082. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.96it/s]
Epoch 8 Iter 59: loss 0.18637. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.96it/s]
Epoch 8 Iter 59: loss 0.18637. :  26%|████████████                                  | 59/224 [00:29<01:23,  1.98it/s]
Epoch 8 Iter 60: loss 0.18004. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.98it/s]
Epoch 8 Iter 60: loss 0.18004. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  2.00it/s]
Epoch 8 Iter 61: loss 0.17969. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  2.00it/s]
Epoch 8 Iter 61: loss 0.17969. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 8 Iter 62: loss 0.16683. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.00it/s]
Epoch 8 Iter 62: loss 0.16683. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 8 Iter 63: loss 0.18877. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 8 Iter 63: loss 0.18877. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.00it/s]
Epoch 8 Iter 64: loss 0.17924. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.00it/s]
Epoch 8 Iter 64: loss 0.17924. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.99it/s]
Epoch 8 Iter 65: loss 0.17582. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.99it/s]
Epoch 8 Iter 65: loss 0.17582. :  29%|█████████████▎                                | 65/224 [00:32<01:21,  1.96it/s]
Epoch 8 Iter 66: loss 0.15688. :  29%|█████████████▎                                | 65/224 [00:33<01:21,  1.96it/s]
Epoch 8 Iter 66: loss 0.15688. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.96it/s]
Epoch 8 Iter 67: loss 0.16055. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.96it/s]
Epoch 8 Iter 67: loss 0.16055. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.97it/s]
Epoch 8 Iter 68: loss 0.17863. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.97it/s]
Epoch 8 Iter 68: loss 0.17863. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.98it/s]
Epoch 8 Iter 69: loss 0.17116. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.98it/s]
Epoch 8 Iter 69: loss 0.17116. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  1.99it/s]
Epoch 8 Iter 70: loss 0.17279. :  31%|██████████████▏                               | 69/224 [00:35<01:17,  1.99it/s]
Epoch 8 Iter 70: loss 0.17279. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 8 Iter 71: loss 0.17115. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 8 Iter 71: loss 0.17115. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  1.99it/s]
Epoch 8 Iter 72: loss 0.17213. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  1.99it/s]
Epoch 8 Iter 72: loss 0.17213. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  2.00it/s]
Epoch 8 Iter 73: loss 0.16799. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  2.00it/s]
Epoch 8 Iter 73: loss 0.16799. :  33%|██████████████▉                               | 73/224 [00:36<01:18,  1.92it/s]
Epoch 8 Iter 74: loss 0.17335. :  33%|██████████████▉                               | 73/224 [00:37<01:18,  1.92it/s]
Epoch 8 Iter 74: loss 0.17335. :  33%|███████████████▏                              | 74/224 [00:37<01:18,  1.90it/s]
Epoch 8 Iter 75: loss 0.16308. :  33%|███████████████▏                              | 74/224 [00:37<01:18,  1.90it/s]
Epoch 8 Iter 75: loss 0.16308. :  33%|███████████████▍                              | 75/224 [00:37<01:17,  1.92it/s]
Epoch 8 Iter 76: loss 0.16914. :  33%|███████████████▍                              | 75/224 [00:38<01:17,  1.92it/s]
Epoch 8 Iter 76: loss 0.16914. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.94it/s]
Epoch 8 Iter 77: loss 0.17315. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.94it/s]
Epoch 8 Iter 77: loss 0.17315. :  34%|███████████████▊                              | 77/224 [00:38<01:15,  1.95it/s]
Epoch 8 Iter 78: loss 0.18109. :  34%|███████████████▊                              | 77/224 [00:39<01:15,  1.95it/s]
Epoch 8 Iter 78: loss 0.18109. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.98it/s]
Epoch 8 Iter 79: loss 0.16276. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.98it/s]
Epoch 8 Iter 79: loss 0.16276. :  35%|████████████████▏                             | 79/224 [00:39<01:12,  1.99it/s]
Epoch 8 Iter 80: loss 0.16166. :  35%|████████████████▏                             | 79/224 [00:40<01:12,  1.99it/s]
Epoch 8 Iter 80: loss 0.16166. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.00it/s]
Epoch 8 Iter 81: loss 0.18236. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.00it/s]
Epoch 8 Iter 81: loss 0.18236. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.02it/s]
Epoch 8 Iter 82: loss 0.16919. :  36%|████████████████▋                             | 81/224 [00:41<01:10,  2.02it/s]
Epoch 8 Iter 82: loss 0.16919. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 8 Iter 83: loss 0.16393. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 8 Iter 83: loss 0.16393. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 8 Iter 84: loss 0.17995. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.02it/s]
Epoch 8 Iter 84: loss 0.17995. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 8 Iter 85: loss 0.17481. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 8 Iter 85: loss 0.17481. :  38%|█████████████████▍                            | 85/224 [00:42<01:14,  1.87it/s]
Epoch 8 Iter 86: loss 0.17543. :  38%|█████████████████▍                            | 85/224 [00:43<01:14,  1.87it/s]
Epoch 8 Iter 86: loss 0.17543. :  38%|█████████████████▋                            | 86/224 [00:43<01:12,  1.90it/s]
Epoch 8 Iter 87: loss 0.16763. :  38%|█████████████████▋                            | 86/224 [00:43<01:12,  1.90it/s]
Epoch 8 Iter 87: loss 0.16763. :  39%|█████████████████▊                            | 87/224 [00:43<01:10,  1.93it/s]
Epoch 8 Iter 88: loss 0.17949. :  39%|█████████████████▊                            | 87/224 [00:44<01:10,  1.93it/s]
Epoch 8 Iter 88: loss 0.17949. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.92it/s]
Epoch 8 Iter 89: loss 0.17045. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.92it/s]
Epoch 8 Iter 89: loss 0.17045. :  40%|██████████████████▎                           | 89/224 [00:44<01:09,  1.95it/s]
Epoch 8 Iter 90: loss 0.18235. :  40%|██████████████████▎                           | 89/224 [00:45<01:09,  1.95it/s]
Epoch 8 Iter 90: loss 0.18235. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.97it/s]
Epoch 8 Iter 91: loss 0.16972. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.97it/s]
Epoch 8 Iter 91: loss 0.16972. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  1.99it/s]
Epoch 8 Iter 92: loss 0.16672. :  41%|██████████████████▋                           | 91/224 [00:46<01:06,  1.99it/s]
Epoch 8 Iter 92: loss 0.16672. :  41%|██████████████████▉                           | 92/224 [00:46<01:08,  1.94it/s]
Epoch 8 Iter 93: loss 0.16791. :  41%|██████████████████▉                           | 92/224 [00:46<01:08,  1.94it/s]
Epoch 8 Iter 93: loss 0.16791. :  42%|███████████████████                           | 93/224 [00:46<01:06,  1.96it/s]
Epoch 8 Iter 94: loss 0.17063. :  42%|███████████████████                           | 93/224 [00:47<01:06,  1.96it/s]
Epoch 8 Iter 94: loss 0.17063. :  42%|███████████████████▎                          | 94/224 [00:47<01:06,  1.97it/s]
Epoch 8 Iter 95: loss 0.15821. :  42%|███████████████████▎                          | 94/224 [00:47<01:06,  1.97it/s]
Epoch 8 Iter 95: loss 0.15821. :  42%|███████████████████▌                          | 95/224 [00:47<01:05,  1.98it/s]
Epoch 8 Iter 96: loss 0.16462. :  42%|███████████████████▌                          | 95/224 [00:48<01:05,  1.98it/s]
Epoch 8 Iter 96: loss 0.16462. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.97it/s]
Epoch 8 Iter 97: loss 0.17932. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.97it/s]
Epoch 8 Iter 97: loss 0.17932. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.97it/s]
Epoch 8 Iter 98: loss 0.16076. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.97it/s]
Epoch 8 Iter 98: loss 0.16076. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.98it/s]
Epoch 8 Iter 99: loss 0.16072. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.98it/s]
Epoch 8 Iter 99: loss 0.16072. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  1.98it/s]
Epoch 8 Iter 100: loss 0.17303. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  1.98it/s]
Epoch 8 Iter 100: loss 0.17303. :  45%|███████████████████▋                        | 100/224 [00:50<01:04,  1.92it/s]
Epoch 8 Iter 101: loss 0.15951. :  45%|███████████████████▋                        | 100/224 [00:50<01:04,  1.92it/s]
Epoch 8 Iter 101: loss 0.15951. :  45%|███████████████████▊                        | 101/224 [00:50<01:03,  1.93it/s]
Epoch 8 Iter 102: loss 0.16105. :  45%|███████████████████▊                        | 101/224 [00:51<01:03,  1.93it/s]
Epoch 8 Iter 102: loss 0.16105. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 8 Iter 103: loss 0.18157. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 8 Iter 103: loss 0.18157. :  46%|████████████████████▏                       | 103/224 [00:51<01:01,  1.96it/s]
Epoch 8 Iter 104: loss 0.17942. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.96it/s]
Epoch 8 Iter 104: loss 0.17942. :  46%|████████████████████▍                       | 104/224 [00:52<01:01,  1.96it/s]
Epoch 8 Iter 105: loss 0.17250. :  46%|████████████████████▍                       | 104/224 [00:52<01:01,  1.96it/s]
Epoch 8 Iter 105: loss 0.17250. :  47%|████████████████████▋                       | 105/224 [00:52<01:00,  1.97it/s]
Epoch 8 Iter 106: loss 0.19642. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.97it/s]
Epoch 8 Iter 106: loss 0.19642. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.98it/s]
Epoch 8 Iter 107: loss 0.18738. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.98it/s]
Epoch 8 Iter 107: loss 0.18738. :  48%|█████████████████████                       | 107/224 [00:53<01:00,  1.93it/s]
Epoch 8 Iter 108: loss 0.17616. :  48%|█████████████████████                       | 107/224 [00:54<01:00,  1.93it/s]
Epoch 8 Iter 108: loss 0.17616. :  48%|█████████████████████▏                      | 108/224 [00:54<01:00,  1.93it/s]
Epoch 8 Iter 109: loss 0.19712. :  48%|█████████████████████▏                      | 108/224 [00:54<01:00,  1.93it/s]
Epoch 8 Iter 109: loss 0.19712. :  49%|█████████████████████▍                      | 109/224 [00:54<00:58,  1.95it/s]
Epoch 8 Iter 110: loss 0.15626. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.95it/s]
Epoch 8 Iter 110: loss 0.15626. :  49%|█████████████████████▌                      | 110/224 [00:55<00:58,  1.94it/s]
Epoch 8 Iter 111: loss 0.17943. :  49%|█████████████████████▌                      | 110/224 [00:56<00:58,  1.94it/s]
Epoch 8 Iter 111: loss 0.17943. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.96it/s]
Epoch 8 Iter 112: loss 0.16954. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.96it/s]
Epoch 8 Iter 112: loss 0.16954. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.98it/s]
Epoch 8 Iter 113: loss 0.17572. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.98it/s]
Epoch 8 Iter 113: loss 0.17572. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.97it/s]
Epoch 8 Iter 114: loss 0.18010. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.97it/s]
Epoch 8 Iter 114: loss 0.18010. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.97it/s]
Epoch 8 Iter 115: loss 0.15294. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.97it/s]
Epoch 8 Iter 115: loss 0.15294. :  51%|██████████████████████▌                     | 115/224 [00:58<00:57,  1.89it/s]
Epoch 8 Iter 116: loss 0.16481. :  51%|██████████████████████▌                     | 115/224 [00:58<00:57,  1.89it/s]
Epoch 8 Iter 116: loss 0.16481. :  52%|██████████████████████▊                     | 116/224 [00:58<00:56,  1.92it/s]
Epoch 8 Iter 117: loss 0.17474. :  52%|██████████████████████▊                     | 116/224 [00:59<00:56,  1.92it/s]
Epoch 8 Iter 117: loss 0.17474. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.94it/s]
Epoch 8 Iter 118: loss 0.17144. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.94it/s]
Epoch 8 Iter 118: loss 0.17144. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.96it/s]
Epoch 8 Iter 119: loss 0.16010. :  53%|███████████████████████▏                    | 118/224 [01:00<00:53,  1.96it/s]
Epoch 8 Iter 119: loss 0.16010. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.97it/s]
Epoch 8 Iter 120: loss 0.17164. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.97it/s]
Epoch 8 Iter 120: loss 0.17164. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 8 Iter 121: loss 0.18185. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 121: loss 0.18185. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 122: loss 0.17026. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 122: loss 0.17026. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.97it/s]
Epoch 8 Iter 123: loss 0.18018. :  54%|███████████████████████▉                    | 122/224 [01:02<00:51,  1.97it/s]
Epoch 8 Iter 123: loss 0.18018. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.94it/s]
Epoch 8 Iter 124: loss 0.17815. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.94it/s]
Epoch 8 Iter 124: loss 0.17815. :  55%|████████████████████████▎                   | 124/224 [01:02<00:51,  1.94it/s]
Epoch 8 Iter 125: loss 0.15731. :  55%|████████████████████████▎                   | 124/224 [01:03<00:51,  1.94it/s]
Epoch 8 Iter 125: loss 0.15731. :  56%|████████████████████████▌                   | 125/224 [01:03<00:51,  1.93it/s]
Epoch 8 Iter 126: loss 0.17895. :  56%|████████████████████████▌                   | 125/224 [01:03<00:51,  1.93it/s]
Epoch 8 Iter 126: loss 0.17895. :  56%|████████████████████████▊                   | 126/224 [01:03<00:50,  1.95it/s]
Epoch 8 Iter 127: loss 0.15825. :  56%|████████████████████████▊                   | 126/224 [01:04<00:50,  1.95it/s]
Epoch 8 Iter 127: loss 0.15825. :  57%|████████████████████████▉                   | 127/224 [01:04<00:50,  1.94it/s]
Epoch 8 Iter 128: loss 0.16716. :  57%|████████████████████████▉                   | 127/224 [01:04<00:50,  1.94it/s]
Epoch 8 Iter 128: loss 0.16716. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:49,  1.95it/s]
Epoch 8 Iter 129: loss 0.17665. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:49,  1.95it/s]
Epoch 8 Iter 129: loss 0.17665. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:48,  1.96it/s]
Epoch 8 Iter 130: loss 0.17118. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:48,  1.96it/s]
Epoch 8 Iter 130: loss 0.17118. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:49,  1.90it/s]
Epoch 8 Iter 131: loss 0.16743. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:49,  1.90it/s]
Epoch 8 Iter 131: loss 0.16743. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:49,  1.89it/s]
Epoch 8 Iter 132: loss 0.17829. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:49,  1.89it/s]
Epoch 8 Iter 132: loss 0.17829. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:47,  1.92it/s]
Epoch 8 Iter 133: loss 0.19170. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:47,  1.92it/s]
Epoch 8 Iter 133: loss 0.19170. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.95it/s]
Epoch 8 Iter 134: loss 0.17832. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.95it/s]
Epoch 8 Iter 134: loss 0.17832. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:46,  1.94it/s]
Epoch 8 Iter 135: loss 0.17619. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:46,  1.94it/s]
Epoch 8 Iter 135: loss 0.17619. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:45,  1.95it/s]
Epoch 8 Iter 136: loss 0.17915. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:45,  1.95it/s]
Epoch 8 Iter 136: loss 0.17915. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.96it/s]
Epoch 8 Iter 137: loss 0.16452. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:44,  1.96it/s]
Epoch 8 Iter 137: loss 0.16452. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:45,  1.91it/s]
Epoch 8 Iter 138: loss 0.16507. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:45,  1.91it/s]
Epoch 8 Iter 138: loss 0.16507. :  62%|███████████████████████████                 | 138/224 [01:10<00:47,  1.82it/s]
Epoch 8 Iter 139: loss 0.15860. :  62%|███████████████████████████                 | 138/224 [01:10<00:47,  1.82it/s]
Epoch 8 Iter 139: loss 0.15860. :  62%|███████████████████████████▎                | 139/224 [01:10<00:45,  1.87it/s]
Epoch 8 Iter 140: loss 0.17835. :  62%|███████████████████████████▎                | 139/224 [01:11<00:45,  1.87it/s]
Epoch 8 Iter 140: loss 0.17835. :  62%|███████████████████████████▌                | 140/224 [01:11<00:44,  1.89it/s]
Epoch 8 Iter 141: loss 0.16618. :  62%|███████████████████████████▌                | 140/224 [01:11<00:44,  1.89it/s]
Epoch 8 Iter 141: loss 0.16618. :  63%|███████████████████████████▋                | 141/224 [01:11<00:43,  1.91it/s]
Epoch 8 Iter 142: loss 0.17810. :  63%|███████████████████████████▋                | 141/224 [01:12<00:43,  1.91it/s]
Epoch 8 Iter 142: loss 0.17810. :  63%|███████████████████████████▉                | 142/224 [01:12<00:42,  1.92it/s]
Epoch 8 Iter 143: loss 0.17946. :  63%|███████████████████████████▉                | 142/224 [01:12<00:42,  1.92it/s]
Epoch 8 Iter 143: loss 0.17946. :  64%|████████████████████████████                | 143/224 [01:12<00:41,  1.94it/s]
Epoch 8 Iter 144: loss 0.18023. :  64%|████████████████████████████                | 143/224 [01:13<00:41,  1.94it/s]
Epoch 8 Iter 144: loss 0.18023. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.96it/s]
Epoch 8 Iter 145: loss 0.17844. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.96it/s]
Epoch 8 Iter 145: loss 0.17844. :  65%|████████████████████████████▍               | 145/224 [01:13<00:40,  1.94it/s]
Epoch 8 Iter 146: loss 0.15900. :  65%|████████████████████████████▍               | 145/224 [01:14<00:40,  1.94it/s]
Epoch 8 Iter 146: loss 0.15900. :  65%|████████████████████████████▋               | 146/224 [01:14<00:40,  1.94it/s]
Epoch 8 Iter 147: loss 0.18550. :  65%|████████████████████████████▋               | 146/224 [01:14<00:40,  1.94it/s]
Epoch 8 Iter 147: loss 0.18550. :  66%|████████████████████████████▉               | 147/224 [01:14<00:39,  1.95it/s]
Epoch 8 Iter 148: loss 0.15573. :  66%|████████████████████████████▉               | 147/224 [01:15<00:39,  1.95it/s]
Epoch 8 Iter 148: loss 0.15573. :  66%|█████████████████████████████               | 148/224 [01:15<00:39,  1.90it/s]
Epoch 8 Iter 149: loss 0.18335. :  66%|█████████████████████████████               | 148/224 [01:15<00:39,  1.90it/s]
Epoch 8 Iter 149: loss 0.18335. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:38,  1.94it/s]
Epoch 8 Iter 150: loss 0.17445. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:38,  1.94it/s]
Epoch 8 Iter 150: loss 0.17445. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:38,  1.94it/s]
Epoch 8 Iter 151: loss 0.18233. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:38,  1.94it/s]
Epoch 8 Iter 151: loss 0.18233. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:37,  1.96it/s]
Epoch 8 Iter 152: loss 0.16364. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:37,  1.96it/s]
Epoch 8 Iter 152: loss 0.16364. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.97it/s]
Epoch 8 Iter 153: loss 0.17319. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.97it/s]
Epoch 8 Iter 153: loss 0.17319. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.98it/s]
Epoch 8 Iter 154: loss 0.16192. :  68%|██████████████████████████████              | 153/224 [01:18<00:35,  1.98it/s]
Epoch 8 Iter 154: loss 0.16192. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:36,  1.92it/s]
Epoch 8 Iter 155: loss 0.16809. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:36,  1.92it/s]
Epoch 8 Iter 155: loss 0.16809. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:35,  1.95it/s]
Epoch 8 Iter 156: loss 0.15357. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:35,  1.95it/s]
Epoch 8 Iter 156: loss 0.15357. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:35,  1.93it/s]
Epoch 8 Iter 157: loss 0.17576. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:35,  1.93it/s]
Epoch 8 Iter 157: loss 0.17576. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:36,  1.84it/s]
Epoch 8 Iter 158: loss 0.18173. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:36,  1.84it/s]
Epoch 8 Iter 158: loss 0.18173. :  71%|███████████████████████████████             | 158/224 [01:20<00:35,  1.88it/s]
Epoch 8 Iter 159: loss 0.20288. :  71%|███████████████████████████████             | 158/224 [01:20<00:35,  1.88it/s]
Epoch 8 Iter 159: loss 0.20288. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:34,  1.91it/s]
Epoch 8 Iter 160: loss 0.18220. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:34,  1.91it/s]
Epoch 8 Iter 160: loss 0.18220. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:33,  1.93it/s]
Epoch 8 Iter 161: loss 0.17182. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:33,  1.93it/s]
Epoch 8 Iter 161: loss 0.17182. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:32,  1.94it/s]
Epoch 8 Iter 162: loss 0.16659. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:32,  1.94it/s]
Epoch 8 Iter 162: loss 0.16659. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.94it/s]
Epoch 8 Iter 163: loss 0.17962. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.94it/s]
Epoch 8 Iter 163: loss 0.17962. :  73%|████████████████████████████████            | 163/224 [01:22<00:31,  1.94it/s]
Epoch 8 Iter 164: loss 0.16587. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.94it/s]
Epoch 8 Iter 164: loss 0.16587. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.95it/s]
Epoch 8 Iter 165: loss 0.16954. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.95it/s]
Epoch 8 Iter 165: loss 0.16954. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  1.97it/s]
Epoch 8 Iter 166: loss 0.17236. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:29,  1.97it/s]
Epoch 8 Iter 166: loss 0.17236. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.94it/s]
Epoch 8 Iter 167: loss 0.18083. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.94it/s]
Epoch 8 Iter 167: loss 0.18083. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.92it/s]
Epoch 8 Iter 168: loss 0.18819. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.92it/s]
Epoch 8 Iter 168: loss 0.18819. :  75%|█████████████████████████████████           | 168/224 [01:25<00:29,  1.93it/s]
Epoch 8 Iter 169: loss 0.18035. :  75%|█████████████████████████████████           | 168/224 [01:26<00:29,  1.93it/s]
Epoch 8 Iter 169: loss 0.18035. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:28,  1.94it/s]
Epoch 8 Iter 170: loss 0.17572. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:28,  1.94it/s]
Epoch 8 Iter 170: loss 0.17572. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.93it/s]
Epoch 8 Iter 171: loss 0.16586. :  76%|█████████████████████████████████▍          | 170/224 [01:27<00:27,  1.93it/s]
Epoch 8 Iter 171: loss 0.16586. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:27,  1.94it/s]
Epoch 8 Iter 172: loss 0.16250. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:27,  1.94it/s]
Epoch 8 Iter 172: loss 0.16250. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.95it/s]
Epoch 8 Iter 173: loss 0.16700. :  77%|█████████████████████████████████▊          | 172/224 [01:28<00:26,  1.95it/s]
Epoch 8 Iter 173: loss 0.16700. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:26,  1.93it/s]
Epoch 8 Iter 174: loss 0.19411. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:26,  1.93it/s]
Epoch 8 Iter 174: loss 0.19411. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:26,  1.90it/s]
Epoch 8 Iter 175: loss 0.18263. :  78%|██████████████████████████████████▏         | 174/224 [01:29<00:26,  1.90it/s]
Epoch 8 Iter 175: loss 0.18263. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:25,  1.90it/s]
Epoch 8 Iter 176: loss 0.14911. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:25,  1.90it/s]
Epoch 8 Iter 176: loss 0.14911. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.92it/s]
Epoch 8 Iter 177: loss 0.16501. :  79%|██████████████████████████████████▌         | 176/224 [01:30<00:24,  1.92it/s]
Epoch 8 Iter 177: loss 0.16501. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:24,  1.95it/s]
Epoch 8 Iter 178: loss 0.17245. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:24,  1.95it/s]
Epoch 8 Iter 178: loss 0.17245. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.95it/s]
Epoch 8 Iter 179: loss 0.17246. :  79%|██████████████████████████████████▉         | 178/224 [01:31<00:23,  1.95it/s]
Epoch 8 Iter 179: loss 0.17246. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:23,  1.94it/s]
Epoch 8 Iter 180: loss 0.15750. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:23,  1.94it/s]
Epoch 8 Iter 180: loss 0.15750. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.96it/s]
Epoch 8 Iter 181: loss 0.16973. :  80%|███████████████████████████████████▎        | 180/224 [01:32<00:22,  1.96it/s]
Epoch 8 Iter 181: loss 0.16973. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:23,  1.87it/s]
Epoch 8 Iter 182: loss 0.14632. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:23,  1.87it/s]
Epoch 8 Iter 182: loss 0.14632. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:22,  1.87it/s]
Epoch 8 Iter 183: loss 0.19013. :  81%|███████████████████████████████████▊        | 182/224 [01:33<00:22,  1.87it/s]
Epoch 8 Iter 183: loss 0.19013. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:21,  1.91it/s]
Epoch 8 Iter 184: loss 0.17776. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:21,  1.91it/s]
Epoch 8 Iter 184: loss 0.17776. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.92it/s]
Epoch 8 Iter 185: loss 0.19345. :  82%|████████████████████████████████████▏       | 184/224 [01:34<00:20,  1.92it/s]
Epoch 8 Iter 185: loss 0.19345. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:20,  1.93it/s]
Epoch 8 Iter 186: loss 0.18229. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:20,  1.93it/s]
Epoch 8 Iter 186: loss 0.18229. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.94it/s]
Epoch 8 Iter 187: loss 0.16720. :  83%|████████████████████████████████████▌       | 186/224 [01:35<00:19,  1.94it/s]
Epoch 8 Iter 187: loss 0.16720. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.95it/s]
Epoch 8 Iter 188: loss 0.17246. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.95it/s]
Epoch 8 Iter 188: loss 0.17246. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.94it/s]
Epoch 8 Iter 189: loss 0.17711. :  84%|████████████████████████████████████▉       | 188/224 [01:36<00:18,  1.94it/s]
Epoch 8 Iter 189: loss 0.17711. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:18,  1.89it/s]
Epoch 8 Iter 190: loss 0.17563. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:18,  1.89it/s]
Epoch 8 Iter 190: loss 0.17563. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.93it/s]
Epoch 8 Iter 191: loss 0.17664. :  85%|█████████████████████████████████████▎      | 190/224 [01:37<00:17,  1.93it/s]
Epoch 8 Iter 191: loss 0.17664. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.94it/s]
Epoch 8 Iter 192: loss 0.16481. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.94it/s]
Epoch 8 Iter 192: loss 0.16481. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.96it/s]
Epoch 8 Iter 193: loss 0.17712. :  86%|█████████████████████████████████████▋      | 192/224 [01:38<00:16,  1.96it/s]
Epoch 8 Iter 193: loss 0.17712. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.97it/s]
Epoch 8 Iter 194: loss 0.17258. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.97it/s]
Epoch 8 Iter 194: loss 0.17258. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 8 Iter 195: loss 0.16325. :  87%|██████████████████████████████████████      | 194/224 [01:39<00:15,  1.97it/s]
Epoch 8 Iter 195: loss 0.16325. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.97it/s]
Epoch 8 Iter 196: loss 0.17465. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.97it/s]
Epoch 8 Iter 196: loss 0.17465. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.94it/s]
Epoch 8 Iter 197: loss 0.17503. :  88%|██████████████████████████████████████▌     | 196/224 [01:40<00:14,  1.94it/s]
Epoch 8 Iter 197: loss 0.17503. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:14,  1.91it/s]
Epoch 8 Iter 198: loss 0.18749. :  88%|██████████████████████████████████████▋     | 197/224 [01:41<00:14,  1.91it/s]
Epoch 8 Iter 198: loss 0.18749. :  88%|██████████████████████████████████████▉     | 198/224 [01:41<00:13,  1.92it/s]
Epoch 8 Iter 199: loss 0.16194. :  88%|██████████████████████████████████████▉     | 198/224 [01:41<00:13,  1.92it/s]
Epoch 8 Iter 199: loss 0.16194. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  1.94it/s]
Epoch 8 Iter 200: loss 0.18081. :  89%|███████████████████████████████████████     | 199/224 [01:42<00:12,  1.94it/s]
Epoch 8 Iter 200: loss 0.18081. :  89%|███████████████████████████████████████▎    | 200/224 [01:42<00:12,  1.95it/s]
Epoch 8 Iter 201: loss 0.16756. :  89%|███████████████████████████████████████▎    | 200/224 [01:42<00:12,  1.95it/s]
Epoch 8 Iter 201: loss 0.16756. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.97it/s]
Epoch 8 Iter 202: loss 0.17623. :  90%|███████████████████████████████████████▍    | 201/224 [01:43<00:11,  1.97it/s]
Epoch 8 Iter 202: loss 0.17623. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.97it/s]
Epoch 8 Iter 203: loss 0.18588. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.97it/s]
Epoch 8 Iter 203: loss 0.18588. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.98it/s]
Epoch 8 Iter 204: loss 0.19901. :  91%|███████████████████████████████████████▉    | 203/224 [01:44<00:10,  1.98it/s]
Epoch 8 Iter 204: loss 0.19901. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.96it/s]
Epoch 8 Iter 205: loss 0.18102. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.96it/s]
Epoch 8 Iter 205: loss 0.18102. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.95it/s]
Epoch 8 Iter 206: loss 0.17618. :  92%|████████████████████████████████████████▎   | 205/224 [01:45<00:09,  1.95it/s]
Epoch 8 Iter 206: loss 0.17618. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.96it/s]
Epoch 8 Iter 207: loss 0.16378. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.96it/s]
Epoch 8 Iter 207: loss 0.16378. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  1.96it/s]
Epoch 8 Iter 208: loss 0.18116. :  92%|████████████████████████████████████████▋   | 207/224 [01:46<00:08,  1.96it/s]
Epoch 8 Iter 208: loss 0.18116. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:08,  1.96it/s]
Epoch 8 Iter 209: loss 0.15855. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:08,  1.96it/s]
Epoch 8 Iter 209: loss 0.15855. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  1.97it/s]
Epoch 8 Iter 210: loss 0.14413. :  93%|█████████████████████████████████████████   | 209/224 [01:47<00:07,  1.97it/s]
Epoch 8 Iter 210: loss 0.14413. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.98it/s]
Epoch 8 Iter 211: loss 0.17232. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.98it/s]
Epoch 8 Iter 211: loss 0.17232. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  1.98it/s]
Epoch 8 Iter 212: loss 0.15663. :  94%|█████████████████████████████████████████▍  | 211/224 [01:48<00:06,  1.98it/s]
Epoch 8 Iter 212: loss 0.15663. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.98it/s]
Epoch 8 Iter 213: loss 0.16836. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.98it/s]
Epoch 8 Iter 213: loss 0.16836. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  1.97it/s]
Epoch 8 Iter 214: loss 0.17745. :  95%|█████████████████████████████████████████▊  | 213/224 [01:49<00:05,  1.97it/s]
Epoch 8 Iter 214: loss 0.17745. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:05,  1.99it/s]
Epoch 8 Iter 215: loss 0.16277. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:05,  1.99it/s]
Epoch 8 Iter 215: loss 0.16277. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.97it/s]
Epoch 8 Iter 216: loss 0.16199. :  96%|██████████████████████████████████████████▏ | 215/224 [01:50<00:04,  1.97it/s]
Epoch 8 Iter 216: loss 0.16199. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.97it/s]
Epoch 8 Iter 217: loss 0.16293. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.97it/s]
Epoch 8 Iter 217: loss 0.16293. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.98it/s]
Epoch 8 Iter 218: loss 0.16393. :  97%|██████████████████████████████████████████▋ | 217/224 [01:51<00:03,  1.98it/s]
Epoch 8 Iter 218: loss 0.16393. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.98it/s]
Epoch 8 Iter 219: loss 0.16595. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.98it/s]
Epoch 8 Iter 219: loss 0.16595. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.95it/s]
Epoch 8 Iter 220: loss 0.17420. :  98%|███████████████████████████████████████████ | 219/224 [01:52<00:02,  1.95it/s]
Epoch 8 Iter 220: loss 0.17420. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:02,  1.88it/s]
Epoch 8 Iter 221: loss 0.16409. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:02,  1.88it/s]
Epoch 8 Iter 221: loss 0.16409. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.90it/s]
Epoch 8 Iter 222: loss 0.19391. :  99%|███████████████████████████████████████████▍| 221/224 [01:53<00:01,  1.90it/s]
Epoch 8 Iter 222: loss 0.19391. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:01,  1.90it/s]
Epoch 8 Iter 223: loss 0.20059. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:01,  1.90it/s]
Epoch 8 Iter 223: loss 0.20059. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.92it/s]
Epoch 8 Iter 224: loss 0.16357. : 100%|███████████████████████████████████████████▊| 223/224 [01:54<00:00,  1.92it/s]
Epoch 8 Iter 224: loss 0.16357. : 100%|████████████████████████████████████████████| 224/224 [01:54<00:00,  1.96it/s]
Epoch 8 Iter 224: loss 0.16357. : 100%|████████████████████████████████████████████| 224/224 [01:54<00:00,  1.96it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.16184. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.16184. :   0%|▏                                               | 1/224 [00:00<01:55,  1.93it/s]
Epoch 9 Iter 2: loss 0.17490. :   0%|▏                                               | 1/224 [00:01<01:55,  1.93it/s]
Epoch 9 Iter 2: loss 0.17490. :   1%|▍                                               | 2/224 [00:01<01:52,  1.97it/s]
Epoch 9 Iter 3: loss 0.18264. :   1%|▍                                               | 2/224 [00:01<01:52,  1.97it/s]
Epoch 9 Iter 3: loss 0.18264. :   1%|▋                                               | 3/224 [00:01<01:51,  1.98it/s]
Epoch 9 Iter 4: loss 0.18693. :   1%|▋                                               | 3/224 [00:02<01:51,  1.98it/s]
Epoch 9 Iter 4: loss 0.18693. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 9 Iter 5: loss 0.16410. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 9 Iter 5: loss 0.16410. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 9 Iter 6: loss 0.17837. :   2%|█                                               | 5/224 [00:03<01:49,  2.00it/s]
Epoch 9 Iter 6: loss 0.17837. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.98it/s]
Epoch 9 Iter 7: loss 0.16315. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.98it/s]
Epoch 9 Iter 7: loss 0.16315. :   3%|█▌                                              | 7/224 [00:03<01:49,  1.98it/s]
Epoch 9 Iter 8: loss 0.17947. :   3%|█▌                                              | 7/224 [00:04<01:49,  1.98it/s]
Epoch 9 Iter 8: loss 0.17947. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 9 Iter 9: loss 0.16451. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 9 Iter 9: loss 0.16451. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 9 Iter 10: loss 0.18099. :   4%|█▉                                             | 9/224 [00:05<01:47,  2.00it/s]
Epoch 9 Iter 10: loss 0.18099. :   4%|██                                            | 10/224 [00:05<01:46,  2.01it/s]
Epoch 9 Iter 11: loss 0.17251. :   4%|██                                            | 10/224 [00:05<01:46,  2.01it/s]
Epoch 9 Iter 11: loss 0.17251. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.01it/s]
Epoch 9 Iter 12: loss 0.15210. :   5%|██▎                                           | 11/224 [00:06<01:45,  2.01it/s]
Epoch 9 Iter 12: loss 0.15210. :   5%|██▍                                           | 12/224 [00:06<01:50,  1.92it/s]
Epoch 9 Iter 13: loss 0.17091. :   5%|██▍                                           | 12/224 [00:06<01:50,  1.92it/s]
Epoch 9 Iter 13: loss 0.17091. :   6%|██▋                                           | 13/224 [00:06<01:48,  1.95it/s]
Epoch 9 Iter 14: loss 0.17300. :   6%|██▋                                           | 13/224 [00:07<01:48,  1.95it/s]
Epoch 9 Iter 14: loss 0.17300. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.97it/s]
Epoch 9 Iter 15: loss 0.18686. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.97it/s]
Epoch 9 Iter 15: loss 0.18686. :   7%|███                                           | 15/224 [00:07<01:45,  1.97it/s]
Epoch 9 Iter 16: loss 0.16928. :   7%|███                                           | 15/224 [00:08<01:45,  1.97it/s]
Epoch 9 Iter 16: loss 0.16928. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 9 Iter 17: loss 0.17584. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 9 Iter 17: loss 0.17584. :   8%|███▍                                          | 17/224 [00:08<01:43,  1.99it/s]
Epoch 9 Iter 18: loss 0.17825. :   8%|███▍                                          | 17/224 [00:09<01:43,  1.99it/s]
Epoch 9 Iter 18: loss 0.17825. :   8%|███▋                                          | 18/224 [00:09<01:43,  1.99it/s]
Epoch 9 Iter 19: loss 0.17950. :   8%|███▋                                          | 18/224 [00:09<01:43,  1.99it/s]
Epoch 9 Iter 19: loss 0.17950. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.00it/s]
Epoch 9 Iter 20: loss 0.18697. :   8%|███▉                                          | 19/224 [00:10<01:42,  2.00it/s]
Epoch 9 Iter 20: loss 0.18697. :   9%|████                                          | 20/224 [00:10<01:48,  1.88it/s]
Epoch 9 Iter 21: loss 0.14747. :   9%|████                                          | 20/224 [00:10<01:48,  1.88it/s]
Epoch 9 Iter 21: loss 0.14747. :   9%|████▎                                         | 21/224 [00:10<01:45,  1.92it/s]
Epoch 9 Iter 22: loss 0.16070. :   9%|████▎                                         | 21/224 [00:11<01:45,  1.92it/s]
Epoch 9 Iter 22: loss 0.16070. :  10%|████▌                                         | 22/224 [00:11<01:44,  1.94it/s]
Epoch 9 Iter 23: loss 0.15676. :  10%|████▌                                         | 22/224 [00:11<01:44,  1.94it/s]
Epoch 9 Iter 23: loss 0.15676. :  10%|████▋                                         | 23/224 [00:11<01:43,  1.94it/s]
Epoch 9 Iter 24: loss 0.16236. :  10%|████▋                                         | 23/224 [00:12<01:43,  1.94it/s]
Epoch 9 Iter 24: loss 0.16236. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.16271. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.16271. :  11%|█████▏                                        | 25/224 [00:12<01:41,  1.95it/s]
Epoch 9 Iter 26: loss 0.17680. :  11%|█████▏                                        | 25/224 [00:13<01:41,  1.95it/s]
Epoch 9 Iter 26: loss 0.17680. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.97it/s]
Epoch 9 Iter 27: loss 0.16016. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.97it/s]
Epoch 9 Iter 27: loss 0.16016. :  12%|█████▌                                        | 27/224 [00:13<01:42,  1.93it/s]
Epoch 9 Iter 28: loss 0.17563. :  12%|█████▌                                        | 27/224 [00:14<01:42,  1.93it/s]
Epoch 9 Iter 28: loss 0.17563. :  12%|█████▊                                        | 28/224 [00:14<01:41,  1.94it/s]
Epoch 9 Iter 29: loss 0.15430. :  12%|█████▊                                        | 28/224 [00:14<01:41,  1.94it/s]
Epoch 9 Iter 29: loss 0.15430. :  13%|█████▉                                        | 29/224 [00:14<01:39,  1.96it/s]
Epoch 9 Iter 30: loss 0.18197. :  13%|█████▉                                        | 29/224 [00:15<01:39,  1.96it/s]
Epoch 9 Iter 30: loss 0.18197. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 9 Iter 31: loss 0.17378. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 9 Iter 31: loss 0.17378. :  14%|██████▎                                       | 31/224 [00:15<01:37,  1.98it/s]
Epoch 9 Iter 32: loss 0.19159. :  14%|██████▎                                       | 31/224 [00:16<01:37,  1.98it/s]
Epoch 9 Iter 32: loss 0.19159. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 9 Iter 33: loss 0.18466. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 9 Iter 33: loss 0.18466. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.99it/s]
Epoch 9 Iter 34: loss 0.16089. :  15%|██████▊                                       | 33/224 [00:17<01:36,  1.99it/s]
Epoch 9 Iter 34: loss 0.16089. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 9 Iter 35: loss 0.16899. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 9 Iter 35: loss 0.16899. :  16%|███████▏                                      | 35/224 [00:17<01:37,  1.93it/s]
Epoch 9 Iter 36: loss 0.15167. :  16%|███████▏                                      | 35/224 [00:18<01:37,  1.93it/s]
Epoch 9 Iter 36: loss 0.15167. :  16%|███████▍                                      | 36/224 [00:18<01:36,  1.95it/s]
Epoch 9 Iter 37: loss 0.17460. :  16%|███████▍                                      | 36/224 [00:18<01:36,  1.95it/s]
Epoch 9 Iter 37: loss 0.17460. :  17%|███████▌                                      | 37/224 [00:18<01:35,  1.96it/s]
Epoch 9 Iter 38: loss 0.17083. :  17%|███████▌                                      | 37/224 [00:19<01:35,  1.96it/s]
Epoch 9 Iter 38: loss 0.17083. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.98it/s]
Epoch 9 Iter 39: loss 0.18178. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.98it/s]
Epoch 9 Iter 39: loss 0.18178. :  17%|████████                                      | 39/224 [00:19<01:33,  1.98it/s]
Epoch 9 Iter 40: loss 0.17082. :  17%|████████                                      | 39/224 [00:20<01:33,  1.98it/s]
Epoch 9 Iter 40: loss 0.17082. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.96it/s]
Epoch 9 Iter 41: loss 0.17885. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.96it/s]
Epoch 9 Iter 41: loss 0.17885. :  18%|████████▍                                     | 41/224 [00:20<01:33,  1.96it/s]
Epoch 9 Iter 42: loss 0.18637. :  18%|████████▍                                     | 41/224 [00:21<01:33,  1.96it/s]
Epoch 9 Iter 42: loss 0.18637. :  19%|████████▋                                     | 42/224 [00:21<01:33,  1.94it/s]
Epoch 9 Iter 43: loss 0.18105. :  19%|████████▋                                     | 42/224 [00:21<01:33,  1.94it/s]
Epoch 9 Iter 43: loss 0.18105. :  19%|████████▊                                     | 43/224 [00:21<01:32,  1.95it/s]
Epoch 9 Iter 44: loss 0.17668. :  19%|████████▊                                     | 43/224 [00:22<01:32,  1.95it/s]
Epoch 9 Iter 44: loss 0.17668. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.96it/s]
Epoch 9 Iter 45: loss 0.19371. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.96it/s]
Epoch 9 Iter 45: loss 0.19371. :  20%|█████████▏                                    | 45/224 [00:22<01:30,  1.98it/s]
Epoch 9 Iter 46: loss 0.17338. :  20%|█████████▏                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 9 Iter 46: loss 0.17338. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  1.99it/s]
Epoch 9 Iter 47: loss 0.18687. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  1.99it/s]
Epoch 9 Iter 47: loss 0.18687. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 9 Iter 48: loss 0.15251. :  21%|█████████▋                                    | 47/224 [00:24<01:28,  2.00it/s]
Epoch 9 Iter 48: loss 0.15251. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 9 Iter 49: loss 0.17648. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 9 Iter 49: loss 0.17648. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.95it/s]
Epoch 9 Iter 50: loss 0.17488. :  22%|██████████                                    | 49/224 [00:25<01:29,  1.95it/s]
Epoch 9 Iter 50: loss 0.17488. :  22%|██████████▎                                   | 50/224 [00:25<01:32,  1.88it/s]
Epoch 9 Iter 51: loss 0.18523. :  22%|██████████▎                                   | 50/224 [00:26<01:32,  1.88it/s]
Epoch 9 Iter 51: loss 0.18523. :  23%|██████████▍                                   | 51/224 [00:26<01:30,  1.91it/s]
Epoch 9 Iter 52: loss 0.18395. :  23%|██████████▍                                   | 51/224 [00:26<01:30,  1.91it/s]
Epoch 9 Iter 52: loss 0.18395. :  23%|██████████▋                                   | 52/224 [00:26<01:28,  1.94it/s]
Epoch 9 Iter 53: loss 0.15555. :  23%|██████████▋                                   | 52/224 [00:27<01:28,  1.94it/s]
Epoch 9 Iter 53: loss 0.15555. :  24%|██████████▉                                   | 53/224 [00:27<01:28,  1.93it/s]
Epoch 9 Iter 54: loss 0.18387. :  24%|██████████▉                                   | 53/224 [00:27<01:28,  1.93it/s]
Epoch 9 Iter 54: loss 0.18387. :  24%|███████████                                   | 54/224 [00:27<01:27,  1.95it/s]
Epoch 9 Iter 55: loss 0.19595. :  24%|███████████                                   | 54/224 [00:28<01:27,  1.95it/s]
Epoch 9 Iter 55: loss 0.19595. :  25%|███████████▎                                  | 55/224 [00:28<01:25,  1.97it/s]
Epoch 9 Iter 56: loss 0.18202. :  25%|███████████▎                                  | 55/224 [00:28<01:25,  1.97it/s]
Epoch 9 Iter 56: loss 0.18202. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.97it/s]
Epoch 9 Iter 57: loss 0.16236. :  25%|███████████▌                                  | 56/224 [00:29<01:25,  1.97it/s]
Epoch 9 Iter 57: loss 0.16236. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 9 Iter 58: loss 0.16961. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 9 Iter 58: loss 0.16961. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.98it/s]
Epoch 9 Iter 59: loss 0.15236. :  26%|███████████▉                                  | 58/224 [00:30<01:23,  1.98it/s]
Epoch 9 Iter 59: loss 0.15236. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.97it/s]
Epoch 9 Iter 60: loss 0.17202. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.97it/s]
Epoch 9 Iter 60: loss 0.17202. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.98it/s]
Epoch 9 Iter 61: loss 0.16202. :  27%|████████████▎                                 | 60/224 [00:31<01:22,  1.98it/s]
Epoch 9 Iter 61: loss 0.16202. :  27%|████████████▌                                 | 61/224 [00:31<01:25,  1.91it/s]
Epoch 9 Iter 62: loss 0.19030. :  27%|████████████▌                                 | 61/224 [00:31<01:25,  1.91it/s]
Epoch 9 Iter 62: loss 0.19030. :  28%|████████████▋                                 | 62/224 [00:31<01:23,  1.93it/s]
Epoch 9 Iter 63: loss 0.15666. :  28%|████████████▋                                 | 62/224 [00:32<01:23,  1.93it/s]
Epoch 9 Iter 63: loss 0.15666. :  28%|████████████▉                                 | 63/224 [00:32<01:22,  1.95it/s]
Epoch 9 Iter 64: loss 0.16782. :  28%|████████████▉                                 | 63/224 [00:32<01:22,  1.95it/s]
Epoch 9 Iter 64: loss 0.16782. :  29%|█████████████▏                                | 64/224 [00:32<01:25,  1.87it/s]
Epoch 9 Iter 65: loss 0.16992. :  29%|█████████████▏                                | 64/224 [00:33<01:25,  1.87it/s]
Epoch 9 Iter 65: loss 0.16992. :  29%|█████████████▎                                | 65/224 [00:33<01:26,  1.84it/s]
Epoch 9 Iter 66: loss 0.17389. :  29%|█████████████▎                                | 65/224 [00:34<01:26,  1.84it/s]
Epoch 9 Iter 66: loss 0.17389. :  29%|█████████████▌                                | 66/224 [00:34<01:41,  1.55it/s]
Epoch 9 Iter 67: loss 0.16524. :  29%|█████████████▌                                | 66/224 [00:35<01:41,  1.55it/s]
Epoch 9 Iter 67: loss 0.16524. :  30%|█████████████▊                                | 67/224 [00:35<02:07,  1.23it/s]
Epoch 9 Iter 68: loss 0.16970. :  30%|█████████████▊                                | 67/224 [00:36<02:07,  1.23it/s]
Epoch 9 Iter 68: loss 0.16970. :  30%|█████████████▉                                | 68/224 [00:36<02:33,  1.02it/s]
Epoch 9 Iter 69: loss 0.15710. :  30%|█████████████▉                                | 68/224 [00:38<02:33,  1.02it/s]
Epoch 9 Iter 69: loss 0.15710. :  31%|██████████████▏                               | 69/224 [00:38<02:59,  1.16s/it]
Epoch 9 Iter 70: loss 0.16883. :  31%|██████████████▏                               | 69/224 [00:39<02:59,  1.16s/it]
Epoch 9 Iter 70: loss 0.16883. :  31%|██████████████▍                               | 70/224 [00:39<02:57,  1.15s/it]
Epoch 9 Iter 71: loss 0.18140. :  31%|██████████████▍                               | 70/224 [00:40<02:57,  1.15s/it]
Epoch 9 Iter 71: loss 0.18140. :  32%|██████████████▌                               | 71/224 [00:40<02:56,  1.16s/it]
Epoch 9 Iter 72: loss 0.16833. :  32%|██████████████▌                               | 71/224 [00:41<02:56,  1.16s/it]
Epoch 9 Iter 72: loss 0.16833. :  32%|██████████████▊                               | 72/224 [00:41<03:01,  1.20s/it]
Epoch 9 Iter 73: loss 0.15471. :  32%|██████████████▊                               | 72/224 [00:43<03:01,  1.20s/it]
Epoch 9 Iter 73: loss 0.15471. :  33%|██████████████▉                               | 73/224 [00:43<03:14,  1.29s/it]
Epoch 9 Iter 74: loss 0.16032. :  33%|██████████████▉                               | 73/224 [00:44<03:14,  1.29s/it]
Epoch 9 Iter 74: loss 0.16032. :  33%|███████████████▏                              | 74/224 [00:44<03:08,  1.25s/it]
Epoch 9 Iter 75: loss 0.17476. :  33%|███████████████▏                              | 74/224 [00:45<03:08,  1.25s/it]
Epoch 9 Iter 75: loss 0.17476. :  33%|███████████████▍                              | 75/224 [00:45<02:51,  1.15s/it]
Epoch 9 Iter 76: loss 0.19404. :  33%|███████████████▍                              | 75/224 [00:46<02:51,  1.15s/it]
Epoch 9 Iter 76: loss 0.19404. :  34%|███████████████▌                              | 76/224 [00:46<02:44,  1.11s/it]
Epoch 9 Iter 77: loss 0.16570. :  34%|███████████████▌                              | 76/224 [00:47<02:44,  1.11s/it]
Epoch 9 Iter 77: loss 0.16570. :  34%|███████████████▊                              | 77/224 [00:47<02:39,  1.08s/it]
Epoch 9 Iter 78: loss 0.17659. :  34%|███████████████▊                              | 77/224 [00:48<02:39,  1.08s/it]
Epoch 9 Iter 78: loss 0.17659. :  35%|████████████████                              | 78/224 [00:48<02:28,  1.02s/it]
Epoch 9 Iter 79: loss 0.15263. :  35%|████████████████                              | 78/224 [00:48<02:28,  1.02s/it]
Epoch 9 Iter 79: loss 0.15263. :  35%|████████████████▏                             | 79/224 [00:48<02:08,  1.13it/s]
Epoch 9 Iter 80: loss 0.18895. :  35%|████████████████▏                             | 79/224 [00:49<02:08,  1.13it/s]
Epoch 9 Iter 80: loss 0.18895. :  36%|████████████████▍                             | 80/224 [00:49<02:05,  1.15it/s]
Epoch 9 Iter 81: loss 0.15443. :  36%|████████████████▍                             | 80/224 [00:51<02:05,  1.15it/s]
Epoch 9 Iter 81: loss 0.15443. :  36%|████████████████▋                             | 81/224 [00:51<02:25,  1.01s/it]
Epoch 9 Iter 82: loss 0.16170. :  36%|████████████████▋                             | 81/224 [00:52<02:25,  1.01s/it]
Epoch 9 Iter 82: loss 0.16170. :  37%|████████████████▊                             | 82/224 [00:52<02:41,  1.14s/it]
Epoch 9 Iter 83: loss 0.15410. :  37%|████████████████▊                             | 82/224 [00:53<02:41,  1.14s/it]
Epoch 9 Iter 83: loss 0.15410. :  37%|█████████████████                             | 83/224 [00:53<02:41,  1.15s/it]
Epoch 9 Iter 84: loss 0.16673. :  37%|█████████████████                             | 83/224 [00:54<02:41,  1.15s/it]
Epoch 9 Iter 84: loss 0.16673. :  38%|█████████████████▎                            | 84/224 [00:54<02:42,  1.16s/it]
Epoch 9 Iter 85: loss 0.16369. :  38%|█████████████████▎                            | 84/224 [00:55<02:42,  1.16s/it]
Epoch 9 Iter 85: loss 0.16369. :  38%|█████████████████▍                            | 85/224 [00:55<02:35,  1.12s/it]
Epoch 9 Iter 86: loss 0.18210. :  38%|█████████████████▍                            | 85/224 [00:57<02:35,  1.12s/it]
Epoch 9 Iter 86: loss 0.18210. :  38%|█████████████████▋                            | 86/224 [00:57<02:38,  1.15s/it]
Epoch 9 Iter 87: loss 0.17352. :  38%|█████████████████▋                            | 86/224 [00:58<02:38,  1.15s/it]
Epoch 9 Iter 87: loss 0.17352. :  39%|█████████████████▊                            | 87/224 [00:58<02:25,  1.06s/it]
Epoch 9 Iter 88: loss 0.16692. :  39%|█████████████████▊                            | 87/224 [00:59<02:25,  1.06s/it]
Epoch 9 Iter 88: loss 0.16692. :  39%|██████████████████                            | 88/224 [00:59<02:46,  1.22s/it]
Epoch 9 Iter 89: loss 0.16511. :  39%|██████████████████                            | 88/224 [01:01<02:46,  1.22s/it]
Epoch 9 Iter 89: loss 0.16511. :  40%|██████████████████▎                           | 89/224 [01:01<02:54,  1.29s/it]
Epoch 9 Iter 90: loss 0.16003. :  40%|██████████████████▎                           | 89/224 [01:01<02:54,  1.29s/it]
Epoch 9 Iter 90: loss 0.16003. :  40%|██████████████████▍                           | 90/224 [01:01<02:29,  1.12s/it]
Epoch 9 Iter 91: loss 0.15703. :  40%|██████████████████▍                           | 90/224 [01:02<02:29,  1.12s/it]
Epoch 9 Iter 91: loss 0.15703. :  41%|██████████████████▋                           | 91/224 [01:02<02:07,  1.04it/s]
Epoch 9 Iter 92: loss 0.17304. :  41%|██████████████████▋                           | 91/224 [01:03<02:07,  1.04it/s]
Epoch 9 Iter 92: loss 0.17304. :  41%|██████████████████▉                           | 92/224 [01:03<02:01,  1.09it/s]
Epoch 9 Iter 93: loss 0.18621. :  41%|██████████████████▉                           | 92/224 [01:04<02:01,  1.09it/s]
Epoch 9 Iter 93: loss 0.18621. :  42%|███████████████████                           | 93/224 [01:04<02:03,  1.06it/s]
Epoch 9 Iter 94: loss 0.16537. :  42%|███████████████████                           | 93/224 [01:05<02:03,  1.06it/s]
Epoch 9 Iter 94: loss 0.16537. :  42%|███████████████████▎                          | 94/224 [01:05<02:28,  1.14s/it]
Epoch 9 Iter 95: loss 0.16233. :  42%|███████████████████▎                          | 94/224 [01:07<02:28,  1.14s/it]
Epoch 9 Iter 95: loss 0.16233. :  42%|███████████████████▌                          | 95/224 [01:07<02:31,  1.17s/it]
Epoch 9 Iter 96: loss 0.17383. :  42%|███████████████████▌                          | 95/224 [01:08<02:31,  1.17s/it]
Epoch 9 Iter 96: loss 0.17383. :  43%|███████████████████▋                          | 96/224 [01:08<02:47,  1.31s/it]
Epoch 9 Iter 97: loss 0.16025. :  43%|███████████████████▋                          | 96/224 [01:10<02:47,  1.31s/it]
Epoch 9 Iter 97: loss 0.16025. :  43%|███████████████████▉                          | 97/224 [01:10<02:57,  1.40s/it]
Epoch 9 Iter 98: loss 0.15906. :  43%|███████████████████▉                          | 97/224 [01:11<02:57,  1.40s/it]
Epoch 9 Iter 98: loss 0.15906. :  44%|████████████████████▏                         | 98/224 [01:11<02:59,  1.42s/it]
Epoch 9 Iter 99: loss 0.16148. :  44%|████████████████████▏                         | 98/224 [01:13<02:59,  1.42s/it]
Epoch 9 Iter 99: loss 0.16148. :  44%|████████████████████▎                         | 99/224 [01:13<03:02,  1.46s/it]
Epoch 9 Iter 100: loss 0.17347. :  44%|███████████████████▉                         | 99/224 [01:14<03:02,  1.46s/it]
Epoch 9 Iter 100: loss 0.17347. :  45%|███████████████████▋                        | 100/224 [01:14<03:00,  1.46s/it]
Epoch 9 Iter 101: loss 0.20019. :  45%|███████████████████▋                        | 100/224 [01:16<03:00,  1.46s/it]
Epoch 9 Iter 101: loss 0.20019. :  45%|███████████████████▊                        | 101/224 [01:16<02:57,  1.44s/it]
Epoch 9 Iter 102: loss 0.17047. :  45%|███████████████████▊                        | 101/224 [01:17<02:57,  1.44s/it]
Epoch 9 Iter 102: loss 0.17047. :  46%|████████████████████                        | 102/224 [01:17<02:35,  1.28s/it]
Epoch 9 Iter 103: loss 0.18377. :  46%|████████████████████                        | 102/224 [01:17<02:35,  1.28s/it]
Epoch 9 Iter 103: loss 0.18377. :  46%|████████████████████▏                       | 103/224 [01:17<02:16,  1.13s/it]
Epoch 9 Iter 104: loss 0.16699. :  46%|████████████████████▏                       | 103/224 [01:18<02:16,  1.13s/it]
Epoch 9 Iter 104: loss 0.16699. :  46%|████████████████████▍                       | 104/224 [01:18<02:14,  1.12s/it]
Epoch 9 Iter 105: loss 0.16054. :  46%|████████████████████▍                       | 104/224 [01:20<02:14,  1.12s/it]
Epoch 9 Iter 105: loss 0.16054. :  47%|████████████████████▋                       | 105/224 [01:20<02:11,  1.10s/it]
Epoch 9 Iter 106: loss 0.17628. :  47%|████████████████████▋                       | 105/224 [01:20<02:11,  1.10s/it]
Epoch 9 Iter 106: loss 0.17628. :  47%|████████████████████▊                       | 106/224 [01:20<01:51,  1.06it/s]
Epoch 9 Iter 107: loss 0.18580. :  47%|████████████████████▊                       | 106/224 [01:21<01:51,  1.06it/s]
Epoch 9 Iter 107: loss 0.18580. :  48%|█████████████████████                       | 107/224 [01:21<01:48,  1.08it/s]
Epoch 9 Iter 108: loss 0.17117. :  48%|█████████████████████                       | 107/224 [01:22<01:48,  1.08it/s]
Epoch 9 Iter 108: loss 0.17117. :  48%|█████████████████████▏                      | 108/224 [01:22<02:02,  1.05s/it]
Epoch 9 Iter 109: loss 0.17842. :  48%|█████████████████████▏                      | 108/224 [01:24<02:02,  1.05s/it]
Epoch 9 Iter 109: loss 0.17842. :  49%|█████████████████████▍                      | 109/224 [01:24<02:13,  1.16s/it]
Epoch 9 Iter 110: loss 0.17928. :  49%|█████████████████████▍                      | 109/224 [01:25<02:13,  1.16s/it]
Epoch 9 Iter 110: loss 0.17928. :  49%|█████████████████████▌                      | 110/224 [01:25<02:14,  1.18s/it]
Epoch 9 Iter 111: loss 0.15710. :  49%|█████████████████████▌                      | 110/224 [01:26<02:14,  1.18s/it]
Epoch 9 Iter 111: loss 0.15710. :  50%|█████████████████████▊                      | 111/224 [01:26<02:25,  1.29s/it]
Epoch 9 Iter 112: loss 0.17934. :  50%|█████████████████████▊                      | 111/224 [01:28<02:25,  1.29s/it]
Epoch 9 Iter 112: loss 0.17934. :  50%|██████████████████████                      | 112/224 [01:28<02:26,  1.31s/it]
Epoch 9 Iter 113: loss 0.17616. :  50%|██████████████████████                      | 112/224 [01:29<02:26,  1.31s/it]
Epoch 9 Iter 113: loss 0.17616. :  50%|██████████████████████▏                     | 113/224 [01:29<02:21,  1.27s/it]
Epoch 9 Iter 114: loss 0.19073. :  50%|██████████████████████▏                     | 113/224 [01:30<02:21,  1.27s/it]
Epoch 9 Iter 114: loss 0.19073. :  51%|██████████████████████▍                     | 114/224 [01:30<02:17,  1.25s/it]
Epoch 9 Iter 115: loss 0.16843. :  51%|██████████████████████▍                     | 114/224 [01:31<02:17,  1.25s/it]
Epoch 9 Iter 115: loss 0.16843. :  51%|██████████████████████▌                     | 115/224 [01:31<02:13,  1.23s/it]
Epoch 9 Iter 116: loss 0.17116. :  51%|██████████████████████▌                     | 115/224 [01:33<02:13,  1.23s/it]
Epoch 9 Iter 116: loss 0.17116. :  52%|██████████████████████▊                     | 116/224 [01:33<02:15,  1.26s/it]
Epoch 9 Iter 117: loss 0.16786. :  52%|██████████████████████▊                     | 116/224 [01:34<02:15,  1.26s/it]
Epoch 9 Iter 117: loss 0.16786. :  52%|██████████████████████▉                     | 117/224 [01:34<02:19,  1.31s/it]
Epoch 9 Iter 118: loss 0.18492. :  52%|██████████████████████▉                     | 117/224 [01:35<02:19,  1.31s/it]
Epoch 9 Iter 118: loss 0.18492. :  53%|███████████████████████▏                    | 118/224 [01:35<01:57,  1.10s/it]
Epoch 9 Iter 119: loss 0.18554. :  53%|███████████████████████▏                    | 118/224 [01:36<01:57,  1.10s/it]
Epoch 9 Iter 119: loss 0.18554. :  53%|███████████████████████▍                    | 119/224 [01:36<01:44,  1.00it/s]
Epoch 9 Iter 120: loss 0.16789. :  53%|███████████████████████▍                    | 119/224 [01:37<01:44,  1.00it/s]
Epoch 9 Iter 120: loss 0.16789. :  54%|███████████████████████▌                    | 120/224 [01:37<01:52,  1.08s/it]
Epoch 9 Iter 121: loss 0.17533. :  54%|███████████████████████▌                    | 120/224 [01:38<01:52,  1.08s/it]
Epoch 9 Iter 121: loss 0.17533. :  54%|███████████████████████▊                    | 121/224 [01:38<02:04,  1.21s/it]
Epoch 9 Iter 122: loss 0.17415. :  54%|███████████████████████▊                    | 121/224 [01:39<02:04,  1.21s/it]
Epoch 9 Iter 122: loss 0.17415. :  54%|███████████████████████▉                    | 122/224 [01:39<02:00,  1.18s/it]
Epoch 9 Iter 123: loss 0.15753. :  54%|███████████████████████▉                    | 122/224 [01:41<02:00,  1.18s/it]
Epoch 9 Iter 123: loss 0.15753. :  55%|████████████████████████▏                   | 123/224 [01:41<02:12,  1.31s/it]
Epoch 9 Iter 124: loss 0.16860. :  55%|████████████████████████▏                   | 123/224 [01:43<02:12,  1.31s/it]
Epoch 9 Iter 124: loss 0.16860. :  55%|████████████████████████▎                   | 124/224 [01:43<02:17,  1.38s/it]
Epoch 9 Iter 125: loss 0.16536. :  55%|████████████████████████▎                   | 124/224 [01:44<02:17,  1.38s/it]
Epoch 9 Iter 125: loss 0.16536. :  56%|████████████████████████▌                   | 125/224 [01:44<02:23,  1.45s/it]
Epoch 9 Iter 126: loss 0.17287. :  56%|████████████████████████▌                   | 125/224 [01:46<02:23,  1.45s/it]
Epoch 9 Iter 126: loss 0.17287. :  56%|████████████████████████▊                   | 126/224 [01:46<02:24,  1.48s/it]
Epoch 9 Iter 127: loss 0.16917. :  56%|████████████████████████▊                   | 126/224 [01:47<02:24,  1.48s/it]
Epoch 9 Iter 127: loss 0.16917. :  57%|████████████████████████▉                   | 127/224 [01:47<02:07,  1.31s/it]
Epoch 9 Iter 128: loss 0.16866. :  57%|████████████████████████▉                   | 127/224 [01:48<02:07,  1.31s/it]
Epoch 9 Iter 128: loss 0.16866. :  57%|█████████████████████████▏                  | 128/224 [01:48<02:03,  1.29s/it]
Epoch 9 Iter 129: loss 0.17285. :  57%|█████████████████████████▏                  | 128/224 [01:49<02:03,  1.29s/it]
Epoch 9 Iter 129: loss 0.17285. :  58%|█████████████████████████▎                  | 129/224 [01:49<01:59,  1.26s/it]
Epoch 9 Iter 130: loss 0.17784. :  58%|█████████████████████████▎                  | 129/224 [01:50<01:59,  1.26s/it]
Epoch 9 Iter 130: loss 0.17784. :  58%|█████████████████████████▌                  | 130/224 [01:50<01:59,  1.27s/it]
Epoch 9 Iter 131: loss 0.17712. :  58%|█████████████████████████▌                  | 130/224 [01:51<01:59,  1.27s/it]
Epoch 9 Iter 131: loss 0.17712. :  58%|█████████████████████████▋                  | 131/224 [01:51<01:49,  1.18s/it]
Epoch 9 Iter 132: loss 0.17243. :  58%|█████████████████████████▋                  | 131/224 [01:52<01:49,  1.18s/it]
Epoch 9 Iter 132: loss 0.17243. :  59%|█████████████████████████▉                  | 132/224 [01:52<01:31,  1.01it/s]
Epoch 9 Iter 133: loss 0.19126. :  59%|█████████████████████████▉                  | 132/224 [01:52<01:31,  1.01it/s]
Epoch 9 Iter 133: loss 0.19126. :  59%|██████████████████████████▏                 | 133/224 [01:52<01:17,  1.18it/s]
Epoch 9 Iter 134: loss 0.17921. :  59%|██████████████████████████▏                 | 133/224 [01:53<01:17,  1.18it/s]
Epoch 9 Iter 134: loss 0.17921. :  60%|██████████████████████████▎                 | 134/224 [01:53<01:07,  1.34it/s]
Epoch 9 Iter 135: loss 0.16982. :  60%|██████████████████████████▎                 | 134/224 [01:53<01:07,  1.34it/s]
Epoch 9 Iter 135: loss 0.16982. :  60%|██████████████████████████▌                 | 135/224 [01:53<01:00,  1.48it/s]
Epoch 9 Iter 136: loss 0.17325. :  60%|██████████████████████████▌                 | 135/224 [01:54<01:00,  1.48it/s]
Epoch 9 Iter 136: loss 0.17325. :  61%|██████████████████████████▋                 | 136/224 [01:54<00:54,  1.60it/s]
Epoch 9 Iter 137: loss 0.16667. :  61%|██████████████████████████▋                 | 136/224 [01:54<00:54,  1.60it/s]
Epoch 9 Iter 137: loss 0.16667. :  61%|██████████████████████████▉                 | 137/224 [01:54<00:51,  1.70it/s]
Epoch 9 Iter 138: loss 0.16814. :  61%|██████████████████████████▉                 | 137/224 [01:55<00:51,  1.70it/s]
Epoch 9 Iter 138: loss 0.16814. :  62%|███████████████████████████                 | 138/224 [01:55<00:48,  1.77it/s]
Epoch 9 Iter 139: loss 0.18037. :  62%|███████████████████████████                 | 138/224 [01:55<00:48,  1.77it/s]
Epoch 9 Iter 139: loss 0.18037. :  62%|███████████████████████████▎                | 139/224 [01:55<00:46,  1.83it/s]
Epoch 9 Iter 140: loss 0.16167. :  62%|███████████████████████████▎                | 139/224 [01:56<00:46,  1.83it/s]
Epoch 9 Iter 140: loss 0.16167. :  62%|███████████████████████████▌                | 140/224 [01:56<00:44,  1.87it/s]
Epoch 9 Iter 141: loss 0.17105. :  62%|███████████████████████████▌                | 140/224 [01:57<00:44,  1.87it/s]
Epoch 9 Iter 141: loss 0.17105. :  63%|███████████████████████████▋                | 141/224 [01:57<00:44,  1.87it/s]
Epoch 9 Iter 142: loss 0.16877. :  63%|███████████████████████████▋                | 141/224 [01:57<00:44,  1.87it/s]
Epoch 9 Iter 142: loss 0.16877. :  63%|███████████████████████████▉                | 142/224 [01:57<00:45,  1.80it/s]
Epoch 9 Iter 143: loss 0.16181. :  63%|███████████████████████████▉                | 142/224 [01:58<00:45,  1.80it/s]
Epoch 9 Iter 143: loss 0.16181. :  64%|████████████████████████████                | 143/224 [01:58<00:43,  1.85it/s]
Epoch 9 Iter 144: loss 0.16702. :  64%|████████████████████████████                | 143/224 [01:58<00:43,  1.85it/s]
Epoch 9 Iter 144: loss 0.16702. :  64%|████████████████████████████▎               | 144/224 [01:58<00:42,  1.88it/s]
Epoch 9 Iter 145: loss 0.16961. :  64%|████████████████████████████▎               | 144/224 [01:59<00:42,  1.88it/s]
Epoch 9 Iter 145: loss 0.16961. :  65%|████████████████████████████▍               | 145/224 [01:59<00:41,  1.92it/s]
Epoch 9 Iter 146: loss 0.16819. :  65%|████████████████████████████▍               | 145/224 [01:59<00:41,  1.92it/s]
Epoch 9 Iter 146: loss 0.16819. :  65%|████████████████████████████▋               | 146/224 [01:59<00:39,  1.95it/s]
Epoch 9 Iter 147: loss 0.16345. :  65%|████████████████████████████▋               | 146/224 [02:00<00:39,  1.95it/s]
Epoch 9 Iter 147: loss 0.16345. :  66%|████████████████████████████▉               | 147/224 [02:00<00:39,  1.96it/s]
Epoch 9 Iter 148: loss 0.17282. :  66%|████████████████████████████▉               | 147/224 [02:00<00:39,  1.96it/s]
Epoch 9 Iter 148: loss 0.17282. :  66%|█████████████████████████████               | 148/224 [02:00<00:38,  1.98it/s]
Epoch 9 Iter 149: loss 0.18059. :  66%|█████████████████████████████               | 148/224 [02:01<00:38,  1.98it/s]
Epoch 9 Iter 149: loss 0.18059. :  67%|█████████████████████████████▎              | 149/224 [02:01<00:37,  1.98it/s]
Epoch 9 Iter 150: loss 0.18114. :  67%|█████████████████████████████▎              | 149/224 [02:01<00:37,  1.98it/s]
Epoch 9 Iter 150: loss 0.18114. :  67%|█████████████████████████████▍              | 150/224 [02:01<00:37,  1.96it/s]
Epoch 9 Iter 151: loss 0.16848. :  67%|█████████████████████████████▍              | 150/224 [02:02<00:37,  1.96it/s]
Epoch 9 Iter 151: loss 0.16848. :  67%|█████████████████████████████▋              | 151/224 [02:02<00:36,  1.98it/s]
Epoch 9 Iter 152: loss 0.16221. :  67%|█████████████████████████████▋              | 151/224 [02:02<00:36,  1.98it/s]
Epoch 9 Iter 152: loss 0.16221. :  68%|█████████████████████████████▊              | 152/224 [02:02<00:36,  1.99it/s]
Epoch 9 Iter 153: loss 0.16469. :  68%|█████████████████████████████▊              | 152/224 [02:03<00:36,  1.99it/s]
Epoch 9 Iter 153: loss 0.16469. :  68%|██████████████████████████████              | 153/224 [02:03<00:35,  2.00it/s]
Epoch 9 Iter 154: loss 0.17291. :  68%|██████████████████████████████              | 153/224 [02:03<00:35,  2.00it/s]
Epoch 9 Iter 154: loss 0.17291. :  69%|██████████████████████████████▎             | 154/224 [02:03<00:35,  2.00it/s]
Epoch 9 Iter 155: loss 0.17954. :  69%|██████████████████████████████▎             | 154/224 [02:04<00:35,  2.00it/s]
Epoch 9 Iter 155: loss 0.17954. :  69%|██████████████████████████████▍             | 155/224 [02:04<00:34,  2.00it/s]
Epoch 9 Iter 156: loss 0.17827. :  69%|██████████████████████████████▍             | 155/224 [02:04<00:34,  2.00it/s]
Epoch 9 Iter 156: loss 0.17827. :  70%|██████████████████████████████▋             | 156/224 [02:04<00:33,  2.00it/s]
Epoch 9 Iter 157: loss 0.16847. :  70%|██████████████████████████████▋             | 156/224 [02:05<00:33,  2.00it/s]
Epoch 9 Iter 157: loss 0.16847. :  70%|██████████████████████████████▊             | 157/224 [02:05<00:33,  2.00it/s]
Epoch 9 Iter 158: loss 0.15186. :  70%|██████████████████████████████▊             | 157/224 [02:05<00:33,  2.00it/s]
Epoch 9 Iter 158: loss 0.15186. :  71%|███████████████████████████████             | 158/224 [02:05<00:32,  2.00it/s]
Epoch 9 Iter 159: loss 0.17795. :  71%|███████████████████████████████             | 158/224 [02:06<00:32,  2.00it/s]
Epoch 9 Iter 159: loss 0.17795. :  71%|███████████████████████████████▏            | 159/224 [02:06<00:32,  2.00it/s]
Epoch 9 Iter 160: loss 0.17856. :  71%|███████████████████████████████▏            | 159/224 [02:06<00:32,  2.00it/s]
Epoch 9 Iter 160: loss 0.17856. :  71%|███████████████████████████████▍            | 160/224 [02:06<00:32,  2.00it/s]
Epoch 9 Iter 161: loss 0.16949. :  71%|███████████████████████████████▍            | 160/224 [02:07<00:32,  2.00it/s]
Epoch 9 Iter 161: loss 0.16949. :  72%|███████████████████████████████▋            | 161/224 [02:07<00:32,  1.96it/s]
Epoch 9 Iter 162: loss 0.16979. :  72%|███████████████████████████████▋            | 161/224 [02:07<00:32,  1.96it/s]
Epoch 9 Iter 162: loss 0.16979. :  72%|███████████████████████████████▊            | 162/224 [02:07<00:31,  1.99it/s]
Epoch 9 Iter 163: loss 0.16576. :  72%|███████████████████████████████▊            | 162/224 [02:08<00:31,  1.99it/s]
Epoch 9 Iter 163: loss 0.16576. :  73%|████████████████████████████████            | 163/224 [02:08<00:30,  1.98it/s]
Epoch 9 Iter 164: loss 0.16107. :  73%|████████████████████████████████            | 163/224 [02:08<00:30,  1.98it/s]
Epoch 9 Iter 164: loss 0.16107. :  73%|████████████████████████████████▏           | 164/224 [02:08<00:30,  1.97it/s]
Epoch 9 Iter 165: loss 0.17292. :  73%|████████████████████████████████▏           | 164/224 [02:09<00:30,  1.97it/s]
Epoch 9 Iter 165: loss 0.17292. :  74%|████████████████████████████████▍           | 165/224 [02:09<00:29,  1.97it/s]
Epoch 9 Iter 166: loss 0.20047. :  74%|████████████████████████████████▍           | 165/224 [02:09<00:29,  1.97it/s]
Epoch 9 Iter 166: loss 0.20047. :  74%|████████████████████████████████▌           | 166/224 [02:09<00:29,  1.99it/s]
Epoch 9 Iter 167: loss 0.16625. :  74%|████████████████████████████████▌           | 166/224 [02:10<00:29,  1.99it/s]
Epoch 9 Iter 167: loss 0.16625. :  75%|████████████████████████████████▊           | 167/224 [02:10<00:28,  1.99it/s]
Epoch 9 Iter 168: loss 0.16283. :  75%|████████████████████████████████▊           | 167/224 [02:10<00:28,  1.99it/s]
Epoch 9 Iter 168: loss 0.16283. :  75%|█████████████████████████████████           | 168/224 [02:10<00:28,  2.00it/s]
Epoch 9 Iter 169: loss 0.17536. :  75%|█████████████████████████████████           | 168/224 [02:11<00:28,  2.00it/s]
Epoch 9 Iter 169: loss 0.17536. :  75%|█████████████████████████████████▏          | 169/224 [02:11<00:27,  2.01it/s]
Epoch 9 Iter 170: loss 0.18599. :  75%|█████████████████████████████████▏          | 169/224 [02:11<00:27,  2.01it/s]
Epoch 9 Iter 170: loss 0.18599. :  76%|█████████████████████████████████▍          | 170/224 [02:11<00:26,  2.01it/s]
Epoch 9 Iter 171: loss 0.17678. :  76%|█████████████████████████████████▍          | 170/224 [02:12<00:26,  2.01it/s]
Epoch 9 Iter 171: loss 0.17678. :  76%|█████████████████████████████████▌          | 171/224 [02:12<00:26,  2.01it/s]
Epoch 9 Iter 172: loss 0.15439. :  76%|█████████████████████████████████▌          | 171/224 [02:12<00:26,  2.01it/s]
Epoch 9 Iter 172: loss 0.15439. :  77%|█████████████████████████████████▊          | 172/224 [02:12<00:25,  2.02it/s]
Epoch 9 Iter 173: loss 0.17478. :  77%|█████████████████████████████████▊          | 172/224 [02:13<00:25,  2.02it/s]
Epoch 9 Iter 173: loss 0.17478. :  77%|█████████████████████████████████▉          | 173/224 [02:13<00:25,  2.02it/s]
Epoch 9 Iter 174: loss 0.15275. :  77%|█████████████████████████████████▉          | 173/224 [02:13<00:25,  2.02it/s]
Epoch 9 Iter 174: loss 0.15275. :  78%|██████████████████████████████████▏         | 174/224 [02:13<00:24,  2.01it/s]
Epoch 9 Iter 175: loss 0.17859. :  78%|██████████████████████████████████▏         | 174/224 [02:14<00:24,  2.01it/s]
Epoch 9 Iter 175: loss 0.17859. :  78%|██████████████████████████████████▍         | 175/224 [02:14<00:24,  2.02it/s]
Epoch 9 Iter 176: loss 0.17213. :  78%|██████████████████████████████████▍         | 175/224 [02:14<00:24,  2.02it/s]
Epoch 9 Iter 176: loss 0.17213. :  79%|██████████████████████████████████▌         | 176/224 [02:14<00:23,  2.02it/s]
Epoch 9 Iter 177: loss 0.18272. :  79%|██████████████████████████████████▌         | 176/224 [02:15<00:23,  2.02it/s]
Epoch 9 Iter 177: loss 0.18272. :  79%|██████████████████████████████████▊         | 177/224 [02:15<00:23,  2.03it/s]
Epoch 9 Iter 178: loss 0.19391. :  79%|██████████████████████████████████▊         | 177/224 [02:15<00:23,  2.03it/s]
Epoch 9 Iter 178: loss 0.19391. :  79%|██████████████████████████████████▉         | 178/224 [02:15<00:22,  2.01it/s]
Epoch 9 Iter 179: loss 0.17935. :  79%|██████████████████████████████████▉         | 178/224 [02:16<00:22,  2.01it/s]
Epoch 9 Iter 179: loss 0.17935. :  80%|███████████████████████████████████▏        | 179/224 [02:16<00:22,  2.00it/s]
Epoch 9 Iter 180: loss 0.16352. :  80%|███████████████████████████████████▏        | 179/224 [02:16<00:22,  2.00it/s]
Epoch 9 Iter 180: loss 0.16352. :  80%|███████████████████████████████████▎        | 180/224 [02:16<00:22,  1.99it/s]
Epoch 9 Iter 181: loss 0.17507. :  80%|███████████████████████████████████▎        | 180/224 [02:17<00:22,  1.99it/s]
Epoch 9 Iter 181: loss 0.17507. :  81%|███████████████████████████████████▌        | 181/224 [02:17<00:21,  1.99it/s]
Epoch 9 Iter 182: loss 0.16446. :  81%|███████████████████████████████████▌        | 181/224 [02:17<00:21,  1.99it/s]
Epoch 9 Iter 182: loss 0.16446. :  81%|███████████████████████████████████▊        | 182/224 [02:17<00:21,  1.98it/s]
Epoch 9 Iter 183: loss 0.16353. :  81%|███████████████████████████████████▊        | 182/224 [02:18<00:21,  1.98it/s]
Epoch 9 Iter 183: loss 0.16353. :  82%|███████████████████████████████████▉        | 183/224 [02:18<00:20,  1.99it/s]
Epoch 9 Iter 184: loss 0.17983. :  82%|███████████████████████████████████▉        | 183/224 [02:18<00:20,  1.99it/s]
Epoch 9 Iter 184: loss 0.17983. :  82%|████████████████████████████████████▏       | 184/224 [02:18<00:20,  1.99it/s]
Epoch 9 Iter 185: loss 0.17646. :  82%|████████████████████████████████████▏       | 184/224 [02:19<00:20,  1.99it/s]
Epoch 9 Iter 185: loss 0.17646. :  83%|████████████████████████████████████▎       | 185/224 [02:19<00:20,  1.92it/s]
Epoch 9 Iter 186: loss 0.17981. :  83%|████████████████████████████████████▎       | 185/224 [02:19<00:20,  1.92it/s]
Epoch 9 Iter 186: loss 0.17981. :  83%|████████████████████████████████████▌       | 186/224 [02:19<00:19,  1.94it/s]
Epoch 9 Iter 187: loss 0.16242. :  83%|████████████████████████████████████▌       | 186/224 [02:20<00:19,  1.94it/s]
Epoch 9 Iter 187: loss 0.16242. :  83%|████████████████████████████████████▋       | 187/224 [02:20<00:18,  1.96it/s]
Epoch 9 Iter 188: loss 0.17294. :  83%|████████████████████████████████████▋       | 187/224 [02:20<00:18,  1.96it/s]
Epoch 9 Iter 188: loss 0.17294. :  84%|████████████████████████████████████▉       | 188/224 [02:20<00:18,  1.98it/s]
Epoch 9 Iter 189: loss 0.15886. :  84%|████████████████████████████████████▉       | 188/224 [02:21<00:18,  1.98it/s]
Epoch 9 Iter 189: loss 0.15886. :  84%|█████████████████████████████████████▏      | 189/224 [02:21<00:17,  1.98it/s]
Epoch 9 Iter 190: loss 0.14993. :  84%|█████████████████████████████████████▏      | 189/224 [02:21<00:17,  1.98it/s]
Epoch 9 Iter 190: loss 0.14993. :  85%|█████████████████████████████████████▎      | 190/224 [02:21<00:17,  1.98it/s]
Epoch 9 Iter 191: loss 0.17908. :  85%|█████████████████████████████████████▎      | 190/224 [02:22<00:17,  1.98it/s]
Epoch 9 Iter 191: loss 0.17908. :  85%|█████████████████████████████████████▌      | 191/224 [02:22<00:16,  1.98it/s]
Epoch 9 Iter 192: loss 0.16063. :  85%|█████████████████████████████████████▌      | 191/224 [02:22<00:16,  1.98it/s]
Epoch 9 Iter 192: loss 0.16063. :  86%|█████████████████████████████████████▋      | 192/224 [02:22<00:16,  1.99it/s]
Epoch 9 Iter 193: loss 0.17176. :  86%|█████████████████████████████████████▋      | 192/224 [02:23<00:16,  1.99it/s]
Epoch 9 Iter 193: loss 0.17176. :  86%|█████████████████████████████████████▉      | 193/224 [02:23<00:15,  2.00it/s]
Epoch 9 Iter 194: loss 0.17483. :  86%|█████████████████████████████████████▉      | 193/224 [02:23<00:15,  2.00it/s]
Epoch 9 Iter 194: loss 0.17483. :  87%|██████████████████████████████████████      | 194/224 [02:23<00:15,  2.00it/s]
Epoch 9 Iter 195: loss 0.17716. :  87%|██████████████████████████████████████      | 194/224 [02:24<00:15,  2.00it/s]
Epoch 9 Iter 195: loss 0.17716. :  87%|██████████████████████████████████████▎     | 195/224 [02:24<00:14,  1.98it/s]
Epoch 9 Iter 196: loss 0.18679. :  87%|██████████████████████████████████████▎     | 195/224 [02:24<00:14,  1.98it/s]
Epoch 9 Iter 196: loss 0.18679. :  88%|██████████████████████████████████████▌     | 196/224 [02:24<00:14,  2.00it/s]
Epoch 9 Iter 197: loss 0.18215. :  88%|██████████████████████████████████████▌     | 196/224 [02:25<00:14,  2.00it/s]
Epoch 9 Iter 197: loss 0.18215. :  88%|██████████████████████████████████████▋     | 197/224 [02:25<00:13,  2.00it/s]
Epoch 9 Iter 198: loss 0.17564. :  88%|██████████████████████████████████████▋     | 197/224 [02:25<00:13,  2.00it/s]
Epoch 9 Iter 198: loss 0.17564. :  88%|██████████████████████████████████████▉     | 198/224 [02:25<00:13,  2.00it/s]
Epoch 9 Iter 199: loss 0.16828. :  88%|██████████████████████████████████████▉     | 198/224 [02:26<00:13,  2.00it/s]
Epoch 9 Iter 199: loss 0.16828. :  89%|███████████████████████████████████████     | 199/224 [02:26<00:12,  2.00it/s]
Epoch 9 Iter 200: loss 0.18942. :  89%|███████████████████████████████████████     | 199/224 [02:26<00:12,  2.00it/s]
Epoch 9 Iter 200: loss 0.18942. :  89%|███████████████████████████████████████▎    | 200/224 [02:26<00:11,  2.00it/s]
Epoch 9 Iter 201: loss 0.17887. :  89%|███████████████████████████████████████▎    | 200/224 [02:27<00:11,  2.00it/s]
Epoch 9 Iter 201: loss 0.17887. :  90%|███████████████████████████████████████▍    | 201/224 [02:27<00:11,  2.01it/s]
Epoch 9 Iter 202: loss 0.16158. :  90%|███████████████████████████████████████▍    | 201/224 [02:27<00:11,  2.01it/s]
Epoch 9 Iter 202: loss 0.16158. :  90%|███████████████████████████████████████▋    | 202/224 [02:27<00:10,  2.01it/s]
Epoch 9 Iter 203: loss 0.16096. :  90%|███████████████████████████████████████▋    | 202/224 [02:28<00:10,  2.01it/s]
Epoch 9 Iter 203: loss 0.16096. :  91%|███████████████████████████████████████▉    | 203/224 [02:28<00:10,  2.01it/s]
Epoch 9 Iter 204: loss 0.15642. :  91%|███████████████████████████████████████▉    | 203/224 [02:28<00:10,  2.01it/s]
Epoch 9 Iter 204: loss 0.15642. :  91%|████████████████████████████████████████    | 204/224 [02:28<00:09,  2.02it/s]
Epoch 9 Iter 205: loss 0.15910. :  91%|████████████████████████████████████████    | 204/224 [02:29<00:09,  2.02it/s]
Epoch 9 Iter 205: loss 0.15910. :  92%|████████████████████████████████████████▎   | 205/224 [02:29<00:09,  2.02it/s]
Epoch 9 Iter 206: loss 0.16334. :  92%|████████████████████████████████████████▎   | 205/224 [02:29<00:09,  2.02it/s]
Epoch 9 Iter 206: loss 0.16334. :  92%|████████████████████████████████████████▍   | 206/224 [02:29<00:08,  2.03it/s]
Epoch 9 Iter 207: loss 0.17764. :  92%|████████████████████████████████████████▍   | 206/224 [02:30<00:08,  2.03it/s]
Epoch 9 Iter 207: loss 0.17764. :  92%|████████████████████████████████████████▋   | 207/224 [02:30<00:08,  2.03it/s]
Epoch 9 Iter 208: loss 0.14821. :  92%|████████████████████████████████████████▋   | 207/224 [02:30<00:08,  2.03it/s]
Epoch 9 Iter 208: loss 0.14821. :  93%|████████████████████████████████████████▊   | 208/224 [02:30<00:07,  2.02it/s]
Epoch 9 Iter 209: loss 0.18686. :  93%|████████████████████████████████████████▊   | 208/224 [02:31<00:07,  2.02it/s]
Epoch 9 Iter 209: loss 0.18686. :  93%|█████████████████████████████████████████   | 209/224 [02:31<00:07,  2.03it/s]
Epoch 9 Iter 210: loss 0.15909. :  93%|█████████████████████████████████████████   | 209/224 [02:31<00:07,  2.03it/s]
Epoch 9 Iter 210: loss 0.15909. :  94%|█████████████████████████████████████████▎  | 210/224 [02:31<00:06,  2.00it/s]
Epoch 9 Iter 211: loss 0.17541. :  94%|█████████████████████████████████████████▎  | 210/224 [02:32<00:06,  2.00it/s]
Epoch 9 Iter 211: loss 0.17541. :  94%|█████████████████████████████████████████▍  | 211/224 [02:32<00:06,  1.99it/s]
Epoch 9 Iter 212: loss 0.17270. :  94%|█████████████████████████████████████████▍  | 211/224 [02:32<00:06,  1.99it/s]
Epoch 9 Iter 212: loss 0.17270. :  95%|█████████████████████████████████████████▋  | 212/224 [02:32<00:06,  1.99it/s]
Epoch 9 Iter 213: loss 0.15510. :  95%|█████████████████████████████████████████▋  | 212/224 [02:33<00:06,  1.99it/s]
Epoch 9 Iter 213: loss 0.15510. :  95%|█████████████████████████████████████████▊  | 213/224 [02:33<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.18101. :  95%|█████████████████████████████████████████▊  | 213/224 [02:33<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.18101. :  96%|██████████████████████████████████████████  | 214/224 [02:33<00:05,  1.97it/s]
Epoch 9 Iter 215: loss 0.20298. :  96%|██████████████████████████████████████████  | 214/224 [02:34<00:05,  1.97it/s]
Epoch 9 Iter 215: loss 0.20298. :  96%|██████████████████████████████████████████▏ | 215/224 [02:34<00:04,  1.96it/s]
Epoch 9 Iter 216: loss 0.17303. :  96%|██████████████████████████████████████████▏ | 215/224 [02:34<00:04,  1.96it/s]
Epoch 9 Iter 216: loss 0.17303. :  96%|██████████████████████████████████████████▍ | 216/224 [02:34<00:04,  1.94it/s]
Epoch 9 Iter 217: loss 0.16652. :  96%|██████████████████████████████████████████▍ | 216/224 [02:35<00:04,  1.94it/s]
Epoch 9 Iter 217: loss 0.16652. :  97%|██████████████████████████████████████████▋ | 217/224 [02:35<00:03,  1.91it/s]
Epoch 9 Iter 218: loss 0.16952. :  97%|██████████████████████████████████████████▋ | 217/224 [02:35<00:03,  1.91it/s]
Epoch 9 Iter 218: loss 0.16952. :  97%|██████████████████████████████████████████▊ | 218/224 [02:35<00:03,  1.95it/s]
Epoch 9 Iter 219: loss 0.18539. :  97%|██████████████████████████████████████████▊ | 218/224 [02:36<00:03,  1.95it/s]
Epoch 9 Iter 219: loss 0.18539. :  98%|███████████████████████████████████████████ | 219/224 [02:36<00:02,  1.97it/s]
Epoch 9 Iter 220: loss 0.19382. :  98%|███████████████████████████████████████████ | 219/224 [02:36<00:02,  1.97it/s]
Epoch 9 Iter 220: loss 0.19382. :  98%|███████████████████████████████████████████▏| 220/224 [02:36<00:02,  1.99it/s]
Epoch 9 Iter 221: loss 0.15708. :  98%|███████████████████████████████████████████▏| 220/224 [02:37<00:02,  1.99it/s]
Epoch 9 Iter 221: loss 0.15708. :  99%|███████████████████████████████████████████▍| 221/224 [02:37<00:01,  1.99it/s]
Epoch 9 Iter 222: loss 0.16224. :  99%|███████████████████████████████████████████▍| 221/224 [02:37<00:01,  1.99it/s]
Epoch 9 Iter 222: loss 0.16224. :  99%|███████████████████████████████████████████▌| 222/224 [02:37<00:01,  1.98it/s]
Epoch 9 Iter 223: loss 0.18116. :  99%|███████████████████████████████████████████▌| 222/224 [02:38<00:01,  1.98it/s]
Epoch 9 Iter 223: loss 0.18116. : 100%|███████████████████████████████████████████▊| 223/224 [02:38<00:00,  1.98it/s]
Epoch 9 Iter 224: loss 0.16904. : 100%|███████████████████████████████████████████▊| 223/224 [02:38<00:00,  1.98it/s]
Epoch 9 Iter 224: loss 0.16904. : 100%|████████████████████████████████████████████| 224/224 [02:38<00:00,  1.97it/s]
Epoch 9 Iter 224: loss 0.16904. : 100%|████████████████████████████████████████████| 224/224 [02:38<00:00,  1.41it/s]

    Train loss: 0.17174
    Valid loss: 0.17429
       Valid loss recons: 0.17429
       Valid loss KL-D:   18792.81756
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.16202. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.16202. :   0%|▏                                              | 1/224 [00:00<02:01,  1.83it/s]
Epoch 10 Iter 2: loss 0.18260. :   0%|▏                                              | 1/224 [00:01<02:01,  1.83it/s]
Epoch 10 Iter 2: loss 0.18260. :   1%|▍                                              | 2/224 [00:01<02:00,  1.85it/s]
Epoch 10 Iter 3: loss 0.16681. :   1%|▍                                              | 2/224 [00:01<02:00,  1.85it/s]
Epoch 10 Iter 3: loss 0.16681. :   1%|▋                                              | 3/224 [00:01<01:55,  1.92it/s]
Epoch 10 Iter 4: loss 0.17214. :   1%|▋                                              | 3/224 [00:02<01:55,  1.92it/s]
Epoch 10 Iter 4: loss 0.17214. :   2%|▊                                              | 4/224 [00:02<01:52,  1.96it/s]
Epoch 10 Iter 5: loss 0.17110. :   2%|▊                                              | 4/224 [00:02<01:52,  1.96it/s]
Epoch 10 Iter 5: loss 0.17110. :   2%|█                                              | 5/224 [00:02<01:50,  1.98it/s]
Epoch 10 Iter 6: loss 0.17611. :   2%|█                                              | 5/224 [00:03<01:50,  1.98it/s]
Epoch 10 Iter 6: loss 0.17611. :   3%|█▎                                             | 6/224 [00:03<01:49,  1.99it/s]
Epoch 10 Iter 7: loss 0.17383. :   3%|█▎                                             | 6/224 [00:03<01:49,  1.99it/s]
Epoch 10 Iter 7: loss 0.17383. :   3%|█▍                                             | 7/224 [00:03<01:48,  1.99it/s]
Epoch 10 Iter 8: loss 0.15865. :   3%|█▍                                             | 7/224 [00:04<01:48,  1.99it/s]
Epoch 10 Iter 8: loss 0.15865. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.98it/s]
Epoch 10 Iter 9: loss 0.15696. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.98it/s]
Epoch 10 Iter 9: loss 0.15696. :   4%|█▉                                             | 9/224 [00:04<01:48,  1.98it/s]
Epoch 10 Iter 10: loss 0.16678. :   4%|█▊                                            | 9/224 [00:05<01:48,  1.98it/s]
Epoch 10 Iter 10: loss 0.16678. :   4%|██                                           | 10/224 [00:05<01:48,  1.98it/s]
Epoch 10 Iter 11: loss 0.18432. :   4%|██                                           | 10/224 [00:05<01:48,  1.98it/s]
Epoch 10 Iter 11: loss 0.18432. :   5%|██▏                                          | 11/224 [00:05<01:47,  1.98it/s]
Epoch 10 Iter 12: loss 0.20092. :   5%|██▏                                          | 11/224 [00:06<01:47,  1.98it/s]
Epoch 10 Iter 12: loss 0.20092. :   5%|██▍                                          | 12/224 [00:06<01:47,  1.97it/s]
Epoch 10 Iter 13: loss 0.18020. :   5%|██▍                                          | 12/224 [00:06<01:47,  1.97it/s]
Epoch 10 Iter 13: loss 0.18020. :   6%|██▌                                          | 13/224 [00:06<01:48,  1.94it/s]
Epoch 10 Iter 14: loss 0.16659. :   6%|██▌                                          | 13/224 [00:07<01:48,  1.94it/s]
Epoch 10 Iter 14: loss 0.16659. :   6%|██▊                                          | 14/224 [00:07<01:46,  1.97it/s]
Epoch 10 Iter 15: loss 0.15788. :   6%|██▊                                          | 14/224 [00:07<01:46,  1.97it/s]
Epoch 10 Iter 15: loss 0.15788. :   7%|███                                          | 15/224 [00:07<01:45,  1.98it/s]
Epoch 10 Iter 16: loss 0.18384. :   7%|███                                          | 15/224 [00:08<01:45,  1.98it/s]
Epoch 10 Iter 16: loss 0.18384. :   7%|███▏                                         | 16/224 [00:08<01:44,  1.99it/s]
Epoch 10 Iter 17: loss 0.17814. :   7%|███▏                                         | 16/224 [00:08<01:44,  1.99it/s]
Epoch 10 Iter 17: loss 0.17814. :   8%|███▍                                         | 17/224 [00:08<01:43,  1.99it/s]
Epoch 10 Iter 18: loss 0.16803. :   8%|███▍                                         | 17/224 [00:09<01:43,  1.99it/s]
Epoch 10 Iter 18: loss 0.16803. :   8%|███▌                                         | 18/224 [00:09<01:43,  1.98it/s]
Epoch 10 Iter 19: loss 0.16504. :   8%|███▌                                         | 18/224 [00:09<01:43,  1.98it/s]
Epoch 10 Iter 19: loss 0.16504. :   8%|███▊                                         | 19/224 [00:09<01:43,  1.99it/s]
Epoch 10 Iter 20: loss 0.18714. :   8%|███▊                                         | 19/224 [00:10<01:43,  1.99it/s]
Epoch 10 Iter 20: loss 0.18714. :   9%|████                                         | 20/224 [00:10<01:42,  2.00it/s]
Epoch 10 Iter 21: loss 0.18622. :   9%|████                                         | 20/224 [00:10<01:42,  2.00it/s]
Epoch 10 Iter 21: loss 0.18622. :   9%|████▏                                        | 21/224 [00:10<01:42,  1.99it/s]
Epoch 10 Iter 22: loss 0.16554. :   9%|████▏                                        | 21/224 [00:11<01:42,  1.99it/s]
Epoch 10 Iter 22: loss 0.16554. :  10%|████▍                                        | 22/224 [00:11<01:42,  1.98it/s]
Epoch 10 Iter 23: loss 0.17778. :  10%|████▍                                        | 22/224 [00:11<01:42,  1.98it/s]
Epoch 10 Iter 23: loss 0.17778. :  10%|████▌                                        | 23/224 [00:11<01:41,  1.98it/s]
Epoch 10 Iter 24: loss 0.16922. :  10%|████▌                                        | 23/224 [00:12<01:41,  1.98it/s]
Epoch 10 Iter 24: loss 0.16922. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.97it/s]
Epoch 10 Iter 25: loss 0.16732. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.97it/s]
Epoch 10 Iter 25: loss 0.16732. :  11%|█████                                        | 25/224 [00:12<01:39,  1.99it/s]
Epoch 10 Iter 26: loss 0.14630. :  11%|█████                                        | 25/224 [00:13<01:39,  1.99it/s]
Epoch 10 Iter 26: loss 0.14630. :  12%|█████▏                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 10 Iter 27: loss 0.17763. :  12%|█████▏                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 10 Iter 27: loss 0.17763. :  12%|█████▍                                       | 27/224 [00:13<01:39,  1.98it/s]
Epoch 10 Iter 28: loss 0.14826. :  12%|█████▍                                       | 27/224 [00:14<01:39,  1.98it/s]
Epoch 10 Iter 28: loss 0.14826. :  12%|█████▋                                       | 28/224 [00:14<01:39,  1.97it/s]
Epoch 10 Iter 29: loss 0.17253. :  12%|█████▋                                       | 28/224 [00:14<01:39,  1.97it/s]
Epoch 10 Iter 29: loss 0.17253. :  13%|█████▊                                       | 29/224 [00:14<01:38,  1.97it/s]
Epoch 10 Iter 30: loss 0.15686. :  13%|█████▊                                       | 29/224 [00:15<01:38,  1.97it/s]
Epoch 10 Iter 30: loss 0.15686. :  13%|██████                                       | 30/224 [00:15<01:37,  1.99it/s]
Epoch 10 Iter 31: loss 0.16922. :  13%|██████                                       | 30/224 [00:15<01:37,  1.99it/s]
Epoch 10 Iter 31: loss 0.16922. :  14%|██████▏                                      | 31/224 [00:15<01:36,  2.00it/s]
Epoch 10 Iter 32: loss 0.16709. :  14%|██████▏                                      | 31/224 [00:16<01:36,  2.00it/s]
Epoch 10 Iter 32: loss 0.16709. :  14%|██████▍                                      | 32/224 [00:16<01:35,  2.00it/s]
Epoch 10 Iter 33: loss 0.16634. :  14%|██████▍                                      | 32/224 [00:16<01:35,  2.00it/s]
Epoch 10 Iter 33: loss 0.16634. :  15%|██████▋                                      | 33/224 [00:16<01:39,  1.93it/s]
Epoch 10 Iter 34: loss 0.16815. :  15%|██████▋                                      | 33/224 [00:17<01:39,  1.93it/s]
Epoch 10 Iter 34: loss 0.16815. :  15%|██████▊                                      | 34/224 [00:17<01:37,  1.95it/s]
Epoch 10 Iter 35: loss 0.14867. :  15%|██████▊                                      | 34/224 [00:17<01:37,  1.95it/s]
Epoch 10 Iter 35: loss 0.14867. :  16%|███████                                      | 35/224 [00:17<01:36,  1.96it/s]
Epoch 10 Iter 36: loss 0.16963. :  16%|███████                                      | 35/224 [00:18<01:36,  1.96it/s]
Epoch 10 Iter 36: loss 0.16963. :  16%|███████▏                                     | 36/224 [00:18<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.16634. :  16%|███████▏                                     | 36/224 [00:18<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.16634. :  17%|███████▍                                     | 37/224 [00:18<01:34,  1.97it/s]
Epoch 10 Iter 38: loss 0.18339. :  17%|███████▍                                     | 37/224 [00:19<01:34,  1.97it/s]
Epoch 10 Iter 38: loss 0.18339. :  17%|███████▋                                     | 38/224 [00:19<01:33,  1.98it/s]
Epoch 10 Iter 39: loss 0.16615. :  17%|███████▋                                     | 38/224 [00:19<01:33,  1.98it/s]
Epoch 10 Iter 39: loss 0.16615. :  17%|███████▊                                     | 39/224 [00:19<01:32,  1.99it/s]
Epoch 10 Iter 40: loss 0.15715. :  17%|███████▊                                     | 39/224 [00:20<01:32,  1.99it/s]
Epoch 10 Iter 40: loss 0.15715. :  18%|████████                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 10 Iter 41: loss 0.18493. :  18%|████████                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 10 Iter 41: loss 0.18493. :  18%|████████▏                                    | 41/224 [00:20<01:33,  1.97it/s]
Epoch 10 Iter 42: loss 0.18170. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.97it/s]
Epoch 10 Iter 42: loss 0.18170. :  19%|████████▍                                    | 42/224 [00:21<01:33,  1.95it/s]
Epoch 10 Iter 43: loss 0.18698. :  19%|████████▍                                    | 42/224 [00:21<01:33,  1.95it/s]
Epoch 10 Iter 43: loss 0.18698. :  19%|████████▋                                    | 43/224 [00:21<01:32,  1.96it/s]
Epoch 10 Iter 44: loss 0.17500. :  19%|████████▋                                    | 43/224 [00:22<01:32,  1.96it/s]
Epoch 10 Iter 44: loss 0.17500. :  20%|████████▊                                    | 44/224 [00:22<01:31,  1.96it/s]
Epoch 10 Iter 45: loss 0.17844. :  20%|████████▊                                    | 44/224 [00:22<01:31,  1.96it/s]
Epoch 10 Iter 45: loss 0.17844. :  20%|█████████                                    | 45/224 [00:22<01:30,  1.99it/s]
Epoch 10 Iter 46: loss 0.15567. :  20%|█████████                                    | 45/224 [00:23<01:30,  1.99it/s]
Epoch 10 Iter 46: loss 0.15567. :  21%|█████████▏                                   | 46/224 [00:23<01:28,  2.00it/s]
Epoch 10 Iter 47: loss 0.20668. :  21%|█████████▏                                   | 46/224 [00:23<01:28,  2.00it/s]
Epoch 10 Iter 47: loss 0.20668. :  21%|█████████▍                                   | 47/224 [00:23<01:28,  2.01it/s]
Epoch 10 Iter 48: loss 0.15437. :  21%|█████████▍                                   | 47/224 [00:24<01:28,  2.01it/s]
Epoch 10 Iter 48: loss 0.15437. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 10 Iter 49: loss 0.18999. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 10 Iter 49: loss 0.18999. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.02it/s]
Epoch 10 Iter 50: loss 0.16434. :  22%|█████████▊                                   | 49/224 [00:25<01:26,  2.02it/s]
Epoch 10 Iter 50: loss 0.16434. :  22%|██████████                                   | 50/224 [00:25<01:25,  2.03it/s]
Epoch 10 Iter 51: loss 0.17458. :  22%|██████████                                   | 50/224 [00:25<01:25,  2.03it/s]
Epoch 10 Iter 51: loss 0.17458. :  23%|██████████▏                                  | 51/224 [00:25<01:25,  2.03it/s]
Epoch 10 Iter 52: loss 0.16564. :  23%|██████████▏                                  | 51/224 [00:26<01:25,  2.03it/s]
Epoch 10 Iter 52: loss 0.16564. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 53: loss 0.17392. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 53: loss 0.17392. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.02it/s]
Epoch 10 Iter 54: loss 0.16000. :  24%|██████████▋                                  | 53/224 [00:27<01:24,  2.02it/s]
Epoch 10 Iter 54: loss 0.16000. :  24%|██████████▊                                  | 54/224 [00:27<01:24,  2.02it/s]
Epoch 10 Iter 55: loss 0.17009. :  24%|██████████▊                                  | 54/224 [00:27<01:24,  2.02it/s]
Epoch 10 Iter 55: loss 0.17009. :  25%|███████████                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 10 Iter 56: loss 0.18516. :  25%|███████████                                  | 55/224 [00:28<01:24,  2.01it/s]
Epoch 10 Iter 56: loss 0.18516. :  25%|███████████▎                                 | 56/224 [00:28<01:23,  2.00it/s]
Epoch 10 Iter 57: loss 0.17579. :  25%|███████████▎                                 | 56/224 [00:28<01:23,  2.00it/s]
Epoch 10 Iter 57: loss 0.17579. :  25%|███████████▍                                 | 57/224 [00:28<01:23,  2.01it/s]
Epoch 10 Iter 58: loss 0.17347. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  2.01it/s]
Epoch 10 Iter 58: loss 0.17347. :  26%|███████████▋                                 | 58/224 [00:29<01:22,  2.02it/s]
Epoch 10 Iter 59: loss 0.18868. :  26%|███████████▋                                 | 58/224 [00:29<01:22,  2.02it/s]
Epoch 10 Iter 59: loss 0.18868. :  26%|███████████▊                                 | 59/224 [00:29<01:21,  2.02it/s]
Epoch 10 Iter 60: loss 0.16747. :  26%|███████████▊                                 | 59/224 [00:30<01:21,  2.02it/s]
Epoch 10 Iter 60: loss 0.16747. :  27%|████████████                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 10 Iter 61: loss 0.18611. :  27%|████████████                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 10 Iter 61: loss 0.18611. :  27%|████████████▎                                | 61/224 [00:30<01:21,  2.00it/s]
Epoch 10 Iter 62: loss 0.18759. :  27%|████████████▎                                | 61/224 [00:31<01:21,  2.00it/s]
Epoch 10 Iter 62: loss 0.18759. :  28%|████████████▍                                | 62/224 [00:31<01:23,  1.94it/s]
Epoch 10 Iter 63: loss 0.19298. :  28%|████████████▍                                | 62/224 [00:31<01:23,  1.94it/s]
Epoch 10 Iter 63: loss 0.19298. :  28%|████████████▋                                | 63/224 [00:31<01:21,  1.97it/s]
Epoch 10 Iter 64: loss 0.14805. :  28%|████████████▋                                | 63/224 [00:32<01:21,  1.97it/s]
Epoch 10 Iter 64: loss 0.14805. :  29%|████████████▊                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 10 Iter 65: loss 0.17731. :  29%|████████████▊                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 10 Iter 65: loss 0.17731. :  29%|█████████████                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 10 Iter 66: loss 0.18020. :  29%|█████████████                                | 65/224 [00:33<01:19,  2.00it/s]
Epoch 10 Iter 66: loss 0.18020. :  29%|█████████████▎                               | 66/224 [00:33<01:19,  1.99it/s]
Epoch 10 Iter 67: loss 0.17693. :  29%|█████████████▎                               | 66/224 [00:33<01:19,  1.99it/s]
Epoch 10 Iter 67: loss 0.17693. :  30%|█████████████▍                               | 67/224 [00:33<01:18,  1.99it/s]
Epoch 10 Iter 68: loss 0.17035. :  30%|█████████████▍                               | 67/224 [00:34<01:18,  1.99it/s]
Epoch 10 Iter 68: loss 0.17035. :  30%|█████████████▋                               | 68/224 [00:34<01:18,  1.99it/s]
Epoch 10 Iter 69: loss 0.18207. :  30%|█████████████▋                               | 68/224 [00:34<01:18,  1.99it/s]
Epoch 10 Iter 69: loss 0.18207. :  31%|█████████████▊                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 10 Iter 70: loss 0.16947. :  31%|█████████████▊                               | 69/224 [00:35<01:17,  2.00it/s]
Epoch 10 Iter 70: loss 0.16947. :  31%|██████████████                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 10 Iter 71: loss 0.16936. :  31%|██████████████                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 10 Iter 71: loss 0.16936. :  32%|██████████████▎                              | 71/224 [00:35<01:16,  2.01it/s]
Epoch 10 Iter 72: loss 0.15635. :  32%|██████████████▎                              | 71/224 [00:36<01:16,  2.01it/s]
Epoch 10 Iter 72: loss 0.15635. :  32%|██████████████▍                              | 72/224 [00:36<01:15,  2.01it/s]
Epoch 10 Iter 73: loss 0.16658. :  32%|██████████████▍                              | 72/224 [00:36<01:15,  2.01it/s]
Epoch 10 Iter 73: loss 0.16658. :  33%|██████████████▋                              | 73/224 [00:36<01:15,  1.99it/s]
Epoch 10 Iter 74: loss 0.16098. :  33%|██████████████▋                              | 73/224 [00:37<01:15,  1.99it/s]
Epoch 10 Iter 74: loss 0.16098. :  33%|██████████████▊                              | 74/224 [00:37<01:14,  2.00it/s]
Epoch 10 Iter 75: loss 0.16996. :  33%|██████████████▊                              | 74/224 [00:37<01:14,  2.00it/s]
Epoch 10 Iter 75: loss 0.16996. :  33%|███████████████                              | 75/224 [00:37<01:14,  2.00it/s]
Epoch 10 Iter 76: loss 0.17415. :  33%|███████████████                              | 75/224 [00:38<01:14,  2.00it/s]
Epoch 10 Iter 76: loss 0.17415. :  34%|███████████████▎                             | 76/224 [00:38<01:13,  2.01it/s]
Epoch 10 Iter 77: loss 0.18041. :  34%|███████████████▎                             | 76/224 [00:38<01:13,  2.01it/s]
Epoch 10 Iter 77: loss 0.18041. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 10 Iter 78: loss 0.16207. :  34%|███████████████▍                             | 77/224 [00:39<01:13,  2.01it/s]
Epoch 10 Iter 78: loss 0.16207. :  35%|███████████████▋                             | 78/224 [00:39<01:16,  1.91it/s]
Epoch 10 Iter 79: loss 0.16777. :  35%|███████████████▋                             | 78/224 [00:39<01:16,  1.91it/s]
Epoch 10 Iter 79: loss 0.16777. :  35%|███████████████▊                             | 79/224 [00:39<01:14,  1.93it/s]
Epoch 10 Iter 80: loss 0.17266. :  35%|███████████████▊                             | 79/224 [00:40<01:14,  1.93it/s]
Epoch 10 Iter 80: loss 0.17266. :  36%|████████████████                             | 80/224 [00:40<01:17,  1.86it/s]
Epoch 10 Iter 81: loss 0.15455. :  36%|████████████████                             | 80/224 [00:40<01:17,  1.86it/s]
Epoch 10 Iter 81: loss 0.15455. :  36%|████████████████▎                            | 81/224 [00:40<01:15,  1.88it/s]
Epoch 10 Iter 82: loss 0.17360. :  36%|████████████████▎                            | 81/224 [00:41<01:15,  1.88it/s]
Epoch 10 Iter 82: loss 0.17360. :  37%|████████████████▍                            | 82/224 [00:41<01:14,  1.91it/s]
Epoch 10 Iter 83: loss 0.16328. :  37%|████████████████▍                            | 82/224 [00:41<01:14,  1.91it/s]
Epoch 10 Iter 83: loss 0.16328. :  37%|████████████████▋                            | 83/224 [00:41<01:13,  1.92it/s]
Epoch 10 Iter 84: loss 0.16675. :  37%|████████████████▋                            | 83/224 [00:42<01:13,  1.92it/s]
Epoch 10 Iter 84: loss 0.16675. :  38%|████████████████▉                            | 84/224 [00:42<01:12,  1.93it/s]
Epoch 10 Iter 85: loss 0.18290. :  38%|████████████████▉                            | 84/224 [00:42<01:12,  1.93it/s]
Epoch 10 Iter 85: loss 0.18290. :  38%|█████████████████                            | 85/224 [00:42<01:11,  1.94it/s]
Epoch 10 Iter 86: loss 0.15998. :  38%|█████████████████                            | 85/224 [00:43<01:11,  1.94it/s]
Epoch 10 Iter 86: loss 0.15998. :  38%|█████████████████▎                           | 86/224 [00:43<01:10,  1.96it/s]
Epoch 10 Iter 87: loss 0.16913. :  38%|█████████████████▎                           | 86/224 [00:44<01:10,  1.96it/s]
Epoch 10 Iter 87: loss 0.16913. :  39%|█████████████████▍                           | 87/224 [00:44<01:11,  1.91it/s]
Epoch 10 Iter 88: loss 0.16442. :  39%|█████████████████▍                           | 87/224 [00:44<01:11,  1.91it/s]
Epoch 10 Iter 88: loss 0.16442. :  39%|█████████████████▋                           | 88/224 [00:44<01:10,  1.92it/s]
Epoch 10 Iter 89: loss 0.17444. :  39%|█████████████████▋                           | 88/224 [00:45<01:10,  1.92it/s]
Epoch 10 Iter 89: loss 0.17444. :  40%|█████████████████▉                           | 89/224 [00:45<01:09,  1.93it/s]
Epoch 10 Iter 90: loss 0.18234. :  40%|█████████████████▉                           | 89/224 [00:45<01:09,  1.93it/s]
Epoch 10 Iter 90: loss 0.18234. :  40%|██████████████████                           | 90/224 [00:45<01:08,  1.95it/s]
Epoch 10 Iter 91: loss 0.16316. :  40%|██████████████████                           | 90/224 [00:46<01:08,  1.95it/s]
Epoch 10 Iter 91: loss 0.16316. :  41%|██████████████████▎                          | 91/224 [00:46<01:07,  1.97it/s]
Epoch 10 Iter 92: loss 0.17866. :  41%|██████████████████▎                          | 91/224 [00:46<01:07,  1.97it/s]
Epoch 10 Iter 92: loss 0.17866. :  41%|██████████████████▍                          | 92/224 [00:46<01:07,  1.96it/s]
Epoch 10 Iter 93: loss 0.16158. :  41%|██████████████████▍                          | 92/224 [00:47<01:07,  1.96it/s]
Epoch 10 Iter 93: loss 0.16158. :  42%|██████████████████▋                          | 93/224 [00:47<01:07,  1.95it/s]
Epoch 10 Iter 94: loss 0.18119. :  42%|██████████████████▋                          | 93/224 [00:47<01:07,  1.95it/s]
Epoch 10 Iter 94: loss 0.18119. :  42%|██████████████████▉                          | 94/224 [00:47<01:06,  1.95it/s]
Epoch 10 Iter 95: loss 0.17171. :  42%|██████████████████▉                          | 94/224 [00:48<01:06,  1.95it/s]
Epoch 10 Iter 95: loss 0.17171. :  42%|███████████████████                          | 95/224 [00:48<01:10,  1.83it/s]
Epoch 10 Iter 96: loss 0.15110. :  42%|███████████████████                          | 95/224 [00:48<01:10,  1.83it/s]
Epoch 10 Iter 96: loss 0.15110. :  43%|███████████████████▎                         | 96/224 [00:48<01:11,  1.80it/s]
Epoch 10 Iter 97: loss 0.17088. :  43%|███████████████████▎                         | 96/224 [00:49<01:11,  1.80it/s]
Epoch 10 Iter 97: loss 0.17088. :  43%|███████████████████▍                         | 97/224 [00:49<01:08,  1.86it/s]
Epoch 10 Iter 98: loss 0.17313. :  43%|███████████████████▍                         | 97/224 [00:49<01:08,  1.86it/s]
Epoch 10 Iter 98: loss 0.17313. :  44%|███████████████████▋                         | 98/224 [00:49<01:06,  1.91it/s]
Epoch 10 Iter 99: loss 0.18981. :  44%|███████████████████▋                         | 98/224 [00:50<01:06,  1.91it/s]
Epoch 10 Iter 99: loss 0.18981. :  44%|███████████████████▉                         | 99/224 [00:50<01:04,  1.93it/s]
Epoch 10 Iter 100: loss 0.16292. :  44%|███████████████████▍                        | 99/224 [00:50<01:04,  1.93it/s]
Epoch 10 Iter 100: loss 0.16292. :  45%|███████████████████▏                       | 100/224 [00:50<01:04,  1.93it/s]
Epoch 10 Iter 101: loss 0.17134. :  45%|███████████████████▏                       | 100/224 [00:51<01:04,  1.93it/s]
Epoch 10 Iter 101: loss 0.17134. :  45%|███████████████████▍                       | 101/224 [00:51<01:03,  1.94it/s]
Epoch 10 Iter 102: loss 0.16761. :  45%|███████████████████▍                       | 101/224 [00:51<01:03,  1.94it/s]
Epoch 10 Iter 102: loss 0.16761. :  46%|███████████████████▌                       | 102/224 [00:51<01:02,  1.95it/s]
Epoch 10 Iter 103: loss 0.16518. :  46%|███████████████████▌                       | 102/224 [00:52<01:02,  1.95it/s]
Epoch 10 Iter 103: loss 0.16518. :  46%|███████████████████▊                       | 103/224 [00:52<01:01,  1.97it/s]
Epoch 10 Iter 104: loss 0.18249. :  46%|███████████████████▊                       | 103/224 [00:52<01:01,  1.97it/s]
Epoch 10 Iter 104: loss 0.18249. :  46%|███████████████████▉                       | 104/224 [00:52<01:00,  1.97it/s]
Epoch 10 Iter 105: loss 0.16319. :  46%|███████████████████▉                       | 104/224 [00:53<01:00,  1.97it/s]
Epoch 10 Iter 105: loss 0.16319. :  47%|████████████████████▏                      | 105/224 [00:53<01:01,  1.94it/s]
Epoch 10 Iter 106: loss 0.16980. :  47%|████████████████████▏                      | 105/224 [00:53<01:01,  1.94it/s]
Epoch 10 Iter 106: loss 0.16980. :  47%|████████████████████▎                      | 106/224 [00:53<01:00,  1.95it/s]
Epoch 10 Iter 107: loss 0.15925. :  47%|████████████████████▎                      | 106/224 [00:54<01:00,  1.95it/s]
Epoch 10 Iter 107: loss 0.15925. :  48%|████████████████████▌                      | 107/224 [00:54<00:59,  1.96it/s]
Epoch 10 Iter 108: loss 0.16934. :  48%|████████████████████▌                      | 107/224 [00:54<00:59,  1.96it/s]
Epoch 10 Iter 108: loss 0.16934. :  48%|████████████████████▋                      | 108/224 [00:54<00:59,  1.96it/s]
Epoch 10 Iter 109: loss 0.18043. :  48%|████████████████████▋                      | 108/224 [00:55<00:59,  1.96it/s]
Epoch 10 Iter 109: loss 0.18043. :  49%|████████████████████▉                      | 109/224 [00:55<00:58,  1.95it/s]
Epoch 10 Iter 110: loss 0.15164. :  49%|████████████████████▉                      | 109/224 [00:55<00:58,  1.95it/s]
Epoch 10 Iter 110: loss 0.15164. :  49%|█████████████████████                      | 110/224 [00:55<00:57,  1.97it/s]
Epoch 10 Iter 111: loss 0.17116. :  49%|█████████████████████                      | 110/224 [00:56<00:57,  1.97it/s]
Epoch 10 Iter 111: loss 0.17116. :  50%|█████████████████████▎                     | 111/224 [00:56<00:57,  1.97it/s]
Epoch 10 Iter 112: loss 0.15745. :  50%|█████████████████████▎                     | 111/224 [00:56<00:57,  1.97it/s]
Epoch 10 Iter 112: loss 0.15745. :  50%|█████████████████████▌                     | 112/224 [00:56<00:56,  1.97it/s]
Epoch 10 Iter 113: loss 0.14924. :  50%|█████████████████████▌                     | 112/224 [00:57<00:56,  1.97it/s]
Epoch 10 Iter 113: loss 0.14924. :  50%|█████████████████████▋                     | 113/224 [00:57<00:55,  1.98it/s]
Epoch 10 Iter 114: loss 0.18047. :  50%|█████████████████████▋                     | 113/224 [00:57<00:55,  1.98it/s]
Epoch 10 Iter 114: loss 0.18047. :  51%|█████████████████████▉                     | 114/224 [00:57<00:57,  1.90it/s]
Epoch 10 Iter 115: loss 0.16094. :  51%|█████████████████████▉                     | 114/224 [00:58<00:57,  1.90it/s]
Epoch 10 Iter 115: loss 0.16094. :  51%|██████████████████████                     | 115/224 [00:58<00:56,  1.93it/s]
Epoch 10 Iter 116: loss 0.17366. :  51%|██████████████████████                     | 115/224 [00:58<00:56,  1.93it/s]
Epoch 10 Iter 116: loss 0.17366. :  52%|██████████████████████▎                    | 116/224 [00:58<00:55,  1.95it/s]
Epoch 10 Iter 117: loss 0.16980. :  52%|██████████████████████▎                    | 116/224 [00:59<00:55,  1.95it/s]
Epoch 10 Iter 117: loss 0.16980. :  52%|██████████████████████▍                    | 117/224 [00:59<00:54,  1.97it/s]
Epoch 10 Iter 118: loss 0.15497. :  52%|██████████████████████▍                    | 117/224 [00:59<00:54,  1.97it/s]
Epoch 10 Iter 118: loss 0.15497. :  53%|██████████████████████▋                    | 118/224 [00:59<00:53,  1.98it/s]
Epoch 10 Iter 119: loss 0.17500. :  53%|██████████████████████▋                    | 118/224 [01:00<00:53,  1.98it/s]
Epoch 10 Iter 119: loss 0.17500. :  53%|██████████████████████▊                    | 119/224 [01:00<00:52,  1.98it/s]
Epoch 10 Iter 120: loss 0.17476. :  53%|██████████████████████▊                    | 119/224 [01:00<00:52,  1.98it/s]
Epoch 10 Iter 120: loss 0.17476. :  54%|███████████████████████                    | 120/224 [01:00<00:52,  1.99it/s]
Epoch 10 Iter 121: loss 0.17548. :  54%|███████████████████████                    | 120/224 [01:01<00:52,  1.99it/s]
Epoch 10 Iter 121: loss 0.17548. :  54%|███████████████████████▏                   | 121/224 [01:01<00:52,  1.95it/s]
Epoch 10 Iter 122: loss 0.16994. :  54%|███████████████████████▏                   | 121/224 [01:02<00:52,  1.95it/s]
Epoch 10 Iter 122: loss 0.16994. :  54%|███████████████████████▍                   | 122/224 [01:02<00:51,  1.97it/s]
Epoch 10 Iter 123: loss 0.16092. :  54%|███████████████████████▍                   | 122/224 [01:02<00:51,  1.97it/s]
Epoch 10 Iter 123: loss 0.16092. :  55%|███████████████████████▌                   | 123/224 [01:02<00:50,  1.98it/s]
Epoch 10 Iter 124: loss 0.16529. :  55%|███████████████████████▌                   | 123/224 [01:03<00:50,  1.98it/s]
Epoch 10 Iter 124: loss 0.16529. :  55%|███████████████████████▊                   | 124/224 [01:03<00:50,  1.99it/s]
Epoch 10 Iter 125: loss 0.17164. :  55%|███████████████████████▊                   | 124/224 [01:03<00:50,  1.99it/s]
Epoch 10 Iter 125: loss 0.17164. :  56%|███████████████████████▉                   | 125/224 [01:03<00:49,  1.99it/s]
Epoch 10 Iter 126: loss 0.14990. :  56%|███████████████████████▉                   | 125/224 [01:04<00:49,  1.99it/s]
Epoch 10 Iter 126: loss 0.14990. :  56%|████████████████████████▏                  | 126/224 [01:04<00:49,  1.99it/s]
Epoch 10 Iter 127: loss 0.17337. :  56%|████████████████████████▏                  | 126/224 [01:04<00:49,  1.99it/s]
Epoch 10 Iter 127: loss 0.17337. :  57%|████████████████████████▍                  | 127/224 [01:04<00:48,  2.00it/s]
Epoch 10 Iter 128: loss 0.17084. :  57%|████████████████████████▍                  | 127/224 [01:05<00:48,  2.00it/s]
Epoch 10 Iter 128: loss 0.17084. :  57%|████████████████████████▌                  | 128/224 [01:05<00:47,  2.00it/s]
Epoch 10 Iter 129: loss 0.17435. :  57%|████████████████████████▌                  | 128/224 [01:05<00:47,  2.00it/s]
Epoch 10 Iter 129: loss 0.17435. :  58%|████████████████████████▊                  | 129/224 [01:05<00:47,  2.00it/s]
Epoch 10 Iter 130: loss 0.15256. :  58%|████████████████████████▊                  | 129/224 [01:06<00:47,  2.00it/s]
Epoch 10 Iter 130: loss 0.15256. :  58%|████████████████████████▉                  | 130/224 [01:06<00:47,  2.00it/s]
Epoch 10 Iter 131: loss 0.14588. :  58%|████████████████████████▉                  | 130/224 [01:06<00:47,  2.00it/s]
Epoch 10 Iter 131: loss 0.14588. :  58%|█████████████████████████▏                 | 131/224 [01:06<00:46,  2.01it/s]
Epoch 10 Iter 132: loss 0.18534. :  58%|█████████████████████████▏                 | 131/224 [01:07<00:46,  2.01it/s]
Epoch 10 Iter 132: loss 0.18534. :  59%|█████████████████████████▎                 | 132/224 [01:07<00:45,  2.01it/s]
Epoch 10 Iter 133: loss 0.18815. :  59%|█████████████████████████▎                 | 132/224 [01:07<00:45,  2.01it/s]
Epoch 10 Iter 133: loss 0.18815. :  59%|█████████████████████████▌                 | 133/224 [01:07<00:46,  1.94it/s]
Epoch 10 Iter 134: loss 0.17077. :  59%|█████████████████████████▌                 | 133/224 [01:08<00:46,  1.94it/s]
Epoch 10 Iter 134: loss 0.17077. :  60%|█████████████████████████▋                 | 134/224 [01:08<00:46,  1.95it/s]
Epoch 10 Iter 135: loss 0.18447. :  60%|█████████████████████████▋                 | 134/224 [01:08<00:46,  1.95it/s]
Epoch 10 Iter 135: loss 0.18447. :  60%|█████████████████████████▉                 | 135/224 [01:08<00:45,  1.97it/s]
Epoch 10 Iter 136: loss 0.17319. :  60%|█████████████████████████▉                 | 135/224 [01:09<00:45,  1.97it/s]
Epoch 10 Iter 136: loss 0.17319. :  61%|██████████████████████████                 | 136/224 [01:09<00:44,  1.99it/s]
Epoch 10 Iter 137: loss 0.15417. :  61%|██████████████████████████                 | 136/224 [01:09<00:44,  1.99it/s]
Epoch 10 Iter 137: loss 0.15417. :  61%|██████████████████████████▎                | 137/224 [01:09<00:43,  1.98it/s]
Epoch 10 Iter 138: loss 0.16817. :  61%|██████████████████████████▎                | 137/224 [01:10<00:43,  1.98it/s]
Epoch 10 Iter 138: loss 0.16817. :  62%|██████████████████████████▍                | 138/224 [01:10<00:43,  1.99it/s]
Epoch 10 Iter 139: loss 0.17503. :  62%|██████████████████████████▍                | 138/224 [01:10<00:43,  1.99it/s]
Epoch 10 Iter 139: loss 0.17503. :  62%|██████████████████████████▋                | 139/224 [01:10<00:42,  2.00it/s]
Epoch 10 Iter 140: loss 0.16486. :  62%|██████████████████████████▋                | 139/224 [01:11<00:42,  2.00it/s]
Epoch 10 Iter 140: loss 0.16486. :  62%|██████████████████████████▉                | 140/224 [01:11<00:43,  1.94it/s]
Epoch 10 Iter 141: loss 0.18123. :  62%|██████████████████████████▉                | 140/224 [01:11<00:43,  1.94it/s]
Epoch 10 Iter 141: loss 0.18123. :  63%|███████████████████████████                | 141/224 [01:11<00:43,  1.92it/s]
Epoch 10 Iter 142: loss 0.18210. :  63%|███████████████████████████                | 141/224 [01:12<00:43,  1.92it/s]
Epoch 10 Iter 142: loss 0.18210. :  63%|███████████████████████████▎               | 142/224 [01:12<00:42,  1.93it/s]
Epoch 10 Iter 143: loss 0.17344. :  63%|███████████████████████████▎               | 142/224 [01:12<00:42,  1.93it/s]
Epoch 10 Iter 143: loss 0.17344. :  64%|███████████████████████████▍               | 143/224 [01:12<00:41,  1.96it/s]
Epoch 10 Iter 144: loss 0.19175. :  64%|███████████████████████████▍               | 143/224 [01:13<00:41,  1.96it/s]
Epoch 10 Iter 144: loss 0.19175. :  64%|███████████████████████████▋               | 144/224 [01:13<00:40,  1.97it/s]
Epoch 10 Iter 145: loss 0.17534. :  64%|███████████████████████████▋               | 144/224 [01:13<00:40,  1.97it/s]
Epoch 10 Iter 145: loss 0.17534. :  65%|███████████████████████████▊               | 145/224 [01:13<00:39,  1.98it/s]
Epoch 10 Iter 146: loss 0.18442. :  65%|███████████████████████████▊               | 145/224 [01:14<00:39,  1.98it/s]
Epoch 10 Iter 146: loss 0.18442. :  65%|████████████████████████████               | 146/224 [01:14<00:39,  1.99it/s]
Epoch 10 Iter 147: loss 0.18914. :  65%|████████████████████████████               | 146/224 [01:14<00:39,  1.99it/s]
Epoch 10 Iter 147: loss 0.18914. :  66%|████████████████████████████▏              | 147/224 [01:14<00:38,  1.99it/s]
Epoch 10 Iter 148: loss 0.17348. :  66%|████████████████████████████▏              | 147/224 [01:15<00:38,  1.99it/s]
Epoch 10 Iter 148: loss 0.17348. :  66%|████████████████████████████▍              | 148/224 [01:15<00:39,  1.92it/s]
Epoch 10 Iter 149: loss 0.17772. :  66%|████████████████████████████▍              | 148/224 [01:15<00:39,  1.92it/s]
Epoch 10 Iter 149: loss 0.17772. :  67%|████████████████████████████▌              | 149/224 [01:15<00:38,  1.92it/s]
Epoch 10 Iter 150: loss 0.16740. :  67%|████████████████████████████▌              | 149/224 [01:16<00:38,  1.92it/s]
Epoch 10 Iter 150: loss 0.16740. :  67%|████████████████████████████▊              | 150/224 [01:16<00:37,  1.95it/s]
Epoch 10 Iter 151: loss 0.15709. :  67%|████████████████████████████▊              | 150/224 [01:16<00:37,  1.95it/s]
Epoch 10 Iter 151: loss 0.15709. :  67%|████████████████████████████▉              | 151/224 [01:16<00:37,  1.97it/s]
Epoch 10 Iter 152: loss 0.15107. :  67%|████████████████████████████▉              | 151/224 [01:17<00:37,  1.97it/s]
Epoch 10 Iter 152: loss 0.15107. :  68%|█████████████████████████████▏             | 152/224 [01:17<00:36,  1.98it/s]
Epoch 10 Iter 153: loss 0.16894. :  68%|█████████████████████████████▏             | 152/224 [01:17<00:36,  1.98it/s]
Epoch 10 Iter 153: loss 0.16894. :  68%|█████████████████████████████▎             | 153/224 [01:17<00:35,  1.98it/s]
Epoch 10 Iter 154: loss 0.15992. :  68%|█████████████████████████████▎             | 153/224 [01:18<00:35,  1.98it/s]
Epoch 10 Iter 154: loss 0.15992. :  69%|█████████████████████████████▌             | 154/224 [01:18<00:35,  1.97it/s]
Epoch 10 Iter 155: loss 0.18403. :  69%|█████████████████████████████▌             | 154/224 [01:18<00:35,  1.97it/s]
Epoch 10 Iter 155: loss 0.18403. :  69%|█████████████████████████████▊             | 155/224 [01:18<00:34,  1.98it/s]
Epoch 10 Iter 156: loss 0.16428. :  69%|█████████████████████████████▊             | 155/224 [01:19<00:34,  1.98it/s]
Epoch 10 Iter 156: loss 0.16428. :  70%|█████████████████████████████▉             | 156/224 [01:19<00:34,  1.99it/s]
Epoch 10 Iter 157: loss 0.18261. :  70%|█████████████████████████████▉             | 156/224 [01:19<00:34,  1.99it/s]
Epoch 10 Iter 157: loss 0.18261. :  70%|██████████████████████████████▏            | 157/224 [01:19<00:34,  1.94it/s]
Epoch 10 Iter 158: loss 0.16502. :  70%|██████████████████████████████▏            | 157/224 [01:20<00:34,  1.94it/s]
Epoch 10 Iter 158: loss 0.16502. :  71%|██████████████████████████████▎            | 158/224 [01:20<00:33,  1.95it/s]
Epoch 10 Iter 159: loss 0.17775. :  71%|██████████████████████████████▎            | 158/224 [01:20<00:33,  1.95it/s]
Epoch 10 Iter 159: loss 0.17775. :  71%|██████████████████████████████▌            | 159/224 [01:20<00:33,  1.92it/s]
Epoch 10 Iter 160: loss 0.18543. :  71%|██████████████████████████████▌            | 159/224 [01:21<00:33,  1.92it/s]
Epoch 10 Iter 160: loss 0.18543. :  71%|██████████████████████████████▋            | 160/224 [01:21<00:32,  1.96it/s]
Epoch 10 Iter 161: loss 0.17516. :  71%|██████████████████████████████▋            | 160/224 [01:21<00:32,  1.96it/s]
Epoch 10 Iter 161: loss 0.17516. :  72%|██████████████████████████████▉            | 161/224 [01:21<00:32,  1.96it/s]
Epoch 10 Iter 162: loss 0.16303. :  72%|██████████████████████████████▉            | 161/224 [01:22<00:32,  1.96it/s]
Epoch 10 Iter 162: loss 0.16303. :  72%|███████████████████████████████            | 162/224 [01:22<00:31,  1.96it/s]
Epoch 10 Iter 163: loss 0.17035. :  72%|███████████████████████████████            | 162/224 [01:22<00:31,  1.96it/s]
Epoch 10 Iter 163: loss 0.17035. :  73%|███████████████████████████████▎           | 163/224 [01:22<00:30,  1.97it/s]
Epoch 10 Iter 164: loss 0.17354. :  73%|███████████████████████████████▎           | 163/224 [01:23<00:30,  1.97it/s]
Epoch 10 Iter 164: loss 0.17354. :  73%|███████████████████████████████▍           | 164/224 [01:23<00:30,  1.97it/s]
Epoch 10 Iter 165: loss 0.17293. :  73%|███████████████████████████████▍           | 164/224 [01:23<00:30,  1.97it/s]
Epoch 10 Iter 165: loss 0.17293. :  74%|███████████████████████████████▋           | 165/224 [01:23<00:29,  1.98it/s]
Epoch 10 Iter 166: loss 0.17238. :  74%|███████████████████████████████▋           | 165/224 [01:24<00:29,  1.98it/s]
Epoch 10 Iter 166: loss 0.17238. :  74%|███████████████████████████████▊           | 166/224 [01:24<00:29,  1.98it/s]
Epoch 10 Iter 167: loss 0.19288. :  74%|███████████████████████████████▊           | 166/224 [01:24<00:29,  1.98it/s]
Epoch 10 Iter 167: loss 0.19288. :  75%|████████████████████████████████           | 167/224 [01:24<00:28,  1.97it/s]
Epoch 10 Iter 168: loss 0.16813. :  75%|████████████████████████████████           | 167/224 [01:25<00:28,  1.97it/s]
Epoch 10 Iter 168: loss 0.16813. :  75%|████████████████████████████████▎          | 168/224 [01:25<00:29,  1.89it/s]
Epoch 10 Iter 169: loss 0.17800. :  75%|████████████████████████████████▎          | 168/224 [01:25<00:29,  1.89it/s]
Epoch 10 Iter 169: loss 0.17800. :  75%|████████████████████████████████▍          | 169/224 [01:25<00:28,  1.92it/s]
Epoch 10 Iter 170: loss 0.17420. :  75%|████████████████████████████████▍          | 169/224 [01:26<00:28,  1.92it/s]
Epoch 10 Iter 170: loss 0.17420. :  76%|████████████████████████████████▋          | 170/224 [01:26<00:27,  1.94it/s]
Epoch 10 Iter 171: loss 0.18030. :  76%|████████████████████████████████▋          | 170/224 [01:26<00:27,  1.94it/s]
Epoch 10 Iter 171: loss 0.18030. :  76%|████████████████████████████████▊          | 171/224 [01:26<00:26,  1.96it/s]
Epoch 10 Iter 172: loss 0.18389. :  76%|████████████████████████████████▊          | 171/224 [01:27<00:26,  1.96it/s]
Epoch 10 Iter 172: loss 0.18389. :  77%|█████████████████████████████████          | 172/224 [01:27<00:26,  1.96it/s]
Epoch 10 Iter 173: loss 0.16231. :  77%|█████████████████████████████████          | 172/224 [01:27<00:26,  1.96it/s]
Epoch 10 Iter 173: loss 0.16231. :  77%|█████████████████████████████████▏         | 173/224 [01:27<00:25,  1.97it/s]
Epoch 10 Iter 174: loss 0.17254. :  77%|█████████████████████████████████▏         | 173/224 [01:28<00:25,  1.97it/s]
Epoch 10 Iter 174: loss 0.17254. :  78%|█████████████████████████████████▍         | 174/224 [01:28<00:25,  1.98it/s]
Epoch 10 Iter 175: loss 0.18048. :  78%|█████████████████████████████████▍         | 174/224 [01:28<00:25,  1.98it/s]
Epoch 10 Iter 175: loss 0.18048. :  78%|█████████████████████████████████▌         | 175/224 [01:28<00:24,  1.98it/s]
Epoch 10 Iter 176: loss 0.16190. :  78%|█████████████████████████████████▌         | 175/224 [01:29<00:24,  1.98it/s]
Epoch 10 Iter 176: loss 0.16190. :  79%|█████████████████████████████████▊         | 176/224 [01:29<00:24,  2.00it/s]
Epoch 10 Iter 177: loss 0.17420. :  79%|█████████████████████████████████▊         | 176/224 [01:29<00:24,  2.00it/s]
Epoch 10 Iter 177: loss 0.17420. :  79%|█████████████████████████████████▉         | 177/224 [01:29<00:23,  2.00it/s]
Epoch 10 Iter 178: loss 0.17413. :  79%|█████████████████████████████████▉         | 177/224 [01:30<00:23,  2.00it/s]
Epoch 10 Iter 178: loss 0.17413. :  79%|██████████████████████████████████▏        | 178/224 [01:30<00:23,  2.00it/s]
Epoch 10 Iter 179: loss 0.17183. :  79%|██████████████████████████████████▏        | 178/224 [01:30<00:23,  2.00it/s]
Epoch 10 Iter 179: loss 0.17183. :  80%|██████████████████████████████████▎        | 179/224 [01:30<00:22,  1.99it/s]
Epoch 10 Iter 180: loss 0.17471. :  80%|██████████████████████████████████▎        | 179/224 [01:31<00:22,  1.99it/s]
Epoch 10 Iter 180: loss 0.17471. :  80%|██████████████████████████████████▌        | 180/224 [01:31<00:22,  2.00it/s]
Epoch 10 Iter 181: loss 0.17344. :  80%|██████████████████████████████████▌        | 180/224 [01:31<00:22,  2.00it/s]
Epoch 10 Iter 181: loss 0.17344. :  81%|██████████████████████████████████▋        | 181/224 [01:31<00:21,  2.00it/s]
Epoch 10 Iter 182: loss 0.15021. :  81%|██████████████████████████████████▋        | 181/224 [01:32<00:21,  2.00it/s]
Epoch 10 Iter 182: loss 0.15021. :  81%|██████████████████████████████████▉        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 10 Iter 183: loss 0.17133. :  81%|██████████████████████████████████▉        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 10 Iter 183: loss 0.17133. :  82%|███████████████████████████████████▏       | 183/224 [01:32<00:20,  1.97it/s]
Epoch 10 Iter 184: loss 0.16268. :  82%|███████████████████████████████████▏       | 183/224 [01:33<00:20,  1.97it/s]
Epoch 10 Iter 184: loss 0.16268. :  82%|███████████████████████████████████▎       | 184/224 [01:33<00:20,  1.97it/s]
Epoch 10 Iter 185: loss 0.16647. :  82%|███████████████████████████████████▎       | 184/224 [01:33<00:20,  1.97it/s]
Epoch 10 Iter 185: loss 0.16647. :  83%|███████████████████████████████████▌       | 185/224 [01:33<00:19,  1.97it/s]
Epoch 10 Iter 186: loss 0.16085. :  83%|███████████████████████████████████▌       | 185/224 [01:34<00:19,  1.97it/s]
Epoch 10 Iter 186: loss 0.16085. :  83%|███████████████████████████████████▋       | 186/224 [01:34<00:19,  1.98it/s]
Epoch 10 Iter 187: loss 0.16111. :  83%|███████████████████████████████████▋       | 186/224 [01:34<00:19,  1.98it/s]
Epoch 10 Iter 187: loss 0.16111. :  83%|███████████████████████████████████▉       | 187/224 [01:34<00:18,  1.97it/s]
Epoch 10 Iter 188: loss 0.16822. :  83%|███████████████████████████████████▉       | 187/224 [01:35<00:18,  1.97it/s]
Epoch 10 Iter 188: loss 0.16822. :  84%|████████████████████████████████████       | 188/224 [01:35<00:18,  1.98it/s]
Epoch 10 Iter 189: loss 0.17104. :  84%|████████████████████████████████████       | 188/224 [01:35<00:18,  1.98it/s]
Epoch 10 Iter 189: loss 0.17104. :  84%|████████████████████████████████████▎      | 189/224 [01:35<00:17,  1.99it/s]
Epoch 10 Iter 190: loss 0.18190. :  84%|████████████████████████████████████▎      | 189/224 [01:36<00:17,  1.99it/s]
Epoch 10 Iter 190: loss 0.18190. :  85%|████████████████████████████████████▍      | 190/224 [01:36<00:16,  2.00it/s]
Epoch 10 Iter 191: loss 0.15341. :  85%|████████████████████████████████████▍      | 190/224 [01:36<00:16,  2.00it/s]
Epoch 10 Iter 191: loss 0.15341. :  85%|████████████████████████████████████▋      | 191/224 [01:36<00:16,  1.99it/s]
Epoch 10 Iter 192: loss 0.15751. :  85%|████████████████████████████████████▋      | 191/224 [01:37<00:16,  1.99it/s]
Epoch 10 Iter 192: loss 0.15751. :  86%|████████████████████████████████████▊      | 192/224 [01:37<00:16,  1.99it/s]
Epoch 10 Iter 193: loss 0.17149. :  86%|████████████████████████████████████▊      | 192/224 [01:38<00:16,  1.99it/s]
Epoch 10 Iter 193: loss 0.17149. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  1.98it/s]
Epoch 10 Iter 194: loss 0.17310. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  1.98it/s]
Epoch 10 Iter 194: loss 0.17310. :  87%|█████████████████████████████████████▏     | 194/224 [01:38<00:15,  1.94it/s]
Epoch 10 Iter 195: loss 0.16315. :  87%|█████████████████████████████████████▏     | 194/224 [01:39<00:15,  1.94it/s]
Epoch 10 Iter 195: loss 0.16315. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  1.96it/s]
Epoch 10 Iter 196: loss 0.16962. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  1.96it/s]
Epoch 10 Iter 196: loss 0.16962. :  88%|█████████████████████████████████████▋     | 196/224 [01:39<00:14,  1.96it/s]
Epoch 10 Iter 197: loss 0.18504. :  88%|█████████████████████████████████████▋     | 196/224 [01:40<00:14,  1.96it/s]
Epoch 10 Iter 197: loss 0.18504. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  1.96it/s]
Epoch 10 Iter 198: loss 0.18095. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  1.96it/s]
Epoch 10 Iter 198: loss 0.18095. :  88%|██████████████████████████████████████     | 198/224 [01:40<00:13,  1.97it/s]
Epoch 10 Iter 199: loss 0.18297. :  88%|██████████████████████████████████████     | 198/224 [01:41<00:13,  1.97it/s]
Epoch 10 Iter 199: loss 0.18297. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  1.98it/s]
Epoch 10 Iter 200: loss 0.17805. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  1.98it/s]
Epoch 10 Iter 200: loss 0.17805. :  89%|██████████████████████████████████████▍    | 200/224 [01:41<00:12,  1.97it/s]
Epoch 10 Iter 201: loss 0.15678. :  89%|██████████████████████████████████████▍    | 200/224 [01:42<00:12,  1.97it/s]
Epoch 10 Iter 201: loss 0.15678. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  1.97it/s]
Epoch 10 Iter 202: loss 0.17023. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  1.97it/s]
Epoch 10 Iter 202: loss 0.17023. :  90%|██████████████████████████████████████▊    | 202/224 [01:42<00:11,  1.99it/s]
Epoch 10 Iter 203: loss 0.17572. :  90%|██████████████████████████████████████▊    | 202/224 [01:43<00:11,  1.99it/s]
Epoch 10 Iter 203: loss 0.17572. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.00it/s]
Epoch 10 Iter 204: loss 0.16660. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.00it/s]
Epoch 10 Iter 204: loss 0.16660. :  91%|███████████████████████████████████████▏   | 204/224 [01:43<00:09,  2.00it/s]
Epoch 10 Iter 205: loss 0.17943. :  91%|███████████████████████████████████████▏   | 204/224 [01:44<00:09,  2.00it/s]
Epoch 10 Iter 205: loss 0.17943. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.01it/s]
Epoch 10 Iter 206: loss 0.15873. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.01it/s]
Epoch 10 Iter 206: loss 0.15873. :  92%|███████████████████████████████████████▌   | 206/224 [01:44<00:08,  2.01it/s]
Epoch 10 Iter 207: loss 0.16674. :  92%|███████████████████████████████████████▌   | 206/224 [01:45<00:08,  2.01it/s]
Epoch 10 Iter 207: loss 0.16674. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.01it/s]
Epoch 10 Iter 208: loss 0.18317. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.01it/s]
Epoch 10 Iter 208: loss 0.18317. :  93%|███████████████████████████████████████▉   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 10 Iter 209: loss 0.17788. :  93%|███████████████████████████████████████▉   | 208/224 [01:46<00:07,  2.01it/s]
Epoch 10 Iter 209: loss 0.17788. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 10 Iter 210: loss 0.15183. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 10 Iter 210: loss 0.15183. :  94%|████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.03it/s]
Epoch 10 Iter 211: loss 0.16931. :  94%|████████████████████████████████████████▎  | 210/224 [01:47<00:06,  2.03it/s]
Epoch 10 Iter 211: loss 0.16931. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.02it/s]
Epoch 10 Iter 212: loss 0.15241. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.02it/s]
Epoch 10 Iter 212: loss 0.15241. :  95%|████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 10 Iter 213: loss 0.17349. :  95%|████████████████████████████████████████▋  | 212/224 [01:48<00:05,  2.02it/s]
Epoch 10 Iter 213: loss 0.17349. :  95%|████████████████████████████████████████▉  | 213/224 [01:48<00:05,  2.02it/s]
Epoch 10 Iter 214: loss 0.16447. :  95%|████████████████████████████████████████▉  | 213/224 [01:48<00:05,  2.02it/s]
Epoch 10 Iter 214: loss 0.16447. :  96%|█████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 10 Iter 215: loss 0.17801. :  96%|█████████████████████████████████████████  | 214/224 [01:49<00:04,  2.02it/s]
Epoch 10 Iter 215: loss 0.17801. :  96%|█████████████████████████████████████████▎ | 215/224 [01:49<00:04,  2.02it/s]
Epoch 10 Iter 216: loss 0.16716. :  96%|█████████████████████████████████████████▎ | 215/224 [01:49<00:04,  2.02it/s]
Epoch 10 Iter 216: loss 0.16716. :  96%|█████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.99it/s]
Epoch 10 Iter 217: loss 0.17304. :  96%|█████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.99it/s]
Epoch 10 Iter 217: loss 0.17304. :  97%|█████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.99it/s]
Epoch 10 Iter 218: loss 0.19110. :  97%|█████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.99it/s]
Epoch 10 Iter 218: loss 0.19110. :  97%|█████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.00it/s]
Epoch 10 Iter 219: loss 0.18104. :  97%|█████████████████████████████████████████▊ | 218/224 [01:51<00:02,  2.00it/s]
Epoch 10 Iter 219: loss 0.18104. :  98%|██████████████████████████████████████████ | 219/224 [01:51<00:02,  1.99it/s]
Epoch 10 Iter 220: loss 0.17503. :  98%|██████████████████████████████████████████ | 219/224 [01:51<00:02,  1.99it/s]
Epoch 10 Iter 220: loss 0.17503. :  98%|██████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.01it/s]
Epoch 10 Iter 221: loss 0.17061. :  98%|██████████████████████████████████████████▏| 220/224 [01:52<00:01,  2.01it/s]
Epoch 10 Iter 221: loss 0.17061. :  99%|██████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.01it/s]
Epoch 10 Iter 222: loss 0.17086. :  99%|██████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.01it/s]
Epoch 10 Iter 222: loss 0.17086. :  99%|██████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.01it/s]
Epoch 10 Iter 223: loss 0.17795. :  99%|██████████████████████████████████████████▌| 222/224 [01:53<00:00,  2.01it/s]
Epoch 10 Iter 223: loss 0.17795. : 100%|██████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.02it/s]
Epoch 10 Iter 224: loss 0.18937. : 100%|██████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.02it/s]
Epoch 10 Iter 224: loss 0.18937. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  2.02it/s]
Epoch 10 Iter 224: loss 0.18937. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  1.97it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.17591. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.17591. :   0%|▏                                              | 1/224 [00:00<01:50,  2.03it/s]
Epoch 11 Iter 2: loss 0.17079. :   0%|▏                                              | 1/224 [00:01<01:50,  2.03it/s]
Epoch 11 Iter 2: loss 0.17079. :   1%|▍                                              | 2/224 [00:01<01:51,  1.99it/s]
Epoch 11 Iter 3: loss 0.16486. :   1%|▍                                              | 2/224 [00:01<01:51,  1.99it/s]
Epoch 11 Iter 3: loss 0.16486. :   1%|▋                                              | 3/224 [00:01<01:57,  1.88it/s]
Epoch 11 Iter 4: loss 0.17119. :   1%|▋                                              | 3/224 [00:02<01:57,  1.88it/s]
Epoch 11 Iter 4: loss 0.17119. :   2%|▊                                              | 4/224 [00:02<01:54,  1.93it/s]
Epoch 11 Iter 5: loss 0.14049. :   2%|▊                                              | 4/224 [00:02<01:54,  1.93it/s]
Epoch 11 Iter 5: loss 0.14049. :   2%|█                                              | 5/224 [00:02<01:51,  1.96it/s]
Epoch 11 Iter 6: loss 0.15680. :   2%|█                                              | 5/224 [00:03<01:51,  1.96it/s]
Epoch 11 Iter 6: loss 0.15680. :   3%|█▎                                             | 6/224 [00:03<01:50,  1.97it/s]
Epoch 11 Iter 7: loss 0.17433. :   3%|█▎                                             | 6/224 [00:03<01:50,  1.97it/s]
Epoch 11 Iter 7: loss 0.17433. :   3%|█▍                                             | 7/224 [00:03<01:49,  1.98it/s]
Epoch 11 Iter 8: loss 0.17099. :   3%|█▍                                             | 7/224 [00:04<01:49,  1.98it/s]
Epoch 11 Iter 8: loss 0.17099. :   4%|█▋                                             | 8/224 [00:04<01:48,  1.99it/s]
Epoch 11 Iter 9: loss 0.17339. :   4%|█▋                                             | 8/224 [00:04<01:48,  1.99it/s]
Epoch 11 Iter 9: loss 0.17339. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.00it/s]
Epoch 11 Iter 10: loss 0.17190. :   4%|█▊                                            | 9/224 [00:05<01:47,  2.00it/s]
Epoch 11 Iter 10: loss 0.17190. :   4%|██                                           | 10/224 [00:05<01:47,  2.00it/s]
Epoch 11 Iter 11: loss 0.16797. :   4%|██                                           | 10/224 [00:05<01:47,  2.00it/s]
Epoch 11 Iter 11: loss 0.16797. :   5%|██▏                                          | 11/224 [00:05<01:46,  2.00it/s]
Epoch 11 Iter 12: loss 0.18558. :   5%|██▏                                          | 11/224 [00:06<01:46,  2.00it/s]
Epoch 11 Iter 12: loss 0.18558. :   5%|██▍                                          | 12/224 [00:06<01:45,  2.01it/s]
Epoch 11 Iter 13: loss 0.17318. :   5%|██▍                                          | 12/224 [00:06<01:45,  2.01it/s]
Epoch 11 Iter 13: loss 0.17318. :   6%|██▌                                          | 13/224 [00:06<01:46,  1.99it/s]
Epoch 11 Iter 14: loss 0.17092. :   6%|██▌                                          | 13/224 [00:07<01:46,  1.99it/s]
Epoch 11 Iter 14: loss 0.17092. :   6%|██▊                                          | 14/224 [00:07<01:45,  1.99it/s]
Epoch 11 Iter 15: loss 0.18028. :   6%|██▊                                          | 14/224 [00:07<01:45,  1.99it/s]
Epoch 11 Iter 15: loss 0.18028. :   7%|███                                          | 15/224 [00:07<01:46,  1.96it/s]
Epoch 11 Iter 16: loss 0.18776. :   7%|███                                          | 15/224 [00:08<01:46,  1.96it/s]
Epoch 11 Iter 16: loss 0.18776. :   7%|███▏                                         | 16/224 [00:08<01:45,  1.97it/s]
Epoch 11 Iter 17: loss 0.16365. :   7%|███▏                                         | 16/224 [00:08<01:45,  1.97it/s]
Epoch 11 Iter 17: loss 0.16365. :   8%|███▍                                         | 17/224 [00:08<01:44,  1.99it/s]
Epoch 11 Iter 18: loss 0.16287. :   8%|███▍                                         | 17/224 [00:09<01:44,  1.99it/s]
Epoch 11 Iter 18: loss 0.16287. :   8%|███▌                                         | 18/224 [00:09<01:43,  2.00it/s]
Epoch 11 Iter 19: loss 0.16808. :   8%|███▌                                         | 18/224 [00:09<01:43,  2.00it/s]
Epoch 11 Iter 19: loss 0.16808. :   8%|███▊                                         | 19/224 [00:09<01:41,  2.01it/s]
Epoch 11 Iter 20: loss 0.17379. :   8%|███▊                                         | 19/224 [00:10<01:41,  2.01it/s]
Epoch 11 Iter 20: loss 0.17379. :   9%|████                                         | 20/224 [00:10<01:41,  2.02it/s]
Epoch 11 Iter 21: loss 0.16119. :   9%|████                                         | 20/224 [00:10<01:41,  2.02it/s]
Epoch 11 Iter 21: loss 0.16119. :   9%|████▏                                        | 21/224 [00:10<01:40,  2.01it/s]
Epoch 11 Iter 22: loss 0.16663. :   9%|████▏                                        | 21/224 [00:11<01:40,  2.01it/s]
Epoch 11 Iter 22: loss 0.16663. :  10%|████▍                                        | 22/224 [00:11<01:40,  2.02it/s]
Epoch 11 Iter 23: loss 0.15979. :  10%|████▍                                        | 22/224 [00:11<01:40,  2.02it/s]
Epoch 11 Iter 23: loss 0.15979. :  10%|████▌                                        | 23/224 [00:11<01:39,  2.01it/s]
Epoch 11 Iter 24: loss 0.16733. :  10%|████▌                                        | 23/224 [00:12<01:39,  2.01it/s]
Epoch 11 Iter 24: loss 0.16733. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.01it/s]
Epoch 11 Iter 25: loss 0.18973. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.01it/s]
Epoch 11 Iter 25: loss 0.18973. :  11%|█████                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 11 Iter 26: loss 0.15984. :  11%|█████                                        | 25/224 [00:13<01:39,  2.00it/s]
Epoch 11 Iter 26: loss 0.15984. :  12%|█████▏                                       | 26/224 [00:13<01:42,  1.93it/s]
Epoch 11 Iter 27: loss 0.14996. :  12%|█████▏                                       | 26/224 [00:13<01:42,  1.93it/s]
Epoch 11 Iter 27: loss 0.14996. :  12%|█████▍                                       | 27/224 [00:13<01:41,  1.94it/s]
Epoch 11 Iter 28: loss 0.15559. :  12%|█████▍                                       | 27/224 [00:14<01:41,  1.94it/s]
Epoch 11 Iter 28: loss 0.15559. :  12%|█████▋                                       | 28/224 [00:14<01:39,  1.97it/s]
Epoch 11 Iter 29: loss 0.15740. :  12%|█████▋                                       | 28/224 [00:14<01:39,  1.97it/s]
Epoch 11 Iter 29: loss 0.15740. :  13%|█████▊                                       | 29/224 [00:14<01:39,  1.96it/s]
Epoch 11 Iter 30: loss 0.16094. :  13%|█████▊                                       | 29/224 [00:15<01:39,  1.96it/s]
Epoch 11 Iter 30: loss 0.16094. :  13%|██████                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 11 Iter 31: loss 0.16416. :  13%|██████                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 11 Iter 31: loss 0.16416. :  14%|██████▏                                      | 31/224 [00:15<01:37,  1.98it/s]
Epoch 11 Iter 32: loss 0.17581. :  14%|██████▏                                      | 31/224 [00:16<01:37,  1.98it/s]
Epoch 11 Iter 32: loss 0.17581. :  14%|██████▍                                      | 32/224 [00:16<01:36,  1.98it/s]
Epoch 11 Iter 33: loss 0.16605. :  14%|██████▍                                      | 32/224 [00:16<01:36,  1.98it/s]
Epoch 11 Iter 33: loss 0.16605. :  15%|██████▋                                      | 33/224 [00:16<01:36,  1.98it/s]
Epoch 11 Iter 34: loss 0.16308. :  15%|██████▋                                      | 33/224 [00:17<01:36,  1.98it/s]
Epoch 11 Iter 34: loss 0.16308. :  15%|██████▊                                      | 34/224 [00:17<01:35,  1.98it/s]
Epoch 11 Iter 35: loss 0.16561. :  15%|██████▊                                      | 34/224 [00:17<01:35,  1.98it/s]
Epoch 11 Iter 35: loss 0.16561. :  16%|███████                                      | 35/224 [00:17<01:35,  1.97it/s]
Epoch 11 Iter 36: loss 0.17564. :  16%|███████                                      | 35/224 [00:18<01:35,  1.97it/s]
Epoch 11 Iter 36: loss 0.17564. :  16%|███████▏                                     | 36/224 [00:18<01:38,  1.91it/s]
Epoch 11 Iter 37: loss 0.18321. :  16%|███████▏                                     | 36/224 [00:18<01:38,  1.91it/s]
Epoch 11 Iter 37: loss 0.18321. :  17%|███████▍                                     | 37/224 [00:18<01:38,  1.90it/s]
Epoch 11 Iter 38: loss 0.15620. :  17%|███████▍                                     | 37/224 [00:19<01:38,  1.90it/s]
Epoch 11 Iter 38: loss 0.15620. :  17%|███████▋                                     | 38/224 [00:19<01:36,  1.92it/s]
Epoch 11 Iter 39: loss 0.16615. :  17%|███████▋                                     | 38/224 [00:19<01:36,  1.92it/s]
Epoch 11 Iter 39: loss 0.16615. :  17%|███████▊                                     | 39/224 [00:19<01:34,  1.95it/s]
Epoch 11 Iter 40: loss 0.17857. :  17%|███████▊                                     | 39/224 [00:20<01:34,  1.95it/s]
Epoch 11 Iter 40: loss 0.17857. :  18%|████████                                     | 40/224 [00:20<01:34,  1.95it/s]
Epoch 11 Iter 41: loss 0.17517. :  18%|████████                                     | 40/224 [00:20<01:34,  1.95it/s]
Epoch 11 Iter 41: loss 0.17517. :  18%|████████▏                                    | 41/224 [00:20<01:33,  1.97it/s]
Epoch 11 Iter 42: loss 0.16126. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.97it/s]
Epoch 11 Iter 42: loss 0.16126. :  19%|████████▍                                    | 42/224 [00:21<01:32,  1.97it/s]
Epoch 11 Iter 43: loss 0.17925. :  19%|████████▍                                    | 42/224 [00:21<01:32,  1.97it/s]
Epoch 11 Iter 43: loss 0.17925. :  19%|████████▋                                    | 43/224 [00:21<01:31,  1.99it/s]
Epoch 11 Iter 44: loss 0.18451. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.99it/s]
Epoch 11 Iter 44: loss 0.18451. :  20%|████████▊                                    | 44/224 [00:22<01:30,  1.99it/s]
Epoch 11 Iter 45: loss 0.15920. :  20%|████████▊                                    | 44/224 [00:22<01:30,  1.99it/s]
Epoch 11 Iter 45: loss 0.15920. :  20%|█████████                                    | 45/224 [00:22<01:29,  1.99it/s]
Epoch 11 Iter 46: loss 0.16873. :  20%|█████████                                    | 45/224 [00:23<01:29,  1.99it/s]
Epoch 11 Iter 46: loss 0.16873. :  21%|█████████▏                                   | 46/224 [00:23<01:29,  2.00it/s]
Epoch 11 Iter 47: loss 0.16730. :  21%|█████████▏                                   | 46/224 [00:23<01:29,  2.00it/s]
Epoch 11 Iter 47: loss 0.16730. :  21%|█████████▍                                   | 47/224 [00:23<01:27,  2.01it/s]
Epoch 11 Iter 48: loss 0.14717. :  21%|█████████▍                                   | 47/224 [00:24<01:27,  2.01it/s]
Epoch 11 Iter 48: loss 0.14717. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 11 Iter 49: loss 0.19129. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 11 Iter 49: loss 0.19129. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.02it/s]
Epoch 11 Iter 50: loss 0.16583. :  22%|█████████▊                                   | 49/224 [00:25<01:26,  2.02it/s]
Epoch 11 Iter 50: loss 0.16583. :  22%|██████████                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 11 Iter 51: loss 0.16497. :  22%|██████████                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 11 Iter 51: loss 0.16497. :  23%|██████████▏                                  | 51/224 [00:25<01:25,  2.01it/s]
Epoch 11 Iter 52: loss 0.16884. :  23%|██████████▏                                  | 51/224 [00:26<01:25,  2.01it/s]
Epoch 11 Iter 52: loss 0.16884. :  23%|██████████▍                                  | 52/224 [00:26<01:25,  2.01it/s]
Epoch 11 Iter 53: loss 0.17131. :  23%|██████████▍                                  | 52/224 [00:26<01:25,  2.01it/s]
Epoch 11 Iter 53: loss 0.17131. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.02it/s]
Epoch 11 Iter 54: loss 0.15143. :  24%|██████████▋                                  | 53/224 [00:27<01:24,  2.02it/s]
Epoch 11 Iter 54: loss 0.15143. :  24%|██████████▊                                  | 54/224 [00:27<01:24,  2.01it/s]
Epoch 11 Iter 55: loss 0.14847. :  24%|██████████▊                                  | 54/224 [00:27<01:24,  2.01it/s]
Epoch 11 Iter 55: loss 0.14847. :  25%|███████████                                  | 55/224 [00:27<01:23,  2.02it/s]
Epoch 11 Iter 56: loss 0.16568. :  25%|███████████                                  | 55/224 [00:28<01:23,  2.02it/s]
Epoch 11 Iter 56: loss 0.16568. :  25%|███████████▎                                 | 56/224 [00:28<01:23,  2.01it/s]
Epoch 11 Iter 57: loss 0.16596. :  25%|███████████▎                                 | 56/224 [00:28<01:23,  2.01it/s]
Epoch 11 Iter 57: loss 0.16596. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.01it/s]
Epoch 11 Iter 58: loss 0.18529. :  25%|███████████▍                                 | 57/224 [00:29<01:22,  2.01it/s]
Epoch 11 Iter 58: loss 0.18529. :  26%|███████████▋                                 | 58/224 [00:29<01:23,  1.99it/s]
Epoch 11 Iter 59: loss 0.17156. :  26%|███████████▋                                 | 58/224 [00:29<01:23,  1.99it/s]
Epoch 11 Iter 59: loss 0.17156. :  26%|███████████▊                                 | 59/224 [00:29<01:22,  1.99it/s]
Epoch 11 Iter 60: loss 0.18290. :  26%|███████████▊                                 | 59/224 [00:30<01:22,  1.99it/s]
Epoch 11 Iter 60: loss 0.18290. :  27%|████████████                                 | 60/224 [00:30<01:22,  1.98it/s]
Epoch 11 Iter 61: loss 0.18219. :  27%|████████████                                 | 60/224 [00:30<01:22,  1.98it/s]
Epoch 11 Iter 61: loss 0.18219. :  27%|████████████▎                                | 61/224 [00:30<01:21,  2.00it/s]
Epoch 11 Iter 62: loss 0.17271. :  27%|████████████▎                                | 61/224 [00:31<01:21,  2.00it/s]
Epoch 11 Iter 62: loss 0.17271. :  28%|████████████▍                                | 62/224 [00:31<01:20,  2.01it/s]
Epoch 11 Iter 63: loss 0.16430. :  28%|████████████▍                                | 62/224 [00:31<01:20,  2.01it/s]
Epoch 11 Iter 63: loss 0.16430. :  28%|████████████▋                                | 63/224 [00:31<01:19,  2.01it/s]
Epoch 11 Iter 64: loss 0.16926. :  28%|████████████▋                                | 63/224 [00:32<01:19,  2.01it/s]
Epoch 11 Iter 64: loss 0.16926. :  29%|████████████▊                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 11 Iter 65: loss 0.16644. :  29%|████████████▊                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 11 Iter 65: loss 0.16644. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.02it/s]
Epoch 11 Iter 66: loss 0.19008. :  29%|█████████████                                | 65/224 [00:33<01:18,  2.02it/s]
Epoch 11 Iter 66: loss 0.19008. :  29%|█████████████▎                               | 66/224 [00:33<01:20,  1.97it/s]
Epoch 11 Iter 67: loss 0.15997. :  29%|█████████████▎                               | 66/224 [00:33<01:20,  1.97it/s]
Epoch 11 Iter 67: loss 0.15997. :  30%|█████████████▍                               | 67/224 [00:33<01:18,  1.99it/s]
Epoch 11 Iter 68: loss 0.16875. :  30%|█████████████▍                               | 67/224 [00:34<01:18,  1.99it/s]
Epoch 11 Iter 68: loss 0.16875. :  30%|█████████████▋                               | 68/224 [00:34<01:18,  1.99it/s]
Epoch 11 Iter 69: loss 0.16307. :  30%|█████████████▋                               | 68/224 [00:34<01:18,  1.99it/s]
Epoch 11 Iter 69: loss 0.16307. :  31%|█████████████▊                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 11 Iter 70: loss 0.16530. :  31%|█████████████▊                               | 69/224 [00:35<01:17,  2.00it/s]
Epoch 11 Iter 70: loss 0.16530. :  31%|██████████████                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 11 Iter 71: loss 0.17584. :  31%|██████████████                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 11 Iter 71: loss 0.17584. :  32%|██████████████▎                              | 71/224 [00:35<01:16,  1.99it/s]
Epoch 11 Iter 72: loss 0.16218. :  32%|██████████████▎                              | 71/224 [00:36<01:16,  1.99it/s]
Epoch 11 Iter 72: loss 0.16218. :  32%|██████████████▍                              | 72/224 [00:36<01:16,  2.00it/s]
Epoch 11 Iter 73: loss 0.16944. :  32%|██████████████▍                              | 72/224 [00:36<01:16,  2.00it/s]
Epoch 11 Iter 73: loss 0.16944. :  33%|██████████████▋                              | 73/224 [00:36<01:15,  2.01it/s]
Epoch 11 Iter 74: loss 0.18084. :  33%|██████████████▋                              | 73/224 [00:37<01:15,  2.01it/s]
Epoch 11 Iter 74: loss 0.18084. :  33%|██████████████▊                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 11 Iter 75: loss 0.17488. :  33%|██████████████▊                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 11 Iter 75: loss 0.17488. :  33%|███████████████                              | 75/224 [00:37<01:14,  2.01it/s]
Epoch 11 Iter 76: loss 0.18467. :  33%|███████████████                              | 75/224 [00:38<01:14,  2.01it/s]
Epoch 11 Iter 76: loss 0.18467. :  34%|███████████████▎                             | 76/224 [00:38<01:13,  2.02it/s]
Epoch 11 Iter 77: loss 0.17745. :  34%|███████████████▎                             | 76/224 [00:38<01:13,  2.02it/s]
Epoch 11 Iter 77: loss 0.17745. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 11 Iter 78: loss 0.17725. :  34%|███████████████▍                             | 77/224 [00:39<01:13,  2.01it/s]
Epoch 11 Iter 78: loss 0.17725. :  35%|███████████████▋                             | 78/224 [00:39<01:12,  2.01it/s]
Epoch 11 Iter 79: loss 0.17316. :  35%|███████████████▋                             | 78/224 [00:39<01:12,  2.01it/s]
Epoch 11 Iter 79: loss 0.17316. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.01it/s]
Epoch 11 Iter 80: loss 0.16141. :  35%|███████████████▊                             | 79/224 [00:40<01:12,  2.01it/s]
Epoch 11 Iter 80: loss 0.16141. :  36%|████████████████                             | 80/224 [00:40<01:12,  1.98it/s]
Epoch 11 Iter 81: loss 0.17282. :  36%|████████████████                             | 80/224 [00:40<01:12,  1.98it/s]
Epoch 11 Iter 81: loss 0.17282. :  36%|████████████████▎                            | 81/224 [00:40<01:11,  1.99it/s]
Epoch 11 Iter 82: loss 0.15486. :  36%|████████████████▎                            | 81/224 [00:41<01:11,  1.99it/s]
Epoch 11 Iter 82: loss 0.15486. :  37%|████████████████▍                            | 82/224 [00:41<01:11,  1.99it/s]
Epoch 11 Iter 83: loss 0.18256. :  37%|████████████████▍                            | 82/224 [00:41<01:11,  1.99it/s]
Epoch 11 Iter 83: loss 0.18256. :  37%|████████████████▋                            | 83/224 [00:41<01:10,  2.00it/s]
Epoch 11 Iter 84: loss 0.20512. :  37%|████████████████▋                            | 83/224 [00:42<01:10,  2.00it/s]
Epoch 11 Iter 84: loss 0.20512. :  38%|████████████████▉                            | 84/224 [00:42<01:10,  1.99it/s]
Epoch 11 Iter 85: loss 0.17290. :  38%|████████████████▉                            | 84/224 [00:42<01:10,  1.99it/s]
Epoch 11 Iter 85: loss 0.17290. :  38%|█████████████████                            | 85/224 [00:42<01:09,  2.01it/s]
Epoch 11 Iter 86: loss 0.17327. :  38%|█████████████████                            | 85/224 [00:43<01:09,  2.01it/s]
Epoch 11 Iter 86: loss 0.17327. :  38%|█████████████████▎                           | 86/224 [00:43<01:08,  2.00it/s]
Epoch 11 Iter 87: loss 0.15635. :  38%|█████████████████▎                           | 86/224 [00:43<01:08,  2.00it/s]
Epoch 11 Iter 87: loss 0.15635. :  39%|█████████████████▍                           | 87/224 [00:43<01:08,  2.00it/s]
Epoch 11 Iter 88: loss 0.16611. :  39%|█████████████████▍                           | 87/224 [00:44<01:08,  2.00it/s]
Epoch 11 Iter 88: loss 0.16611. :  39%|█████████████████▋                           | 88/224 [00:44<01:07,  2.00it/s]
Epoch 11 Iter 89: loss 0.17076. :  39%|█████████████████▋                           | 88/224 [00:44<01:07,  2.00it/s]
Epoch 11 Iter 89: loss 0.17076. :  40%|█████████████████▉                           | 89/224 [00:44<01:07,  2.00it/s]
Epoch 11 Iter 90: loss 0.17827. :  40%|█████████████████▉                           | 89/224 [00:45<01:07,  2.00it/s]
Epoch 11 Iter 90: loss 0.17827. :  40%|██████████████████                           | 90/224 [00:45<01:06,  2.00it/s]
Epoch 11 Iter 91: loss 0.18634. :  40%|██████████████████                           | 90/224 [00:45<01:06,  2.00it/s]
Epoch 11 Iter 91: loss 0.18634. :  41%|██████████████████▎                          | 91/224 [00:45<01:06,  2.01it/s]
Epoch 11 Iter 92: loss 0.16996. :  41%|██████████████████▎                          | 91/224 [00:46<01:06,  2.01it/s]
Epoch 11 Iter 92: loss 0.16996. :  41%|██████████████████▍                          | 92/224 [00:46<01:05,  2.02it/s]
Epoch 11 Iter 93: loss 0.17052. :  41%|██████████████████▍                          | 92/224 [00:46<01:05,  2.02it/s]
Epoch 11 Iter 93: loss 0.17052. :  42%|██████████████████▋                          | 93/224 [00:46<01:05,  2.00it/s]
Epoch 11 Iter 94: loss 0.18258. :  42%|██████████████████▋                          | 93/224 [00:47<01:05,  2.00it/s]
Epoch 11 Iter 94: loss 0.18258. :  42%|██████████████████▉                          | 94/224 [00:47<01:04,  2.01it/s]
Epoch 11 Iter 95: loss 0.18445. :  42%|██████████████████▉                          | 94/224 [00:47<01:04,  2.01it/s]
Epoch 11 Iter 95: loss 0.18445. :  42%|███████████████████                          | 95/224 [00:47<01:04,  1.99it/s]
Epoch 11 Iter 96: loss 0.16899. :  42%|███████████████████                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 11 Iter 96: loss 0.16899. :  43%|███████████████████▎                         | 96/224 [00:48<01:04,  2.00it/s]
Epoch 11 Iter 97: loss 0.15942. :  43%|███████████████████▎                         | 96/224 [00:48<01:04,  2.00it/s]
Epoch 11 Iter 97: loss 0.15942. :  43%|███████████████████▍                         | 97/224 [00:48<01:03,  2.00it/s]
Epoch 11 Iter 98: loss 0.19482. :  43%|███████████████████▍                         | 97/224 [00:49<01:03,  2.00it/s]
Epoch 11 Iter 98: loss 0.19482. :  44%|███████████████████▋                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 11 Iter 99: loss 0.15216. :  44%|███████████████████▋                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 11 Iter 99: loss 0.15216. :  44%|███████████████████▉                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 11 Iter 100: loss 0.17548. :  44%|███████████████████▍                        | 99/224 [00:50<01:02,  2.01it/s]
Epoch 11 Iter 100: loss 0.17548. :  45%|███████████████████▏                       | 100/224 [00:50<01:01,  2.00it/s]
Epoch 11 Iter 101: loss 0.15055. :  45%|███████████████████▏                       | 100/224 [00:50<01:01,  2.00it/s]
Epoch 11 Iter 101: loss 0.15055. :  45%|███████████████████▍                       | 101/224 [00:50<01:01,  2.01it/s]
Epoch 11 Iter 102: loss 0.15197. :  45%|███████████████████▍                       | 101/224 [00:51<01:01,  2.01it/s]
Epoch 11 Iter 102: loss 0.15197. :  46%|███████████████████▌                       | 102/224 [00:51<01:00,  2.01it/s]
Epoch 11 Iter 103: loss 0.18302. :  46%|███████████████████▌                       | 102/224 [00:51<01:00,  2.01it/s]
Epoch 11 Iter 103: loss 0.18302. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.03it/s]
Epoch 11 Iter 104: loss 0.15726. :  46%|███████████████████▊                       | 103/224 [00:52<00:59,  2.03it/s]
Epoch 11 Iter 104: loss 0.15726. :  46%|███████████████████▉                       | 104/224 [00:52<00:59,  2.03it/s]
Epoch 11 Iter 105: loss 0.19285. :  46%|███████████████████▉                       | 104/224 [00:52<00:59,  2.03it/s]
Epoch 11 Iter 105: loss 0.19285. :  47%|████████████████████▏                      | 105/224 [00:52<00:58,  2.02it/s]
Epoch 11 Iter 106: loss 0.17947. :  47%|████████████████████▏                      | 105/224 [00:53<00:58,  2.02it/s]
Epoch 11 Iter 106: loss 0.17947. :  47%|████████████████████▎                      | 106/224 [00:53<00:58,  2.02it/s]
Epoch 11 Iter 107: loss 0.17172. :  47%|████████████████████▎                      | 106/224 [00:53<00:58,  2.02it/s]
Epoch 11 Iter 107: loss 0.17172. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.02it/s]
Epoch 11 Iter 108: loss 0.18069. :  48%|████████████████████▌                      | 107/224 [00:54<00:57,  2.02it/s]
Epoch 11 Iter 108: loss 0.18069. :  48%|████████████████████▋                      | 108/224 [00:54<00:57,  2.03it/s]
Epoch 11 Iter 109: loss 0.19193. :  48%|████████████████████▋                      | 108/224 [00:54<00:57,  2.03it/s]
Epoch 11 Iter 109: loss 0.19193. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 11 Iter 110: loss 0.16945. :  49%|████████████████████▉                      | 109/224 [00:55<00:56,  2.03it/s]
Epoch 11 Iter 110: loss 0.16945. :  49%|█████████████████████                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 11 Iter 111: loss 0.17822. :  49%|█████████████████████                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 11 Iter 111: loss 0.17822. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 11 Iter 112: loss 0.15704. :  50%|█████████████████████▎                     | 111/224 [00:56<00:55,  2.03it/s]
Epoch 11 Iter 112: loss 0.15704. :  50%|█████████████████████▌                     | 112/224 [00:56<00:54,  2.04it/s]
Epoch 11 Iter 113: loss 0.18550. :  50%|█████████████████████▌                     | 112/224 [00:56<00:54,  2.04it/s]
Epoch 11 Iter 113: loss 0.18550. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.04it/s]
Epoch 11 Iter 114: loss 0.18216. :  50%|█████████████████████▋                     | 113/224 [00:57<00:54,  2.04it/s]
Epoch 11 Iter 114: loss 0.18216. :  51%|█████████████████████▉                     | 114/224 [00:57<00:53,  2.04it/s]
Epoch 11 Iter 115: loss 0.17445. :  51%|█████████████████████▉                     | 114/224 [00:57<00:53,  2.04it/s]
Epoch 11 Iter 115: loss 0.17445. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.03it/s]
Epoch 11 Iter 116: loss 0.18327. :  51%|██████████████████████                     | 115/224 [00:58<00:53,  2.03it/s]
Epoch 11 Iter 116: loss 0.18327. :  52%|██████████████████████▎                    | 116/224 [00:58<00:52,  2.04it/s]
Epoch 11 Iter 117: loss 0.19098. :  52%|██████████████████████▎                    | 116/224 [00:58<00:52,  2.04it/s]
Epoch 11 Iter 117: loss 0.19098. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.04it/s]
Epoch 11 Iter 118: loss 0.17969. :  52%|██████████████████████▍                    | 117/224 [00:59<00:52,  2.04it/s]
Epoch 11 Iter 118: loss 0.17969. :  53%|██████████████████████▋                    | 118/224 [00:59<00:52,  2.03it/s]
Epoch 11 Iter 119: loss 0.16402. :  53%|██████████████████████▋                    | 118/224 [00:59<00:52,  2.03it/s]
Epoch 11 Iter 119: loss 0.16402. :  53%|██████████████████████▊                    | 119/224 [00:59<00:51,  2.03it/s]
Epoch 11 Iter 120: loss 0.19215. :  53%|██████████████████████▊                    | 119/224 [01:00<00:51,  2.03it/s]
Epoch 11 Iter 120: loss 0.19215. :  54%|███████████████████████                    | 120/224 [01:00<00:51,  2.04it/s]
Epoch 11 Iter 121: loss 0.17662. :  54%|███████████████████████                    | 120/224 [01:00<00:51,  2.04it/s]
Epoch 11 Iter 121: loss 0.17662. :  54%|███████████████████████▏                   | 121/224 [01:00<00:50,  2.05it/s]
Epoch 11 Iter 122: loss 0.17851. :  54%|███████████████████████▏                   | 121/224 [01:01<00:50,  2.05it/s]
Epoch 11 Iter 122: loss 0.17851. :  54%|███████████████████████▍                   | 122/224 [01:01<00:49,  2.04it/s]
Epoch 11 Iter 123: loss 0.14863. :  54%|███████████████████████▍                   | 122/224 [01:01<00:49,  2.04it/s]
Epoch 11 Iter 123: loss 0.14863. :  55%|███████████████████████▌                   | 123/224 [01:01<00:49,  2.03it/s]
Epoch 11 Iter 124: loss 0.16991. :  55%|███████████████████████▌                   | 123/224 [01:02<00:49,  2.03it/s]
Epoch 11 Iter 124: loss 0.16991. :  55%|███████████████████████▊                   | 124/224 [01:02<00:49,  2.03it/s]
Epoch 11 Iter 125: loss 0.16411. :  55%|███████████████████████▊                   | 124/224 [01:02<00:49,  2.03it/s]
Epoch 11 Iter 125: loss 0.16411. :  56%|███████████████████████▉                   | 125/224 [01:02<00:48,  2.04it/s]
Epoch 11 Iter 126: loss 0.17399. :  56%|███████████████████████▉                   | 125/224 [01:03<00:48,  2.04it/s]
Epoch 11 Iter 126: loss 0.17399. :  56%|████████████████████████▏                  | 126/224 [01:03<00:48,  2.03it/s]
Epoch 11 Iter 127: loss 0.17351. :  56%|████████████████████████▏                  | 126/224 [01:03<00:48,  2.03it/s]
Epoch 11 Iter 127: loss 0.17351. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.03it/s]
Epoch 11 Iter 128: loss 0.17742. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.03it/s]
Epoch 11 Iter 128: loss 0.17742. :  57%|████████████████████████▌                  | 128/224 [01:03<00:47,  2.02it/s]
Epoch 11 Iter 129: loss 0.16144. :  57%|████████████████████████▌                  | 128/224 [01:04<00:47,  2.02it/s]
Epoch 11 Iter 129: loss 0.16144. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.03it/s]
Epoch 11 Iter 130: loss 0.17494. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.03it/s]
Epoch 11 Iter 130: loss 0.17494. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.03it/s]
Epoch 11 Iter 131: loss 0.14467. :  58%|████████████████████████▉                  | 130/224 [01:05<00:46,  2.03it/s]
Epoch 11 Iter 131: loss 0.14467. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:46,  2.02it/s]
Epoch 11 Iter 132: loss 0.17762. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:46,  2.02it/s]
Epoch 11 Iter 132: loss 0.17762. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.03it/s]
Epoch 11 Iter 133: loss 0.18915. :  59%|█████████████████████████▎                 | 132/224 [01:06<00:45,  2.03it/s]
Epoch 11 Iter 133: loss 0.18915. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 11 Iter 134: loss 0.17749. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 11 Iter 134: loss 0.17749. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:44,  2.02it/s]
Epoch 11 Iter 135: loss 0.17282. :  60%|█████████████████████████▋                 | 134/224 [01:07<00:44,  2.02it/s]
Epoch 11 Iter 135: loss 0.17282. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:44,  2.02it/s]
Epoch 11 Iter 136: loss 0.19620. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:44,  2.02it/s]
Epoch 11 Iter 136: loss 0.19620. :  61%|██████████████████████████                 | 136/224 [01:07<00:43,  2.01it/s]
Epoch 11 Iter 137: loss 0.15794. :  61%|██████████████████████████                 | 136/224 [01:08<00:43,  2.01it/s]
Epoch 11 Iter 137: loss 0.15794. :  61%|██████████████████████████▎                | 137/224 [01:08<00:42,  2.03it/s]
Epoch 11 Iter 138: loss 0.16440. :  61%|██████████████████████████▎                | 137/224 [01:08<00:42,  2.03it/s]
Epoch 11 Iter 138: loss 0.16440. :  62%|██████████████████████████▍                | 138/224 [01:08<00:42,  2.03it/s]
Epoch 11 Iter 139: loss 0.16662. :  62%|██████████████████████████▍                | 138/224 [01:09<00:42,  2.03it/s]
Epoch 11 Iter 139: loss 0.16662. :  62%|██████████████████████████▋                | 139/224 [01:09<00:42,  2.02it/s]
Epoch 11 Iter 140: loss 0.19034. :  62%|██████████████████████████▋                | 139/224 [01:09<00:42,  2.02it/s]
Epoch 11 Iter 140: loss 0.19034. :  62%|██████████████████████████▉                | 140/224 [01:09<00:41,  2.02it/s]
Epoch 11 Iter 141: loss 0.17499. :  62%|██████████████████████████▉                | 140/224 [01:10<00:41,  2.02it/s]
Epoch 11 Iter 141: loss 0.17499. :  63%|███████████████████████████                | 141/224 [01:10<00:41,  2.02it/s]
Epoch 11 Iter 142: loss 0.15446. :  63%|███████████████████████████                | 141/224 [01:10<00:41,  2.02it/s]
Epoch 11 Iter 142: loss 0.15446. :  63%|███████████████████████████▎               | 142/224 [01:10<00:40,  2.01it/s]
Epoch 11 Iter 143: loss 0.16389. :  63%|███████████████████████████▎               | 142/224 [01:11<00:40,  2.01it/s]
Epoch 11 Iter 143: loss 0.16389. :  64%|███████████████████████████▍               | 143/224 [01:11<00:40,  2.01it/s]
Epoch 11 Iter 144: loss 0.16037. :  64%|███████████████████████████▍               | 143/224 [01:11<00:40,  2.01it/s]
Epoch 11 Iter 144: loss 0.16037. :  64%|███████████████████████████▋               | 144/224 [01:11<00:39,  2.01it/s]
Epoch 11 Iter 145: loss 0.17500. :  64%|███████████████████████████▋               | 144/224 [01:12<00:39,  2.01it/s]
Epoch 11 Iter 145: loss 0.17500. :  65%|███████████████████████████▊               | 145/224 [01:12<00:39,  2.00it/s]
Epoch 11 Iter 146: loss 0.15424. :  65%|███████████████████████████▊               | 145/224 [01:12<00:39,  2.00it/s]
Epoch 11 Iter 146: loss 0.15424. :  65%|████████████████████████████               | 146/224 [01:12<00:38,  2.01it/s]
Epoch 11 Iter 147: loss 0.19837. :  65%|████████████████████████████               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 11 Iter 147: loss 0.19837. :  66%|████████████████████████████▏              | 147/224 [01:13<00:38,  2.01it/s]
Epoch 11 Iter 148: loss 0.17920. :  66%|████████████████████████████▏              | 147/224 [01:13<00:38,  2.01it/s]
Epoch 11 Iter 148: loss 0.17920. :  66%|████████████████████████████▍              | 148/224 [01:13<00:38,  1.99it/s]
Epoch 11 Iter 149: loss 0.16307. :  66%|████████████████████████████▍              | 148/224 [01:14<00:38,  1.99it/s]
Epoch 11 Iter 149: loss 0.16307. :  67%|████████████████████████████▌              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 11 Iter 150: loss 0.17323. :  67%|████████████████████████████▌              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 11 Iter 150: loss 0.17323. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.02it/s]
Epoch 11 Iter 151: loss 0.17832. :  67%|████████████████████████████▊              | 150/224 [01:15<00:36,  2.02it/s]
Epoch 11 Iter 151: loss 0.17832. :  67%|████████████████████████████▉              | 151/224 [01:15<00:36,  2.02it/s]
Epoch 11 Iter 152: loss 0.15735. :  67%|████████████████████████████▉              | 151/224 [01:15<00:36,  2.02it/s]
Epoch 11 Iter 152: loss 0.15735. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:35,  2.03it/s]
Epoch 11 Iter 153: loss 0.17593. :  68%|█████████████████████████████▏             | 152/224 [01:16<00:35,  2.03it/s]
Epoch 11 Iter 153: loss 0.17593. :  68%|█████████████████████████████▎             | 153/224 [01:16<00:35,  2.03it/s]
Epoch 11 Iter 154: loss 0.18582. :  68%|█████████████████████████████▎             | 153/224 [01:16<00:35,  2.03it/s]
Epoch 11 Iter 154: loss 0.18582. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:34,  2.03it/s]
Epoch 11 Iter 155: loss 0.17769. :  69%|█████████████████████████████▌             | 154/224 [01:17<00:34,  2.03it/s]
Epoch 11 Iter 155: loss 0.17769. :  69%|█████████████████████████████▊             | 155/224 [01:17<00:34,  1.99it/s]
Epoch 11 Iter 156: loss 0.16370. :  69%|█████████████████████████████▊             | 155/224 [01:17<00:34,  1.99it/s]
Epoch 11 Iter 156: loss 0.16370. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:33,  2.01it/s]
Epoch 11 Iter 157: loss 0.16788. :  70%|█████████████████████████████▉             | 156/224 [01:18<00:33,  2.01it/s]
Epoch 11 Iter 157: loss 0.16788. :  70%|██████████████████████████████▏            | 157/224 [01:18<00:33,  2.01it/s]
Epoch 11 Iter 158: loss 0.16818. :  70%|██████████████████████████████▏            | 157/224 [01:18<00:33,  2.01it/s]
Epoch 11 Iter 158: loss 0.16818. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:32,  2.03it/s]
Epoch 11 Iter 159: loss 0.14790. :  71%|██████████████████████████████▎            | 158/224 [01:19<00:32,  2.03it/s]
Epoch 11 Iter 159: loss 0.14790. :  71%|██████████████████████████████▌            | 159/224 [01:19<00:32,  2.02it/s]
Epoch 11 Iter 160: loss 0.18245. :  71%|██████████████████████████████▌            | 159/224 [01:19<00:32,  2.02it/s]
Epoch 11 Iter 160: loss 0.18245. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.03it/s]
Epoch 11 Iter 161: loss 0.16678. :  71%|██████████████████████████████▋            | 160/224 [01:20<00:31,  2.03it/s]
Epoch 11 Iter 161: loss 0.16678. :  72%|██████████████████████████████▉            | 161/224 [01:20<00:31,  2.02it/s]
Epoch 11 Iter 162: loss 0.17322. :  72%|██████████████████████████████▉            | 161/224 [01:20<00:31,  2.02it/s]
Epoch 11 Iter 162: loss 0.17322. :  72%|███████████████████████████████            | 162/224 [01:20<00:30,  2.02it/s]
Epoch 11 Iter 163: loss 0.16172. :  72%|███████████████████████████████            | 162/224 [01:21<00:30,  2.02it/s]
Epoch 11 Iter 163: loss 0.16172. :  73%|███████████████████████████████▎           | 163/224 [01:21<00:30,  2.02it/s]
Epoch 11 Iter 164: loss 0.18550. :  73%|███████████████████████████████▎           | 163/224 [01:21<00:30,  2.02it/s]
Epoch 11 Iter 164: loss 0.18550. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:29,  2.02it/s]
Epoch 11 Iter 165: loss 0.18410. :  73%|███████████████████████████████▍           | 164/224 [01:22<00:29,  2.02it/s]
Epoch 11 Iter 165: loss 0.18410. :  74%|███████████████████████████████▋           | 165/224 [01:22<00:29,  2.01it/s]
Epoch 11 Iter 166: loss 0.15311. :  74%|███████████████████████████████▋           | 165/224 [01:22<00:29,  2.01it/s]
Epoch 11 Iter 166: loss 0.15311. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.01it/s]
Epoch 11 Iter 167: loss 0.18584. :  74%|███████████████████████████████▊           | 166/224 [01:23<00:28,  2.01it/s]
Epoch 11 Iter 167: loss 0.18584. :  75%|████████████████████████████████           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 11 Iter 168: loss 0.15900. :  75%|████████████████████████████████           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 11 Iter 168: loss 0.15900. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.01it/s]
Epoch 11 Iter 169: loss 0.17227. :  75%|████████████████████████████████▎          | 168/224 [01:24<00:27,  2.01it/s]
Epoch 11 Iter 169: loss 0.17227. :  75%|████████████████████████████████▍          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 11 Iter 170: loss 0.16597. :  75%|████████████████████████████████▍          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 11 Iter 170: loss 0.16597. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.02it/s]
Epoch 11 Iter 171: loss 0.16866. :  76%|████████████████████████████████▋          | 170/224 [01:25<00:26,  2.02it/s]
Epoch 11 Iter 171: loss 0.16866. :  76%|████████████████████████████████▊          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 11 Iter 172: loss 0.17126. :  76%|████████████████████████████████▊          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 11 Iter 172: loss 0.17126. :  77%|█████████████████████████████████          | 172/224 [01:25<00:25,  2.02it/s]
Epoch 11 Iter 173: loss 0.16520. :  77%|█████████████████████████████████          | 172/224 [01:26<00:25,  2.02it/s]
Epoch 11 Iter 173: loss 0.16520. :  77%|█████████████████████████████████▏         | 173/224 [01:26<00:25,  2.02it/s]
Epoch 11 Iter 174: loss 0.17263. :  77%|█████████████████████████████████▏         | 173/224 [01:26<00:25,  2.02it/s]
Epoch 11 Iter 174: loss 0.17263. :  78%|█████████████████████████████████▍         | 174/224 [01:26<00:24,  2.02it/s]
Epoch 11 Iter 175: loss 0.15541. :  78%|█████████████████████████████████▍         | 174/224 [01:27<00:24,  2.02it/s]
Epoch 11 Iter 175: loss 0.15541. :  78%|█████████████████████████████████▌         | 175/224 [01:27<00:24,  2.03it/s]
Epoch 11 Iter 176: loss 0.14861. :  78%|█████████████████████████████████▌         | 175/224 [01:27<00:24,  2.03it/s]
Epoch 11 Iter 176: loss 0.14861. :  79%|█████████████████████████████████▊         | 176/224 [01:27<00:23,  2.03it/s]
Epoch 11 Iter 177: loss 0.17487. :  79%|█████████████████████████████████▊         | 176/224 [01:28<00:23,  2.03it/s]
Epoch 11 Iter 177: loss 0.17487. :  79%|█████████████████████████████████▉         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 11 Iter 178: loss 0.17979. :  79%|█████████████████████████████████▉         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 11 Iter 178: loss 0.17979. :  79%|██████████████████████████████████▏        | 178/224 [01:28<00:22,  2.02it/s]
Epoch 11 Iter 179: loss 0.18461. :  79%|██████████████████████████████████▏        | 178/224 [01:29<00:22,  2.02it/s]
Epoch 11 Iter 179: loss 0.18461. :  80%|██████████████████████████████████▎        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 11 Iter 180: loss 0.15739. :  80%|██████████████████████████████████▎        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 11 Iter 180: loss 0.15739. :  80%|██████████████████████████████████▌        | 180/224 [01:29<00:21,  2.01it/s]
Epoch 11 Iter 181: loss 0.16584. :  80%|██████████████████████████████████▌        | 180/224 [01:30<00:21,  2.01it/s]
Epoch 11 Iter 181: loss 0.16584. :  81%|██████████████████████████████████▋        | 181/224 [01:30<00:21,  2.01it/s]
Epoch 11 Iter 182: loss 0.16353. :  81%|██████████████████████████████████▋        | 181/224 [01:30<00:21,  2.01it/s]
Epoch 11 Iter 182: loss 0.16353. :  81%|██████████████████████████████████▉        | 182/224 [01:30<00:20,  2.02it/s]
Epoch 11 Iter 183: loss 0.18060. :  81%|██████████████████████████████████▉        | 182/224 [01:31<00:20,  2.02it/s]
Epoch 11 Iter 183: loss 0.18060. :  82%|███████████████████████████████████▏       | 183/224 [01:31<00:20,  2.00it/s]
Epoch 11 Iter 184: loss 0.17226. :  82%|███████████████████████████████████▏       | 183/224 [01:31<00:20,  2.00it/s]
Epoch 11 Iter 184: loss 0.17226. :  82%|███████████████████████████████████▎       | 184/224 [01:31<00:19,  2.00it/s]
Epoch 11 Iter 185: loss 0.16585. :  82%|███████████████████████████████████▎       | 184/224 [01:32<00:19,  2.00it/s]
Epoch 11 Iter 185: loss 0.16585. :  83%|███████████████████████████████████▌       | 185/224 [01:32<00:19,  2.01it/s]
Epoch 11 Iter 186: loss 0.16998. :  83%|███████████████████████████████████▌       | 185/224 [01:32<00:19,  2.01it/s]
Epoch 11 Iter 186: loss 0.16998. :  83%|███████████████████████████████████▋       | 186/224 [01:32<00:19,  1.99it/s]
Epoch 11 Iter 187: loss 0.18424. :  83%|███████████████████████████████████▋       | 186/224 [01:33<00:19,  1.99it/s]
Epoch 11 Iter 187: loss 0.18424. :  83%|███████████████████████████████████▉       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 11 Iter 188: loss 0.17372. :  83%|███████████████████████████████████▉       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 11 Iter 188: loss 0.17372. :  84%|████████████████████████████████████       | 188/224 [01:33<00:17,  2.01it/s]
Epoch 11 Iter 189: loss 0.17264. :  84%|████████████████████████████████████       | 188/224 [01:34<00:17,  2.01it/s]
Epoch 11 Iter 189: loss 0.17264. :  84%|████████████████████████████████████▎      | 189/224 [01:34<00:17,  1.99it/s]
Epoch 11 Iter 190: loss 0.18481. :  84%|████████████████████████████████████▎      | 189/224 [01:34<00:17,  1.99it/s]
Epoch 11 Iter 190: loss 0.18481. :  85%|████████████████████████████████████▍      | 190/224 [01:34<00:16,  2.00it/s]
Epoch 11 Iter 191: loss 0.16553. :  85%|████████████████████████████████████▍      | 190/224 [01:35<00:16,  2.00it/s]
Epoch 11 Iter 191: loss 0.16553. :  85%|████████████████████████████████████▋      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 11 Iter 192: loss 0.19226. :  85%|████████████████████████████████████▋      | 191/224 [01:35<00:16,  1.99it/s]
Epoch 11 Iter 192: loss 0.19226. :  86%|████████████████████████████████████▊      | 192/224 [01:35<00:16,  1.98it/s]
Epoch 11 Iter 193: loss 0.16277. :  86%|████████████████████████████████████▊      | 192/224 [01:36<00:16,  1.98it/s]
Epoch 11 Iter 193: loss 0.16277. :  86%|█████████████████████████████████████      | 193/224 [01:36<00:15,  1.97it/s]
Epoch 11 Iter 194: loss 0.15203. :  86%|█████████████████████████████████████      | 193/224 [01:36<00:15,  1.97it/s]
Epoch 11 Iter 194: loss 0.15203. :  87%|█████████████████████████████████████▏     | 194/224 [01:36<00:15,  1.91it/s]
Epoch 11 Iter 195: loss 0.15932. :  87%|█████████████████████████████████████▏     | 194/224 [01:37<00:15,  1.91it/s]
Epoch 11 Iter 195: loss 0.15932. :  87%|█████████████████████████████████████▍     | 195/224 [01:37<00:15,  1.89it/s]
Epoch 11 Iter 196: loss 0.16576. :  87%|█████████████████████████████████████▍     | 195/224 [01:37<00:15,  1.89it/s]
Epoch 11 Iter 196: loss 0.16576. :  88%|█████████████████████████████████████▋     | 196/224 [01:37<00:14,  1.89it/s]
Epoch 11 Iter 197: loss 0.17756. :  88%|█████████████████████████████████████▋     | 196/224 [01:38<00:14,  1.89it/s]
Epoch 11 Iter 197: loss 0.17756. :  88%|█████████████████████████████████████▊     | 197/224 [01:38<00:13,  1.93it/s]
Epoch 11 Iter 198: loss 0.18169. :  88%|█████████████████████████████████████▊     | 197/224 [01:38<00:13,  1.93it/s]
Epoch 11 Iter 198: loss 0.18169. :  88%|██████████████████████████████████████     | 198/224 [01:38<00:13,  1.95it/s]
Epoch 11 Iter 199: loss 0.17508. :  88%|██████████████████████████████████████     | 198/224 [01:39<00:13,  1.95it/s]
Epoch 11 Iter 199: loss 0.17508. :  89%|██████████████████████████████████████▏    | 199/224 [01:39<00:12,  1.97it/s]
Epoch 11 Iter 200: loss 0.16517. :  89%|██████████████████████████████████████▏    | 199/224 [01:39<00:12,  1.97it/s]
Epoch 11 Iter 200: loss 0.16517. :  89%|██████████████████████████████████████▍    | 200/224 [01:39<00:12,  1.98it/s]
Epoch 11 Iter 201: loss 0.18115. :  89%|██████████████████████████████████████▍    | 200/224 [01:40<00:12,  1.98it/s]
Epoch 11 Iter 201: loss 0.18115. :  90%|██████████████████████████████████████▌    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 11 Iter 202: loss 0.16977. :  90%|██████████████████████████████████████▌    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 11 Iter 202: loss 0.16977. :  90%|██████████████████████████████████████▊    | 202/224 [01:40<00:11,  1.99it/s]
Epoch 11 Iter 203: loss 0.16979. :  90%|██████████████████████████████████████▊    | 202/224 [01:41<00:11,  1.99it/s]
Epoch 11 Iter 203: loss 0.16979. :  91%|██████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.96it/s]
Epoch 11 Iter 204: loss 0.16097. :  91%|██████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.96it/s]
Epoch 11 Iter 204: loss 0.16097. :  91%|███████████████████████████████████████▏   | 204/224 [01:41<00:10,  1.97it/s]
Epoch 11 Iter 205: loss 0.16967. :  91%|███████████████████████████████████████▏   | 204/224 [01:42<00:10,  1.97it/s]
Epoch 11 Iter 205: loss 0.16967. :  92%|███████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.96it/s]
Epoch 11 Iter 206: loss 0.16211. :  92%|███████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.96it/s]
Epoch 11 Iter 206: loss 0.16211. :  92%|███████████████████████████████████████▌   | 206/224 [01:42<00:09,  1.98it/s]
Epoch 11 Iter 207: loss 0.17262. :  92%|███████████████████████████████████████▌   | 206/224 [01:43<00:09,  1.98it/s]
Epoch 11 Iter 207: loss 0.17262. :  92%|███████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.99it/s]
Epoch 11 Iter 208: loss 0.15823. :  92%|███████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.99it/s]
Epoch 11 Iter 208: loss 0.15823. :  93%|███████████████████████████████████████▉   | 208/224 [01:43<00:08,  1.99it/s]
Epoch 11 Iter 209: loss 0.16910. :  93%|███████████████████████████████████████▉   | 208/224 [01:44<00:08,  1.99it/s]
Epoch 11 Iter 209: loss 0.16910. :  93%|████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 11 Iter 210: loss 0.16544. :  93%|████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 11 Iter 210: loss 0.16544. :  94%|████████████████████████████████████████▎  | 210/224 [01:44<00:07,  1.99it/s]
Epoch 11 Iter 211: loss 0.16916. :  94%|████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.99it/s]
Epoch 11 Iter 211: loss 0.16916. :  94%|████████████████████████████████████████▌  | 211/224 [01:45<00:06,  1.97it/s]
Epoch 11 Iter 212: loss 0.15609. :  94%|████████████████████████████████████████▌  | 211/224 [01:45<00:06,  1.97it/s]
Epoch 11 Iter 212: loss 0.15609. :  95%|████████████████████████████████████████▋  | 212/224 [01:45<00:06,  1.97it/s]
Epoch 11 Iter 213: loss 0.17396. :  95%|████████████████████████████████████████▋  | 212/224 [01:46<00:06,  1.97it/s]
Epoch 11 Iter 213: loss 0.17396. :  95%|████████████████████████████████████████▉  | 213/224 [01:46<00:05,  1.98it/s]
Epoch 11 Iter 214: loss 0.19640. :  95%|████████████████████████████████████████▉  | 213/224 [01:46<00:05,  1.98it/s]
Epoch 11 Iter 214: loss 0.19640. :  96%|█████████████████████████████████████████  | 214/224 [01:46<00:05,  1.98it/s]
Epoch 11 Iter 215: loss 0.15729. :  96%|█████████████████████████████████████████  | 214/224 [01:47<00:05,  1.98it/s]
Epoch 11 Iter 215: loss 0.15729. :  96%|█████████████████████████████████████████▎ | 215/224 [01:47<00:04,  1.99it/s]
Epoch 11 Iter 216: loss 0.15234. :  96%|█████████████████████████████████████████▎ | 215/224 [01:47<00:04,  1.99it/s]
Epoch 11 Iter 216: loss 0.15234. :  96%|█████████████████████████████████████████▍ | 216/224 [01:47<00:04,  2.00it/s]
Epoch 11 Iter 217: loss 0.17731. :  96%|█████████████████████████████████████████▍ | 216/224 [01:48<00:04,  2.00it/s]
Epoch 11 Iter 217: loss 0.17731. :  97%|█████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 11 Iter 218: loss 0.16159. :  97%|█████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.00it/s]
Epoch 11 Iter 218: loss 0.16159. :  97%|█████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.95it/s]
Epoch 11 Iter 219: loss 0.15564. :  97%|█████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.95it/s]
Epoch 11 Iter 219: loss 0.15564. :  98%|██████████████████████████████████████████ | 219/224 [01:49<00:02,  1.96it/s]
Epoch 11 Iter 220: loss 0.17987. :  98%|██████████████████████████████████████████ | 219/224 [01:50<00:02,  1.96it/s]
Epoch 11 Iter 220: loss 0.17987. :  98%|██████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.98it/s]
Epoch 11 Iter 221: loss 0.17339. :  98%|██████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.98it/s]
Epoch 11 Iter 221: loss 0.17339. :  99%|██████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.99it/s]
Epoch 11 Iter 222: loss 0.15807. :  99%|██████████████████████████████████████████▍| 221/224 [01:51<00:01,  1.99it/s]
Epoch 11 Iter 222: loss 0.15807. :  99%|██████████████████████████████████████████▌| 222/224 [01:51<00:01,  2.00it/s]
Epoch 11 Iter 223: loss 0.15346. :  99%|██████████████████████████████████████████▌| 222/224 [01:51<00:01,  2.00it/s]
Epoch 11 Iter 223: loss 0.15346. : 100%|██████████████████████████████████████████▊| 223/224 [01:51<00:00,  1.99it/s]
Epoch 11 Iter 224: loss 0.16995. : 100%|██████████████████████████████████████████▊| 223/224 [01:52<00:00,  1.99it/s]
Epoch 11 Iter 224: loss 0.16995. : 100%|███████████████████████████████████████████| 224/224 [01:52<00:00,  2.00it/s]
Epoch 11 Iter 224: loss 0.16995. : 100%|███████████████████████████████████████████| 224/224 [01:52<00:00,  2.00it/s]

    Train loss: 0.17056
    Valid loss: 0.17343
       Valid loss recons: 0.17343
       Valid loss KL-D:   23499.49814
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.15309. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.15309. :   0%|▏                                              | 1/224 [00:00<01:53,  1.97it/s]
Epoch 12 Iter 2: loss 0.15971. :   0%|▏                                              | 1/224 [00:01<01:53,  1.97it/s]
Epoch 12 Iter 2: loss 0.15971. :   1%|▍                                              | 2/224 [00:01<01:51,  1.98it/s]
Epoch 12 Iter 3: loss 0.17901. :   1%|▍                                              | 2/224 [00:01<01:51,  1.98it/s]
Epoch 12 Iter 3: loss 0.17901. :   1%|▋                                              | 3/224 [00:01<01:50,  2.00it/s]
Epoch 12 Iter 4: loss 0.18437. :   1%|▋                                              | 3/224 [00:02<01:50,  2.00it/s]
Epoch 12 Iter 4: loss 0.18437. :   2%|▊                                              | 4/224 [00:02<01:50,  1.99it/s]
Epoch 12 Iter 5: loss 0.16263. :   2%|▊                                              | 4/224 [00:02<01:50,  1.99it/s]
Epoch 12 Iter 5: loss 0.16263. :   2%|█                                              | 5/224 [00:02<01:53,  1.93it/s]
Epoch 12 Iter 6: loss 0.16057. :   2%|█                                              | 5/224 [00:03<01:53,  1.93it/s]
Epoch 12 Iter 6: loss 0.16057. :   3%|█▎                                             | 6/224 [00:03<01:54,  1.91it/s]
Epoch 12 Iter 7: loss 0.14522. :   3%|█▎                                             | 6/224 [00:03<01:54,  1.91it/s]
Epoch 12 Iter 7: loss 0.14522. :   3%|█▍                                             | 7/224 [00:03<01:56,  1.86it/s]
Epoch 12 Iter 8: loss 0.16774. :   3%|█▍                                             | 7/224 [00:04<01:56,  1.86it/s]
Epoch 12 Iter 8: loss 0.16774. :   4%|█▋                                             | 8/224 [00:04<01:57,  1.84it/s]
Epoch 12 Iter 9: loss 0.16834. :   4%|█▋                                             | 8/224 [00:04<01:57,  1.84it/s]
Epoch 12 Iter 9: loss 0.16834. :   4%|█▉                                             | 9/224 [00:04<01:55,  1.87it/s]
Epoch 12 Iter 10: loss 0.18607. :   4%|█▊                                            | 9/224 [00:05<01:55,  1.87it/s]
Epoch 12 Iter 10: loss 0.18607. :   4%|██                                           | 10/224 [00:05<01:54,  1.87it/s]
Epoch 12 Iter 11: loss 0.15498. :   4%|██                                           | 10/224 [00:05<01:54,  1.87it/s]
Epoch 12 Iter 11: loss 0.15498. :   5%|██▏                                          | 11/224 [00:05<01:52,  1.90it/s]
Epoch 12 Iter 12: loss 0.18965. :   5%|██▏                                          | 11/224 [00:06<01:52,  1.90it/s]
Epoch 12 Iter 12: loss 0.18965. :   5%|██▍                                          | 12/224 [00:06<01:49,  1.93it/s]
Epoch 12 Iter 13: loss 0.18023. :   5%|██▍                                          | 12/224 [00:06<01:49,  1.93it/s]
Epoch 12 Iter 13: loss 0.18023. :   6%|██▌                                          | 13/224 [00:06<01:49,  1.92it/s]
Epoch 12 Iter 14: loss 0.17661. :   6%|██▌                                          | 13/224 [00:07<01:49,  1.92it/s]
Epoch 12 Iter 14: loss 0.17661. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 12 Iter 15: loss 0.17637. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 12 Iter 15: loss 0.17637. :   7%|███                                          | 15/224 [00:07<01:46,  1.97it/s]
Epoch 12 Iter 16: loss 0.15502. :   7%|███                                          | 15/224 [00:08<01:46,  1.97it/s]
Epoch 12 Iter 16: loss 0.15502. :   7%|███▏                                         | 16/224 [00:08<01:45,  1.98it/s]
Epoch 12 Iter 17: loss 0.17929. :   7%|███▏                                         | 16/224 [00:08<01:45,  1.98it/s]
Epoch 12 Iter 17: loss 0.17929. :   8%|███▍                                         | 17/224 [00:08<01:44,  1.99it/s]
Epoch 12 Iter 18: loss 0.17186. :   8%|███▍                                         | 17/224 [00:09<01:44,  1.99it/s]
Epoch 12 Iter 18: loss 0.17186. :   8%|███▌                                         | 18/224 [00:09<01:44,  1.98it/s]
Epoch 12 Iter 19: loss 0.19933. :   8%|███▌                                         | 18/224 [00:09<01:44,  1.98it/s]
Epoch 12 Iter 19: loss 0.19933. :   8%|███▊                                         | 19/224 [00:09<01:45,  1.94it/s]
Epoch 12 Iter 20: loss 0.16005. :   8%|███▊                                         | 19/224 [00:10<01:45,  1.94it/s]
Epoch 12 Iter 20: loss 0.16005. :   9%|████                                         | 20/224 [00:10<01:45,  1.94it/s]
Epoch 12 Iter 21: loss 0.17475. :   9%|████                                         | 20/224 [00:10<01:45,  1.94it/s]
Epoch 12 Iter 21: loss 0.17475. :   9%|████▏                                        | 21/224 [00:10<01:44,  1.95it/s]
Epoch 12 Iter 22: loss 0.18543. :   9%|████▏                                        | 21/224 [00:11<01:44,  1.95it/s]
Epoch 12 Iter 22: loss 0.18543. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.94it/s]
Epoch 12 Iter 23: loss 0.16289. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.94it/s]
Epoch 12 Iter 23: loss 0.16289. :  10%|████▌                                        | 23/224 [00:11<01:42,  1.96it/s]
Epoch 12 Iter 24: loss 0.16281. :  10%|████▌                                        | 23/224 [00:12<01:42,  1.96it/s]
Epoch 12 Iter 24: loss 0.16281. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.98it/s]
Epoch 12 Iter 25: loss 0.15823. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.98it/s]
Epoch 12 Iter 25: loss 0.15823. :  11%|█████                                        | 25/224 [00:12<01:40,  1.99it/s]
Epoch 12 Iter 26: loss 0.16868. :  11%|█████                                        | 25/224 [00:13<01:40,  1.99it/s]
Epoch 12 Iter 26: loss 0.16868. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.01it/s]
Epoch 12 Iter 27: loss 0.16280. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.01it/s]
Epoch 12 Iter 27: loss 0.16280. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.01it/s]
Epoch 12 Iter 28: loss 0.15053. :  12%|█████▍                                       | 27/224 [00:14<01:37,  2.01it/s]
Epoch 12 Iter 28: loss 0.15053. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.02it/s]
Epoch 12 Iter 29: loss 0.15593. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.02it/s]
Epoch 12 Iter 29: loss 0.15593. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.02it/s]
Epoch 12 Iter 30: loss 0.16770. :  13%|█████▊                                       | 29/224 [00:15<01:36,  2.02it/s]
Epoch 12 Iter 30: loss 0.16770. :  13%|██████                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 12 Iter 31: loss 0.17222. :  13%|██████                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 12 Iter 31: loss 0.17222. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.02it/s]
Epoch 12 Iter 32: loss 0.17602. :  14%|██████▏                                      | 31/224 [00:16<01:35,  2.02it/s]
Epoch 12 Iter 32: loss 0.17602. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.03it/s]
Epoch 12 Iter 33: loss 0.15212. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.03it/s]
Epoch 12 Iter 33: loss 0.15212. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.02it/s]
Epoch 12 Iter 34: loss 0.18744. :  15%|██████▋                                      | 33/224 [00:17<01:34,  2.02it/s]
Epoch 12 Iter 34: loss 0.18744. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.01it/s]
Epoch 12 Iter 35: loss 0.19168. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.01it/s]
Epoch 12 Iter 35: loss 0.19168. :  16%|███████                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 12 Iter 36: loss 0.19764. :  16%|███████                                      | 35/224 [00:18<01:34,  2.00it/s]
Epoch 12 Iter 36: loss 0.19764. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.01it/s]
Epoch 12 Iter 37: loss 0.16547. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.01it/s]
Epoch 12 Iter 37: loss 0.16547. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.01it/s]
Epoch 12 Iter 38: loss 0.17148. :  17%|███████▍                                     | 37/224 [00:19<01:33,  2.01it/s]
Epoch 12 Iter 38: loss 0.17148. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 12 Iter 39: loss 0.16150. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 12 Iter 39: loss 0.16150. :  17%|███████▊                                     | 39/224 [00:19<01:32,  2.00it/s]
Epoch 12 Iter 40: loss 0.18751. :  17%|███████▊                                     | 39/224 [00:20<01:32,  2.00it/s]
Epoch 12 Iter 40: loss 0.18751. :  18%|████████                                     | 40/224 [00:20<01:31,  2.00it/s]
Epoch 12 Iter 41: loss 0.20079. :  18%|████████                                     | 40/224 [00:20<01:31,  2.00it/s]
Epoch 12 Iter 41: loss 0.20079. :  18%|████████▏                                    | 41/224 [00:20<01:31,  2.01it/s]
Epoch 12 Iter 42: loss 0.16236. :  18%|████████▏                                    | 41/224 [00:21<01:31,  2.01it/s]
Epoch 12 Iter 42: loss 0.16236. :  19%|████████▍                                    | 42/224 [00:21<01:30,  2.01it/s]
Epoch 12 Iter 43: loss 0.17497. :  19%|████████▍                                    | 42/224 [00:21<01:30,  2.01it/s]
Epoch 12 Iter 43: loss 0.17497. :  19%|████████▋                                    | 43/224 [00:21<01:35,  1.89it/s]
Epoch 12 Iter 44: loss 0.17234. :  19%|████████▋                                    | 43/224 [00:22<01:35,  1.89it/s]
Epoch 12 Iter 44: loss 0.17234. :  20%|████████▊                                    | 44/224 [00:22<01:48,  1.65it/s]
Epoch 12 Iter 45: loss 0.16123. :  20%|████████▊                                    | 44/224 [00:23<01:48,  1.65it/s]
Epoch 12 Iter 45: loss 0.16123. :  20%|█████████                                    | 45/224 [00:23<01:56,  1.54it/s]
Epoch 12 Iter 46: loss 0.16827. :  20%|█████████                                    | 45/224 [00:23<01:56,  1.54it/s]
Epoch 12 Iter 46: loss 0.16827. :  21%|█████████▏                                   | 46/224 [00:23<01:49,  1.63it/s]
Epoch 12 Iter 47: loss 0.17947. :  21%|█████████▏                                   | 46/224 [00:24<01:49,  1.63it/s]
Epoch 12 Iter 47: loss 0.17947. :  21%|█████████▍                                   | 47/224 [00:24<01:56,  1.51it/s]
Epoch 12 Iter 48: loss 0.17791. :  21%|█████████▍                                   | 47/224 [00:25<01:56,  1.51it/s]
Epoch 12 Iter 48: loss 0.17791. :  21%|█████████▋                                   | 48/224 [00:25<02:02,  1.43it/s]
Epoch 12 Iter 49: loss 0.18159. :  21%|█████████▋                                   | 48/224 [00:26<02:02,  1.43it/s]
Epoch 12 Iter 49: loss 0.18159. :  22%|█████████▊                                   | 49/224 [00:26<01:58,  1.47it/s]
Epoch 12 Iter 50: loss 0.14962. :  22%|█████████▊                                   | 49/224 [00:26<01:58,  1.47it/s]
Epoch 12 Iter 50: loss 0.14962. :  22%|██████████                                   | 50/224 [00:26<01:54,  1.52it/s]
Epoch 12 Iter 51: loss 0.16013. :  22%|██████████                                   | 50/224 [00:27<01:54,  1.52it/s]
Epoch 12 Iter 51: loss 0.16013. :  23%|██████████▏                                  | 51/224 [00:27<01:59,  1.45it/s]
Epoch 12 Iter 52: loss 0.18232. :  23%|██████████▏                                  | 51/224 [00:28<01:59,  1.45it/s]
Epoch 12 Iter 52: loss 0.18232. :  23%|██████████▍                                  | 52/224 [00:28<02:02,  1.41it/s]
Epoch 12 Iter 53: loss 0.15794. :  23%|██████████▍                                  | 52/224 [00:28<02:02,  1.41it/s]
Epoch 12 Iter 53: loss 0.15794. :  24%|██████████▋                                  | 53/224 [00:28<01:53,  1.51it/s]
Epoch 12 Iter 54: loss 0.17390. :  24%|██████████▋                                  | 53/224 [00:29<01:53,  1.51it/s]
Epoch 12 Iter 54: loss 0.17390. :  24%|██████████▊                                  | 54/224 [00:29<01:46,  1.60it/s]
Epoch 12 Iter 55: loss 0.17466. :  24%|██████████▊                                  | 54/224 [00:30<01:46,  1.60it/s]
Epoch 12 Iter 55: loss 0.17466. :  25%|███████████                                  | 55/224 [00:30<01:52,  1.50it/s]
Epoch 12 Iter 56: loss 0.15973. :  25%|███████████                                  | 55/224 [00:30<01:52,  1.50it/s]
Epoch 12 Iter 56: loss 0.15973. :  25%|███████████▎                                 | 56/224 [00:30<01:57,  1.42it/s]
Epoch 12 Iter 57: loss 0.16366. :  25%|███████████▎                                 | 56/224 [00:31<01:57,  1.42it/s]
Epoch 12 Iter 57: loss 0.16366. :  25%|███████████▍                                 | 57/224 [00:31<02:00,  1.39it/s]
Epoch 12 Iter 58: loss 0.16092. :  25%|███████████▍                                 | 57/224 [00:32<02:00,  1.39it/s]
Epoch 12 Iter 58: loss 0.16092. :  26%|███████████▋                                 | 58/224 [00:32<01:59,  1.39it/s]
Epoch 12 Iter 59: loss 0.18094. :  26%|███████████▋                                 | 58/224 [00:33<01:59,  1.39it/s]
Epoch 12 Iter 59: loss 0.18094. :  26%|███████████▊                                 | 59/224 [00:33<01:58,  1.40it/s]
Epoch 12 Iter 60: loss 0.17363. :  26%|███████████▊                                 | 59/224 [00:33<01:58,  1.40it/s]
Epoch 12 Iter 60: loss 0.17363. :  27%|████████████                                 | 60/224 [00:33<01:56,  1.41it/s]
Epoch 12 Iter 61: loss 0.17076. :  27%|████████████                                 | 60/224 [00:34<01:56,  1.41it/s]
Epoch 12 Iter 61: loss 0.17076. :  27%|████████████▎                                | 61/224 [00:34<01:48,  1.50it/s]
Epoch 12 Iter 62: loss 0.17137. :  27%|████████████▎                                | 61/224 [00:34<01:48,  1.50it/s]
Epoch 12 Iter 62: loss 0.17137. :  28%|████████████▍                                | 62/224 [00:34<01:40,  1.61it/s]
Epoch 12 Iter 63: loss 0.15165. :  28%|████████████▍                                | 62/224 [00:35<01:40,  1.61it/s]
Epoch 12 Iter 63: loss 0.15165. :  28%|████████████▋                                | 63/224 [00:35<01:40,  1.60it/s]
Epoch 12 Iter 64: loss 0.16777. :  28%|████████████▋                                | 63/224 [00:36<01:40,  1.60it/s]
Epoch 12 Iter 64: loss 0.16777. :  29%|████████████▊                                | 64/224 [00:36<01:35,  1.68it/s]
Epoch 12 Iter 65: loss 0.17234. :  29%|████████████▊                                | 64/224 [00:36<01:35,  1.68it/s]
Epoch 12 Iter 65: loss 0.17234. :  29%|█████████████                                | 65/224 [00:36<01:32,  1.72it/s]
Epoch 12 Iter 66: loss 0.16278. :  29%|█████████████                                | 65/224 [00:37<01:32,  1.72it/s]
Epoch 12 Iter 66: loss 0.16278. :  29%|█████████████▎                               | 66/224 [00:37<01:32,  1.71it/s]
Epoch 12 Iter 67: loss 0.16787. :  29%|█████████████▎                               | 66/224 [00:37<01:32,  1.71it/s]
Epoch 12 Iter 67: loss 0.16787. :  30%|█████████████▍                               | 67/224 [00:37<01:41,  1.55it/s]
Epoch 12 Iter 68: loss 0.17772. :  30%|█████████████▍                               | 67/224 [00:38<01:41,  1.55it/s]
Epoch 12 Iter 68: loss 0.17772. :  30%|█████████████▋                               | 68/224 [00:38<01:39,  1.57it/s]
Epoch 12 Iter 69: loss 0.16774. :  30%|█████████████▋                               | 68/224 [00:39<01:39,  1.57it/s]
Epoch 12 Iter 69: loss 0.16774. :  31%|█████████████▊                               | 69/224 [00:39<01:42,  1.51it/s]
Epoch 12 Iter 70: loss 0.16361. :  31%|█████████████▊                               | 69/224 [00:40<01:42,  1.51it/s]
Epoch 12 Iter 70: loss 0.16361. :  31%|██████████████                               | 70/224 [00:40<01:46,  1.45it/s]
Epoch 12 Iter 71: loss 0.18994. :  31%|██████████████                               | 70/224 [00:40<01:46,  1.45it/s]
Epoch 12 Iter 71: loss 0.18994. :  32%|██████████████▎                              | 71/224 [00:40<01:49,  1.40it/s]
Epoch 12 Iter 72: loss 0.16740. :  32%|██████████████▎                              | 71/224 [00:41<01:49,  1.40it/s]
Epoch 12 Iter 72: loss 0.16740. :  32%|██████████████▍                              | 72/224 [00:41<01:50,  1.38it/s]
Epoch 12 Iter 73: loss 0.17150. :  32%|██████████████▍                              | 72/224 [00:42<01:50,  1.38it/s]
Epoch 12 Iter 73: loss 0.17150. :  33%|██████████████▋                              | 73/224 [00:42<01:47,  1.41it/s]
Epoch 12 Iter 74: loss 0.17686. :  33%|██████████████▋                              | 73/224 [00:42<01:47,  1.41it/s]
Epoch 12 Iter 74: loss 0.17686. :  33%|██████████████▊                              | 74/224 [00:42<01:41,  1.48it/s]
Epoch 12 Iter 75: loss 0.17010. :  33%|██████████████▊                              | 74/224 [00:43<01:41,  1.48it/s]
Epoch 12 Iter 75: loss 0.17010. :  33%|███████████████                              | 75/224 [00:43<01:44,  1.43it/s]
Epoch 12 Iter 76: loss 0.16075. :  33%|███████████████                              | 75/224 [00:44<01:44,  1.43it/s]
Epoch 12 Iter 76: loss 0.16075. :  34%|███████████████▎                             | 76/224 [00:44<01:45,  1.40it/s]
Epoch 12 Iter 77: loss 0.17676. :  34%|███████████████▎                             | 76/224 [00:45<01:45,  1.40it/s]
Epoch 12 Iter 77: loss 0.17676. :  34%|███████████████▍                             | 77/224 [00:45<01:41,  1.45it/s]
Epoch 12 Iter 78: loss 0.18589. :  34%|███████████████▍                             | 77/224 [00:45<01:41,  1.45it/s]
Epoch 12 Iter 78: loss 0.18589. :  35%|███████████████▋                             | 78/224 [00:45<01:33,  1.56it/s]
Epoch 12 Iter 79: loss 0.18187. :  35%|███████████████▋                             | 78/224 [00:46<01:33,  1.56it/s]
Epoch 12 Iter 79: loss 0.18187. :  35%|███████████████▊                             | 79/224 [00:46<01:35,  1.51it/s]
Epoch 12 Iter 80: loss 0.16654. :  35%|███████████████▊                             | 79/224 [00:46<01:35,  1.51it/s]
Epoch 12 Iter 80: loss 0.16654. :  36%|████████████████                             | 80/224 [00:46<01:32,  1.56it/s]
Epoch 12 Iter 81: loss 0.16368. :  36%|████████████████                             | 80/224 [00:47<01:32,  1.56it/s]
Epoch 12 Iter 81: loss 0.16368. :  36%|████████████████▎                            | 81/224 [00:47<01:25,  1.67it/s]
Epoch 12 Iter 82: loss 0.16868. :  36%|████████████████▎                            | 81/224 [00:47<01:25,  1.67it/s]
Epoch 12 Iter 82: loss 0.16868. :  37%|████████████████▍                            | 82/224 [00:47<01:20,  1.76it/s]
Epoch 12 Iter 83: loss 0.16745. :  37%|████████████████▍                            | 82/224 [00:48<01:20,  1.76it/s]
Epoch 12 Iter 83: loss 0.16745. :  37%|████████████████▋                            | 83/224 [00:48<01:17,  1.83it/s]
Epoch 12 Iter 84: loss 0.16939. :  37%|████████████████▋                            | 83/224 [00:48<01:17,  1.83it/s]
Epoch 12 Iter 84: loss 0.16939. :  38%|████████████████▉                            | 84/224 [00:48<01:14,  1.88it/s]
Epoch 12 Iter 85: loss 0.15882. :  38%|████████████████▉                            | 84/224 [00:49<01:14,  1.88it/s]
Epoch 12 Iter 85: loss 0.15882. :  38%|█████████████████                            | 85/224 [00:49<01:12,  1.91it/s]
Epoch 12 Iter 86: loss 0.16391. :  38%|█████████████████                            | 85/224 [00:49<01:12,  1.91it/s]
Epoch 12 Iter 86: loss 0.16391. :  38%|█████████████████▎                           | 86/224 [00:49<01:11,  1.94it/s]
Epoch 12 Iter 87: loss 0.15548. :  38%|█████████████████▎                           | 86/224 [00:50<01:11,  1.94it/s]
Epoch 12 Iter 87: loss 0.15548. :  39%|█████████████████▍                           | 87/224 [00:50<01:09,  1.96it/s]
Epoch 12 Iter 88: loss 0.18989. :  39%|█████████████████▍                           | 87/224 [00:50<01:09,  1.96it/s]
Epoch 12 Iter 88: loss 0.18989. :  39%|█████████████████▋                           | 88/224 [00:50<01:09,  1.96it/s]
Epoch 12 Iter 89: loss 0.15536. :  39%|█████████████████▋                           | 88/224 [00:51<01:09,  1.96it/s]
Epoch 12 Iter 89: loss 0.15536. :  40%|█████████████████▉                           | 89/224 [00:51<01:08,  1.97it/s]
Epoch 12 Iter 90: loss 0.17662. :  40%|█████████████████▉                           | 89/224 [00:51<01:08,  1.97it/s]
Epoch 12 Iter 90: loss 0.17662. :  40%|██████████████████                           | 90/224 [00:51<01:07,  1.99it/s]
Epoch 12 Iter 91: loss 0.18775. :  40%|██████████████████                           | 90/224 [00:52<01:07,  1.99it/s]
Epoch 12 Iter 91: loss 0.18775. :  41%|██████████████████▎                          | 91/224 [00:52<01:06,  1.99it/s]
Epoch 12 Iter 92: loss 0.18078. :  41%|██████████████████▎                          | 91/224 [00:52<01:06,  1.99it/s]
Epoch 12 Iter 92: loss 0.18078. :  41%|██████████████████▍                          | 92/224 [00:52<01:05,  2.00it/s]
Epoch 12 Iter 93: loss 0.15872. :  41%|██████████████████▍                          | 92/224 [00:53<01:05,  2.00it/s]
Epoch 12 Iter 93: loss 0.15872. :  42%|██████████████████▋                          | 93/224 [00:53<01:05,  1.99it/s]
Epoch 12 Iter 94: loss 0.20158. :  42%|██████████████████▋                          | 93/224 [00:53<01:05,  1.99it/s]
Epoch 12 Iter 94: loss 0.20158. :  42%|██████████████████▉                          | 94/224 [00:53<01:04,  2.01it/s]
Epoch 12 Iter 95: loss 0.18787. :  42%|██████████████████▉                          | 94/224 [00:54<01:04,  2.01it/s]
Epoch 12 Iter 95: loss 0.18787. :  42%|███████████████████                          | 95/224 [00:54<01:09,  1.84it/s]
Epoch 12 Iter 96: loss 0.17185. :  42%|███████████████████                          | 95/224 [00:55<01:09,  1.84it/s]
Epoch 12 Iter 96: loss 0.17185. :  43%|███████████████████▎                         | 96/224 [00:55<01:15,  1.71it/s]
Epoch 12 Iter 97: loss 0.15987. :  43%|███████████████████▎                         | 96/224 [00:55<01:15,  1.71it/s]
Epoch 12 Iter 97: loss 0.15987. :  43%|███████████████████▍                         | 97/224 [00:55<01:16,  1.67it/s]
Epoch 12 Iter 98: loss 0.16226. :  43%|███████████████████▍                         | 97/224 [00:56<01:16,  1.67it/s]
Epoch 12 Iter 98: loss 0.16226. :  44%|███████████████████▋                         | 98/224 [00:56<01:19,  1.59it/s]
Epoch 12 Iter 99: loss 0.17766. :  44%|███████████████████▋                         | 98/224 [00:57<01:19,  1.59it/s]
Epoch 12 Iter 99: loss 0.17766. :  44%|███████████████████▉                         | 99/224 [00:57<01:23,  1.49it/s]
Epoch 12 Iter 100: loss 0.17116. :  44%|███████████████████▍                        | 99/224 [00:58<01:23,  1.49it/s]
Epoch 12 Iter 100: loss 0.17116. :  45%|███████████████████▏                       | 100/224 [00:58<01:26,  1.44it/s]
Epoch 12 Iter 101: loss 0.16524. :  45%|███████████████████▏                       | 100/224 [00:58<01:26,  1.44it/s]
Epoch 12 Iter 101: loss 0.16524. :  45%|███████████████████▍                       | 101/224 [00:58<01:20,  1.53it/s]
Epoch 12 Iter 102: loss 0.16768. :  45%|███████████████████▍                       | 101/224 [00:59<01:20,  1.53it/s]
Epoch 12 Iter 102: loss 0.16768. :  46%|███████████████████▌                       | 102/224 [00:59<01:14,  1.64it/s]
Epoch 12 Iter 103: loss 0.16424. :  46%|███████████████████▌                       | 102/224 [00:59<01:14,  1.64it/s]
Epoch 12 Iter 103: loss 0.16424. :  46%|███████████████████▊                       | 103/224 [00:59<01:09,  1.73it/s]
Epoch 12 Iter 104: loss 0.16503. :  46%|███████████████████▊                       | 103/224 [01:00<01:09,  1.73it/s]
Epoch 12 Iter 104: loss 0.16503. :  46%|███████████████████▉                       | 104/224 [01:00<01:06,  1.81it/s]
Epoch 12 Iter 105: loss 0.15763. :  46%|███████████████████▉                       | 104/224 [01:00<01:06,  1.81it/s]
Epoch 12 Iter 105: loss 0.15763. :  47%|████████████████████▏                      | 105/224 [01:00<01:03,  1.87it/s]
Epoch 12 Iter 106: loss 0.15025. :  47%|████████████████████▏                      | 105/224 [01:01<01:03,  1.87it/s]
Epoch 12 Iter 106: loss 0.15025. :  47%|████████████████████▎                      | 106/224 [01:01<01:02,  1.90it/s]
Epoch 12 Iter 107: loss 0.16613. :  47%|████████████████████▎                      | 106/224 [01:01<01:02,  1.90it/s]
Epoch 12 Iter 107: loss 0.16613. :  48%|████████████████████▌                      | 107/224 [01:01<01:01,  1.91it/s]
Epoch 12 Iter 108: loss 0.17338. :  48%|████████████████████▌                      | 107/224 [01:02<01:01,  1.91it/s]
Epoch 12 Iter 108: loss 0.17338. :  48%|████████████████████▋                      | 108/224 [01:02<01:00,  1.92it/s]
Epoch 12 Iter 109: loss 0.14992. :  48%|████████████████████▋                      | 108/224 [01:02<01:00,  1.92it/s]
Epoch 12 Iter 109: loss 0.14992. :  49%|████████████████████▉                      | 109/224 [01:02<01:02,  1.84it/s]
Epoch 12 Iter 110: loss 0.17210. :  49%|████████████████████▉                      | 109/224 [01:03<01:02,  1.84it/s]
Epoch 12 Iter 110: loss 0.17210. :  49%|█████████████████████                      | 110/224 [01:03<01:00,  1.87it/s]
Epoch 12 Iter 111: loss 0.19238. :  49%|█████████████████████                      | 110/224 [01:03<01:00,  1.87it/s]
Epoch 12 Iter 111: loss 0.19238. :  50%|█████████████████████▎                     | 111/224 [01:03<00:59,  1.90it/s]
Epoch 12 Iter 112: loss 0.15621. :  50%|█████████████████████▎                     | 111/224 [01:04<00:59,  1.90it/s]
Epoch 12 Iter 112: loss 0.15621. :  50%|█████████████████████▌                     | 112/224 [01:04<00:57,  1.93it/s]
Epoch 12 Iter 113: loss 0.16749. :  50%|█████████████████████▌                     | 112/224 [01:04<00:57,  1.93it/s]
Epoch 12 Iter 113: loss 0.16749. :  50%|█████████████████████▋                     | 113/224 [01:04<00:56,  1.95it/s]
Epoch 12 Iter 114: loss 0.16113. :  50%|█████████████████████▋                     | 113/224 [01:05<00:56,  1.95it/s]
Epoch 12 Iter 114: loss 0.16113. :  51%|█████████████████████▉                     | 114/224 [01:05<00:55,  1.98it/s]
Epoch 12 Iter 115: loss 0.18185. :  51%|█████████████████████▉                     | 114/224 [01:05<00:55,  1.98it/s]
Epoch 12 Iter 115: loss 0.18185. :  51%|██████████████████████                     | 115/224 [01:05<00:55,  1.98it/s]
Epoch 12 Iter 116: loss 0.16237. :  51%|██████████████████████                     | 115/224 [01:06<00:55,  1.98it/s]
Epoch 12 Iter 116: loss 0.16237. :  52%|██████████████████████▎                    | 116/224 [01:06<00:57,  1.89it/s]
Epoch 12 Iter 117: loss 0.16144. :  52%|██████████████████████▎                    | 116/224 [01:06<00:57,  1.89it/s]
Epoch 12 Iter 117: loss 0.16144. :  52%|██████████████████████▍                    | 117/224 [01:06<00:57,  1.87it/s]
Epoch 12 Iter 118: loss 0.15918. :  52%|██████████████████████▍                    | 117/224 [01:07<00:57,  1.87it/s]
Epoch 12 Iter 118: loss 0.15918. :  53%|██████████████████████▋                    | 118/224 [01:07<00:55,  1.90it/s]
Epoch 12 Iter 119: loss 0.15901. :  53%|██████████████████████▋                    | 118/224 [01:07<00:55,  1.90it/s]
Epoch 12 Iter 119: loss 0.15901. :  53%|██████████████████████▊                    | 119/224 [01:07<00:54,  1.91it/s]
Epoch 12 Iter 120: loss 0.17560. :  53%|██████████████████████▊                    | 119/224 [01:08<00:54,  1.91it/s]
Epoch 12 Iter 120: loss 0.17560. :  54%|███████████████████████                    | 120/224 [01:08<00:54,  1.92it/s]
Epoch 12 Iter 121: loss 0.16129. :  54%|███████████████████████                    | 120/224 [01:08<00:54,  1.92it/s]
Epoch 12 Iter 121: loss 0.16129. :  54%|███████████████████████▏                   | 121/224 [01:08<00:52,  1.96it/s]
Epoch 12 Iter 122: loss 0.18969. :  54%|███████████████████████▏                   | 121/224 [01:09<00:52,  1.96it/s]
Epoch 12 Iter 122: loss 0.18969. :  54%|███████████████████████▍                   | 122/224 [01:09<00:51,  1.98it/s]
Epoch 12 Iter 123: loss 0.18506. :  54%|███████████████████████▍                   | 122/224 [01:10<00:51,  1.98it/s]
Epoch 12 Iter 123: loss 0.18506. :  55%|███████████████████████▌                   | 123/224 [01:10<00:55,  1.80it/s]
Epoch 12 Iter 124: loss 0.16544. :  55%|███████████████████████▌                   | 123/224 [01:10<00:55,  1.80it/s]
Epoch 12 Iter 124: loss 0.16544. :  55%|███████████████████████▊                   | 124/224 [01:10<00:55,  1.81it/s]
Epoch 12 Iter 125: loss 0.17058. :  55%|███████████████████████▊                   | 124/224 [01:11<00:55,  1.81it/s]
Epoch 12 Iter 125: loss 0.17058. :  56%|███████████████████████▉                   | 125/224 [01:11<00:53,  1.86it/s]
Epoch 12 Iter 126: loss 0.16451. :  56%|███████████████████████▉                   | 125/224 [01:11<00:53,  1.86it/s]
Epoch 12 Iter 126: loss 0.16451. :  56%|████████████████████████▏                  | 126/224 [01:11<00:52,  1.88it/s]
Epoch 12 Iter 127: loss 0.18705. :  56%|████████████████████████▏                  | 126/224 [01:12<00:52,  1.88it/s]
Epoch 12 Iter 127: loss 0.18705. :  57%|████████████████████████▍                  | 127/224 [01:12<00:50,  1.91it/s]
Epoch 12 Iter 128: loss 0.18526. :  57%|████████████████████████▍                  | 127/224 [01:12<00:50,  1.91it/s]
Epoch 12 Iter 128: loss 0.18526. :  57%|████████████████████████▌                  | 128/224 [01:12<00:50,  1.92it/s]
Epoch 12 Iter 129: loss 0.16102. :  57%|████████████████████████▌                  | 128/224 [01:13<00:50,  1.92it/s]
Epoch 12 Iter 129: loss 0.16102. :  58%|████████████████████████▊                  | 129/224 [01:13<00:49,  1.93it/s]
Epoch 12 Iter 130: loss 0.15321. :  58%|████████████████████████▊                  | 129/224 [01:13<00:49,  1.93it/s]
Epoch 12 Iter 130: loss 0.15321. :  58%|████████████████████████▉                  | 130/224 [01:13<00:49,  1.90it/s]
Epoch 12 Iter 131: loss 0.15400. :  58%|████████████████████████▉                  | 130/224 [01:14<00:49,  1.90it/s]
Epoch 12 Iter 131: loss 0.15400. :  58%|█████████████████████████▏                 | 131/224 [01:14<00:51,  1.80it/s]
Epoch 12 Iter 132: loss 0.15445. :  58%|█████████████████████████▏                 | 131/224 [01:14<00:51,  1.80it/s]
Epoch 12 Iter 132: loss 0.15445. :  59%|█████████████████████████▎                 | 132/224 [01:14<00:52,  1.77it/s]
Epoch 12 Iter 133: loss 0.21354. :  59%|█████████████████████████▎                 | 132/224 [01:15<00:52,  1.77it/s]
Epoch 12 Iter 133: loss 0.21354. :  59%|█████████████████████████▌                 | 133/224 [01:15<00:52,  1.73it/s]
Epoch 12 Iter 134: loss 0.19610. :  59%|█████████████████████████▌                 | 133/224 [01:16<00:52,  1.73it/s]
Epoch 12 Iter 134: loss 0.19610. :  60%|█████████████████████████▋                 | 134/224 [01:16<00:50,  1.78it/s]
Epoch 12 Iter 135: loss 0.18829. :  60%|█████████████████████████▋                 | 134/224 [01:16<00:50,  1.78it/s]
Epoch 12 Iter 135: loss 0.18829. :  60%|█████████████████████████▉                 | 135/224 [01:16<00:48,  1.84it/s]
Epoch 12 Iter 136: loss 0.16858. :  60%|█████████████████████████▉                 | 135/224 [01:17<00:48,  1.84it/s]
Epoch 12 Iter 136: loss 0.16858. :  61%|██████████████████████████                 | 136/224 [01:17<00:47,  1.87it/s]
Epoch 12 Iter 137: loss 0.17466. :  61%|██████████████████████████                 | 136/224 [01:17<00:47,  1.87it/s]
Epoch 12 Iter 137: loss 0.17466. :  61%|██████████████████████████▎                | 137/224 [01:17<00:45,  1.90it/s]
Epoch 12 Iter 138: loss 0.18006. :  61%|██████████████████████████▎                | 137/224 [01:18<00:45,  1.90it/s]
Epoch 12 Iter 138: loss 0.18006. :  62%|██████████████████████████▍                | 138/224 [01:18<00:44,  1.92it/s]
Epoch 12 Iter 139: loss 0.16659. :  62%|██████████████████████████▍                | 138/224 [01:18<00:44,  1.92it/s]
Epoch 12 Iter 139: loss 0.16659. :  62%|██████████████████████████▋                | 139/224 [01:18<00:44,  1.93it/s]
Epoch 12 Iter 140: loss 0.16365. :  62%|██████████████████████████▋                | 139/224 [01:19<00:44,  1.93it/s]
Epoch 12 Iter 140: loss 0.16365. :  62%|██████████████████████████▉                | 140/224 [01:19<00:42,  1.95it/s]
Epoch 12 Iter 141: loss 0.16707. :  62%|██████████████████████████▉                | 140/224 [01:19<00:42,  1.95it/s]
Epoch 12 Iter 141: loss 0.16707. :  63%|███████████████████████████                | 141/224 [01:19<00:42,  1.95it/s]
Epoch 12 Iter 142: loss 0.17716. :  63%|███████████████████████████                | 141/224 [01:20<00:42,  1.95it/s]
Epoch 12 Iter 142: loss 0.17716. :  63%|███████████████████████████▎               | 142/224 [01:20<00:41,  1.96it/s]
Epoch 12 Iter 143: loss 0.16345. :  63%|███████████████████████████▎               | 142/224 [01:20<00:41,  1.96it/s]
Epoch 12 Iter 143: loss 0.16345. :  64%|███████████████████████████▍               | 143/224 [01:20<00:41,  1.96it/s]
Epoch 12 Iter 144: loss 0.17192. :  64%|███████████████████████████▍               | 143/224 [01:21<00:41,  1.96it/s]
Epoch 12 Iter 144: loss 0.17192. :  64%|███████████████████████████▋               | 144/224 [01:21<00:41,  1.94it/s]
Epoch 12 Iter 145: loss 0.17992. :  64%|███████████████████████████▋               | 144/224 [01:21<00:41,  1.94it/s]
Epoch 12 Iter 145: loss 0.17992. :  65%|███████████████████████████▊               | 145/224 [01:21<00:40,  1.94it/s]
Epoch 12 Iter 146: loss 0.13997. :  65%|███████████████████████████▊               | 145/224 [01:22<00:40,  1.94it/s]
Epoch 12 Iter 146: loss 0.13997. :  65%|████████████████████████████               | 146/224 [01:22<00:39,  1.96it/s]
Epoch 12 Iter 147: loss 0.17151. :  65%|████████████████████████████               | 146/224 [01:22<00:39,  1.96it/s]
Epoch 12 Iter 147: loss 0.17151. :  66%|████████████████████████████▏              | 147/224 [01:22<00:39,  1.95it/s]
Epoch 12 Iter 148: loss 0.17073. :  66%|████████████████████████████▏              | 147/224 [01:23<00:39,  1.95it/s]
Epoch 12 Iter 148: loss 0.17073. :  66%|████████████████████████████▍              | 148/224 [01:23<00:38,  1.96it/s]
Epoch 12 Iter 149: loss 0.16825. :  66%|████████████████████████████▍              | 148/224 [01:23<00:38,  1.96it/s]
Epoch 12 Iter 149: loss 0.16825. :  67%|████████████████████████████▌              | 149/224 [01:23<00:39,  1.89it/s]
Epoch 12 Iter 150: loss 0.16279. :  67%|████████████████████████████▌              | 149/224 [01:24<00:39,  1.89it/s]
Epoch 12 Iter 150: loss 0.16279. :  67%|████████████████████████████▊              | 150/224 [01:24<00:41,  1.80it/s]
Epoch 12 Iter 151: loss 0.16496. :  67%|████████████████████████████▊              | 150/224 [01:24<00:41,  1.80it/s]
Epoch 12 Iter 151: loss 0.16496. :  67%|████████████████████████████▉              | 151/224 [01:24<00:42,  1.71it/s]
Epoch 12 Iter 152: loss 0.17697. :  67%|████████████████████████████▉              | 151/224 [01:25<00:42,  1.71it/s]
Epoch 12 Iter 152: loss 0.17697. :  68%|█████████████████████████████▏             | 152/224 [01:25<00:44,  1.60it/s]
Epoch 12 Iter 153: loss 0.16913. :  68%|█████████████████████████████▏             | 152/224 [01:26<00:44,  1.60it/s]
Epoch 12 Iter 153: loss 0.16913. :  68%|█████████████████████████████▎             | 153/224 [01:26<00:47,  1.51it/s]
Epoch 12 Iter 154: loss 0.17379. :  68%|█████████████████████████████▎             | 153/224 [01:27<00:47,  1.51it/s]
Epoch 12 Iter 154: loss 0.17379. :  69%|█████████████████████████████▌             | 154/224 [01:27<00:48,  1.44it/s]
Epoch 12 Iter 155: loss 0.18061. :  69%|█████████████████████████████▌             | 154/224 [01:28<00:48,  1.44it/s]
Epoch 12 Iter 155: loss 0.18061. :  69%|█████████████████████████████▊             | 155/224 [01:28<00:49,  1.40it/s]
Epoch 12 Iter 156: loss 0.17890. :  69%|█████████████████████████████▊             | 155/224 [01:28<00:49,  1.40it/s]
Epoch 12 Iter 156: loss 0.17890. :  70%|█████████████████████████████▉             | 156/224 [01:28<00:47,  1.43it/s]
Epoch 12 Iter 157: loss 0.17546. :  70%|█████████████████████████████▉             | 156/224 [01:29<00:47,  1.43it/s]
Epoch 12 Iter 157: loss 0.17546. :  70%|██████████████████████████████▏            | 157/224 [01:29<00:48,  1.38it/s]
Epoch 12 Iter 158: loss 0.16763. :  70%|██████████████████████████████▏            | 157/224 [01:30<00:48,  1.38it/s]
Epoch 12 Iter 158: loss 0.16763. :  71%|██████████████████████████████▎            | 158/224 [01:30<00:48,  1.36it/s]
Epoch 12 Iter 159: loss 0.16065. :  71%|██████████████████████████████▎            | 158/224 [01:30<00:48,  1.36it/s]
Epoch 12 Iter 159: loss 0.16065. :  71%|██████████████████████████████▌            | 159/224 [01:30<00:45,  1.43it/s]
Epoch 12 Iter 160: loss 0.18080. :  71%|██████████████████████████████▌            | 159/224 [01:31<00:45,  1.43it/s]
Epoch 12 Iter 160: loss 0.18080. :  71%|██████████████████████████████▋            | 160/224 [01:31<00:41,  1.54it/s]
Epoch 12 Iter 161: loss 0.17082. :  71%|██████████████████████████████▋            | 160/224 [01:31<00:41,  1.54it/s]
Epoch 12 Iter 161: loss 0.17082. :  72%|██████████████████████████████▉            | 161/224 [01:31<00:38,  1.62it/s]
Epoch 12 Iter 162: loss 0.17569. :  72%|██████████████████████████████▉            | 161/224 [01:32<00:38,  1.62it/s]
Epoch 12 Iter 162: loss 0.17569. :  72%|███████████████████████████████            | 162/224 [01:32<00:39,  1.58it/s]
Epoch 12 Iter 163: loss 0.18879. :  72%|███████████████████████████████            | 162/224 [01:33<00:39,  1.58it/s]
Epoch 12 Iter 163: loss 0.18879. :  73%|███████████████████████████████▎           | 163/224 [01:33<00:39,  1.54it/s]
Epoch 12 Iter 164: loss 0.17708. :  73%|███████████████████████████████▎           | 163/224 [01:33<00:39,  1.54it/s]
Epoch 12 Iter 164: loss 0.17708. :  73%|███████████████████████████████▍           | 164/224 [01:33<00:37,  1.61it/s]
Epoch 12 Iter 165: loss 0.18518. :  73%|███████████████████████████████▍           | 164/224 [01:34<00:37,  1.61it/s]
Epoch 12 Iter 165: loss 0.18518. :  74%|███████████████████████████████▋           | 165/224 [01:34<00:36,  1.62it/s]
Epoch 12 Iter 166: loss 0.17839. :  74%|███████████████████████████████▋           | 165/224 [01:35<00:36,  1.62it/s]
Epoch 12 Iter 166: loss 0.17839. :  74%|███████████████████████████████▊           | 166/224 [01:35<00:35,  1.64it/s]
Epoch 12 Iter 167: loss 0.16276. :  74%|███████████████████████████████▊           | 166/224 [01:35<00:35,  1.64it/s]
Epoch 12 Iter 167: loss 0.16276. :  75%|████████████████████████████████           | 167/224 [01:35<00:37,  1.53it/s]
Epoch 12 Iter 168: loss 0.15235. :  75%|████████████████████████████████           | 167/224 [01:36<00:37,  1.53it/s]
Epoch 12 Iter 168: loss 0.15235. :  75%|████████████████████████████████▎          | 168/224 [01:36<00:37,  1.51it/s]
Epoch 12 Iter 169: loss 0.16049. :  75%|████████████████████████████████▎          | 168/224 [01:36<00:37,  1.51it/s]
Epoch 12 Iter 169: loss 0.16049. :  75%|████████████████████████████████▍          | 169/224 [01:36<00:34,  1.60it/s]
Epoch 12 Iter 170: loss 0.15595. :  75%|████████████████████████████████▍          | 169/224 [01:37<00:34,  1.60it/s]
Epoch 12 Iter 170: loss 0.15595. :  76%|████████████████████████████████▋          | 170/224 [01:37<00:32,  1.64it/s]
Epoch 12 Iter 171: loss 0.15364. :  76%|████████████████████████████████▋          | 170/224 [01:38<00:32,  1.64it/s]
Epoch 12 Iter 171: loss 0.15364. :  76%|████████████████████████████████▊          | 171/224 [01:38<00:34,  1.52it/s]
Epoch 12 Iter 172: loss 0.15023. :  76%|████████████████████████████████▊          | 171/224 [01:39<00:34,  1.52it/s]
Epoch 12 Iter 172: loss 0.15023. :  77%|█████████████████████████████████          | 172/224 [01:39<00:34,  1.51it/s]
Epoch 12 Iter 173: loss 0.16058. :  77%|█████████████████████████████████          | 172/224 [01:39<00:34,  1.51it/s]
Epoch 12 Iter 173: loss 0.16058. :  77%|█████████████████████████████████▏         | 173/224 [01:39<00:35,  1.44it/s]
Epoch 12 Iter 174: loss 0.16559. :  77%|█████████████████████████████████▏         | 173/224 [01:40<00:35,  1.44it/s]
Epoch 12 Iter 174: loss 0.16559. :  78%|█████████████████████████████████▍         | 174/224 [01:40<00:33,  1.48it/s]
Epoch 12 Iter 175: loss 0.15520. :  78%|█████████████████████████████████▍         | 174/224 [01:41<00:33,  1.48it/s]
Epoch 12 Iter 175: loss 0.15520. :  78%|█████████████████████████████████▌         | 175/224 [01:41<00:34,  1.44it/s]
Epoch 12 Iter 176: loss 0.18511. :  78%|█████████████████████████████████▌         | 175/224 [01:41<00:34,  1.44it/s]
Epoch 12 Iter 176: loss 0.18511. :  79%|█████████████████████████████████▊         | 176/224 [01:41<00:31,  1.52it/s]
Epoch 12 Iter 177: loss 0.15535. :  79%|█████████████████████████████████▊         | 176/224 [01:42<00:31,  1.52it/s]
Epoch 12 Iter 177: loss 0.15535. :  79%|█████████████████████████████████▉         | 177/224 [01:42<00:30,  1.52it/s]
Epoch 12 Iter 178: loss 0.17497. :  79%|█████████████████████████████████▉         | 177/224 [01:43<00:30,  1.52it/s]
Epoch 12 Iter 178: loss 0.17497. :  79%|██████████████████████████████████▏        | 178/224 [01:43<00:32,  1.44it/s]
Epoch 12 Iter 179: loss 0.18846. :  79%|██████████████████████████████████▏        | 178/224 [01:43<00:32,  1.44it/s]
Epoch 12 Iter 179: loss 0.18846. :  80%|██████████████████████████████████▎        | 179/224 [01:43<00:29,  1.54it/s]
Epoch 12 Iter 180: loss 0.16629. :  80%|██████████████████████████████████▎        | 179/224 [01:44<00:29,  1.54it/s]
Epoch 12 Iter 180: loss 0.16629. :  80%|██████████████████████████████████▌        | 180/224 [01:44<00:29,  1.49it/s]
Epoch 12 Iter 181: loss 0.16858. :  80%|██████████████████████████████████▌        | 180/224 [01:45<00:29,  1.49it/s]
Epoch 12 Iter 181: loss 0.16858. :  81%|██████████████████████████████████▋        | 181/224 [01:45<00:29,  1.44it/s]
Epoch 12 Iter 182: loss 0.18782. :  81%|██████████████████████████████████▋        | 181/224 [01:45<00:29,  1.44it/s]
Epoch 12 Iter 182: loss 0.18782. :  81%|██████████████████████████████████▉        | 182/224 [01:45<00:28,  1.45it/s]
Epoch 12 Iter 183: loss 0.14122. :  81%|██████████████████████████████████▉        | 182/224 [01:46<00:28,  1.45it/s]
Epoch 12 Iter 183: loss 0.14122. :  82%|███████████████████████████████████▏       | 183/224 [01:46<00:28,  1.42it/s]
Epoch 12 Iter 184: loss 0.15613. :  82%|███████████████████████████████████▏       | 183/224 [01:47<00:28,  1.42it/s]
Epoch 12 Iter 184: loss 0.15613. :  82%|███████████████████████████████████▎       | 184/224 [01:47<00:26,  1.52it/s]
Epoch 12 Iter 185: loss 0.17931. :  82%|███████████████████████████████████▎       | 184/224 [01:47<00:26,  1.52it/s]
Epoch 12 Iter 185: loss 0.17931. :  83%|███████████████████████████████████▌       | 185/224 [01:47<00:24,  1.57it/s]
Epoch 12 Iter 186: loss 0.18540. :  83%|███████████████████████████████████▌       | 185/224 [01:48<00:24,  1.57it/s]
Epoch 12 Iter 186: loss 0.18540. :  83%|███████████████████████████████████▋       | 186/224 [01:48<00:24,  1.55it/s]
Epoch 12 Iter 187: loss 0.17831. :  83%|███████████████████████████████████▋       | 186/224 [01:48<00:24,  1.55it/s]
Epoch 12 Iter 187: loss 0.17831. :  83%|███████████████████████████████████▉       | 187/224 [01:48<00:22,  1.63it/s]
Epoch 12 Iter 188: loss 0.15901. :  83%|███████████████████████████████████▉       | 187/224 [01:49<00:22,  1.63it/s]
Epoch 12 Iter 188: loss 0.15901. :  84%|████████████████████████████████████       | 188/224 [01:49<00:23,  1.51it/s]
Epoch 12 Iter 189: loss 0.17376. :  84%|████████████████████████████████████       | 188/224 [01:50<00:23,  1.51it/s]
Epoch 12 Iter 189: loss 0.17376. :  84%|████████████████████████████████████▎      | 189/224 [01:50<00:23,  1.52it/s]
Epoch 12 Iter 190: loss 0.19027. :  84%|████████████████████████████████████▎      | 189/224 [01:50<00:23,  1.52it/s]
Epoch 12 Iter 190: loss 0.19027. :  85%|████████████████████████████████████▍      | 190/224 [01:50<00:21,  1.59it/s]
Epoch 12 Iter 191: loss 0.18582. :  85%|████████████████████████████████████▍      | 190/224 [01:51<00:21,  1.59it/s]
Epoch 12 Iter 191: loss 0.18582. :  85%|████████████████████████████████████▋      | 191/224 [01:51<00:21,  1.53it/s]
Epoch 12 Iter 192: loss 0.16556. :  85%|████████████████████████████████████▋      | 191/224 [01:52<00:21,  1.53it/s]
Epoch 12 Iter 192: loss 0.16556. :  86%|████████████████████████████████████▊      | 192/224 [01:52<00:20,  1.55it/s]
Epoch 12 Iter 193: loss 0.17643. :  86%|████████████████████████████████████▊      | 192/224 [01:52<00:20,  1.55it/s]
Epoch 12 Iter 193: loss 0.17643. :  86%|█████████████████████████████████████      | 193/224 [01:52<00:19,  1.59it/s]
Epoch 12 Iter 194: loss 0.16034. :  86%|█████████████████████████████████████      | 193/224 [01:53<00:19,  1.59it/s]
Epoch 12 Iter 194: loss 0.16034. :  87%|█████████████████████████████████████▏     | 194/224 [01:53<00:20,  1.46it/s]
Epoch 12 Iter 195: loss 0.15932. :  87%|█████████████████████████████████████▏     | 194/224 [01:54<00:20,  1.46it/s]
Epoch 12 Iter 195: loss 0.15932. :  87%|█████████████████████████████████████▍     | 195/224 [01:54<00:20,  1.38it/s]
Epoch 12 Iter 196: loss 0.17672. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:20,  1.38it/s]
Epoch 12 Iter 196: loss 0.17672. :  88%|█████████████████████████████████████▋     | 196/224 [01:55<00:20,  1.36it/s]
Epoch 12 Iter 197: loss 0.13379. :  88%|█████████████████████████████████████▋     | 196/224 [01:55<00:20,  1.36it/s]
Epoch 12 Iter 197: loss 0.13379. :  88%|█████████████████████████████████████▊     | 197/224 [01:55<00:20,  1.34it/s]
Epoch 12 Iter 198: loss 0.15503. :  88%|█████████████████████████████████████▊     | 197/224 [01:56<00:20,  1.34it/s]
Epoch 12 Iter 198: loss 0.15503. :  88%|██████████████████████████████████████     | 198/224 [01:56<00:18,  1.44it/s]
Epoch 12 Iter 199: loss 0.14175. :  88%|██████████████████████████████████████     | 198/224 [01:57<00:18,  1.44it/s]
Epoch 12 Iter 199: loss 0.14175. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:16,  1.52it/s]
Epoch 12 Iter 200: loss 0.18361. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:16,  1.52it/s]
Epoch 12 Iter 200: loss 0.18361. :  89%|██████████████████████████████████████▍    | 200/224 [01:57<00:15,  1.60it/s]
Epoch 12 Iter 201: loss 0.14744. :  89%|██████████████████████████████████████▍    | 200/224 [01:58<00:15,  1.60it/s]
Epoch 12 Iter 201: loss 0.14744. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:13,  1.67it/s]
Epoch 12 Iter 202: loss 0.17578. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:13,  1.67it/s]
Epoch 12 Iter 202: loss 0.17578. :  90%|██████████████████████████████████████▊    | 202/224 [01:58<00:12,  1.71it/s]
Epoch 12 Iter 203: loss 0.16064. :  90%|██████████████████████████████████████▊    | 202/224 [01:59<00:12,  1.71it/s]
Epoch 12 Iter 203: loss 0.16064. :  91%|██████████████████████████████████████▉    | 203/224 [01:59<00:12,  1.62it/s]
Epoch 12 Iter 204: loss 0.17768. :  91%|██████████████████████████████████████▉    | 203/224 [02:00<00:12,  1.62it/s]
Epoch 12 Iter 204: loss 0.17768. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:13,  1.52it/s]
Epoch 12 Iter 205: loss 0.15565. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:13,  1.52it/s]
Epoch 12 Iter 205: loss 0.15565. :  92%|███████████████████████████████████████▎   | 205/224 [02:00<00:13,  1.45it/s]
Epoch 12 Iter 206: loss 0.19122. :  92%|███████████████████████████████████████▎   | 205/224 [02:01<00:13,  1.45it/s]
Epoch 12 Iter 206: loss 0.19122. :  92%|███████████████████████████████████████▌   | 206/224 [02:01<00:12,  1.41it/s]
Epoch 12 Iter 207: loss 0.18964. :  92%|███████████████████████████████████████▌   | 206/224 [02:02<00:12,  1.41it/s]
Epoch 12 Iter 207: loss 0.18964. :  92%|███████████████████████████████████████▋   | 207/224 [02:02<00:12,  1.38it/s]
Epoch 12 Iter 208: loss 0.15663. :  92%|███████████████████████████████████████▋   | 207/224 [02:03<00:12,  1.38it/s]
Epoch 12 Iter 208: loss 0.15663. :  93%|███████████████████████████████████████▉   | 208/224 [02:03<00:11,  1.43it/s]
Epoch 12 Iter 209: loss 0.15964. :  93%|███████████████████████████████████████▉   | 208/224 [02:03<00:11,  1.43it/s]
Epoch 12 Iter 209: loss 0.15964. :  93%|████████████████████████████████████████   | 209/224 [02:03<00:10,  1.40it/s]
Epoch 12 Iter 210: loss 0.16490. :  93%|████████████████████████████████████████   | 209/224 [02:04<00:10,  1.40it/s]
Epoch 12 Iter 210: loss 0.16490. :  94%|████████████████████████████████████████▎  | 210/224 [02:04<00:09,  1.50it/s]
Epoch 12 Iter 211: loss 0.15624. :  94%|████████████████████████████████████████▎  | 210/224 [02:05<00:09,  1.50it/s]
Epoch 12 Iter 211: loss 0.15624. :  94%|████████████████████████████████████████▌  | 211/224 [02:05<00:09,  1.41it/s]
Epoch 12 Iter 212: loss 0.17151. :  94%|████████████████████████████████████████▌  | 211/224 [02:05<00:09,  1.41it/s]
Epoch 12 Iter 212: loss 0.17151. :  95%|████████████████████████████████████████▋  | 212/224 [02:05<00:08,  1.41it/s]
Epoch 12 Iter 213: loss 0.16297. :  95%|████████████████████████████████████████▋  | 212/224 [02:06<00:08,  1.41it/s]
Epoch 12 Iter 213: loss 0.16297. :  95%|████████████████████████████████████████▉  | 213/224 [02:06<00:07,  1.48it/s]
Epoch 12 Iter 214: loss 0.15660. :  95%|████████████████████████████████████████▉  | 213/224 [02:07<00:07,  1.48it/s]
Epoch 12 Iter 214: loss 0.15660. :  96%|█████████████████████████████████████████  | 214/224 [02:07<00:06,  1.48it/s]
Epoch 12 Iter 215: loss 0.16318. :  96%|█████████████████████████████████████████  | 214/224 [02:07<00:06,  1.48it/s]
Epoch 12 Iter 215: loss 0.16318. :  96%|█████████████████████████████████████████▎ | 215/224 [02:07<00:05,  1.57it/s]
Epoch 12 Iter 216: loss 0.18807. :  96%|█████████████████████████████████████████▎ | 215/224 [02:08<00:05,  1.57it/s]
Epoch 12 Iter 216: loss 0.18807. :  96%|█████████████████████████████████████████▍ | 216/224 [02:08<00:05,  1.57it/s]
Epoch 12 Iter 217: loss 0.18766. :  96%|█████████████████████████████████████████▍ | 216/224 [02:09<00:05,  1.57it/s]
Epoch 12 Iter 217: loss 0.18766. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:04,  1.60it/s]
Epoch 12 Iter 218: loss 0.16749. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:04,  1.60it/s]
Epoch 12 Iter 218: loss 0.16749. :  97%|█████████████████████████████████████████▊ | 218/224 [02:09<00:04,  1.49it/s]
Epoch 12 Iter 219: loss 0.17234. :  97%|█████████████████████████████████████████▊ | 218/224 [02:10<00:04,  1.49it/s]
Epoch 12 Iter 219: loss 0.17234. :  98%|██████████████████████████████████████████ | 219/224 [02:10<00:03,  1.47it/s]
Epoch 12 Iter 220: loss 0.19200. :  98%|██████████████████████████████████████████ | 219/224 [02:11<00:03,  1.47it/s]
Epoch 12 Iter 220: loss 0.19200. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.43it/s]
Epoch 12 Iter 221: loss 0.15807. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.43it/s]
Epoch 12 Iter 221: loss 0.15807. :  99%|██████████████████████████████████████████▍| 221/224 [02:11<00:01,  1.53it/s]
Epoch 12 Iter 222: loss 0.18632. :  99%|██████████████████████████████████████████▍| 221/224 [02:12<00:01,  1.53it/s]
Epoch 12 Iter 222: loss 0.18632. :  99%|██████████████████████████████████████████▌| 222/224 [02:12<00:01,  1.58it/s]
Epoch 12 Iter 223: loss 0.18627. :  99%|██████████████████████████████████████████▌| 222/224 [02:13<00:01,  1.58it/s]
Epoch 12 Iter 223: loss 0.18627. : 100%|██████████████████████████████████████████▊| 223/224 [02:13<00:00,  1.54it/s]
Epoch 12 Iter 224: loss 0.16168. : 100%|██████████████████████████████████████████▊| 223/224 [02:13<00:00,  1.54it/s]
Epoch 12 Iter 224: loss 0.16168. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.46it/s]
Epoch 12 Iter 224: loss 0.16168. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.67it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.17045. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.17045. :   0%|▏                                              | 1/224 [00:00<02:28,  1.50it/s]
Epoch 13 Iter 2: loss 0.16224. :   0%|▏                                              | 1/224 [00:01<02:28,  1.50it/s]
Epoch 13 Iter 2: loss 0.16224. :   1%|▍                                              | 2/224 [00:01<02:14,  1.65it/s]
Epoch 13 Iter 3: loss 0.15066. :   1%|▍                                              | 2/224 [00:01<02:14,  1.65it/s]
Epoch 13 Iter 3: loss 0.15066. :   1%|▋                                              | 3/224 [00:01<02:27,  1.50it/s]
Epoch 13 Iter 4: loss 0.18446. :   1%|▋                                              | 3/224 [00:02<02:27,  1.50it/s]
Epoch 13 Iter 4: loss 0.18446. :   2%|▊                                              | 4/224 [00:02<02:17,  1.60it/s]
Epoch 13 Iter 5: loss 0.17408. :   2%|▊                                              | 4/224 [00:03<02:17,  1.60it/s]
Epoch 13 Iter 5: loss 0.17408. :   2%|█                                              | 5/224 [00:03<02:14,  1.63it/s]
Epoch 13 Iter 6: loss 0.16780. :   2%|█                                              | 5/224 [00:03<02:14,  1.63it/s]
Epoch 13 Iter 6: loss 0.16780. :   3%|█▎                                             | 6/224 [00:03<02:07,  1.70it/s]
Epoch 13 Iter 7: loss 0.19136. :   3%|█▎                                             | 6/224 [00:04<02:07,  1.70it/s]
Epoch 13 Iter 7: loss 0.19136. :   3%|█▍                                             | 7/224 [00:04<02:16,  1.58it/s]
Epoch 13 Iter 8: loss 0.15092. :   3%|█▍                                             | 7/224 [00:05<02:16,  1.58it/s]
Epoch 13 Iter 8: loss 0.15092. :   4%|█▋                                             | 8/224 [00:05<02:20,  1.54it/s]
Epoch 13 Iter 9: loss 0.18477. :   4%|█▋                                             | 8/224 [00:05<02:20,  1.54it/s]
Epoch 13 Iter 9: loss 0.18477. :   4%|█▉                                             | 9/224 [00:05<02:20,  1.53it/s]
Epoch 13 Iter 10: loss 0.15341. :   4%|█▊                                            | 9/224 [00:06<02:20,  1.53it/s]
Epoch 13 Iter 10: loss 0.15341. :   4%|██                                           | 10/224 [00:06<02:12,  1.62it/s]
Epoch 13 Iter 11: loss 0.16098. :   4%|██                                           | 10/224 [00:06<02:12,  1.62it/s]
Epoch 13 Iter 11: loss 0.16098. :   5%|██▏                                          | 11/224 [00:06<02:07,  1.67it/s]
Epoch 13 Iter 12: loss 0.16581. :   5%|██▏                                          | 11/224 [00:07<02:07,  1.67it/s]
Epoch 13 Iter 12: loss 0.16581. :   5%|██▍                                          | 12/224 [00:07<02:14,  1.57it/s]
Epoch 13 Iter 13: loss 0.15387. :   5%|██▍                                          | 12/224 [00:08<02:14,  1.57it/s]
Epoch 13 Iter 13: loss 0.15387. :   6%|██▌                                          | 13/224 [00:08<02:09,  1.62it/s]
Epoch 13 Iter 14: loss 0.15379. :   6%|██▌                                          | 13/224 [00:08<02:09,  1.62it/s]
Epoch 13 Iter 14: loss 0.15379. :   6%|██▊                                          | 14/224 [00:08<02:18,  1.51it/s]
Epoch 13 Iter 15: loss 0.18058. :   6%|██▊                                          | 14/224 [00:09<02:18,  1.51it/s]
Epoch 13 Iter 15: loss 0.18058. :   7%|███                                          | 15/224 [00:09<02:24,  1.44it/s]
Epoch 13 Iter 16: loss 0.17639. :   7%|███                                          | 15/224 [00:10<02:24,  1.44it/s]
Epoch 13 Iter 16: loss 0.17639. :   7%|███▏                                         | 16/224 [00:10<02:28,  1.40it/s]
Epoch 13 Iter 17: loss 0.16858. :   7%|███▏                                         | 16/224 [00:11<02:28,  1.40it/s]
Epoch 13 Iter 17: loss 0.16858. :   8%|███▍                                         | 17/224 [00:11<02:25,  1.42it/s]
Epoch 13 Iter 18: loss 0.18102. :   8%|███▍                                         | 17/224 [00:11<02:25,  1.42it/s]
Epoch 13 Iter 18: loss 0.18102. :   8%|███▌                                         | 18/224 [00:11<02:15,  1.52it/s]
Epoch 13 Iter 19: loss 0.16748. :   8%|███▌                                         | 18/224 [00:12<02:15,  1.52it/s]
Epoch 13 Iter 19: loss 0.16748. :   8%|███▊                                         | 19/224 [00:12<02:08,  1.59it/s]
Epoch 13 Iter 20: loss 0.17938. :   8%|███▊                                         | 19/224 [00:12<02:08,  1.59it/s]
Epoch 13 Iter 20: loss 0.17938. :   9%|████                                         | 20/224 [00:12<02:02,  1.66it/s]
Epoch 13 Iter 21: loss 0.15897. :   9%|████                                         | 20/224 [00:13<02:02,  1.66it/s]
Epoch 13 Iter 21: loss 0.15897. :   9%|████▏                                        | 21/224 [00:13<02:14,  1.51it/s]
Epoch 13 Iter 22: loss 0.17721. :   9%|████▏                                        | 21/224 [00:14<02:14,  1.51it/s]
Epoch 13 Iter 22: loss 0.17721. :  10%|████▍                                        | 22/224 [00:14<02:07,  1.59it/s]
Epoch 13 Iter 23: loss 0.15248. :  10%|████▍                                        | 22/224 [00:14<02:07,  1.59it/s]
Epoch 13 Iter 23: loss 0.15248. :  10%|████▌                                        | 23/224 [00:14<02:05,  1.60it/s]
Epoch 13 Iter 24: loss 0.15285. :  10%|████▌                                        | 23/224 [00:15<02:05,  1.60it/s]
Epoch 13 Iter 24: loss 0.15285. :  11%|████▊                                        | 24/224 [00:15<02:12,  1.51it/s]
Epoch 13 Iter 25: loss 0.15168. :  11%|████▊                                        | 24/224 [00:16<02:12,  1.51it/s]
Epoch 13 Iter 25: loss 0.15168. :  11%|█████                                        | 25/224 [00:16<02:08,  1.55it/s]
Epoch 13 Iter 26: loss 0.14548. :  11%|█████                                        | 25/224 [00:16<02:08,  1.55it/s]
Epoch 13 Iter 26: loss 0.14548. :  12%|█████▏                                       | 26/224 [00:16<02:00,  1.65it/s]
Epoch 13 Iter 27: loss 0.16375. :  12%|█████▏                                       | 26/224 [00:17<02:00,  1.65it/s]
Epoch 13 Iter 27: loss 0.16375. :  12%|█████▍                                       | 27/224 [00:17<01:56,  1.68it/s]
Epoch 13 Iter 28: loss 0.17003. :  12%|█████▍                                       | 27/224 [00:17<01:56,  1.68it/s]
Epoch 13 Iter 28: loss 0.17003. :  12%|█████▋                                       | 28/224 [00:17<01:53,  1.72it/s]
Epoch 13 Iter 29: loss 0.17090. :  12%|█████▋                                       | 28/224 [00:18<01:53,  1.72it/s]
Epoch 13 Iter 29: loss 0.17090. :  13%|█████▊                                       | 29/224 [00:18<01:56,  1.68it/s]
Epoch 13 Iter 30: loss 0.14672. :  13%|█████▊                                       | 29/224 [00:18<01:56,  1.68it/s]
Epoch 13 Iter 30: loss 0.14672. :  13%|██████                                       | 30/224 [00:18<01:52,  1.73it/s]
Epoch 13 Iter 31: loss 0.16009. :  13%|██████                                       | 30/224 [00:19<01:52,  1.73it/s]
Epoch 13 Iter 31: loss 0.16009. :  14%|██████▏                                      | 31/224 [00:19<01:48,  1.77it/s]
Epoch 13 Iter 32: loss 0.15879. :  14%|██████▏                                      | 31/224 [00:19<01:48,  1.77it/s]
Epoch 13 Iter 32: loss 0.15879. :  14%|██████▍                                      | 32/224 [00:19<01:47,  1.78it/s]
Epoch 13 Iter 33: loss 0.16275. :  14%|██████▍                                      | 32/224 [00:20<01:47,  1.78it/s]
Epoch 13 Iter 33: loss 0.16275. :  15%|██████▋                                      | 33/224 [00:20<01:45,  1.80it/s]
Epoch 13 Iter 34: loss 0.17696. :  15%|██████▋                                      | 33/224 [00:21<01:45,  1.80it/s]
Epoch 13 Iter 34: loss 0.17696. :  15%|██████▊                                      | 34/224 [00:21<01:44,  1.82it/s]
Epoch 13 Iter 35: loss 0.16476. :  15%|██████▊                                      | 34/224 [00:21<01:44,  1.82it/s]
Epoch 13 Iter 35: loss 0.16476. :  16%|███████                                      | 35/224 [00:21<01:46,  1.78it/s]
Epoch 13 Iter 36: loss 0.18855. :  16%|███████                                      | 35/224 [00:22<01:46,  1.78it/s]
Epoch 13 Iter 36: loss 0.18855. :  16%|███████▏                                     | 36/224 [00:22<01:55,  1.63it/s]
Epoch 13 Iter 37: loss 0.17030. :  16%|███████▏                                     | 36/224 [00:23<01:55,  1.63it/s]
Epoch 13 Iter 37: loss 0.17030. :  17%|███████▍                                     | 37/224 [00:23<02:03,  1.52it/s]
Epoch 13 Iter 38: loss 0.15974. :  17%|███████▍                                     | 37/224 [00:23<02:03,  1.52it/s]
Epoch 13 Iter 38: loss 0.15974. :  17%|███████▋                                     | 38/224 [00:23<02:01,  1.53it/s]
Epoch 13 Iter 39: loss 0.17137. :  17%|███████▋                                     | 38/224 [00:24<02:01,  1.53it/s]
Epoch 13 Iter 39: loss 0.17137. :  17%|███████▊                                     | 39/224 [00:24<01:59,  1.55it/s]
Epoch 13 Iter 40: loss 0.18296. :  17%|███████▊                                     | 39/224 [00:25<01:59,  1.55it/s]
Epoch 13 Iter 40: loss 0.18296. :  18%|████████                                     | 40/224 [00:25<02:00,  1.52it/s]
Epoch 13 Iter 41: loss 0.15531. :  18%|████████                                     | 40/224 [00:25<02:00,  1.52it/s]
Epoch 13 Iter 41: loss 0.15531. :  18%|████████▏                                    | 41/224 [00:25<02:06,  1.44it/s]
Epoch 13 Iter 42: loss 0.16823. :  18%|████████▏                                    | 41/224 [00:26<02:06,  1.44it/s]
Epoch 13 Iter 42: loss 0.16823. :  19%|████████▍                                    | 42/224 [00:26<02:00,  1.50it/s]
Epoch 13 Iter 43: loss 0.18330. :  19%|████████▍                                    | 42/224 [00:27<02:00,  1.50it/s]
Epoch 13 Iter 43: loss 0.18330. :  19%|████████▋                                    | 43/224 [00:27<01:56,  1.55it/s]
Epoch 13 Iter 44: loss 0.16727. :  19%|████████▋                                    | 43/224 [00:27<01:56,  1.55it/s]
Epoch 13 Iter 44: loss 0.16727. :  20%|████████▊                                    | 44/224 [00:27<01:49,  1.64it/s]
Epoch 13 Iter 45: loss 0.14945. :  20%|████████▊                                    | 44/224 [00:28<01:49,  1.64it/s]
Epoch 13 Iter 45: loss 0.14945. :  20%|█████████                                    | 45/224 [00:28<01:45,  1.70it/s]
Epoch 13 Iter 46: loss 0.18685. :  20%|█████████                                    | 45/224 [00:28<01:45,  1.70it/s]
Epoch 13 Iter 46: loss 0.18685. :  21%|█████████▏                                   | 46/224 [00:28<01:42,  1.74it/s]
Epoch 13 Iter 47: loss 0.17252. :  21%|█████████▏                                   | 46/224 [00:29<01:42,  1.74it/s]
Epoch 13 Iter 47: loss 0.17252. :  21%|█████████▍                                   | 47/224 [00:29<01:44,  1.70it/s]
Epoch 13 Iter 48: loss 0.16504. :  21%|█████████▍                                   | 47/224 [00:29<01:44,  1.70it/s]
Epoch 13 Iter 48: loss 0.16504. :  21%|█████████▋                                   | 48/224 [00:29<01:40,  1.75it/s]
Epoch 13 Iter 49: loss 0.16083. :  21%|█████████▋                                   | 48/224 [00:30<01:40,  1.75it/s]
Epoch 13 Iter 49: loss 0.16083. :  22%|█████████▊                                   | 49/224 [00:30<01:48,  1.62it/s]
Epoch 13 Iter 50: loss 0.17473. :  22%|█████████▊                                   | 49/224 [00:31<01:48,  1.62it/s]
Epoch 13 Iter 50: loss 0.17473. :  22%|██████████                                   | 50/224 [00:31<01:44,  1.66it/s]
Epoch 13 Iter 51: loss 0.14787. :  22%|██████████                                   | 50/224 [00:31<01:44,  1.66it/s]
Epoch 13 Iter 51: loss 0.14787. :  23%|██████████▏                                  | 51/224 [00:31<01:39,  1.73it/s]
Epoch 13 Iter 52: loss 0.14886. :  23%|██████████▏                                  | 51/224 [00:32<01:39,  1.73it/s]
Epoch 13 Iter 52: loss 0.14886. :  23%|██████████▍                                  | 52/224 [00:32<01:48,  1.59it/s]
Epoch 13 Iter 53: loss 0.17932. :  23%|██████████▍                                  | 52/224 [00:33<01:48,  1.59it/s]
Epoch 13 Iter 53: loss 0.17932. :  24%|██████████▋                                  | 53/224 [00:33<01:53,  1.51it/s]
Epoch 13 Iter 54: loss 0.17659. :  24%|██████████▋                                  | 53/224 [00:33<01:53,  1.51it/s]
Epoch 13 Iter 54: loss 0.17659. :  24%|██████████▊                                  | 54/224 [00:33<01:58,  1.44it/s]
Epoch 13 Iter 55: loss 0.15762. :  24%|██████████▊                                  | 54/224 [00:34<01:58,  1.44it/s]
Epoch 13 Iter 55: loss 0.15762. :  25%|███████████                                  | 55/224 [00:34<02:01,  1.39it/s]
Epoch 13 Iter 56: loss 0.16393. :  25%|███████████                                  | 55/224 [00:35<02:01,  1.39it/s]
Epoch 13 Iter 56: loss 0.16393. :  25%|███████████▎                                 | 56/224 [00:35<01:54,  1.47it/s]
Epoch 13 Iter 57: loss 0.15423. :  25%|███████████▎                                 | 56/224 [00:35<01:54,  1.47it/s]
Epoch 13 Iter 57: loss 0.15423. :  25%|███████████▍                                 | 57/224 [00:35<01:47,  1.55it/s]
Epoch 13 Iter 58: loss 0.16299. :  25%|███████████▍                                 | 57/224 [00:36<01:47,  1.55it/s]
Epoch 13 Iter 58: loss 0.16299. :  26%|███████████▋                                 | 58/224 [00:36<01:45,  1.58it/s]
Epoch 13 Iter 59: loss 0.16464. :  26%|███████████▋                                 | 58/224 [00:36<01:45,  1.58it/s]
Epoch 13 Iter 59: loss 0.16464. :  26%|███████████▊                                 | 59/224 [00:36<01:40,  1.64it/s]
Epoch 13 Iter 60: loss 0.18518. :  26%|███████████▊                                 | 59/224 [00:37<01:40,  1.64it/s]
Epoch 13 Iter 60: loss 0.18518. :  27%|████████████                                 | 60/224 [00:37<01:37,  1.68it/s]
Epoch 13 Iter 61: loss 0.17034. :  27%|████████████                                 | 60/224 [00:38<01:37,  1.68it/s]
Epoch 13 Iter 61: loss 0.17034. :  27%|████████████▎                                | 61/224 [00:38<01:43,  1.58it/s]
Epoch 13 Iter 62: loss 0.18193. :  27%|████████████▎                                | 61/224 [00:38<01:43,  1.58it/s]
Epoch 13 Iter 62: loss 0.18193. :  28%|████████████▍                                | 62/224 [00:38<01:38,  1.64it/s]
Epoch 13 Iter 63: loss 0.16950. :  28%|████████████▍                                | 62/224 [00:39<01:38,  1.64it/s]
Epoch 13 Iter 63: loss 0.16950. :  28%|████████████▋                                | 63/224 [00:39<01:34,  1.70it/s]
Epoch 13 Iter 64: loss 0.16760. :  28%|████████████▋                                | 63/224 [00:39<01:34,  1.70it/s]
Epoch 13 Iter 64: loss 0.16760. :  29%|████████████▊                                | 64/224 [00:39<01:35,  1.68it/s]
Epoch 13 Iter 65: loss 0.15887. :  29%|████████████▊                                | 64/224 [00:40<01:35,  1.68it/s]
Epoch 13 Iter 65: loss 0.15887. :  29%|█████████████                                | 65/224 [00:40<01:35,  1.66it/s]
Epoch 13 Iter 66: loss 0.15447. :  29%|█████████████                                | 65/224 [00:41<01:35,  1.66it/s]
Epoch 13 Iter 66: loss 0.15447. :  29%|█████████████▎                               | 66/224 [00:41<01:32,  1.71it/s]
Epoch 13 Iter 67: loss 0.16819. :  29%|█████████████▎                               | 66/224 [00:41<01:32,  1.71it/s]
Epoch 13 Iter 67: loss 0.16819. :  30%|█████████████▍                               | 67/224 [00:41<01:37,  1.61it/s]
Epoch 13 Iter 68: loss 0.14647. :  30%|█████████████▍                               | 67/224 [00:42<01:37,  1.61it/s]
Epoch 13 Iter 68: loss 0.14647. :  30%|█████████████▋                               | 68/224 [00:42<01:35,  1.63it/s]
Epoch 13 Iter 69: loss 0.17425. :  30%|█████████████▋                               | 68/224 [00:42<01:35,  1.63it/s]
Epoch 13 Iter 69: loss 0.17425. :  31%|█████████████▊                               | 69/224 [00:42<01:32,  1.68it/s]
Epoch 13 Iter 70: loss 0.13994. :  31%|█████████████▊                               | 69/224 [00:43<01:32,  1.68it/s]
Epoch 13 Iter 70: loss 0.13994. :  31%|██████████████                               | 70/224 [00:43<01:30,  1.70it/s]
Epoch 13 Iter 71: loss 0.18649. :  31%|██████████████                               | 70/224 [00:44<01:30,  1.70it/s]
Epoch 13 Iter 71: loss 0.18649. :  32%|██████████████▎                              | 71/224 [00:44<01:30,  1.70it/s]
Epoch 13 Iter 72: loss 0.15748. :  32%|██████████████▎                              | 71/224 [00:44<01:30,  1.70it/s]
Epoch 13 Iter 72: loss 0.15748. :  32%|██████████████▍                              | 72/224 [00:44<01:35,  1.59it/s]
Epoch 13 Iter 73: loss 0.17786. :  32%|██████████████▍                              | 72/224 [00:45<01:35,  1.59it/s]
Epoch 13 Iter 73: loss 0.17786. :  33%|██████████████▋                              | 73/224 [00:45<01:36,  1.56it/s]
Epoch 13 Iter 74: loss 0.18723. :  33%|██████████████▋                              | 73/224 [00:46<01:36,  1.56it/s]
Epoch 13 Iter 74: loss 0.18723. :  33%|██████████████▊                              | 74/224 [00:46<01:42,  1.46it/s]
Epoch 13 Iter 75: loss 0.17279. :  33%|██████████████▊                              | 74/224 [00:47<01:42,  1.46it/s]
Epoch 13 Iter 75: loss 0.17279. :  33%|███████████████                              | 75/224 [00:47<01:45,  1.42it/s]
Epoch 13 Iter 76: loss 0.16112. :  33%|███████████████                              | 75/224 [00:47<01:45,  1.42it/s]
Epoch 13 Iter 76: loss 0.16112. :  34%|███████████████▎                             | 76/224 [00:47<01:37,  1.52it/s]
Epoch 13 Iter 77: loss 0.17007. :  34%|███████████████▎                             | 76/224 [00:48<01:37,  1.52it/s]
Epoch 13 Iter 77: loss 0.17007. :  34%|███████████████▍                             | 77/224 [00:48<01:31,  1.61it/s]
Epoch 13 Iter 78: loss 0.17815. :  34%|███████████████▍                             | 77/224 [00:48<01:31,  1.61it/s]
Epoch 13 Iter 78: loss 0.17815. :  35%|███████████████▋                             | 78/224 [00:48<01:36,  1.51it/s]
Epoch 13 Iter 79: loss 0.16755. :  35%|███████████████▋                             | 78/224 [00:49<01:36,  1.51it/s]
Epoch 13 Iter 79: loss 0.16755. :  35%|███████████████▊                             | 79/224 [00:49<01:41,  1.42it/s]
Epoch 13 Iter 80: loss 0.17472. :  35%|███████████████▊                             | 79/224 [00:50<01:41,  1.42it/s]
Epoch 13 Iter 80: loss 0.17472. :  36%|████████████████                             | 80/224 [00:50<01:36,  1.49it/s]
Epoch 13 Iter 81: loss 0.18299. :  36%|████████████████                             | 80/224 [00:50<01:36,  1.49it/s]
Epoch 13 Iter 81: loss 0.18299. :  36%|████████████████▎                            | 81/224 [00:50<01:35,  1.49it/s]
Epoch 13 Iter 82: loss 0.16317. :  36%|████████████████▎                            | 81/224 [00:51<01:35,  1.49it/s]
Epoch 13 Iter 82: loss 0.16317. :  37%|████████████████▍                            | 82/224 [00:51<01:32,  1.53it/s]
Epoch 13 Iter 83: loss 0.16411. :  37%|████████████████▍                            | 82/224 [00:52<01:32,  1.53it/s]
Epoch 13 Iter 83: loss 0.16411. :  37%|████████████████▋                            | 83/224 [00:52<01:27,  1.62it/s]
Epoch 13 Iter 84: loss 0.18187. :  37%|████████████████▋                            | 83/224 [00:52<01:27,  1.62it/s]
Epoch 13 Iter 84: loss 0.18187. :  38%|████████████████▉                            | 84/224 [00:52<01:23,  1.68it/s]
Epoch 13 Iter 85: loss 0.17467. :  38%|████████████████▉                            | 84/224 [00:53<01:23,  1.68it/s]
Epoch 13 Iter 85: loss 0.17467. :  38%|█████████████████                            | 85/224 [00:53<01:23,  1.66it/s]
Epoch 13 Iter 86: loss 0.16427. :  38%|█████████████████                            | 85/224 [00:53<01:23,  1.66it/s]
Epoch 13 Iter 86: loss 0.16427. :  38%|█████████████████▎                           | 86/224 [00:53<01:23,  1.66it/s]
Epoch 13 Iter 87: loss 0.16618. :  38%|█████████████████▎                           | 86/224 [00:54<01:23,  1.66it/s]
Epoch 13 Iter 87: loss 0.16618. :  39%|█████████████████▍                           | 87/224 [00:54<01:20,  1.70it/s]
Epoch 13 Iter 88: loss 0.16917. :  39%|█████████████████▍                           | 87/224 [00:55<01:20,  1.70it/s]
Epoch 13 Iter 88: loss 0.16917. :  39%|█████████████████▋                           | 88/224 [00:55<01:22,  1.64it/s]
Epoch 13 Iter 89: loss 0.17696. :  39%|█████████████████▋                           | 88/224 [00:55<01:22,  1.64it/s]
Epoch 13 Iter 89: loss 0.17696. :  40%|█████████████████▉                           | 89/224 [00:55<01:19,  1.71it/s]
Epoch 13 Iter 90: loss 0.16462. :  40%|█████████████████▉                           | 89/224 [00:56<01:19,  1.71it/s]
Epoch 13 Iter 90: loss 0.16462. :  40%|██████████████████                           | 90/224 [00:56<01:20,  1.67it/s]
Epoch 13 Iter 91: loss 0.15784. :  40%|██████████████████                           | 90/224 [00:56<01:20,  1.67it/s]
Epoch 13 Iter 91: loss 0.15784. :  41%|██████████████████▎                          | 91/224 [00:56<01:16,  1.73it/s]
Epoch 13 Iter 92: loss 0.17181. :  41%|██████████████████▎                          | 91/224 [00:57<01:16,  1.73it/s]
Epoch 13 Iter 92: loss 0.17181. :  41%|██████████████████▍                          | 92/224 [00:57<01:15,  1.74it/s]
Epoch 13 Iter 93: loss 0.18032. :  41%|██████████████████▍                          | 92/224 [00:57<01:15,  1.74it/s]
Epoch 13 Iter 93: loss 0.18032. :  42%|██████████████████▋                          | 93/224 [00:57<01:17,  1.69it/s]
Epoch 13 Iter 94: loss 0.17191. :  42%|██████████████████▋                          | 93/224 [00:58<01:17,  1.69it/s]
Epoch 13 Iter 94: loss 0.17191. :  42%|██████████████████▉                          | 94/224 [00:58<01:18,  1.66it/s]
Epoch 13 Iter 95: loss 0.17802. :  42%|██████████████████▉                          | 94/224 [00:59<01:18,  1.66it/s]
Epoch 13 Iter 95: loss 0.17802. :  42%|███████████████████                          | 95/224 [00:59<01:17,  1.67it/s]
Epoch 13 Iter 96: loss 0.17624. :  42%|███████████████████                          | 95/224 [00:59<01:17,  1.67it/s]
Epoch 13 Iter 96: loss 0.17624. :  43%|███████████████████▎                         | 96/224 [00:59<01:14,  1.72it/s]
Epoch 13 Iter 97: loss 0.17231. :  43%|███████████████████▎                         | 96/224 [01:00<01:14,  1.72it/s]
Epoch 13 Iter 97: loss 0.17231. :  43%|███████████████████▍                         | 97/224 [01:00<01:21,  1.57it/s]
Epoch 13 Iter 98: loss 0.19110. :  43%|███████████████████▍                         | 97/224 [01:01<01:21,  1.57it/s]
Epoch 13 Iter 98: loss 0.19110. :  44%|███████████████████▋                         | 98/224 [01:01<01:17,  1.63it/s]
Epoch 13 Iter 99: loss 0.16134. :  44%|███████████████████▋                         | 98/224 [01:01<01:17,  1.63it/s]
Epoch 13 Iter 99: loss 0.16134. :  44%|███████████████████▉                         | 99/224 [01:01<01:16,  1.64it/s]
Epoch 13 Iter 100: loss 0.17457. :  44%|███████████████████▍                        | 99/224 [01:02<01:16,  1.64it/s]
Epoch 13 Iter 100: loss 0.17457. :  45%|███████████████████▏                       | 100/224 [01:02<01:14,  1.66it/s]
Epoch 13 Iter 101: loss 0.16929. :  45%|███████████████████▏                       | 100/224 [01:02<01:14,  1.66it/s]
Epoch 13 Iter 101: loss 0.16929. :  45%|███████████████████▍                       | 101/224 [01:02<01:13,  1.68it/s]
Epoch 13 Iter 102: loss 0.16996. :  45%|███████████████████▍                       | 101/224 [01:03<01:13,  1.68it/s]
Epoch 13 Iter 102: loss 0.16996. :  46%|███████████████████▌                       | 102/224 [01:03<01:11,  1.71it/s]
Epoch 13 Iter 103: loss 0.16322. :  46%|███████████████████▌                       | 102/224 [01:03<01:11,  1.71it/s]
Epoch 13 Iter 103: loss 0.16322. :  46%|███████████████████▊                       | 103/224 [01:03<01:09,  1.75it/s]
Epoch 13 Iter 104: loss 0.18568. :  46%|███████████████████▊                       | 103/224 [01:04<01:09,  1.75it/s]
Epoch 13 Iter 104: loss 0.18568. :  46%|███████████████████▉                       | 104/224 [01:04<01:08,  1.76it/s]
Epoch 13 Iter 105: loss 0.16483. :  46%|███████████████████▉                       | 104/224 [01:05<01:08,  1.76it/s]
Epoch 13 Iter 105: loss 0.16483. :  47%|████████████████████▏                      | 105/224 [01:05<01:11,  1.66it/s]
Epoch 13 Iter 106: loss 0.15732. :  47%|████████████████████▏                      | 105/224 [01:05<01:11,  1.66it/s]
Epoch 13 Iter 106: loss 0.15732. :  47%|████████████████████▎                      | 106/224 [01:05<01:10,  1.67it/s]
Epoch 13 Iter 107: loss 0.16628. :  47%|████████████████████▎                      | 106/224 [01:06<01:10,  1.67it/s]
Epoch 13 Iter 107: loss 0.16628. :  48%|████████████████████▌                      | 107/224 [01:06<01:08,  1.72it/s]
Epoch 13 Iter 108: loss 0.15248. :  48%|████████████████████▌                      | 107/224 [01:06<01:08,  1.72it/s]
Epoch 13 Iter 108: loss 0.15248. :  48%|████████████████████▋                      | 108/224 [01:06<01:06,  1.73it/s]
Epoch 13 Iter 109: loss 0.16944. :  48%|████████████████████▋                      | 108/224 [01:07<01:06,  1.73it/s]
Epoch 13 Iter 109: loss 0.16944. :  49%|████████████████████▉                      | 109/224 [01:07<01:05,  1.75it/s]
Epoch 13 Iter 110: loss 0.16375. :  49%|████████████████████▉                      | 109/224 [01:07<01:05,  1.75it/s]
Epoch 13 Iter 110: loss 0.16375. :  49%|█████████████████████                      | 110/224 [01:07<01:03,  1.78it/s]
Epoch 13 Iter 111: loss 0.16787. :  49%|█████████████████████                      | 110/224 [01:08<01:03,  1.78it/s]
Epoch 13 Iter 111: loss 0.16787. :  50%|█████████████████████▎                     | 111/224 [01:08<01:03,  1.77it/s]
Epoch 13 Iter 112: loss 0.15823. :  50%|█████████████████████▎                     | 111/224 [01:09<01:03,  1.77it/s]
Epoch 13 Iter 112: loss 0.15823. :  50%|█████████████████████▌                     | 112/224 [01:09<01:02,  1.78it/s]
Epoch 13 Iter 113: loss 0.15542. :  50%|█████████████████████▌                     | 112/224 [01:09<01:02,  1.78it/s]
Epoch 13 Iter 113: loss 0.15542. :  50%|█████████████████████▋                     | 113/224 [01:09<01:03,  1.75it/s]
Epoch 13 Iter 114: loss 0.18513. :  50%|█████████████████████▋                     | 113/224 [01:10<01:03,  1.75it/s]
Epoch 13 Iter 114: loss 0.18513. :  51%|█████████████████████▉                     | 114/224 [01:10<01:01,  1.78it/s]
Epoch 13 Iter 115: loss 0.17381. :  51%|█████████████████████▉                     | 114/224 [01:10<01:01,  1.78it/s]
Epoch 13 Iter 115: loss 0.17381. :  51%|██████████████████████                     | 115/224 [01:10<01:05,  1.67it/s]
Epoch 13 Iter 116: loss 0.16237. :  51%|██████████████████████                     | 115/224 [01:11<01:05,  1.67it/s]
Epoch 13 Iter 116: loss 0.16237. :  52%|██████████████████████▎                    | 116/224 [01:11<01:02,  1.72it/s]
Epoch 13 Iter 117: loss 0.17107. :  52%|██████████████████████▎                    | 116/224 [01:11<01:02,  1.72it/s]
Epoch 13 Iter 117: loss 0.17107. :  52%|██████████████████████▍                    | 117/224 [01:11<00:59,  1.79it/s]
Epoch 13 Iter 118: loss 0.16879. :  52%|██████████████████████▍                    | 117/224 [01:12<00:59,  1.79it/s]
Epoch 13 Iter 118: loss 0.16879. :  53%|██████████████████████▋                    | 118/224 [01:12<00:57,  1.85it/s]
Epoch 13 Iter 119: loss 0.18815. :  53%|██████████████████████▋                    | 118/224 [01:13<00:57,  1.85it/s]
Epoch 13 Iter 119: loss 0.18815. :  53%|██████████████████████▊                    | 119/224 [01:13<00:57,  1.83it/s]
Epoch 13 Iter 120: loss 0.17980. :  53%|██████████████████████▊                    | 119/224 [01:13<00:57,  1.83it/s]
Epoch 13 Iter 120: loss 0.17980. :  54%|███████████████████████                    | 120/224 [01:13<00:55,  1.86it/s]
Epoch 13 Iter 121: loss 0.16663. :  54%|███████████████████████                    | 120/224 [01:14<00:55,  1.86it/s]
Epoch 13 Iter 121: loss 0.16663. :  54%|███████████████████████▏                   | 121/224 [01:14<00:53,  1.91it/s]
Epoch 13 Iter 122: loss 0.16044. :  54%|███████████████████████▏                   | 121/224 [01:14<00:53,  1.91it/s]
Epoch 13 Iter 122: loss 0.16044. :  54%|███████████████████████▍                   | 122/224 [01:14<00:52,  1.93it/s]
Epoch 13 Iter 123: loss 0.16768. :  54%|███████████████████████▍                   | 122/224 [01:15<00:52,  1.93it/s]
Epoch 13 Iter 123: loss 0.16768. :  55%|███████████████████████▌                   | 123/224 [01:15<00:51,  1.95it/s]
Epoch 13 Iter 124: loss 0.16588. :  55%|███████████████████████▌                   | 123/224 [01:15<00:51,  1.95it/s]
Epoch 13 Iter 124: loss 0.16588. :  55%|███████████████████████▊                   | 124/224 [01:15<00:50,  1.97it/s]
Epoch 13 Iter 125: loss 0.16795. :  55%|███████████████████████▊                   | 124/224 [01:16<00:50,  1.97it/s]
Epoch 13 Iter 125: loss 0.16795. :  56%|███████████████████████▉                   | 125/224 [01:16<00:50,  1.98it/s]
Epoch 13 Iter 126: loss 0.17711. :  56%|███████████████████████▉                   | 125/224 [01:16<00:50,  1.98it/s]
Epoch 13 Iter 126: loss 0.17711. :  56%|████████████████████████▏                  | 126/224 [01:16<00:50,  1.95it/s]
Epoch 13 Iter 127: loss 0.15987. :  56%|████████████████████████▏                  | 126/224 [01:17<00:50,  1.95it/s]
Epoch 13 Iter 127: loss 0.15987. :  57%|████████████████████████▍                  | 127/224 [01:17<00:49,  1.95it/s]
Epoch 13 Iter 128: loss 0.18619. :  57%|████████████████████████▍                  | 127/224 [01:17<00:49,  1.95it/s]
Epoch 13 Iter 128: loss 0.18619. :  57%|████████████████████████▌                  | 128/224 [01:17<00:48,  1.96it/s]
Epoch 13 Iter 129: loss 0.16887. :  57%|████████████████████████▌                  | 128/224 [01:18<00:48,  1.96it/s]
Epoch 13 Iter 129: loss 0.16887. :  58%|████████████████████████▊                  | 129/224 [01:18<00:48,  1.97it/s]
Epoch 13 Iter 130: loss 0.16704. :  58%|████████████████████████▊                  | 129/224 [01:18<00:48,  1.97it/s]
Epoch 13 Iter 130: loss 0.16704. :  58%|████████████████████████▉                  | 130/224 [01:18<00:47,  1.97it/s]
Epoch 13 Iter 131: loss 0.16628. :  58%|████████████████████████▉                  | 130/224 [01:19<00:47,  1.97it/s]
Epoch 13 Iter 131: loss 0.16628. :  58%|█████████████████████████▏                 | 131/224 [01:19<00:47,  1.96it/s]
Epoch 13 Iter 132: loss 0.18075. :  58%|█████████████████████████▏                 | 131/224 [01:19<00:47,  1.96it/s]
Epoch 13 Iter 132: loss 0.18075. :  59%|█████████████████████████▎                 | 132/224 [01:19<00:46,  1.97it/s]
Epoch 13 Iter 133: loss 0.16360. :  59%|█████████████████████████▎                 | 132/224 [01:20<00:46,  1.97it/s]
Epoch 13 Iter 133: loss 0.16360. :  59%|█████████████████████████▌                 | 133/224 [01:20<00:46,  1.98it/s]
Epoch 13 Iter 134: loss 0.15559. :  59%|█████████████████████████▌                 | 133/224 [01:20<00:46,  1.98it/s]
Epoch 13 Iter 134: loss 0.15559. :  60%|█████████████████████████▋                 | 134/224 [01:20<00:49,  1.81it/s]
Epoch 13 Iter 135: loss 0.17180. :  60%|█████████████████████████▋                 | 134/224 [01:21<00:49,  1.81it/s]
Epoch 13 Iter 135: loss 0.17180. :  60%|█████████████████████████▉                 | 135/224 [01:21<00:49,  1.81it/s]
Epoch 13 Iter 136: loss 0.15825. :  60%|█████████████████████████▉                 | 135/224 [01:21<00:49,  1.81it/s]
Epoch 13 Iter 136: loss 0.15825. :  61%|██████████████████████████                 | 136/224 [01:21<00:47,  1.85it/s]
Epoch 13 Iter 137: loss 0.17598. :  61%|██████████████████████████                 | 136/224 [01:22<00:47,  1.85it/s]
Epoch 13 Iter 137: loss 0.17598. :  61%|██████████████████████████▎                | 137/224 [01:22<00:46,  1.89it/s]
Epoch 13 Iter 138: loss 0.18894. :  61%|██████████████████████████▎                | 137/224 [01:22<00:46,  1.89it/s]
Epoch 13 Iter 138: loss 0.18894. :  62%|██████████████████████████▍                | 138/224 [01:22<00:44,  1.92it/s]
Epoch 13 Iter 139: loss 0.16146. :  62%|██████████████████████████▍                | 138/224 [01:23<00:44,  1.92it/s]
Epoch 13 Iter 139: loss 0.16146. :  62%|██████████████████████████▋                | 139/224 [01:23<00:43,  1.94it/s]
Epoch 13 Iter 140: loss 0.15062. :  62%|██████████████████████████▋                | 139/224 [01:23<00:43,  1.94it/s]
Epoch 13 Iter 140: loss 0.15062. :  62%|██████████████████████████▉                | 140/224 [01:23<00:43,  1.95it/s]
Epoch 13 Iter 141: loss 0.15837. :  62%|██████████████████████████▉                | 140/224 [01:24<00:43,  1.95it/s]
Epoch 13 Iter 141: loss 0.15837. :  63%|███████████████████████████                | 141/224 [01:24<00:43,  1.92it/s]
Epoch 13 Iter 142: loss 0.18219. :  63%|███████████████████████████                | 141/224 [01:24<00:43,  1.92it/s]
Epoch 13 Iter 142: loss 0.18219. :  63%|███████████████████████████▎               | 142/224 [01:24<00:42,  1.94it/s]
Epoch 13 Iter 143: loss 0.15718. :  63%|███████████████████████████▎               | 142/224 [01:25<00:42,  1.94it/s]
Epoch 13 Iter 143: loss 0.15718. :  64%|███████████████████████████▍               | 143/224 [01:25<00:41,  1.96it/s]
Epoch 13 Iter 144: loss 0.19588. :  64%|███████████████████████████▍               | 143/224 [01:25<00:41,  1.96it/s]
Epoch 13 Iter 144: loss 0.19588. :  64%|███████████████████████████▋               | 144/224 [01:25<00:40,  1.97it/s]
Epoch 13 Iter 145: loss 0.17524. :  64%|███████████████████████████▋               | 144/224 [01:26<00:40,  1.97it/s]
Epoch 13 Iter 145: loss 0.17524. :  65%|███████████████████████████▊               | 145/224 [01:26<00:40,  1.97it/s]
Epoch 13 Iter 146: loss 0.17829. :  65%|███████████████████████████▊               | 145/224 [01:26<00:40,  1.97it/s]
Epoch 13 Iter 146: loss 0.17829. :  65%|████████████████████████████               | 146/224 [01:26<00:39,  1.96it/s]
Epoch 13 Iter 147: loss 0.15509. :  65%|████████████████████████████               | 146/224 [01:27<00:39,  1.96it/s]
Epoch 13 Iter 147: loss 0.15509. :  66%|████████████████████████████▏              | 147/224 [01:27<00:39,  1.95it/s]
Epoch 13 Iter 148: loss 0.15776. :  66%|████████████████████████████▏              | 147/224 [01:27<00:39,  1.95it/s]
Epoch 13 Iter 148: loss 0.15776. :  66%|████████████████████████████▍              | 148/224 [01:27<00:40,  1.88it/s]
Epoch 13 Iter 149: loss 0.16834. :  66%|████████████████████████████▍              | 148/224 [01:28<00:40,  1.88it/s]
Epoch 13 Iter 149: loss 0.16834. :  67%|████████████████████████████▌              | 149/224 [01:28<00:39,  1.92it/s]
Epoch 13 Iter 150: loss 0.18471. :  67%|████████████████████████████▌              | 149/224 [01:29<00:39,  1.92it/s]
Epoch 13 Iter 150: loss 0.18471. :  67%|████████████████████████████▊              | 150/224 [01:29<00:38,  1.93it/s]
Epoch 13 Iter 151: loss 0.17173. :  67%|████████████████████████████▊              | 150/224 [01:29<00:38,  1.93it/s]
Epoch 13 Iter 151: loss 0.17173. :  67%|████████████████████████████▉              | 151/224 [01:29<00:37,  1.93it/s]
Epoch 13 Iter 152: loss 0.15691. :  67%|████████████████████████████▉              | 151/224 [01:30<00:37,  1.93it/s]
Epoch 13 Iter 152: loss 0.15691. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:37,  1.94it/s]
Epoch 13 Iter 153: loss 0.18099. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:37,  1.94it/s]
Epoch 13 Iter 153: loss 0.18099. :  68%|█████████████████████████████▎             | 153/224 [01:30<00:36,  1.97it/s]
Epoch 13 Iter 154: loss 0.17958. :  68%|█████████████████████████████▎             | 153/224 [01:31<00:36,  1.97it/s]
Epoch 13 Iter 154: loss 0.17958. :  69%|█████████████████████████████▌             | 154/224 [01:31<00:35,  1.98it/s]
Epoch 13 Iter 155: loss 0.17746. :  69%|█████████████████████████████▌             | 154/224 [01:31<00:35,  1.98it/s]
Epoch 13 Iter 155: loss 0.17746. :  69%|█████████████████████████████▊             | 155/224 [01:31<00:35,  1.97it/s]
Epoch 13 Iter 156: loss 0.15306. :  69%|█████████████████████████████▊             | 155/224 [01:32<00:35,  1.97it/s]
Epoch 13 Iter 156: loss 0.15306. :  70%|█████████████████████████████▉             | 156/224 [01:32<00:34,  1.97it/s]
Epoch 13 Iter 157: loss 0.16885. :  70%|█████████████████████████████▉             | 156/224 [01:32<00:34,  1.97it/s]
Epoch 13 Iter 157: loss 0.16885. :  70%|██████████████████████████████▏            | 157/224 [01:32<00:34,  1.95it/s]
Epoch 13 Iter 158: loss 0.16287. :  70%|██████████████████████████████▏            | 157/224 [01:33<00:34,  1.95it/s]
Epoch 13 Iter 158: loss 0.16287. :  71%|██████████████████████████████▎            | 158/224 [01:33<00:33,  1.96it/s]
Epoch 13 Iter 159: loss 0.16445. :  71%|██████████████████████████████▎            | 158/224 [01:33<00:33,  1.96it/s]
Epoch 13 Iter 159: loss 0.16445. :  71%|██████████████████████████████▌            | 159/224 [01:33<00:33,  1.95it/s]
Epoch 13 Iter 160: loss 0.17275. :  71%|██████████████████████████████▌            | 159/224 [01:34<00:33,  1.95it/s]
Epoch 13 Iter 160: loss 0.17275. :  71%|██████████████████████████████▋            | 160/224 [01:34<00:32,  1.96it/s]
Epoch 13 Iter 161: loss 0.17082. :  71%|██████████████████████████████▋            | 160/224 [01:34<00:32,  1.96it/s]
Epoch 13 Iter 161: loss 0.17082. :  72%|██████████████████████████████▉            | 161/224 [01:34<00:31,  1.97it/s]
Epoch 13 Iter 162: loss 0.18027. :  72%|██████████████████████████████▉            | 161/224 [01:35<00:31,  1.97it/s]
Epoch 13 Iter 162: loss 0.18027. :  72%|███████████████████████████████            | 162/224 [01:35<00:31,  1.97it/s]
Epoch 13 Iter 163: loss 0.15805. :  72%|███████████████████████████████            | 162/224 [01:35<00:31,  1.97it/s]
Epoch 13 Iter 163: loss 0.15805. :  73%|███████████████████████████████▎           | 163/224 [01:35<00:30,  1.98it/s]
Epoch 13 Iter 164: loss 0.18923. :  73%|███████████████████████████████▎           | 163/224 [01:36<00:30,  1.98it/s]
Epoch 13 Iter 164: loss 0.18923. :  73%|███████████████████████████████▍           | 164/224 [01:36<00:33,  1.80it/s]
Epoch 13 Iter 165: loss 0.18528. :  73%|███████████████████████████████▍           | 164/224 [01:36<00:33,  1.80it/s]
Epoch 13 Iter 165: loss 0.18528. :  74%|███████████████████████████████▋           | 165/224 [01:36<00:34,  1.69it/s]
Epoch 13 Iter 166: loss 0.15972. :  74%|███████████████████████████████▋           | 165/224 [01:37<00:34,  1.69it/s]
Epoch 13 Iter 166: loss 0.15972. :  74%|███████████████████████████████▊           | 166/224 [01:37<00:34,  1.70it/s]
Epoch 13 Iter 167: loss 0.17014. :  74%|███████████████████████████████▊           | 166/224 [01:38<00:34,  1.70it/s]
Epoch 13 Iter 167: loss 0.17014. :  75%|████████████████████████████████           | 167/224 [01:38<00:35,  1.59it/s]
Epoch 13 Iter 168: loss 0.17451. :  75%|████████████████████████████████           | 167/224 [01:39<00:35,  1.59it/s]
Epoch 13 Iter 168: loss 0.17451. :  75%|████████████████████████████████▎          | 168/224 [01:39<00:37,  1.50it/s]
Epoch 13 Iter 169: loss 0.17884. :  75%|████████████████████████████████▎          | 168/224 [01:39<00:37,  1.50it/s]
Epoch 13 Iter 169: loss 0.17884. :  75%|████████████████████████████████▍          | 169/224 [01:39<00:38,  1.44it/s]
Epoch 13 Iter 170: loss 0.17487. :  75%|████████████████████████████████▍          | 169/224 [01:40<00:38,  1.44it/s]
Epoch 13 Iter 170: loss 0.17487. :  76%|████████████████████████████████▋          | 170/224 [01:40<00:35,  1.54it/s]
Epoch 13 Iter 171: loss 0.17121. :  76%|████████████████████████████████▋          | 170/224 [01:40<00:35,  1.54it/s]
Epoch 13 Iter 171: loss 0.17121. :  76%|████████████████████████████████▊          | 171/224 [01:40<00:32,  1.63it/s]
Epoch 13 Iter 172: loss 0.16671. :  76%|████████████████████████████████▊          | 171/224 [01:41<00:32,  1.63it/s]
Epoch 13 Iter 172: loss 0.16671. :  77%|█████████████████████████████████          | 172/224 [01:41<00:30,  1.69it/s]
Epoch 13 Iter 173: loss 0.17881. :  77%|█████████████████████████████████          | 172/224 [01:41<00:30,  1.69it/s]
Epoch 13 Iter 173: loss 0.17881. :  77%|█████████████████████████████████▏         | 173/224 [01:41<00:30,  1.68it/s]
Epoch 13 Iter 174: loss 0.17340. :  77%|█████████████████████████████████▏         | 173/224 [01:42<00:30,  1.68it/s]
Epoch 13 Iter 174: loss 0.17340. :  78%|█████████████████████████████████▍         | 174/224 [01:42<00:31,  1.59it/s]
Epoch 13 Iter 175: loss 0.19170. :  78%|█████████████████████████████████▍         | 174/224 [01:43<00:31,  1.59it/s]
Epoch 13 Iter 175: loss 0.19170. :  78%|█████████████████████████████████▌         | 175/224 [01:43<00:30,  1.62it/s]
Epoch 13 Iter 176: loss 0.15830. :  78%|█████████████████████████████████▌         | 175/224 [01:43<00:30,  1.62it/s]
Epoch 13 Iter 176: loss 0.15830. :  79%|█████████████████████████████████▊         | 176/224 [01:43<00:29,  1.61it/s]
Epoch 13 Iter 177: loss 0.16637. :  79%|█████████████████████████████████▊         | 176/224 [01:44<00:29,  1.61it/s]
Epoch 13 Iter 177: loss 0.16637. :  79%|█████████████████████████████████▉         | 177/224 [01:44<00:28,  1.67it/s]
Epoch 13 Iter 178: loss 0.17616. :  79%|█████████████████████████████████▉         | 177/224 [01:44<00:28,  1.67it/s]
Epoch 13 Iter 178: loss 0.17616. :  79%|██████████████████████████████████▏        | 178/224 [01:44<00:26,  1.73it/s]
Epoch 13 Iter 179: loss 0.16275. :  79%|██████████████████████████████████▏        | 178/224 [01:45<00:26,  1.73it/s]
Epoch 13 Iter 179: loss 0.16275. :  80%|██████████████████████████████████▎        | 179/224 [01:45<00:25,  1.78it/s]
Epoch 13 Iter 180: loss 0.18107. :  80%|██████████████████████████████████▎        | 179/224 [01:46<00:25,  1.78it/s]
Epoch 13 Iter 180: loss 0.18107. :  80%|██████████████████████████████████▌        | 180/224 [01:46<00:24,  1.80it/s]
Epoch 13 Iter 181: loss 0.16790. :  80%|██████████████████████████████████▌        | 180/224 [01:46<00:24,  1.80it/s]
Epoch 13 Iter 181: loss 0.16790. :  81%|██████████████████████████████████▋        | 181/224 [01:46<00:24,  1.79it/s]
Epoch 13 Iter 182: loss 0.17458. :  81%|██████████████████████████████████▋        | 181/224 [01:47<00:24,  1.79it/s]
Epoch 13 Iter 182: loss 0.17458. :  81%|██████████████████████████████████▉        | 182/224 [01:47<00:23,  1.80it/s]
Epoch 13 Iter 183: loss 0.17583. :  81%|██████████████████████████████████▉        | 182/224 [01:47<00:23,  1.80it/s]
Epoch 13 Iter 183: loss 0.17583. :  82%|███████████████████████████████████▏       | 183/224 [01:47<00:25,  1.64it/s]
Epoch 13 Iter 184: loss 0.16778. :  82%|███████████████████████████████████▏       | 183/224 [01:48<00:25,  1.64it/s]
Epoch 13 Iter 184: loss 0.16778. :  82%|███████████████████████████████████▎       | 184/224 [01:48<00:25,  1.57it/s]
Epoch 13 Iter 185: loss 0.17835. :  82%|███████████████████████████████████▎       | 184/224 [01:49<00:25,  1.57it/s]
Epoch 13 Iter 185: loss 0.17835. :  83%|███████████████████████████████████▌       | 185/224 [01:49<00:23,  1.66it/s]
Epoch 13 Iter 186: loss 0.19991. :  83%|███████████████████████████████████▌       | 185/224 [01:49<00:23,  1.66it/s]
Epoch 13 Iter 186: loss 0.19991. :  83%|███████████████████████████████████▋       | 186/224 [01:49<00:24,  1.54it/s]
Epoch 13 Iter 187: loss 0.16585. :  83%|███████████████████████████████████▋       | 186/224 [01:50<00:24,  1.54it/s]
Epoch 13 Iter 187: loss 0.16585. :  83%|███████████████████████████████████▉       | 187/224 [01:50<00:23,  1.54it/s]
Epoch 13 Iter 188: loss 0.17456. :  83%|███████████████████████████████████▉       | 187/224 [01:51<00:23,  1.54it/s]
Epoch 13 Iter 188: loss 0.17456. :  84%|████████████████████████████████████       | 188/224 [01:51<00:22,  1.59it/s]
Epoch 13 Iter 189: loss 0.19126. :  84%|████████████████████████████████████       | 188/224 [01:51<00:22,  1.59it/s]
Epoch 13 Iter 189: loss 0.19126. :  84%|████████████████████████████████████▎      | 189/224 [01:51<00:23,  1.49it/s]
Epoch 13 Iter 190: loss 0.17049. :  84%|████████████████████████████████████▎      | 189/224 [01:52<00:23,  1.49it/s]
Epoch 13 Iter 190: loss 0.17049. :  85%|████████████████████████████████████▍      | 190/224 [01:52<00:21,  1.55it/s]
Epoch 13 Iter 191: loss 0.17601. :  85%|████████████████████████████████████▍      | 190/224 [01:53<00:21,  1.55it/s]
Epoch 13 Iter 191: loss 0.17601. :  85%|████████████████████████████████████▋      | 191/224 [01:53<00:20,  1.62it/s]
Epoch 13 Iter 192: loss 0.16416. :  85%|████████████████████████████████████▋      | 191/224 [01:53<00:20,  1.62it/s]
Epoch 13 Iter 192: loss 0.16416. :  86%|████████████████████████████████████▊      | 192/224 [01:53<00:21,  1.51it/s]
Epoch 13 Iter 193: loss 0.15651. :  86%|████████████████████████████████████▊      | 192/224 [01:54<00:21,  1.51it/s]
Epoch 13 Iter 193: loss 0.15651. :  86%|█████████████████████████████████████      | 193/224 [01:54<00:20,  1.50it/s]
Epoch 13 Iter 194: loss 0.17810. :  86%|█████████████████████████████████████      | 193/224 [01:55<00:20,  1.50it/s]
Epoch 13 Iter 194: loss 0.17810. :  87%|█████████████████████████████████████▏     | 194/224 [01:55<00:20,  1.47it/s]
Epoch 13 Iter 195: loss 0.16183. :  87%|█████████████████████████████████████▏     | 194/224 [01:55<00:20,  1.47it/s]
Epoch 13 Iter 195: loss 0.16183. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:20,  1.42it/s]
Epoch 13 Iter 196: loss 0.18077. :  87%|█████████████████████████████████████▍     | 195/224 [01:56<00:20,  1.42it/s]
Epoch 13 Iter 196: loss 0.18077. :  88%|█████████████████████████████████████▋     | 196/224 [01:56<00:18,  1.52it/s]
Epoch 13 Iter 197: loss 0.17268. :  88%|█████████████████████████████████████▋     | 196/224 [01:57<00:18,  1.52it/s]
Epoch 13 Iter 197: loss 0.17268. :  88%|█████████████████████████████████████▊     | 197/224 [01:57<00:18,  1.49it/s]
Epoch 13 Iter 198: loss 0.18425. :  88%|█████████████████████████████████████▊     | 197/224 [01:57<00:18,  1.49it/s]
Epoch 13 Iter 198: loss 0.18425. :  88%|██████████████████████████████████████     | 198/224 [01:57<00:18,  1.43it/s]
Epoch 13 Iter 199: loss 0.17251. :  88%|██████████████████████████████████████     | 198/224 [01:58<00:18,  1.43it/s]
Epoch 13 Iter 199: loss 0.17251. :  89%|██████████████████████████████████████▏    | 199/224 [01:58<00:18,  1.39it/s]
Epoch 13 Iter 200: loss 0.17544. :  89%|██████████████████████████████████████▏    | 199/224 [01:59<00:18,  1.39it/s]
Epoch 13 Iter 200: loss 0.17544. :  89%|██████████████████████████████████████▍    | 200/224 [01:59<00:16,  1.48it/s]
Epoch 13 Iter 201: loss 0.14866. :  89%|██████████████████████████████████████▍    | 200/224 [01:59<00:16,  1.48it/s]
Epoch 13 Iter 201: loss 0.14866. :  90%|██████████████████████████████████████▌    | 201/224 [01:59<00:15,  1.52it/s]
Epoch 13 Iter 202: loss 0.16801. :  90%|██████████████████████████████████████▌    | 201/224 [02:00<00:15,  1.52it/s]
Epoch 13 Iter 202: loss 0.16801. :  90%|██████████████████████████████████████▊    | 202/224 [02:00<00:13,  1.61it/s]
Epoch 13 Iter 203: loss 0.15276. :  90%|██████████████████████████████████████▊    | 202/224 [02:01<00:13,  1.61it/s]
Epoch 13 Iter 203: loss 0.15276. :  91%|██████████████████████████████████████▉    | 203/224 [02:01<00:12,  1.64it/s]
Epoch 13 Iter 204: loss 0.18834. :  91%|██████████████████████████████████████▉    | 203/224 [02:01<00:12,  1.64it/s]
Epoch 13 Iter 204: loss 0.18834. :  91%|███████████████████████████████████████▏   | 204/224 [02:01<00:11,  1.69it/s]
Epoch 13 Iter 205: loss 0.18379. :  91%|███████████████████████████████████████▏   | 204/224 [02:02<00:11,  1.69it/s]
Epoch 13 Iter 205: loss 0.18379. :  92%|███████████████████████████████████████▎   | 205/224 [02:02<00:11,  1.63it/s]
Epoch 13 Iter 206: loss 0.19360. :  92%|███████████████████████████████████████▎   | 205/224 [02:02<00:11,  1.63it/s]
Epoch 13 Iter 206: loss 0.19360. :  92%|███████████████████████████████████████▌   | 206/224 [02:02<00:10,  1.66it/s]
Epoch 13 Iter 207: loss 0.17122. :  92%|███████████████████████████████████████▌   | 206/224 [02:03<00:10,  1.66it/s]
Epoch 13 Iter 207: loss 0.17122. :  92%|███████████████████████████████████████▋   | 207/224 [02:03<00:10,  1.64it/s]
Epoch 13 Iter 208: loss 0.15879. :  92%|███████████████████████████████████████▋   | 207/224 [02:04<00:10,  1.64it/s]
Epoch 13 Iter 208: loss 0.15879. :  93%|███████████████████████████████████████▉   | 208/224 [02:04<00:10,  1.51it/s]
Epoch 13 Iter 209: loss 0.16623. :  93%|███████████████████████████████████████▉   | 208/224 [02:05<00:10,  1.51it/s]
Epoch 13 Iter 209: loss 0.16623. :  93%|████████████████████████████████████████   | 209/224 [02:05<00:10,  1.42it/s]
Epoch 13 Iter 210: loss 0.16942. :  93%|████████████████████████████████████████   | 209/224 [02:05<00:10,  1.42it/s]
Epoch 13 Iter 210: loss 0.16942. :  94%|████████████████████████████████████████▎  | 210/224 [02:05<00:10,  1.38it/s]
Epoch 13 Iter 211: loss 0.17751. :  94%|████████████████████████████████████████▎  | 210/224 [02:06<00:10,  1.38it/s]
Epoch 13 Iter 211: loss 0.17751. :  94%|████████████████████████████████████████▌  | 211/224 [02:06<00:09,  1.37it/s]
Epoch 13 Iter 212: loss 0.19320. :  94%|████████████████████████████████████████▌  | 211/224 [02:07<00:09,  1.37it/s]
Epoch 13 Iter 212: loss 0.19320. :  95%|████████████████████████████████████████▋  | 212/224 [02:07<00:08,  1.49it/s]
Epoch 13 Iter 213: loss 0.17312. :  95%|████████████████████████████████████████▋  | 212/224 [02:07<00:08,  1.49it/s]
Epoch 13 Iter 213: loss 0.17312. :  95%|████████████████████████████████████████▉  | 213/224 [02:07<00:07,  1.45it/s]
Epoch 13 Iter 214: loss 0.17175. :  95%|████████████████████████████████████████▉  | 213/224 [02:08<00:07,  1.45it/s]
Epoch 13 Iter 214: loss 0.17175. :  96%|█████████████████████████████████████████  | 214/224 [02:08<00:06,  1.47it/s]
Epoch 13 Iter 215: loss 0.16923. :  96%|█████████████████████████████████████████  | 214/224 [02:09<00:06,  1.47it/s]
Epoch 13 Iter 215: loss 0.16923. :  96%|█████████████████████████████████████████▎ | 215/224 [02:09<00:06,  1.42it/s]
Epoch 13 Iter 216: loss 0.14997. :  96%|█████████████████████████████████████████▎ | 215/224 [02:09<00:06,  1.42it/s]
Epoch 13 Iter 216: loss 0.14997. :  96%|█████████████████████████████████████████▍ | 216/224 [02:09<00:05,  1.53it/s]
Epoch 13 Iter 217: loss 0.17252. :  96%|█████████████████████████████████████████▍ | 216/224 [02:10<00:05,  1.53it/s]
Epoch 13 Iter 217: loss 0.17252. :  97%|█████████████████████████████████████████▋ | 217/224 [02:10<00:04,  1.63it/s]
Epoch 13 Iter 218: loss 0.17586. :  97%|█████████████████████████████████████████▋ | 217/224 [02:10<00:04,  1.63it/s]
Epoch 13 Iter 218: loss 0.17586. :  97%|█████████████████████████████████████████▊ | 218/224 [02:10<00:03,  1.69it/s]
Epoch 13 Iter 219: loss 0.17975. :  97%|█████████████████████████████████████████▊ | 218/224 [02:11<00:03,  1.69it/s]
Epoch 13 Iter 219: loss 0.17975. :  98%|██████████████████████████████████████████ | 219/224 [02:11<00:02,  1.73it/s]
Epoch 13 Iter 220: loss 0.16205. :  98%|██████████████████████████████████████████ | 219/224 [02:11<00:02,  1.73it/s]
Epoch 13 Iter 220: loss 0.16205. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.76it/s]
Epoch 13 Iter 221: loss 0.16236. :  98%|██████████████████████████████████████████▏| 220/224 [02:12<00:02,  1.76it/s]
Epoch 13 Iter 221: loss 0.16236. :  99%|██████████████████████████████████████████▍| 221/224 [02:12<00:01,  1.58it/s]
Epoch 13 Iter 222: loss 0.17129. :  99%|██████████████████████████████████████████▍| 221/224 [02:13<00:01,  1.58it/s]
Epoch 13 Iter 222: loss 0.17129. :  99%|██████████████████████████████████████████▌| 222/224 [02:13<00:01,  1.47it/s]
Epoch 13 Iter 223: loss 0.16187. :  99%|██████████████████████████████████████████▌| 222/224 [02:14<00:01,  1.47it/s]
Epoch 13 Iter 223: loss 0.16187. : 100%|██████████████████████████████████████████▊| 223/224 [02:14<00:00,  1.40it/s]
Epoch 13 Iter 224: loss 0.16682. : 100%|██████████████████████████████████████████▊| 223/224 [02:14<00:00,  1.40it/s]
Epoch 13 Iter 224: loss 0.16682. : 100%|███████████████████████████████████████████| 224/224 [02:14<00:00,  1.42it/s]
Epoch 13 Iter 224: loss 0.16682. : 100%|███████████████████████████████████████████| 224/224 [02:14<00:00,  1.66it/s]

    Train loss: 0.16955
    Valid loss: 0.17251
       Valid loss recons: 0.17251
       Valid loss KL-D:   27534.63752
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.15855. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.15855. :   0%|▏                                              | 1/224 [00:00<02:37,  1.41it/s]
Epoch 14 Iter 2: loss 0.16247. :   0%|▏                                              | 1/224 [00:01<02:37,  1.41it/s]
Epoch 14 Iter 2: loss 0.16247. :   1%|▍                                              | 2/224 [00:01<02:34,  1.43it/s]
Epoch 14 Iter 3: loss 0.15636. :   1%|▍                                              | 2/224 [00:01<02:34,  1.43it/s]
Epoch 14 Iter 3: loss 0.15636. :   1%|▋                                              | 3/224 [00:01<02:17,  1.60it/s]
Epoch 14 Iter 4: loss 0.16599. :   1%|▋                                              | 3/224 [00:02<02:17,  1.60it/s]
Epoch 14 Iter 4: loss 0.16599. :   2%|▊                                              | 4/224 [00:02<02:11,  1.67it/s]
Epoch 14 Iter 5: loss 0.20281. :   2%|▊                                              | 4/224 [00:03<02:11,  1.67it/s]
Epoch 14 Iter 5: loss 0.20281. :   2%|█                                              | 5/224 [00:03<02:07,  1.72it/s]
Epoch 14 Iter 6: loss 0.16869. :   2%|█                                              | 5/224 [00:03<02:07,  1.72it/s]
Epoch 14 Iter 6: loss 0.16869. :   3%|█▎                                             | 6/224 [00:03<02:04,  1.75it/s]
Epoch 14 Iter 7: loss 0.18744. :   3%|█▎                                             | 6/224 [00:04<02:04,  1.75it/s]
Epoch 14 Iter 7: loss 0.18744. :   3%|█▍                                             | 7/224 [00:04<02:02,  1.78it/s]
Epoch 14 Iter 8: loss 0.16851. :   3%|█▍                                             | 7/224 [00:04<02:02,  1.78it/s]
Epoch 14 Iter 8: loss 0.16851. :   4%|█▋                                             | 8/224 [00:04<02:00,  1.80it/s]
Epoch 14 Iter 9: loss 0.16310. :   4%|█▋                                             | 8/224 [00:05<02:00,  1.80it/s]
Epoch 14 Iter 9: loss 0.16310. :   4%|█▉                                             | 9/224 [00:05<02:05,  1.72it/s]
Epoch 14 Iter 10: loss 0.18007. :   4%|█▊                                            | 9/224 [00:05<02:05,  1.72it/s]
Epoch 14 Iter 10: loss 0.18007. :   4%|██                                           | 10/224 [00:05<02:05,  1.71it/s]
Epoch 14 Iter 11: loss 0.16175. :   4%|██                                           | 10/224 [00:06<02:05,  1.71it/s]
Epoch 14 Iter 11: loss 0.16175. :   5%|██▏                                          | 11/224 [00:06<02:01,  1.75it/s]
Epoch 14 Iter 12: loss 0.16102. :   5%|██▏                                          | 11/224 [00:07<02:01,  1.75it/s]
Epoch 14 Iter 12: loss 0.16102. :   5%|██▍                                          | 12/224 [00:07<02:00,  1.76it/s]
Epoch 14 Iter 13: loss 0.16703. :   5%|██▍                                          | 12/224 [00:07<02:00,  1.76it/s]
Epoch 14 Iter 13: loss 0.16703. :   6%|██▌                                          | 13/224 [00:07<02:11,  1.61it/s]
Epoch 14 Iter 14: loss 0.16788. :   6%|██▌                                          | 13/224 [00:08<02:11,  1.61it/s]
Epoch 14 Iter 14: loss 0.16788. :   6%|██▊                                          | 14/224 [00:08<02:19,  1.51it/s]
Epoch 14 Iter 15: loss 0.16525. :   6%|██▊                                          | 14/224 [00:09<02:19,  1.51it/s]
Epoch 14 Iter 15: loss 0.16525. :   7%|███                                          | 15/224 [00:09<02:22,  1.47it/s]
Epoch 14 Iter 16: loss 0.19211. :   7%|███                                          | 15/224 [00:09<02:22,  1.47it/s]
Epoch 14 Iter 16: loss 0.19211. :   7%|███▏                                         | 16/224 [00:09<02:12,  1.57it/s]
Epoch 14 Iter 17: loss 0.16763. :   7%|███▏                                         | 16/224 [00:10<02:12,  1.57it/s]
Epoch 14 Iter 17: loss 0.16763. :   8%|███▍                                         | 17/224 [00:10<02:05,  1.65it/s]
Epoch 14 Iter 18: loss 0.17837. :   8%|███▍                                         | 17/224 [00:10<02:05,  1.65it/s]
Epoch 14 Iter 18: loss 0.17837. :   8%|███▌                                         | 18/224 [00:10<02:00,  1.71it/s]
Epoch 14 Iter 19: loss 0.16759. :   8%|███▌                                         | 18/224 [00:11<02:00,  1.71it/s]
Epoch 14 Iter 19: loss 0.16759. :   8%|███▊                                         | 19/224 [00:11<02:04,  1.65it/s]
Epoch 14 Iter 20: loss 0.17355. :   8%|███▊                                         | 19/224 [00:12<02:04,  1.65it/s]
Epoch 14 Iter 20: loss 0.17355. :   9%|████                                         | 20/224 [00:12<01:59,  1.70it/s]
Epoch 14 Iter 21: loss 0.16457. :   9%|████                                         | 20/224 [00:12<01:59,  1.70it/s]
Epoch 14 Iter 21: loss 0.16457. :   9%|████▏                                        | 21/224 [00:12<02:00,  1.68it/s]
Epoch 14 Iter 22: loss 0.16064. :   9%|████▏                                        | 21/224 [00:13<02:00,  1.68it/s]
Epoch 14 Iter 22: loss 0.16064. :  10%|████▍                                        | 22/224 [00:13<01:57,  1.73it/s]
Epoch 14 Iter 23: loss 0.17054. :  10%|████▍                                        | 22/224 [00:13<01:57,  1.73it/s]
Epoch 14 Iter 23: loss 0.17054. :  10%|████▌                                        | 23/224 [00:13<01:59,  1.69it/s]
Epoch 14 Iter 24: loss 0.15823. :  10%|████▌                                        | 23/224 [00:14<01:59,  1.69it/s]
Epoch 14 Iter 24: loss 0.15823. :  11%|████▊                                        | 24/224 [00:14<01:55,  1.74it/s]
Epoch 14 Iter 25: loss 0.18401. :  11%|████▊                                        | 24/224 [00:14<01:55,  1.74it/s]
Epoch 14 Iter 25: loss 0.18401. :  11%|█████                                        | 25/224 [00:14<01:51,  1.78it/s]
Epoch 14 Iter 26: loss 0.14754. :  11%|█████                                        | 25/224 [00:15<01:51,  1.78it/s]
Epoch 14 Iter 26: loss 0.14754. :  12%|█████▏                                       | 26/224 [00:15<01:51,  1.77it/s]
Epoch 14 Iter 27: loss 0.15632. :  12%|█████▏                                       | 26/224 [00:16<01:51,  1.77it/s]
Epoch 14 Iter 27: loss 0.15632. :  12%|█████▍                                       | 27/224 [00:16<01:56,  1.69it/s]
Epoch 14 Iter 28: loss 0.18445. :  12%|█████▍                                       | 27/224 [00:16<01:56,  1.69it/s]
Epoch 14 Iter 28: loss 0.18445. :  12%|█████▋                                       | 28/224 [00:16<02:06,  1.55it/s]
Epoch 14 Iter 29: loss 0.17352. :  12%|█████▋                                       | 28/224 [00:17<02:06,  1.55it/s]
Epoch 14 Iter 29: loss 0.17352. :  13%|█████▊                                       | 29/224 [00:17<02:13,  1.46it/s]
Epoch 14 Iter 30: loss 0.17470. :  13%|█████▊                                       | 29/224 [00:18<02:13,  1.46it/s]
Epoch 14 Iter 30: loss 0.17470. :  13%|██████                                       | 30/224 [00:18<02:15,  1.43it/s]
Epoch 14 Iter 31: loss 0.16785. :  13%|██████                                       | 30/224 [00:18<02:15,  1.43it/s]
Epoch 14 Iter 31: loss 0.16785. :  14%|██████▏                                      | 31/224 [00:18<02:05,  1.54it/s]
Epoch 14 Iter 32: loss 0.16926. :  14%|██████▏                                      | 31/224 [00:19<02:05,  1.54it/s]
Epoch 14 Iter 32: loss 0.16926. :  14%|██████▍                                      | 32/224 [00:19<02:00,  1.60it/s]
Epoch 14 Iter 33: loss 0.17495. :  14%|██████▍                                      | 32/224 [00:20<02:00,  1.60it/s]
Epoch 14 Iter 33: loss 0.17495. :  15%|██████▋                                      | 33/224 [00:20<01:57,  1.62it/s]
Epoch 14 Iter 34: loss 0.18236. :  15%|██████▋                                      | 33/224 [00:20<01:57,  1.62it/s]
Epoch 14 Iter 34: loss 0.18236. :  15%|██████▊                                      | 34/224 [00:20<02:05,  1.51it/s]
Epoch 14 Iter 35: loss 0.17060. :  15%|██████▊                                      | 34/224 [00:21<02:05,  1.51it/s]
Epoch 14 Iter 35: loss 0.17060. :  16%|███████                                      | 35/224 [00:21<01:58,  1.59it/s]
Epoch 14 Iter 36: loss 0.15608. :  16%|███████                                      | 35/224 [00:22<01:58,  1.59it/s]
Epoch 14 Iter 36: loss 0.15608. :  16%|███████▏                                     | 36/224 [00:22<02:07,  1.47it/s]
Epoch 14 Iter 37: loss 0.17093. :  16%|███████▏                                     | 36/224 [00:22<02:07,  1.47it/s]
Epoch 14 Iter 37: loss 0.17093. :  17%|███████▍                                     | 37/224 [00:22<02:04,  1.50it/s]
Epoch 14 Iter 38: loss 0.17541. :  17%|███████▍                                     | 37/224 [00:23<02:04,  1.50it/s]
Epoch 14 Iter 38: loss 0.17541. :  17%|███████▋                                     | 38/224 [00:23<02:01,  1.53it/s]
Epoch 14 Iter 39: loss 0.15347. :  17%|███████▋                                     | 38/224 [00:24<02:01,  1.53it/s]
Epoch 14 Iter 39: loss 0.15347. :  17%|███████▊                                     | 39/224 [00:24<02:03,  1.49it/s]
Epoch 14 Iter 40: loss 0.14989. :  17%|███████▊                                     | 39/224 [00:24<02:03,  1.49it/s]
Epoch 14 Iter 40: loss 0.14989. :  18%|████████                                     | 40/224 [00:24<01:56,  1.58it/s]
Epoch 14 Iter 41: loss 0.13582. :  18%|████████                                     | 40/224 [00:25<01:56,  1.58it/s]
Epoch 14 Iter 41: loss 0.13582. :  18%|████████▏                                    | 41/224 [00:25<01:51,  1.64it/s]
Epoch 14 Iter 42: loss 0.17089. :  18%|████████▏                                    | 41/224 [00:26<01:51,  1.64it/s]
Epoch 14 Iter 42: loss 0.17089. :  19%|████████▍                                    | 42/224 [00:26<02:00,  1.51it/s]
Epoch 14 Iter 43: loss 0.16836. :  19%|████████▍                                    | 42/224 [00:26<02:00,  1.51it/s]
Epoch 14 Iter 43: loss 0.16836. :  19%|████████▋                                    | 43/224 [00:26<01:54,  1.59it/s]
Epoch 14 Iter 44: loss 0.16127. :  19%|████████▋                                    | 43/224 [00:27<01:54,  1.59it/s]
Epoch 14 Iter 44: loss 0.16127. :  20%|████████▊                                    | 44/224 [00:27<01:53,  1.59it/s]
Epoch 14 Iter 45: loss 0.16446. :  20%|████████▊                                    | 44/224 [00:27<01:53,  1.59it/s]
Epoch 14 Iter 45: loss 0.16446. :  20%|█████████                                    | 45/224 [00:27<01:48,  1.65it/s]
Epoch 14 Iter 46: loss 0.15830. :  20%|█████████                                    | 45/224 [00:28<01:48,  1.65it/s]
Epoch 14 Iter 46: loss 0.15830. :  21%|█████████▏                                   | 46/224 [00:28<01:53,  1.58it/s]
Epoch 14 Iter 47: loss 0.17417. :  21%|█████████▏                                   | 46/224 [00:29<01:53,  1.58it/s]
Epoch 14 Iter 47: loss 0.17417. :  21%|█████████▍                                   | 47/224 [00:29<01:53,  1.57it/s]
Epoch 14 Iter 48: loss 0.15259. :  21%|█████████▍                                   | 47/224 [00:29<01:53,  1.57it/s]
Epoch 14 Iter 48: loss 0.15259. :  21%|█████████▋                                   | 48/224 [00:29<01:47,  1.64it/s]
Epoch 14 Iter 49: loss 0.16730. :  21%|█████████▋                                   | 48/224 [00:30<01:47,  1.64it/s]
Epoch 14 Iter 49: loss 0.16730. :  22%|█████████▊                                   | 49/224 [00:30<01:50,  1.58it/s]
Epoch 14 Iter 50: loss 0.17244. :  22%|█████████▊                                   | 49/224 [00:31<01:50,  1.58it/s]
Epoch 14 Iter 50: loss 0.17244. :  22%|██████████                                   | 50/224 [00:31<01:56,  1.49it/s]
Epoch 14 Iter 51: loss 0.16460. :  22%|██████████                                   | 50/224 [00:31<01:56,  1.49it/s]
Epoch 14 Iter 51: loss 0.16460. :  23%|██████████▏                                  | 51/224 [00:31<02:01,  1.42it/s]
Epoch 14 Iter 52: loss 0.16084. :  23%|██████████▏                                  | 51/224 [00:32<02:01,  1.42it/s]
Epoch 14 Iter 52: loss 0.16084. :  23%|██████████▍                                  | 52/224 [00:32<02:04,  1.38it/s]
Epoch 14 Iter 53: loss 0.16944. :  23%|██████████▍                                  | 52/224 [00:33<02:04,  1.38it/s]
Epoch 14 Iter 53: loss 0.16944. :  24%|██████████▋                                  | 53/224 [00:33<02:05,  1.36it/s]
Epoch 14 Iter 54: loss 0.17812. :  24%|██████████▋                                  | 53/224 [00:34<02:05,  1.36it/s]
Epoch 14 Iter 54: loss 0.17812. :  24%|██████████▊                                  | 54/224 [00:34<01:56,  1.46it/s]
Epoch 14 Iter 55: loss 0.18058. :  24%|██████████▊                                  | 54/224 [00:34<01:56,  1.46it/s]
Epoch 14 Iter 55: loss 0.18058. :  25%|███████████                                  | 55/224 [00:34<01:48,  1.56it/s]
Epoch 14 Iter 56: loss 0.17696. :  25%|███████████                                  | 55/224 [00:35<01:48,  1.56it/s]
Epoch 14 Iter 56: loss 0.17696. :  25%|███████████▎                                 | 56/224 [00:35<01:51,  1.50it/s]
Epoch 14 Iter 57: loss 0.18196. :  25%|███████████▎                                 | 56/224 [00:35<01:51,  1.50it/s]
Epoch 14 Iter 57: loss 0.18196. :  25%|███████████▍                                 | 57/224 [00:35<01:45,  1.59it/s]
Epoch 14 Iter 58: loss 0.18551. :  25%|███████████▍                                 | 57/224 [00:36<01:45,  1.59it/s]
Epoch 14 Iter 58: loss 0.18551. :  26%|███████████▋                                 | 58/224 [00:36<01:40,  1.65it/s]
Epoch 14 Iter 59: loss 0.15497. :  26%|███████████▋                                 | 58/224 [00:36<01:40,  1.65it/s]
Epoch 14 Iter 59: loss 0.15497. :  26%|███████████▊                                 | 59/224 [00:36<01:37,  1.69it/s]
Epoch 14 Iter 60: loss 0.16658. :  26%|███████████▊                                 | 59/224 [00:37<01:37,  1.69it/s]
Epoch 14 Iter 60: loss 0.16658. :  27%|████████████                                 | 60/224 [00:37<01:46,  1.55it/s]
Epoch 14 Iter 61: loss 0.17064. :  27%|████████████                                 | 60/224 [00:38<01:46,  1.55it/s]
Epoch 14 Iter 61: loss 0.17064. :  27%|████████████▎                                | 61/224 [00:38<01:49,  1.49it/s]
Epoch 14 Iter 62: loss 0.16112. :  27%|████████████▎                                | 61/224 [00:39<01:49,  1.49it/s]
Epoch 14 Iter 62: loss 0.16112. :  28%|████████████▍                                | 62/224 [00:39<01:54,  1.42it/s]
Epoch 14 Iter 63: loss 0.17675. :  28%|████████████▍                                | 62/224 [00:39<01:54,  1.42it/s]
Epoch 14 Iter 63: loss 0.17675. :  28%|████████████▋                                | 63/224 [00:39<01:52,  1.43it/s]
Epoch 14 Iter 64: loss 0.17581. :  28%|████████████▋                                | 63/224 [00:40<01:52,  1.43it/s]
Epoch 14 Iter 64: loss 0.17581. :  29%|████████████▊                                | 64/224 [00:40<01:50,  1.44it/s]
Epoch 14 Iter 65: loss 0.17047. :  29%|████████████▊                                | 64/224 [00:41<01:50,  1.44it/s]
Epoch 14 Iter 65: loss 0.17047. :  29%|█████████████                                | 65/224 [00:41<01:42,  1.55it/s]
Epoch 14 Iter 66: loss 0.15815. :  29%|█████████████                                | 65/224 [00:41<01:42,  1.55it/s]
Epoch 14 Iter 66: loss 0.15815. :  29%|█████████████▎                               | 66/224 [00:41<01:45,  1.49it/s]
Epoch 14 Iter 67: loss 0.16488. :  29%|█████████████▎                               | 66/224 [00:42<01:45,  1.49it/s]
Epoch 14 Iter 67: loss 0.16488. :  30%|█████████████▍                               | 67/224 [00:42<01:50,  1.42it/s]
Epoch 14 Iter 68: loss 0.15814. :  30%|█████████████▍                               | 67/224 [00:43<01:50,  1.42it/s]
Epoch 14 Iter 68: loss 0.15814. :  30%|█████████████▋                               | 68/224 [00:43<01:53,  1.37it/s]
Epoch 14 Iter 69: loss 0.15984. :  30%|█████████████▋                               | 68/224 [00:44<01:53,  1.37it/s]
Epoch 14 Iter 69: loss 0.15984. :  31%|█████████████▊                               | 69/224 [00:44<01:54,  1.35it/s]
Epoch 14 Iter 70: loss 0.15627. :  31%|█████████████▊                               | 69/224 [00:44<01:54,  1.35it/s]
Epoch 14 Iter 70: loss 0.15627. :  31%|██████████████                               | 70/224 [00:44<01:44,  1.47it/s]
Epoch 14 Iter 71: loss 0.16068. :  31%|██████████████                               | 70/224 [00:45<01:44,  1.47it/s]
Epoch 14 Iter 71: loss 0.16068. :  32%|██████████████▎                              | 71/224 [00:45<01:47,  1.42it/s]
Epoch 14 Iter 72: loss 0.18743. :  32%|██████████████▎                              | 71/224 [00:46<01:47,  1.42it/s]
Epoch 14 Iter 72: loss 0.18743. :  32%|██████████████▍                              | 72/224 [00:46<01:50,  1.38it/s]
Epoch 14 Iter 73: loss 0.16045. :  32%|██████████████▍                              | 72/224 [00:47<01:50,  1.38it/s]
Epoch 14 Iter 73: loss 0.16045. :  33%|██████████████▋                              | 73/224 [00:47<01:51,  1.36it/s]
Epoch 14 Iter 74: loss 0.14494. :  33%|██████████████▋                              | 73/224 [00:47<01:51,  1.36it/s]
Epoch 14 Iter 74: loss 0.14494. :  33%|██████████████▊                              | 74/224 [00:47<01:52,  1.33it/s]
Epoch 14 Iter 75: loss 0.16263. :  33%|██████████████▊                              | 74/224 [00:48<01:52,  1.33it/s]
Epoch 14 Iter 75: loss 0.16263. :  33%|███████████████                              | 75/224 [00:48<01:44,  1.43it/s]
Epoch 14 Iter 76: loss 0.18524. :  33%|███████████████                              | 75/224 [00:49<01:44,  1.43it/s]
Epoch 14 Iter 76: loss 0.18524. :  34%|███████████████▎                             | 76/224 [00:49<01:46,  1.39it/s]
Epoch 14 Iter 77: loss 0.14527. :  34%|███████████████▎                             | 76/224 [00:49<01:46,  1.39it/s]
Epoch 14 Iter 77: loss 0.14527. :  34%|███████████████▍                             | 77/224 [00:49<01:37,  1.50it/s]
Epoch 14 Iter 78: loss 0.17134. :  34%|███████████████▍                             | 77/224 [00:50<01:37,  1.50it/s]
Epoch 14 Iter 78: loss 0.17134. :  35%|███████████████▋                             | 78/224 [00:50<01:35,  1.53it/s]
Epoch 14 Iter 79: loss 0.16762. :  35%|███████████████▋                             | 78/224 [00:50<01:35,  1.53it/s]
Epoch 14 Iter 79: loss 0.16762. :  35%|███████████████▊                             | 79/224 [00:50<01:35,  1.52it/s]
Epoch 14 Iter 80: loss 0.15818. :  35%|███████████████▊                             | 79/224 [00:51<01:35,  1.52it/s]
Epoch 14 Iter 80: loss 0.15818. :  36%|████████████████                             | 80/224 [00:51<01:35,  1.50it/s]
Epoch 14 Iter 81: loss 0.18219. :  36%|████████████████                             | 80/224 [00:52<01:35,  1.50it/s]
Epoch 14 Iter 81: loss 0.18219. :  36%|████████████████▎                            | 81/224 [00:52<01:35,  1.50it/s]
Epoch 14 Iter 82: loss 0.17639. :  36%|████████████████▎                            | 81/224 [00:52<01:35,  1.50it/s]
Epoch 14 Iter 82: loss 0.17639. :  37%|████████████████▍                            | 82/224 [00:52<01:33,  1.53it/s]
Epoch 14 Iter 83: loss 0.17865. :  37%|████████████████▍                            | 82/224 [00:53<01:33,  1.53it/s]
Epoch 14 Iter 83: loss 0.17865. :  37%|████████████████▋                            | 83/224 [00:53<01:37,  1.45it/s]
Epoch 14 Iter 84: loss 0.16622. :  37%|████████████████▋                            | 83/224 [00:54<01:37,  1.45it/s]
Epoch 14 Iter 84: loss 0.16622. :  38%|████████████████▉                            | 84/224 [00:54<01:41,  1.38it/s]
Epoch 14 Iter 85: loss 0.18410. :  38%|████████████████▉                            | 84/224 [00:55<01:41,  1.38it/s]
Epoch 14 Iter 85: loss 0.18410. :  38%|█████████████████                            | 85/224 [00:55<01:32,  1.50it/s]
Epoch 14 Iter 86: loss 0.19616. :  38%|█████████████████                            | 85/224 [00:55<01:32,  1.50it/s]
Epoch 14 Iter 86: loss 0.19616. :  38%|█████████████████▎                           | 86/224 [00:55<01:27,  1.57it/s]
Epoch 14 Iter 87: loss 0.17814. :  38%|█████████████████▎                           | 86/224 [00:56<01:27,  1.57it/s]
Epoch 14 Iter 87: loss 0.17814. :  39%|█████████████████▍                           | 87/224 [00:56<01:33,  1.47it/s]
Epoch 14 Iter 88: loss 0.14708. :  39%|█████████████████▍                           | 87/224 [00:57<01:33,  1.47it/s]
Epoch 14 Iter 88: loss 0.14708. :  39%|█████████████████▋                           | 88/224 [00:57<01:35,  1.42it/s]
Epoch 14 Iter 89: loss 0.15920. :  39%|█████████████████▋                           | 88/224 [00:57<01:35,  1.42it/s]
Epoch 14 Iter 89: loss 0.15920. :  40%|█████████████████▉                           | 89/224 [00:57<01:30,  1.49it/s]
Epoch 14 Iter 90: loss 0.17173. :  40%|█████████████████▉                           | 89/224 [00:58<01:30,  1.49it/s]
Epoch 14 Iter 90: loss 0.17173. :  40%|██████████████████                           | 90/224 [00:58<01:33,  1.43it/s]
Epoch 14 Iter 91: loss 0.18848. :  40%|██████████████████                           | 90/224 [00:59<01:33,  1.43it/s]
Epoch 14 Iter 91: loss 0.18848. :  41%|██████████████████▎                          | 91/224 [00:59<01:35,  1.40it/s]
Epoch 14 Iter 92: loss 0.17058. :  41%|██████████████████▎                          | 91/224 [00:59<01:35,  1.40it/s]
Epoch 14 Iter 92: loss 0.17058. :  41%|██████████████████▍                          | 92/224 [00:59<01:32,  1.42it/s]
Epoch 14 Iter 93: loss 0.16149. :  41%|██████████████████▍                          | 92/224 [01:00<01:32,  1.42it/s]
Epoch 14 Iter 93: loss 0.16149. :  42%|██████████████████▋                          | 93/224 [01:00<01:25,  1.54it/s]
Epoch 14 Iter 94: loss 0.17191. :  42%|██████████████████▋                          | 93/224 [01:01<01:25,  1.54it/s]
Epoch 14 Iter 94: loss 0.17191. :  42%|██████████████████▉                          | 94/224 [01:01<01:20,  1.61it/s]
Epoch 14 Iter 95: loss 0.16978. :  42%|██████████████████▉                          | 94/224 [01:01<01:20,  1.61it/s]
Epoch 14 Iter 95: loss 0.16978. :  42%|███████████████████                          | 95/224 [01:01<01:18,  1.64it/s]
Epoch 14 Iter 96: loss 0.17232. :  42%|███████████████████                          | 95/224 [01:02<01:18,  1.64it/s]
Epoch 14 Iter 96: loss 0.17232. :  43%|███████████████████▎                         | 96/224 [01:02<01:20,  1.59it/s]
Epoch 14 Iter 97: loss 0.17425. :  43%|███████████████████▎                         | 96/224 [01:02<01:20,  1.59it/s]
Epoch 14 Iter 97: loss 0.17425. :  43%|███████████████████▍                         | 97/224 [01:02<01:16,  1.67it/s]
Epoch 14 Iter 98: loss 0.18610. :  43%|███████████████████▍                         | 97/224 [01:03<01:16,  1.67it/s]
Epoch 14 Iter 98: loss 0.18610. :  44%|███████████████████▋                         | 98/224 [01:03<01:13,  1.71it/s]
Epoch 14 Iter 99: loss 0.15747. :  44%|███████████████████▋                         | 98/224 [01:04<01:13,  1.71it/s]
Epoch 14 Iter 99: loss 0.15747. :  44%|███████████████████▉                         | 99/224 [01:04<01:15,  1.66it/s]
Epoch 14 Iter 100: loss 0.19382. :  44%|███████████████████▍                        | 99/224 [01:04<01:15,  1.66it/s]
Epoch 14 Iter 100: loss 0.19382. :  45%|███████████████████▏                       | 100/224 [01:04<01:19,  1.57it/s]
Epoch 14 Iter 101: loss 0.18456. :  45%|███████████████████▏                       | 100/224 [01:05<01:19,  1.57it/s]
Epoch 14 Iter 101: loss 0.18456. :  45%|███████████████████▍                       | 101/224 [01:05<01:17,  1.59it/s]
Epoch 14 Iter 102: loss 0.18667. :  45%|███████████████████▍                       | 101/224 [01:05<01:17,  1.59it/s]
Epoch 14 Iter 102: loss 0.18667. :  46%|███████████████████▌                       | 102/224 [01:05<01:13,  1.65it/s]
Epoch 14 Iter 103: loss 0.16159. :  46%|███████████████████▌                       | 102/224 [01:06<01:13,  1.65it/s]
Epoch 14 Iter 103: loss 0.16159. :  46%|███████████████████▊                       | 103/224 [01:06<01:15,  1.61it/s]
Epoch 14 Iter 104: loss 0.16872. :  46%|███████████████████▊                       | 103/224 [01:07<01:15,  1.61it/s]
Epoch 14 Iter 104: loss 0.16872. :  46%|███████████████████▉                       | 104/224 [01:07<01:11,  1.68it/s]
Epoch 14 Iter 105: loss 0.16231. :  46%|███████████████████▉                       | 104/224 [01:07<01:11,  1.68it/s]
Epoch 14 Iter 105: loss 0.16231. :  47%|████████████████████▏                      | 105/224 [01:07<01:11,  1.65it/s]
Epoch 14 Iter 106: loss 0.15795. :  47%|████████████████████▏                      | 105/224 [01:08<01:11,  1.65it/s]
Epoch 14 Iter 106: loss 0.15795. :  47%|████████████████████▎                      | 106/224 [01:08<01:10,  1.67it/s]
Epoch 14 Iter 107: loss 0.14751. :  47%|████████████████████▎                      | 106/224 [01:08<01:10,  1.67it/s]
Epoch 14 Iter 107: loss 0.14751. :  48%|████████████████████▌                      | 107/224 [01:08<01:08,  1.72it/s]
Epoch 14 Iter 108: loss 0.16387. :  48%|████████████████████▌                      | 107/224 [01:09<01:08,  1.72it/s]
Epoch 14 Iter 108: loss 0.16387. :  48%|████████████████████▋                      | 108/224 [01:09<01:10,  1.65it/s]
Epoch 14 Iter 109: loss 0.17389. :  48%|████████████████████▋                      | 108/224 [01:10<01:10,  1.65it/s]
Epoch 14 Iter 109: loss 0.17389. :  49%|████████████████████▉                      | 109/224 [01:10<01:12,  1.58it/s]
Epoch 14 Iter 110: loss 0.17447. :  49%|████████████████████▉                      | 109/224 [01:10<01:12,  1.58it/s]
Epoch 14 Iter 110: loss 0.17447. :  49%|█████████████████████                      | 110/224 [01:10<01:11,  1.58it/s]
Epoch 14 Iter 111: loss 0.18974. :  49%|█████████████████████                      | 110/224 [01:11<01:11,  1.58it/s]
Epoch 14 Iter 111: loss 0.18974. :  50%|█████████████████████▎                     | 111/224 [01:11<01:09,  1.64it/s]
Epoch 14 Iter 112: loss 0.20516. :  50%|█████████████████████▎                     | 111/224 [01:12<01:09,  1.64it/s]
Epoch 14 Iter 112: loss 0.20516. :  50%|█████████████████████▌                     | 112/224 [01:12<01:14,  1.51it/s]
Epoch 14 Iter 113: loss 0.17000. :  50%|█████████████████████▌                     | 112/224 [01:12<01:14,  1.51it/s]
Epoch 14 Iter 113: loss 0.17000. :  50%|█████████████████████▋                     | 113/224 [01:12<01:17,  1.43it/s]
Epoch 14 Iter 114: loss 0.15131. :  50%|█████████████████████▋                     | 113/224 [01:13<01:17,  1.43it/s]
Epoch 14 Iter 114: loss 0.15131. :  51%|█████████████████████▉                     | 114/224 [01:13<01:14,  1.48it/s]
Epoch 14 Iter 115: loss 0.17364. :  51%|█████████████████████▉                     | 114/224 [01:14<01:14,  1.48it/s]
Epoch 14 Iter 115: loss 0.17364. :  51%|██████████████████████                     | 115/224 [01:14<01:16,  1.42it/s]
Epoch 14 Iter 116: loss 0.15853. :  51%|██████████████████████                     | 115/224 [01:15<01:16,  1.42it/s]
Epoch 14 Iter 116: loss 0.15853. :  52%|██████████████████████▎                    | 116/224 [01:15<01:16,  1.42it/s]
Epoch 14 Iter 117: loss 0.17852. :  52%|██████████████████████▎                    | 116/224 [01:15<01:16,  1.42it/s]
Epoch 14 Iter 117: loss 0.17852. :  52%|██████████████████████▍                    | 117/224 [01:15<01:10,  1.52it/s]
Epoch 14 Iter 118: loss 0.18634. :  52%|██████████████████████▍                    | 117/224 [01:16<01:10,  1.52it/s]
Epoch 14 Iter 118: loss 0.18634. :  53%|██████████████████████▋                    | 118/224 [01:16<01:06,  1.59it/s]
Epoch 14 Iter 119: loss 0.16800. :  53%|██████████████████████▋                    | 118/224 [01:16<01:06,  1.59it/s]
Epoch 14 Iter 119: loss 0.16800. :  53%|██████████████████████▊                    | 119/224 [01:16<01:03,  1.66it/s]
Epoch 14 Iter 120: loss 0.20017. :  53%|██████████████████████▊                    | 119/224 [01:17<01:03,  1.66it/s]
Epoch 14 Iter 120: loss 0.20017. :  54%|███████████████████████                    | 120/224 [01:17<01:02,  1.67it/s]
Epoch 14 Iter 121: loss 0.16315. :  54%|███████████████████████                    | 120/224 [01:17<01:02,  1.67it/s]
Epoch 14 Iter 121: loss 0.16315. :  54%|███████████████████████▏                   | 121/224 [01:17<01:01,  1.67it/s]
Epoch 14 Iter 122: loss 0.17124. :  54%|███████████████████████▏                   | 121/224 [01:18<01:01,  1.67it/s]
Epoch 14 Iter 122: loss 0.17124. :  54%|███████████████████████▍                   | 122/224 [01:18<00:58,  1.76it/s]
Epoch 14 Iter 123: loss 0.15762. :  54%|███████████████████████▍                   | 122/224 [01:18<00:58,  1.76it/s]
Epoch 14 Iter 123: loss 0.15762. :  55%|███████████████████████▌                   | 123/224 [01:18<00:55,  1.83it/s]
Epoch 14 Iter 124: loss 0.18831. :  55%|███████████████████████▌                   | 123/224 [01:19<00:55,  1.83it/s]
Epoch 14 Iter 124: loss 0.18831. :  55%|███████████████████████▊                   | 124/224 [01:19<00:53,  1.87it/s]
Epoch 14 Iter 125: loss 0.16489. :  55%|███████████████████████▊                   | 124/224 [01:19<00:53,  1.87it/s]
Epoch 14 Iter 125: loss 0.16489. :  56%|███████████████████████▉                   | 125/224 [01:19<00:52,  1.90it/s]
Epoch 14 Iter 126: loss 0.15891. :  56%|███████████████████████▉                   | 125/224 [01:20<00:52,  1.90it/s]
Epoch 14 Iter 126: loss 0.15891. :  56%|████████████████████████▏                  | 126/224 [01:20<00:51,  1.92it/s]
Epoch 14 Iter 127: loss 0.15809. :  56%|████████████████████████▏                  | 126/224 [01:20<00:51,  1.92it/s]
Epoch 14 Iter 127: loss 0.15809. :  57%|████████████████████████▍                  | 127/224 [01:20<00:50,  1.92it/s]
Epoch 14 Iter 128: loss 0.16785. :  57%|████████████████████████▍                  | 127/224 [01:21<00:50,  1.92it/s]
Epoch 14 Iter 128: loss 0.16785. :  57%|████████████████████████▌                  | 128/224 [01:21<00:49,  1.94it/s]
Epoch 14 Iter 129: loss 0.16085. :  57%|████████████████████████▌                  | 128/224 [01:21<00:49,  1.94it/s]
Epoch 14 Iter 129: loss 0.16085. :  58%|████████████████████████▊                  | 129/224 [01:21<00:48,  1.95it/s]
Epoch 14 Iter 130: loss 0.15082. :  58%|████████████████████████▊                  | 129/224 [01:22<00:48,  1.95it/s]
Epoch 14 Iter 130: loss 0.15082. :  58%|████████████████████████▉                  | 130/224 [01:22<00:48,  1.94it/s]
Epoch 14 Iter 131: loss 0.14823. :  58%|████████████████████████▉                  | 130/224 [01:22<00:48,  1.94it/s]
Epoch 14 Iter 131: loss 0.14823. :  58%|█████████████████████████▏                 | 131/224 [01:22<00:47,  1.95it/s]
Epoch 14 Iter 132: loss 0.19844. :  58%|█████████████████████████▏                 | 131/224 [01:23<00:47,  1.95it/s]
Epoch 14 Iter 132: loss 0.19844. :  59%|█████████████████████████▎                 | 132/224 [01:23<00:47,  1.96it/s]
Epoch 14 Iter 133: loss 0.16134. :  59%|█████████████████████████▎                 | 132/224 [01:23<00:47,  1.96it/s]
Epoch 14 Iter 133: loss 0.16134. :  59%|█████████████████████████▌                 | 133/224 [01:23<00:46,  1.96it/s]
Epoch 14 Iter 134: loss 0.15411. :  59%|█████████████████████████▌                 | 133/224 [01:24<00:46,  1.96it/s]
Epoch 14 Iter 134: loss 0.15411. :  60%|█████████████████████████▋                 | 134/224 [01:24<00:45,  1.97it/s]
Epoch 14 Iter 135: loss 0.16474. :  60%|█████████████████████████▋                 | 134/224 [01:25<00:45,  1.97it/s]
Epoch 14 Iter 135: loss 0.16474. :  60%|█████████████████████████▉                 | 135/224 [01:25<00:45,  1.97it/s]
Epoch 14 Iter 136: loss 0.19108. :  60%|█████████████████████████▉                 | 135/224 [01:25<00:45,  1.97it/s]
Epoch 14 Iter 136: loss 0.19108. :  61%|██████████████████████████                 | 136/224 [01:25<00:44,  1.97it/s]
Epoch 14 Iter 137: loss 0.17128. :  61%|██████████████████████████                 | 136/224 [01:26<00:44,  1.97it/s]
Epoch 14 Iter 137: loss 0.17128. :  61%|██████████████████████████▎                | 137/224 [01:26<00:45,  1.93it/s]
Epoch 14 Iter 138: loss 0.16958. :  61%|██████████████████████████▎                | 137/224 [01:26<00:45,  1.93it/s]
Epoch 14 Iter 138: loss 0.16958. :  62%|██████████████████████████▍                | 138/224 [01:26<00:44,  1.95it/s]
Epoch 14 Iter 139: loss 0.16527. :  62%|██████████████████████████▍                | 138/224 [01:27<00:44,  1.95it/s]
Epoch 14 Iter 139: loss 0.16527. :  62%|██████████████████████████▋                | 139/224 [01:27<00:43,  1.95it/s]
Epoch 14 Iter 140: loss 0.17172. :  62%|██████████████████████████▋                | 139/224 [01:27<00:43,  1.95it/s]
Epoch 14 Iter 140: loss 0.17172. :  62%|██████████████████████████▉                | 140/224 [01:27<00:43,  1.92it/s]
Epoch 14 Iter 141: loss 0.18207. :  62%|██████████████████████████▉                | 140/224 [01:28<00:43,  1.92it/s]
Epoch 14 Iter 141: loss 0.18207. :  63%|███████████████████████████                | 141/224 [01:28<00:42,  1.95it/s]
Epoch 14 Iter 142: loss 0.17836. :  63%|███████████████████████████                | 141/224 [01:28<00:42,  1.95it/s]
Epoch 14 Iter 142: loss 0.17836. :  63%|███████████████████████████▎               | 142/224 [01:28<00:41,  1.96it/s]
Epoch 14 Iter 143: loss 0.14297. :  63%|███████████████████████████▎               | 142/224 [01:29<00:41,  1.96it/s]
Epoch 14 Iter 143: loss 0.14297. :  64%|███████████████████████████▍               | 143/224 [01:29<00:41,  1.97it/s]
Epoch 14 Iter 144: loss 0.15811. :  64%|███████████████████████████▍               | 143/224 [01:29<00:41,  1.97it/s]
Epoch 14 Iter 144: loss 0.15811. :  64%|███████████████████████████▋               | 144/224 [01:29<00:40,  1.98it/s]
Epoch 14 Iter 145: loss 0.17031. :  64%|███████████████████████████▋               | 144/224 [01:30<00:40,  1.98it/s]
Epoch 14 Iter 145: loss 0.17031. :  65%|███████████████████████████▊               | 145/224 [01:30<00:39,  1.98it/s]
Epoch 14 Iter 146: loss 0.17701. :  65%|███████████████████████████▊               | 145/224 [01:30<00:39,  1.98it/s]
Epoch 14 Iter 146: loss 0.17701. :  65%|████████████████████████████               | 146/224 [01:30<00:39,  1.98it/s]
Epoch 14 Iter 147: loss 0.17354. :  65%|████████████████████████████               | 146/224 [01:31<00:39,  1.98it/s]
Epoch 14 Iter 147: loss 0.17354. :  66%|████████████████████████████▏              | 147/224 [01:31<00:38,  1.98it/s]
Epoch 14 Iter 148: loss 0.15604. :  66%|████████████████████████████▏              | 147/224 [01:31<00:38,  1.98it/s]
Epoch 14 Iter 148: loss 0.15604. :  66%|████████████████████████████▍              | 148/224 [01:31<00:39,  1.93it/s]
Epoch 14 Iter 149: loss 0.18009. :  66%|████████████████████████████▍              | 148/224 [01:32<00:39,  1.93it/s]
Epoch 14 Iter 149: loss 0.18009. :  67%|████████████████████████████▌              | 149/224 [01:32<00:38,  1.94it/s]
Epoch 14 Iter 150: loss 0.16399. :  67%|████████████████████████████▌              | 149/224 [01:32<00:38,  1.94it/s]
Epoch 14 Iter 150: loss 0.16399. :  67%|████████████████████████████▊              | 150/224 [01:32<00:38,  1.95it/s]
Epoch 14 Iter 151: loss 0.16841. :  67%|████████████████████████████▊              | 150/224 [01:33<00:38,  1.95it/s]
Epoch 14 Iter 151: loss 0.16841. :  67%|████████████████████████████▉              | 151/224 [01:33<00:38,  1.90it/s]
Epoch 14 Iter 152: loss 0.17800. :  67%|████████████████████████████▉              | 151/224 [01:33<00:38,  1.90it/s]
Epoch 14 Iter 152: loss 0.17800. :  68%|█████████████████████████████▏             | 152/224 [01:33<00:37,  1.93it/s]
Epoch 14 Iter 153: loss 0.15599. :  68%|█████████████████████████████▏             | 152/224 [01:34<00:37,  1.93it/s]
Epoch 14 Iter 153: loss 0.15599. :  68%|█████████████████████████████▎             | 153/224 [01:34<00:36,  1.92it/s]
Epoch 14 Iter 154: loss 0.17822. :  68%|█████████████████████████████▎             | 153/224 [01:34<00:36,  1.92it/s]
Epoch 14 Iter 154: loss 0.17822. :  69%|█████████████████████████████▌             | 154/224 [01:34<00:36,  1.94it/s]
Epoch 14 Iter 155: loss 0.20519. :  69%|█████████████████████████████▌             | 154/224 [01:35<00:36,  1.94it/s]
Epoch 14 Iter 155: loss 0.20519. :  69%|█████████████████████████████▊             | 155/224 [01:35<00:35,  1.95it/s]
Epoch 14 Iter 156: loss 0.17769. :  69%|█████████████████████████████▊             | 155/224 [01:35<00:35,  1.95it/s]
Epoch 14 Iter 156: loss 0.17769. :  70%|█████████████████████████████▉             | 156/224 [01:35<00:34,  1.95it/s]
Epoch 14 Iter 157: loss 0.18370. :  70%|█████████████████████████████▉             | 156/224 [01:36<00:34,  1.95it/s]
Epoch 14 Iter 157: loss 0.18370. :  70%|██████████████████████████████▏            | 157/224 [01:36<00:34,  1.96it/s]
Epoch 14 Iter 158: loss 0.16652. :  70%|██████████████████████████████▏            | 157/224 [01:36<00:34,  1.96it/s]
Epoch 14 Iter 158: loss 0.16652. :  71%|██████████████████████████████▎            | 158/224 [01:36<00:33,  1.98it/s]
Epoch 14 Iter 159: loss 0.14350. :  71%|██████████████████████████████▎            | 158/224 [01:37<00:33,  1.98it/s]
Epoch 14 Iter 159: loss 0.14350. :  71%|██████████████████████████████▌            | 159/224 [01:37<00:32,  1.97it/s]
Epoch 14 Iter 160: loss 0.15392. :  71%|██████████████████████████████▌            | 159/224 [01:37<00:32,  1.97it/s]
Epoch 14 Iter 160: loss 0.15392. :  71%|██████████████████████████████▋            | 160/224 [01:37<00:32,  1.99it/s]
Epoch 14 Iter 161: loss 0.17297. :  71%|██████████████████████████████▋            | 160/224 [01:38<00:32,  1.99it/s]
Epoch 14 Iter 161: loss 0.17297. :  72%|██████████████████████████████▉            | 161/224 [01:38<00:31,  2.01it/s]
Epoch 14 Iter 162: loss 0.17171. :  72%|██████████████████████████████▉            | 161/224 [01:38<00:31,  2.01it/s]
Epoch 14 Iter 162: loss 0.17171. :  72%|███████████████████████████████            | 162/224 [01:38<00:31,  1.99it/s]
Epoch 14 Iter 163: loss 0.16754. :  72%|███████████████████████████████            | 162/224 [01:39<00:31,  1.99it/s]
Epoch 14 Iter 163: loss 0.16754. :  73%|███████████████████████████████▎           | 163/224 [01:39<00:30,  2.00it/s]
Epoch 14 Iter 164: loss 0.17916. :  73%|███████████████████████████████▎           | 163/224 [01:39<00:30,  2.00it/s]
Epoch 14 Iter 164: loss 0.17916. :  73%|███████████████████████████████▍           | 164/224 [01:39<00:30,  1.98it/s]
Epoch 14 Iter 165: loss 0.15633. :  73%|███████████████████████████████▍           | 164/224 [01:40<00:30,  1.98it/s]
Epoch 14 Iter 165: loss 0.15633. :  74%|███████████████████████████████▋           | 165/224 [01:40<00:30,  1.96it/s]
Epoch 14 Iter 166: loss 0.17002. :  74%|███████████████████████████████▋           | 165/224 [01:40<00:30,  1.96it/s]
Epoch 14 Iter 166: loss 0.17002. :  74%|███████████████████████████████▊           | 166/224 [01:40<00:29,  1.97it/s]
Epoch 14 Iter 167: loss 0.16828. :  74%|███████████████████████████████▊           | 166/224 [01:41<00:29,  1.97it/s]
Epoch 14 Iter 167: loss 0.16828. :  75%|████████████████████████████████           | 167/224 [01:41<00:28,  1.98it/s]
Epoch 14 Iter 168: loss 0.16817. :  75%|████████████████████████████████           | 167/224 [01:41<00:28,  1.98it/s]
Epoch 14 Iter 168: loss 0.16817. :  75%|████████████████████████████████▎          | 168/224 [01:41<00:28,  1.98it/s]
Epoch 14 Iter 169: loss 0.16258. :  75%|████████████████████████████████▎          | 168/224 [01:42<00:28,  1.98it/s]
Epoch 14 Iter 169: loss 0.16258. :  75%|████████████████████████████████▍          | 169/224 [01:42<00:27,  1.97it/s]
Epoch 14 Iter 170: loss 0.18923. :  75%|████████████████████████████████▍          | 169/224 [01:42<00:27,  1.97it/s]
Epoch 14 Iter 170: loss 0.18923. :  76%|████████████████████████████████▋          | 170/224 [01:42<00:27,  1.94it/s]
Epoch 14 Iter 171: loss 0.15966. :  76%|████████████████████████████████▋          | 170/224 [01:43<00:27,  1.94it/s]
Epoch 14 Iter 171: loss 0.15966. :  76%|████████████████████████████████▊          | 171/224 [01:43<00:27,  1.95it/s]
Epoch 14 Iter 172: loss 0.15344. :  76%|████████████████████████████████▊          | 171/224 [01:43<00:27,  1.95it/s]
Epoch 14 Iter 172: loss 0.15344. :  77%|█████████████████████████████████          | 172/224 [01:43<00:26,  1.96it/s]
Epoch 14 Iter 173: loss 0.16802. :  77%|█████████████████████████████████          | 172/224 [01:44<00:26,  1.96it/s]
Epoch 14 Iter 173: loss 0.16802. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:25,  1.97it/s]
Epoch 14 Iter 174: loss 0.16612. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:25,  1.97it/s]
Epoch 14 Iter 174: loss 0.16612. :  78%|█████████████████████████████████▍         | 174/224 [01:44<00:25,  1.97it/s]
Epoch 14 Iter 175: loss 0.16656. :  78%|█████████████████████████████████▍         | 174/224 [01:45<00:25,  1.97it/s]
Epoch 14 Iter 175: loss 0.16656. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:24,  1.97it/s]
Epoch 14 Iter 176: loss 0.17897. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:24,  1.97it/s]
Epoch 14 Iter 176: loss 0.17897. :  79%|█████████████████████████████████▊         | 176/224 [01:45<00:24,  1.97it/s]
Epoch 14 Iter 177: loss 0.17569. :  79%|█████████████████████████████████▊         | 176/224 [01:46<00:24,  1.97it/s]
Epoch 14 Iter 177: loss 0.17569. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:24,  1.93it/s]
Epoch 14 Iter 178: loss 0.15265. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:24,  1.93it/s]
Epoch 14 Iter 178: loss 0.15265. :  79%|██████████████████████████████████▏        | 178/224 [01:46<00:23,  1.94it/s]
Epoch 14 Iter 179: loss 0.18724. :  79%|██████████████████████████████████▏        | 178/224 [01:47<00:23,  1.94it/s]
Epoch 14 Iter 179: loss 0.18724. :  80%|██████████████████████████████████▎        | 179/224 [01:47<00:23,  1.95it/s]
Epoch 14 Iter 180: loss 0.17476. :  80%|██████████████████████████████████▎        | 179/224 [01:47<00:23,  1.95it/s]
Epoch 14 Iter 180: loss 0.17476. :  80%|██████████████████████████████████▌        | 180/224 [01:47<00:22,  1.95it/s]
Epoch 14 Iter 181: loss 0.18262. :  80%|██████████████████████████████████▌        | 180/224 [01:48<00:22,  1.95it/s]
Epoch 14 Iter 181: loss 0.18262. :  81%|██████████████████████████████████▋        | 181/224 [01:48<00:22,  1.94it/s]
Epoch 14 Iter 182: loss 0.15663. :  81%|██████████████████████████████████▋        | 181/224 [01:48<00:22,  1.94it/s]
Epoch 14 Iter 182: loss 0.15663. :  81%|██████████████████████████████████▉        | 182/224 [01:48<00:21,  1.96it/s]
Epoch 14 Iter 183: loss 0.17818. :  81%|██████████████████████████████████▉        | 182/224 [01:49<00:21,  1.96it/s]
Epoch 14 Iter 183: loss 0.17818. :  82%|███████████████████████████████████▏       | 183/224 [01:49<00:20,  1.97it/s]
Epoch 14 Iter 184: loss 0.18080. :  82%|███████████████████████████████████▏       | 183/224 [01:50<00:20,  1.97it/s]
Epoch 14 Iter 184: loss 0.18080. :  82%|███████████████████████████████████▎       | 184/224 [01:50<00:20,  1.96it/s]
Epoch 14 Iter 185: loss 0.17812. :  82%|███████████████████████████████████▎       | 184/224 [01:50<00:20,  1.96it/s]
Epoch 14 Iter 185: loss 0.17812. :  83%|███████████████████████████████████▌       | 185/224 [01:50<00:19,  1.97it/s]
Epoch 14 Iter 186: loss 0.14907. :  83%|███████████████████████████████████▌       | 185/224 [01:51<00:19,  1.97it/s]
Epoch 14 Iter 186: loss 0.14907. :  83%|███████████████████████████████████▋       | 186/224 [01:51<00:19,  1.98it/s]
Epoch 14 Iter 187: loss 0.15007. :  83%|███████████████████████████████████▋       | 186/224 [01:51<00:19,  1.98it/s]
Epoch 14 Iter 187: loss 0.15007. :  83%|███████████████████████████████████▉       | 187/224 [01:51<00:18,  1.97it/s]
Epoch 14 Iter 188: loss 0.16507. :  83%|███████████████████████████████████▉       | 187/224 [01:52<00:18,  1.97it/s]
Epoch 14 Iter 188: loss 0.16507. :  84%|████████████████████████████████████       | 188/224 [01:52<00:18,  1.95it/s]
Epoch 14 Iter 189: loss 0.18193. :  84%|████████████████████████████████████       | 188/224 [01:52<00:18,  1.95it/s]
Epoch 14 Iter 189: loss 0.18193. :  84%|████████████████████████████████████▎      | 189/224 [01:52<00:17,  1.97it/s]
Epoch 14 Iter 190: loss 0.17205. :  84%|████████████████████████████████████▎      | 189/224 [01:53<00:17,  1.97it/s]
Epoch 14 Iter 190: loss 0.17205. :  85%|████████████████████████████████████▍      | 190/224 [01:53<00:17,  2.00it/s]
Epoch 14 Iter 191: loss 0.16211. :  85%|████████████████████████████████████▍      | 190/224 [01:53<00:17,  2.00it/s]
Epoch 14 Iter 191: loss 0.16211. :  85%|████████████████████████████████████▋      | 191/224 [01:53<00:16,  2.00it/s]
Epoch 14 Iter 192: loss 0.17147. :  85%|████████████████████████████████████▋      | 191/224 [01:54<00:16,  2.00it/s]
Epoch 14 Iter 192: loss 0.17147. :  86%|████████████████████████████████████▊      | 192/224 [01:54<00:16,  1.94it/s]
Epoch 14 Iter 193: loss 0.14774. :  86%|████████████████████████████████████▊      | 192/224 [01:54<00:16,  1.94it/s]
Epoch 14 Iter 193: loss 0.14774. :  86%|█████████████████████████████████████      | 193/224 [01:54<00:15,  1.95it/s]
Epoch 14 Iter 194: loss 0.17815. :  86%|█████████████████████████████████████      | 193/224 [01:55<00:15,  1.95it/s]
Epoch 14 Iter 194: loss 0.17815. :  87%|█████████████████████████████████████▏     | 194/224 [01:55<00:15,  1.97it/s]
Epoch 14 Iter 195: loss 0.17354. :  87%|█████████████████████████████████████▏     | 194/224 [01:55<00:15,  1.97it/s]
Epoch 14 Iter 195: loss 0.17354. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:14,  1.98it/s]
Epoch 14 Iter 196: loss 0.18275. :  87%|█████████████████████████████████████▍     | 195/224 [01:56<00:14,  1.98it/s]
Epoch 14 Iter 196: loss 0.18275. :  88%|█████████████████████████████████████▋     | 196/224 [01:56<00:14,  1.98it/s]
Epoch 14 Iter 197: loss 0.15553. :  88%|█████████████████████████████████████▋     | 196/224 [01:56<00:14,  1.98it/s]
Epoch 14 Iter 197: loss 0.15553. :  88%|█████████████████████████████████████▊     | 197/224 [01:56<00:13,  1.99it/s]
Epoch 14 Iter 198: loss 0.15503. :  88%|█████████████████████████████████████▊     | 197/224 [01:57<00:13,  1.99it/s]
Epoch 14 Iter 198: loss 0.15503. :  88%|██████████████████████████████████████     | 198/224 [01:57<00:13,  2.00it/s]
Epoch 14 Iter 199: loss 0.16641. :  88%|██████████████████████████████████████     | 198/224 [01:57<00:13,  2.00it/s]
Epoch 14 Iter 199: loss 0.16641. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:12,  2.00it/s]
Epoch 14 Iter 200: loss 0.17374. :  89%|██████████████████████████████████████▏    | 199/224 [01:58<00:12,  2.00it/s]
Epoch 14 Iter 200: loss 0.17374. :  89%|██████████████████████████████████████▍    | 200/224 [01:58<00:12,  2.00it/s]
Epoch 14 Iter 201: loss 0.16012. :  89%|██████████████████████████████████████▍    | 200/224 [01:58<00:12,  2.00it/s]
Epoch 14 Iter 201: loss 0.16012. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:12,  1.87it/s]
Epoch 14 Iter 202: loss 0.18615. :  90%|██████████████████████████████████████▌    | 201/224 [01:59<00:12,  1.87it/s]
Epoch 14 Iter 202: loss 0.18615. :  90%|██████████████████████████████████████▊    | 202/224 [01:59<00:11,  1.91it/s]
Epoch 14 Iter 203: loss 0.18092. :  90%|██████████████████████████████████████▊    | 202/224 [01:59<00:11,  1.91it/s]
Epoch 14 Iter 203: loss 0.18092. :  91%|██████████████████████████████████████▉    | 203/224 [01:59<00:10,  1.93it/s]
Epoch 14 Iter 204: loss 0.17383. :  91%|██████████████████████████████████████▉    | 203/224 [02:00<00:10,  1.93it/s]
Epoch 14 Iter 204: loss 0.17383. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:10,  1.96it/s]
Epoch 14 Iter 205: loss 0.16522. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:10,  1.96it/s]
Epoch 14 Iter 205: loss 0.16522. :  92%|███████████████████████████████████████▎   | 205/224 [02:00<00:09,  1.96it/s]
Epoch 14 Iter 206: loss 0.17004. :  92%|███████████████████████████████████████▎   | 205/224 [02:01<00:09,  1.96it/s]
Epoch 14 Iter 206: loss 0.17004. :  92%|███████████████████████████████████████▌   | 206/224 [02:01<00:09,  1.99it/s]
Epoch 14 Iter 207: loss 0.15307. :  92%|███████████████████████████████████████▌   | 206/224 [02:01<00:09,  1.99it/s]
Epoch 14 Iter 207: loss 0.15307. :  92%|███████████████████████████████████████▋   | 207/224 [02:01<00:08,  2.00it/s]
Epoch 14 Iter 208: loss 0.19085. :  92%|███████████████████████████████████████▋   | 207/224 [02:02<00:08,  2.00it/s]
Epoch 14 Iter 208: loss 0.19085. :  93%|███████████████████████████████████████▉   | 208/224 [02:02<00:08,  1.99it/s]
Epoch 14 Iter 209: loss 0.16055. :  93%|███████████████████████████████████████▉   | 208/224 [02:02<00:08,  1.99it/s]
Epoch 14 Iter 209: loss 0.16055. :  93%|████████████████████████████████████████   | 209/224 [02:02<00:07,  1.97it/s]
Epoch 14 Iter 210: loss 0.16513. :  93%|████████████████████████████████████████   | 209/224 [02:03<00:07,  1.97it/s]
Epoch 14 Iter 210: loss 0.16513. :  94%|████████████████████████████████████████▎  | 210/224 [02:03<00:07,  1.98it/s]
Epoch 14 Iter 211: loss 0.15505. :  94%|████████████████████████████████████████▎  | 210/224 [02:03<00:07,  1.98it/s]
Epoch 14 Iter 211: loss 0.15505. :  94%|████████████████████████████████████████▌  | 211/224 [02:03<00:06,  1.99it/s]
Epoch 14 Iter 212: loss 0.18636. :  94%|████████████████████████████████████████▌  | 211/224 [02:04<00:06,  1.99it/s]
Epoch 14 Iter 212: loss 0.18636. :  95%|████████████████████████████████████████▋  | 212/224 [02:04<00:06,  1.99it/s]
Epoch 14 Iter 213: loss 0.15903. :  95%|████████████████████████████████████████▋  | 212/224 [02:04<00:06,  1.99it/s]
Epoch 14 Iter 213: loss 0.15903. :  95%|████████████████████████████████████████▉  | 213/224 [02:04<00:05,  1.97it/s]
Epoch 14 Iter 214: loss 0.15592. :  95%|████████████████████████████████████████▉  | 213/224 [02:05<00:05,  1.97it/s]
Epoch 14 Iter 214: loss 0.15592. :  96%|█████████████████████████████████████████  | 214/224 [02:05<00:05,  1.97it/s]
Epoch 14 Iter 215: loss 0.19575. :  96%|█████████████████████████████████████████  | 214/224 [02:05<00:05,  1.97it/s]
Epoch 14 Iter 215: loss 0.19575. :  96%|█████████████████████████████████████████▎ | 215/224 [02:05<00:04,  1.87it/s]
Epoch 14 Iter 216: loss 0.15710. :  96%|█████████████████████████████████████████▎ | 215/224 [02:06<00:04,  1.87it/s]
Epoch 14 Iter 216: loss 0.15710. :  96%|█████████████████████████████████████████▍ | 216/224 [02:06<00:04,  1.82it/s]
Epoch 14 Iter 217: loss 0.15434. :  96%|█████████████████████████████████████████▍ | 216/224 [02:06<00:04,  1.82it/s]
Epoch 14 Iter 217: loss 0.15434. :  97%|█████████████████████████████████████████▋ | 217/224 [02:06<00:03,  1.87it/s]
Epoch 14 Iter 218: loss 0.19268. :  97%|█████████████████████████████████████████▋ | 217/224 [02:07<00:03,  1.87it/s]
Epoch 14 Iter 218: loss 0.19268. :  97%|█████████████████████████████████████████▊ | 218/224 [02:07<00:03,  1.88it/s]
Epoch 14 Iter 219: loss 0.17589. :  97%|█████████████████████████████████████████▊ | 218/224 [02:07<00:03,  1.88it/s]
Epoch 14 Iter 219: loss 0.17589. :  98%|██████████████████████████████████████████ | 219/224 [02:07<00:02,  1.92it/s]
Epoch 14 Iter 220: loss 0.18448. :  98%|██████████████████████████████████████████ | 219/224 [02:08<00:02,  1.92it/s]
Epoch 14 Iter 220: loss 0.18448. :  98%|██████████████████████████████████████████▏| 220/224 [02:08<00:02,  1.95it/s]
Epoch 14 Iter 221: loss 0.17331. :  98%|██████████████████████████████████████████▏| 220/224 [02:08<00:02,  1.95it/s]
Epoch 14 Iter 221: loss 0.17331. :  99%|██████████████████████████████████████████▍| 221/224 [02:08<00:01,  1.95it/s]
Epoch 14 Iter 222: loss 0.16636. :  99%|██████████████████████████████████████████▍| 221/224 [02:09<00:01,  1.95it/s]
Epoch 14 Iter 222: loss 0.16636. :  99%|██████████████████████████████████████████▌| 222/224 [02:09<00:01,  1.97it/s]
Epoch 14 Iter 223: loss 0.14762. :  99%|██████████████████████████████████████████▌| 222/224 [02:09<00:01,  1.97it/s]
Epoch 14 Iter 223: loss 0.14762. : 100%|██████████████████████████████████████████▊| 223/224 [02:09<00:00,  1.93it/s]
Epoch 14 Iter 224: loss 0.15540. : 100%|██████████████████████████████████████████▊| 223/224 [02:10<00:00,  1.93it/s]
Epoch 14 Iter 224: loss 0.15540. : 100%|███████████████████████████████████████████| 224/224 [02:10<00:00,  1.84it/s]
Epoch 14 Iter 224: loss 0.15540. : 100%|███████████████████████████████████████████| 224/224 [02:10<00:00,  1.72it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.16961. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.16961. :   0%|▏                                              | 1/224 [00:00<01:50,  2.01it/s]
Epoch 15 Iter 2: loss 0.16385. :   0%|▏                                              | 1/224 [00:01<01:50,  2.01it/s]
Epoch 15 Iter 2: loss 0.16385. :   1%|▍                                              | 2/224 [00:01<02:04,  1.79it/s]
Epoch 15 Iter 3: loss 0.17129. :   1%|▍                                              | 2/224 [00:01<02:04,  1.79it/s]
Epoch 15 Iter 3: loss 0.17129. :   1%|▋                                              | 3/224 [00:01<02:01,  1.82it/s]
Epoch 15 Iter 4: loss 0.16077. :   1%|▋                                              | 3/224 [00:02<02:01,  1.82it/s]
Epoch 15 Iter 4: loss 0.16077. :   2%|▊                                              | 4/224 [00:02<02:00,  1.83it/s]
Epoch 15 Iter 5: loss 0.17083. :   2%|▊                                              | 4/224 [00:02<02:00,  1.83it/s]
Epoch 15 Iter 5: loss 0.17083. :   2%|█                                              | 5/224 [00:02<01:54,  1.91it/s]
Epoch 15 Iter 6: loss 0.16841. :   2%|█                                              | 5/224 [00:03<01:54,  1.91it/s]
Epoch 15 Iter 6: loss 0.16841. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 15 Iter 7: loss 0.17284. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 15 Iter 7: loss 0.17284. :   3%|█▍                                             | 7/224 [00:03<01:50,  1.96it/s]
Epoch 15 Iter 8: loss 0.17398. :   3%|█▍                                             | 7/224 [00:04<01:50,  1.96it/s]
Epoch 15 Iter 8: loss 0.17398. :   4%|█▋                                             | 8/224 [00:04<01:50,  1.96it/s]
Epoch 15 Iter 9: loss 0.18425. :   4%|█▋                                             | 8/224 [00:04<01:50,  1.96it/s]
Epoch 15 Iter 9: loss 0.18425. :   4%|█▉                                             | 9/224 [00:04<01:49,  1.96it/s]
Epoch 15 Iter 10: loss 0.17933. :   4%|█▊                                            | 9/224 [00:05<01:49,  1.96it/s]
Epoch 15 Iter 10: loss 0.17933. :   4%|██                                           | 10/224 [00:05<01:48,  1.98it/s]
Epoch 15 Iter 11: loss 0.17628. :   4%|██                                           | 10/224 [00:05<01:48,  1.98it/s]
Epoch 15 Iter 11: loss 0.17628. :   5%|██▏                                          | 11/224 [00:05<01:47,  1.98it/s]
Epoch 15 Iter 12: loss 0.17070. :   5%|██▏                                          | 11/224 [00:06<01:47,  1.98it/s]
Epoch 15 Iter 12: loss 0.17070. :   5%|██▍                                          | 12/224 [00:06<01:47,  1.97it/s]
Epoch 15 Iter 13: loss 0.16987. :   5%|██▍                                          | 12/224 [00:06<01:47,  1.97it/s]
Epoch 15 Iter 13: loss 0.16987. :   6%|██▌                                          | 13/224 [00:06<01:47,  1.97it/s]
Epoch 15 Iter 14: loss 0.16145. :   6%|██▌                                          | 13/224 [00:07<01:47,  1.97it/s]
Epoch 15 Iter 14: loss 0.16145. :   6%|██▊                                          | 14/224 [00:07<01:45,  1.99it/s]
Epoch 15 Iter 15: loss 0.15490. :   6%|██▊                                          | 14/224 [00:07<01:45,  1.99it/s]
Epoch 15 Iter 15: loss 0.15490. :   7%|███                                          | 15/224 [00:07<01:47,  1.94it/s]
Epoch 15 Iter 16: loss 0.16404. :   7%|███                                          | 15/224 [00:08<01:47,  1.94it/s]
Epoch 15 Iter 16: loss 0.16404. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 15 Iter 17: loss 0.17347. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 15 Iter 17: loss 0.17347. :   8%|███▍                                         | 17/224 [00:08<01:44,  1.98it/s]
Epoch 15 Iter 18: loss 0.19478. :   8%|███▍                                         | 17/224 [00:09<01:44,  1.98it/s]
Epoch 15 Iter 18: loss 0.19478. :   8%|███▌                                         | 18/224 [00:09<01:43,  1.98it/s]
Epoch 15 Iter 19: loss 0.17570. :   8%|███▌                                         | 18/224 [00:09<01:43,  1.98it/s]
Epoch 15 Iter 19: loss 0.17570. :   8%|███▊                                         | 19/224 [00:09<01:42,  2.00it/s]
Epoch 15 Iter 20: loss 0.14759. :   8%|███▊                                         | 19/224 [00:10<01:42,  2.00it/s]
Epoch 15 Iter 20: loss 0.14759. :   9%|████                                         | 20/224 [00:10<01:41,  2.01it/s]
Epoch 15 Iter 21: loss 0.15909. :   9%|████                                         | 20/224 [00:10<01:41,  2.01it/s]
Epoch 15 Iter 21: loss 0.15909. :   9%|████▏                                        | 21/224 [00:10<01:41,  2.01it/s]
Epoch 15 Iter 22: loss 0.17274. :   9%|████▏                                        | 21/224 [00:11<01:41,  2.01it/s]
Epoch 15 Iter 22: loss 0.17274. :  10%|████▍                                        | 22/224 [00:11<01:40,  2.02it/s]
Epoch 15 Iter 23: loss 0.18443. :  10%|████▍                                        | 22/224 [00:11<01:40,  2.02it/s]
Epoch 15 Iter 23: loss 0.18443. :  10%|████▌                                        | 23/224 [00:11<01:40,  2.00it/s]
Epoch 15 Iter 24: loss 0.16153. :  10%|████▌                                        | 23/224 [00:12<01:40,  2.00it/s]
Epoch 15 Iter 24: loss 0.16153. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.00it/s]
Epoch 15 Iter 25: loss 0.17350. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.00it/s]
Epoch 15 Iter 25: loss 0.17350. :  11%|█████                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 15 Iter 26: loss 0.16887. :  11%|█████                                        | 25/224 [00:13<01:39,  2.00it/s]
Epoch 15 Iter 26: loss 0.16887. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.01it/s]
Epoch 15 Iter 27: loss 0.14825. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.01it/s]
Epoch 15 Iter 27: loss 0.14825. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.01it/s]
Epoch 15 Iter 28: loss 0.17288. :  12%|█████▍                                       | 27/224 [00:14<01:37,  2.01it/s]
Epoch 15 Iter 28: loss 0.17288. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.00it/s]
Epoch 15 Iter 29: loss 0.16684. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.00it/s]
Epoch 15 Iter 29: loss 0.16684. :  13%|█████▊                                       | 29/224 [00:14<01:37,  2.00it/s]
Epoch 15 Iter 30: loss 0.17533. :  13%|█████▊                                       | 29/224 [00:15<01:37,  2.00it/s]
Epoch 15 Iter 30: loss 0.17533. :  13%|██████                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 15 Iter 31: loss 0.15397. :  13%|██████                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 15 Iter 31: loss 0.15397. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.01it/s]
Epoch 15 Iter 32: loss 0.16145. :  14%|██████▏                                      | 31/224 [00:16<01:35,  2.01it/s]
Epoch 15 Iter 32: loss 0.16145. :  14%|██████▍                                      | 32/224 [00:16<01:35,  2.02it/s]
Epoch 15 Iter 33: loss 0.15210. :  14%|██████▍                                      | 32/224 [00:16<01:35,  2.02it/s]
Epoch 15 Iter 33: loss 0.15210. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.02it/s]
Epoch 15 Iter 34: loss 0.16242. :  15%|██████▋                                      | 33/224 [00:17<01:34,  2.02it/s]
Epoch 15 Iter 34: loss 0.16242. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.00it/s]
Epoch 15 Iter 35: loss 0.16322. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.00it/s]
Epoch 15 Iter 35: loss 0.16322. :  16%|███████                                      | 35/224 [00:17<01:34,  2.01it/s]
Epoch 15 Iter 36: loss 0.15283. :  16%|███████                                      | 35/224 [00:18<01:34,  2.01it/s]
Epoch 15 Iter 36: loss 0.15283. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.02it/s]
Epoch 15 Iter 37: loss 0.17787. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.02it/s]
Epoch 15 Iter 37: loss 0.17787. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.01it/s]
Epoch 15 Iter 38: loss 0.17658. :  17%|███████▍                                     | 37/224 [00:19<01:33,  2.01it/s]
Epoch 15 Iter 38: loss 0.17658. :  17%|███████▋                                     | 38/224 [00:19<01:34,  1.98it/s]
Epoch 15 Iter 39: loss 0.16649. :  17%|███████▋                                     | 38/224 [00:19<01:34,  1.98it/s]
Epoch 15 Iter 39: loss 0.16649. :  17%|███████▊                                     | 39/224 [00:19<01:34,  1.97it/s]
Epoch 15 Iter 40: loss 0.16719. :  17%|███████▊                                     | 39/224 [00:20<01:34,  1.97it/s]
Epoch 15 Iter 40: loss 0.16719. :  18%|████████                                     | 40/224 [00:20<01:33,  1.96it/s]
Epoch 15 Iter 41: loss 0.16055. :  18%|████████                                     | 40/224 [00:20<01:33,  1.96it/s]
Epoch 15 Iter 41: loss 0.16055. :  18%|████████▏                                    | 41/224 [00:20<01:33,  1.95it/s]
Epoch 15 Iter 42: loss 0.16741. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.95it/s]
Epoch 15 Iter 42: loss 0.16741. :  19%|████████▍                                    | 42/224 [00:21<01:32,  1.96it/s]
Epoch 15 Iter 43: loss 0.16118. :  19%|████████▍                                    | 42/224 [00:21<01:32,  1.96it/s]
Epoch 15 Iter 43: loss 0.16118. :  19%|████████▋                                    | 43/224 [00:21<01:31,  1.98it/s]
Epoch 15 Iter 44: loss 0.17264. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.98it/s]
Epoch 15 Iter 44: loss 0.17264. :  20%|████████▊                                    | 44/224 [00:22<01:30,  1.98it/s]
Epoch 15 Iter 45: loss 0.16634. :  20%|████████▊                                    | 44/224 [00:22<01:30,  1.98it/s]
Epoch 15 Iter 45: loss 0.16634. :  20%|█████████                                    | 45/224 [00:22<01:30,  1.98it/s]
Epoch 15 Iter 46: loss 0.18675. :  20%|█████████                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 15 Iter 46: loss 0.18675. :  21%|█████████▏                                   | 46/224 [00:23<01:29,  1.99it/s]
Epoch 15 Iter 47: loss 0.16493. :  21%|█████████▏                                   | 46/224 [00:23<01:29,  1.99it/s]
Epoch 15 Iter 47: loss 0.16493. :  21%|█████████▍                                   | 47/224 [00:23<01:32,  1.91it/s]
Epoch 15 Iter 48: loss 0.15902. :  21%|█████████▍                                   | 47/224 [00:24<01:32,  1.91it/s]
Epoch 15 Iter 48: loss 0.15902. :  21%|█████████▋                                   | 48/224 [00:24<01:31,  1.93it/s]
Epoch 15 Iter 49: loss 0.15644. :  21%|█████████▋                                   | 48/224 [00:24<01:31,  1.93it/s]
Epoch 15 Iter 49: loss 0.15644. :  22%|█████████▊                                   | 49/224 [00:24<01:29,  1.95it/s]
Epoch 15 Iter 50: loss 0.18085. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.95it/s]
Epoch 15 Iter 50: loss 0.18085. :  22%|██████████                                   | 50/224 [00:25<01:28,  1.96it/s]
Epoch 15 Iter 51: loss 0.16237. :  22%|██████████                                   | 50/224 [00:25<01:28,  1.96it/s]
Epoch 15 Iter 51: loss 0.16237. :  23%|██████████▏                                  | 51/224 [00:25<01:28,  1.95it/s]
Epoch 15 Iter 52: loss 0.16409. :  23%|██████████▏                                  | 51/224 [00:26<01:28,  1.95it/s]
Epoch 15 Iter 52: loss 0.16409. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.17668. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.17668. :  24%|██████████▋                                  | 53/224 [00:26<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.16699. :  24%|██████████▋                                  | 53/224 [00:27<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.16699. :  24%|██████████▊                                  | 54/224 [00:27<01:25,  1.98it/s]
Epoch 15 Iter 55: loss 0.18561. :  24%|██████████▊                                  | 54/224 [00:27<01:25,  1.98it/s]
Epoch 15 Iter 55: loss 0.18561. :  25%|███████████                                  | 55/224 [00:27<01:24,  1.99it/s]
Epoch 15 Iter 56: loss 0.15108. :  25%|███████████                                  | 55/224 [00:28<01:24,  1.99it/s]
Epoch 15 Iter 56: loss 0.15108. :  25%|███████████▎                                 | 56/224 [00:28<01:24,  2.00it/s]
Epoch 15 Iter 57: loss 0.14912. :  25%|███████████▎                                 | 56/224 [00:28<01:24,  2.00it/s]
Epoch 15 Iter 57: loss 0.14912. :  25%|███████████▍                                 | 57/224 [00:28<01:23,  2.00it/s]
Epoch 15 Iter 58: loss 0.18191. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  2.00it/s]
Epoch 15 Iter 58: loss 0.18191. :  26%|███████████▋                                 | 58/224 [00:29<01:30,  1.83it/s]
Epoch 15 Iter 59: loss 0.17501. :  26%|███████████▋                                 | 58/224 [00:30<01:30,  1.83it/s]
Epoch 15 Iter 59: loss 0.17501. :  26%|███████████▊                                 | 59/224 [00:30<01:32,  1.78it/s]
Epoch 15 Iter 60: loss 0.15345. :  26%|███████████▊                                 | 59/224 [00:30<01:32,  1.78it/s]
Epoch 15 Iter 60: loss 0.15345. :  27%|████████████                                 | 60/224 [00:30<01:31,  1.79it/s]
Epoch 15 Iter 61: loss 0.17361. :  27%|████████████                                 | 60/224 [00:31<01:31,  1.79it/s]
Epoch 15 Iter 61: loss 0.17361. :  27%|████████████▎                                | 61/224 [00:31<01:37,  1.67it/s]
Epoch 15 Iter 62: loss 0.17399. :  27%|████████████▎                                | 61/224 [00:32<01:37,  1.67it/s]
Epoch 15 Iter 62: loss 0.17399. :  28%|████████████▍                                | 62/224 [00:32<01:46,  1.52it/s]
Epoch 15 Iter 63: loss 0.16968. :  28%|████████████▍                                | 62/224 [00:32<01:46,  1.52it/s]
Epoch 15 Iter 63: loss 0.16968. :  28%|████████████▋                                | 63/224 [00:32<01:47,  1.50it/s]
Epoch 15 Iter 64: loss 0.18274. :  28%|████████████▋                                | 63/224 [00:33<01:47,  1.50it/s]
Epoch 15 Iter 64: loss 0.18274. :  29%|████████████▊                                | 64/224 [00:33<01:44,  1.53it/s]
Epoch 15 Iter 65: loss 0.17321. :  29%|████████████▊                                | 64/224 [00:33<01:44,  1.53it/s]
Epoch 15 Iter 65: loss 0.17321. :  29%|█████████████                                | 65/224 [00:33<01:38,  1.62it/s]
Epoch 15 Iter 66: loss 0.17782. :  29%|█████████████                                | 65/224 [00:34<01:38,  1.62it/s]
Epoch 15 Iter 66: loss 0.17782. :  29%|█████████████▎                               | 66/224 [00:34<01:40,  1.57it/s]
Epoch 15 Iter 67: loss 0.14829. :  29%|█████████████▎                               | 66/224 [00:35<01:40,  1.57it/s]
Epoch 15 Iter 67: loss 0.14829. :  30%|█████████████▍                               | 67/224 [00:35<01:44,  1.50it/s]
Epoch 15 Iter 68: loss 0.14675. :  30%|█████████████▍                               | 67/224 [00:36<01:44,  1.50it/s]
Epoch 15 Iter 68: loss 0.14675. :  30%|█████████████▋                               | 68/224 [00:36<01:48,  1.44it/s]
Epoch 15 Iter 69: loss 0.18852. :  30%|█████████████▋                               | 68/224 [00:36<01:48,  1.44it/s]
Epoch 15 Iter 69: loss 0.18852. :  31%|█████████████▊                               | 69/224 [00:36<01:40,  1.54it/s]
Epoch 15 Iter 70: loss 0.18755. :  31%|█████████████▊                               | 69/224 [00:37<01:40,  1.54it/s]
Epoch 15 Iter 70: loss 0.18755. :  31%|██████████████                               | 70/224 [00:37<01:36,  1.59it/s]
Epoch 15 Iter 71: loss 0.16301. :  31%|██████████████                               | 70/224 [00:38<01:36,  1.59it/s]
Epoch 15 Iter 71: loss 0.16301. :  32%|██████████████▎                              | 71/224 [00:38<01:42,  1.50it/s]
Epoch 15 Iter 72: loss 0.17368. :  32%|██████████████▎                              | 71/224 [00:38<01:42,  1.50it/s]
Epoch 15 Iter 72: loss 0.17368. :  32%|██████████████▍                              | 72/224 [00:38<01:45,  1.44it/s]
Epoch 15 Iter 73: loss 0.16096. :  32%|██████████████▍                              | 72/224 [00:39<01:45,  1.44it/s]
Epoch 15 Iter 73: loss 0.16096. :  33%|██████████████▋                              | 73/224 [00:39<01:47,  1.41it/s]
Epoch 15 Iter 74: loss 0.17169. :  33%|██████████████▋                              | 73/224 [00:40<01:47,  1.41it/s]
Epoch 15 Iter 74: loss 0.17169. :  33%|██████████████▊                              | 74/224 [00:40<01:49,  1.37it/s]
Epoch 15 Iter 75: loss 0.17849. :  33%|██████████████▊                              | 74/224 [00:41<01:49,  1.37it/s]
Epoch 15 Iter 75: loss 0.17849. :  33%|███████████████                              | 75/224 [00:41<01:51,  1.34it/s]
Epoch 15 Iter 76: loss 0.18072. :  33%|███████████████                              | 75/224 [00:41<01:51,  1.34it/s]
Epoch 15 Iter 76: loss 0.18072. :  34%|███████████████▎                             | 76/224 [00:41<01:51,  1.32it/s]
Epoch 15 Iter 77: loss 0.16469. :  34%|███████████████▎                             | 76/224 [00:42<01:51,  1.32it/s]
Epoch 15 Iter 77: loss 0.16469. :  34%|███████████████▍                             | 77/224 [00:42<01:42,  1.44it/s]
Epoch 15 Iter 78: loss 0.12917. :  34%|███████████████▍                             | 77/224 [00:42<01:42,  1.44it/s]
Epoch 15 Iter 78: loss 0.12917. :  35%|███████████████▋                             | 78/224 [00:42<01:34,  1.55it/s]
Epoch 15 Iter 79: loss 0.17182. :  35%|███████████████▋                             | 78/224 [00:43<01:34,  1.55it/s]
Epoch 15 Iter 79: loss 0.17182. :  35%|███████████████▊                             | 79/224 [00:43<01:28,  1.63it/s]
Epoch 15 Iter 80: loss 0.17212. :  35%|███████████████▊                             | 79/224 [00:44<01:28,  1.63it/s]
Epoch 15 Iter 80: loss 0.17212. :  36%|████████████████                             | 80/224 [00:44<01:25,  1.68it/s]
Epoch 15 Iter 81: loss 0.16546. :  36%|████████████████                             | 80/224 [00:44<01:25,  1.68it/s]
Epoch 15 Iter 81: loss 0.16546. :  36%|████████████████▎                            | 81/224 [00:44<01:23,  1.72it/s]
Epoch 15 Iter 82: loss 0.17104. :  36%|████████████████▎                            | 81/224 [00:45<01:23,  1.72it/s]
Epoch 15 Iter 82: loss 0.17104. :  37%|████████████████▍                            | 82/224 [00:45<01:21,  1.75it/s]
Epoch 15 Iter 83: loss 0.17053. :  37%|████████████████▍                            | 82/224 [00:45<01:21,  1.75it/s]
Epoch 15 Iter 83: loss 0.17053. :  37%|████████████████▋                            | 83/224 [00:45<01:20,  1.76it/s]
Epoch 15 Iter 84: loss 0.16928. :  37%|████████████████▋                            | 83/224 [00:46<01:20,  1.76it/s]
Epoch 15 Iter 84: loss 0.16928. :  38%|████████████████▉                            | 84/224 [00:46<01:28,  1.57it/s]
Epoch 15 Iter 85: loss 0.18996. :  38%|████████████████▉                            | 84/224 [00:47<01:28,  1.57it/s]
Epoch 15 Iter 85: loss 0.18996. :  38%|█████████████████                            | 85/224 [00:47<01:33,  1.49it/s]
Epoch 15 Iter 86: loss 0.17051. :  38%|█████████████████                            | 85/224 [00:48<01:33,  1.49it/s]
Epoch 15 Iter 86: loss 0.17051. :  38%|█████████████████▎                           | 86/224 [00:48<01:36,  1.43it/s]
Epoch 15 Iter 87: loss 0.17652. :  38%|█████████████████▎                           | 86/224 [00:48<01:36,  1.43it/s]
Epoch 15 Iter 87: loss 0.17652. :  39%|█████████████████▍                           | 87/224 [00:48<01:38,  1.39it/s]
Epoch 15 Iter 88: loss 0.15103. :  39%|█████████████████▍                           | 87/224 [00:49<01:38,  1.39it/s]
Epoch 15 Iter 88: loss 0.15103. :  39%|█████████████████▋                           | 88/224 [00:49<01:39,  1.36it/s]
Epoch 15 Iter 89: loss 0.15216. :  39%|█████████████████▋                           | 88/224 [00:50<01:39,  1.36it/s]
Epoch 15 Iter 89: loss 0.15216. :  40%|█████████████████▉                           | 89/224 [00:50<01:36,  1.40it/s]
Epoch 15 Iter 90: loss 0.17132. :  40%|█████████████████▉                           | 89/224 [00:50<01:36,  1.40it/s]
Epoch 15 Iter 90: loss 0.17132. :  40%|██████████████████                           | 90/224 [00:50<01:29,  1.49it/s]
Epoch 15 Iter 91: loss 0.16287. :  40%|██████████████████                           | 90/224 [00:51<01:29,  1.49it/s]
Epoch 15 Iter 91: loss 0.16287. :  41%|██████████████████▎                          | 91/224 [00:51<01:23,  1.58it/s]
Epoch 15 Iter 92: loss 0.17081. :  41%|██████████████████▎                          | 91/224 [00:51<01:23,  1.58it/s]
Epoch 15 Iter 92: loss 0.17081. :  41%|██████████████████▍                          | 92/224 [00:51<01:19,  1.66it/s]
Epoch 15 Iter 93: loss 0.18310. :  41%|██████████████████▍                          | 92/224 [00:52<01:19,  1.66it/s]
Epoch 15 Iter 93: loss 0.18310. :  42%|██████████████████▋                          | 93/224 [00:52<01:16,  1.72it/s]
Epoch 15 Iter 94: loss 0.17577. :  42%|██████████████████▋                          | 93/224 [00:53<01:16,  1.72it/s]
Epoch 15 Iter 94: loss 0.17577. :  42%|██████████████████▉                          | 94/224 [00:53<01:18,  1.65it/s]
Epoch 15 Iter 95: loss 0.17543. :  42%|██████████████████▉                          | 94/224 [00:53<01:18,  1.65it/s]
Epoch 15 Iter 95: loss 0.17543. :  42%|███████████████████                          | 95/224 [00:53<01:23,  1.54it/s]
Epoch 15 Iter 96: loss 0.16905. :  42%|███████████████████                          | 95/224 [00:54<01:23,  1.54it/s]
Epoch 15 Iter 96: loss 0.16905. :  43%|███████████████████▎                         | 96/224 [00:54<01:27,  1.46it/s]
Epoch 15 Iter 97: loss 0.15783. :  43%|███████████████████▎                         | 96/224 [00:55<01:27,  1.46it/s]
Epoch 15 Iter 97: loss 0.15783. :  43%|███████████████████▍                         | 97/224 [00:55<01:30,  1.41it/s]
Epoch 15 Iter 98: loss 0.17824. :  43%|███████████████████▍                         | 97/224 [00:55<01:30,  1.41it/s]
Epoch 15 Iter 98: loss 0.17824. :  44%|███████████████████▋                         | 98/224 [00:55<01:23,  1.52it/s]
Epoch 15 Iter 99: loss 0.15509. :  44%|███████████████████▋                         | 98/224 [00:56<01:23,  1.52it/s]
Epoch 15 Iter 99: loss 0.15509. :  44%|███████████████████▉                         | 99/224 [00:56<01:18,  1.60it/s]
Epoch 15 Iter 100: loss 0.15113. :  44%|███████████████████▍                        | 99/224 [00:57<01:18,  1.60it/s]
Epoch 15 Iter 100: loss 0.15113. :  45%|███████████████████▏                       | 100/224 [00:57<01:23,  1.48it/s]
Epoch 15 Iter 101: loss 0.16458. :  45%|███████████████████▏                       | 100/224 [00:58<01:23,  1.48it/s]
Epoch 15 Iter 101: loss 0.16458. :  45%|███████████████████▍                       | 101/224 [00:58<01:27,  1.41it/s]
Epoch 15 Iter 102: loss 0.17502. :  45%|███████████████████▍                       | 101/224 [00:58<01:27,  1.41it/s]
Epoch 15 Iter 102: loss 0.17502. :  46%|███████████████████▌                       | 102/224 [00:58<01:28,  1.37it/s]
Epoch 15 Iter 103: loss 0.18152. :  46%|███████████████████▌                       | 102/224 [00:59<01:28,  1.37it/s]
Epoch 15 Iter 103: loss 0.18152. :  46%|███████████████████▊                       | 103/224 [00:59<01:29,  1.36it/s]
Epoch 15 Iter 104: loss 0.16747. :  46%|███████████████████▊                       | 103/224 [01:00<01:29,  1.36it/s]
Epoch 15 Iter 104: loss 0.16747. :  46%|███████████████████▉                       | 104/224 [01:00<01:25,  1.41it/s]
Epoch 15 Iter 105: loss 0.17683. :  46%|███████████████████▉                       | 104/224 [01:00<01:25,  1.41it/s]
Epoch 15 Iter 105: loss 0.17683. :  47%|████████████████████▏                      | 105/224 [01:00<01:22,  1.45it/s]
Epoch 15 Iter 106: loss 0.15875. :  47%|████████████████████▏                      | 105/224 [01:01<01:22,  1.45it/s]
Epoch 15 Iter 106: loss 0.15875. :  47%|████████████████████▎                      | 106/224 [01:01<01:16,  1.55it/s]
Epoch 15 Iter 107: loss 0.15692. :  47%|████████████████████▎                      | 106/224 [01:02<01:16,  1.55it/s]
Epoch 15 Iter 107: loss 0.15692. :  48%|████████████████████▌                      | 107/224 [01:02<01:20,  1.46it/s]
Epoch 15 Iter 108: loss 0.16502. :  48%|████████████████████▌                      | 107/224 [01:02<01:20,  1.46it/s]
Epoch 15 Iter 108: loss 0.16502. :  48%|████████████████████▋                      | 108/224 [01:02<01:15,  1.54it/s]
Epoch 15 Iter 109: loss 0.17713. :  48%|████████████████████▋                      | 108/224 [01:03<01:15,  1.54it/s]
Epoch 15 Iter 109: loss 0.17713. :  49%|████████████████████▉                      | 109/224 [01:03<01:10,  1.64it/s]
Epoch 15 Iter 110: loss 0.17259. :  49%|████████████████████▉                      | 109/224 [01:03<01:10,  1.64it/s]
Epoch 15 Iter 110: loss 0.17259. :  49%|█████████████████████                      | 110/224 [01:03<01:07,  1.68it/s]
Epoch 15 Iter 111: loss 0.15948. :  49%|█████████████████████                      | 110/224 [01:04<01:07,  1.68it/s]
Epoch 15 Iter 111: loss 0.15948. :  50%|█████████████████████▎                     | 111/224 [01:04<01:13,  1.54it/s]
Epoch 15 Iter 112: loss 0.18311. :  50%|█████████████████████▎                     | 111/224 [01:05<01:13,  1.54it/s]
Epoch 15 Iter 112: loss 0.18311. :  50%|█████████████████████▌                     | 112/224 [01:05<01:17,  1.45it/s]
Epoch 15 Iter 113: loss 0.18122. :  50%|█████████████████████▌                     | 112/224 [01:06<01:17,  1.45it/s]
Epoch 15 Iter 113: loss 0.18122. :  50%|█████████████████████▋                     | 113/224 [01:06<01:14,  1.48it/s]
Epoch 15 Iter 114: loss 0.17251. :  50%|█████████████████████▋                     | 113/224 [01:06<01:14,  1.48it/s]
Epoch 15 Iter 114: loss 0.17251. :  51%|█████████████████████▉                     | 114/224 [01:06<01:09,  1.57it/s]
Epoch 15 Iter 115: loss 0.19693. :  51%|█████████████████████▉                     | 114/224 [01:07<01:09,  1.57it/s]
Epoch 15 Iter 115: loss 0.19693. :  51%|██████████████████████                     | 115/224 [01:07<01:06,  1.65it/s]
Epoch 15 Iter 116: loss 0.15344. :  51%|██████████████████████                     | 115/224 [01:07<01:06,  1.65it/s]
Epoch 15 Iter 116: loss 0.15344. :  52%|██████████████████████▎                    | 116/224 [01:07<01:03,  1.69it/s]
Epoch 15 Iter 117: loss 0.17237. :  52%|██████████████████████▎                    | 116/224 [01:08<01:03,  1.69it/s]
Epoch 15 Iter 117: loss 0.17237. :  52%|██████████████████████▍                    | 117/224 [01:08<01:02,  1.71it/s]
Epoch 15 Iter 118: loss 0.18174. :  52%|██████████████████████▍                    | 117/224 [01:08<01:02,  1.71it/s]
Epoch 15 Iter 118: loss 0.18174. :  53%|██████████████████████▋                    | 118/224 [01:08<01:06,  1.60it/s]
Epoch 15 Iter 119: loss 0.16523. :  53%|██████████████████████▋                    | 118/224 [01:09<01:06,  1.60it/s]
Epoch 15 Iter 119: loss 0.16523. :  53%|██████████████████████▊                    | 119/224 [01:09<01:02,  1.69it/s]
Epoch 15 Iter 120: loss 0.16726. :  53%|██████████████████████▊                    | 119/224 [01:10<01:02,  1.69it/s]
Epoch 15 Iter 120: loss 0.16726. :  54%|███████████████████████                    | 120/224 [01:10<01:00,  1.72it/s]
Epoch 15 Iter 121: loss 0.16606. :  54%|███████████████████████                    | 120/224 [01:10<01:00,  1.72it/s]
Epoch 15 Iter 121: loss 0.16606. :  54%|███████████████████████▏                   | 121/224 [01:10<00:59,  1.72it/s]
Epoch 15 Iter 122: loss 0.15435. :  54%|███████████████████████▏                   | 121/224 [01:11<00:59,  1.72it/s]
Epoch 15 Iter 122: loss 0.15435. :  54%|███████████████████████▍                   | 122/224 [01:11<00:58,  1.74it/s]
Epoch 15 Iter 123: loss 0.16541. :  54%|███████████████████████▍                   | 122/224 [01:11<00:58,  1.74it/s]
Epoch 15 Iter 123: loss 0.16541. :  55%|███████████████████████▌                   | 123/224 [01:11<01:04,  1.58it/s]
Epoch 15 Iter 124: loss 0.16965. :  55%|███████████████████████▌                   | 123/224 [01:12<01:04,  1.58it/s]
Epoch 15 Iter 124: loss 0.16965. :  55%|███████████████████████▊                   | 124/224 [01:12<01:08,  1.45it/s]
Epoch 15 Iter 125: loss 0.16865. :  55%|███████████████████████▊                   | 124/224 [01:13<01:08,  1.45it/s]
Epoch 15 Iter 125: loss 0.16865. :  56%|███████████████████████▉                   | 125/224 [01:13<01:10,  1.40it/s]
Epoch 15 Iter 126: loss 0.16830. :  56%|███████████████████████▉                   | 125/224 [01:14<01:10,  1.40it/s]
Epoch 15 Iter 126: loss 0.16830. :  56%|████████████████████████▏                  | 126/224 [01:14<01:05,  1.50it/s]
Epoch 15 Iter 127: loss 0.15469. :  56%|████████████████████████▏                  | 126/224 [01:14<01:05,  1.50it/s]
Epoch 15 Iter 127: loss 0.15469. :  57%|████████████████████████▍                  | 127/224 [01:14<01:01,  1.57it/s]
Epoch 15 Iter 128: loss 0.17379. :  57%|████████████████████████▍                  | 127/224 [01:15<01:01,  1.57it/s]
Epoch 15 Iter 128: loss 0.17379. :  57%|████████████████████████▌                  | 128/224 [01:15<00:58,  1.64it/s]
Epoch 15 Iter 129: loss 0.17877. :  57%|████████████████████████▌                  | 128/224 [01:15<00:58,  1.64it/s]
Epoch 15 Iter 129: loss 0.17877. :  58%|████████████████████████▊                  | 129/224 [01:15<01:01,  1.54it/s]
Epoch 15 Iter 130: loss 0.16326. :  58%|████████████████████████▊                  | 129/224 [01:16<01:01,  1.54it/s]
Epoch 15 Iter 130: loss 0.16326. :  58%|████████████████████████▉                  | 130/224 [01:16<00:58,  1.60it/s]
Epoch 15 Iter 131: loss 0.16279. :  58%|████████████████████████▉                  | 130/224 [01:17<00:58,  1.60it/s]
Epoch 15 Iter 131: loss 0.16279. :  58%|█████████████████████████▏                 | 131/224 [01:17<00:56,  1.65it/s]
Epoch 15 Iter 132: loss 0.16457. :  58%|█████████████████████████▏                 | 131/224 [01:17<00:56,  1.65it/s]
Epoch 15 Iter 132: loss 0.16457. :  59%|█████████████████████████▎                 | 132/224 [01:17<00:53,  1.71it/s]
Epoch 15 Iter 133: loss 0.17726. :  59%|█████████████████████████▎                 | 132/224 [01:18<00:53,  1.71it/s]
Epoch 15 Iter 133: loss 0.17726. :  59%|█████████████████████████▌                 | 133/224 [01:18<00:51,  1.76it/s]
Epoch 15 Iter 134: loss 0.17226. :  59%|█████████████████████████▌                 | 133/224 [01:18<00:51,  1.76it/s]
Epoch 15 Iter 134: loss 0.17226. :  60%|█████████████████████████▋                 | 134/224 [01:18<00:56,  1.58it/s]
Epoch 15 Iter 135: loss 0.17720. :  60%|█████████████████████████▋                 | 134/224 [01:19<00:56,  1.58it/s]
Epoch 15 Iter 135: loss 0.17720. :  60%|█████████████████████████▉                 | 135/224 [01:19<00:56,  1.59it/s]
Epoch 15 Iter 136: loss 0.19160. :  60%|█████████████████████████▉                 | 135/224 [01:20<00:56,  1.59it/s]
Epoch 15 Iter 136: loss 0.19160. :  61%|██████████████████████████                 | 136/224 [01:20<00:59,  1.48it/s]
Epoch 15 Iter 137: loss 0.16661. :  61%|██████████████████████████                 | 136/224 [01:21<00:59,  1.48it/s]
Epoch 15 Iter 137: loss 0.16661. :  61%|██████████████████████████▎                | 137/224 [01:21<01:01,  1.42it/s]
Epoch 15 Iter 138: loss 0.18272. :  61%|██████████████████████████▎                | 137/224 [01:21<01:01,  1.42it/s]
Epoch 15 Iter 138: loss 0.18272. :  62%|██████████████████████████▍                | 138/224 [01:21<01:02,  1.37it/s]
Epoch 15 Iter 139: loss 0.15547. :  62%|██████████████████████████▍                | 138/224 [01:22<01:02,  1.37it/s]
Epoch 15 Iter 139: loss 0.15547. :  62%|██████████████████████████▋                | 139/224 [01:22<00:59,  1.44it/s]
Epoch 15 Iter 140: loss 0.19651. :  62%|██████████████████████████▋                | 139/224 [01:23<00:59,  1.44it/s]
Epoch 15 Iter 140: loss 0.19651. :  62%|██████████████████████████▉                | 140/224 [01:23<00:58,  1.44it/s]
Epoch 15 Iter 141: loss 0.16569. :  62%|██████████████████████████▉                | 140/224 [01:23<00:58,  1.44it/s]
Epoch 15 Iter 141: loss 0.16569. :  63%|███████████████████████████                | 141/224 [01:23<00:54,  1.52it/s]
Epoch 15 Iter 142: loss 0.15765. :  63%|███████████████████████████                | 141/224 [01:24<00:54,  1.52it/s]
Epoch 15 Iter 142: loss 0.15765. :  63%|███████████████████████████▎               | 142/224 [01:24<00:54,  1.49it/s]
Epoch 15 Iter 143: loss 0.18584. :  63%|███████████████████████████▎               | 142/224 [01:25<00:54,  1.49it/s]
Epoch 15 Iter 143: loss 0.18584. :  64%|███████████████████████████▍               | 143/224 [01:25<00:54,  1.48it/s]
Epoch 15 Iter 144: loss 0.17030. :  64%|███████████████████████████▍               | 143/224 [01:25<00:54,  1.48it/s]
Epoch 15 Iter 144: loss 0.17030. :  64%|███████████████████████████▋               | 144/224 [01:25<00:53,  1.50it/s]
Epoch 15 Iter 145: loss 0.17071. :  64%|███████████████████████████▋               | 144/224 [01:26<00:53,  1.50it/s]
Epoch 15 Iter 145: loss 0.17071. :  65%|███████████████████████████▊               | 145/224 [01:26<00:54,  1.44it/s]
Epoch 15 Iter 146: loss 0.16167. :  65%|███████████████████████████▊               | 145/224 [01:27<00:54,  1.44it/s]
Epoch 15 Iter 146: loss 0.16167. :  65%|████████████████████████████               | 146/224 [01:27<00:52,  1.49it/s]
Epoch 15 Iter 147: loss 0.18063. :  65%|████████████████████████████               | 146/224 [01:27<00:52,  1.49it/s]
Epoch 15 Iter 147: loss 0.18063. :  66%|████████████████████████████▏              | 147/224 [01:27<00:51,  1.50it/s]
Epoch 15 Iter 148: loss 0.18116. :  66%|████████████████████████████▏              | 147/224 [01:28<00:51,  1.50it/s]
Epoch 15 Iter 148: loss 0.18116. :  66%|████████████████████████████▍              | 148/224 [01:28<00:53,  1.43it/s]
Epoch 15 Iter 149: loss 0.16763. :  66%|████████████████████████████▍              | 148/224 [01:29<00:53,  1.43it/s]
Epoch 15 Iter 149: loss 0.16763. :  67%|████████████████████████████▌              | 149/224 [01:29<00:49,  1.51it/s]
Epoch 15 Iter 150: loss 0.14702. :  67%|████████████████████████████▌              | 149/224 [01:29<00:49,  1.51it/s]
Epoch 15 Iter 150: loss 0.14702. :  67%|████████████████████████████▊              | 150/224 [01:29<00:51,  1.44it/s]
Epoch 15 Iter 151: loss 0.16902. :  67%|████████████████████████████▊              | 150/224 [01:30<00:51,  1.44it/s]
Epoch 15 Iter 151: loss 0.16902. :  67%|████████████████████████████▉              | 151/224 [01:30<00:47,  1.55it/s]
Epoch 15 Iter 152: loss 0.17740. :  67%|████████████████████████████▉              | 151/224 [01:30<00:47,  1.55it/s]
Epoch 15 Iter 152: loss 0.17740. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:44,  1.64it/s]
Epoch 15 Iter 153: loss 0.16691. :  68%|█████████████████████████████▏             | 152/224 [01:31<00:44,  1.64it/s]
Epoch 15 Iter 153: loss 0.16691. :  68%|█████████████████████████████▎             | 153/224 [01:31<00:42,  1.69it/s]
Epoch 15 Iter 154: loss 0.16960. :  68%|█████████████████████████████▎             | 153/224 [01:32<00:42,  1.69it/s]
Epoch 15 Iter 154: loss 0.16960. :  69%|█████████████████████████████▌             | 154/224 [01:32<00:41,  1.68it/s]
Epoch 15 Iter 155: loss 0.14325. :  69%|█████████████████████████████▌             | 154/224 [01:32<00:41,  1.68it/s]
Epoch 15 Iter 155: loss 0.14325. :  69%|█████████████████████████████▊             | 155/224 [01:32<00:41,  1.67it/s]
Epoch 15 Iter 156: loss 0.17267. :  69%|█████████████████████████████▊             | 155/224 [01:33<00:41,  1.67it/s]
Epoch 15 Iter 156: loss 0.17267. :  70%|█████████████████████████████▉             | 156/224 [01:33<00:39,  1.72it/s]
Epoch 15 Iter 157: loss 0.16859. :  70%|█████████████████████████████▉             | 156/224 [01:33<00:39,  1.72it/s]
Epoch 15 Iter 157: loss 0.16859. :  70%|██████████████████████████████▏            | 157/224 [01:33<00:38,  1.76it/s]
Epoch 15 Iter 158: loss 0.15302. :  70%|██████████████████████████████▏            | 157/224 [01:34<00:38,  1.76it/s]
Epoch 15 Iter 158: loss 0.15302. :  71%|██████████████████████████████▎            | 158/224 [01:34<00:40,  1.61it/s]
Epoch 15 Iter 159: loss 0.17740. :  71%|██████████████████████████████▎            | 158/224 [01:35<00:40,  1.61it/s]
Epoch 15 Iter 159: loss 0.17740. :  71%|██████████████████████████████▌            | 159/224 [01:35<00:42,  1.53it/s]
Epoch 15 Iter 160: loss 0.15779. :  71%|██████████████████████████████▌            | 159/224 [01:35<00:42,  1.53it/s]
Epoch 15 Iter 160: loss 0.15779. :  71%|██████████████████████████████▋            | 160/224 [01:35<00:40,  1.57it/s]
Epoch 15 Iter 161: loss 0.15873. :  71%|██████████████████████████████▋            | 160/224 [01:36<00:40,  1.57it/s]
Epoch 15 Iter 161: loss 0.15873. :  72%|██████████████████████████████▉            | 161/224 [01:36<00:41,  1.54it/s]
Epoch 15 Iter 162: loss 0.16909. :  72%|██████████████████████████████▉            | 161/224 [01:37<00:41,  1.54it/s]
Epoch 15 Iter 162: loss 0.16909. :  72%|███████████████████████████████            | 162/224 [01:37<00:42,  1.46it/s]
Epoch 15 Iter 163: loss 0.18893. :  72%|███████████████████████████████            | 162/224 [01:38<00:42,  1.46it/s]
Epoch 15 Iter 163: loss 0.18893. :  73%|███████████████████████████████▎           | 163/224 [01:38<00:42,  1.43it/s]
Epoch 15 Iter 164: loss 0.17618. :  73%|███████████████████████████████▎           | 163/224 [01:38<00:42,  1.43it/s]
Epoch 15 Iter 164: loss 0.17618. :  73%|███████████████████████████████▍           | 164/224 [01:38<00:43,  1.38it/s]
Epoch 15 Iter 165: loss 0.17340. :  73%|███████████████████████████████▍           | 164/224 [01:39<00:43,  1.38it/s]
Epoch 15 Iter 165: loss 0.17340. :  74%|███████████████████████████████▋           | 165/224 [01:39<00:41,  1.41it/s]
Epoch 15 Iter 166: loss 0.17129. :  74%|███████████████████████████████▋           | 165/224 [01:40<00:41,  1.41it/s]
Epoch 15 Iter 166: loss 0.17129. :  74%|███████████████████████████████▊           | 166/224 [01:40<00:39,  1.47it/s]
Epoch 15 Iter 167: loss 0.17288. :  74%|███████████████████████████████▊           | 166/224 [01:40<00:39,  1.47it/s]
Epoch 15 Iter 167: loss 0.17288. :  75%|████████████████████████████████           | 167/224 [01:40<00:40,  1.40it/s]
Epoch 15 Iter 168: loss 0.17718. :  75%|████████████████████████████████           | 167/224 [01:41<00:40,  1.40it/s]
Epoch 15 Iter 168: loss 0.17718. :  75%|████████████████████████████████▎          | 168/224 [01:41<00:39,  1.41it/s]
Epoch 15 Iter 169: loss 0.17683. :  75%|████████████████████████████████▎          | 168/224 [01:42<00:39,  1.41it/s]
Epoch 15 Iter 169: loss 0.17683. :  75%|████████████████████████████████▍          | 169/224 [01:42<00:36,  1.51it/s]
Epoch 15 Iter 170: loss 0.16990. :  75%|████████████████████████████████▍          | 169/224 [01:42<00:36,  1.51it/s]
Epoch 15 Iter 170: loss 0.16990. :  76%|████████████████████████████████▋          | 170/224 [01:42<00:33,  1.59it/s]
Epoch 15 Iter 171: loss 0.18267. :  76%|████████████████████████████████▋          | 170/224 [01:43<00:33,  1.59it/s]
Epoch 15 Iter 171: loss 0.18267. :  76%|████████████████████████████████▊          | 171/224 [01:43<00:31,  1.67it/s]
Epoch 15 Iter 172: loss 0.16618. :  76%|████████████████████████████████▊          | 171/224 [01:43<00:31,  1.67it/s]
Epoch 15 Iter 172: loss 0.16618. :  77%|█████████████████████████████████          | 172/224 [01:43<00:31,  1.64it/s]
Epoch 15 Iter 173: loss 0.16907. :  77%|█████████████████████████████████          | 172/224 [01:44<00:31,  1.64it/s]
Epoch 15 Iter 173: loss 0.16907. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:31,  1.63it/s]
Epoch 15 Iter 174: loss 0.20326. :  77%|█████████████████████████████████▏         | 173/224 [01:45<00:31,  1.63it/s]
Epoch 15 Iter 174: loss 0.20326. :  78%|█████████████████████████████████▍         | 174/224 [01:45<00:29,  1.69it/s]
Epoch 15 Iter 175: loss 0.16673. :  78%|█████████████████████████████████▍         | 174/224 [01:45<00:29,  1.69it/s]
Epoch 15 Iter 175: loss 0.16673. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:28,  1.74it/s]
Epoch 15 Iter 176: loss 0.15961. :  78%|█████████████████████████████████▌         | 175/224 [01:46<00:28,  1.74it/s]
Epoch 15 Iter 176: loss 0.15961. :  79%|█████████████████████████████████▊         | 176/224 [01:46<00:27,  1.77it/s]
Epoch 15 Iter 177: loss 0.16092. :  79%|█████████████████████████████████▊         | 176/224 [01:46<00:27,  1.77it/s]
Epoch 15 Iter 177: loss 0.16092. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:26,  1.78it/s]
Epoch 15 Iter 178: loss 0.14867. :  79%|█████████████████████████████████▉         | 177/224 [01:47<00:26,  1.78it/s]
Epoch 15 Iter 178: loss 0.14867. :  79%|██████████████████████████████████▏        | 178/224 [01:47<00:28,  1.60it/s]
Epoch 15 Iter 179: loss 0.17878. :  79%|██████████████████████████████████▏        | 178/224 [01:48<00:28,  1.60it/s]
Epoch 15 Iter 179: loss 0.17878. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:28,  1.56it/s]
Epoch 15 Iter 180: loss 0.17432. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:28,  1.56it/s]
Epoch 15 Iter 180: loss 0.17432. :  80%|██████████████████████████████████▌        | 180/224 [01:48<00:30,  1.46it/s]
Epoch 15 Iter 181: loss 0.14941. :  80%|██████████████████████████████████▌        | 180/224 [01:49<00:30,  1.46it/s]
Epoch 15 Iter 181: loss 0.14941. :  81%|██████████████████████████████████▋        | 181/224 [01:49<00:28,  1.51it/s]
Epoch 15 Iter 182: loss 0.16583. :  81%|██████████████████████████████████▋        | 181/224 [01:50<00:28,  1.51it/s]
Epoch 15 Iter 182: loss 0.16583. :  81%|██████████████████████████████████▉        | 182/224 [01:50<00:26,  1.61it/s]
Epoch 15 Iter 183: loss 0.17147. :  81%|██████████████████████████████████▉        | 182/224 [01:50<00:26,  1.61it/s]
Epoch 15 Iter 183: loss 0.17147. :  82%|███████████████████████████████████▏       | 183/224 [01:50<00:26,  1.53it/s]
Epoch 15 Iter 184: loss 0.16552. :  82%|███████████████████████████████████▏       | 183/224 [01:51<00:26,  1.53it/s]
Epoch 15 Iter 184: loss 0.16552. :  82%|███████████████████████████████████▎       | 184/224 [01:51<00:25,  1.56it/s]
Epoch 15 Iter 185: loss 0.14711. :  82%|███████████████████████████████████▎       | 184/224 [01:52<00:25,  1.56it/s]
Epoch 15 Iter 185: loss 0.14711. :  83%|███████████████████████████████████▌       | 185/224 [01:52<00:25,  1.51it/s]
Epoch 15 Iter 186: loss 0.19407. :  83%|███████████████████████████████████▌       | 185/224 [01:52<00:25,  1.51it/s]
Epoch 15 Iter 186: loss 0.19407. :  83%|███████████████████████████████████▋       | 186/224 [01:52<00:25,  1.46it/s]
Epoch 15 Iter 187: loss 0.16573. :  83%|███████████████████████████████████▋       | 186/224 [01:53<00:25,  1.46it/s]
Epoch 15 Iter 187: loss 0.16573. :  83%|███████████████████████████████████▉       | 187/224 [01:53<00:24,  1.54it/s]
Epoch 15 Iter 188: loss 0.18455. :  83%|███████████████████████████████████▉       | 187/224 [01:53<00:24,  1.54it/s]
Epoch 15 Iter 188: loss 0.18455. :  84%|████████████████████████████████████       | 188/224 [01:53<00:22,  1.63it/s]
Epoch 15 Iter 189: loss 0.17580. :  84%|████████████████████████████████████       | 188/224 [01:54<00:22,  1.63it/s]
Epoch 15 Iter 189: loss 0.17580. :  84%|████████████████████████████████████▎      | 189/224 [01:54<00:20,  1.69it/s]
Epoch 15 Iter 190: loss 0.16690. :  84%|████████████████████████████████████▎      | 189/224 [01:55<00:20,  1.69it/s]
Epoch 15 Iter 190: loss 0.16690. :  85%|████████████████████████████████████▍      | 190/224 [01:55<00:19,  1.71it/s]
Epoch 15 Iter 191: loss 0.16453. :  85%|████████████████████████████████████▍      | 190/224 [01:55<00:19,  1.71it/s]
Epoch 15 Iter 191: loss 0.16453. :  85%|████████████████████████████████████▋      | 191/224 [01:55<00:21,  1.56it/s]
Epoch 15 Iter 192: loss 0.17201. :  85%|████████████████████████████████████▋      | 191/224 [01:56<00:21,  1.56it/s]
Epoch 15 Iter 192: loss 0.17201. :  86%|████████████████████████████████████▊      | 192/224 [01:56<00:19,  1.64it/s]
Epoch 15 Iter 193: loss 0.16560. :  86%|████████████████████████████████████▊      | 192/224 [01:56<00:19,  1.64it/s]
Epoch 15 Iter 193: loss 0.16560. :  86%|█████████████████████████████████████      | 193/224 [01:56<00:18,  1.69it/s]
Epoch 15 Iter 194: loss 0.18613. :  86%|█████████████████████████████████████      | 193/224 [01:57<00:18,  1.69it/s]
Epoch 15 Iter 194: loss 0.18613. :  87%|█████████████████████████████████████▏     | 194/224 [01:57<00:17,  1.74it/s]
Epoch 15 Iter 195: loss 0.16738. :  87%|█████████████████████████████████████▏     | 194/224 [01:58<00:17,  1.74it/s]
Epoch 15 Iter 195: loss 0.16738. :  87%|█████████████████████████████████████▍     | 195/224 [01:58<00:16,  1.75it/s]
Epoch 15 Iter 196: loss 0.16650. :  87%|█████████████████████████████████████▍     | 195/224 [01:58<00:16,  1.75it/s]
Epoch 15 Iter 196: loss 0.16650. :  88%|█████████████████████████████████████▋     | 196/224 [01:58<00:15,  1.77it/s]
Epoch 15 Iter 197: loss 0.17420. :  88%|█████████████████████████████████████▋     | 196/224 [01:59<00:15,  1.77it/s]
Epoch 15 Iter 197: loss 0.17420. :  88%|█████████████████████████████████████▊     | 197/224 [01:59<00:16,  1.67it/s]
Epoch 15 Iter 198: loss 0.17399. :  88%|█████████████████████████████████████▊     | 197/224 [02:00<00:16,  1.67it/s]
Epoch 15 Iter 198: loss 0.17399. :  88%|██████████████████████████████████████     | 198/224 [02:00<00:17,  1.52it/s]
Epoch 15 Iter 199: loss 0.16416. :  88%|██████████████████████████████████████     | 198/224 [02:00<00:17,  1.52it/s]
Epoch 15 Iter 199: loss 0.16416. :  89%|██████████████████████████████████████▏    | 199/224 [02:00<00:17,  1.44it/s]
Epoch 15 Iter 200: loss 0.16494. :  89%|██████████████████████████████████████▏    | 199/224 [02:01<00:17,  1.44it/s]
Epoch 15 Iter 200: loss 0.16494. :  89%|██████████████████████████████████████▍    | 200/224 [02:01<00:16,  1.47it/s]
Epoch 15 Iter 201: loss 0.15719. :  89%|██████████████████████████████████████▍    | 200/224 [02:02<00:16,  1.47it/s]
Epoch 15 Iter 201: loss 0.15719. :  90%|██████████████████████████████████████▌    | 201/224 [02:02<00:14,  1.54it/s]
Epoch 15 Iter 202: loss 0.14929. :  90%|██████████████████████████████████████▌    | 201/224 [02:02<00:14,  1.54it/s]
Epoch 15 Iter 202: loss 0.14929. :  90%|██████████████████████████████████████▊    | 202/224 [02:02<00:14,  1.50it/s]
Epoch 15 Iter 203: loss 0.16808. :  90%|██████████████████████████████████████▊    | 202/224 [02:03<00:14,  1.50it/s]
Epoch 15 Iter 203: loss 0.16808. :  91%|██████████████████████████████████████▉    | 203/224 [02:03<00:13,  1.57it/s]
Epoch 15 Iter 204: loss 0.17883. :  91%|██████████████████████████████████████▉    | 203/224 [02:04<00:13,  1.57it/s]
Epoch 15 Iter 204: loss 0.17883. :  91%|███████████████████████████████████████▏   | 204/224 [02:04<00:13,  1.47it/s]
Epoch 15 Iter 205: loss 0.16972. :  91%|███████████████████████████████████████▏   | 204/224 [02:04<00:13,  1.47it/s]
Epoch 15 Iter 205: loss 0.16972. :  92%|███████████████████████████████████████▎   | 205/224 [02:04<00:12,  1.49it/s]
Epoch 15 Iter 206: loss 0.15640. :  92%|███████████████████████████████████████▎   | 205/224 [02:05<00:12,  1.49it/s]
Epoch 15 Iter 206: loss 0.15640. :  92%|███████████████████████████████████████▌   | 206/224 [02:05<00:11,  1.57it/s]
Epoch 15 Iter 207: loss 0.21327. :  92%|███████████████████████████████████████▌   | 206/224 [02:05<00:11,  1.57it/s]
Epoch 15 Iter 207: loss 0.21327. :  92%|███████████████████████████████████████▋   | 207/224 [02:05<00:10,  1.64it/s]
Epoch 15 Iter 208: loss 0.17966. :  92%|███████████████████████████████████████▋   | 207/224 [02:06<00:10,  1.64it/s]
Epoch 15 Iter 208: loss 0.17966. :  93%|███████████████████████████████████████▉   | 208/224 [02:06<00:10,  1.50it/s]
Epoch 15 Iter 209: loss 0.14095. :  93%|███████████████████████████████████████▉   | 208/224 [02:07<00:10,  1.50it/s]
Epoch 15 Iter 209: loss 0.14095. :  93%|████████████████████████████████████████   | 209/224 [02:07<00:09,  1.60it/s]
Epoch 15 Iter 210: loss 0.17938. :  93%|████████████████████████████████████████   | 209/224 [02:07<00:09,  1.60it/s]
Epoch 15 Iter 210: loss 0.17938. :  94%|████████████████████████████████████████▎  | 210/224 [02:07<00:09,  1.49it/s]
Epoch 15 Iter 211: loss 0.15049. :  94%|████████████████████████████████████████▎  | 210/224 [02:08<00:09,  1.49it/s]
Epoch 15 Iter 211: loss 0.15049. :  94%|████████████████████████████████████████▌  | 211/224 [02:08<00:09,  1.44it/s]
Epoch 15 Iter 212: loss 0.15627. :  94%|████████████████████████████████████████▌  | 211/224 [02:09<00:09,  1.44it/s]
Epoch 15 Iter 212: loss 0.15627. :  95%|████████████████████████████████████████▋  | 212/224 [02:09<00:07,  1.55it/s]
Epoch 15 Iter 213: loss 0.15832. :  95%|████████████████████████████████████████▋  | 212/224 [02:09<00:07,  1.55it/s]
Epoch 15 Iter 213: loss 0.15832. :  95%|████████████████████████████████████████▉  | 213/224 [02:09<00:06,  1.63it/s]
Epoch 15 Iter 214: loss 0.16281. :  95%|████████████████████████████████████████▉  | 213/224 [02:10<00:06,  1.63it/s]
Epoch 15 Iter 214: loss 0.16281. :  96%|█████████████████████████████████████████  | 214/224 [02:10<00:05,  1.68it/s]
Epoch 15 Iter 215: loss 0.16275. :  96%|█████████████████████████████████████████  | 214/224 [02:10<00:05,  1.68it/s]
Epoch 15 Iter 215: loss 0.16275. :  96%|█████████████████████████████████████████▎ | 215/224 [02:10<00:05,  1.67it/s]
Epoch 15 Iter 216: loss 0.17538. :  96%|█████████████████████████████████████████▎ | 215/224 [02:11<00:05,  1.67it/s]
Epoch 15 Iter 216: loss 0.17538. :  96%|█████████████████████████████████████████▍ | 216/224 [02:11<00:04,  1.72it/s]
Epoch 15 Iter 217: loss 0.16293. :  96%|█████████████████████████████████████████▍ | 216/224 [02:12<00:04,  1.72it/s]
Epoch 15 Iter 217: loss 0.16293. :  97%|█████████████████████████████████████████▋ | 217/224 [02:12<00:03,  1.76it/s]
Epoch 15 Iter 218: loss 0.16298. :  97%|█████████████████████████████████████████▋ | 217/224 [02:12<00:03,  1.76it/s]
Epoch 15 Iter 218: loss 0.16298. :  97%|█████████████████████████████████████████▊ | 218/224 [02:12<00:03,  1.59it/s]
Epoch 15 Iter 219: loss 0.14536. :  97%|█████████████████████████████████████████▊ | 218/224 [02:13<00:03,  1.59it/s]
Epoch 15 Iter 219: loss 0.14536. :  98%|██████████████████████████████████████████ | 219/224 [02:13<00:03,  1.53it/s]
Epoch 15 Iter 220: loss 0.16684. :  98%|██████████████████████████████████████████ | 219/224 [02:14<00:03,  1.53it/s]
Epoch 15 Iter 220: loss 0.16684. :  98%|██████████████████████████████████████████▏| 220/224 [02:14<00:02,  1.44it/s]
Epoch 15 Iter 221: loss 0.15484. :  98%|██████████████████████████████████████████▏| 220/224 [02:14<00:02,  1.44it/s]
Epoch 15 Iter 221: loss 0.15484. :  99%|██████████████████████████████████████████▍| 221/224 [02:14<00:02,  1.48it/s]
Epoch 15 Iter 222: loss 0.17102. :  99%|██████████████████████████████████████████▍| 221/224 [02:15<00:02,  1.48it/s]
Epoch 15 Iter 222: loss 0.17102. :  99%|██████████████████████████████████████████▌| 222/224 [02:15<00:01,  1.44it/s]
Epoch 15 Iter 223: loss 0.16146. :  99%|██████████████████████████████████████████▌| 222/224 [02:16<00:01,  1.44it/s]
Epoch 15 Iter 223: loss 0.16146. : 100%|██████████████████████████████████████████▊| 223/224 [02:16<00:00,  1.47it/s]
Epoch 15 Iter 224: loss 0.17777. : 100%|██████████████████████████████████████████▊| 223/224 [02:16<00:00,  1.47it/s]
Epoch 15 Iter 224: loss 0.17777. : 100%|███████████████████████████████████████████| 224/224 [02:16<00:00,  1.59it/s]
Epoch 15 Iter 224: loss 0.17777. : 100%|███████████████████████████████████████████| 224/224 [02:16<00:00,  1.64it/s]

    Train loss: 0.16873
    Valid loss: 0.1722
       Valid loss recons: 0.1722
       Valid loss KL-D:   32325.6883
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.15825. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.15825. :   0%|▏                                              | 1/224 [00:00<02:18,  1.60it/s]
Epoch 16 Iter 2: loss 0.18085. :   0%|▏                                              | 1/224 [00:01<02:18,  1.60it/s]
Epoch 16 Iter 2: loss 0.18085. :   1%|▍                                              | 2/224 [00:01<02:24,  1.53it/s]
Epoch 16 Iter 3: loss 0.17692. :   1%|▍                                              | 2/224 [00:02<02:24,  1.53it/s]
Epoch 16 Iter 3: loss 0.17692. :   1%|▋                                              | 3/224 [00:02<02:35,  1.42it/s]
Epoch 16 Iter 4: loss 0.17653. :   1%|▋                                              | 3/224 [00:02<02:35,  1.42it/s]
Epoch 16 Iter 4: loss 0.17653. :   2%|▊                                              | 4/224 [00:02<02:41,  1.37it/s]
Epoch 16 Iter 5: loss 0.17657. :   2%|▊                                              | 4/224 [00:03<02:41,  1.37it/s]
Epoch 16 Iter 5: loss 0.17657. :   2%|█                                              | 5/224 [00:03<02:35,  1.41it/s]
Epoch 16 Iter 6: loss 0.15316. :   2%|█                                              | 5/224 [00:04<02:35,  1.41it/s]
Epoch 16 Iter 6: loss 0.15316. :   3%|█▎                                             | 6/224 [00:04<02:39,  1.37it/s]
Epoch 16 Iter 7: loss 0.17146. :   3%|█▎                                             | 6/224 [00:04<02:39,  1.37it/s]
Epoch 16 Iter 7: loss 0.17146. :   3%|█▍                                             | 7/224 [00:04<02:24,  1.50it/s]
Epoch 16 Iter 8: loss 0.17141. :   3%|█▍                                             | 7/224 [00:05<02:24,  1.50it/s]
Epoch 16 Iter 8: loss 0.17141. :   4%|█▋                                             | 8/224 [00:05<02:31,  1.43it/s]
Epoch 16 Iter 9: loss 0.15014. :   4%|█▋                                             | 8/224 [00:06<02:31,  1.43it/s]
Epoch 16 Iter 9: loss 0.15014. :   4%|█▉                                             | 9/224 [00:06<02:24,  1.48it/s]
Epoch 16 Iter 10: loss 0.16895. :   4%|█▊                                            | 9/224 [00:06<02:24,  1.48it/s]
Epoch 16 Iter 10: loss 0.16895. :   4%|██                                           | 10/224 [00:06<02:21,  1.51it/s]
Epoch 16 Iter 11: loss 0.15463. :   4%|██                                           | 10/224 [00:07<02:21,  1.51it/s]
Epoch 16 Iter 11: loss 0.15463. :   5%|██▏                                          | 11/224 [00:07<02:14,  1.58it/s]
Epoch 16 Iter 12: loss 0.16943. :   5%|██▏                                          | 11/224 [00:08<02:14,  1.58it/s]
Epoch 16 Iter 12: loss 0.16943. :   5%|██▍                                          | 12/224 [00:08<02:16,  1.55it/s]
Epoch 16 Iter 13: loss 0.17092. :   5%|██▍                                          | 12/224 [00:08<02:16,  1.55it/s]
Epoch 16 Iter 13: loss 0.17092. :   6%|██▌                                          | 13/224 [00:08<02:16,  1.55it/s]
Epoch 16 Iter 14: loss 0.18803. :   6%|██▌                                          | 13/224 [00:09<02:16,  1.55it/s]
Epoch 16 Iter 14: loss 0.18803. :   6%|██▊                                          | 14/224 [00:09<02:09,  1.62it/s]
Epoch 16 Iter 15: loss 0.18245. :   6%|██▊                                          | 14/224 [00:10<02:09,  1.62it/s]
Epoch 16 Iter 15: loss 0.18245. :   7%|███                                          | 15/224 [00:10<02:17,  1.52it/s]
Epoch 16 Iter 16: loss 0.18635. :   7%|███                                          | 15/224 [00:10<02:17,  1.52it/s]
Epoch 16 Iter 16: loss 0.18635. :   7%|███▏                                         | 16/224 [00:10<02:25,  1.43it/s]
Epoch 16 Iter 17: loss 0.17497. :   7%|███▏                                         | 16/224 [00:11<02:25,  1.43it/s]
Epoch 16 Iter 17: loss 0.17497. :   8%|███▍                                         | 17/224 [00:11<02:30,  1.38it/s]
Epoch 16 Iter 18: loss 0.17957. :   8%|███▍                                         | 17/224 [00:12<02:30,  1.38it/s]
Epoch 16 Iter 18: loss 0.17957. :   8%|███▌                                         | 18/224 [00:12<02:27,  1.40it/s]
Epoch 16 Iter 19: loss 0.18593. :   8%|███▌                                         | 18/224 [00:12<02:27,  1.40it/s]
Epoch 16 Iter 19: loss 0.18593. :   8%|███▊                                         | 19/224 [00:12<02:15,  1.52it/s]
Epoch 16 Iter 20: loss 0.19279. :   8%|███▊                                         | 19/224 [00:13<02:15,  1.52it/s]
Epoch 16 Iter 20: loss 0.19279. :   9%|████                                         | 20/224 [00:13<02:03,  1.65it/s]
Epoch 16 Iter 21: loss 0.17069. :   9%|████                                         | 20/224 [00:13<02:03,  1.65it/s]
Epoch 16 Iter 21: loss 0.17069. :   9%|████▏                                        | 21/224 [00:13<01:59,  1.69it/s]
Epoch 16 Iter 22: loss 0.17166. :   9%|████▏                                        | 21/224 [00:14<01:59,  1.69it/s]
Epoch 16 Iter 22: loss 0.17166. :  10%|████▍                                        | 22/224 [00:14<01:54,  1.77it/s]
Epoch 16 Iter 23: loss 0.17226. :  10%|████▍                                        | 22/224 [00:14<01:54,  1.77it/s]
Epoch 16 Iter 23: loss 0.17226. :  10%|████▌                                        | 23/224 [00:14<01:49,  1.84it/s]
Epoch 16 Iter 24: loss 0.16602. :  10%|████▌                                        | 23/224 [00:15<01:49,  1.84it/s]
Epoch 16 Iter 24: loss 0.16602. :  11%|████▊                                        | 24/224 [00:15<01:46,  1.88it/s]
Epoch 16 Iter 25: loss 0.16723. :  11%|████▊                                        | 24/224 [00:15<01:46,  1.88it/s]
Epoch 16 Iter 25: loss 0.16723. :  11%|█████                                        | 25/224 [00:15<01:44,  1.90it/s]
Epoch 16 Iter 26: loss 0.15831. :  11%|█████                                        | 25/224 [00:16<01:44,  1.90it/s]
Epoch 16 Iter 26: loss 0.15831. :  12%|█████▏                                       | 26/224 [00:16<01:43,  1.91it/s]
Epoch 16 Iter 27: loss 0.17398. :  12%|█████▏                                       | 26/224 [00:16<01:43,  1.91it/s]
Epoch 16 Iter 27: loss 0.17398. :  12%|█████▍                                       | 27/224 [00:16<01:41,  1.94it/s]
Epoch 16 Iter 28: loss 0.16000. :  12%|█████▍                                       | 27/224 [00:17<01:41,  1.94it/s]
Epoch 16 Iter 28: loss 0.16000. :  12%|█████▋                                       | 28/224 [00:17<01:39,  1.96it/s]
Epoch 16 Iter 29: loss 0.17395. :  12%|█████▋                                       | 28/224 [00:17<01:39,  1.96it/s]
Epoch 16 Iter 29: loss 0.17395. :  13%|█████▊                                       | 29/224 [00:17<01:39,  1.97it/s]
Epoch 16 Iter 30: loss 0.15844. :  13%|█████▊                                       | 29/224 [00:18<01:39,  1.97it/s]
Epoch 16 Iter 30: loss 0.15844. :  13%|██████                                       | 30/224 [00:18<01:39,  1.96it/s]
Epoch 16 Iter 31: loss 0.14847. :  13%|██████                                       | 30/224 [00:18<01:39,  1.96it/s]
Epoch 16 Iter 31: loss 0.14847. :  14%|██████▏                                      | 31/224 [00:18<01:38,  1.95it/s]
Epoch 16 Iter 32: loss 0.15728. :  14%|██████▏                                      | 31/224 [00:19<01:38,  1.95it/s]
Epoch 16 Iter 32: loss 0.15728. :  14%|██████▍                                      | 32/224 [00:19<01:37,  1.97it/s]
Epoch 16 Iter 33: loss 0.17098. :  14%|██████▍                                      | 32/224 [00:19<01:37,  1.97it/s]
Epoch 16 Iter 33: loss 0.17098. :  15%|██████▋                                      | 33/224 [00:19<01:37,  1.97it/s]
Epoch 16 Iter 34: loss 0.15566. :  15%|██████▋                                      | 33/224 [00:20<01:37,  1.97it/s]
Epoch 16 Iter 34: loss 0.15566. :  15%|██████▊                                      | 34/224 [00:20<01:36,  1.97it/s]
Epoch 16 Iter 35: loss 0.17091. :  15%|██████▊                                      | 34/224 [00:20<01:36,  1.97it/s]
Epoch 16 Iter 35: loss 0.17091. :  16%|███████                                      | 35/224 [00:20<01:35,  1.97it/s]
Epoch 16 Iter 36: loss 0.14943. :  16%|███████                                      | 35/224 [00:21<01:35,  1.97it/s]
Epoch 16 Iter 36: loss 0.14943. :  16%|███████▏                                     | 36/224 [00:21<01:35,  1.97it/s]
Epoch 16 Iter 37: loss 0.18260. :  16%|███████▏                                     | 36/224 [00:21<01:35,  1.97it/s]
Epoch 16 Iter 37: loss 0.18260. :  17%|███████▍                                     | 37/224 [00:21<01:34,  1.99it/s]
Epoch 16 Iter 38: loss 0.15803. :  17%|███████▍                                     | 37/224 [00:22<01:34,  1.99it/s]
Epoch 16 Iter 38: loss 0.15803. :  17%|███████▋                                     | 38/224 [00:22<01:42,  1.82it/s]
Epoch 16 Iter 39: loss 0.18014. :  17%|███████▋                                     | 38/224 [00:23<01:42,  1.82it/s]
Epoch 16 Iter 39: loss 0.18014. :  17%|███████▊                                     | 39/224 [00:23<01:45,  1.75it/s]
Epoch 16 Iter 40: loss 0.16171. :  17%|███████▊                                     | 39/224 [00:23<01:45,  1.75it/s]
Epoch 16 Iter 40: loss 0.16171. :  18%|████████                                     | 40/224 [00:23<01:41,  1.81it/s]
Epoch 16 Iter 41: loss 0.16959. :  18%|████████                                     | 40/224 [00:24<01:41,  1.81it/s]
Epoch 16 Iter 41: loss 0.16959. :  18%|████████▏                                    | 41/224 [00:24<01:38,  1.86it/s]
Epoch 16 Iter 42: loss 0.18998. :  18%|████████▏                                    | 41/224 [00:24<01:38,  1.86it/s]
Epoch 16 Iter 42: loss 0.18998. :  19%|████████▍                                    | 42/224 [00:24<01:35,  1.90it/s]
Epoch 16 Iter 43: loss 0.16610. :  19%|████████▍                                    | 42/224 [00:25<01:35,  1.90it/s]
Epoch 16 Iter 43: loss 0.16610. :  19%|████████▋                                    | 43/224 [00:25<01:33,  1.93it/s]
Epoch 16 Iter 44: loss 0.15126. :  19%|████████▋                                    | 43/224 [00:25<01:33,  1.93it/s]
Epoch 16 Iter 44: loss 0.15126. :  20%|████████▊                                    | 44/224 [00:25<01:31,  1.96it/s]
Epoch 16 Iter 45: loss 0.16153. :  20%|████████▊                                    | 44/224 [00:26<01:31,  1.96it/s]
Epoch 16 Iter 45: loss 0.16153. :  20%|█████████                                    | 45/224 [00:26<01:34,  1.90it/s]
Epoch 16 Iter 46: loss 0.16584. :  20%|█████████                                    | 45/224 [00:26<01:34,  1.90it/s]
Epoch 16 Iter 46: loss 0.16584. :  21%|█████████▏                                   | 46/224 [00:26<01:32,  1.93it/s]
Epoch 16 Iter 47: loss 0.16951. :  21%|█████████▏                                   | 46/224 [00:27<01:32,  1.93it/s]
Epoch 16 Iter 47: loss 0.16951. :  21%|█████████▍                                   | 47/224 [00:27<01:31,  1.94it/s]
Epoch 16 Iter 48: loss 0.15773. :  21%|█████████▍                                   | 47/224 [00:27<01:31,  1.94it/s]
Epoch 16 Iter 48: loss 0.15773. :  21%|█████████▋                                   | 48/224 [00:27<01:29,  1.96it/s]
Epoch 16 Iter 49: loss 0.16379. :  21%|█████████▋                                   | 48/224 [00:28<01:29,  1.96it/s]
Epoch 16 Iter 49: loss 0.16379. :  22%|█████████▊                                   | 49/224 [00:28<01:32,  1.90it/s]
Epoch 16 Iter 50: loss 0.16731. :  22%|█████████▊                                   | 49/224 [00:28<01:32,  1.90it/s]
Epoch 16 Iter 50: loss 0.16731. :  22%|██████████                                   | 50/224 [00:28<01:30,  1.92it/s]
Epoch 16 Iter 51: loss 0.16901. :  22%|██████████                                   | 50/224 [00:29<01:30,  1.92it/s]
Epoch 16 Iter 51: loss 0.16901. :  23%|██████████▏                                  | 51/224 [00:29<01:29,  1.94it/s]
Epoch 16 Iter 52: loss 0.16650. :  23%|██████████▏                                  | 51/224 [00:29<01:29,  1.94it/s]
Epoch 16 Iter 52: loss 0.16650. :  23%|██████████▍                                  | 52/224 [00:29<01:30,  1.91it/s]
Epoch 16 Iter 53: loss 0.14177. :  23%|██████████▍                                  | 52/224 [00:30<01:30,  1.91it/s]
Epoch 16 Iter 53: loss 0.14177. :  24%|██████████▋                                  | 53/224 [00:30<01:28,  1.92it/s]
Epoch 16 Iter 54: loss 0.16846. :  24%|██████████▋                                  | 53/224 [00:30<01:28,  1.92it/s]
Epoch 16 Iter 54: loss 0.16846. :  24%|██████████▊                                  | 54/224 [00:30<01:27,  1.94it/s]
Epoch 16 Iter 55: loss 0.16834. :  24%|██████████▊                                  | 54/224 [00:31<01:27,  1.94it/s]
Epoch 16 Iter 55: loss 0.16834. :  25%|███████████                                  | 55/224 [00:31<01:26,  1.96it/s]
Epoch 16 Iter 56: loss 0.16880. :  25%|███████████                                  | 55/224 [00:31<01:26,  1.96it/s]
Epoch 16 Iter 56: loss 0.16880. :  25%|███████████▎                                 | 56/224 [00:31<01:25,  1.97it/s]
Epoch 16 Iter 57: loss 0.15681. :  25%|███████████▎                                 | 56/224 [00:32<01:25,  1.97it/s]
Epoch 16 Iter 57: loss 0.15681. :  25%|███████████▍                                 | 57/224 [00:32<01:24,  1.98it/s]
Epoch 16 Iter 58: loss 0.17847. :  25%|███████████▍                                 | 57/224 [00:32<01:24,  1.98it/s]
Epoch 16 Iter 58: loss 0.17847. :  26%|███████████▋                                 | 58/224 [00:32<01:24,  1.97it/s]
Epoch 16 Iter 59: loss 0.15871. :  26%|███████████▋                                 | 58/224 [00:33<01:24,  1.97it/s]
Epoch 16 Iter 59: loss 0.15871. :  26%|███████████▊                                 | 59/224 [00:33<01:23,  1.97it/s]
Epoch 16 Iter 60: loss 0.18171. :  26%|███████████▊                                 | 59/224 [00:34<01:23,  1.97it/s]
Epoch 16 Iter 60: loss 0.18171. :  27%|████████████                                 | 60/224 [00:34<01:26,  1.89it/s]
Epoch 16 Iter 61: loss 0.16973. :  27%|████████████                                 | 60/224 [00:34<01:26,  1.89it/s]
Epoch 16 Iter 61: loss 0.16973. :  27%|████████████▎                                | 61/224 [00:34<01:26,  1.89it/s]
Epoch 16 Iter 62: loss 0.16593. :  27%|████████████▎                                | 61/224 [00:35<01:26,  1.89it/s]
Epoch 16 Iter 62: loss 0.16593. :  28%|████████████▍                                | 62/224 [00:35<01:24,  1.91it/s]
Epoch 16 Iter 63: loss 0.16309. :  28%|████████████▍                                | 62/224 [00:35<01:24,  1.91it/s]
Epoch 16 Iter 63: loss 0.16309. :  28%|████████████▋                                | 63/224 [00:35<01:23,  1.93it/s]
Epoch 16 Iter 64: loss 0.18150. :  28%|████████████▋                                | 63/224 [00:36<01:23,  1.93it/s]
Epoch 16 Iter 64: loss 0.18150. :  29%|████████████▊                                | 64/224 [00:36<01:21,  1.95it/s]
Epoch 16 Iter 65: loss 0.15601. :  29%|████████████▊                                | 64/224 [00:36<01:21,  1.95it/s]
Epoch 16 Iter 65: loss 0.15601. :  29%|█████████████                                | 65/224 [00:36<01:21,  1.96it/s]
Epoch 16 Iter 66: loss 0.19039. :  29%|█████████████                                | 65/224 [00:37<01:21,  1.96it/s]
Epoch 16 Iter 66: loss 0.19039. :  29%|█████████████▎                               | 66/224 [00:37<01:21,  1.94it/s]
Epoch 16 Iter 67: loss 0.18842. :  29%|█████████████▎                               | 66/224 [00:37<01:21,  1.94it/s]
Epoch 16 Iter 67: loss 0.18842. :  30%|█████████████▍                               | 67/224 [00:37<01:22,  1.89it/s]
Epoch 16 Iter 68: loss 0.16708. :  30%|█████████████▍                               | 67/224 [00:38<01:22,  1.89it/s]
Epoch 16 Iter 68: loss 0.16708. :  30%|█████████████▋                               | 68/224 [00:38<01:22,  1.90it/s]
Epoch 16 Iter 69: loss 0.15383. :  30%|█████████████▋                               | 68/224 [00:38<01:22,  1.90it/s]
Epoch 16 Iter 69: loss 0.15383. :  31%|█████████████▊                               | 69/224 [00:38<01:23,  1.85it/s]
Epoch 16 Iter 70: loss 0.16125. :  31%|█████████████▊                               | 69/224 [00:39<01:23,  1.85it/s]
Epoch 16 Iter 70: loss 0.16125. :  31%|██████████████                               | 70/224 [00:39<01:23,  1.85it/s]
Epoch 16 Iter 71: loss 0.17459. :  31%|██████████████                               | 70/224 [00:39<01:23,  1.85it/s]
Epoch 16 Iter 71: loss 0.17459. :  32%|██████████████▎                              | 71/224 [00:39<01:20,  1.89it/s]
Epoch 16 Iter 72: loss 0.16870. :  32%|██████████████▎                              | 71/224 [00:40<01:20,  1.89it/s]
Epoch 16 Iter 72: loss 0.16870. :  32%|██████████████▍                              | 72/224 [00:40<01:20,  1.89it/s]
Epoch 16 Iter 73: loss 0.18167. :  32%|██████████████▍                              | 72/224 [00:40<01:20,  1.89it/s]
Epoch 16 Iter 73: loss 0.18167. :  33%|██████████████▋                              | 73/224 [00:40<01:19,  1.90it/s]
Epoch 16 Iter 74: loss 0.18213. :  33%|██████████████▋                              | 73/224 [00:41<01:19,  1.90it/s]
Epoch 16 Iter 74: loss 0.18213. :  33%|██████████████▊                              | 74/224 [00:41<01:19,  1.89it/s]
Epoch 16 Iter 75: loss 0.18478. :  33%|██████████████▊                              | 74/224 [00:41<01:19,  1.89it/s]
Epoch 16 Iter 75: loss 0.18478. :  33%|███████████████                              | 75/224 [00:41<01:18,  1.91it/s]
Epoch 16 Iter 76: loss 0.17894. :  33%|███████████████                              | 75/224 [00:42<01:18,  1.91it/s]
Epoch 16 Iter 76: loss 0.17894. :  34%|███████████████▎                             | 76/224 [00:42<01:16,  1.95it/s]
Epoch 16 Iter 77: loss 0.18262. :  34%|███████████████▎                             | 76/224 [00:42<01:16,  1.95it/s]
Epoch 16 Iter 77: loss 0.18262. :  34%|███████████████▍                             | 77/224 [00:42<01:14,  1.96it/s]
Epoch 16 Iter 78: loss 0.16295. :  34%|███████████████▍                             | 77/224 [00:43<01:14,  1.96it/s]
Epoch 16 Iter 78: loss 0.16295. :  35%|███████████████▋                             | 78/224 [00:43<01:14,  1.97it/s]
Epoch 16 Iter 79: loss 0.15805. :  35%|███████████████▋                             | 78/224 [00:43<01:14,  1.97it/s]
Epoch 16 Iter 79: loss 0.15805. :  35%|███████████████▊                             | 79/224 [00:43<01:13,  1.97it/s]
Epoch 16 Iter 80: loss 0.18069. :  35%|███████████████▊                             | 79/224 [00:44<01:13,  1.97it/s]
Epoch 16 Iter 80: loss 0.18069. :  36%|████████████████                             | 80/224 [00:44<01:12,  1.98it/s]
Epoch 16 Iter 81: loss 0.17368. :  36%|████████████████                             | 80/224 [00:44<01:12,  1.98it/s]
Epoch 16 Iter 81: loss 0.17368. :  36%|████████████████▎                            | 81/224 [00:44<01:12,  1.97it/s]
Epoch 16 Iter 82: loss 0.16528. :  36%|████████████████▎                            | 81/224 [00:45<01:12,  1.97it/s]
Epoch 16 Iter 82: loss 0.16528. :  37%|████████████████▍                            | 82/224 [00:45<01:13,  1.93it/s]
Epoch 16 Iter 83: loss 0.18915. :  37%|████████████████▍                            | 82/224 [00:45<01:13,  1.93it/s]
Epoch 16 Iter 83: loss 0.18915. :  37%|████████████████▋                            | 83/224 [00:45<01:11,  1.96it/s]
Epoch 16 Iter 84: loss 0.16867. :  37%|████████████████▋                            | 83/224 [00:46<01:11,  1.96it/s]
Epoch 16 Iter 84: loss 0.16867. :  38%|████████████████▉                            | 84/224 [00:46<01:10,  1.98it/s]
Epoch 16 Iter 85: loss 0.17615. :  38%|████████████████▉                            | 84/224 [00:46<01:10,  1.98it/s]
Epoch 16 Iter 85: loss 0.17615. :  38%|█████████████████                            | 85/224 [00:46<01:09,  1.99it/s]
Epoch 16 Iter 86: loss 0.16318. :  38%|█████████████████                            | 85/224 [00:47<01:09,  1.99it/s]
Epoch 16 Iter 86: loss 0.16318. :  38%|█████████████████▎                           | 86/224 [00:47<01:09,  1.99it/s]
Epoch 16 Iter 87: loss 0.16720. :  38%|█████████████████▎                           | 86/224 [00:47<01:09,  1.99it/s]
Epoch 16 Iter 87: loss 0.16720. :  39%|█████████████████▍                           | 87/224 [00:47<01:08,  1.99it/s]
Epoch 16 Iter 88: loss 0.16203. :  39%|█████████████████▍                           | 87/224 [00:48<01:08,  1.99it/s]
Epoch 16 Iter 88: loss 0.16203. :  39%|█████████████████▋                           | 88/224 [00:48<01:08,  1.98it/s]
Epoch 16 Iter 89: loss 0.14963. :  39%|█████████████████▋                           | 88/224 [00:48<01:08,  1.98it/s]
Epoch 16 Iter 89: loss 0.14963. :  40%|█████████████████▉                           | 89/224 [00:48<01:07,  1.99it/s]
Epoch 16 Iter 90: loss 0.17507. :  40%|█████████████████▉                           | 89/224 [00:49<01:07,  1.99it/s]
Epoch 16 Iter 90: loss 0.17507. :  40%|██████████████████                           | 90/224 [00:49<01:07,  1.99it/s]
Epoch 16 Iter 91: loss 0.18019. :  40%|██████████████████                           | 90/224 [00:49<01:07,  1.99it/s]
Epoch 16 Iter 91: loss 0.18019. :  41%|██████████████████▎                          | 91/224 [00:49<01:06,  2.00it/s]
Epoch 16 Iter 92: loss 0.14967. :  41%|██████████████████▎                          | 91/224 [00:50<01:06,  2.00it/s]
Epoch 16 Iter 92: loss 0.14967. :  41%|██████████████████▍                          | 92/224 [00:50<01:06,  2.00it/s]
Epoch 16 Iter 93: loss 0.15655. :  41%|██████████████████▍                          | 92/224 [00:50<01:06,  2.00it/s]
Epoch 16 Iter 93: loss 0.15655. :  42%|██████████████████▋                          | 93/224 [00:50<01:05,  2.00it/s]
Epoch 16 Iter 94: loss 0.15545. :  42%|██████████████████▋                          | 93/224 [00:51<01:05,  2.00it/s]
Epoch 16 Iter 94: loss 0.15545. :  42%|██████████████████▉                          | 94/224 [00:51<01:04,  2.01it/s]
Epoch 16 Iter 95: loss 0.16751. :  42%|██████████████████▉                          | 94/224 [00:51<01:04,  2.01it/s]
Epoch 16 Iter 95: loss 0.16751. :  42%|███████████████████                          | 95/224 [00:51<01:04,  2.01it/s]
Epoch 16 Iter 96: loss 0.16556. :  42%|███████████████████                          | 95/224 [00:52<01:04,  2.01it/s]
Epoch 16 Iter 96: loss 0.16556. :  43%|███████████████████▎                         | 96/224 [00:52<01:04,  1.99it/s]
Epoch 16 Iter 97: loss 0.16429. :  43%|███████████████████▎                         | 96/224 [00:52<01:04,  1.99it/s]
Epoch 16 Iter 97: loss 0.16429. :  43%|███████████████████▍                         | 97/224 [00:52<01:04,  1.97it/s]
Epoch 16 Iter 98: loss 0.15574. :  43%|███████████████████▍                         | 97/224 [00:53<01:04,  1.97it/s]
Epoch 16 Iter 98: loss 0.15574. :  44%|███████████████████▋                         | 98/224 [00:53<01:03,  1.98it/s]
Epoch 16 Iter 99: loss 0.16096. :  44%|███████████████████▋                         | 98/224 [00:53<01:03,  1.98it/s]
Epoch 16 Iter 99: loss 0.16096. :  44%|███████████████████▉                         | 99/224 [00:53<01:03,  1.98it/s]
Epoch 16 Iter 100: loss 0.17003. :  44%|███████████████████▍                        | 99/224 [00:54<01:03,  1.98it/s]
Epoch 16 Iter 100: loss 0.17003. :  45%|███████████████████▏                       | 100/224 [00:54<01:02,  1.98it/s]
Epoch 16 Iter 101: loss 0.16248. :  45%|███████████████████▏                       | 100/224 [00:54<01:02,  1.98it/s]
Epoch 16 Iter 101: loss 0.16248. :  45%|███████████████████▍                       | 101/224 [00:54<01:01,  1.98it/s]
Epoch 16 Iter 102: loss 0.18606. :  45%|███████████████████▍                       | 101/224 [00:55<01:01,  1.98it/s]
Epoch 16 Iter 102: loss 0.18606. :  46%|███████████████████▌                       | 102/224 [00:55<01:01,  1.99it/s]
Epoch 16 Iter 103: loss 0.18101. :  46%|███████████████████▌                       | 102/224 [00:55<01:01,  1.99it/s]
Epoch 16 Iter 103: loss 0.18101. :  46%|███████████████████▊                       | 103/224 [00:55<01:00,  1.99it/s]
Epoch 16 Iter 104: loss 0.15920. :  46%|███████████████████▊                       | 103/224 [00:56<01:00,  1.99it/s]
Epoch 16 Iter 104: loss 0.15920. :  46%|███████████████████▉                       | 104/224 [00:56<01:00,  1.99it/s]
Epoch 16 Iter 105: loss 0.17805. :  46%|███████████████████▉                       | 104/224 [00:56<01:00,  1.99it/s]
Epoch 16 Iter 105: loss 0.17805. :  47%|████████████████████▏                      | 105/224 [00:56<00:59,  1.99it/s]
Epoch 16 Iter 106: loss 0.18170. :  47%|████████████████████▏                      | 105/224 [00:57<00:59,  1.99it/s]
Epoch 16 Iter 106: loss 0.18170. :  47%|████████████████████▎                      | 106/224 [00:57<00:58,  2.00it/s]
Epoch 16 Iter 107: loss 0.16627. :  47%|████████████████████▎                      | 106/224 [00:57<00:58,  2.00it/s]
Epoch 16 Iter 107: loss 0.16627. :  48%|████████████████████▌                      | 107/224 [00:58<00:59,  1.98it/s]
Epoch 16 Iter 108: loss 0.18090. :  48%|████████████████████▌                      | 107/224 [00:58<00:59,  1.98it/s]
Epoch 16 Iter 108: loss 0.18090. :  48%|████████████████████▋                      | 108/224 [00:58<00:58,  1.99it/s]
Epoch 16 Iter 109: loss 0.18246. :  48%|████████████████████▋                      | 108/224 [00:59<00:58,  1.99it/s]
Epoch 16 Iter 109: loss 0.18246. :  49%|████████████████████▉                      | 109/224 [00:59<00:57,  1.98it/s]
Epoch 16 Iter 110: loss 0.14822. :  49%|████████████████████▉                      | 109/224 [00:59<00:57,  1.98it/s]
Epoch 16 Iter 110: loss 0.14822. :  49%|█████████████████████                      | 110/224 [00:59<00:57,  1.99it/s]
Epoch 16 Iter 111: loss 0.16659. :  49%|█████████████████████                      | 110/224 [00:59<00:57,  1.99it/s]
Epoch 16 Iter 111: loss 0.16659. :  50%|█████████████████████▎                     | 111/224 [00:59<00:56,  2.00it/s]
Epoch 16 Iter 112: loss 0.15384. :  50%|█████████████████████▎                     | 111/224 [01:00<00:56,  2.00it/s]
Epoch 16 Iter 112: loss 0.15384. :  50%|█████████████████████▌                     | 112/224 [01:00<00:56,  1.99it/s]
Epoch 16 Iter 113: loss 0.17644. :  50%|█████████████████████▌                     | 112/224 [01:01<00:56,  1.99it/s]
Epoch 16 Iter 113: loss 0.17644. :  50%|█████████████████████▋                     | 113/224 [01:01<00:55,  1.99it/s]
Epoch 16 Iter 114: loss 0.16428. :  50%|█████████████████████▋                     | 113/224 [01:01<00:55,  1.99it/s]
Epoch 16 Iter 114: loss 0.16428. :  51%|█████████████████████▉                     | 114/224 [01:01<00:55,  2.00it/s]
Epoch 16 Iter 115: loss 0.16697. :  51%|█████████████████████▉                     | 114/224 [01:01<00:55,  2.00it/s]
Epoch 16 Iter 115: loss 0.16697. :  51%|██████████████████████                     | 115/224 [01:01<00:54,  2.00it/s]
Epoch 16 Iter 116: loss 0.17320. :  51%|██████████████████████                     | 115/224 [01:02<00:54,  2.00it/s]
Epoch 16 Iter 116: loss 0.17320. :  52%|██████████████████████▎                    | 116/224 [01:02<00:53,  2.02it/s]
Epoch 16 Iter 117: loss 0.17841. :  52%|██████████████████████▎                    | 116/224 [01:03<00:53,  2.02it/s]
Epoch 16 Iter 117: loss 0.17841. :  52%|██████████████████████▍                    | 117/224 [01:03<00:54,  1.95it/s]
Epoch 16 Iter 118: loss 0.19502. :  52%|██████████████████████▍                    | 117/224 [01:03<00:54,  1.95it/s]
Epoch 16 Iter 118: loss 0.19502. :  53%|██████████████████████▋                    | 118/224 [01:03<00:59,  1.78it/s]
Epoch 16 Iter 119: loss 0.16268. :  53%|██████████████████████▋                    | 118/224 [01:04<00:59,  1.78it/s]
Epoch 16 Iter 119: loss 0.16268. :  53%|██████████████████████▊                    | 119/224 [01:04<00:59,  1.77it/s]
Epoch 16 Iter 120: loss 0.16665. :  53%|██████████████████████▊                    | 119/224 [01:04<00:59,  1.77it/s]
Epoch 16 Iter 120: loss 0.16665. :  54%|███████████████████████                    | 120/224 [01:04<00:56,  1.84it/s]
Epoch 16 Iter 121: loss 0.17363. :  54%|███████████████████████                    | 120/224 [01:05<00:56,  1.84it/s]
Epoch 16 Iter 121: loss 0.17363. :  54%|███████████████████████▏                   | 121/224 [01:05<00:54,  1.89it/s]
Epoch 16 Iter 122: loss 0.16222. :  54%|███████████████████████▏                   | 121/224 [01:05<00:54,  1.89it/s]
Epoch 16 Iter 122: loss 0.16222. :  54%|███████████████████████▍                   | 122/224 [01:05<00:52,  1.93it/s]
Epoch 16 Iter 123: loss 0.17125. :  54%|███████████████████████▍                   | 122/224 [01:06<00:52,  1.93it/s]
Epoch 16 Iter 123: loss 0.17125. :  55%|███████████████████████▌                   | 123/224 [01:06<00:51,  1.95it/s]
Epoch 16 Iter 124: loss 0.15672. :  55%|███████████████████████▌                   | 123/224 [01:06<00:51,  1.95it/s]
Epoch 16 Iter 124: loss 0.15672. :  55%|███████████████████████▊                   | 124/224 [01:06<00:50,  1.97it/s]
Epoch 16 Iter 125: loss 0.17833. :  55%|███████████████████████▊                   | 124/224 [01:07<00:50,  1.97it/s]
Epoch 16 Iter 125: loss 0.17833. :  56%|███████████████████████▉                   | 125/224 [01:07<00:50,  1.98it/s]
Epoch 16 Iter 126: loss 0.14297. :  56%|███████████████████████▉                   | 125/224 [01:07<00:50,  1.98it/s]
Epoch 16 Iter 126: loss 0.14297. :  56%|████████████████████████▏                  | 126/224 [01:07<00:49,  1.99it/s]
Epoch 16 Iter 127: loss 0.15839. :  56%|████████████████████████▏                  | 126/224 [01:08<00:49,  1.99it/s]
Epoch 16 Iter 127: loss 0.15839. :  57%|████████████████████████▍                  | 127/224 [01:08<00:48,  2.00it/s]
Epoch 16 Iter 128: loss 0.14869. :  57%|████████████████████████▍                  | 127/224 [01:08<00:48,  2.00it/s]
Epoch 16 Iter 128: loss 0.14869. :  57%|████████████████████████▌                  | 128/224 [01:08<00:48,  2.00it/s]
Epoch 16 Iter 129: loss 0.17075. :  57%|████████████████████████▌                  | 128/224 [01:10<00:48,  2.00it/s]
Epoch 16 Iter 129: loss 0.17075. :  58%|████████████████████████▊                  | 129/224 [01:10<01:10,  1.35it/s]
Epoch 16 Iter 130: loss 0.17151. :  58%|████████████████████████▊                  | 129/224 [01:10<01:10,  1.35it/s]
Epoch 16 Iter 130: loss 0.17151. :  58%|████████████████████████▉                  | 130/224 [01:10<01:03,  1.48it/s]
Epoch 16 Iter 131: loss 0.16597. :  58%|████████████████████████▉                  | 130/224 [01:11<01:03,  1.48it/s]
Epoch 16 Iter 131: loss 0.16597. :  58%|█████████████████████████▏                 | 131/224 [01:11<00:58,  1.58it/s]
Epoch 16 Iter 132: loss 0.17728. :  58%|█████████████████████████▏                 | 131/224 [01:11<00:58,  1.58it/s]
Epoch 16 Iter 132: loss 0.17728. :  59%|█████████████████████████▎                 | 132/224 [01:11<00:54,  1.68it/s]
Epoch 16 Iter 133: loss 0.16422. :  59%|█████████████████████████▎                 | 132/224 [01:12<00:54,  1.68it/s]
Epoch 16 Iter 133: loss 0.16422. :  59%|█████████████████████████▌                 | 133/224 [01:12<00:51,  1.76it/s]
Epoch 16 Iter 134: loss 0.18612. :  59%|█████████████████████████▌                 | 133/224 [01:12<00:51,  1.76it/s]
Epoch 16 Iter 134: loss 0.18612. :  60%|█████████████████████████▋                 | 134/224 [01:12<00:49,  1.82it/s]
Epoch 16 Iter 135: loss 0.18647. :  60%|█████████████████████████▋                 | 134/224 [01:13<00:49,  1.82it/s]
Epoch 16 Iter 135: loss 0.18647. :  60%|█████████████████████████▉                 | 135/224 [01:13<00:49,  1.81it/s]
Epoch 16 Iter 136: loss 0.17073. :  60%|█████████████████████████▉                 | 135/224 [01:13<00:49,  1.81it/s]
Epoch 16 Iter 136: loss 0.17073. :  61%|██████████████████████████                 | 136/224 [01:13<00:47,  1.86it/s]
Epoch 16 Iter 137: loss 0.17505. :  61%|██████████████████████████                 | 136/224 [01:14<00:47,  1.86it/s]
Epoch 16 Iter 137: loss 0.17505. :  61%|██████████████████████████▎                | 137/224 [01:14<00:45,  1.90it/s]
Epoch 16 Iter 138: loss 0.16346. :  61%|██████████████████████████▎                | 137/224 [01:14<00:45,  1.90it/s]
Epoch 16 Iter 138: loss 0.16346. :  62%|██████████████████████████▍                | 138/224 [01:14<00:44,  1.91it/s]
Epoch 16 Iter 139: loss 0.16237. :  62%|██████████████████████████▍                | 138/224 [01:15<00:44,  1.91it/s]
Epoch 16 Iter 139: loss 0.16237. :  62%|██████████████████████████▋                | 139/224 [01:15<00:43,  1.94it/s]
Epoch 16 Iter 140: loss 0.14949. :  62%|██████████████████████████▋                | 139/224 [01:15<00:43,  1.94it/s]
Epoch 16 Iter 140: loss 0.14949. :  62%|██████████████████████████▉                | 140/224 [01:15<00:42,  1.95it/s]
Epoch 16 Iter 141: loss 0.15558. :  62%|██████████████████████████▉                | 140/224 [01:16<00:42,  1.95it/s]
Epoch 16 Iter 141: loss 0.15558. :  63%|███████████████████████████                | 141/224 [01:16<00:42,  1.95it/s]
Epoch 16 Iter 142: loss 0.17470. :  63%|███████████████████████████                | 141/224 [01:16<00:42,  1.95it/s]
Epoch 16 Iter 142: loss 0.17470. :  63%|███████████████████████████▎               | 142/224 [01:16<00:41,  1.96it/s]
Epoch 16 Iter 143: loss 0.17350. :  63%|███████████████████████████▎               | 142/224 [01:17<00:41,  1.96it/s]
Epoch 16 Iter 143: loss 0.17350. :  64%|███████████████████████████▍               | 143/224 [01:17<00:41,  1.97it/s]
Epoch 16 Iter 144: loss 0.16201. :  64%|███████████████████████████▍               | 143/224 [01:17<00:41,  1.97it/s]
Epoch 16 Iter 144: loss 0.16201. :  64%|███████████████████████████▋               | 144/224 [01:17<00:40,  1.98it/s]
Epoch 16 Iter 145: loss 0.17713. :  64%|███████████████████████████▋               | 144/224 [01:18<00:40,  1.98it/s]
Epoch 16 Iter 145: loss 0.17713. :  65%|███████████████████████████▊               | 145/224 [01:18<00:39,  1.99it/s]
Epoch 16 Iter 146: loss 0.16928. :  65%|███████████████████████████▊               | 145/224 [01:18<00:39,  1.99it/s]
Epoch 16 Iter 146: loss 0.16928. :  65%|████████████████████████████               | 146/224 [01:18<00:39,  2.00it/s]
Epoch 16 Iter 147: loss 0.18047. :  65%|████████████████████████████               | 146/224 [01:19<00:39,  2.00it/s]
Epoch 16 Iter 147: loss 0.18047. :  66%|████████████████████████████▏              | 147/224 [01:19<00:39,  1.93it/s]
Epoch 16 Iter 148: loss 0.16334. :  66%|████████████████████████████▏              | 147/224 [01:19<00:39,  1.93it/s]
Epoch 16 Iter 148: loss 0.16334. :  66%|████████████████████████████▍              | 148/224 [01:19<00:38,  1.96it/s]
Epoch 16 Iter 149: loss 0.14602. :  66%|████████████████████████████▍              | 148/224 [01:20<00:38,  1.96it/s]
Epoch 16 Iter 149: loss 0.14602. :  67%|████████████████████████████▌              | 149/224 [01:20<00:37,  1.98it/s]
Epoch 16 Iter 150: loss 0.16499. :  67%|████████████████████████████▌              | 149/224 [01:20<00:37,  1.98it/s]
Epoch 16 Iter 150: loss 0.16499. :  67%|████████████████████████████▊              | 150/224 [01:20<00:37,  1.99it/s]
Epoch 16 Iter 151: loss 0.15631. :  67%|████████████████████████████▊              | 150/224 [01:21<00:37,  1.99it/s]
Epoch 16 Iter 151: loss 0.15631. :  67%|████████████████████████████▉              | 151/224 [01:21<00:36,  1.99it/s]
Epoch 16 Iter 152: loss 0.17622. :  67%|████████████████████████████▉              | 151/224 [01:21<00:36,  1.99it/s]
Epoch 16 Iter 152: loss 0.17622. :  68%|█████████████████████████████▏             | 152/224 [01:21<00:36,  1.99it/s]
Epoch 16 Iter 153: loss 0.17682. :  68%|█████████████████████████████▏             | 152/224 [01:22<00:36,  1.99it/s]
Epoch 16 Iter 153: loss 0.17682. :  68%|█████████████████████████████▎             | 153/224 [01:22<00:35,  2.01it/s]
Epoch 16 Iter 154: loss 0.17919. :  68%|█████████████████████████████▎             | 153/224 [01:22<00:35,  2.01it/s]
Epoch 16 Iter 154: loss 0.17919. :  69%|█████████████████████████████▌             | 154/224 [01:22<00:34,  2.01it/s]
Epoch 16 Iter 155: loss 0.16571. :  69%|█████████████████████████████▌             | 154/224 [01:23<00:34,  2.01it/s]
Epoch 16 Iter 155: loss 0.16571. :  69%|█████████████████████████████▊             | 155/224 [01:23<00:34,  2.01it/s]
Epoch 16 Iter 156: loss 0.15626. :  69%|█████████████████████████████▊             | 155/224 [01:23<00:34,  2.01it/s]
Epoch 16 Iter 156: loss 0.15626. :  70%|█████████████████████████████▉             | 156/224 [01:23<00:33,  2.01it/s]
Epoch 16 Iter 157: loss 0.17298. :  70%|█████████████████████████████▉             | 156/224 [01:24<00:33,  2.01it/s]
Epoch 16 Iter 157: loss 0.17298. :  70%|██████████████████████████████▏            | 157/224 [01:24<00:33,  2.01it/s]
Epoch 16 Iter 158: loss 0.16377. :  70%|██████████████████████████████▏            | 157/224 [01:24<00:33,  2.01it/s]
Epoch 16 Iter 158: loss 0.16377. :  71%|██████████████████████████████▎            | 158/224 [01:24<00:33,  2.00it/s]
Epoch 16 Iter 159: loss 0.16163. :  71%|██████████████████████████████▎            | 158/224 [01:25<00:33,  2.00it/s]
Epoch 16 Iter 159: loss 0.16163. :  71%|██████████████████████████████▌            | 159/224 [01:25<00:32,  2.00it/s]
Epoch 16 Iter 160: loss 0.15515. :  71%|██████████████████████████████▌            | 159/224 [01:25<00:32,  2.00it/s]
Epoch 16 Iter 160: loss 0.15515. :  71%|██████████████████████████████▋            | 160/224 [01:25<00:31,  2.01it/s]
Epoch 16 Iter 161: loss 0.14280. :  71%|██████████████████████████████▋            | 160/224 [01:26<00:31,  2.01it/s]
Epoch 16 Iter 161: loss 0.14280. :  72%|██████████████████████████████▉            | 161/224 [01:26<00:31,  2.00it/s]
Epoch 16 Iter 162: loss 0.17351. :  72%|██████████████████████████████▉            | 161/224 [01:26<00:31,  2.00it/s]
Epoch 16 Iter 162: loss 0.17351. :  72%|███████████████████████████████            | 162/224 [01:26<00:31,  2.00it/s]
Epoch 16 Iter 163: loss 0.16186. :  72%|███████████████████████████████            | 162/224 [01:27<00:31,  2.00it/s]
Epoch 16 Iter 163: loss 0.16186. :  73%|███████████████████████████████▎           | 163/224 [01:27<00:30,  2.00it/s]
Epoch 16 Iter 164: loss 0.15119. :  73%|███████████████████████████████▎           | 163/224 [01:27<00:30,  2.00it/s]
Epoch 16 Iter 164: loss 0.15119. :  73%|███████████████████████████████▍           | 164/224 [01:27<00:29,  2.01it/s]
Epoch 16 Iter 165: loss 0.15982. :  73%|███████████████████████████████▍           | 164/224 [01:28<00:29,  2.01it/s]
Epoch 16 Iter 165: loss 0.15982. :  74%|███████████████████████████████▋           | 165/224 [01:28<00:29,  2.02it/s]
Epoch 16 Iter 166: loss 0.13847. :  74%|███████████████████████████████▋           | 165/224 [01:28<00:29,  2.02it/s]
Epoch 16 Iter 166: loss 0.13847. :  74%|███████████████████████████████▊           | 166/224 [01:28<00:28,  2.02it/s]
Epoch 16 Iter 167: loss 0.14984. :  74%|███████████████████████████████▊           | 166/224 [01:29<00:28,  2.02it/s]
Epoch 16 Iter 167: loss 0.14984. :  75%|████████████████████████████████           | 167/224 [01:29<00:28,  2.02it/s]
Epoch 16 Iter 168: loss 0.18060. :  75%|████████████████████████████████           | 167/224 [01:29<00:28,  2.02it/s]
Epoch 16 Iter 168: loss 0.18060. :  75%|████████████████████████████████▎          | 168/224 [01:29<00:27,  2.02it/s]
Epoch 16 Iter 169: loss 0.17402. :  75%|████████████████████████████████▎          | 168/224 [01:30<00:27,  2.02it/s]
Epoch 16 Iter 169: loss 0.17402. :  75%|████████████████████████████████▍          | 169/224 [01:30<00:27,  2.02it/s]
Epoch 16 Iter 170: loss 0.17352. :  75%|████████████████████████████████▍          | 169/224 [01:30<00:27,  2.02it/s]
Epoch 16 Iter 170: loss 0.17352. :  76%|████████████████████████████████▋          | 170/224 [01:30<00:26,  2.03it/s]
Epoch 16 Iter 171: loss 0.16259. :  76%|████████████████████████████████▋          | 170/224 [01:31<00:26,  2.03it/s]
Epoch 16 Iter 171: loss 0.16259. :  76%|████████████████████████████████▊          | 171/224 [01:31<00:26,  2.04it/s]
Epoch 16 Iter 172: loss 0.17616. :  76%|████████████████████████████████▊          | 171/224 [01:31<00:26,  2.04it/s]
Epoch 16 Iter 172: loss 0.17616. :  77%|█████████████████████████████████          | 172/224 [01:31<00:25,  2.03it/s]
Epoch 16 Iter 173: loss 0.15599. :  77%|█████████████████████████████████          | 172/224 [01:32<00:25,  2.03it/s]
Epoch 16 Iter 173: loss 0.15599. :  77%|█████████████████████████████████▏         | 173/224 [01:32<00:25,  2.04it/s]
Epoch 16 Iter 174: loss 0.16223. :  77%|█████████████████████████████████▏         | 173/224 [01:32<00:25,  2.04it/s]
Epoch 16 Iter 174: loss 0.16223. :  78%|█████████████████████████████████▍         | 174/224 [01:32<00:24,  2.03it/s]
Epoch 16 Iter 175: loss 0.15531. :  78%|█████████████████████████████████▍         | 174/224 [01:33<00:24,  2.03it/s]
Epoch 16 Iter 175: loss 0.15531. :  78%|█████████████████████████████████▌         | 175/224 [01:33<00:24,  2.03it/s]
Epoch 16 Iter 176: loss 0.16961. :  78%|█████████████████████████████████▌         | 175/224 [01:33<00:24,  2.03it/s]
Epoch 16 Iter 176: loss 0.16961. :  79%|█████████████████████████████████▊         | 176/224 [01:33<00:23,  2.02it/s]
Epoch 16 Iter 177: loss 0.16991. :  79%|█████████████████████████████████▊         | 176/224 [01:34<00:23,  2.02it/s]
Epoch 16 Iter 177: loss 0.16991. :  79%|█████████████████████████████████▉         | 177/224 [01:34<00:23,  2.02it/s]
Epoch 16 Iter 178: loss 0.16779. :  79%|█████████████████████████████████▉         | 177/224 [01:34<00:23,  2.02it/s]
Epoch 16 Iter 178: loss 0.16779. :  79%|██████████████████████████████████▏        | 178/224 [01:34<00:22,  2.02it/s]
Epoch 16 Iter 179: loss 0.16236. :  79%|██████████████████████████████████▏        | 178/224 [01:35<00:22,  2.02it/s]
Epoch 16 Iter 179: loss 0.16236. :  80%|██████████████████████████████████▎        | 179/224 [01:35<00:22,  2.02it/s]
Epoch 16 Iter 180: loss 0.18141. :  80%|██████████████████████████████████▎        | 179/224 [01:35<00:22,  2.02it/s]
Epoch 16 Iter 180: loss 0.18141. :  80%|██████████████████████████████████▌        | 180/224 [01:35<00:21,  2.02it/s]
Epoch 16 Iter 181: loss 0.16872. :  80%|██████████████████████████████████▌        | 180/224 [01:36<00:21,  2.02it/s]
Epoch 16 Iter 181: loss 0.16872. :  81%|██████████████████████████████████▋        | 181/224 [01:36<00:21,  2.01it/s]
Epoch 16 Iter 182: loss 0.17046. :  81%|██████████████████████████████████▋        | 181/224 [01:36<00:21,  2.01it/s]
Epoch 16 Iter 182: loss 0.17046. :  81%|██████████████████████████████████▉        | 182/224 [01:36<00:20,  2.02it/s]
Epoch 16 Iter 183: loss 0.18189. :  81%|██████████████████████████████████▉        | 182/224 [01:37<00:20,  2.02it/s]
Epoch 16 Iter 183: loss 0.18189. :  82%|███████████████████████████████████▏       | 183/224 [01:37<00:20,  2.02it/s]
Epoch 16 Iter 184: loss 0.15261. :  82%|███████████████████████████████████▏       | 183/224 [01:37<00:20,  2.02it/s]
Epoch 16 Iter 184: loss 0.15261. :  82%|███████████████████████████████████▎       | 184/224 [01:37<00:19,  2.02it/s]
Epoch 16 Iter 185: loss 0.19476. :  82%|███████████████████████████████████▎       | 184/224 [01:38<00:19,  2.02it/s]
Epoch 16 Iter 185: loss 0.19476. :  83%|███████████████████████████████████▌       | 185/224 [01:38<00:19,  2.02it/s]
Epoch 16 Iter 186: loss 0.16112. :  83%|███████████████████████████████████▌       | 185/224 [01:38<00:19,  2.02it/s]
Epoch 16 Iter 186: loss 0.16112. :  83%|███████████████████████████████████▋       | 186/224 [01:38<00:18,  2.02it/s]
Epoch 16 Iter 187: loss 0.15297. :  83%|███████████████████████████████████▋       | 186/224 [01:39<00:18,  2.02it/s]
Epoch 16 Iter 187: loss 0.15297. :  83%|███████████████████████████████████▉       | 187/224 [01:39<00:18,  2.01it/s]
Epoch 16 Iter 188: loss 0.17839. :  83%|███████████████████████████████████▉       | 187/224 [01:39<00:18,  2.01it/s]
Epoch 16 Iter 188: loss 0.17839. :  84%|████████████████████████████████████       | 188/224 [01:39<00:17,  2.00it/s]
Epoch 16 Iter 189: loss 0.16109. :  84%|████████████████████████████████████       | 188/224 [01:40<00:17,  2.00it/s]
Epoch 16 Iter 189: loss 0.16109. :  84%|████████████████████████████████████▎      | 189/224 [01:40<00:17,  2.01it/s]
Epoch 16 Iter 190: loss 0.17805. :  84%|████████████████████████████████████▎      | 189/224 [01:40<00:17,  2.01it/s]
Epoch 16 Iter 190: loss 0.17805. :  85%|████████████████████████████████████▍      | 190/224 [01:40<00:16,  2.02it/s]
Epoch 16 Iter 191: loss 0.15392. :  85%|████████████████████████████████████▍      | 190/224 [01:41<00:16,  2.02it/s]
Epoch 16 Iter 191: loss 0.15392. :  85%|████████████████████████████████████▋      | 191/224 [01:41<00:16,  2.02it/s]
Epoch 16 Iter 192: loss 0.17815. :  85%|████████████████████████████████████▋      | 191/224 [01:41<00:16,  2.02it/s]
Epoch 16 Iter 192: loss 0.17815. :  86%|████████████████████████████████████▊      | 192/224 [01:41<00:15,  2.02it/s]
Epoch 16 Iter 193: loss 0.17476. :  86%|████████████████████████████████████▊      | 192/224 [01:42<00:15,  2.02it/s]
Epoch 16 Iter 193: loss 0.17476. :  86%|█████████████████████████████████████      | 193/224 [01:42<00:15,  2.02it/s]
Epoch 16 Iter 194: loss 0.18604. :  86%|█████████████████████████████████████      | 193/224 [01:42<00:15,  2.02it/s]
Epoch 16 Iter 194: loss 0.18604. :  87%|█████████████████████████████████████▏     | 194/224 [01:42<00:14,  2.03it/s]
Epoch 16 Iter 195: loss 0.18462. :  87%|█████████████████████████████████████▏     | 194/224 [01:43<00:14,  2.03it/s]
Epoch 16 Iter 195: loss 0.18462. :  87%|█████████████████████████████████████▍     | 195/224 [01:43<00:14,  2.05it/s]
Epoch 16 Iter 196: loss 0.15412. :  87%|█████████████████████████████████████▍     | 195/224 [01:43<00:14,  2.05it/s]
Epoch 16 Iter 196: loss 0.15412. :  88%|█████████████████████████████████████▋     | 196/224 [01:43<00:13,  2.05it/s]
Epoch 16 Iter 197: loss 0.15375. :  88%|█████████████████████████████████████▋     | 196/224 [01:44<00:13,  2.05it/s]
Epoch 16 Iter 197: loss 0.15375. :  88%|█████████████████████████████████████▊     | 197/224 [01:44<00:13,  2.05it/s]
Epoch 16 Iter 198: loss 0.17280. :  88%|█████████████████████████████████████▊     | 197/224 [01:44<00:13,  2.05it/s]
Epoch 16 Iter 198: loss 0.17280. :  88%|██████████████████████████████████████     | 198/224 [01:44<00:12,  2.06it/s]
Epoch 16 Iter 199: loss 0.16058. :  88%|██████████████████████████████████████     | 198/224 [01:44<00:12,  2.06it/s]
Epoch 16 Iter 199: loss 0.16058. :  89%|██████████████████████████████████████▏    | 199/224 [01:44<00:12,  2.05it/s]
Epoch 16 Iter 200: loss 0.17070. :  89%|██████████████████████████████████████▏    | 199/224 [01:45<00:12,  2.05it/s]
Epoch 16 Iter 200: loss 0.17070. :  89%|██████████████████████████████████████▍    | 200/224 [01:45<00:11,  2.03it/s]
Epoch 16 Iter 201: loss 0.16764. :  89%|██████████████████████████████████████▍    | 200/224 [01:45<00:11,  2.03it/s]
Epoch 16 Iter 201: loss 0.16764. :  90%|██████████████████████████████████████▌    | 201/224 [01:45<00:11,  2.02it/s]
Epoch 16 Iter 202: loss 0.16523. :  90%|██████████████████████████████████████▌    | 201/224 [01:46<00:11,  2.02it/s]
Epoch 16 Iter 202: loss 0.16523. :  90%|██████████████████████████████████████▊    | 202/224 [01:46<00:11,  1.99it/s]
Epoch 16 Iter 203: loss 0.19815. :  90%|██████████████████████████████████████▊    | 202/224 [01:47<00:11,  1.99it/s]
Epoch 16 Iter 203: loss 0.19815. :  91%|██████████████████████████████████████▉    | 203/224 [01:47<00:10,  2.00it/s]
Epoch 16 Iter 204: loss 0.17290. :  91%|██████████████████████████████████████▉    | 203/224 [01:47<00:10,  2.00it/s]
Epoch 16 Iter 204: loss 0.17290. :  91%|███████████████████████████████████████▏   | 204/224 [01:47<00:09,  2.00it/s]
Epoch 16 Iter 205: loss 0.16501. :  91%|███████████████████████████████████████▏   | 204/224 [01:48<00:09,  2.00it/s]
Epoch 16 Iter 205: loss 0.16501. :  92%|███████████████████████████████████████▎   | 205/224 [01:48<00:09,  2.01it/s]
Epoch 16 Iter 206: loss 0.17372. :  92%|███████████████████████████████████████▎   | 205/224 [01:48<00:09,  2.01it/s]
Epoch 16 Iter 206: loss 0.17372. :  92%|███████████████████████████████████████▌   | 206/224 [01:48<00:08,  2.00it/s]
Epoch 16 Iter 207: loss 0.16482. :  92%|███████████████████████████████████████▌   | 206/224 [01:49<00:08,  2.00it/s]
Epoch 16 Iter 207: loss 0.16482. :  92%|███████████████████████████████████████▋   | 207/224 [01:49<00:08,  1.99it/s]
Epoch 16 Iter 208: loss 0.16004. :  92%|███████████████████████████████████████▋   | 207/224 [01:49<00:08,  1.99it/s]
Epoch 16 Iter 208: loss 0.16004. :  93%|███████████████████████████████████████▉   | 208/224 [01:49<00:08,  1.99it/s]
Epoch 16 Iter 209: loss 0.15947. :  93%|███████████████████████████████████████▉   | 208/224 [01:50<00:08,  1.99it/s]
Epoch 16 Iter 209: loss 0.15947. :  93%|████████████████████████████████████████   | 209/224 [01:50<00:07,  2.00it/s]
Epoch 16 Iter 210: loss 0.18171. :  93%|████████████████████████████████████████   | 209/224 [01:51<00:07,  2.00it/s]
Epoch 16 Iter 210: loss 0.18171. :  94%|████████████████████████████████████████▎  | 210/224 [01:51<00:10,  1.37it/s]
Epoch 16 Iter 211: loss 0.17708. :  94%|████████████████████████████████████████▎  | 210/224 [01:51<00:10,  1.37it/s]
Epoch 16 Iter 211: loss 0.17708. :  94%|████████████████████████████████████████▌  | 211/224 [01:51<00:08,  1.51it/s]
Epoch 16 Iter 212: loss 0.19385. :  94%|████████████████████████████████████████▌  | 211/224 [01:52<00:08,  1.51it/s]
Epoch 16 Iter 212: loss 0.19385. :  95%|████████████████████████████████████████▋  | 212/224 [01:52<00:07,  1.63it/s]
Epoch 16 Iter 213: loss 0.17876. :  95%|████████████████████████████████████████▋  | 212/224 [01:52<00:07,  1.63it/s]
Epoch 16 Iter 213: loss 0.17876. :  95%|████████████████████████████████████████▉  | 213/224 [01:52<00:06,  1.72it/s]
Epoch 16 Iter 214: loss 0.15032. :  95%|████████████████████████████████████████▉  | 213/224 [01:53<00:06,  1.72it/s]
Epoch 16 Iter 214: loss 0.15032. :  96%|█████████████████████████████████████████  | 214/224 [01:53<00:05,  1.79it/s]
Epoch 16 Iter 215: loss 0.17804. :  96%|█████████████████████████████████████████  | 214/224 [01:53<00:05,  1.79it/s]
Epoch 16 Iter 215: loss 0.17804. :  96%|█████████████████████████████████████████▎ | 215/224 [01:53<00:04,  1.83it/s]
Epoch 16 Iter 216: loss 0.16032. :  96%|█████████████████████████████████████████▎ | 215/224 [01:54<00:04,  1.83it/s]
Epoch 16 Iter 216: loss 0.16032. :  96%|█████████████████████████████████████████▍ | 216/224 [01:54<00:04,  1.87it/s]
Epoch 16 Iter 217: loss 0.14340. :  96%|█████████████████████████████████████████▍ | 216/224 [01:54<00:04,  1.87it/s]
Epoch 16 Iter 217: loss 0.14340. :  97%|█████████████████████████████████████████▋ | 217/224 [01:54<00:03,  1.91it/s]
Epoch 16 Iter 218: loss 0.16851. :  97%|█████████████████████████████████████████▋ | 217/224 [01:55<00:03,  1.91it/s]
Epoch 16 Iter 218: loss 0.16851. :  97%|█████████████████████████████████████████▊ | 218/224 [01:55<00:03,  1.93it/s]
Epoch 16 Iter 219: loss 0.17491. :  97%|█████████████████████████████████████████▊ | 218/224 [01:55<00:03,  1.93it/s]
Epoch 16 Iter 219: loss 0.17491. :  98%|██████████████████████████████████████████ | 219/224 [01:55<00:02,  1.93it/s]
Epoch 16 Iter 220: loss 0.14309. :  98%|██████████████████████████████████████████ | 219/224 [01:56<00:02,  1.93it/s]
Epoch 16 Iter 220: loss 0.14309. :  98%|██████████████████████████████████████████▏| 220/224 [01:56<00:02,  1.93it/s]
Epoch 16 Iter 221: loss 0.17075. :  98%|██████████████████████████████████████████▏| 220/224 [01:56<00:02,  1.93it/s]
Epoch 16 Iter 221: loss 0.17075. :  99%|██████████████████████████████████████████▍| 221/224 [01:56<00:01,  1.94it/s]
Epoch 16 Iter 222: loss 0.17470. :  99%|██████████████████████████████████████████▍| 221/224 [01:57<00:01,  1.94it/s]
Epoch 16 Iter 222: loss 0.17470. :  99%|██████████████████████████████████████████▌| 222/224 [01:57<00:01,  1.96it/s]
Epoch 16 Iter 223: loss 0.15621. :  99%|██████████████████████████████████████████▌| 222/224 [01:57<00:01,  1.96it/s]
Epoch 16 Iter 223: loss 0.15621. : 100%|██████████████████████████████████████████▊| 223/224 [01:57<00:00,  1.98it/s]
Epoch 16 Iter 224: loss 0.18019. : 100%|██████████████████████████████████████████▊| 223/224 [01:58<00:00,  1.98it/s]
Epoch 16 Iter 224: loss 0.18019. : 100%|███████████████████████████████████████████| 224/224 [01:58<00:00,  1.98it/s]
Epoch 16 Iter 224: loss 0.18019. : 100%|███████████████████████████████████████████| 224/224 [01:58<00:00,  1.89it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.16616. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.16616. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 17 Iter 2: loss 0.17220. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 17 Iter 2: loss 0.17220. :   1%|▍                                              | 2/224 [00:00<01:50,  2.00it/s]
Epoch 17 Iter 3: loss 0.16096. :   1%|▍                                              | 2/224 [00:01<01:50,  2.00it/s]
Epoch 17 Iter 3: loss 0.16096. :   1%|▋                                              | 3/224 [00:01<01:59,  1.85it/s]
Epoch 17 Iter 4: loss 0.15380. :   1%|▋                                              | 3/224 [00:02<01:59,  1.85it/s]
Epoch 17 Iter 4: loss 0.15380. :   2%|▊                                              | 4/224 [00:02<01:58,  1.86it/s]
Epoch 17 Iter 5: loss 0.15783. :   2%|▊                                              | 4/224 [00:02<01:58,  1.86it/s]
Epoch 17 Iter 5: loss 0.15783. :   2%|█                                              | 5/224 [00:02<01:54,  1.91it/s]
Epoch 17 Iter 6: loss 0.18582. :   2%|█                                              | 5/224 [00:03<01:54,  1.91it/s]
Epoch 17 Iter 6: loss 0.18582. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 17 Iter 7: loss 0.18085. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 17 Iter 7: loss 0.18085. :   3%|█▍                                             | 7/224 [00:03<01:51,  1.95it/s]
Epoch 17 Iter 8: loss 0.16753. :   3%|█▍                                             | 7/224 [00:04<01:51,  1.95it/s]
Epoch 17 Iter 8: loss 0.16753. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.97it/s]
Epoch 17 Iter 9: loss 0.16344. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.97it/s]
Epoch 17 Iter 9: loss 0.16344. :   4%|█▉                                             | 9/224 [00:04<01:49,  1.97it/s]
Epoch 17 Iter 10: loss 0.16851. :   4%|█▊                                            | 9/224 [00:05<01:49,  1.97it/s]
Epoch 17 Iter 10: loss 0.16851. :   4%|██                                           | 10/224 [00:05<01:49,  1.95it/s]
Epoch 17 Iter 11: loss 0.17675. :   4%|██                                           | 10/224 [00:05<01:49,  1.95it/s]
Epoch 17 Iter 11: loss 0.17675. :   5%|██▏                                          | 11/224 [00:05<01:58,  1.79it/s]
Epoch 17 Iter 12: loss 0.17686. :   5%|██▏                                          | 11/224 [00:06<01:58,  1.79it/s]
Epoch 17 Iter 12: loss 0.17686. :   5%|██▍                                          | 12/224 [00:06<01:56,  1.82it/s]
Epoch 17 Iter 13: loss 0.18529. :   5%|██▍                                          | 12/224 [00:06<01:56,  1.82it/s]
Epoch 17 Iter 13: loss 0.18529. :   6%|██▌                                          | 13/224 [00:06<01:52,  1.87it/s]
Epoch 17 Iter 14: loss 0.14666. :   6%|██▌                                          | 13/224 [00:07<01:52,  1.87it/s]
Epoch 17 Iter 14: loss 0.14666. :   6%|██▊                                          | 14/224 [00:07<01:49,  1.91it/s]
Epoch 17 Iter 15: loss 0.15973. :   6%|██▊                                          | 14/224 [00:07<01:49,  1.91it/s]
Epoch 17 Iter 15: loss 0.15973. :   7%|███                                          | 15/224 [00:07<01:47,  1.94it/s]
Epoch 17 Iter 16: loss 0.17165. :   7%|███                                          | 15/224 [00:08<01:47,  1.94it/s]
Epoch 17 Iter 16: loss 0.17165. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 17 Iter 17: loss 0.17757. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 17 Iter 17: loss 0.17757. :   8%|███▍                                         | 17/224 [00:08<01:44,  1.97it/s]
Epoch 17 Iter 18: loss 0.16551. :   8%|███▍                                         | 17/224 [00:09<01:44,  1.97it/s]
Epoch 17 Iter 18: loss 0.16551. :   8%|███▌                                         | 18/224 [00:09<01:45,  1.96it/s]
Epoch 17 Iter 19: loss 0.17764. :   8%|███▌                                         | 18/224 [00:09<01:45,  1.96it/s]
Epoch 17 Iter 19: loss 0.17764. :   8%|███▊                                         | 19/224 [00:09<01:44,  1.96it/s]
Epoch 17 Iter 20: loss 0.17509. :   8%|███▊                                         | 19/224 [00:10<01:44,  1.96it/s]
Epoch 17 Iter 20: loss 0.17509. :   9%|████                                         | 20/224 [00:10<01:43,  1.97it/s]
Epoch 17 Iter 21: loss 0.17442. :   9%|████                                         | 20/224 [00:10<01:43,  1.97it/s]
Epoch 17 Iter 21: loss 0.17442. :   9%|████▏                                        | 21/224 [00:10<01:42,  1.98it/s]
Epoch 17 Iter 22: loss 0.17969. :   9%|████▏                                        | 21/224 [00:11<01:42,  1.98it/s]
Epoch 17 Iter 22: loss 0.17969. :  10%|████▍                                        | 22/224 [00:11<01:41,  1.99it/s]
Epoch 17 Iter 23: loss 0.19131. :  10%|████▍                                        | 22/224 [00:11<01:41,  1.99it/s]
Epoch 17 Iter 23: loss 0.19131. :  10%|████▌                                        | 23/224 [00:11<01:42,  1.96it/s]
Epoch 17 Iter 24: loss 0.18202. :  10%|████▌                                        | 23/224 [00:12<01:42,  1.96it/s]
Epoch 17 Iter 24: loss 0.18202. :  11%|████▊                                        | 24/224 [00:12<01:42,  1.96it/s]
Epoch 17 Iter 25: loss 0.17080. :  11%|████▊                                        | 24/224 [00:12<01:42,  1.96it/s]
Epoch 17 Iter 25: loss 0.17080. :  11%|█████                                        | 25/224 [00:12<01:42,  1.94it/s]
Epoch 17 Iter 26: loss 0.16458. :  11%|█████                                        | 25/224 [00:13<01:42,  1.94it/s]
Epoch 17 Iter 26: loss 0.16458. :  12%|█████▏                                       | 26/224 [00:13<01:43,  1.91it/s]
Epoch 17 Iter 27: loss 0.16350. :  12%|█████▏                                       | 26/224 [00:13<01:43,  1.91it/s]
Epoch 17 Iter 27: loss 0.16350. :  12%|█████▍                                       | 27/224 [00:13<01:42,  1.92it/s]
Epoch 17 Iter 28: loss 0.16204. :  12%|█████▍                                       | 27/224 [00:14<01:42,  1.92it/s]
Epoch 17 Iter 28: loss 0.16204. :  12%|█████▋                                       | 28/224 [00:14<01:40,  1.94it/s]
Epoch 17 Iter 29: loss 0.16281. :  12%|█████▋                                       | 28/224 [00:14<01:40,  1.94it/s]
Epoch 17 Iter 29: loss 0.16281. :  13%|█████▊                                       | 29/224 [00:14<01:39,  1.95it/s]
Epoch 17 Iter 30: loss 0.18228. :  13%|█████▊                                       | 29/224 [00:15<01:39,  1.95it/s]
Epoch 17 Iter 30: loss 0.18228. :  13%|██████                                       | 30/224 [00:15<01:39,  1.96it/s]
Epoch 17 Iter 31: loss 0.18873. :  13%|██████                                       | 30/224 [00:16<01:39,  1.96it/s]
Epoch 17 Iter 31: loss 0.18873. :  14%|██████▏                                      | 31/224 [00:16<01:40,  1.92it/s]
Epoch 17 Iter 32: loss 0.17625. :  14%|██████▏                                      | 31/224 [00:16<01:40,  1.92it/s]
Epoch 17 Iter 32: loss 0.17625. :  14%|██████▍                                      | 32/224 [00:16<01:41,  1.89it/s]
Epoch 17 Iter 33: loss 0.16904. :  14%|██████▍                                      | 32/224 [00:17<01:41,  1.89it/s]
Epoch 17 Iter 33: loss 0.16904. :  15%|██████▋                                      | 33/224 [00:17<01:39,  1.92it/s]
Epoch 17 Iter 34: loss 0.14903. :  15%|██████▋                                      | 33/224 [00:17<01:39,  1.92it/s]
Epoch 17 Iter 34: loss 0.14903. :  15%|██████▊                                      | 34/224 [00:17<01:38,  1.94it/s]
Epoch 17 Iter 35: loss 0.15860. :  15%|██████▊                                      | 34/224 [00:18<01:38,  1.94it/s]
Epoch 17 Iter 35: loss 0.15860. :  16%|███████                                      | 35/224 [00:18<01:37,  1.95it/s]
Epoch 17 Iter 36: loss 0.16169. :  16%|███████                                      | 35/224 [00:18<01:37,  1.95it/s]
Epoch 17 Iter 36: loss 0.16169. :  16%|███████▏                                     | 36/224 [00:18<01:35,  1.96it/s]
Epoch 17 Iter 37: loss 0.15981. :  16%|███████▏                                     | 36/224 [00:19<01:35,  1.96it/s]
Epoch 17 Iter 37: loss 0.15981. :  17%|███████▍                                     | 37/224 [00:19<01:37,  1.92it/s]
Epoch 17 Iter 38: loss 0.16751. :  17%|███████▍                                     | 37/224 [00:19<01:37,  1.92it/s]
Epoch 17 Iter 38: loss 0.16751. :  17%|███████▋                                     | 38/224 [00:19<01:35,  1.94it/s]
Epoch 17 Iter 39: loss 0.18002. :  17%|███████▋                                     | 38/224 [00:20<01:35,  1.94it/s]
Epoch 17 Iter 39: loss 0.18002. :  17%|███████▊                                     | 39/224 [00:20<01:33,  1.97it/s]
Epoch 17 Iter 40: loss 0.14699. :  17%|███████▊                                     | 39/224 [00:20<01:33,  1.97it/s]
Epoch 17 Iter 40: loss 0.14699. :  18%|████████                                     | 40/224 [00:20<01:34,  1.95it/s]
Epoch 17 Iter 41: loss 0.15805. :  18%|████████                                     | 40/224 [00:21<01:34,  1.95it/s]
Epoch 17 Iter 41: loss 0.15805. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.96it/s]
Epoch 17 Iter 42: loss 0.15716. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.96it/s]
Epoch 17 Iter 42: loss 0.15716. :  19%|████████▍                                    | 42/224 [00:21<01:34,  1.92it/s]
Epoch 17 Iter 43: loss 0.16978. :  19%|████████▍                                    | 42/224 [00:22<01:34,  1.92it/s]
Epoch 17 Iter 43: loss 0.16978. :  19%|████████▋                                    | 43/224 [00:22<01:34,  1.92it/s]
Epoch 17 Iter 44: loss 0.18216. :  19%|████████▋                                    | 43/224 [00:22<01:34,  1.92it/s]
Epoch 17 Iter 44: loss 0.18216. :  20%|████████▊                                    | 44/224 [00:22<01:32,  1.94it/s]
Epoch 17 Iter 45: loss 0.18070. :  20%|████████▊                                    | 44/224 [00:23<01:32,  1.94it/s]
Epoch 17 Iter 45: loss 0.18070. :  20%|█████████                                    | 45/224 [00:23<01:31,  1.95it/s]
Epoch 17 Iter 46: loss 0.17632. :  20%|█████████                                    | 45/224 [00:23<01:31,  1.95it/s]
Epoch 17 Iter 46: loss 0.17632. :  21%|█████████▏                                   | 46/224 [00:23<01:30,  1.96it/s]
Epoch 17 Iter 47: loss 0.17036. :  21%|█████████▏                                   | 46/224 [00:24<01:30,  1.96it/s]
Epoch 17 Iter 47: loss 0.17036. :  21%|█████████▍                                   | 47/224 [00:24<01:30,  1.97it/s]
Epoch 17 Iter 48: loss 0.18809. :  21%|█████████▍                                   | 47/224 [00:24<01:30,  1.97it/s]
Epoch 17 Iter 48: loss 0.18809. :  21%|█████████▋                                   | 48/224 [00:24<01:29,  1.97it/s]
Epoch 17 Iter 49: loss 0.15662. :  21%|█████████▋                                   | 48/224 [00:25<01:29,  1.97it/s]
Epoch 17 Iter 49: loss 0.15662. :  22%|█████████▊                                   | 49/224 [00:25<01:28,  1.99it/s]
Epoch 17 Iter 50: loss 0.16860. :  22%|█████████▊                                   | 49/224 [00:25<01:28,  1.99it/s]
Epoch 17 Iter 50: loss 0.16860. :  22%|██████████                                   | 50/224 [00:25<01:27,  1.99it/s]
Epoch 17 Iter 51: loss 0.17403. :  22%|██████████                                   | 50/224 [00:26<01:27,  1.99it/s]
Epoch 17 Iter 51: loss 0.17403. :  23%|██████████▏                                  | 51/224 [00:26<01:26,  2.00it/s]
Epoch 17 Iter 52: loss 0.17466. :  23%|██████████▏                                  | 51/224 [00:26<01:26,  2.00it/s]
Epoch 17 Iter 52: loss 0.17466. :  23%|██████████▍                                  | 52/224 [00:26<01:25,  2.02it/s]
Epoch 17 Iter 53: loss 0.17636. :  23%|██████████▍                                  | 52/224 [00:27<01:25,  2.02it/s]
Epoch 17 Iter 53: loss 0.17636. :  24%|██████████▋                                  | 53/224 [00:27<01:24,  2.02it/s]
Epoch 17 Iter 54: loss 0.17109. :  24%|██████████▋                                  | 53/224 [00:27<01:24,  2.02it/s]
Epoch 17 Iter 54: loss 0.17109. :  24%|██████████▊                                  | 54/224 [00:27<01:23,  2.03it/s]
Epoch 17 Iter 55: loss 0.15790. :  24%|██████████▊                                  | 54/224 [00:28<01:23,  2.03it/s]
Epoch 17 Iter 55: loss 0.15790. :  25%|███████████                                  | 55/224 [00:28<01:24,  2.00it/s]
Epoch 17 Iter 56: loss 0.17270. :  25%|███████████                                  | 55/224 [00:28<01:24,  2.00it/s]
Epoch 17 Iter 56: loss 0.17270. :  25%|███████████▎                                 | 56/224 [00:28<01:26,  1.94it/s]
Epoch 17 Iter 57: loss 0.18081. :  25%|███████████▎                                 | 56/224 [00:29<01:26,  1.94it/s]
Epoch 17 Iter 57: loss 0.18081. :  25%|███████████▍                                 | 57/224 [00:29<01:34,  1.77it/s]
Epoch 17 Iter 58: loss 0.16683. :  25%|███████████▍                                 | 57/224 [00:30<01:34,  1.77it/s]
Epoch 17 Iter 58: loss 0.16683. :  26%|███████████▋                                 | 58/224 [00:30<01:32,  1.80it/s]
Epoch 17 Iter 59: loss 0.18337. :  26%|███████████▋                                 | 58/224 [00:30<01:32,  1.80it/s]
Epoch 17 Iter 59: loss 0.18337. :  26%|███████████▊                                 | 59/224 [00:30<01:31,  1.80it/s]
Epoch 17 Iter 60: loss 0.17046. :  26%|███████████▊                                 | 59/224 [00:31<01:31,  1.80it/s]
Epoch 17 Iter 60: loss 0.17046. :  27%|████████████                                 | 60/224 [00:31<01:41,  1.61it/s]
Epoch 17 Iter 61: loss 0.15735. :  27%|████████████                                 | 60/224 [00:31<01:41,  1.61it/s]
Epoch 17 Iter 61: loss 0.15735. :  27%|████████████▎                                | 61/224 [00:31<01:37,  1.66it/s]
Epoch 17 Iter 62: loss 0.14851. :  27%|████████████▎                                | 61/224 [00:32<01:37,  1.66it/s]
Epoch 17 Iter 62: loss 0.14851. :  28%|████████████▍                                | 62/224 [00:32<01:34,  1.71it/s]
Epoch 17 Iter 63: loss 0.17294. :  28%|████████████▍                                | 62/224 [00:33<01:34,  1.71it/s]
Epoch 17 Iter 63: loss 0.17294. :  28%|████████████▋                                | 63/224 [00:33<01:37,  1.65it/s]
Epoch 17 Iter 64: loss 0.16138. :  28%|████████████▋                                | 63/224 [00:33<01:37,  1.65it/s]
Epoch 17 Iter 64: loss 0.16138. :  29%|████████████▊                                | 64/224 [00:33<01:38,  1.62it/s]
Epoch 17 Iter 65: loss 0.14820. :  29%|████████████▊                                | 64/224 [00:34<01:38,  1.62it/s]
Epoch 17 Iter 65: loss 0.14820. :  29%|█████████████                                | 65/224 [00:34<01:34,  1.68it/s]
Epoch 17 Iter 66: loss 0.14782. :  29%|█████████████                                | 65/224 [00:34<01:34,  1.68it/s]
Epoch 17 Iter 66: loss 0.14782. :  29%|█████████████▎                               | 66/224 [00:34<01:39,  1.58it/s]
Epoch 17 Iter 67: loss 0.15850. :  29%|█████████████▎                               | 66/224 [00:35<01:39,  1.58it/s]
Epoch 17 Iter 67: loss 0.15850. :  30%|█████████████▍                               | 67/224 [00:35<01:45,  1.49it/s]
Epoch 17 Iter 68: loss 0.16386. :  30%|█████████████▍                               | 67/224 [00:36<01:45,  1.49it/s]
Epoch 17 Iter 68: loss 0.16386. :  30%|█████████████▋                               | 68/224 [00:36<01:48,  1.43it/s]
Epoch 17 Iter 69: loss 0.14650. :  30%|█████████████▋                               | 68/224 [00:37<01:48,  1.43it/s]
Epoch 17 Iter 69: loss 0.14650. :  31%|█████████████▊                               | 69/224 [00:37<01:49,  1.41it/s]
Epoch 17 Iter 70: loss 0.15943. :  31%|█████████████▊                               | 69/224 [00:37<01:49,  1.41it/s]
Epoch 17 Iter 70: loss 0.15943. :  31%|██████████████                               | 70/224 [00:37<01:43,  1.49it/s]
Epoch 17 Iter 71: loss 0.18273. :  31%|██████████████                               | 70/224 [00:38<01:43,  1.49it/s]
Epoch 17 Iter 71: loss 0.18273. :  32%|██████████████▎                              | 71/224 [00:38<01:39,  1.54it/s]
Epoch 17 Iter 72: loss 0.16920. :  32%|██████████████▎                              | 71/224 [00:39<01:39,  1.54it/s]
Epoch 17 Iter 72: loss 0.16920. :  32%|██████████████▍                              | 72/224 [00:39<01:37,  1.55it/s]
Epoch 17 Iter 73: loss 0.15189. :  32%|██████████████▍                              | 72/224 [00:39<01:37,  1.55it/s]
Epoch 17 Iter 73: loss 0.15189. :  33%|██████████████▋                              | 73/224 [00:39<01:36,  1.57it/s]
Epoch 17 Iter 74: loss 0.18526. :  33%|██████████████▋                              | 73/224 [00:40<01:36,  1.57it/s]
Epoch 17 Iter 74: loss 0.18526. :  33%|██████████████▊                              | 74/224 [00:40<01:31,  1.64it/s]
Epoch 17 Iter 75: loss 0.15472. :  33%|██████████████▊                              | 74/224 [00:40<01:31,  1.64it/s]
Epoch 17 Iter 75: loss 0.15472. :  33%|███████████████                              | 75/224 [00:40<01:28,  1.69it/s]
Epoch 17 Iter 76: loss 0.17708. :  33%|███████████████                              | 75/224 [00:41<01:28,  1.69it/s]
Epoch 17 Iter 76: loss 0.17708. :  34%|███████████████▎                             | 76/224 [00:41<01:25,  1.72it/s]
Epoch 17 Iter 77: loss 0.17594. :  34%|███████████████▎                             | 76/224 [00:42<01:25,  1.72it/s]
Epoch 17 Iter 77: loss 0.17594. :  34%|███████████████▍                             | 77/224 [00:42<01:29,  1.65it/s]
Epoch 17 Iter 78: loss 0.18029. :  34%|███████████████▍                             | 77/224 [00:42<01:29,  1.65it/s]
Epoch 17 Iter 78: loss 0.18029. :  35%|███████████████▋                             | 78/224 [00:42<01:31,  1.59it/s]
Epoch 17 Iter 79: loss 0.16834. :  35%|███████████████▋                             | 78/224 [00:43<01:31,  1.59it/s]
Epoch 17 Iter 79: loss 0.16834. :  35%|███████████████▊                             | 79/224 [00:43<01:27,  1.66it/s]
Epoch 17 Iter 80: loss 0.18678. :  35%|███████████████▊                             | 79/224 [00:43<01:27,  1.66it/s]
Epoch 17 Iter 80: loss 0.18678. :  36%|████████████████                             | 80/224 [00:43<01:23,  1.72it/s]
Epoch 17 Iter 81: loss 0.17459. :  36%|████████████████                             | 80/224 [00:44<01:23,  1.72it/s]
Epoch 17 Iter 81: loss 0.17459. :  36%|████████████████▎                            | 81/224 [00:44<01:21,  1.76it/s]
Epoch 17 Iter 82: loss 0.15927. :  36%|████████████████▎                            | 81/224 [00:44<01:21,  1.76it/s]
Epoch 17 Iter 82: loss 0.15927. :  37%|████████████████▍                            | 82/224 [00:44<01:21,  1.75it/s]
Epoch 17 Iter 83: loss 0.16605. :  37%|████████████████▍                            | 82/224 [00:45<01:21,  1.75it/s]
Epoch 17 Iter 83: loss 0.16605. :  37%|████████████████▋                            | 83/224 [00:45<01:26,  1.63it/s]
Epoch 17 Iter 84: loss 0.17775. :  37%|████████████████▋                            | 83/224 [00:46<01:26,  1.63it/s]
Epoch 17 Iter 84: loss 0.17775. :  38%|████████████████▉                            | 84/224 [00:46<01:22,  1.70it/s]
Epoch 17 Iter 85: loss 0.15023. :  38%|████████████████▉                            | 84/224 [00:46<01:22,  1.70it/s]
Epoch 17 Iter 85: loss 0.15023. :  38%|█████████████████                            | 85/224 [00:46<01:19,  1.74it/s]
Epoch 17 Iter 86: loss 0.16522. :  38%|█████████████████                            | 85/224 [00:47<01:19,  1.74it/s]
Epoch 17 Iter 86: loss 0.16522. :  38%|█████████████████▎                           | 86/224 [00:47<01:18,  1.77it/s]
Epoch 17 Iter 87: loss 0.15326. :  38%|█████████████████▎                           | 86/224 [00:47<01:18,  1.77it/s]
Epoch 17 Iter 87: loss 0.15326. :  39%|█████████████████▍                           | 87/224 [00:47<01:17,  1.77it/s]
Epoch 17 Iter 88: loss 0.16803. :  39%|█████████████████▍                           | 87/224 [00:48<01:17,  1.77it/s]
Epoch 17 Iter 88: loss 0.16803. :  39%|█████████████████▋                           | 88/224 [00:48<01:20,  1.68it/s]
Epoch 17 Iter 89: loss 0.15624. :  39%|█████████████████▋                           | 88/224 [00:49<01:20,  1.68it/s]
Epoch 17 Iter 89: loss 0.15624. :  40%|█████████████████▉                           | 89/224 [00:49<01:24,  1.61it/s]
Epoch 17 Iter 90: loss 0.16174. :  40%|█████████████████▉                           | 89/224 [00:49<01:24,  1.61it/s]
Epoch 17 Iter 90: loss 0.16174. :  40%|██████████████████                           | 90/224 [00:49<01:21,  1.65it/s]
Epoch 17 Iter 91: loss 0.17038. :  40%|██████████████████                           | 90/224 [00:50<01:21,  1.65it/s]
Epoch 17 Iter 91: loss 0.17038. :  41%|██████████████████▎                          | 91/224 [00:50<01:19,  1.67it/s]
Epoch 17 Iter 92: loss 0.16386. :  41%|██████████████████▎                          | 91/224 [00:50<01:19,  1.67it/s]
Epoch 17 Iter 92: loss 0.16386. :  41%|██████████████████▍                          | 92/224 [00:50<01:18,  1.69it/s]
Epoch 17 Iter 93: loss 0.15205. :  41%|██████████████████▍                          | 92/224 [00:51<01:18,  1.69it/s]
Epoch 17 Iter 93: loss 0.15205. :  42%|██████████████████▋                          | 93/224 [00:51<01:15,  1.74it/s]
Epoch 17 Iter 94: loss 0.17689. :  42%|██████████████████▋                          | 93/224 [00:51<01:15,  1.74it/s]
Epoch 17 Iter 94: loss 0.17689. :  42%|██████████████████▉                          | 94/224 [00:51<01:13,  1.77it/s]
Epoch 17 Iter 95: loss 0.14362. :  42%|██████████████████▉                          | 94/224 [00:52<01:13,  1.77it/s]
Epoch 17 Iter 95: loss 0.14362. :  42%|███████████████████                          | 95/224 [00:52<01:11,  1.81it/s]
Epoch 17 Iter 96: loss 0.16085. :  42%|███████████████████                          | 95/224 [00:52<01:11,  1.81it/s]
Epoch 17 Iter 96: loss 0.16085. :  43%|███████████████████▎                         | 96/224 [00:52<01:10,  1.81it/s]
Epoch 17 Iter 97: loss 0.16970. :  43%|███████████████████▎                         | 96/224 [00:53<01:10,  1.81it/s]
Epoch 17 Iter 97: loss 0.16970. :  43%|███████████████████▍                         | 97/224 [00:53<01:11,  1.79it/s]
Epoch 17 Iter 98: loss 0.18883. :  43%|███████████████████▍                         | 97/224 [00:54<01:11,  1.79it/s]
Epoch 17 Iter 98: loss 0.18883. :  44%|███████████████████▋                         | 98/224 [00:54<01:14,  1.69it/s]
Epoch 17 Iter 99: loss 0.16871. :  44%|███████████████████▋                         | 98/224 [00:54<01:14,  1.69it/s]
Epoch 17 Iter 99: loss 0.16871. :  44%|███████████████████▉                         | 99/224 [00:54<01:16,  1.63it/s]
Epoch 17 Iter 100: loss 0.14546. :  44%|███████████████████▍                        | 99/224 [00:55<01:16,  1.63it/s]
Epoch 17 Iter 100: loss 0.14546. :  45%|███████████████████▏                       | 100/224 [00:55<01:12,  1.70it/s]
Epoch 17 Iter 101: loss 0.16314. :  45%|███████████████████▏                       | 100/224 [00:55<01:12,  1.70it/s]
Epoch 17 Iter 101: loss 0.16314. :  45%|███████████████████▍                       | 101/224 [00:55<01:10,  1.74it/s]
Epoch 17 Iter 102: loss 0.17846. :  45%|███████████████████▍                       | 101/224 [00:56<01:10,  1.74it/s]
Epoch 17 Iter 102: loss 0.17846. :  46%|███████████████████▌                       | 102/224 [00:56<01:08,  1.77it/s]
Epoch 17 Iter 103: loss 0.19044. :  46%|███████████████████▌                       | 102/224 [00:57<01:08,  1.77it/s]
Epoch 17 Iter 103: loss 0.19044. :  46%|███████████████████▊                       | 103/224 [00:57<01:08,  1.78it/s]
Epoch 17 Iter 104: loss 0.15157. :  46%|███████████████████▊                       | 103/224 [00:57<01:08,  1.78it/s]
Epoch 17 Iter 104: loss 0.15157. :  46%|███████████████████▉                       | 104/224 [00:57<01:06,  1.80it/s]
Epoch 17 Iter 105: loss 0.14535. :  46%|███████████████████▉                       | 104/224 [00:58<01:06,  1.80it/s]
Epoch 17 Iter 105: loss 0.14535. :  47%|████████████████████▏                      | 105/224 [00:58<01:14,  1.61it/s]
Epoch 17 Iter 106: loss 0.18039. :  47%|████████████████████▏                      | 105/224 [00:59<01:14,  1.61it/s]
Epoch 17 Iter 106: loss 0.18039. :  47%|████████████████████▎                      | 106/224 [00:59<01:19,  1.49it/s]
Epoch 17 Iter 107: loss 0.17242. :  47%|████████████████████▎                      | 106/224 [00:59<01:19,  1.49it/s]
Epoch 17 Iter 107: loss 0.17242. :  48%|████████████████████▌                      | 107/224 [00:59<01:18,  1.48it/s]
Epoch 17 Iter 108: loss 0.18559. :  48%|████████████████████▌                      | 107/224 [01:00<01:18,  1.48it/s]
Epoch 17 Iter 108: loss 0.18559. :  48%|████████████████████▋                      | 108/224 [01:00<01:16,  1.51it/s]
Epoch 17 Iter 109: loss 0.16880. :  48%|████████████████████▋                      | 108/224 [01:01<01:16,  1.51it/s]
Epoch 17 Iter 109: loss 0.16880. :  49%|████████████████████▉                      | 109/224 [01:01<01:19,  1.44it/s]
Epoch 17 Iter 110: loss 0.15948. :  49%|████████████████████▉                      | 109/224 [01:02<01:19,  1.44it/s]
Epoch 17 Iter 110: loss 0.15948. :  49%|█████████████████████                      | 110/224 [01:02<01:22,  1.38it/s]
Epoch 17 Iter 111: loss 0.16629. :  49%|█████████████████████                      | 110/224 [01:02<01:22,  1.38it/s]
Epoch 17 Iter 111: loss 0.16629. :  50%|█████████████████████▎                     | 111/224 [01:02<01:23,  1.35it/s]
Epoch 17 Iter 112: loss 0.17267. :  50%|█████████████████████▎                     | 111/224 [01:03<01:23,  1.35it/s]
Epoch 17 Iter 112: loss 0.17267. :  50%|█████████████████████▌                     | 112/224 [01:03<01:24,  1.33it/s]
Epoch 17 Iter 113: loss 0.15865. :  50%|█████████████████████▌                     | 112/224 [01:04<01:24,  1.33it/s]
Epoch 17 Iter 113: loss 0.15865. :  50%|█████████████████████▋                     | 113/224 [01:04<01:24,  1.31it/s]
Epoch 17 Iter 114: loss 0.16183. :  50%|█████████████████████▋                     | 113/224 [01:04<01:24,  1.31it/s]
Epoch 17 Iter 114: loss 0.16183. :  51%|█████████████████████▉                     | 114/224 [01:04<01:16,  1.44it/s]
Epoch 17 Iter 115: loss 0.17242. :  51%|█████████████████████▉                     | 114/224 [01:05<01:16,  1.44it/s]
Epoch 17 Iter 115: loss 0.17242. :  51%|██████████████████████                     | 115/224 [01:05<01:18,  1.39it/s]
Epoch 17 Iter 116: loss 0.16946. :  51%|██████████████████████                     | 115/224 [01:06<01:18,  1.39it/s]
Epoch 17 Iter 116: loss 0.16946. :  52%|██████████████████████▎                    | 116/224 [01:06<01:13,  1.46it/s]
Epoch 17 Iter 117: loss 0.17368. :  52%|██████████████████████▎                    | 116/224 [01:07<01:13,  1.46it/s]
Epoch 17 Iter 117: loss 0.17368. :  52%|██████████████████████▍                    | 117/224 [01:07<01:16,  1.41it/s]
Epoch 17 Iter 118: loss 0.17132. :  52%|██████████████████████▍                    | 117/224 [01:07<01:16,  1.41it/s]
Epoch 17 Iter 118: loss 0.17132. :  53%|██████████████████████▋                    | 118/224 [01:07<01:14,  1.42it/s]
Epoch 17 Iter 119: loss 0.15837. :  53%|██████████████████████▋                    | 118/224 [01:08<01:14,  1.42it/s]
Epoch 17 Iter 119: loss 0.15837. :  53%|██████████████████████▊                    | 119/224 [01:08<01:09,  1.52it/s]
Epoch 17 Iter 120: loss 0.14923. :  53%|██████████████████████▊                    | 119/224 [01:08<01:09,  1.52it/s]
Epoch 17 Iter 120: loss 0.14923. :  54%|███████████████████████                    | 120/224 [01:08<01:04,  1.61it/s]
Epoch 17 Iter 121: loss 0.18834. :  54%|███████████████████████                    | 120/224 [01:09<01:04,  1.61it/s]
Epoch 17 Iter 121: loss 0.18834. :  54%|███████████████████████▏                   | 121/224 [01:09<01:01,  1.68it/s]
Epoch 17 Iter 122: loss 0.15138. :  54%|███████████████████████▏                   | 121/224 [01:09<01:01,  1.68it/s]
Epoch 17 Iter 122: loss 0.15138. :  54%|███████████████████████▍                   | 122/224 [01:09<00:59,  1.71it/s]
Epoch 17 Iter 123: loss 0.14556. :  54%|███████████████████████▍                   | 122/224 [01:10<00:59,  1.71it/s]
Epoch 17 Iter 123: loss 0.14556. :  55%|███████████████████████▌                   | 123/224 [01:10<00:59,  1.68it/s]
Epoch 17 Iter 124: loss 0.15269. :  55%|███████████████████████▌                   | 123/224 [01:11<00:59,  1.68it/s]
Epoch 17 Iter 124: loss 0.15269. :  55%|███████████████████████▊                   | 124/224 [01:11<01:00,  1.65it/s]
Epoch 17 Iter 125: loss 0.17354. :  55%|███████████████████████▊                   | 124/224 [01:11<01:00,  1.65it/s]
Epoch 17 Iter 125: loss 0.17354. :  56%|███████████████████████▉                   | 125/224 [01:11<00:57,  1.71it/s]
Epoch 17 Iter 126: loss 0.17453. :  56%|███████████████████████▉                   | 125/224 [01:12<00:57,  1.71it/s]
Epoch 17 Iter 126: loss 0.17453. :  56%|████████████████████████▏                  | 126/224 [01:12<00:55,  1.77it/s]
Epoch 17 Iter 127: loss 0.17643. :  56%|████████████████████████▏                  | 126/224 [01:12<00:55,  1.77it/s]
Epoch 17 Iter 127: loss 0.17643. :  57%|████████████████████████▍                  | 127/224 [01:12<00:53,  1.80it/s]
Epoch 17 Iter 128: loss 0.17532. :  57%|████████████████████████▍                  | 127/224 [01:13<00:53,  1.80it/s]
Epoch 17 Iter 128: loss 0.17532. :  57%|████████████████████████▌                  | 128/224 [01:13<00:52,  1.82it/s]
Epoch 17 Iter 129: loss 0.16807. :  57%|████████████████████████▌                  | 128/224 [01:13<00:52,  1.82it/s]
Epoch 17 Iter 129: loss 0.16807. :  58%|████████████████████████▊                  | 129/224 [01:13<00:52,  1.82it/s]
Epoch 17 Iter 130: loss 0.16279. :  58%|████████████████████████▊                  | 129/224 [01:14<00:52,  1.82it/s]
Epoch 17 Iter 130: loss 0.16279. :  58%|████████████████████████▉                  | 130/224 [01:14<00:51,  1.82it/s]
Epoch 17 Iter 131: loss 0.20267. :  58%|████████████████████████▉                  | 130/224 [01:14<00:51,  1.82it/s]
Epoch 17 Iter 131: loss 0.20267. :  58%|█████████████████████████▏                 | 131/224 [01:14<00:50,  1.84it/s]
Epoch 17 Iter 132: loss 0.15314. :  58%|█████████████████████████▏                 | 131/224 [01:15<00:50,  1.84it/s]
Epoch 17 Iter 132: loss 0.15314. :  59%|█████████████████████████▎                 | 132/224 [01:15<00:50,  1.82it/s]
Epoch 17 Iter 133: loss 0.18134. :  59%|█████████████████████████▎                 | 132/224 [01:16<00:50,  1.82it/s]
Epoch 17 Iter 133: loss 0.18134. :  59%|█████████████████████████▌                 | 133/224 [01:16<00:49,  1.84it/s]
Epoch 17 Iter 134: loss 0.15208. :  59%|█████████████████████████▌                 | 133/224 [01:16<00:49,  1.84it/s]
Epoch 17 Iter 134: loss 0.15208. :  60%|█████████████████████████▋                 | 134/224 [01:16<00:48,  1.84it/s]
Epoch 17 Iter 135: loss 0.16088. :  60%|█████████████████████████▋                 | 134/224 [01:17<00:48,  1.84it/s]
Epoch 17 Iter 135: loss 0.16088. :  60%|█████████████████████████▉                 | 135/224 [01:17<00:48,  1.84it/s]
Epoch 17 Iter 136: loss 0.16862. :  60%|█████████████████████████▉                 | 135/224 [01:17<00:48,  1.84it/s]
Epoch 17 Iter 136: loss 0.16862. :  61%|██████████████████████████                 | 136/224 [01:17<00:50,  1.74it/s]
Epoch 17 Iter 137: loss 0.17158. :  61%|██████████████████████████                 | 136/224 [01:18<00:50,  1.74it/s]
Epoch 17 Iter 137: loss 0.17158. :  61%|██████████████████████████▎                | 137/224 [01:18<00:48,  1.79it/s]
Epoch 17 Iter 138: loss 0.18894. :  61%|██████████████████████████▎                | 137/224 [01:18<00:48,  1.79it/s]
Epoch 17 Iter 138: loss 0.18894. :  62%|██████████████████████████▍                | 138/224 [01:18<00:48,  1.78it/s]
Epoch 17 Iter 139: loss 0.15758. :  62%|██████████████████████████▍                | 138/224 [01:19<00:48,  1.78it/s]
Epoch 17 Iter 139: loss 0.15758. :  62%|██████████████████████████▋                | 139/224 [01:19<00:48,  1.74it/s]
Epoch 17 Iter 140: loss 0.15704. :  62%|██████████████████████████▋                | 139/224 [01:20<00:48,  1.74it/s]
Epoch 17 Iter 140: loss 0.15704. :  62%|██████████████████████████▉                | 140/224 [01:20<00:53,  1.56it/s]
Epoch 17 Iter 141: loss 0.15509. :  62%|██████████████████████████▉                | 140/224 [01:20<00:53,  1.56it/s]
Epoch 17 Iter 141: loss 0.15509. :  63%|███████████████████████████                | 141/224 [01:20<00:50,  1.64it/s]
Epoch 17 Iter 142: loss 0.15840. :  63%|███████████████████████████                | 141/224 [01:21<00:50,  1.64it/s]
Epoch 17 Iter 142: loss 0.15840. :  63%|███████████████████████████▎               | 142/224 [01:21<00:48,  1.71it/s]
Epoch 17 Iter 143: loss 0.18934. :  63%|███████████████████████████▎               | 142/224 [01:21<00:48,  1.71it/s]
Epoch 17 Iter 143: loss 0.18934. :  64%|███████████████████████████▍               | 143/224 [01:21<00:48,  1.67it/s]
Epoch 17 Iter 144: loss 0.15268. :  64%|███████████████████████████▍               | 143/224 [01:22<00:48,  1.67it/s]
Epoch 17 Iter 144: loss 0.15268. :  64%|███████████████████████████▋               | 144/224 [01:22<00:51,  1.55it/s]
Epoch 17 Iter 145: loss 0.18345. :  64%|███████████████████████████▋               | 144/224 [01:23<00:51,  1.55it/s]
Epoch 17 Iter 145: loss 0.18345. :  65%|███████████████████████████▊               | 145/224 [01:23<00:54,  1.46it/s]
Epoch 17 Iter 146: loss 0.17037. :  65%|███████████████████████████▊               | 145/224 [01:24<00:54,  1.46it/s]
Epoch 17 Iter 146: loss 0.17037. :  65%|████████████████████████████               | 146/224 [01:24<00:51,  1.52it/s]
Epoch 17 Iter 147: loss 0.15050. :  65%|████████████████████████████               | 146/224 [01:24<00:51,  1.52it/s]
Epoch 17 Iter 147: loss 0.15050. :  66%|████████████████████████████▏              | 147/224 [01:24<00:53,  1.45it/s]
Epoch 17 Iter 148: loss 0.17044. :  66%|████████████████████████████▏              | 147/224 [01:25<00:53,  1.45it/s]
Epoch 17 Iter 148: loss 0.17044. :  66%|████████████████████████████▍              | 148/224 [01:25<00:51,  1.47it/s]
Epoch 17 Iter 149: loss 0.18687. :  66%|████████████████████████████▍              | 148/224 [01:26<00:51,  1.47it/s]
Epoch 17 Iter 149: loss 0.18687. :  67%|████████████████████████████▌              | 149/224 [01:26<00:49,  1.52it/s]
Epoch 17 Iter 150: loss 0.17590. :  67%|████████████████████████████▌              | 149/224 [01:26<00:49,  1.52it/s]
Epoch 17 Iter 150: loss 0.17590. :  67%|████████████████████████████▊              | 150/224 [01:26<00:46,  1.60it/s]
Epoch 17 Iter 151: loss 0.15685. :  67%|████████████████████████████▊              | 150/224 [01:27<00:46,  1.60it/s]
Epoch 17 Iter 151: loss 0.15685. :  67%|████████████████████████████▉              | 151/224 [01:27<00:45,  1.61it/s]
Epoch 17 Iter 152: loss 0.19037. :  67%|████████████████████████████▉              | 151/224 [01:27<00:45,  1.61it/s]
Epoch 17 Iter 152: loss 0.19037. :  68%|█████████████████████████████▏             | 152/224 [01:27<00:46,  1.54it/s]
Epoch 17 Iter 153: loss 0.15044. :  68%|█████████████████████████████▏             | 152/224 [01:28<00:46,  1.54it/s]
Epoch 17 Iter 153: loss 0.15044. :  68%|█████████████████████████████▎             | 153/224 [01:28<00:45,  1.57it/s]
Epoch 17 Iter 154: loss 0.17194. :  68%|█████████████████████████████▎             | 153/224 [01:29<00:45,  1.57it/s]
Epoch 17 Iter 154: loss 0.17194. :  69%|█████████████████████████████▌             | 154/224 [01:29<00:43,  1.62it/s]
Epoch 17 Iter 155: loss 0.17804. :  69%|█████████████████████████████▌             | 154/224 [01:29<00:43,  1.62it/s]
Epoch 17 Iter 155: loss 0.17804. :  69%|█████████████████████████████▊             | 155/224 [01:29<00:41,  1.67it/s]
Epoch 17 Iter 156: loss 0.17264. :  69%|█████████████████████████████▊             | 155/224 [01:30<00:41,  1.67it/s]
Epoch 17 Iter 156: loss 0.17264. :  70%|█████████████████████████████▉             | 156/224 [01:30<00:40,  1.68it/s]
Epoch 17 Iter 157: loss 0.15891. :  70%|█████████████████████████████▉             | 156/224 [01:30<00:40,  1.68it/s]
Epoch 17 Iter 157: loss 0.15891. :  70%|██████████████████████████████▏            | 157/224 [01:30<00:38,  1.73it/s]
Epoch 17 Iter 158: loss 0.16504. :  70%|██████████████████████████████▏            | 157/224 [01:31<00:38,  1.73it/s]
Epoch 17 Iter 158: loss 0.16504. :  71%|██████████████████████████████▎            | 158/224 [01:31<00:37,  1.74it/s]
Epoch 17 Iter 159: loss 0.19771. :  71%|██████████████████████████████▎            | 158/224 [01:31<00:37,  1.74it/s]
Epoch 17 Iter 159: loss 0.19771. :  71%|██████████████████████████████▌            | 159/224 [01:31<00:36,  1.77it/s]
Epoch 17 Iter 160: loss 0.17143. :  71%|██████████████████████████████▌            | 159/224 [01:32<00:36,  1.77it/s]
Epoch 17 Iter 160: loss 0.17143. :  71%|██████████████████████████████▋            | 160/224 [01:32<00:36,  1.77it/s]
Epoch 17 Iter 161: loss 0.15737. :  71%|██████████████████████████████▋            | 160/224 [01:33<00:36,  1.77it/s]
Epoch 17 Iter 161: loss 0.15737. :  72%|██████████████████████████████▉            | 161/224 [01:33<00:37,  1.67it/s]
Epoch 17 Iter 162: loss 0.16440. :  72%|██████████████████████████████▉            | 161/224 [01:33<00:37,  1.67it/s]
Epoch 17 Iter 162: loss 0.16440. :  72%|███████████████████████████████            | 162/224 [01:33<00:37,  1.67it/s]
Epoch 17 Iter 163: loss 0.19169. :  72%|███████████████████████████████            | 162/224 [01:34<00:37,  1.67it/s]
Epoch 17 Iter 163: loss 0.19169. :  73%|███████████████████████████████▎           | 163/224 [01:34<00:36,  1.69it/s]
Epoch 17 Iter 164: loss 0.19110. :  73%|███████████████████████████████▎           | 163/224 [01:34<00:36,  1.69it/s]
Epoch 17 Iter 164: loss 0.19110. :  73%|███████████████████████████████▍           | 164/224 [01:34<00:34,  1.72it/s]
Epoch 17 Iter 165: loss 0.17634. :  73%|███████████████████████████████▍           | 164/224 [01:35<00:34,  1.72it/s]
Epoch 17 Iter 165: loss 0.17634. :  74%|███████████████████████████████▋           | 165/224 [01:35<00:35,  1.64it/s]
Epoch 17 Iter 166: loss 0.16426. :  74%|███████████████████████████████▋           | 165/224 [01:36<00:35,  1.64it/s]
Epoch 17 Iter 166: loss 0.16426. :  74%|███████████████████████████████▊           | 166/224 [01:36<00:38,  1.51it/s]
Epoch 17 Iter 167: loss 0.18331. :  74%|███████████████████████████████▊           | 166/224 [01:37<00:38,  1.51it/s]
Epoch 17 Iter 167: loss 0.18331. :  75%|████████████████████████████████           | 167/224 [01:37<00:41,  1.38it/s]
Epoch 17 Iter 168: loss 0.15156. :  75%|████████████████████████████████           | 167/224 [01:37<00:41,  1.38it/s]
Epoch 17 Iter 168: loss 0.15156. :  75%|████████████████████████████████▎          | 168/224 [01:37<00:39,  1.43it/s]
Epoch 17 Iter 169: loss 0.20171. :  75%|████████████████████████████████▎          | 168/224 [01:38<00:39,  1.43it/s]
Epoch 17 Iter 169: loss 0.20171. :  75%|████████████████████████████████▍          | 169/224 [01:38<00:36,  1.50it/s]
Epoch 17 Iter 170: loss 0.14924. :  75%|████████████████████████████████▍          | 169/224 [01:39<00:36,  1.50it/s]
Epoch 17 Iter 170: loss 0.14924. :  76%|████████████████████████████████▋          | 170/224 [01:39<00:37,  1.43it/s]
Epoch 17 Iter 171: loss 0.16433. :  76%|████████████████████████████████▋          | 170/224 [01:40<00:37,  1.43it/s]
Epoch 17 Iter 171: loss 0.16433. :  76%|████████████████████████████████▊          | 171/224 [01:40<00:38,  1.39it/s]
Epoch 17 Iter 172: loss 0.18125. :  76%|████████████████████████████████▊          | 171/224 [01:40<00:38,  1.39it/s]
Epoch 17 Iter 172: loss 0.18125. :  77%|█████████████████████████████████          | 172/224 [01:40<00:38,  1.36it/s]
Epoch 17 Iter 173: loss 0.17940. :  77%|█████████████████████████████████          | 172/224 [01:41<00:38,  1.36it/s]
Epoch 17 Iter 173: loss 0.17940. :  77%|█████████████████████████████████▏         | 173/224 [01:41<00:34,  1.46it/s]
Epoch 17 Iter 174: loss 0.18998. :  77%|█████████████████████████████████▏         | 173/224 [01:41<00:34,  1.46it/s]
Epoch 17 Iter 174: loss 0.18998. :  78%|█████████████████████████████████▍         | 174/224 [01:41<00:32,  1.56it/s]
Epoch 17 Iter 175: loss 0.18905. :  78%|█████████████████████████████████▍         | 174/224 [01:42<00:32,  1.56it/s]
Epoch 17 Iter 175: loss 0.18905. :  78%|█████████████████████████████████▌         | 175/224 [01:42<00:29,  1.64it/s]
Epoch 17 Iter 176: loss 0.17138. :  78%|█████████████████████████████████▌         | 175/224 [01:43<00:29,  1.64it/s]
Epoch 17 Iter 176: loss 0.17138. :  79%|█████████████████████████████████▊         | 176/224 [01:43<00:29,  1.64it/s]
Epoch 17 Iter 177: loss 0.17757. :  79%|█████████████████████████████████▊         | 176/224 [01:43<00:29,  1.64it/s]
Epoch 17 Iter 177: loss 0.17757. :  79%|█████████████████████████████████▉         | 177/224 [01:43<00:28,  1.68it/s]
Epoch 17 Iter 178: loss 0.17407. :  79%|█████████████████████████████████▉         | 177/224 [01:44<00:28,  1.68it/s]
Epoch 17 Iter 178: loss 0.17407. :  79%|██████████████████████████████████▏        | 178/224 [01:44<00:29,  1.56it/s]
Epoch 17 Iter 179: loss 0.15955. :  79%|██████████████████████████████████▏        | 178/224 [01:45<00:29,  1.56it/s]
Epoch 17 Iter 179: loss 0.15955. :  80%|██████████████████████████████████▎        | 179/224 [01:45<00:30,  1.48it/s]
Epoch 17 Iter 180: loss 0.17038. :  80%|██████████████████████████████████▎        | 179/224 [01:45<00:30,  1.48it/s]
Epoch 17 Iter 180: loss 0.17038. :  80%|██████████████████████████████████▌        | 180/224 [01:45<00:28,  1.52it/s]
Epoch 17 Iter 181: loss 0.15240. :  80%|██████████████████████████████████▌        | 180/224 [01:46<00:28,  1.52it/s]
Epoch 17 Iter 181: loss 0.15240. :  81%|██████████████████████████████████▋        | 181/224 [01:46<00:29,  1.44it/s]
Epoch 17 Iter 182: loss 0.16804. :  81%|██████████████████████████████████▋        | 181/224 [01:47<00:29,  1.44it/s]
Epoch 17 Iter 182: loss 0.16804. :  81%|██████████████████████████████████▉        | 182/224 [01:47<00:30,  1.39it/s]
Epoch 17 Iter 183: loss 0.15123. :  81%|██████████████████████████████████▉        | 182/224 [01:48<00:30,  1.39it/s]
Epoch 17 Iter 183: loss 0.15123. :  82%|███████████████████████████████████▏       | 183/224 [01:48<00:29,  1.38it/s]
Epoch 17 Iter 184: loss 0.15341. :  82%|███████████████████████████████████▏       | 183/224 [01:48<00:29,  1.38it/s]
Epoch 17 Iter 184: loss 0.15341. :  82%|███████████████████████████████████▎       | 184/224 [01:48<00:26,  1.48it/s]
Epoch 17 Iter 185: loss 0.17118. :  82%|███████████████████████████████████▎       | 184/224 [01:49<00:26,  1.48it/s]
Epoch 17 Iter 185: loss 0.17118. :  83%|███████████████████████████████████▌       | 185/224 [01:49<00:25,  1.55it/s]
Epoch 17 Iter 186: loss 0.16765. :  83%|███████████████████████████████████▌       | 185/224 [01:49<00:25,  1.55it/s]
Epoch 17 Iter 186: loss 0.16765. :  83%|███████████████████████████████████▋       | 186/224 [01:49<00:23,  1.63it/s]
Epoch 17 Iter 187: loss 0.17758. :  83%|███████████████████████████████████▋       | 186/224 [01:50<00:23,  1.63it/s]
Epoch 17 Iter 187: loss 0.17758. :  83%|███████████████████████████████████▉       | 187/224 [01:50<00:23,  1.59it/s]
Epoch 17 Iter 188: loss 0.15348. :  83%|███████████████████████████████████▉       | 187/224 [01:51<00:23,  1.59it/s]
Epoch 17 Iter 188: loss 0.15348. :  84%|████████████████████████████████████       | 188/224 [01:51<00:24,  1.47it/s]
Epoch 17 Iter 189: loss 0.16731. :  84%|████████████████████████████████████       | 188/224 [01:51<00:24,  1.47it/s]
Epoch 17 Iter 189: loss 0.16731. :  84%|████████████████████████████████████▎      | 189/224 [01:51<00:23,  1.51it/s]
Epoch 17 Iter 190: loss 0.16415. :  84%|████████████████████████████████████▎      | 189/224 [01:52<00:23,  1.51it/s]
Epoch 17 Iter 190: loss 0.16415. :  85%|████████████████████████████████████▍      | 190/224 [01:52<00:21,  1.59it/s]
Epoch 17 Iter 191: loss 0.16698. :  85%|████████████████████████████████████▍      | 190/224 [01:52<00:21,  1.59it/s]
Epoch 17 Iter 191: loss 0.16698. :  85%|████████████████████████████████████▋      | 191/224 [01:52<00:20,  1.65it/s]
Epoch 17 Iter 192: loss 0.15592. :  85%|████████████████████████████████████▋      | 191/224 [01:53<00:20,  1.65it/s]
Epoch 17 Iter 192: loss 0.15592. :  86%|████████████████████████████████████▊      | 192/224 [01:53<00:18,  1.71it/s]
Epoch 17 Iter 193: loss 0.16051. :  86%|████████████████████████████████████▊      | 192/224 [01:53<00:18,  1.71it/s]
Epoch 17 Iter 193: loss 0.16051. :  86%|█████████████████████████████████████      | 193/224 [01:53<00:17,  1.76it/s]
Epoch 17 Iter 194: loss 0.15435. :  86%|█████████████████████████████████████      | 193/224 [01:54<00:17,  1.76it/s]
Epoch 17 Iter 194: loss 0.15435. :  87%|█████████████████████████████████████▏     | 194/224 [01:54<00:16,  1.79it/s]
Epoch 17 Iter 195: loss 0.17792. :  87%|█████████████████████████████████████▏     | 194/224 [01:55<00:16,  1.79it/s]
Epoch 17 Iter 195: loss 0.17792. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:16,  1.81it/s]
Epoch 17 Iter 196: loss 0.17554. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:16,  1.81it/s]
Epoch 17 Iter 196: loss 0.17554. :  88%|█████████████████████████████████████▋     | 196/224 [01:55<00:16,  1.69it/s]
Epoch 17 Iter 197: loss 0.16947. :  88%|█████████████████████████████████████▋     | 196/224 [01:56<00:16,  1.69it/s]
Epoch 17 Iter 197: loss 0.16947. :  88%|█████████████████████████████████████▊     | 197/224 [01:56<00:15,  1.72it/s]
Epoch 17 Iter 198: loss 0.14102. :  88%|█████████████████████████████████████▊     | 197/224 [01:56<00:15,  1.72it/s]
Epoch 17 Iter 198: loss 0.14102. :  88%|██████████████████████████████████████     | 198/224 [01:56<00:14,  1.75it/s]
Epoch 17 Iter 199: loss 0.13987. :  88%|██████████████████████████████████████     | 198/224 [01:57<00:14,  1.75it/s]
Epoch 17 Iter 199: loss 0.13987. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:14,  1.78it/s]
Epoch 17 Iter 200: loss 0.18540. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:14,  1.78it/s]
Epoch 17 Iter 200: loss 0.18540. :  89%|██████████████████████████████████████▍    | 200/224 [01:57<00:13,  1.79it/s]
Epoch 17 Iter 201: loss 0.16050. :  89%|██████████████████████████████████████▍    | 200/224 [01:58<00:13,  1.79it/s]
Epoch 17 Iter 201: loss 0.16050. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:12,  1.83it/s]
Epoch 17 Iter 202: loss 0.16503. :  90%|██████████████████████████████████████▌    | 201/224 [01:59<00:12,  1.83it/s]
Epoch 17 Iter 202: loss 0.16503. :  90%|██████████████████████████████████████▊    | 202/224 [01:59<00:13,  1.63it/s]
Epoch 17 Iter 203: loss 0.16259. :  90%|██████████████████████████████████████▊    | 202/224 [02:00<00:13,  1.63it/s]
Epoch 17 Iter 203: loss 0.16259. :  91%|██████████████████████████████████████▉    | 203/224 [02:00<00:14,  1.49it/s]
Epoch 17 Iter 204: loss 0.18074. :  91%|██████████████████████████████████████▉    | 203/224 [02:00<00:14,  1.49it/s]
Epoch 17 Iter 204: loss 0.18074. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:12,  1.59it/s]
Epoch 17 Iter 205: loss 0.16727. :  91%|███████████████████████████████████████▏   | 204/224 [02:01<00:12,  1.59it/s]
Epoch 17 Iter 205: loss 0.16727. :  92%|███████████████████████████████████████▎   | 205/224 [02:01<00:12,  1.52it/s]
Epoch 17 Iter 206: loss 0.17102. :  92%|███████████████████████████████████████▎   | 205/224 [02:01<00:12,  1.52it/s]
Epoch 17 Iter 206: loss 0.17102. :  92%|███████████████████████████████████████▌   | 206/224 [02:01<00:11,  1.56it/s]
Epoch 17 Iter 207: loss 0.17431. :  92%|███████████████████████████████████████▌   | 206/224 [02:02<00:11,  1.56it/s]
Epoch 17 Iter 207: loss 0.17431. :  92%|███████████████████████████████████████▋   | 207/224 [02:02<00:10,  1.64it/s]
Epoch 17 Iter 208: loss 0.17455. :  92%|███████████████████████████████████████▋   | 207/224 [02:03<00:10,  1.64it/s]
Epoch 17 Iter 208: loss 0.17455. :  93%|███████████████████████████████████████▉   | 208/224 [02:03<00:10,  1.58it/s]
Epoch 17 Iter 209: loss 0.18987. :  93%|███████████████████████████████████████▉   | 208/224 [02:03<00:10,  1.58it/s]
Epoch 17 Iter 209: loss 0.18987. :  93%|████████████████████████████████████████   | 209/224 [02:03<00:09,  1.53it/s]
Epoch 17 Iter 210: loss 0.16735. :  93%|████████████████████████████████████████   | 209/224 [02:04<00:09,  1.53it/s]
Epoch 17 Iter 210: loss 0.16735. :  94%|████████████████████████████████████████▎  | 210/224 [02:04<00:08,  1.59it/s]
Epoch 17 Iter 211: loss 0.17656. :  94%|████████████████████████████████████████▎  | 210/224 [02:04<00:08,  1.59it/s]
Epoch 17 Iter 211: loss 0.17656. :  94%|████████████████████████████████████████▌  | 211/224 [02:04<00:08,  1.62it/s]
Epoch 17 Iter 212: loss 0.15151. :  94%|████████████████████████████████████████▌  | 211/224 [02:05<00:08,  1.62it/s]
Epoch 17 Iter 212: loss 0.15151. :  95%|████████████████████████████████████████▋  | 212/224 [02:05<00:07,  1.68it/s]
Epoch 17 Iter 213: loss 0.15496. :  95%|████████████████████████████████████████▋  | 212/224 [02:06<00:07,  1.68it/s]
Epoch 17 Iter 213: loss 0.15496. :  95%|████████████████████████████████████████▉  | 213/224 [02:06<00:07,  1.57it/s]
Epoch 17 Iter 214: loss 0.15462. :  95%|████████████████████████████████████████▉  | 213/224 [02:06<00:07,  1.57it/s]
Epoch 17 Iter 214: loss 0.15462. :  96%|█████████████████████████████████████████  | 214/224 [02:06<00:06,  1.62it/s]
Epoch 17 Iter 215: loss 0.17512. :  96%|█████████████████████████████████████████  | 214/224 [02:07<00:06,  1.62it/s]
Epoch 17 Iter 215: loss 0.17512. :  96%|█████████████████████████████████████████▎ | 215/224 [02:07<00:05,  1.52it/s]
Epoch 17 Iter 216: loss 0.17628. :  96%|█████████████████████████████████████████▎ | 215/224 [02:08<00:05,  1.52it/s]
Epoch 17 Iter 216: loss 0.17628. :  96%|█████████████████████████████████████████▍ | 216/224 [02:08<00:05,  1.49it/s]
Epoch 17 Iter 217: loss 0.16757. :  96%|█████████████████████████████████████████▍ | 216/224 [02:09<00:05,  1.49it/s]
Epoch 17 Iter 217: loss 0.16757. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:04,  1.43it/s]
Epoch 17 Iter 218: loss 0.14634. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:04,  1.43it/s]
Epoch 17 Iter 218: loss 0.14634. :  97%|█████████████████████████████████████████▊ | 218/224 [02:09<00:04,  1.39it/s]
Epoch 17 Iter 219: loss 0.17818. :  97%|█████████████████████████████████████████▊ | 218/224 [02:10<00:04,  1.39it/s]
Epoch 17 Iter 219: loss 0.17818. :  98%|██████████████████████████████████████████ | 219/224 [02:10<00:03,  1.37it/s]
Epoch 17 Iter 220: loss 0.17623. :  98%|██████████████████████████████████████████ | 219/224 [02:11<00:03,  1.37it/s]
Epoch 17 Iter 220: loss 0.17623. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.49it/s]
Epoch 17 Iter 221: loss 0.15670. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.49it/s]
Epoch 17 Iter 221: loss 0.15670. :  99%|██████████████████████████████████████████▍| 221/224 [02:11<00:01,  1.57it/s]
Epoch 17 Iter 222: loss 0.16365. :  99%|██████████████████████████████████████████▍| 221/224 [02:12<00:01,  1.57it/s]
Epoch 17 Iter 222: loss 0.16365. :  99%|██████████████████████████████████████████▌| 222/224 [02:12<00:01,  1.49it/s]
Epoch 17 Iter 223: loss 0.16078. :  99%|██████████████████████████████████████████▌| 222/224 [02:13<00:01,  1.49it/s]
Epoch 17 Iter 223: loss 0.16078. : 100%|██████████████████████████████████████████▊| 223/224 [02:13<00:00,  1.46it/s]
Epoch 17 Iter 224: loss 0.15511. : 100%|██████████████████████████████████████████▊| 223/224 [02:13<00:00,  1.46it/s]
Epoch 17 Iter 224: loss 0.15511. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.56it/s]
Epoch 17 Iter 224: loss 0.15511. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.68it/s]

    Train loss: 0.16809
    Valid loss: 0.17159
       Valid loss recons: 0.17159
       Valid loss KL-D:   35487.60707
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.15484. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.15484. :   0%|▏                                              | 1/224 [00:00<02:03,  1.80it/s]
Epoch 18 Iter 2: loss 0.17432. :   0%|▏                                              | 1/224 [00:01<02:03,  1.80it/s]
Epoch 18 Iter 2: loss 0.17432. :   1%|▍                                              | 2/224 [00:01<02:31,  1.47it/s]
Epoch 18 Iter 3: loss 0.19116. :   1%|▍                                              | 2/224 [00:02<02:31,  1.47it/s]
Epoch 18 Iter 3: loss 0.19116. :   1%|▋                                              | 3/224 [00:02<02:41,  1.37it/s]
Epoch 18 Iter 4: loss 0.15706. :   1%|▋                                              | 3/224 [00:02<02:41,  1.37it/s]
Epoch 18 Iter 4: loss 0.15706. :   2%|▊                                              | 4/224 [00:02<02:44,  1.34it/s]
Epoch 18 Iter 5: loss 0.17427. :   2%|▊                                              | 4/224 [00:03<02:44,  1.34it/s]
Epoch 18 Iter 5: loss 0.17427. :   2%|█                                              | 5/224 [00:03<02:44,  1.33it/s]
Epoch 18 Iter 6: loss 0.17552. :   2%|█                                              | 5/224 [00:04<02:44,  1.33it/s]
Epoch 18 Iter 6: loss 0.17552. :   3%|█▎                                             | 6/224 [00:04<02:31,  1.44it/s]
Epoch 18 Iter 7: loss 0.16108. :   3%|█▎                                             | 6/224 [00:04<02:31,  1.44it/s]
Epoch 18 Iter 7: loss 0.16108. :   3%|█▍                                             | 7/224 [00:04<02:20,  1.54it/s]
Epoch 18 Iter 8: loss 0.17240. :   3%|█▍                                             | 7/224 [00:05<02:20,  1.54it/s]
Epoch 18 Iter 8: loss 0.17240. :   4%|█▋                                             | 8/224 [00:05<02:14,  1.61it/s]
Epoch 18 Iter 9: loss 0.16970. :   4%|█▋                                             | 8/224 [00:05<02:14,  1.61it/s]
Epoch 18 Iter 9: loss 0.16970. :   4%|█▉                                             | 9/224 [00:05<02:06,  1.70it/s]
Epoch 18 Iter 10: loss 0.15499. :   4%|█▊                                            | 9/224 [00:06<02:06,  1.70it/s]
Epoch 18 Iter 10: loss 0.15499. :   4%|██                                           | 10/224 [00:06<01:58,  1.80it/s]
Epoch 18 Iter 11: loss 0.16981. :   4%|██                                           | 10/224 [00:06<01:58,  1.80it/s]
Epoch 18 Iter 11: loss 0.16981. :   5%|██▏                                          | 11/224 [00:06<01:53,  1.87it/s]
Epoch 18 Iter 12: loss 0.17874. :   5%|██▏                                          | 11/224 [00:07<01:53,  1.87it/s]
Epoch 18 Iter 12: loss 0.17874. :   5%|██▍                                          | 12/224 [00:07<01:50,  1.91it/s]
Epoch 18 Iter 13: loss 0.16590. :   5%|██▍                                          | 12/224 [00:07<01:50,  1.91it/s]
Epoch 18 Iter 13: loss 0.16590. :   6%|██▌                                          | 13/224 [00:07<01:48,  1.94it/s]
Epoch 18 Iter 14: loss 0.15880. :   6%|██▌                                          | 13/224 [00:08<01:48,  1.94it/s]
Epoch 18 Iter 14: loss 0.15880. :   6%|██▊                                          | 14/224 [00:08<01:47,  1.95it/s]
Epoch 18 Iter 15: loss 0.17981. :   6%|██▊                                          | 14/224 [00:08<01:47,  1.95it/s]
Epoch 18 Iter 15: loss 0.17981. :   7%|███                                          | 15/224 [00:08<01:51,  1.88it/s]
Epoch 18 Iter 16: loss 0.19594. :   7%|███                                          | 15/224 [00:09<01:51,  1.88it/s]
Epoch 18 Iter 16: loss 0.19594. :   7%|███▏                                         | 16/224 [00:09<01:49,  1.90it/s]
Epoch 18 Iter 17: loss 0.16929. :   7%|███▏                                         | 16/224 [00:09<01:49,  1.90it/s]
Epoch 18 Iter 17: loss 0.16929. :   8%|███▍                                         | 17/224 [00:09<01:47,  1.92it/s]
Epoch 18 Iter 18: loss 0.16864. :   8%|███▍                                         | 17/224 [00:10<01:47,  1.92it/s]
Epoch 18 Iter 18: loss 0.16864. :   8%|███▌                                         | 18/224 [00:10<01:45,  1.94it/s]
Epoch 18 Iter 19: loss 0.16472. :   8%|███▌                                         | 18/224 [00:10<01:45,  1.94it/s]
Epoch 18 Iter 19: loss 0.16472. :   8%|███▊                                         | 19/224 [00:10<01:44,  1.96it/s]
Epoch 18 Iter 20: loss 0.18143. :   8%|███▊                                         | 19/224 [00:11<01:44,  1.96it/s]
Epoch 18 Iter 20: loss 0.18143. :   9%|████                                         | 20/224 [00:11<01:48,  1.88it/s]
Epoch 18 Iter 21: loss 0.15103. :   9%|████                                         | 20/224 [00:12<01:48,  1.88it/s]
Epoch 18 Iter 21: loss 0.15103. :   9%|████▏                                        | 21/224 [00:12<01:46,  1.91it/s]
Epoch 18 Iter 22: loss 0.14675. :   9%|████▏                                        | 21/224 [00:12<01:46,  1.91it/s]
Epoch 18 Iter 22: loss 0.14675. :  10%|████▍                                        | 22/224 [00:12<01:45,  1.91it/s]
Epoch 18 Iter 23: loss 0.16256. :  10%|████▍                                        | 22/224 [00:13<01:45,  1.91it/s]
Epoch 18 Iter 23: loss 0.16256. :  10%|████▌                                        | 23/224 [00:13<01:44,  1.93it/s]
Epoch 18 Iter 24: loss 0.17369. :  10%|████▌                                        | 23/224 [00:13<01:44,  1.93it/s]
Epoch 18 Iter 24: loss 0.17369. :  11%|████▊                                        | 24/224 [00:13<01:43,  1.94it/s]
Epoch 18 Iter 25: loss 0.16159. :  11%|████▊                                        | 24/224 [00:14<01:43,  1.94it/s]
Epoch 18 Iter 25: loss 0.16159. :  11%|█████                                        | 25/224 [00:14<01:41,  1.96it/s]
Epoch 18 Iter 26: loss 0.16047. :  11%|█████                                        | 25/224 [00:14<01:41,  1.96it/s]
Epoch 18 Iter 26: loss 0.16047. :  12%|█████▏                                       | 26/224 [00:14<01:41,  1.96it/s]
Epoch 18 Iter 27: loss 0.18050. :  12%|█████▏                                       | 26/224 [00:15<01:41,  1.96it/s]
Epoch 18 Iter 27: loss 0.18050. :  12%|█████▍                                       | 27/224 [00:15<01:39,  1.97it/s]
Epoch 18 Iter 28: loss 0.18870. :  12%|█████▍                                       | 27/224 [00:15<01:39,  1.97it/s]
Epoch 18 Iter 28: loss 0.18870. :  12%|█████▋                                       | 28/224 [00:15<01:39,  1.97it/s]
Epoch 18 Iter 29: loss 0.15260. :  12%|█████▋                                       | 28/224 [00:16<01:39,  1.97it/s]
Epoch 18 Iter 29: loss 0.15260. :  13%|█████▊                                       | 29/224 [00:16<01:42,  1.91it/s]
Epoch 18 Iter 30: loss 0.15553. :  13%|█████▊                                       | 29/224 [00:16<01:42,  1.91it/s]
Epoch 18 Iter 30: loss 0.15553. :  13%|██████                                       | 30/224 [00:16<01:41,  1.91it/s]
Epoch 18 Iter 31: loss 0.16374. :  13%|██████                                       | 30/224 [00:17<01:41,  1.91it/s]
Epoch 18 Iter 31: loss 0.16374. :  14%|██████▏                                      | 31/224 [00:17<01:39,  1.94it/s]
Epoch 18 Iter 32: loss 0.18404. :  14%|██████▏                                      | 31/224 [00:17<01:39,  1.94it/s]
Epoch 18 Iter 32: loss 0.18404. :  14%|██████▍                                      | 32/224 [00:17<01:37,  1.96it/s]
Epoch 18 Iter 33: loss 0.16262. :  14%|██████▍                                      | 32/224 [00:18<01:37,  1.96it/s]
Epoch 18 Iter 33: loss 0.16262. :  15%|██████▋                                      | 33/224 [00:18<01:36,  1.98it/s]
Epoch 18 Iter 34: loss 0.14752. :  15%|██████▋                                      | 33/224 [00:18<01:36,  1.98it/s]
Epoch 18 Iter 34: loss 0.14752. :  15%|██████▊                                      | 34/224 [00:18<01:36,  1.98it/s]
Epoch 18 Iter 35: loss 0.14792. :  15%|██████▊                                      | 34/224 [00:19<01:36,  1.98it/s]
Epoch 18 Iter 35: loss 0.14792. :  16%|███████                                      | 35/224 [00:19<01:37,  1.93it/s]
Epoch 18 Iter 36: loss 0.15933. :  16%|███████                                      | 35/224 [00:20<01:37,  1.93it/s]
Epoch 18 Iter 36: loss 0.15933. :  16%|███████▏                                     | 36/224 [00:20<02:10,  1.44it/s]
Epoch 18 Iter 37: loss 0.16793. :  16%|███████▏                                     | 36/224 [00:20<02:10,  1.44it/s]
Epoch 18 Iter 37: loss 0.16793. :  17%|███████▍                                     | 37/224 [00:20<02:00,  1.56it/s]
Epoch 18 Iter 38: loss 0.17880. :  17%|███████▍                                     | 37/224 [00:21<02:00,  1.56it/s]
Epoch 18 Iter 38: loss 0.17880. :  17%|███████▋                                     | 38/224 [00:21<01:51,  1.67it/s]
Epoch 18 Iter 39: loss 0.15663. :  17%|███████▋                                     | 38/224 [00:21<01:51,  1.67it/s]
Epoch 18 Iter 39: loss 0.15663. :  17%|███████▊                                     | 39/224 [00:21<01:44,  1.76it/s]
Epoch 18 Iter 40: loss 0.15476. :  17%|███████▊                                     | 39/224 [00:22<01:44,  1.76it/s]
Epoch 18 Iter 40: loss 0.15476. :  18%|████████                                     | 40/224 [00:22<01:40,  1.84it/s]
Epoch 18 Iter 41: loss 0.17896. :  18%|████████                                     | 40/224 [00:22<01:40,  1.84it/s]
Epoch 18 Iter 41: loss 0.17896. :  18%|████████▏                                    | 41/224 [00:22<01:36,  1.89it/s]
Epoch 18 Iter 42: loss 0.15531. :  18%|████████▏                                    | 41/224 [00:23<01:36,  1.89it/s]
Epoch 18 Iter 42: loss 0.15531. :  19%|████████▍                                    | 42/224 [00:23<01:34,  1.93it/s]
Epoch 18 Iter 43: loss 0.15583. :  19%|████████▍                                    | 42/224 [00:23<01:34,  1.93it/s]
Epoch 18 Iter 43: loss 0.15583. :  19%|████████▋                                    | 43/224 [00:23<01:32,  1.96it/s]
Epoch 18 Iter 44: loss 0.18615. :  19%|████████▋                                    | 43/224 [00:24<01:32,  1.96it/s]
Epoch 18 Iter 44: loss 0.18615. :  20%|████████▊                                    | 44/224 [00:24<01:32,  1.95it/s]
Epoch 18 Iter 45: loss 0.15780. :  20%|████████▊                                    | 44/224 [00:24<01:32,  1.95it/s]
Epoch 18 Iter 45: loss 0.15780. :  20%|█████████                                    | 45/224 [00:24<01:31,  1.96it/s]
Epoch 18 Iter 46: loss 0.15053. :  20%|█████████                                    | 45/224 [00:25<01:31,  1.96it/s]
Epoch 18 Iter 46: loss 0.15053. :  21%|█████████▏                                   | 46/224 [00:25<01:30,  1.97it/s]
Epoch 18 Iter 47: loss 0.16815. :  21%|█████████▏                                   | 46/224 [00:25<01:30,  1.97it/s]
Epoch 18 Iter 47: loss 0.16815. :  21%|█████████▍                                   | 47/224 [00:25<01:28,  1.99it/s]
Epoch 18 Iter 48: loss 0.19332. :  21%|█████████▍                                   | 47/224 [00:26<01:28,  1.99it/s]
Epoch 18 Iter 48: loss 0.19332. :  21%|█████████▋                                   | 48/224 [00:26<01:28,  2.00it/s]
Epoch 18 Iter 49: loss 0.18423. :  21%|█████████▋                                   | 48/224 [00:26<01:28,  2.00it/s]
Epoch 18 Iter 49: loss 0.18423. :  22%|█████████▊                                   | 49/224 [00:26<01:27,  2.00it/s]
Epoch 18 Iter 50: loss 0.16924. :  22%|█████████▊                                   | 49/224 [00:27<01:27,  2.00it/s]
Epoch 18 Iter 50: loss 0.16924. :  22%|██████████                                   | 50/224 [00:27<01:26,  2.01it/s]
Epoch 18 Iter 51: loss 0.15644. :  22%|██████████                                   | 50/224 [00:27<01:26,  2.01it/s]
Epoch 18 Iter 51: loss 0.15644. :  23%|██████████▏                                  | 51/224 [00:27<01:29,  1.94it/s]
Epoch 18 Iter 52: loss 0.16574. :  23%|██████████▏                                  | 51/224 [00:28<01:29,  1.94it/s]
Epoch 18 Iter 52: loss 0.16574. :  23%|██████████▍                                  | 52/224 [00:28<01:27,  1.97it/s]
Epoch 18 Iter 53: loss 0.18841. :  23%|██████████▍                                  | 52/224 [00:28<01:27,  1.97it/s]
Epoch 18 Iter 53: loss 0.18841. :  24%|██████████▋                                  | 53/224 [00:28<01:29,  1.92it/s]
Epoch 18 Iter 54: loss 0.16546. :  24%|██████████▋                                  | 53/224 [00:29<01:29,  1.92it/s]
Epoch 18 Iter 54: loss 0.16546. :  24%|██████████▊                                  | 54/224 [00:29<01:26,  1.96it/s]
Epoch 18 Iter 55: loss 0.18499. :  24%|██████████▊                                  | 54/224 [00:29<01:26,  1.96it/s]
Epoch 18 Iter 55: loss 0.18499. :  25%|███████████                                  | 55/224 [00:29<01:26,  1.96it/s]
Epoch 18 Iter 56: loss 0.16182. :  25%|███████████                                  | 55/224 [00:30<01:26,  1.96it/s]
Epoch 18 Iter 56: loss 0.16182. :  25%|███████████▎                                 | 56/224 [00:30<01:27,  1.91it/s]
Epoch 18 Iter 57: loss 0.17145. :  25%|███████████▎                                 | 56/224 [00:30<01:27,  1.91it/s]
Epoch 18 Iter 57: loss 0.17145. :  25%|███████████▍                                 | 57/224 [00:30<01:27,  1.91it/s]
Epoch 18 Iter 58: loss 0.17214. :  25%|███████████▍                                 | 57/224 [00:31<01:27,  1.91it/s]
Epoch 18 Iter 58: loss 0.17214. :  26%|███████████▋                                 | 58/224 [00:31<01:26,  1.91it/s]
Epoch 18 Iter 59: loss 0.16524. :  26%|███████████▋                                 | 58/224 [00:31<01:26,  1.91it/s]
Epoch 18 Iter 59: loss 0.16524. :  26%|███████████▊                                 | 59/224 [00:31<01:24,  1.94it/s]
Epoch 18 Iter 60: loss 0.15229. :  26%|███████████▊                                 | 59/224 [00:32<01:24,  1.94it/s]
Epoch 18 Iter 60: loss 0.15229. :  27%|████████████                                 | 60/224 [00:32<01:23,  1.96it/s]
Epoch 18 Iter 61: loss 0.16637. :  27%|████████████                                 | 60/224 [00:32<01:23,  1.96it/s]
Epoch 18 Iter 61: loss 0.16637. :  27%|████████████▎                                | 61/224 [00:32<01:21,  1.99it/s]
Epoch 18 Iter 62: loss 0.15922. :  27%|████████████▎                                | 61/224 [00:33<01:21,  1.99it/s]
Epoch 18 Iter 62: loss 0.15922. :  28%|████████████▍                                | 62/224 [00:33<01:20,  2.00it/s]
Epoch 18 Iter 63: loss 0.16389. :  28%|████████████▍                                | 62/224 [00:33<01:20,  2.00it/s]
Epoch 18 Iter 63: loss 0.16389. :  28%|████████████▋                                | 63/224 [00:33<01:20,  2.01it/s]
Epoch 18 Iter 64: loss 0.17545. :  28%|████████████▋                                | 63/224 [00:34<01:20,  2.01it/s]
Epoch 18 Iter 64: loss 0.17545. :  29%|████████████▊                                | 64/224 [00:34<01:46,  1.51it/s]
Epoch 18 Iter 65: loss 0.15562. :  29%|████████████▊                                | 64/224 [00:35<01:46,  1.51it/s]
Epoch 18 Iter 65: loss 0.15562. :  29%|█████████████                                | 65/224 [00:35<01:37,  1.63it/s]
Epoch 18 Iter 66: loss 0.15960. :  29%|█████████████                                | 65/224 [00:35<01:37,  1.63it/s]
Epoch 18 Iter 66: loss 0.15960. :  29%|█████████████▎                               | 66/224 [00:35<01:30,  1.74it/s]
Epoch 18 Iter 67: loss 0.16331. :  29%|█████████████▎                               | 66/224 [00:36<01:30,  1.74it/s]
Epoch 18 Iter 67: loss 0.16331. :  30%|█████████████▍                               | 67/224 [00:36<01:26,  1.81it/s]
Epoch 18 Iter 68: loss 0.17043. :  30%|█████████████▍                               | 67/224 [00:36<01:26,  1.81it/s]
Epoch 18 Iter 68: loss 0.17043. :  30%|█████████████▋                               | 68/224 [00:36<01:23,  1.87it/s]
Epoch 18 Iter 69: loss 0.17309. :  30%|█████████████▋                               | 68/224 [00:37<01:23,  1.87it/s]
Epoch 18 Iter 69: loss 0.17309. :  31%|█████████████▊                               | 69/224 [00:37<01:20,  1.92it/s]
Epoch 18 Iter 70: loss 0.15908. :  31%|█████████████▊                               | 69/224 [00:37<01:20,  1.92it/s]
Epoch 18 Iter 70: loss 0.15908. :  31%|██████████████                               | 70/224 [00:37<01:19,  1.94it/s]
Epoch 18 Iter 71: loss 0.15387. :  31%|██████████████                               | 70/224 [00:38<01:19,  1.94it/s]
Epoch 18 Iter 71: loss 0.15387. :  32%|██████████████▎                              | 71/224 [00:38<01:17,  1.97it/s]
Epoch 18 Iter 72: loss 0.17613. :  32%|██████████████▎                              | 71/224 [00:38<01:17,  1.97it/s]
Epoch 18 Iter 72: loss 0.17613. :  32%|██████████████▍                              | 72/224 [00:38<01:15,  2.00it/s]
Epoch 18 Iter 73: loss 0.17536. :  32%|██████████████▍                              | 72/224 [00:39<01:15,  2.00it/s]
Epoch 18 Iter 73: loss 0.17536. :  33%|██████████████▋                              | 73/224 [00:39<01:15,  2.00it/s]
Epoch 18 Iter 74: loss 0.17739. :  33%|██████████████▋                              | 73/224 [00:39<01:15,  2.00it/s]
Epoch 18 Iter 74: loss 0.17739. :  33%|██████████████▊                              | 74/224 [00:39<01:15,  1.99it/s]
Epoch 18 Iter 75: loss 0.15943. :  33%|██████████████▊                              | 74/224 [00:40<01:15,  1.99it/s]
Epoch 18 Iter 75: loss 0.15943. :  33%|███████████████                              | 75/224 [00:40<01:14,  2.00it/s]
Epoch 18 Iter 76: loss 0.16185. :  33%|███████████████                              | 75/224 [00:40<01:14,  2.00it/s]
Epoch 18 Iter 76: loss 0.16185. :  34%|███████████████▎                             | 76/224 [00:40<01:13,  2.00it/s]
Epoch 18 Iter 77: loss 0.17442. :  34%|███████████████▎                             | 76/224 [00:41<01:13,  2.00it/s]
Epoch 18 Iter 77: loss 0.17442. :  34%|███████████████▍                             | 77/224 [00:41<01:13,  2.01it/s]
Epoch 18 Iter 78: loss 0.15865. :  34%|███████████████▍                             | 77/224 [00:41<01:13,  2.01it/s]
Epoch 18 Iter 78: loss 0.15865. :  35%|███████████████▋                             | 78/224 [00:41<01:12,  2.01it/s]
Epoch 18 Iter 79: loss 0.15036. :  35%|███████████████▋                             | 78/224 [00:42<01:12,  2.01it/s]
Epoch 18 Iter 79: loss 0.15036. :  35%|███████████████▊                             | 79/224 [00:42<01:12,  2.00it/s]
Epoch 18 Iter 80: loss 0.17301. :  35%|███████████████▊                             | 79/224 [00:42<01:12,  2.00it/s]
Epoch 18 Iter 80: loss 0.17301. :  36%|████████████████                             | 80/224 [00:42<01:11,  2.01it/s]
Epoch 18 Iter 81: loss 0.16926. :  36%|████████████████                             | 80/224 [00:43<01:11,  2.01it/s]
Epoch 18 Iter 81: loss 0.16926. :  36%|████████████████▎                            | 81/224 [00:43<01:11,  2.01it/s]
Epoch 18 Iter 82: loss 0.17058. :  36%|████████████████▎                            | 81/224 [00:43<01:11,  2.01it/s]
Epoch 18 Iter 82: loss 0.17058. :  37%|████████████████▍                            | 82/224 [00:43<01:10,  2.00it/s]
Epoch 18 Iter 83: loss 0.16846. :  37%|████████████████▍                            | 82/224 [00:44<01:10,  2.00it/s]
Epoch 18 Iter 83: loss 0.16846. :  37%|████████████████▋                            | 83/224 [00:44<01:09,  2.02it/s]
Epoch 18 Iter 84: loss 0.15302. :  37%|████████████████▋                            | 83/224 [00:44<01:09,  2.02it/s]
Epoch 18 Iter 84: loss 0.15302. :  38%|████████████████▉                            | 84/224 [00:44<01:09,  2.03it/s]
Epoch 18 Iter 85: loss 0.16418. :  38%|████████████████▉                            | 84/224 [00:45<01:09,  2.03it/s]
Epoch 18 Iter 85: loss 0.16418. :  38%|█████████████████                            | 85/224 [00:45<01:08,  2.04it/s]
Epoch 18 Iter 86: loss 0.16974. :  38%|█████████████████                            | 85/224 [00:45<01:08,  2.04it/s]
Epoch 18 Iter 86: loss 0.16974. :  38%|█████████████████▎                           | 86/224 [00:45<01:07,  2.04it/s]
Epoch 18 Iter 87: loss 0.16021. :  38%|█████████████████▎                           | 86/224 [00:46<01:07,  2.04it/s]
Epoch 18 Iter 87: loss 0.16021. :  39%|█████████████████▍                           | 87/224 [00:46<01:06,  2.04it/s]
Epoch 18 Iter 88: loss 0.16789. :  39%|█████████████████▍                           | 87/224 [00:46<01:06,  2.04it/s]
Epoch 18 Iter 88: loss 0.16789. :  39%|█████████████████▋                           | 88/224 [00:46<01:06,  2.05it/s]
Epoch 18 Iter 89: loss 0.15313. :  39%|█████████████████▋                           | 88/224 [00:47<01:06,  2.05it/s]
Epoch 18 Iter 89: loss 0.15313. :  40%|█████████████████▉                           | 89/224 [00:47<01:05,  2.05it/s]
Epoch 18 Iter 90: loss 0.14987. :  40%|█████████████████▉                           | 89/224 [00:47<01:05,  2.05it/s]
Epoch 18 Iter 90: loss 0.14987. :  40%|██████████████████                           | 90/224 [00:47<01:05,  2.04it/s]
Epoch 18 Iter 91: loss 0.15840. :  40%|██████████████████                           | 90/224 [00:48<01:05,  2.04it/s]
Epoch 18 Iter 91: loss 0.15840. :  41%|██████████████████▎                          | 91/224 [00:48<01:05,  2.03it/s]
Epoch 18 Iter 92: loss 0.14140. :  41%|██████████████████▎                          | 91/224 [00:48<01:05,  2.03it/s]
Epoch 18 Iter 92: loss 0.14140. :  41%|██████████████████▍                          | 92/224 [00:48<01:04,  2.04it/s]
Epoch 18 Iter 93: loss 0.15959. :  41%|██████████████████▍                          | 92/224 [00:49<01:04,  2.04it/s]
Epoch 18 Iter 93: loss 0.15959. :  42%|██████████████████▋                          | 93/224 [00:49<01:04,  2.03it/s]
Epoch 18 Iter 94: loss 0.16674. :  42%|██████████████████▋                          | 93/224 [00:49<01:04,  2.03it/s]
Epoch 18 Iter 94: loss 0.16674. :  42%|██████████████████▉                          | 94/224 [00:49<01:04,  2.03it/s]
Epoch 18 Iter 95: loss 0.16147. :  42%|██████████████████▉                          | 94/224 [00:50<01:04,  2.03it/s]
Epoch 18 Iter 95: loss 0.16147. :  42%|███████████████████                          | 95/224 [00:50<01:03,  2.02it/s]
Epoch 18 Iter 96: loss 0.16686. :  42%|███████████████████                          | 95/224 [00:50<01:03,  2.02it/s]
Epoch 18 Iter 96: loss 0.16686. :  43%|███████████████████▎                         | 96/224 [00:50<01:02,  2.04it/s]
Epoch 18 Iter 97: loss 0.16981. :  43%|███████████████████▎                         | 96/224 [00:51<01:02,  2.04it/s]
Epoch 18 Iter 97: loss 0.16981. :  43%|███████████████████▍                         | 97/224 [00:51<01:02,  2.04it/s]
Epoch 18 Iter 98: loss 0.17162. :  43%|███████████████████▍                         | 97/224 [00:51<01:02,  2.04it/s]
Epoch 18 Iter 98: loss 0.17162. :  44%|███████████████████▋                         | 98/224 [00:51<01:01,  2.04it/s]
Epoch 18 Iter 99: loss 0.17581. :  44%|███████████████████▋                         | 98/224 [00:52<01:01,  2.04it/s]
Epoch 18 Iter 99: loss 0.17581. :  44%|███████████████████▉                         | 99/224 [00:52<01:01,  2.03it/s]
Epoch 18 Iter 100: loss 0.17564. :  44%|███████████████████▍                        | 99/224 [00:52<01:01,  2.03it/s]
Epoch 18 Iter 100: loss 0.17564. :  45%|███████████████████▏                       | 100/224 [00:52<01:01,  2.02it/s]
Epoch 18 Iter 101: loss 0.16006. :  45%|███████████████████▏                       | 100/224 [00:53<01:01,  2.02it/s]
Epoch 18 Iter 101: loss 0.16006. :  45%|███████████████████▍                       | 101/224 [00:53<01:00,  2.04it/s]
Epoch 18 Iter 102: loss 0.16372. :  45%|███████████████████▍                       | 101/224 [00:53<01:00,  2.04it/s]
Epoch 18 Iter 102: loss 0.16372. :  46%|███████████████████▌                       | 102/224 [00:53<00:59,  2.05it/s]
Epoch 18 Iter 103: loss 0.16697. :  46%|███████████████████▌                       | 102/224 [00:54<00:59,  2.05it/s]
Epoch 18 Iter 103: loss 0.16697. :  46%|███████████████████▊                       | 103/224 [00:54<00:59,  2.04it/s]
Epoch 18 Iter 104: loss 0.17321. :  46%|███████████████████▊                       | 103/224 [00:54<00:59,  2.04it/s]
Epoch 18 Iter 104: loss 0.17321. :  46%|███████████████████▉                       | 104/224 [00:54<00:59,  2.02it/s]
Epoch 18 Iter 105: loss 0.18241. :  46%|███████████████████▉                       | 104/224 [00:55<00:59,  2.02it/s]
Epoch 18 Iter 105: loss 0.18241. :  47%|████████████████████▏                      | 105/224 [00:55<00:58,  2.04it/s]
Epoch 18 Iter 106: loss 0.16281. :  47%|████████████████████▏                      | 105/224 [00:55<00:58,  2.04it/s]
Epoch 18 Iter 106: loss 0.16281. :  47%|████████████████████▎                      | 106/224 [00:55<00:57,  2.05it/s]
Epoch 18 Iter 107: loss 0.18127. :  47%|████████████████████▎                      | 106/224 [00:56<00:57,  2.05it/s]
Epoch 18 Iter 107: loss 0.18127. :  48%|████████████████████▌                      | 107/224 [00:56<00:57,  2.03it/s]
Epoch 18 Iter 108: loss 0.15996. :  48%|████████████████████▌                      | 107/224 [00:56<00:57,  2.03it/s]
Epoch 18 Iter 108: loss 0.15996. :  48%|████████████████████▋                      | 108/224 [00:56<00:57,  2.03it/s]
Epoch 18 Iter 109: loss 0.16715. :  48%|████████████████████▋                      | 108/224 [00:57<00:57,  2.03it/s]
Epoch 18 Iter 109: loss 0.16715. :  49%|████████████████████▉                      | 109/224 [00:57<00:56,  2.05it/s]
Epoch 18 Iter 110: loss 0.17027. :  49%|████████████████████▉                      | 109/224 [00:57<00:56,  2.05it/s]
Epoch 18 Iter 110: loss 0.17027. :  49%|█████████████████████                      | 110/224 [00:57<00:55,  2.06it/s]
Epoch 18 Iter 111: loss 0.15884. :  49%|█████████████████████                      | 110/224 [00:58<00:55,  2.06it/s]
Epoch 18 Iter 111: loss 0.15884. :  50%|█████████████████████▎                     | 111/224 [00:58<00:55,  2.04it/s]
Epoch 18 Iter 112: loss 0.16475. :  50%|█████████████████████▎                     | 111/224 [00:58<00:55,  2.04it/s]
Epoch 18 Iter 112: loss 0.16475. :  50%|█████████████████████▌                     | 112/224 [00:58<00:54,  2.04it/s]
Epoch 18 Iter 113: loss 0.16688. :  50%|█████████████████████▌                     | 112/224 [00:59<00:54,  2.04it/s]
Epoch 18 Iter 113: loss 0.16688. :  50%|█████████████████████▋                     | 113/224 [00:59<00:54,  2.05it/s]
Epoch 18 Iter 114: loss 0.18383. :  50%|█████████████████████▋                     | 113/224 [00:59<00:54,  2.05it/s]
Epoch 18 Iter 114: loss 0.18383. :  51%|█████████████████████▉                     | 114/224 [00:59<00:53,  2.04it/s]
Epoch 18 Iter 115: loss 0.18679. :  51%|█████████████████████▉                     | 114/224 [01:00<00:53,  2.04it/s]
Epoch 18 Iter 115: loss 0.18679. :  51%|██████████████████████                     | 115/224 [01:00<00:52,  2.06it/s]
Epoch 18 Iter 116: loss 0.14914. :  51%|██████████████████████                     | 115/224 [01:00<00:52,  2.06it/s]
Epoch 18 Iter 116: loss 0.14914. :  52%|██████████████████████▎                    | 116/224 [01:00<00:53,  2.03it/s]
Epoch 18 Iter 117: loss 0.16736. :  52%|██████████████████████▎                    | 116/224 [01:01<00:53,  2.03it/s]
Epoch 18 Iter 117: loss 0.16736. :  52%|██████████████████████▍                    | 117/224 [01:01<00:53,  1.98it/s]
Epoch 18 Iter 118: loss 0.16128. :  52%|██████████████████████▍                    | 117/224 [01:01<00:53,  1.98it/s]
Epoch 18 Iter 118: loss 0.16128. :  53%|██████████████████████▋                    | 118/224 [01:01<00:53,  1.98it/s]
Epoch 18 Iter 119: loss 0.16474. :  53%|██████████████████████▋                    | 118/224 [01:02<00:53,  1.98it/s]
Epoch 18 Iter 119: loss 0.16474. :  53%|██████████████████████▊                    | 119/224 [01:02<00:53,  1.98it/s]
Epoch 18 Iter 120: loss 0.16102. :  53%|██████████████████████▊                    | 119/224 [01:02<00:53,  1.98it/s]
Epoch 18 Iter 120: loss 0.16102. :  54%|███████████████████████                    | 120/224 [01:02<00:52,  1.99it/s]
Epoch 18 Iter 121: loss 0.16480. :  54%|███████████████████████                    | 120/224 [01:03<00:52,  1.99it/s]
Epoch 18 Iter 121: loss 0.16480. :  54%|███████████████████████▏                   | 121/224 [01:03<00:51,  2.00it/s]
Epoch 18 Iter 122: loss 0.16106. :  54%|███████████████████████▏                   | 121/224 [01:03<00:51,  2.00it/s]
Epoch 18 Iter 122: loss 0.16106. :  54%|███████████████████████▍                   | 122/224 [01:03<00:50,  2.01it/s]
Epoch 18 Iter 123: loss 0.18137. :  54%|███████████████████████▍                   | 122/224 [01:04<00:50,  2.01it/s]
Epoch 18 Iter 123: loss 0.18137. :  55%|███████████████████████▌                   | 123/224 [01:04<00:49,  2.03it/s]
Epoch 18 Iter 124: loss 0.16387. :  55%|███████████████████████▌                   | 123/224 [01:04<00:49,  2.03it/s]
Epoch 18 Iter 124: loss 0.16387. :  55%|███████████████████████▊                   | 124/224 [01:04<00:48,  2.04it/s]
Epoch 18 Iter 125: loss 0.17641. :  55%|███████████████████████▊                   | 124/224 [01:05<00:48,  2.04it/s]
Epoch 18 Iter 125: loss 0.17641. :  56%|███████████████████████▉                   | 125/224 [01:05<00:48,  2.03it/s]
Epoch 18 Iter 126: loss 0.17263. :  56%|███████████████████████▉                   | 125/224 [01:05<00:48,  2.03it/s]
Epoch 18 Iter 126: loss 0.17263. :  56%|████████████████████████▏                  | 126/224 [01:05<00:48,  2.03it/s]
Epoch 18 Iter 127: loss 0.15130. :  56%|████████████████████████▏                  | 126/224 [01:06<00:48,  2.03it/s]
Epoch 18 Iter 127: loss 0.15130. :  57%|████████████████████████▍                  | 127/224 [01:06<00:47,  2.05it/s]
Epoch 18 Iter 128: loss 0.16280. :  57%|████████████████████████▍                  | 127/224 [01:06<00:47,  2.05it/s]
Epoch 18 Iter 128: loss 0.16280. :  57%|████████████████████████▌                  | 128/224 [01:06<00:46,  2.05it/s]
Epoch 18 Iter 129: loss 0.15836. :  57%|████████████████████████▌                  | 128/224 [01:07<00:46,  2.05it/s]
Epoch 18 Iter 129: loss 0.15836. :  58%|████████████████████████▊                  | 129/224 [01:07<00:46,  2.05it/s]
Epoch 18 Iter 130: loss 0.15418. :  58%|████████████████████████▊                  | 129/224 [01:07<00:46,  2.05it/s]
Epoch 18 Iter 130: loss 0.15418. :  58%|████████████████████████▉                  | 130/224 [01:07<00:45,  2.05it/s]
Epoch 18 Iter 131: loss 0.15947. :  58%|████████████████████████▉                  | 130/224 [01:07<00:45,  2.05it/s]
Epoch 18 Iter 131: loss 0.15947. :  58%|█████████████████████████▏                 | 131/224 [01:07<00:45,  2.05it/s]
Epoch 18 Iter 132: loss 0.16409. :  58%|█████████████████████████▏                 | 131/224 [01:08<00:45,  2.05it/s]
Epoch 18 Iter 132: loss 0.16409. :  59%|█████████████████████████▎                 | 132/224 [01:08<00:45,  2.04it/s]
Epoch 18 Iter 133: loss 0.15032. :  59%|█████████████████████████▎                 | 132/224 [01:08<00:45,  2.04it/s]
Epoch 18 Iter 133: loss 0.15032. :  59%|█████████████████████████▌                 | 133/224 [01:08<00:44,  2.04it/s]
Epoch 18 Iter 134: loss 0.18203. :  59%|█████████████████████████▌                 | 133/224 [01:09<00:44,  2.04it/s]
Epoch 18 Iter 134: loss 0.18203. :  60%|█████████████████████████▋                 | 134/224 [01:09<00:44,  2.04it/s]
Epoch 18 Iter 135: loss 0.16613. :  60%|█████████████████████████▋                 | 134/224 [01:09<00:44,  2.04it/s]
Epoch 18 Iter 135: loss 0.16613. :  60%|█████████████████████████▉                 | 135/224 [01:09<00:44,  2.02it/s]
Epoch 18 Iter 136: loss 0.16865. :  60%|█████████████████████████▉                 | 135/224 [01:10<00:44,  2.02it/s]
Epoch 18 Iter 136: loss 0.16865. :  61%|██████████████████████████                 | 136/224 [01:10<00:43,  2.03it/s]
Epoch 18 Iter 137: loss 0.15339. :  61%|██████████████████████████                 | 136/224 [01:10<00:43,  2.03it/s]
Epoch 18 Iter 137: loss 0.15339. :  61%|██████████████████████████▎                | 137/224 [01:10<00:42,  2.03it/s]
Epoch 18 Iter 138: loss 0.15471. :  61%|██████████████████████████▎                | 137/224 [01:11<00:42,  2.03it/s]
Epoch 18 Iter 138: loss 0.15471. :  62%|██████████████████████████▍                | 138/224 [01:11<00:42,  2.03it/s]
Epoch 18 Iter 139: loss 0.13983. :  62%|██████████████████████████▍                | 138/224 [01:11<00:42,  2.03it/s]
Epoch 18 Iter 139: loss 0.13983. :  62%|██████████████████████████▋                | 139/224 [01:11<00:41,  2.05it/s]
Epoch 18 Iter 140: loss 0.17645. :  62%|██████████████████████████▋                | 139/224 [01:12<00:41,  2.05it/s]
Epoch 18 Iter 140: loss 0.17645. :  62%|██████████████████████████▉                | 140/224 [01:12<00:40,  2.05it/s]
Epoch 18 Iter 141: loss 0.16279. :  62%|██████████████████████████▉                | 140/224 [01:12<00:40,  2.05it/s]
Epoch 18 Iter 141: loss 0.16279. :  63%|███████████████████████████                | 141/224 [01:12<00:40,  2.05it/s]
Epoch 18 Iter 142: loss 0.18207. :  63%|███████████████████████████                | 141/224 [01:13<00:40,  2.05it/s]
Epoch 18 Iter 142: loss 0.18207. :  63%|███████████████████████████▎               | 142/224 [01:13<00:39,  2.05it/s]
Epoch 18 Iter 143: loss 0.15324. :  63%|███████████████████████████▎               | 142/224 [01:13<00:39,  2.05it/s]
Epoch 18 Iter 143: loss 0.15324. :  64%|███████████████████████████▍               | 143/224 [01:13<00:39,  2.04it/s]
Epoch 18 Iter 144: loss 0.17834. :  64%|███████████████████████████▍               | 143/224 [01:14<00:39,  2.04it/s]
Epoch 18 Iter 144: loss 0.17834. :  64%|███████████████████████████▋               | 144/224 [01:14<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.18785. :  64%|███████████████████████████▋               | 144/224 [01:14<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.18785. :  65%|███████████████████████████▊               | 145/224 [01:14<00:38,  2.05it/s]
Epoch 18 Iter 146: loss 0.18067. :  65%|███████████████████████████▊               | 145/224 [01:15<00:38,  2.05it/s]
Epoch 18 Iter 146: loss 0.18067. :  65%|████████████████████████████               | 146/224 [01:15<00:38,  2.05it/s]
Epoch 18 Iter 147: loss 0.17174. :  65%|████████████████████████████               | 146/224 [01:15<00:38,  2.05it/s]
Epoch 18 Iter 147: loss 0.17174. :  66%|████████████████████████████▏              | 147/224 [01:15<00:37,  2.05it/s]
Epoch 18 Iter 148: loss 0.17522. :  66%|████████████████████████████▏              | 147/224 [01:16<00:37,  2.05it/s]
Epoch 18 Iter 148: loss 0.17522. :  66%|████████████████████████████▍              | 148/224 [01:16<00:36,  2.08it/s]
Epoch 18 Iter 149: loss 0.15969. :  66%|████████████████████████████▍              | 148/224 [01:16<00:36,  2.08it/s]
Epoch 18 Iter 149: loss 0.15969. :  67%|████████████████████████████▌              | 149/224 [01:16<00:36,  2.08it/s]
Epoch 18 Iter 150: loss 0.16009. :  67%|████████████████████████████▌              | 149/224 [01:17<00:36,  2.08it/s]
Epoch 18 Iter 150: loss 0.16009. :  67%|████████████████████████████▊              | 150/224 [01:17<00:35,  2.08it/s]
Epoch 18 Iter 151: loss 0.19811. :  67%|████████████████████████████▊              | 150/224 [01:17<00:35,  2.08it/s]
Epoch 18 Iter 151: loss 0.19811. :  67%|████████████████████████████▉              | 151/224 [01:17<00:35,  2.05it/s]
Epoch 18 Iter 152: loss 0.16818. :  67%|████████████████████████████▉              | 151/224 [01:18<00:35,  2.05it/s]
Epoch 18 Iter 152: loss 0.16818. :  68%|█████████████████████████████▏             | 152/224 [01:18<00:34,  2.06it/s]
Epoch 18 Iter 153: loss 0.15008. :  68%|█████████████████████████████▏             | 152/224 [01:18<00:34,  2.06it/s]
Epoch 18 Iter 153: loss 0.15008. :  68%|█████████████████████████████▎             | 153/224 [01:18<00:34,  2.06it/s]
Epoch 18 Iter 154: loss 0.15464. :  68%|█████████████████████████████▎             | 153/224 [01:19<00:34,  2.06it/s]
Epoch 18 Iter 154: loss 0.15464. :  69%|█████████████████████████████▌             | 154/224 [01:19<00:34,  2.04it/s]
Epoch 18 Iter 155: loss 0.16198. :  69%|█████████████████████████████▌             | 154/224 [01:19<00:34,  2.04it/s]
Epoch 18 Iter 155: loss 0.16198. :  69%|█████████████████████████████▊             | 155/224 [01:19<00:34,  2.03it/s]
Epoch 18 Iter 156: loss 0.16461. :  69%|█████████████████████████████▊             | 155/224 [01:20<00:34,  2.03it/s]
Epoch 18 Iter 156: loss 0.16461. :  70%|█████████████████████████████▉             | 156/224 [01:20<00:33,  2.04it/s]
Epoch 18 Iter 157: loss 0.15034. :  70%|█████████████████████████████▉             | 156/224 [01:20<00:33,  2.04it/s]
Epoch 18 Iter 157: loss 0.15034. :  70%|██████████████████████████████▏            | 157/224 [01:20<00:33,  2.03it/s]
Epoch 18 Iter 158: loss 0.17115. :  70%|██████████████████████████████▏            | 157/224 [01:21<00:33,  2.03it/s]
Epoch 18 Iter 158: loss 0.17115. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:32,  2.04it/s]
Epoch 18 Iter 159: loss 0.14876. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:32,  2.04it/s]
Epoch 18 Iter 159: loss 0.14876. :  71%|██████████████████████████████▌            | 159/224 [01:21<00:31,  2.04it/s]
Epoch 18 Iter 160: loss 0.16874. :  71%|██████████████████████████████▌            | 159/224 [01:22<00:31,  2.04it/s]
Epoch 18 Iter 160: loss 0.16874. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:31,  2.03it/s]
Epoch 18 Iter 161: loss 0.15928. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:31,  2.03it/s]
Epoch 18 Iter 161: loss 0.15928. :  72%|██████████████████████████████▉            | 161/224 [01:22<00:30,  2.04it/s]
Epoch 18 Iter 162: loss 0.18482. :  72%|██████████████████████████████▉            | 161/224 [01:23<00:30,  2.04it/s]
Epoch 18 Iter 162: loss 0.18482. :  72%|███████████████████████████████            | 162/224 [01:23<00:30,  2.03it/s]
Epoch 18 Iter 163: loss 0.15221. :  72%|███████████████████████████████            | 162/224 [01:23<00:30,  2.03it/s]
Epoch 18 Iter 163: loss 0.15221. :  73%|███████████████████████████████▎           | 163/224 [01:23<00:29,  2.06it/s]
Epoch 18 Iter 164: loss 0.15548. :  73%|███████████████████████████████▎           | 163/224 [01:24<00:29,  2.06it/s]
Epoch 18 Iter 164: loss 0.15548. :  73%|███████████████████████████████▍           | 164/224 [01:24<00:29,  2.06it/s]
Epoch 18 Iter 165: loss 0.17629. :  73%|███████████████████████████████▍           | 164/224 [01:24<00:29,  2.06it/s]
Epoch 18 Iter 165: loss 0.17629. :  74%|███████████████████████████████▋           | 165/224 [01:24<00:28,  2.06it/s]
Epoch 18 Iter 166: loss 0.19243. :  74%|███████████████████████████████▋           | 165/224 [01:25<00:28,  2.06it/s]
Epoch 18 Iter 166: loss 0.19243. :  74%|███████████████████████████████▊           | 166/224 [01:25<00:28,  2.06it/s]
Epoch 18 Iter 167: loss 0.17134. :  74%|███████████████████████████████▊           | 166/224 [01:25<00:28,  2.06it/s]
Epoch 18 Iter 167: loss 0.17134. :  75%|████████████████████████████████           | 167/224 [01:25<00:27,  2.06it/s]
Epoch 18 Iter 168: loss 0.16965. :  75%|████████████████████████████████           | 167/224 [01:26<00:27,  2.06it/s]
Epoch 18 Iter 168: loss 0.16965. :  75%|████████████████████████████████▎          | 168/224 [01:26<00:27,  2.06it/s]
Epoch 18 Iter 169: loss 0.17074. :  75%|████████████████████████████████▎          | 168/224 [01:26<00:27,  2.06it/s]
Epoch 18 Iter 169: loss 0.17074. :  75%|████████████████████████████████▍          | 169/224 [01:26<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.16734. :  75%|████████████████████████████████▍          | 169/224 [01:27<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.16734. :  76%|████████████████████████████████▋          | 170/224 [01:27<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.18172. :  76%|████████████████████████████████▋          | 170/224 [01:27<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.18172. :  76%|████████████████████████████████▊          | 171/224 [01:27<00:25,  2.05it/s]
Epoch 18 Iter 172: loss 0.19301. :  76%|████████████████████████████████▊          | 171/224 [01:28<00:25,  2.05it/s]
Epoch 18 Iter 172: loss 0.19301. :  77%|█████████████████████████████████          | 172/224 [01:28<00:25,  2.05it/s]
Epoch 18 Iter 173: loss 0.17686. :  77%|█████████████████████████████████          | 172/224 [01:28<00:25,  2.05it/s]
Epoch 18 Iter 173: loss 0.17686. :  77%|█████████████████████████████████▏         | 173/224 [01:28<00:24,  2.06it/s]
Epoch 18 Iter 174: loss 0.18557. :  77%|█████████████████████████████████▏         | 173/224 [01:28<00:24,  2.06it/s]
Epoch 18 Iter 174: loss 0.18557. :  78%|█████████████████████████████████▍         | 174/224 [01:28<00:24,  2.06it/s]
Epoch 18 Iter 175: loss 0.16691. :  78%|█████████████████████████████████▍         | 174/224 [01:29<00:24,  2.06it/s]
Epoch 18 Iter 175: loss 0.16691. :  78%|█████████████████████████████████▌         | 175/224 [01:29<00:23,  2.06it/s]
Epoch 18 Iter 176: loss 0.15203. :  78%|█████████████████████████████████▌         | 175/224 [01:29<00:23,  2.06it/s]
Epoch 18 Iter 176: loss 0.15203. :  79%|█████████████████████████████████▊         | 176/224 [01:29<00:23,  2.04it/s]
Epoch 18 Iter 177: loss 0.16954. :  79%|█████████████████████████████████▊         | 176/224 [01:30<00:23,  2.04it/s]
Epoch 18 Iter 177: loss 0.16954. :  79%|█████████████████████████████████▉         | 177/224 [01:30<00:23,  2.04it/s]
Epoch 18 Iter 178: loss 0.17433. :  79%|█████████████████████████████████▉         | 177/224 [01:30<00:23,  2.04it/s]
Epoch 18 Iter 178: loss 0.17433. :  79%|██████████████████████████████████▏        | 178/224 [01:30<00:22,  2.05it/s]
Epoch 18 Iter 179: loss 0.18007. :  79%|██████████████████████████████████▏        | 178/224 [01:31<00:22,  2.05it/s]
Epoch 18 Iter 179: loss 0.18007. :  80%|██████████████████████████████████▎        | 179/224 [01:31<00:21,  2.05it/s]
Epoch 18 Iter 180: loss 0.15564. :  80%|██████████████████████████████████▎        | 179/224 [01:31<00:21,  2.05it/s]
Epoch 18 Iter 180: loss 0.15564. :  80%|██████████████████████████████████▌        | 180/224 [01:31<00:21,  2.06it/s]
Epoch 18 Iter 181: loss 0.17089. :  80%|██████████████████████████████████▌        | 180/224 [01:32<00:21,  2.06it/s]
Epoch 18 Iter 181: loss 0.17089. :  81%|██████████████████████████████████▋        | 181/224 [01:32<00:20,  2.05it/s]
Epoch 18 Iter 182: loss 0.15943. :  81%|██████████████████████████████████▋        | 181/224 [01:32<00:20,  2.05it/s]
Epoch 18 Iter 182: loss 0.15943. :  81%|██████████████████████████████████▉        | 182/224 [01:32<00:20,  2.06it/s]
Epoch 18 Iter 183: loss 0.15892. :  81%|██████████████████████████████████▉        | 182/224 [01:33<00:20,  2.06it/s]
Epoch 18 Iter 183: loss 0.15892. :  82%|███████████████████████████████████▏       | 183/224 [01:33<00:19,  2.06it/s]
Epoch 18 Iter 184: loss 0.18801. :  82%|███████████████████████████████████▏       | 183/224 [01:33<00:19,  2.06it/s]
Epoch 18 Iter 184: loss 0.18801. :  82%|███████████████████████████████████▎       | 184/224 [01:33<00:19,  2.05it/s]
Epoch 18 Iter 185: loss 0.17156. :  82%|███████████████████████████████████▎       | 184/224 [01:34<00:19,  2.05it/s]
Epoch 18 Iter 185: loss 0.17156. :  83%|███████████████████████████████████▌       | 185/224 [01:34<00:19,  2.05it/s]
Epoch 18 Iter 186: loss 0.17832. :  83%|███████████████████████████████████▌       | 185/224 [01:34<00:19,  2.05it/s]
Epoch 18 Iter 186: loss 0.17832. :  83%|███████████████████████████████████▋       | 186/224 [01:34<00:18,  2.04it/s]
Epoch 18 Iter 187: loss 0.16626. :  83%|███████████████████████████████████▋       | 186/224 [01:35<00:18,  2.04it/s]
Epoch 18 Iter 187: loss 0.16626. :  83%|███████████████████████████████████▉       | 187/224 [01:35<00:18,  2.04it/s]
Epoch 18 Iter 188: loss 0.18024. :  83%|███████████████████████████████████▉       | 187/224 [01:35<00:18,  2.04it/s]
Epoch 18 Iter 188: loss 0.18024. :  84%|████████████████████████████████████       | 188/224 [01:35<00:17,  2.04it/s]
Epoch 18 Iter 189: loss 0.16119. :  84%|████████████████████████████████████       | 188/224 [01:36<00:17,  2.04it/s]
Epoch 18 Iter 189: loss 0.16119. :  84%|████████████████████████████████████▎      | 189/224 [01:36<00:17,  2.04it/s]
Epoch 18 Iter 190: loss 0.18047. :  84%|████████████████████████████████████▎      | 189/224 [01:36<00:17,  2.04it/s]
Epoch 18 Iter 190: loss 0.18047. :  85%|████████████████████████████████████▍      | 190/224 [01:36<00:16,  2.03it/s]
Epoch 18 Iter 191: loss 0.16969. :  85%|████████████████████████████████████▍      | 190/224 [01:37<00:16,  2.03it/s]
Epoch 18 Iter 191: loss 0.16969. :  85%|████████████████████████████████████▋      | 191/224 [01:37<00:16,  2.05it/s]
Epoch 18 Iter 192: loss 0.16780. :  85%|████████████████████████████████████▋      | 191/224 [01:37<00:16,  2.05it/s]
Epoch 18 Iter 192: loss 0.16780. :  86%|████████████████████████████████████▊      | 192/224 [01:37<00:15,  2.05it/s]
Epoch 18 Iter 193: loss 0.17687. :  86%|████████████████████████████████████▊      | 192/224 [01:38<00:15,  2.05it/s]
Epoch 18 Iter 193: loss 0.17687. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  2.06it/s]
Epoch 18 Iter 194: loss 0.17147. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  2.06it/s]
Epoch 18 Iter 194: loss 0.17147. :  87%|█████████████████████████████████████▏     | 194/224 [01:38<00:14,  2.05it/s]
Epoch 18 Iter 195: loss 0.15579. :  87%|█████████████████████████████████████▏     | 194/224 [01:39<00:14,  2.05it/s]
Epoch 18 Iter 195: loss 0.15579. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  2.05it/s]
Epoch 18 Iter 196: loss 0.16847. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  2.05it/s]
Epoch 18 Iter 196: loss 0.16847. :  88%|█████████████████████████████████████▋     | 196/224 [01:39<00:13,  2.04it/s]
Epoch 18 Iter 197: loss 0.16880. :  88%|█████████████████████████████████████▋     | 196/224 [01:40<00:13,  2.04it/s]
Epoch 18 Iter 197: loss 0.16880. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  2.04it/s]
Epoch 18 Iter 198: loss 0.16088. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  2.04it/s]
Epoch 18 Iter 198: loss 0.16088. :  88%|██████████████████████████████████████     | 198/224 [01:40<00:12,  2.04it/s]
Epoch 18 Iter 199: loss 0.16106. :  88%|██████████████████████████████████████     | 198/224 [01:41<00:12,  2.04it/s]
Epoch 18 Iter 199: loss 0.16106. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  2.02it/s]
Epoch 18 Iter 200: loss 0.16820. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  2.02it/s]
Epoch 18 Iter 200: loss 0.16820. :  89%|██████████████████████████████████████▍    | 200/224 [01:41<00:11,  2.03it/s]
Epoch 18 Iter 201: loss 0.17813. :  89%|██████████████████████████████████████▍    | 200/224 [01:42<00:11,  2.03it/s]
Epoch 18 Iter 201: loss 0.17813. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  2.04it/s]
Epoch 18 Iter 202: loss 0.17964. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  2.04it/s]
Epoch 18 Iter 202: loss 0.17964. :  90%|██████████████████████████████████████▊    | 202/224 [01:42<00:10,  2.05it/s]
Epoch 18 Iter 203: loss 0.15558. :  90%|██████████████████████████████████████▊    | 202/224 [01:43<00:10,  2.05it/s]
Epoch 18 Iter 203: loss 0.15558. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.03it/s]
Epoch 18 Iter 204: loss 0.17690. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.03it/s]
Epoch 18 Iter 204: loss 0.17690. :  91%|███████████████████████████████████████▏   | 204/224 [01:43<00:09,  2.04it/s]
Epoch 18 Iter 205: loss 0.17161. :  91%|███████████████████████████████████████▏   | 204/224 [01:44<00:09,  2.04it/s]
Epoch 18 Iter 205: loss 0.17161. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.04it/s]
Epoch 18 Iter 206: loss 0.15847. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.04it/s]
Epoch 18 Iter 206: loss 0.15847. :  92%|███████████████████████████████████████▌   | 206/224 [01:44<00:08,  2.03it/s]
Epoch 18 Iter 207: loss 0.18438. :  92%|███████████████████████████████████████▌   | 206/224 [01:45<00:08,  2.03it/s]
Epoch 18 Iter 207: loss 0.18438. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.03it/s]
Epoch 18 Iter 208: loss 0.19556. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.03it/s]
Epoch 18 Iter 208: loss 0.19556. :  93%|███████████████████████████████████████▉   | 208/224 [01:45<00:07,  2.04it/s]
Epoch 18 Iter 209: loss 0.16681. :  93%|███████████████████████████████████████▉   | 208/224 [01:46<00:07,  2.04it/s]
Epoch 18 Iter 209: loss 0.16681. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.04it/s]
Epoch 18 Iter 210: loss 0.17177. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.04it/s]
Epoch 18 Iter 210: loss 0.17177. :  94%|████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.05it/s]
Epoch 18 Iter 211: loss 0.15485. :  94%|████████████████████████████████████████▎  | 210/224 [01:47<00:06,  2.05it/s]
Epoch 18 Iter 211: loss 0.15485. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.06it/s]
Epoch 18 Iter 212: loss 0.16214. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.06it/s]
Epoch 18 Iter 212: loss 0.16214. :  95%|████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.04it/s]
Epoch 18 Iter 213: loss 0.16524. :  95%|████████████████████████████████████████▋  | 212/224 [01:48<00:05,  2.04it/s]
Epoch 18 Iter 213: loss 0.16524. :  95%|████████████████████████████████████████▉  | 213/224 [01:48<00:05,  2.04it/s]
Epoch 18 Iter 214: loss 0.16960. :  95%|████████████████████████████████████████▉  | 213/224 [01:48<00:05,  2.04it/s]
Epoch 18 Iter 214: loss 0.16960. :  96%|█████████████████████████████████████████  | 214/224 [01:48<00:04,  2.04it/s]
Epoch 18 Iter 215: loss 0.16059. :  96%|█████████████████████████████████████████  | 214/224 [01:49<00:04,  2.04it/s]
Epoch 18 Iter 215: loss 0.16059. :  96%|█████████████████████████████████████████▎ | 215/224 [01:49<00:04,  2.04it/s]
Epoch 18 Iter 216: loss 0.16440. :  96%|█████████████████████████████████████████▎ | 215/224 [01:49<00:04,  2.04it/s]
Epoch 18 Iter 216: loss 0.16440. :  96%|█████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.05it/s]
Epoch 18 Iter 217: loss 0.19213. :  96%|█████████████████████████████████████████▍ | 216/224 [01:50<00:03,  2.05it/s]
Epoch 18 Iter 217: loss 0.19213. :  97%|█████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.04it/s]
Epoch 18 Iter 218: loss 0.15978. :  97%|█████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.04it/s]
Epoch 18 Iter 218: loss 0.15978. :  97%|█████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.99it/s]
Epoch 18 Iter 219: loss 0.15370. :  97%|█████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.99it/s]
Epoch 18 Iter 219: loss 0.15370. :  98%|██████████████████████████████████████████ | 219/224 [01:51<00:02,  2.01it/s]
Epoch 18 Iter 220: loss 0.19024. :  98%|██████████████████████████████████████████ | 219/224 [01:51<00:02,  2.01it/s]
Epoch 18 Iter 220: loss 0.19024. :  98%|██████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.01it/s]
Epoch 18 Iter 221: loss 0.16279. :  98%|██████████████████████████████████████████▏| 220/224 [01:52<00:01,  2.01it/s]
Epoch 18 Iter 221: loss 0.16279. :  99%|██████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.01it/s]
Epoch 18 Iter 222: loss 0.17975. :  99%|██████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.01it/s]
Epoch 18 Iter 222: loss 0.17975. :  99%|██████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 18 Iter 223: loss 0.16274. :  99%|██████████████████████████████████████████▌| 222/224 [01:53<00:00,  2.02it/s]
Epoch 18 Iter 223: loss 0.16274. : 100%|██████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.04it/s]
Epoch 18 Iter 224: loss 0.15846. : 100%|██████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.04it/s]
Epoch 18 Iter 224: loss 0.15846. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  2.03it/s]
Epoch 18 Iter 224: loss 0.15846. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  1.97it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.15992. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.15992. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 19 Iter 2: loss 0.15937. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 19 Iter 2: loss 0.15937. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 19 Iter 3: loss 0.18836. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 19 Iter 3: loss 0.18836. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 19 Iter 4: loss 0.15949. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 19 Iter 4: loss 0.15949. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 19 Iter 5: loss 0.15374. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 19 Iter 5: loss 0.15374. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 19 Iter 6: loss 0.17054. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 19 Iter 6: loss 0.17054. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 19 Iter 7: loss 0.17040. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 19 Iter 7: loss 0.17040. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 19 Iter 8: loss 0.16480. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 19 Iter 8: loss 0.16480. :   4%|█▋                                             | 8/224 [00:03<01:48,  2.00it/s]
Epoch 19 Iter 9: loss 0.14687. :   4%|█▋                                             | 8/224 [00:04<01:48,  2.00it/s]
Epoch 19 Iter 9: loss 0.14687. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.03it/s]
Epoch 19 Iter 10: loss 0.15381. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.03it/s]
Epoch 19 Iter 10: loss 0.15381. :   4%|██                                           | 10/224 [00:04<01:45,  2.03it/s]
Epoch 19 Iter 11: loss 0.17693. :   4%|██                                           | 10/224 [00:05<01:45,  2.03it/s]
Epoch 19 Iter 11: loss 0.17693. :   5%|██▏                                          | 11/224 [00:05<01:46,  2.00it/s]
Epoch 19 Iter 12: loss 0.14217. :   5%|██▏                                          | 11/224 [00:05<01:46,  2.00it/s]
Epoch 19 Iter 12: loss 0.14217. :   5%|██▍                                          | 12/224 [00:05<01:44,  2.02it/s]
Epoch 19 Iter 13: loss 0.14192. :   5%|██▍                                          | 12/224 [00:06<01:44,  2.02it/s]
Epoch 19 Iter 13: loss 0.14192. :   6%|██▌                                          | 13/224 [00:06<01:44,  2.02it/s]
Epoch 19 Iter 14: loss 0.15116. :   6%|██▌                                          | 13/224 [00:06<01:44,  2.02it/s]
Epoch 19 Iter 14: loss 0.15116. :   6%|██▊                                          | 14/224 [00:06<01:43,  2.03it/s]
Epoch 19 Iter 15: loss 0.16721. :   6%|██▊                                          | 14/224 [00:07<01:43,  2.03it/s]
Epoch 19 Iter 15: loss 0.16721. :   7%|███                                          | 15/224 [00:07<01:42,  2.03it/s]
Epoch 19 Iter 16: loss 0.15014. :   7%|███                                          | 15/224 [00:07<01:42,  2.03it/s]
Epoch 19 Iter 16: loss 0.15014. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 19 Iter 17: loss 0.15203. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 19 Iter 17: loss 0.15203. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 19 Iter 18: loss 0.15200. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 19 Iter 18: loss 0.15200. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 19: loss 0.17672. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 19 Iter 19: loss 0.17672. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.17817. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.17817. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 21: loss 0.15829. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 19 Iter 21: loss 0.15829. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 19 Iter 22: loss 0.16278. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 19 Iter 22: loss 0.16278. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 19 Iter 23: loss 0.15729. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 19 Iter 23: loss 0.15729. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 19 Iter 24: loss 0.18086. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 19 Iter 24: loss 0.18086. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 19 Iter 25: loss 0.16603. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 19 Iter 25: loss 0.16603. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 19 Iter 26: loss 0.14396. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 19 Iter 26: loss 0.14396. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 19 Iter 27: loss 0.16653. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 19 Iter 27: loss 0.16653. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 19 Iter 28: loss 0.18360. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 19 Iter 28: loss 0.18360. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 19 Iter 29: loss 0.17409. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 19 Iter 29: loss 0.17409. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 19 Iter 30: loss 0.16306. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 19 Iter 30: loss 0.16306. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 19 Iter 31: loss 0.17958. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 19 Iter 31: loss 0.17958. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 19 Iter 32: loss 0.16633. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 19 Iter 32: loss 0.16633. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 19 Iter 33: loss 0.18455. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 19 Iter 33: loss 0.18455. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 19 Iter 34: loss 0.16844. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 19 Iter 34: loss 0.16844. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 19 Iter 35: loss 0.16086. :  15%|██████▊                                      | 34/224 [00:17<01:31,  2.07it/s]
Epoch 19 Iter 35: loss 0.16086. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 19 Iter 36: loss 0.16250. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 19 Iter 36: loss 0.16250. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 19 Iter 37: loss 0.15637. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 19 Iter 37: loss 0.15637. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 19 Iter 38: loss 0.18619. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 19 Iter 38: loss 0.18619. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 19 Iter 39: loss 0.17195. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.06it/s]
Epoch 19 Iter 39: loss 0.17195. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 19 Iter 40: loss 0.17500. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 19 Iter 40: loss 0.17500. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 19 Iter 41: loss 0.17886. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 19 Iter 41: loss 0.17886. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 19 Iter 42: loss 0.17496. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 19 Iter 42: loss 0.17496. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 19 Iter 43: loss 0.16073. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 19 Iter 43: loss 0.16073. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 19 Iter 44: loss 0.18799. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 19 Iter 44: loss 0.18799. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 19 Iter 45: loss 0.15666. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 19 Iter 45: loss 0.15666. :  20%|█████████                                    | 45/224 [00:21<01:25,  2.09it/s]
Epoch 19 Iter 46: loss 0.16805. :  20%|█████████                                    | 45/224 [00:22<01:25,  2.09it/s]
Epoch 19 Iter 46: loss 0.16805. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 19 Iter 47: loss 0.16301. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 19 Iter 47: loss 0.16301. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 19 Iter 48: loss 0.17038. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 19 Iter 48: loss 0.17038. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 19 Iter 49: loss 0.17582. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 19 Iter 49: loss 0.17582. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 19 Iter 50: loss 0.15576. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 19 Iter 50: loss 0.15576. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 19 Iter 51: loss 0.18149. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 19 Iter 51: loss 0.18149. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 19 Iter 52: loss 0.15984. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 19 Iter 52: loss 0.15984. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 19 Iter 53: loss 0.17350. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 19 Iter 53: loss 0.17350. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 19 Iter 54: loss 0.16950. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 19 Iter 54: loss 0.16950. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 19 Iter 55: loss 0.17025. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 19 Iter 55: loss 0.17025. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.06it/s]
Epoch 19 Iter 56: loss 0.15452. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.06it/s]
Epoch 19 Iter 56: loss 0.15452. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 19 Iter 57: loss 0.15695. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 19 Iter 57: loss 0.15695. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 19 Iter 58: loss 0.16981. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 19 Iter 58: loss 0.16981. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 19 Iter 59: loss 0.16675. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 19 Iter 59: loss 0.16675. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 19 Iter 60: loss 0.18706. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 19 Iter 60: loss 0.18706. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 19 Iter 61: loss 0.16842. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 19 Iter 61: loss 0.16842. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 19 Iter 62: loss 0.16644. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 19 Iter 62: loss 0.16644. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 19 Iter 63: loss 0.16449. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 19 Iter 63: loss 0.16449. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 19 Iter 64: loss 0.16667. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 19 Iter 64: loss 0.16667. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.05it/s]
Epoch 19 Iter 65: loss 0.17290. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.05it/s]
Epoch 19 Iter 65: loss 0.17290. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 19 Iter 66: loss 0.18051. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 19 Iter 66: loss 0.18051. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 67: loss 0.17047. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 67: loss 0.17047. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 68: loss 0.15752. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.04it/s]
Epoch 19 Iter 68: loss 0.15752. :  30%|█████████████▋                               | 68/224 [00:33<01:17,  2.01it/s]
Epoch 19 Iter 69: loss 0.18456. :  30%|█████████████▋                               | 68/224 [00:33<01:17,  2.01it/s]
Epoch 19 Iter 69: loss 0.18456. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.01it/s]
Epoch 19 Iter 70: loss 0.15193. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.01it/s]
Epoch 19 Iter 70: loss 0.15193. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 19 Iter 71: loss 0.18816. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 19 Iter 71: loss 0.18816. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.03it/s]
Epoch 19 Iter 72: loss 0.19840. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.03it/s]
Epoch 19 Iter 72: loss 0.19840. :  32%|██████████████▍                              | 72/224 [00:35<01:18,  1.94it/s]
Epoch 19 Iter 73: loss 0.14684. :  32%|██████████████▍                              | 72/224 [00:35<01:18,  1.94it/s]
Epoch 19 Iter 73: loss 0.14684. :  33%|██████████████▋                              | 73/224 [00:35<01:17,  1.96it/s]
Epoch 19 Iter 74: loss 0.15910. :  33%|██████████████▋                              | 73/224 [00:36<01:17,  1.96it/s]
Epoch 19 Iter 74: loss 0.15910. :  33%|██████████████▊                              | 74/224 [00:36<01:15,  1.99it/s]
Epoch 19 Iter 75: loss 0.14467. :  33%|██████████████▊                              | 74/224 [00:36<01:15,  1.99it/s]
Epoch 19 Iter 75: loss 0.14467. :  33%|███████████████                              | 75/224 [00:36<01:14,  1.99it/s]
Epoch 19 Iter 76: loss 0.18319. :  33%|███████████████                              | 75/224 [00:37<01:14,  1.99it/s]
Epoch 19 Iter 76: loss 0.18319. :  34%|███████████████▎                             | 76/224 [00:37<01:14,  2.00it/s]
Epoch 19 Iter 77: loss 0.16410. :  34%|███████████████▎                             | 76/224 [00:37<01:14,  2.00it/s]
Epoch 19 Iter 77: loss 0.16410. :  34%|███████████████▍                             | 77/224 [00:37<01:14,  1.98it/s]
Epoch 19 Iter 78: loss 0.18440. :  34%|███████████████▍                             | 77/224 [00:38<01:14,  1.98it/s]
Epoch 19 Iter 78: loss 0.18440. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.00it/s]
Epoch 19 Iter 79: loss 0.17686. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.00it/s]
Epoch 19 Iter 79: loss 0.17686. :  35%|███████████████▊                             | 79/224 [00:38<01:12,  2.01it/s]
Epoch 19 Iter 80: loss 0.15678. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.01it/s]
Epoch 19 Iter 80: loss 0.15678. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.01it/s]
Epoch 19 Iter 81: loss 0.16438. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.01it/s]
Epoch 19 Iter 81: loss 0.16438. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.02it/s]
Epoch 19 Iter 82: loss 0.16247. :  36%|████████████████▎                            | 81/224 [00:40<01:10,  2.02it/s]
Epoch 19 Iter 82: loss 0.16247. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.02it/s]
Epoch 19 Iter 83: loss 0.16560. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.02it/s]
Epoch 19 Iter 83: loss 0.16560. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.03it/s]
Epoch 19 Iter 84: loss 0.16337. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.03it/s]
Epoch 19 Iter 84: loss 0.16337. :  38%|████████████████▉                            | 84/224 [00:41<01:09,  2.02it/s]
Epoch 19 Iter 85: loss 0.17364. :  38%|████████████████▉                            | 84/224 [00:41<01:09,  2.02it/s]
Epoch 19 Iter 85: loss 0.17364. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.02it/s]
Epoch 19 Iter 86: loss 0.14531. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 19 Iter 86: loss 0.14531. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.01it/s]
Epoch 19 Iter 87: loss 0.17568. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.01it/s]
Epoch 19 Iter 87: loss 0.17568. :  39%|█████████████████▍                           | 87/224 [00:42<01:08,  2.00it/s]
Epoch 19 Iter 88: loss 0.17570. :  39%|█████████████████▍                           | 87/224 [00:43<01:08,  2.00it/s]
Epoch 19 Iter 88: loss 0.17570. :  39%|█████████████████▋                           | 88/224 [00:43<01:08,  2.00it/s]
Epoch 19 Iter 89: loss 0.17030. :  39%|█████████████████▋                           | 88/224 [00:43<01:08,  2.00it/s]
Epoch 19 Iter 89: loss 0.17030. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.02it/s]
Epoch 19 Iter 90: loss 0.16582. :  40%|█████████████████▉                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 19 Iter 90: loss 0.16582. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 19 Iter 91: loss 0.18305. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 19 Iter 91: loss 0.18305. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.02it/s]
Epoch 19 Iter 92: loss 0.16388. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.02it/s]
Epoch 19 Iter 92: loss 0.16388. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.03it/s]
Epoch 19 Iter 93: loss 0.16395. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.03it/s]
Epoch 19 Iter 93: loss 0.16395. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.05it/s]
Epoch 19 Iter 94: loss 0.17096. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.05it/s]
Epoch 19 Iter 94: loss 0.17096. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 19 Iter 95: loss 0.17167. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 19 Iter 95: loss 0.17167. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 19 Iter 96: loss 0.16202. :  42%|███████████████████                          | 95/224 [00:47<01:02,  2.05it/s]
Epoch 19 Iter 96: loss 0.16202. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 19 Iter 97: loss 0.15423. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 19 Iter 97: loss 0.15423. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 19 Iter 98: loss 0.17224. :  43%|███████████████████▍                         | 97/224 [00:48<01:02,  2.05it/s]
Epoch 19 Iter 98: loss 0.17224. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 19 Iter 99: loss 0.17141. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 19 Iter 99: loss 0.17141. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.03it/s]
Epoch 19 Iter 100: loss 0.16696. :  44%|███████████████████▍                        | 99/224 [00:49<01:01,  2.03it/s]
Epoch 19 Iter 100: loss 0.16696. :  45%|███████████████████▏                       | 100/224 [00:49<01:02,  1.99it/s]
Epoch 19 Iter 101: loss 0.18249. :  45%|███████████████████▏                       | 100/224 [00:49<01:02,  1.99it/s]
Epoch 19 Iter 101: loss 0.18249. :  45%|███████████████████▍                       | 101/224 [00:49<01:02,  1.96it/s]
Epoch 19 Iter 102: loss 0.14868. :  45%|███████████████████▍                       | 101/224 [00:50<01:02,  1.96it/s]
Epoch 19 Iter 102: loss 0.14868. :  46%|███████████████████▌                       | 102/224 [00:50<01:05,  1.87it/s]
Epoch 19 Iter 103: loss 0.16230. :  46%|███████████████████▌                       | 102/224 [00:50<01:05,  1.87it/s]
Epoch 19 Iter 103: loss 0.16230. :  46%|███████████████████▊                       | 103/224 [00:50<01:09,  1.73it/s]
Epoch 19 Iter 104: loss 0.14445. :  46%|███████████████████▊                       | 103/224 [00:51<01:09,  1.73it/s]
Epoch 19 Iter 104: loss 0.14445. :  46%|███████████████████▉                       | 104/224 [00:51<01:09,  1.73it/s]
Epoch 19 Iter 105: loss 0.17172. :  46%|███████████████████▉                       | 104/224 [00:51<01:09,  1.73it/s]
Epoch 19 Iter 105: loss 0.17172. :  47%|████████████████████▏                      | 105/224 [00:51<01:04,  1.83it/s]
Epoch 19 Iter 106: loss 0.17857. :  47%|████████████████████▏                      | 105/224 [00:52<01:04,  1.83it/s]
Epoch 19 Iter 106: loss 0.17857. :  47%|████████████████████▎                      | 106/224 [00:52<01:01,  1.91it/s]
Epoch 19 Iter 107: loss 0.15589. :  47%|████████████████████▎                      | 106/224 [00:52<01:01,  1.91it/s]
Epoch 19 Iter 107: loss 0.15589. :  48%|████████████████████▌                      | 107/224 [00:52<01:00,  1.92it/s]
Epoch 19 Iter 108: loss 0.17841. :  48%|████████████████████▌                      | 107/224 [00:53<01:00,  1.92it/s]
Epoch 19 Iter 108: loss 0.17841. :  48%|████████████████████▋                      | 108/224 [00:53<00:58,  1.98it/s]
Epoch 19 Iter 109: loss 0.15415. :  48%|████████████████████▋                      | 108/224 [00:53<00:58,  1.98it/s]
Epoch 19 Iter 109: loss 0.15415. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.02it/s]
Epoch 19 Iter 110: loss 0.16163. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 19 Iter 110: loss 0.16163. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 19 Iter 111: loss 0.15737. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 19 Iter 111: loss 0.15737. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.03it/s]
Epoch 19 Iter 112: loss 0.17366. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 19 Iter 112: loss 0.17366. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.06it/s]
Epoch 19 Iter 113: loss 0.17310. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.06it/s]
Epoch 19 Iter 113: loss 0.17310. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.03it/s]
Epoch 19 Iter 114: loss 0.18035. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 19 Iter 114: loss 0.18035. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 19 Iter 115: loss 0.15777. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 19 Iter 115: loss 0.15777. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.04it/s]
Epoch 19 Iter 116: loss 0.17951. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.04it/s]
Epoch 19 Iter 116: loss 0.17951. :  52%|██████████████████████▎                    | 116/224 [00:57<00:53,  2.03it/s]
Epoch 19 Iter 117: loss 0.18733. :  52%|██████████████████████▎                    | 116/224 [00:57<00:53,  2.03it/s]
Epoch 19 Iter 117: loss 0.18733. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 19 Iter 118: loss 0.14921. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.04it/s]
Epoch 19 Iter 118: loss 0.14921. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.04it/s]
Epoch 19 Iter 119: loss 0.15337. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.04it/s]
Epoch 19 Iter 119: loss 0.15337. :  53%|██████████████████████▊                    | 119/224 [00:58<00:52,  2.02it/s]
Epoch 19 Iter 120: loss 0.15938. :  53%|██████████████████████▊                    | 119/224 [00:59<00:52,  2.02it/s]
Epoch 19 Iter 120: loss 0.15938. :  54%|███████████████████████                    | 120/224 [00:59<00:52,  1.99it/s]
Epoch 19 Iter 121: loss 0.15914. :  54%|███████████████████████                    | 120/224 [00:59<00:52,  1.99it/s]
Epoch 19 Iter 121: loss 0.15914. :  54%|███████████████████████▏                   | 121/224 [00:59<00:52,  1.95it/s]
Epoch 19 Iter 122: loss 0.18991. :  54%|███████████████████████▏                   | 121/224 [01:00<00:52,  1.95it/s]
Epoch 19 Iter 122: loss 0.18991. :  54%|███████████████████████▍                   | 122/224 [01:00<00:53,  1.92it/s]
Epoch 19 Iter 123: loss 0.16935. :  54%|███████████████████████▍                   | 122/224 [01:00<00:53,  1.92it/s]
Epoch 19 Iter 123: loss 0.16935. :  55%|███████████████████████▌                   | 123/224 [01:00<00:51,  1.96it/s]
Epoch 19 Iter 124: loss 0.18780. :  55%|███████████████████████▌                   | 123/224 [01:01<00:51,  1.96it/s]
Epoch 19 Iter 124: loss 0.18780. :  55%|███████████████████████▊                   | 124/224 [01:01<00:50,  1.98it/s]
Epoch 19 Iter 125: loss 0.16814. :  55%|███████████████████████▊                   | 124/224 [01:01<00:50,  1.98it/s]
Epoch 19 Iter 125: loss 0.16814. :  56%|███████████████████████▉                   | 125/224 [01:01<00:49,  2.00it/s]
Epoch 19 Iter 126: loss 0.18386. :  56%|███████████████████████▉                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 19 Iter 126: loss 0.18386. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.01it/s]
Epoch 19 Iter 127: loss 0.15917. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.01it/s]
Epoch 19 Iter 127: loss 0.15917. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.02it/s]
Epoch 19 Iter 128: loss 0.16524. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.02it/s]
Epoch 19 Iter 128: loss 0.16524. :  57%|████████████████████████▌                  | 128/224 [01:03<00:47,  2.02it/s]
Epoch 19 Iter 129: loss 0.17441. :  57%|████████████████████████▌                  | 128/224 [01:03<00:47,  2.02it/s]
Epoch 19 Iter 129: loss 0.17441. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.02it/s]
Epoch 19 Iter 130: loss 0.16017. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.02it/s]
Epoch 19 Iter 130: loss 0.16017. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.06it/s]
Epoch 19 Iter 131: loss 0.17833. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.06it/s]
Epoch 19 Iter 131: loss 0.17833. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.08it/s]
Epoch 19 Iter 132: loss 0.14572. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:44,  2.08it/s]
Epoch 19 Iter 132: loss 0.14572. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.07it/s]
Epoch 19 Iter 133: loss 0.17247. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.07it/s]
Epoch 19 Iter 133: loss 0.17247. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.08it/s]
Epoch 19 Iter 134: loss 0.16826. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:43,  2.08it/s]
Epoch 19 Iter 134: loss 0.16826. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:42,  2.10it/s]
Epoch 19 Iter 135: loss 0.15213. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:42,  2.10it/s]
Epoch 19 Iter 135: loss 0.15213. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.11it/s]
Epoch 19 Iter 136: loss 0.18727. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:42,  2.11it/s]
Epoch 19 Iter 136: loss 0.18727. :  61%|██████████████████████████                 | 136/224 [01:07<00:41,  2.12it/s]
Epoch 19 Iter 137: loss 0.17331. :  61%|██████████████████████████                 | 136/224 [01:07<00:41,  2.12it/s]
Epoch 19 Iter 137: loss 0.17331. :  61%|██████████████████████████▎                | 137/224 [01:07<00:41,  2.10it/s]
Epoch 19 Iter 138: loss 0.17269. :  61%|██████████████████████████▎                | 137/224 [01:08<00:41,  2.10it/s]
Epoch 19 Iter 138: loss 0.17269. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.07it/s]
Epoch 19 Iter 139: loss 0.16523. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.07it/s]
Epoch 19 Iter 139: loss 0.16523. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 19 Iter 140: loss 0.16989. :  62%|██████████████████████████▋                | 139/224 [01:09<00:41,  2.06it/s]
Epoch 19 Iter 140: loss 0.16989. :  62%|██████████████████████████▉                | 140/224 [01:09<00:41,  2.04it/s]
Epoch 19 Iter 141: loss 0.16335. :  62%|██████████████████████████▉                | 140/224 [01:09<00:41,  2.04it/s]
Epoch 19 Iter 141: loss 0.16335. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.04it/s]
Epoch 19 Iter 142: loss 0.18186. :  63%|███████████████████████████                | 141/224 [01:10<00:40,  2.04it/s]
Epoch 19 Iter 142: loss 0.18186. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.07it/s]
Epoch 19 Iter 143: loss 0.16365. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.07it/s]
Epoch 19 Iter 143: loss 0.16365. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 19 Iter 144: loss 0.16523. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 19 Iter 144: loss 0.16523. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 19 Iter 145: loss 0.15196. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 19 Iter 145: loss 0.15196. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 19 Iter 146: loss 0.19683. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 19 Iter 146: loss 0.19683. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.03it/s]
Epoch 19 Iter 147: loss 0.16653. :  65%|████████████████████████████               | 146/224 [01:12<00:38,  2.03it/s]
Epoch 19 Iter 147: loss 0.16653. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.04it/s]
Epoch 19 Iter 148: loss 0.15745. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.04it/s]
Epoch 19 Iter 148: loss 0.15745. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 19 Iter 149: loss 0.15109. :  66%|████████████████████████████▍              | 148/224 [01:13<00:37,  2.05it/s]
Epoch 19 Iter 149: loss 0.15109. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 19 Iter 150: loss 0.15292. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 19 Iter 150: loss 0.15292. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 19 Iter 151: loss 0.16361. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.05it/s]
Epoch 19 Iter 151: loss 0.16361. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.05it/s]
Epoch 19 Iter 152: loss 0.15087. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.05it/s]
Epoch 19 Iter 152: loss 0.15087. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 19 Iter 153: loss 0.17117. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:35,  2.05it/s]
Epoch 19 Iter 153: loss 0.17117. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.05it/s]
Epoch 19 Iter 154: loss 0.15003. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.05it/s]
Epoch 19 Iter 154: loss 0.15003. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.04it/s]
Epoch 19 Iter 155: loss 0.15432. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:34,  2.04it/s]
Epoch 19 Iter 155: loss 0.15432. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.03it/s]
Epoch 19 Iter 156: loss 0.17306. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.03it/s]
Epoch 19 Iter 156: loss 0.17306. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.01it/s]
Epoch 19 Iter 157: loss 0.17593. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:33,  2.01it/s]
Epoch 19 Iter 157: loss 0.17593. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:33,  2.03it/s]
Epoch 19 Iter 158: loss 0.16772. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:33,  2.03it/s]
Epoch 19 Iter 158: loss 0.16772. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.03it/s]
Epoch 19 Iter 159: loss 0.17050. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:32,  2.03it/s]
Epoch 19 Iter 159: loss 0.17050. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.04it/s]
Epoch 19 Iter 160: loss 0.16390. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.04it/s]
Epoch 19 Iter 160: loss 0.16390. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 19 Iter 161: loss 0.15512. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.05it/s]
Epoch 19 Iter 161: loss 0.15512. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 19 Iter 162: loss 0.17164. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 19 Iter 162: loss 0.17164. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 19 Iter 163: loss 0.16021. :  72%|███████████████████████████████            | 162/224 [01:20<00:30,  2.06it/s]
Epoch 19 Iter 163: loss 0.16021. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.15963. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.15963. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.16802. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.16802. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.05it/s]
Epoch 19 Iter 166: loss 0.15896. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.05it/s]
Epoch 19 Iter 166: loss 0.15896. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 19 Iter 167: loss 0.17631. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.05it/s]
Epoch 19 Iter 167: loss 0.17631. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.18203. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.18203. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 19 Iter 169: loss 0.16481. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.06it/s]
Epoch 19 Iter 169: loss 0.16481. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 19 Iter 170: loss 0.18521. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 19 Iter 170: loss 0.18521. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 19 Iter 171: loss 0.14883. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.06it/s]
Epoch 19 Iter 171: loss 0.14883. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.05it/s]
Epoch 19 Iter 172: loss 0.15937. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.05it/s]
Epoch 19 Iter 172: loss 0.15937. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.05it/s]
Epoch 19 Iter 173: loss 0.17659. :  77%|█████████████████████████████████          | 172/224 [01:25<00:25,  2.05it/s]
Epoch 19 Iter 173: loss 0.17659. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 19 Iter 174: loss 0.18015. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 19 Iter 174: loss 0.18015. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 19 Iter 175: loss 0.16183. :  78%|█████████████████████████████████▍         | 174/224 [01:26<00:24,  2.05it/s]
Epoch 19 Iter 175: loss 0.16183. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.06it/s]
Epoch 19 Iter 176: loss 0.16844. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.06it/s]
Epoch 19 Iter 176: loss 0.16844. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 19 Iter 177: loss 0.16244. :  79%|█████████████████████████████████▊         | 176/224 [01:27<00:23,  2.06it/s]
Epoch 19 Iter 177: loss 0.16244. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.07it/s]
Epoch 19 Iter 178: loss 0.17100. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.07it/s]
Epoch 19 Iter 178: loss 0.17100. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.08it/s]
Epoch 19 Iter 179: loss 0.18457. :  79%|██████████████████████████████████▏        | 178/224 [01:28<00:22,  2.08it/s]
Epoch 19 Iter 179: loss 0.18457. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.07it/s]
Epoch 19 Iter 180: loss 0.17242. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.07it/s]
Epoch 19 Iter 180: loss 0.17242. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 19 Iter 181: loss 0.16913. :  80%|██████████████████████████████████▌        | 180/224 [01:29<00:21,  2.07it/s]
Epoch 19 Iter 181: loss 0.16913. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 19 Iter 182: loss 0.16406. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 19 Iter 182: loss 0.16406. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.15211. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.15211. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.17071. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.17071. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.14842. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.14842. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 19 Iter 186: loss 0.15698. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 19 Iter 186: loss 0.15698. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 19 Iter 187: loss 0.14816. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 19 Iter 187: loss 0.14816. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 19 Iter 188: loss 0.17571. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:18,  2.05it/s]
Epoch 19 Iter 188: loss 0.17571. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.06it/s]
Epoch 19 Iter 189: loss 0.15079. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.06it/s]
Epoch 19 Iter 189: loss 0.15079. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 19 Iter 190: loss 0.15785. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:17,  2.06it/s]
Epoch 19 Iter 190: loss 0.15785. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.07it/s]
Epoch 19 Iter 191: loss 0.15281. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.07it/s]
Epoch 19 Iter 191: loss 0.15281. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 19 Iter 192: loss 0.17420. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:15,  2.07it/s]
Epoch 19 Iter 192: loss 0.17420. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.06it/s]
Epoch 19 Iter 193: loss 0.17312. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.06it/s]
Epoch 19 Iter 193: loss 0.17312. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.03it/s]
Epoch 19 Iter 194: loss 0.16985. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:15,  2.03it/s]
Epoch 19 Iter 194: loss 0.16985. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.05it/s]
Epoch 19 Iter 195: loss 0.16264. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.05it/s]
Epoch 19 Iter 195: loss 0.16264. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 19 Iter 196: loss 0.16562. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:14,  2.05it/s]
Epoch 19 Iter 196: loss 0.16562. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.05it/s]
Epoch 19 Iter 197: loss 0.17239. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.05it/s]
Epoch 19 Iter 197: loss 0.17239. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 19 Iter 198: loss 0.18076. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  2.05it/s]
Epoch 19 Iter 198: loss 0.18076. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 19 Iter 199: loss 0.18142. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 19 Iter 199: loss 0.18142. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 19 Iter 200: loss 0.17356. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  2.08it/s]
Epoch 19 Iter 200: loss 0.17356. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.07it/s]
Epoch 19 Iter 201: loss 0.15751. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.07it/s]
Epoch 19 Iter 201: loss 0.15751. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.07it/s]
Epoch 19 Iter 202: loss 0.16123. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.07it/s]
Epoch 19 Iter 202: loss 0.16123. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.07it/s]
Epoch 19 Iter 203: loss 0.16247. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.07it/s]
Epoch 19 Iter 203: loss 0.16247. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 19 Iter 204: loss 0.18781. :  91%|██████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.07it/s]
Epoch 19 Iter 204: loss 0.18781. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.18160. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.18160. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.08it/s]
Epoch 19 Iter 206: loss 0.16381. :  92%|███████████████████████████████████████▎   | 205/224 [01:41<00:09,  2.08it/s]
Epoch 19 Iter 206: loss 0.16381. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.08it/s]
Epoch 19 Iter 207: loss 0.16723. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.08it/s]
Epoch 19 Iter 207: loss 0.16723. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.08it/s]
Epoch 19 Iter 208: loss 0.18171. :  92%|███████████████████████████████████████▋   | 207/224 [01:42<00:08,  2.08it/s]
Epoch 19 Iter 208: loss 0.18171. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.08it/s]
Epoch 19 Iter 209: loss 0.17348. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.08it/s]
Epoch 19 Iter 209: loss 0.17348. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.08it/s]
Epoch 19 Iter 210: loss 0.16505. :  93%|████████████████████████████████████████   | 209/224 [01:43<00:07,  2.08it/s]
Epoch 19 Iter 210: loss 0.16505. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.07it/s]
Epoch 19 Iter 211: loss 0.17579. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.07it/s]
Epoch 19 Iter 211: loss 0.17579. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 19 Iter 212: loss 0.16518. :  94%|████████████████████████████████████████▌  | 211/224 [01:44<00:06,  2.06it/s]
Epoch 19 Iter 212: loss 0.16518. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.06it/s]
Epoch 19 Iter 213: loss 0.15721. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.06it/s]
Epoch 19 Iter 213: loss 0.15721. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 19 Iter 214: loss 0.16450. :  95%|████████████████████████████████████████▉  | 213/224 [01:45<00:05,  2.06it/s]
Epoch 19 Iter 214: loss 0.16450. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.06it/s]
Epoch 19 Iter 215: loss 0.16937. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.06it/s]
Epoch 19 Iter 215: loss 0.16937. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.06it/s]
Epoch 19 Iter 216: loss 0.17548. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.06it/s]
Epoch 19 Iter 216: loss 0.17548. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 19 Iter 217: loss 0.16927. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.07it/s]
Epoch 19 Iter 217: loss 0.16927. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.05it/s]
Epoch 19 Iter 218: loss 0.18232. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.05it/s]
Epoch 19 Iter 218: loss 0.18232. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 19 Iter 219: loss 0.15288. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.05it/s]
Epoch 19 Iter 219: loss 0.15288. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.04it/s]
Epoch 19 Iter 220: loss 0.16431. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.04it/s]
Epoch 19 Iter 220: loss 0.16431. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 19 Iter 221: loss 0.16935. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.05it/s]
Epoch 19 Iter 221: loss 0.16935. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.05it/s]
Epoch 19 Iter 222: loss 0.17547. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.05it/s]
Epoch 19 Iter 222: loss 0.17547. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.04it/s]
Epoch 19 Iter 223: loss 0.15369. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.04it/s]
Epoch 19 Iter 223: loss 0.15369. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.04it/s]
Epoch 19 Iter 224: loss 0.18263. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.04it/s]
Epoch 19 Iter 224: loss 0.18263. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]
Epoch 19 Iter 224: loss 0.18263. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.04it/s]

    Train loss: 0.16708
    Valid loss: 0.17145
       Valid loss recons: 0.17145
       Valid loss KL-D:   43154.09952
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.16985. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.16985. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 20 Iter 2: loss 0.17786. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 20 Iter 2: loss 0.17786. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 20 Iter 3: loss 0.16585. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 20 Iter 3: loss 0.16585. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 20 Iter 4: loss 0.17427. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 20 Iter 4: loss 0.17427. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 20 Iter 5: loss 0.15820. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 20 Iter 5: loss 0.15820. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 20 Iter 6: loss 0.17600. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 20 Iter 6: loss 0.17600. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 20 Iter 7: loss 0.17463. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 20 Iter 7: loss 0.17463. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 20 Iter 8: loss 0.16390. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 20 Iter 8: loss 0.16390. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 20 Iter 9: loss 0.17179. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 20 Iter 9: loss 0.17179. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 20 Iter 10: loss 0.16829. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 20 Iter 10: loss 0.16829. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 20 Iter 11: loss 0.16807. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 20 Iter 11: loss 0.16807. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 20 Iter 12: loss 0.16702. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 20 Iter 12: loss 0.16702. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.08it/s]
Epoch 20 Iter 13: loss 0.17689. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.08it/s]
Epoch 20 Iter 13: loss 0.17689. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 20 Iter 14: loss 0.16468. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 20 Iter 14: loss 0.16468. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 20 Iter 15: loss 0.19144. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 20 Iter 15: loss 0.19144. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 20 Iter 16: loss 0.15897. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 20 Iter 16: loss 0.15897. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 20 Iter 17: loss 0.18009. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 20 Iter 17: loss 0.18009. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 20 Iter 18: loss 0.18827. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 20 Iter 18: loss 0.18827. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 20 Iter 19: loss 0.18123. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 20 Iter 19: loss 0.18123. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 20 Iter 20: loss 0.17755. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 20 Iter 20: loss 0.17755. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 20 Iter 21: loss 0.14145. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 20 Iter 21: loss 0.14145. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 20 Iter 22: loss 0.15338. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 20 Iter 22: loss 0.15338. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 20 Iter 23: loss 0.16522. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 20 Iter 23: loss 0.16522. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 20 Iter 24: loss 0.15769. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 20 Iter 24: loss 0.15769. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 20 Iter 25: loss 0.17690. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 20 Iter 25: loss 0.17690. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 20 Iter 26: loss 0.15472. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 20 Iter 26: loss 0.15472. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 20 Iter 27: loss 0.16843. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 20 Iter 27: loss 0.16843. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 20 Iter 28: loss 0.16257. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 20 Iter 28: loss 0.16257. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.06it/s]
Epoch 20 Iter 29: loss 0.17300. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.06it/s]
Epoch 20 Iter 29: loss 0.17300. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 20 Iter 30: loss 0.18317. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 20 Iter 30: loss 0.18317. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 20 Iter 31: loss 0.16176. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 20 Iter 31: loss 0.16176. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 20 Iter 32: loss 0.16138. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 20 Iter 32: loss 0.16138. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 20 Iter 33: loss 0.16614. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 20 Iter 33: loss 0.16614. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 20 Iter 34: loss 0.18170. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 20 Iter 34: loss 0.18170. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 20 Iter 35: loss 0.16370. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 20 Iter 35: loss 0.16370. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 20 Iter 36: loss 0.16066. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 20 Iter 36: loss 0.16066. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 37: loss 0.15706. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 37: loss 0.15706. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.18036. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.18036. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 39: loss 0.20047. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 39: loss 0.20047. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 20 Iter 40: loss 0.15049. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 20 Iter 40: loss 0.15049. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 20 Iter 41: loss 0.17121. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 20 Iter 41: loss 0.17121. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 20 Iter 42: loss 0.16327. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 20 Iter 42: loss 0.16327. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 20 Iter 43: loss 0.15853. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 20 Iter 43: loss 0.15853. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 20 Iter 44: loss 0.14385. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 20 Iter 44: loss 0.14385. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 20 Iter 45: loss 0.14940. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 20 Iter 45: loss 0.14940. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 20 Iter 46: loss 0.15244. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 20 Iter 46: loss 0.15244. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 20 Iter 47: loss 0.15305. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 20 Iter 47: loss 0.15305. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 20 Iter 48: loss 0.17486. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 20 Iter 48: loss 0.17486. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 20 Iter 49: loss 0.17006. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 20 Iter 49: loss 0.17006. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 20 Iter 50: loss 0.14656. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 20 Iter 50: loss 0.14656. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 20 Iter 51: loss 0.15619. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 20 Iter 51: loss 0.15619. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 20 Iter 52: loss 0.16670. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 20 Iter 52: loss 0.16670. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 20 Iter 53: loss 0.18029. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 20 Iter 53: loss 0.18029. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 20 Iter 54: loss 0.15513. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 20 Iter 54: loss 0.15513. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 20 Iter 55: loss 0.17524. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 20 Iter 55: loss 0.17524. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 20 Iter 56: loss 0.18099. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 20 Iter 56: loss 0.18099. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 20 Iter 57: loss 0.19275. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 20 Iter 57: loss 0.19275. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 20 Iter 58: loss 0.16215. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 20 Iter 58: loss 0.16215. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 20 Iter 59: loss 0.15544. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 20 Iter 59: loss 0.15544. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 20 Iter 60: loss 0.15855. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 20 Iter 60: loss 0.15855. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 20 Iter 61: loss 0.16700. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 20 Iter 61: loss 0.16700. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 20 Iter 62: loss 0.15014. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 20 Iter 62: loss 0.15014. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 20 Iter 63: loss 0.14886. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 20 Iter 63: loss 0.14886. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.04it/s]
Epoch 20 Iter 64: loss 0.17307. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.04it/s]
Epoch 20 Iter 64: loss 0.17307. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 20 Iter 65: loss 0.16816. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 20 Iter 65: loss 0.16816. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.04it/s]
Epoch 20 Iter 66: loss 0.16818. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.04it/s]
Epoch 20 Iter 66: loss 0.16818. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 20 Iter 67: loss 0.15543. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 20 Iter 67: loss 0.15543. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.03it/s]
Epoch 20 Iter 68: loss 0.17600. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.03it/s]
Epoch 20 Iter 68: loss 0.17600. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 20 Iter 69: loss 0.17406. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 20 Iter 69: loss 0.17406. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.04it/s]
Epoch 20 Iter 70: loss 0.16253. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.04it/s]
Epoch 20 Iter 70: loss 0.16253. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 20 Iter 71: loss 0.14674. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 20 Iter 71: loss 0.14674. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.17057. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.17057. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.16603. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.16603. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 74: loss 0.16716. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 74: loss 0.16716. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.03it/s]
Epoch 20 Iter 75: loss 0.17469. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 20 Iter 75: loss 0.17469. :  33%|███████████████                              | 75/224 [00:36<01:13,  2.03it/s]
Epoch 20 Iter 76: loss 0.16840. :  33%|███████████████                              | 75/224 [00:36<01:13,  2.03it/s]
Epoch 20 Iter 76: loss 0.16840. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.03it/s]
Epoch 20 Iter 77: loss 0.16618. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.03it/s]
Epoch 20 Iter 77: loss 0.16618. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.03it/s]
Epoch 20 Iter 78: loss 0.15220. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.03it/s]
Epoch 20 Iter 78: loss 0.15220. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.03it/s]
Epoch 20 Iter 79: loss 0.17624. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.03it/s]
Epoch 20 Iter 79: loss 0.17624. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 20 Iter 80: loss 0.17213. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 20 Iter 80: loss 0.17213. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.04it/s]
Epoch 20 Iter 81: loss 0.16666. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 20 Iter 81: loss 0.16666. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 20 Iter 82: loss 0.17997. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 20 Iter 82: loss 0.17997. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 20 Iter 83: loss 0.16585. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 20 Iter 83: loss 0.16585. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 20 Iter 84: loss 0.17278. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 20 Iter 84: loss 0.17278. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 20 Iter 85: loss 0.16208. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 20 Iter 85: loss 0.16208. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 20 Iter 86: loss 0.17466. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 20 Iter 86: loss 0.17466. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 20 Iter 87: loss 0.17382. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 20 Iter 87: loss 0.17382. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 20 Iter 88: loss 0.17826. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 20 Iter 88: loss 0.17826. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 20 Iter 89: loss 0.15599. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 20 Iter 89: loss 0.15599. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 20 Iter 90: loss 0.14989. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 20 Iter 90: loss 0.14989. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 20 Iter 91: loss 0.17523. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 20 Iter 91: loss 0.17523. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 20 Iter 92: loss 0.18439. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 20 Iter 92: loss 0.18439. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 20 Iter 93: loss 0.18982. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 20 Iter 93: loss 0.18982. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 20 Iter 94: loss 0.18425. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 20 Iter 94: loss 0.18425. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 20 Iter 95: loss 0.15290. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 20 Iter 95: loss 0.15290. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 20 Iter 96: loss 0.17230. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 20 Iter 96: loss 0.17230. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 20 Iter 97: loss 0.17201. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 20 Iter 97: loss 0.17201. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 20 Iter 98: loss 0.18466. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 20 Iter 98: loss 0.18466. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.09it/s]
Epoch 20 Iter 99: loss 0.16043. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.09it/s]
Epoch 20 Iter 99: loss 0.16043. :  44%|███████████████████▉                         | 99/224 [00:48<00:59,  2.09it/s]
Epoch 20 Iter 100: loss 0.16868. :  44%|███████████████████▍                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 20 Iter 100: loss 0.16868. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 20 Iter 101: loss 0.15331. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 20 Iter 101: loss 0.15331. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 102: loss 0.15485. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 102: loss 0.15485. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 103: loss 0.16872. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 20 Iter 103: loss 0.16872. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 20 Iter 104: loss 0.19327. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 20 Iter 104: loss 0.19327. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 20 Iter 105: loss 0.19599. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.05it/s]
Epoch 20 Iter 105: loss 0.19599. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 20 Iter 106: loss 0.18321. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 20 Iter 106: loss 0.18321. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 20 Iter 107: loss 0.16515. :  47%|████████████████████▎                      | 106/224 [00:52<00:56,  2.07it/s]
Epoch 20 Iter 107: loss 0.16515. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 20 Iter 108: loss 0.18099. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 20 Iter 108: loss 0.18099. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 20 Iter 109: loss 0.16489. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.06it/s]
Epoch 20 Iter 109: loss 0.16489. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.04it/s]
Epoch 20 Iter 110: loss 0.16136. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.04it/s]
Epoch 20 Iter 110: loss 0.16136. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 20 Iter 111: loss 0.15834. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 20 Iter 111: loss 0.15834. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 20 Iter 112: loss 0.16246. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 20 Iter 112: loss 0.16246. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 20 Iter 113: loss 0.16733. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 20 Iter 113: loss 0.16733. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 20 Iter 114: loss 0.18209. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 20 Iter 114: loss 0.18209. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.08it/s]
Epoch 20 Iter 115: loss 0.16085. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.08it/s]
Epoch 20 Iter 115: loss 0.16085. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 20 Iter 116: loss 0.18052. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.08it/s]
Epoch 20 Iter 116: loss 0.18052. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 20 Iter 117: loss 0.17067. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 20 Iter 117: loss 0.17067. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 20 Iter 118: loss 0.16750. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 20 Iter 118: loss 0.16750. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 20 Iter 119: loss 0.16425. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 20 Iter 119: loss 0.16425. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.09it/s]
Epoch 20 Iter 120: loss 0.14603. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.09it/s]
Epoch 20 Iter 120: loss 0.14603. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.10it/s]
Epoch 20 Iter 121: loss 0.15200. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.10it/s]
Epoch 20 Iter 121: loss 0.15200. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 20 Iter 122: loss 0.16506. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 20 Iter 122: loss 0.16506. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 20 Iter 123: loss 0.16978. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 20 Iter 123: loss 0.16978. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.09it/s]
Epoch 20 Iter 124: loss 0.18730. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.09it/s]
Epoch 20 Iter 124: loss 0.18730. :  55%|███████████████████████▊                   | 124/224 [01:00<00:47,  2.10it/s]
Epoch 20 Iter 125: loss 0.14830. :  55%|███████████████████████▊                   | 124/224 [01:00<00:47,  2.10it/s]
Epoch 20 Iter 125: loss 0.14830. :  56%|███████████████████████▉                   | 125/224 [01:00<00:46,  2.12it/s]
Epoch 20 Iter 126: loss 0.16778. :  56%|███████████████████████▉                   | 125/224 [01:01<00:46,  2.12it/s]
Epoch 20 Iter 126: loss 0.16778. :  56%|████████████████████████▏                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 20 Iter 127: loss 0.15918. :  56%|████████████████████████▏                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 20 Iter 127: loss 0.15918. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.10it/s]
Epoch 20 Iter 128: loss 0.15775. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.10it/s]
Epoch 20 Iter 128: loss 0.15775. :  57%|████████████████████████▌                  | 128/224 [01:02<00:45,  2.10it/s]
Epoch 20 Iter 129: loss 0.15922. :  57%|████████████████████████▌                  | 128/224 [01:02<00:45,  2.10it/s]
Epoch 20 Iter 129: loss 0.15922. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.09it/s]
Epoch 20 Iter 130: loss 0.18058. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.09it/s]
Epoch 20 Iter 130: loss 0.18058. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 20 Iter 131: loss 0.17333. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 20 Iter 131: loss 0.17333. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 20 Iter 132: loss 0.15437. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.08it/s]
Epoch 20 Iter 132: loss 0.15437. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 20 Iter 133: loss 0.18192. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 20 Iter 133: loss 0.18192. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 20 Iter 134: loss 0.15608. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.07it/s]
Epoch 20 Iter 134: loss 0.15608. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 20 Iter 135: loss 0.13879. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 20 Iter 135: loss 0.13879. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 20 Iter 136: loss 0.16397. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 20 Iter 136: loss 0.16397. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 20 Iter 137: loss 0.17320. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 20 Iter 137: loss 0.17320. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 20 Iter 138: loss 0.16760. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 20 Iter 138: loss 0.16760. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 20 Iter 139: loss 0.16409. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 20 Iter 139: loss 0.16409. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 140: loss 0.15512. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 140: loss 0.15512. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 20 Iter 141: loss 0.14919. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 20 Iter 141: loss 0.14919. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 20 Iter 142: loss 0.17387. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 20 Iter 142: loss 0.17387. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 20 Iter 143: loss 0.16323. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 20 Iter 143: loss 0.16323. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 20 Iter 144: loss 0.16278. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 20 Iter 144: loss 0.16278. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 20 Iter 145: loss 0.15821. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 20 Iter 145: loss 0.15821. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 20 Iter 146: loss 0.17322. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 20 Iter 146: loss 0.17322. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 20 Iter 147: loss 0.16272. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 20 Iter 147: loss 0.16272. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 20 Iter 148: loss 0.16869. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 20 Iter 148: loss 0.16869. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 20 Iter 149: loss 0.17526. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 20 Iter 149: loss 0.17526. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 20 Iter 150: loss 0.17123. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 20 Iter 150: loss 0.17123. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.06it/s]
Epoch 20 Iter 151: loss 0.15591. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.06it/s]
Epoch 20 Iter 151: loss 0.15591. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 20 Iter 152: loss 0.16228. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 20 Iter 152: loss 0.16228. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 20 Iter 153: loss 0.20230. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 20 Iter 153: loss 0.20230. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 20 Iter 154: loss 0.16518. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 20 Iter 154: loss 0.16518. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 20 Iter 155: loss 0.15999. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 20 Iter 155: loss 0.15999. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 20 Iter 156: loss 0.16351. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 20 Iter 156: loss 0.16351. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 20 Iter 157: loss 0.18102. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.05it/s]
Epoch 20 Iter 157: loss 0.18102. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 20 Iter 158: loss 0.15319. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 20 Iter 158: loss 0.15319. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 20 Iter 159: loss 0.19036. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 20 Iter 159: loss 0.19036. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 20 Iter 160: loss 0.16789. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 20 Iter 160: loss 0.16789. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 20 Iter 161: loss 0.14724. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 20 Iter 161: loss 0.14724. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 20 Iter 162: loss 0.17834. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 20 Iter 162: loss 0.17834. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 20 Iter 163: loss 0.16957. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 20 Iter 163: loss 0.16957. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 20 Iter 164: loss 0.15598. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 20 Iter 164: loss 0.15598. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 20 Iter 165: loss 0.16204. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 20 Iter 165: loss 0.16204. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 20 Iter 166: loss 0.14894. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 20 Iter 166: loss 0.14894. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 20 Iter 167: loss 0.15803. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.04it/s]
Epoch 20 Iter 167: loss 0.15803. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.04it/s]
Epoch 20 Iter 168: loss 0.14873. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.04it/s]
Epoch 20 Iter 168: loss 0.14873. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 20 Iter 169: loss 0.17658. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 20 Iter 169: loss 0.17658. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 20 Iter 170: loss 0.18359. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 20 Iter 170: loss 0.18359. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 20 Iter 171: loss 0.17544. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 20 Iter 171: loss 0.17544. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 20 Iter 172: loss 0.15976. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 172: loss 0.15976. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 173: loss 0.15860. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 173: loss 0.15860. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.15474. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.15474. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 175: loss 0.15754. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 175: loss 0.15754. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 20 Iter 176: loss 0.18124. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 176: loss 0.18124. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 177: loss 0.15580. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 177: loss 0.15580. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 20 Iter 178: loss 0.16015. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 20 Iter 178: loss 0.16015. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 20 Iter 179: loss 0.18387. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 20 Iter 179: loss 0.18387. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 20 Iter 180: loss 0.15809. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 20 Iter 180: loss 0.15809. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 20 Iter 181: loss 0.16938. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 20 Iter 181: loss 0.16938. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 20 Iter 182: loss 0.15472. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 20 Iter 182: loss 0.15472. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 20 Iter 183: loss 0.18120. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 20 Iter 183: loss 0.18120. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 20 Iter 184: loss 0.17181. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 20 Iter 184: loss 0.17181. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 20 Iter 185: loss 0.16870. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 20 Iter 185: loss 0.16870. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 20 Iter 186: loss 0.16066. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 20 Iter 186: loss 0.16066. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 20 Iter 187: loss 0.17532. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 20 Iter 187: loss 0.17532. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 20 Iter 188: loss 0.18319. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 20 Iter 188: loss 0.18319. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 20 Iter 189: loss 0.17915. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 20 Iter 189: loss 0.17915. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 20 Iter 190: loss 0.15653. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 20 Iter 190: loss 0.15653. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 20 Iter 191: loss 0.16550. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 20 Iter 191: loss 0.16550. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 20 Iter 192: loss 0.15389. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 20 Iter 192: loss 0.15389. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 193: loss 0.18441. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 193: loss 0.18441. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 20 Iter 194: loss 0.16593. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 20 Iter 194: loss 0.16593. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 20 Iter 195: loss 0.17857. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 20 Iter 195: loss 0.17857. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 20 Iter 196: loss 0.17118. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 20 Iter 196: loss 0.17118. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 20 Iter 197: loss 0.17438. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 20 Iter 197: loss 0.17438. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 20 Iter 198: loss 0.15845. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 20 Iter 198: loss 0.15845. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 20 Iter 199: loss 0.16193. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 20 Iter 199: loss 0.16193. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 20 Iter 200: loss 0.16598. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 20 Iter 200: loss 0.16598. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 20 Iter 201: loss 0.17197. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 201: loss 0.17197. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 202: loss 0.15317. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 202: loss 0.15317. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 20 Iter 203: loss 0.15378. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 20 Iter 203: loss 0.15378. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 20 Iter 204: loss 0.16397. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 20 Iter 204: loss 0.16397. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 20 Iter 205: loss 0.17031. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 20 Iter 205: loss 0.17031. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 20 Iter 206: loss 0.16697. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 20 Iter 206: loss 0.16697. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 20 Iter 207: loss 0.18051. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 20 Iter 207: loss 0.18051. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 20 Iter 208: loss 0.16893. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 20 Iter 208: loss 0.16893. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 20 Iter 209: loss 0.15729. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 20 Iter 209: loss 0.15729. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 20 Iter 210: loss 0.15671. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 20 Iter 210: loss 0.15671. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 20 Iter 211: loss 0.16288. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 20 Iter 211: loss 0.16288. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 20 Iter 212: loss 0.15967. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 20 Iter 212: loss 0.15967. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 20 Iter 213: loss 0.16844. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 20 Iter 213: loss 0.16844. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 20 Iter 214: loss 0.15896. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 20 Iter 214: loss 0.15896. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 20 Iter 215: loss 0.15237. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 20 Iter 215: loss 0.15237. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 20 Iter 216: loss 0.18671. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 20 Iter 216: loss 0.18671. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 20 Iter 217: loss 0.16423. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 20 Iter 217: loss 0.16423. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 20 Iter 218: loss 0.16447. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 20 Iter 218: loss 0.16447. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 20 Iter 219: loss 0.16062. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 20 Iter 219: loss 0.16062. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 20 Iter 220: loss 0.16232. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 20 Iter 220: loss 0.16232. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 20 Iter 221: loss 0.17375. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 221: loss 0.17375. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 222: loss 0.15879. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 222: loss 0.15879. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 20 Iter 223: loss 0.17718. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 20 Iter 223: loss 0.17718. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 20 Iter 224: loss 0.17020. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 20 Iter 224: loss 0.17020. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 20 Iter 224: loss 0.17020. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.14932. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.14932. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 21 Iter 2: loss 0.16203. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 21 Iter 2: loss 0.16203. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 21 Iter 3: loss 0.17177. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 21 Iter 3: loss 0.17177. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 21 Iter 4: loss 0.16855. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 21 Iter 4: loss 0.16855. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.17377. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.17377. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 21 Iter 6: loss 0.14623. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 21 Iter 6: loss 0.14623. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 21 Iter 7: loss 0.14829. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 21 Iter 7: loss 0.14829. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 21 Iter 8: loss 0.16016. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 21 Iter 8: loss 0.16016. :   4%|█▋                                             | 8/224 [00:03<01:46,  2.04it/s]
Epoch 21 Iter 9: loss 0.18232. :   4%|█▋                                             | 8/224 [00:04<01:46,  2.04it/s]
Epoch 21 Iter 9: loss 0.18232. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 21 Iter 10: loss 0.15211. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 21 Iter 10: loss 0.15211. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 21 Iter 11: loss 0.18405. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 21 Iter 11: loss 0.18405. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 21 Iter 12: loss 0.18992. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 21 Iter 12: loss 0.18992. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.04it/s]
Epoch 21 Iter 13: loss 0.17392. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.04it/s]
Epoch 21 Iter 13: loss 0.17392. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.15889. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.15889. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 21 Iter 15: loss 0.16207. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 21 Iter 15: loss 0.16207. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 21 Iter 16: loss 0.15853. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 21 Iter 16: loss 0.15853. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 21 Iter 17: loss 0.15989. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 21 Iter 17: loss 0.15989. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 21 Iter 18: loss 0.16297. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 21 Iter 18: loss 0.16297. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 21 Iter 19: loss 0.15445. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 19: loss 0.15445. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 21 Iter 20: loss 0.18649. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 21 Iter 20: loss 0.18649. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 21: loss 0.17174. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 21 Iter 21: loss 0.17174. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 21 Iter 22: loss 0.18236. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 21 Iter 22: loss 0.18236. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.03it/s]
Epoch 21 Iter 23: loss 0.15922. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.03it/s]
Epoch 21 Iter 23: loss 0.15922. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 21 Iter 24: loss 0.15869. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 21 Iter 24: loss 0.15869. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.04it/s]
Epoch 21 Iter 25: loss 0.16449. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.04it/s]
Epoch 21 Iter 25: loss 0.16449. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 21 Iter 26: loss 0.16866. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 21 Iter 26: loss 0.16866. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.04it/s]
Epoch 21 Iter 27: loss 0.16591. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 27: loss 0.16591. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 28: loss 0.17251. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 28: loss 0.17251. :  12%|█████▋                                       | 28/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 29: loss 0.15548. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.04it/s]
Epoch 21 Iter 29: loss 0.15548. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 21 Iter 30: loss 0.15781. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 21 Iter 30: loss 0.15781. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 21 Iter 31: loss 0.17569. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 21 Iter 31: loss 0.17569. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 21 Iter 32: loss 0.14544. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 21 Iter 32: loss 0.14544. :  14%|██████▍                                      | 32/224 [00:15<01:34,  2.04it/s]
Epoch 21 Iter 33: loss 0.15637. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.04it/s]
Epoch 21 Iter 33: loss 0.15637. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 21 Iter 34: loss 0.14724. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 21 Iter 34: loss 0.14724. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 21 Iter 35: loss 0.16856. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 21 Iter 35: loss 0.16856. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 21 Iter 36: loss 0.16076. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 21 Iter 36: loss 0.16076. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 21 Iter 37: loss 0.15579. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 21 Iter 37: loss 0.15579. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 21 Iter 38: loss 0.17283. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 21 Iter 38: loss 0.17283. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 21 Iter 39: loss 0.15030. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.05it/s]
Epoch 21 Iter 39: loss 0.15030. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 21 Iter 40: loss 0.15342. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 21 Iter 40: loss 0.15342. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 21 Iter 41: loss 0.16946. :  18%|████████                                     | 40/224 [00:20<01:30,  2.04it/s]
Epoch 21 Iter 41: loss 0.16946. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 21 Iter 42: loss 0.14964. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 21 Iter 42: loss 0.14964. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 21 Iter 43: loss 0.18261. :  19%|████████▍                                    | 42/224 [00:21<01:29,  2.04it/s]
Epoch 21 Iter 43: loss 0.18261. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 21 Iter 44: loss 0.15834. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 21 Iter 44: loss 0.15834. :  20%|████████▊                                    | 44/224 [00:21<01:29,  2.02it/s]
Epoch 21 Iter 45: loss 0.16051. :  20%|████████▊                                    | 44/224 [00:21<01:29,  2.02it/s]
Epoch 21 Iter 45: loss 0.16051. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 21 Iter 46: loss 0.16923. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 21 Iter 46: loss 0.16923. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 21 Iter 47: loss 0.14563. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 21 Iter 47: loss 0.14563. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 21 Iter 48: loss 0.17310. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 21 Iter 48: loss 0.17310. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 21 Iter 49: loss 0.17601. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 21 Iter 49: loss 0.17601. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 21 Iter 50: loss 0.18520. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 21 Iter 50: loss 0.18520. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 21 Iter 51: loss 0.16556. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 21 Iter 51: loss 0.16556. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 21 Iter 52: loss 0.16159. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 21 Iter 52: loss 0.16159. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 21 Iter 53: loss 0.17616. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 21 Iter 53: loss 0.17616. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 21 Iter 54: loss 0.16265. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 21 Iter 54: loss 0.16265. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 21 Iter 55: loss 0.18763. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 21 Iter 55: loss 0.18763. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 21 Iter 56: loss 0.14050. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 21 Iter 56: loss 0.14050. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 21 Iter 57: loss 0.18539. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 21 Iter 57: loss 0.18539. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 21 Iter 58: loss 0.15422. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 21 Iter 58: loss 0.15422. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 21 Iter 59: loss 0.16962. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 21 Iter 59: loss 0.16962. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 21 Iter 60: loss 0.19119. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 21 Iter 60: loss 0.19119. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 21 Iter 61: loss 0.18585. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 21 Iter 61: loss 0.18585. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 21 Iter 62: loss 0.17688. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 21 Iter 62: loss 0.17688. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 21 Iter 63: loss 0.16598. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 21 Iter 63: loss 0.16598. :  28%|████████████▋                                | 63/224 [00:30<01:19,  2.03it/s]
Epoch 21 Iter 64: loss 0.16286. :  28%|████████████▋                                | 63/224 [00:31<01:19,  2.03it/s]
Epoch 21 Iter 64: loss 0.16286. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 21 Iter 65: loss 0.16951. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 21 Iter 65: loss 0.16951. :  29%|█████████████                                | 65/224 [00:31<01:19,  1.99it/s]
Epoch 21 Iter 66: loss 0.16660. :  29%|█████████████                                | 65/224 [00:32<01:19,  1.99it/s]
Epoch 21 Iter 66: loss 0.16660. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.00it/s]
Epoch 21 Iter 67: loss 0.19057. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.00it/s]
Epoch 21 Iter 67: loss 0.19057. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.03it/s]
Epoch 21 Iter 68: loss 0.18507. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.03it/s]
Epoch 21 Iter 68: loss 0.18507. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 21 Iter 69: loss 0.16466. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 21 Iter 69: loss 0.16466. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 21 Iter 70: loss 0.18929. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 21 Iter 70: loss 0.18929. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.08it/s]
Epoch 21 Iter 71: loss 0.15421. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.08it/s]
Epoch 21 Iter 71: loss 0.15421. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 21 Iter 72: loss 0.16927. :  32%|██████████████▎                              | 71/224 [00:35<01:13,  2.08it/s]
Epoch 21 Iter 72: loss 0.16927. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 21 Iter 73: loss 0.14425. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 21 Iter 73: loss 0.14425. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.09it/s]
Epoch 21 Iter 74: loss 0.17352. :  33%|██████████████▋                              | 73/224 [00:36<01:12,  2.09it/s]
Epoch 21 Iter 74: loss 0.17352. :  33%|██████████████▊                              | 74/224 [00:36<01:11,  2.08it/s]
Epoch 21 Iter 75: loss 0.15798. :  33%|██████████████▊                              | 74/224 [00:36<01:11,  2.08it/s]
Epoch 21 Iter 75: loss 0.15798. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 21 Iter 76: loss 0.18966. :  33%|███████████████                              | 75/224 [00:37<01:12,  2.06it/s]
Epoch 21 Iter 76: loss 0.18966. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 21 Iter 77: loss 0.15822. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 21 Iter 77: loss 0.15822. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 21 Iter 78: loss 0.16536. :  34%|███████████████▍                             | 77/224 [00:38<01:11,  2.05it/s]
Epoch 21 Iter 78: loss 0.16536. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 21 Iter 79: loss 0.14679. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 21 Iter 79: loss 0.14679. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 21 Iter 80: loss 0.16409. :  35%|███████████████▊                             | 79/224 [00:39<01:10,  2.06it/s]
Epoch 21 Iter 80: loss 0.16409. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.06it/s]
Epoch 21 Iter 81: loss 0.18538. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.06it/s]
Epoch 21 Iter 81: loss 0.18538. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 21 Iter 82: loss 0.16417. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 21 Iter 82: loss 0.16417. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 21 Iter 83: loss 0.17408. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 83: loss 0.17408. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 84: loss 0.15181. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 84: loss 0.15181. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 85: loss 0.15210. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 21 Iter 85: loss 0.15210. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 21 Iter 86: loss 0.15166. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 21 Iter 86: loss 0.15166. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 21 Iter 87: loss 0.19077. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 21 Iter 87: loss 0.19077. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 21 Iter 88: loss 0.15887. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 21 Iter 88: loss 0.15887. :  39%|█████████████████▋                           | 88/224 [00:42<01:07,  2.03it/s]
Epoch 21 Iter 89: loss 0.17437. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.03it/s]
Epoch 21 Iter 89: loss 0.17437. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.02it/s]
Epoch 21 Iter 90: loss 0.16661. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.02it/s]
Epoch 21 Iter 90: loss 0.16661. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.03it/s]
Epoch 21 Iter 91: loss 0.16289. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.03it/s]
Epoch 21 Iter 91: loss 0.16289. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 92: loss 0.17889. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 92: loss 0.17889. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 21 Iter 93: loss 0.18073. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 21 Iter 93: loss 0.18073. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 21 Iter 94: loss 0.15633. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 21 Iter 94: loss 0.15633. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.04it/s]
Epoch 21 Iter 95: loss 0.15945. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 21 Iter 95: loss 0.15945. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 21 Iter 96: loss 0.16919. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 21 Iter 96: loss 0.16919. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 21 Iter 97: loss 0.16909. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 21 Iter 97: loss 0.16909. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 21 Iter 98: loss 0.18276. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 21 Iter 98: loss 0.18276. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 21 Iter 99: loss 0.16827. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 21 Iter 99: loss 0.16827. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.05it/s]
Epoch 21 Iter 100: loss 0.17491. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.05it/s]
Epoch 21 Iter 100: loss 0.17491. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 21 Iter 101: loss 0.16780. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 21 Iter 101: loss 0.16780. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 21 Iter 102: loss 0.17498. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 21 Iter 102: loss 0.17498. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 21 Iter 103: loss 0.16613. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 21 Iter 103: loss 0.16613. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 21 Iter 104: loss 0.14691. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 21 Iter 104: loss 0.14691. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 21 Iter 105: loss 0.18661. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 21 Iter 105: loss 0.18661. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 21 Iter 106: loss 0.15512. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 21 Iter 106: loss 0.15512. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 21 Iter 107: loss 0.16748. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.05it/s]
Epoch 21 Iter 107: loss 0.16748. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 108: loss 0.15174. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 108: loss 0.15174. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 109: loss 0.15339. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.06it/s]
Epoch 21 Iter 109: loss 0.15339. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 21 Iter 110: loss 0.16574. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 21 Iter 110: loss 0.16574. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 21 Iter 111: loss 0.16491. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.07it/s]
Epoch 21 Iter 111: loss 0.16491. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 21 Iter 112: loss 0.17192. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 21 Iter 112: loss 0.17192. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 21 Iter 113: loss 0.17722. :  50%|█████████████████████▌                     | 112/224 [00:55<00:53,  2.08it/s]
Epoch 21 Iter 113: loss 0.17722. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.09it/s]
Epoch 21 Iter 114: loss 0.15597. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.09it/s]
Epoch 21 Iter 114: loss 0.15597. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 21 Iter 115: loss 0.15849. :  51%|█████████████████████▉                     | 114/224 [00:56<00:52,  2.08it/s]
Epoch 21 Iter 115: loss 0.15849. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 21 Iter 116: loss 0.14549. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 21 Iter 116: loss 0.14549. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 21 Iter 117: loss 0.18547. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.07it/s]
Epoch 21 Iter 117: loss 0.18547. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 21 Iter 118: loss 0.14874. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 21 Iter 118: loss 0.14874. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 21 Iter 119: loss 0.17128. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 21 Iter 119: loss 0.17128. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 21 Iter 120: loss 0.18335. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 21 Iter 120: loss 0.18335. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 21 Iter 121: loss 0.17298. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 21 Iter 121: loss 0.17298. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 21 Iter 122: loss 0.17614. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 122: loss 0.17614. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 21 Iter 123: loss 0.14865. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 21 Iter 123: loss 0.14865. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.16442. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.16442. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 21 Iter 125: loss 0.14257. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 21 Iter 125: loss 0.14257. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.18120. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.18120. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 21 Iter 127: loss 0.17342. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 21 Iter 127: loss 0.17342. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 21 Iter 128: loss 0.16166. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.04it/s]
Epoch 21 Iter 128: loss 0.16166. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.03it/s]
Epoch 21 Iter 129: loss 0.15191. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.03it/s]
Epoch 21 Iter 129: loss 0.15191. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.04it/s]
Epoch 21 Iter 130: loss 0.18251. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.04it/s]
Epoch 21 Iter 130: loss 0.18251. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 21 Iter 131: loss 0.15513. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 21 Iter 131: loss 0.15513. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 21 Iter 132: loss 0.17148. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.04it/s]
Epoch 21 Iter 132: loss 0.17148. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 21 Iter 133: loss 0.16533. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 21 Iter 133: loss 0.16533. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 21 Iter 134: loss 0.15340. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 21 Iter 134: loss 0.15340. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 21 Iter 135: loss 0.16485. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 21 Iter 135: loss 0.16485. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 21 Iter 136: loss 0.17242. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 21 Iter 136: loss 0.17242. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 21 Iter 137: loss 0.15118. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 21 Iter 137: loss 0.15118. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 21 Iter 138: loss 0.14607. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 21 Iter 138: loss 0.14607. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 21 Iter 139: loss 0.16212. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 21 Iter 139: loss 0.16212. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 21 Iter 140: loss 0.18763. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 21 Iter 140: loss 0.18763. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 21 Iter 141: loss 0.15616. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 21 Iter 141: loss 0.15616. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 21 Iter 142: loss 0.16383. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 21 Iter 142: loss 0.16383. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 21 Iter 143: loss 0.14753. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 21 Iter 143: loss 0.14753. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 21 Iter 144: loss 0.18462. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 21 Iter 144: loss 0.18462. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 21 Iter 145: loss 0.15457. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 21 Iter 145: loss 0.15457. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 21 Iter 146: loss 0.15919. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 21 Iter 146: loss 0.15919. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.05it/s]
Epoch 21 Iter 147: loss 0.16235. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.05it/s]
Epoch 21 Iter 147: loss 0.16235. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 21 Iter 148: loss 0.15524. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.05it/s]
Epoch 21 Iter 148: loss 0.15524. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 21 Iter 149: loss 0.15716. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 21 Iter 149: loss 0.15716. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 21 Iter 150: loss 0.16330. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 21 Iter 150: loss 0.16330. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 21 Iter 151: loss 0.17067. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 21 Iter 151: loss 0.17067. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 21 Iter 152: loss 0.16192. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.05it/s]
Epoch 21 Iter 152: loss 0.16192. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 21 Iter 153: loss 0.16596. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 21 Iter 153: loss 0.16596. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 21 Iter 154: loss 0.16101. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.05it/s]
Epoch 21 Iter 154: loss 0.16101. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 21 Iter 155: loss 0.14723. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 21 Iter 155: loss 0.14723. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 21 Iter 156: loss 0.14082. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.06it/s]
Epoch 21 Iter 156: loss 0.14082. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 21 Iter 157: loss 0.16137. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 21 Iter 157: loss 0.16137. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 21 Iter 158: loss 0.17782. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 21 Iter 158: loss 0.17782. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 21 Iter 159: loss 0.16176. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 21 Iter 159: loss 0.16176. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 21 Iter 160: loss 0.18062. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 21 Iter 160: loss 0.18062. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 21 Iter 161: loss 0.17335. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 21 Iter 161: loss 0.17335. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 21 Iter 162: loss 0.15717. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 21 Iter 162: loss 0.15717. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 21 Iter 163: loss 0.16832. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 21 Iter 163: loss 0.16832. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 21 Iter 164: loss 0.17275. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 21 Iter 164: loss 0.17275. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 21 Iter 165: loss 0.16833. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.07it/s]
Epoch 21 Iter 165: loss 0.16833. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 21 Iter 166: loss 0.17222. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 21 Iter 166: loss 0.17222. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 21 Iter 167: loss 0.16000. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 21 Iter 167: loss 0.16000. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 21 Iter 168: loss 0.16495. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 21 Iter 168: loss 0.16495. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 21 Iter 169: loss 0.17622. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 21 Iter 169: loss 0.17622. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 21 Iter 170: loss 0.18888. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 21 Iter 170: loss 0.18888. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 21 Iter 171: loss 0.16313. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 21 Iter 171: loss 0.16313. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 21 Iter 172: loss 0.15799. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 21 Iter 172: loss 0.15799. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 21 Iter 173: loss 0.19516. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 21 Iter 173: loss 0.19516. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 21 Iter 174: loss 0.16392. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 21 Iter 174: loss 0.16392. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.04it/s]
Epoch 21 Iter 175: loss 0.15092. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.04it/s]
Epoch 21 Iter 175: loss 0.15092. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 21 Iter 176: loss 0.17086. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 21 Iter 176: loss 0.17086. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 21 Iter 177: loss 0.15831. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.08it/s]
Epoch 21 Iter 177: loss 0.15831. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.09it/s]
Epoch 21 Iter 178: loss 0.17388. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.09it/s]
Epoch 21 Iter 178: loss 0.17388. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 21 Iter 179: loss 0.16727. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.09it/s]
Epoch 21 Iter 179: loss 0.16727. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 21 Iter 180: loss 0.16403. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 21 Iter 180: loss 0.16403. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.16772. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.16772. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 21 Iter 182: loss 0.18403. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 21 Iter 182: loss 0.18403. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 21 Iter 183: loss 0.16834. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.05it/s]
Epoch 21 Iter 183: loss 0.16834. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:20,  2.04it/s]
Epoch 21 Iter 184: loss 0.14682. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:20,  2.04it/s]
Epoch 21 Iter 184: loss 0.14682. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 21 Iter 185: loss 0.17504. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.05it/s]
Epoch 21 Iter 185: loss 0.17504. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.17219. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.17219. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 21 Iter 187: loss 0.17326. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 21 Iter 187: loss 0.17326. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 21 Iter 188: loss 0.15060. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 21 Iter 188: loss 0.15060. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 21 Iter 189: loss 0.17546. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.07it/s]
Epoch 21 Iter 189: loss 0.17546. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 21 Iter 190: loss 0.17508. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 21 Iter 190: loss 0.17508. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 21 Iter 191: loss 0.17789. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 21 Iter 191: loss 0.17789. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 21 Iter 192: loss 0.18626. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 21 Iter 192: loss 0.18626. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 21 Iter 193: loss 0.17981. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 21 Iter 193: loss 0.17981. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 21 Iter 194: loss 0.16992. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 21 Iter 194: loss 0.16992. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 21 Iter 195: loss 0.18597. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 21 Iter 195: loss 0.18597. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 21 Iter 196: loss 0.15841. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 21 Iter 196: loss 0.15841. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 21 Iter 197: loss 0.17968. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 21 Iter 197: loss 0.17968. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 21 Iter 198: loss 0.16977. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 21 Iter 198: loss 0.16977. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 21 Iter 199: loss 0.17189. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 21 Iter 199: loss 0.17189. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 21 Iter 200: loss 0.17723. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:11,  2.09it/s]
Epoch 21 Iter 200: loss 0.17723. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 21 Iter 201: loss 0.18281. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 21 Iter 201: loss 0.18281. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.09it/s]
Epoch 21 Iter 202: loss 0.15008. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.09it/s]
Epoch 21 Iter 202: loss 0.15008. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.10it/s]
Epoch 21 Iter 203: loss 0.17859. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.10it/s]
Epoch 21 Iter 203: loss 0.17859. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:09,  2.10it/s]
Epoch 21 Iter 204: loss 0.16972. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:09,  2.10it/s]
Epoch 21 Iter 204: loss 0.16972. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 21 Iter 205: loss 0.16592. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 21 Iter 205: loss 0.16592. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 21 Iter 206: loss 0.16784. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.08it/s]
Epoch 21 Iter 206: loss 0.16784. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.09it/s]
Epoch 21 Iter 207: loss 0.17725. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.09it/s]
Epoch 21 Iter 207: loss 0.17725. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 21 Iter 208: loss 0.17362. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.09it/s]
Epoch 21 Iter 208: loss 0.17362. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.10it/s]
Epoch 21 Iter 209: loss 0.14780. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.10it/s]
Epoch 21 Iter 209: loss 0.14780. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 21 Iter 210: loss 0.17111. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.09it/s]
Epoch 21 Iter 210: loss 0.17111. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.10it/s]
Epoch 21 Iter 211: loss 0.15683. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.10it/s]
Epoch 21 Iter 211: loss 0.15683. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.10it/s]
Epoch 21 Iter 212: loss 0.16460. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.10it/s]
Epoch 21 Iter 212: loss 0.16460. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 21 Iter 213: loss 0.16654. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 21 Iter 213: loss 0.16654. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 21 Iter 214: loss 0.16562. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 21 Iter 214: loss 0.16562. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 21 Iter 215: loss 0.17390. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 21 Iter 215: loss 0.17390. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 21 Iter 216: loss 0.17537. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.05it/s]
Epoch 21 Iter 216: loss 0.17537. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 21 Iter 217: loss 0.16636. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 21 Iter 217: loss 0.16636. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 21 Iter 218: loss 0.16747. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 21 Iter 218: loss 0.16747. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 21 Iter 219: loss 0.16934. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.04it/s]
Epoch 21 Iter 219: loss 0.16934. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.03it/s]
Epoch 21 Iter 220: loss 0.16816. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.03it/s]
Epoch 21 Iter 220: loss 0.16816. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.04it/s]
Epoch 21 Iter 221: loss 0.17914. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.04it/s]
Epoch 21 Iter 221: loss 0.17914. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.04it/s]
Epoch 21 Iter 222: loss 0.15516. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.04it/s]
Epoch 21 Iter 222: loss 0.15516. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.03it/s]
Epoch 21 Iter 223: loss 0.15045. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.03it/s]
Epoch 21 Iter 223: loss 0.15045. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 21 Iter 224: loss 0.16032. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 21 Iter 224: loss 0.16032. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.03it/s]
Epoch 21 Iter 224: loss 0.16032. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16652
    Valid loss: 0.17085
       Valid loss recons: 0.17085
       Valid loss KL-D:   50145.12287
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.16903. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.16903. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 22 Iter 2: loss 0.16389. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 22 Iter 2: loss 0.16389. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 22 Iter 3: loss 0.15830. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 22 Iter 3: loss 0.15830. :   1%|▋                                              | 3/224 [00:01<01:49,  2.02it/s]
Epoch 22 Iter 4: loss 0.17818. :   1%|▋                                              | 3/224 [00:01<01:49,  2.02it/s]
Epoch 22 Iter 4: loss 0.17818. :   2%|▊                                              | 4/224 [00:01<01:47,  2.04it/s]
Epoch 22 Iter 5: loss 0.18110. :   2%|▊                                              | 4/224 [00:02<01:47,  2.04it/s]
Epoch 22 Iter 5: loss 0.18110. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 22 Iter 6: loss 0.15823. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 22 Iter 6: loss 0.15823. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 22 Iter 7: loss 0.15629. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 22 Iter 7: loss 0.15629. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 22 Iter 8: loss 0.16197. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 22 Iter 8: loss 0.16197. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 22 Iter 9: loss 0.16294. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 22 Iter 9: loss 0.16294. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 22 Iter 10: loss 0.18472. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 22 Iter 10: loss 0.18472. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 22 Iter 11: loss 0.16584. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 22 Iter 11: loss 0.16584. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 22 Iter 12: loss 0.16984. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 22 Iter 12: loss 0.16984. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.06it/s]
Epoch 22 Iter 13: loss 0.17132. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.06it/s]
Epoch 22 Iter 13: loss 0.17132. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.03it/s]
Epoch 22 Iter 14: loss 0.16321. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.03it/s]
Epoch 22 Iter 14: loss 0.16321. :   6%|██▊                                          | 14/224 [00:06<01:43,  2.03it/s]
Epoch 22 Iter 15: loss 0.16202. :   6%|██▊                                          | 14/224 [00:07<01:43,  2.03it/s]
Epoch 22 Iter 15: loss 0.16202. :   7%|███                                          | 15/224 [00:07<01:43,  2.03it/s]
Epoch 22 Iter 16: loss 0.17175. :   7%|███                                          | 15/224 [00:07<01:43,  2.03it/s]
Epoch 22 Iter 16: loss 0.17175. :   7%|███▏                                         | 16/224 [00:07<01:43,  2.01it/s]
Epoch 22 Iter 17: loss 0.18373. :   7%|███▏                                         | 16/224 [00:08<01:43,  2.01it/s]
Epoch 22 Iter 17: loss 0.18373. :   8%|███▍                                         | 17/224 [00:08<01:42,  2.02it/s]
Epoch 22 Iter 18: loss 0.16060. :   8%|███▍                                         | 17/224 [00:08<01:42,  2.02it/s]
Epoch 22 Iter 18: loss 0.16060. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.03it/s]
Epoch 22 Iter 19: loss 0.15427. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.03it/s]
Epoch 22 Iter 19: loss 0.15427. :   8%|███▊                                         | 19/224 [00:09<01:41,  2.03it/s]
Epoch 22 Iter 20: loss 0.15774. :   8%|███▊                                         | 19/224 [00:09<01:41,  2.03it/s]
Epoch 22 Iter 20: loss 0.15774. :   9%|████                                         | 20/224 [00:09<01:40,  2.03it/s]
Epoch 22 Iter 21: loss 0.16732. :   9%|████                                         | 20/224 [00:10<01:40,  2.03it/s]
Epoch 22 Iter 21: loss 0.16732. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 22 Iter 22: loss 0.15540. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 22 Iter 22: loss 0.15540. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.03it/s]
Epoch 22 Iter 23: loss 0.17170. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.03it/s]
Epoch 22 Iter 23: loss 0.17170. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 22 Iter 24: loss 0.15525. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 22 Iter 24: loss 0.15525. :  11%|████▊                                        | 24/224 [00:11<01:38,  2.04it/s]
Epoch 22 Iter 25: loss 0.16860. :  11%|████▊                                        | 24/224 [00:12<01:38,  2.04it/s]
Epoch 22 Iter 25: loss 0.16860. :  11%|█████                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 22 Iter 26: loss 0.18319. :  11%|█████                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 22 Iter 26: loss 0.18319. :  12%|█████▏                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 22 Iter 27: loss 0.17179. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 22 Iter 27: loss 0.17179. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 22 Iter 28: loss 0.14838. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 22 Iter 28: loss 0.14838. :  12%|█████▋                                       | 28/224 [00:13<01:37,  2.01it/s]
Epoch 22 Iter 29: loss 0.14378. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.01it/s]
Epoch 22 Iter 29: loss 0.14378. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.01it/s]
Epoch 22 Iter 30: loss 0.16708. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.01it/s]
Epoch 22 Iter 30: loss 0.16708. :  13%|██████                                       | 30/224 [00:14<01:35,  2.04it/s]
Epoch 22 Iter 31: loss 0.16008. :  13%|██████                                       | 30/224 [00:15<01:35,  2.04it/s]
Epoch 22 Iter 31: loss 0.16008. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 22 Iter 32: loss 0.16663. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 22 Iter 32: loss 0.16663. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 22 Iter 33: loss 0.17543. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 22 Iter 33: loss 0.17543. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 22 Iter 34: loss 0.14729. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 22 Iter 34: loss 0.14729. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 22 Iter 35: loss 0.17540. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 22 Iter 35: loss 0.17540. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 22 Iter 36: loss 0.18135. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 22 Iter 36: loss 0.18135. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.04it/s]
Epoch 22 Iter 37: loss 0.16918. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.04it/s]
Epoch 22 Iter 37: loss 0.16918. :  17%|███████▍                                     | 37/224 [00:18<01:32,  2.03it/s]
Epoch 22 Iter 38: loss 0.15860. :  17%|███████▍                                     | 37/224 [00:18<01:32,  2.03it/s]
Epoch 22 Iter 38: loss 0.15860. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.04it/s]
Epoch 22 Iter 39: loss 0.14892. :  17%|███████▋                                     | 38/224 [00:19<01:31,  2.04it/s]
Epoch 22 Iter 39: loss 0.14892. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 22 Iter 40: loss 0.16167. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 22 Iter 40: loss 0.16167. :  18%|████████                                     | 40/224 [00:19<01:30,  2.03it/s]
Epoch 22 Iter 41: loss 0.16760. :  18%|████████                                     | 40/224 [00:20<01:30,  2.03it/s]
Epoch 22 Iter 41: loss 0.16760. :  18%|████████▏                                    | 41/224 [00:20<01:30,  2.02it/s]
Epoch 22 Iter 42: loss 0.17473. :  18%|████████▏                                    | 41/224 [00:20<01:30,  2.02it/s]
Epoch 22 Iter 42: loss 0.17473. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.03it/s]
Epoch 22 Iter 43: loss 0.15968. :  19%|████████▍                                    | 42/224 [00:21<01:29,  2.03it/s]
Epoch 22 Iter 43: loss 0.15968. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.03it/s]
Epoch 22 Iter 44: loss 0.15947. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.03it/s]
Epoch 22 Iter 44: loss 0.15947. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 22 Iter 45: loss 0.17726. :  20%|████████▊                                    | 44/224 [00:22<01:28,  2.04it/s]
Epoch 22 Iter 45: loss 0.17726. :  20%|█████████                                    | 45/224 [00:22<01:28,  2.03it/s]
Epoch 22 Iter 46: loss 0.16256. :  20%|█████████                                    | 45/224 [00:22<01:28,  2.03it/s]
Epoch 22 Iter 46: loss 0.16256. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 22 Iter 47: loss 0.16202. :  21%|█████████▏                                   | 46/224 [00:23<01:27,  2.03it/s]
Epoch 22 Iter 47: loss 0.16202. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 22 Iter 48: loss 0.18809. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 22 Iter 48: loss 0.18809. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 22 Iter 49: loss 0.18463. :  21%|█████████▋                                   | 48/224 [00:24<01:26,  2.03it/s]
Epoch 22 Iter 49: loss 0.18463. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 22 Iter 50: loss 0.15964. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 22 Iter 50: loss 0.15964. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 22 Iter 51: loss 0.15647. :  22%|██████████                                   | 50/224 [00:25<01:24,  2.05it/s]
Epoch 22 Iter 51: loss 0.15647. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 22 Iter 52: loss 0.15108. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 22 Iter 52: loss 0.15108. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 22 Iter 53: loss 0.16154. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.04it/s]
Epoch 22 Iter 53: loss 0.16154. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.03it/s]
Epoch 22 Iter 54: loss 0.18072. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.03it/s]
Epoch 22 Iter 54: loss 0.18072. :  24%|██████████▊                                  | 54/224 [00:26<01:24,  2.02it/s]
Epoch 22 Iter 55: loss 0.16195. :  24%|██████████▊                                  | 54/224 [00:27<01:24,  2.02it/s]
Epoch 22 Iter 55: loss 0.16195. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 22 Iter 56: loss 0.18313. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 22 Iter 56: loss 0.18313. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.03it/s]
Epoch 22 Iter 57: loss 0.16069. :  25%|███████████▎                                 | 56/224 [00:28<01:22,  2.03it/s]
Epoch 22 Iter 57: loss 0.16069. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 22 Iter 58: loss 0.16819. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 22 Iter 58: loss 0.16819. :  26%|███████████▋                                 | 58/224 [00:28<01:23,  2.00it/s]
Epoch 22 Iter 59: loss 0.14830. :  26%|███████████▋                                 | 58/224 [00:28<01:23,  2.00it/s]
Epoch 22 Iter 59: loss 0.14830. :  26%|███████████▊                                 | 59/224 [00:28<01:21,  2.03it/s]
Epoch 22 Iter 60: loss 0.16488. :  26%|███████████▊                                 | 59/224 [00:29<01:21,  2.03it/s]
Epoch 22 Iter 60: loss 0.16488. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 22 Iter 61: loss 0.15792. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 22 Iter 61: loss 0.15792. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 22 Iter 62: loss 0.16660. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.04it/s]
Epoch 22 Iter 62: loss 0.16660. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 22 Iter 63: loss 0.16149. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 22 Iter 63: loss 0.16149. :  28%|████████████▋                                | 63/224 [00:30<01:19,  2.03it/s]
Epoch 22 Iter 64: loss 0.16701. :  28%|████████████▋                                | 63/224 [00:31<01:19,  2.03it/s]
Epoch 22 Iter 64: loss 0.16701. :  29%|████████████▊                                | 64/224 [00:31<01:19,  2.01it/s]
Epoch 22 Iter 65: loss 0.16117. :  29%|████████████▊                                | 64/224 [00:31<01:19,  2.01it/s]
Epoch 22 Iter 65: loss 0.16117. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.02it/s]
Epoch 22 Iter 66: loss 0.18221. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.02it/s]
Epoch 22 Iter 66: loss 0.18221. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.02it/s]
Epoch 22 Iter 67: loss 0.16150. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.02it/s]
Epoch 22 Iter 67: loss 0.16150. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.02it/s]
Epoch 22 Iter 68: loss 0.15658. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.02it/s]
Epoch 22 Iter 68: loss 0.15658. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 22 Iter 69: loss 0.18282. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 22 Iter 69: loss 0.18282. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.02it/s]
Epoch 22 Iter 70: loss 0.14771. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 22 Iter 70: loss 0.14771. :  31%|██████████████                               | 70/224 [00:34<01:16,  2.02it/s]
Epoch 22 Iter 71: loss 0.18875. :  31%|██████████████                               | 70/224 [00:34<01:16,  2.02it/s]
Epoch 22 Iter 71: loss 0.18875. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.02it/s]
Epoch 22 Iter 72: loss 0.17316. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 22 Iter 72: loss 0.17316. :  32%|██████████████▍                              | 72/224 [00:35<01:15,  2.02it/s]
Epoch 22 Iter 73: loss 0.15642. :  32%|██████████████▍                              | 72/224 [00:35<01:15,  2.02it/s]
Epoch 22 Iter 73: loss 0.15642. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.03it/s]
Epoch 22 Iter 74: loss 0.18114. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.03it/s]
Epoch 22 Iter 74: loss 0.18114. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 22 Iter 75: loss 0.15707. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 22 Iter 75: loss 0.15707. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.04it/s]
Epoch 22 Iter 76: loss 0.16936. :  33%|███████████████                              | 75/224 [00:37<01:12,  2.04it/s]
Epoch 22 Iter 76: loss 0.16936. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.01it/s]
Epoch 22 Iter 77: loss 0.17436. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.01it/s]
Epoch 22 Iter 77: loss 0.17436. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.02it/s]
Epoch 22 Iter 78: loss 0.18060. :  34%|███████████████▍                             | 77/224 [00:38<01:12,  2.02it/s]
Epoch 22 Iter 78: loss 0.18060. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.03it/s]
Epoch 22 Iter 79: loss 0.16480. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.03it/s]
Epoch 22 Iter 79: loss 0.16480. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 22 Iter 80: loss 0.16887. :  35%|███████████████▊                             | 79/224 [00:39<01:11,  2.03it/s]
Epoch 22 Iter 80: loss 0.16887. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 22 Iter 81: loss 0.16842. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 22 Iter 81: loss 0.16842. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.03it/s]
Epoch 22 Iter 82: loss 0.18611. :  36%|████████████████▎                            | 81/224 [00:40<01:10,  2.03it/s]
Epoch 22 Iter 82: loss 0.18611. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.03it/s]
Epoch 22 Iter 83: loss 0.18283. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.03it/s]
Epoch 22 Iter 83: loss 0.18283. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 22 Iter 84: loss 0.16508. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.04it/s]
Epoch 22 Iter 84: loss 0.16508. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 22 Iter 85: loss 0.15780. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 22 Iter 85: loss 0.15780. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 22 Iter 86: loss 0.15004. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.04it/s]
Epoch 22 Iter 86: loss 0.15004. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.02it/s]
Epoch 22 Iter 87: loss 0.16106. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.02it/s]
Epoch 22 Iter 87: loss 0.16106. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.02it/s]
Epoch 22 Iter 88: loss 0.16445. :  39%|█████████████████▍                           | 87/224 [00:43<01:07,  2.02it/s]
Epoch 22 Iter 88: loss 0.16445. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.02it/s]
Epoch 22 Iter 89: loss 0.16793. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.02it/s]
Epoch 22 Iter 89: loss 0.16793. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.03it/s]
Epoch 22 Iter 90: loss 0.16046. :  40%|█████████████████▉                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 22 Iter 90: loss 0.16046. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 22 Iter 91: loss 0.14837. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 22 Iter 91: loss 0.14837. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.03it/s]
Epoch 22 Iter 92: loss 0.16068. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.03it/s]
Epoch 22 Iter 92: loss 0.16068. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 22 Iter 93: loss 0.17195. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 22 Iter 93: loss 0.17195. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 22 Iter 94: loss 0.15852. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.04it/s]
Epoch 22 Iter 94: loss 0.15852. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 22 Iter 95: loss 0.17023. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 22 Iter 95: loss 0.17023. :  42%|███████████████████                          | 95/224 [00:46<01:04,  2.01it/s]
Epoch 22 Iter 96: loss 0.19389. :  42%|███████████████████                          | 95/224 [00:47<01:04,  2.01it/s]
Epoch 22 Iter 96: loss 0.19389. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 22 Iter 97: loss 0.16726. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 22 Iter 97: loss 0.16726. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.03it/s]
Epoch 22 Iter 98: loss 0.18037. :  43%|███████████████████▍                         | 97/224 [00:48<01:02,  2.03it/s]
Epoch 22 Iter 98: loss 0.18037. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.03it/s]
Epoch 22 Iter 99: loss 0.17562. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.03it/s]
Epoch 22 Iter 99: loss 0.17562. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.05it/s]
Epoch 22 Iter 100: loss 0.17620. :  44%|███████████████████▍                        | 99/224 [00:49<01:01,  2.05it/s]
Epoch 22 Iter 100: loss 0.17620. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.04it/s]
Epoch 22 Iter 101: loss 0.17869. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.04it/s]
Epoch 22 Iter 101: loss 0.17869. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 22 Iter 102: loss 0.14684. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.05it/s]
Epoch 22 Iter 102: loss 0.14684. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 22 Iter 103: loss 0.16157. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 22 Iter 103: loss 0.16157. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.03it/s]
Epoch 22 Iter 104: loss 0.17712. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.03it/s]
Epoch 22 Iter 104: loss 0.17712. :  46%|███████████████████▉                       | 104/224 [00:51<00:59,  2.03it/s]
Epoch 22 Iter 105: loss 0.16198. :  46%|███████████████████▉                       | 104/224 [00:51<00:59,  2.03it/s]
Epoch 22 Iter 105: loss 0.16198. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.03it/s]
Epoch 22 Iter 106: loss 0.15575. :  47%|████████████████████▏                      | 105/224 [00:52<00:58,  2.03it/s]
Epoch 22 Iter 106: loss 0.15575. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.03it/s]
Epoch 22 Iter 107: loss 0.15909. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.03it/s]
Epoch 22 Iter 107: loss 0.15909. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.05it/s]
Epoch 22 Iter 108: loss 0.15221. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.05it/s]
Epoch 22 Iter 108: loss 0.15221. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.03it/s]
Epoch 22 Iter 109: loss 0.17351. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.03it/s]
Epoch 22 Iter 109: loss 0.17351. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.04it/s]
Epoch 22 Iter 110: loss 0.15697. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.04it/s]
Epoch 22 Iter 110: loss 0.15697. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 22 Iter 111: loss 0.14580. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 22 Iter 111: loss 0.14580. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.03it/s]
Epoch 22 Iter 112: loss 0.16523. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 22 Iter 112: loss 0.16523. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 22 Iter 113: loss 0.15690. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 22 Iter 113: loss 0.15690. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.03it/s]
Epoch 22 Iter 114: loss 0.17542. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 22 Iter 114: loss 0.17542. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 22 Iter 115: loss 0.18114. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 22 Iter 115: loss 0.18114. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.03it/s]
Epoch 22 Iter 116: loss 0.16892. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.03it/s]
Epoch 22 Iter 116: loss 0.16892. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.05it/s]
Epoch 22 Iter 117: loss 0.17279. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.05it/s]
Epoch 22 Iter 117: loss 0.17279. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 22 Iter 118: loss 0.16775. :  52%|██████████████████████▍                    | 117/224 [00:58<00:51,  2.07it/s]
Epoch 22 Iter 118: loss 0.16775. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.05it/s]
Epoch 22 Iter 119: loss 0.15305. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.05it/s]
Epoch 22 Iter 119: loss 0.15305. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 22 Iter 120: loss 0.16900. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 22 Iter 120: loss 0.16900. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 22 Iter 121: loss 0.16462. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.06it/s]
Epoch 22 Iter 121: loss 0.16462. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 122: loss 0.18216. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 122: loss 0.18216. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.16292. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.16292. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 22 Iter 124: loss 0.16716. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 22 Iter 124: loss 0.16716. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.16796. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.16796. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 22 Iter 126: loss 0.14782. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 22 Iter 126: loss 0.14782. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 22 Iter 127: loss 0.19275. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.08it/s]
Epoch 22 Iter 127: loss 0.19275. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 22 Iter 128: loss 0.17468. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 22 Iter 128: loss 0.17468. :  57%|████████████████████████▌                  | 128/224 [01:02<00:45,  2.09it/s]
Epoch 22 Iter 129: loss 0.16556. :  57%|████████████████████████▌                  | 128/224 [01:03<00:45,  2.09it/s]
Epoch 22 Iter 129: loss 0.16556. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.08it/s]
Epoch 22 Iter 130: loss 0.16431. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.08it/s]
Epoch 22 Iter 130: loss 0.16431. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 22 Iter 131: loss 0.16475. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.07it/s]
Epoch 22 Iter 131: loss 0.16475. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 22 Iter 132: loss 0.15241. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 22 Iter 132: loss 0.15241. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 22 Iter 133: loss 0.19311. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 22 Iter 133: loss 0.19311. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.07it/s]
Epoch 22 Iter 134: loss 0.16734. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.07it/s]
Epoch 22 Iter 134: loss 0.16734. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 22 Iter 135: loss 0.18695. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.06it/s]
Epoch 22 Iter 135: loss 0.18695. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 22 Iter 136: loss 0.15009. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 22 Iter 136: loss 0.15009. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 22 Iter 137: loss 0.17897. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.06it/s]
Epoch 22 Iter 137: loss 0.17897. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 22 Iter 138: loss 0.14965. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 22 Iter 138: loss 0.14965. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 22 Iter 139: loss 0.16333. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 22 Iter 139: loss 0.16333. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 22 Iter 140: loss 0.16629. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 22 Iter 140: loss 0.16629. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 22 Iter 141: loss 0.17878. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.05it/s]
Epoch 22 Iter 141: loss 0.17878. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.05it/s]
Epoch 22 Iter 142: loss 0.15191. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.05it/s]
Epoch 22 Iter 142: loss 0.15191. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 22 Iter 143: loss 0.16302. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.06it/s]
Epoch 22 Iter 143: loss 0.16302. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 22 Iter 144: loss 0.16047. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 22 Iter 144: loss 0.16047. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 22 Iter 145: loss 0.17729. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 22 Iter 145: loss 0.17729. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 22 Iter 146: loss 0.16351. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 22 Iter 146: loss 0.16351. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 22 Iter 147: loss 0.15248. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.06it/s]
Epoch 22 Iter 147: loss 0.15248. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.06it/s]
Epoch 22 Iter 148: loss 0.15623. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.06it/s]
Epoch 22 Iter 148: loss 0.15623. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.05it/s]
Epoch 22 Iter 149: loss 0.18552. :  66%|████████████████████████████▍              | 148/224 [01:13<00:36,  2.05it/s]
Epoch 22 Iter 149: loss 0.18552. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 22 Iter 150: loss 0.18733. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 22 Iter 150: loss 0.18733. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 22 Iter 151: loss 0.15949. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.05it/s]
Epoch 22 Iter 151: loss 0.15949. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 22 Iter 152: loss 0.16569. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 22 Iter 152: loss 0.16569. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.06it/s]
Epoch 22 Iter 153: loss 0.16682. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.06it/s]
Epoch 22 Iter 153: loss 0.16682. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 22 Iter 154: loss 0.16965. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 22 Iter 154: loss 0.16965. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.17074. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.17074. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 22 Iter 156: loss 0.15720. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.07it/s]
Epoch 22 Iter 156: loss 0.15720. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 22 Iter 157: loss 0.14636. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 22 Iter 157: loss 0.14636. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 22 Iter 158: loss 0.16541. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.06it/s]
Epoch 22 Iter 158: loss 0.16541. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.16585. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.16585. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.15169. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.15169. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.16884. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.16884. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.16132. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.16132. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 22 Iter 163: loss 0.16322. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 22 Iter 163: loss 0.16322. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 22 Iter 164: loss 0.14487. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 22 Iter 164: loss 0.14487. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 22 Iter 165: loss 0.17678. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 22 Iter 165: loss 0.17678. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 22 Iter 166: loss 0.17156. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:29,  2.03it/s]
Epoch 22 Iter 166: loss 0.17156. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.03it/s]
Epoch 22 Iter 167: loss 0.16245. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.03it/s]
Epoch 22 Iter 167: loss 0.16245. :  75%|████████████████████████████████           | 167/224 [01:21<00:28,  2.03it/s]
Epoch 22 Iter 168: loss 0.15962. :  75%|████████████████████████████████           | 167/224 [01:22<00:28,  2.03it/s]
Epoch 22 Iter 168: loss 0.15962. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.02it/s]
Epoch 22 Iter 169: loss 0.17684. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.02it/s]
Epoch 22 Iter 169: loss 0.17684. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:27,  2.02it/s]
Epoch 22 Iter 170: loss 0.18398. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:27,  2.02it/s]
Epoch 22 Iter 170: loss 0.18398. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.02it/s]
Epoch 22 Iter 171: loss 0.17758. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.02it/s]
Epoch 22 Iter 171: loss 0.17758. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:26,  2.02it/s]
Epoch 22 Iter 172: loss 0.14595. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:26,  2.02it/s]
Epoch 22 Iter 172: loss 0.14595. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.03it/s]
Epoch 22 Iter 173: loss 0.16454. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.03it/s]
Epoch 22 Iter 173: loss 0.16454. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 22 Iter 174: loss 0.16212. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 22 Iter 174: loss 0.16212. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.04it/s]
Epoch 22 Iter 175: loss 0.15679. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.04it/s]
Epoch 22 Iter 175: loss 0.15679. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.04it/s]
Epoch 22 Iter 176: loss 0.17095. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.04it/s]
Epoch 22 Iter 176: loss 0.17095. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 22 Iter 177: loss 0.16397. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 22 Iter 177: loss 0.16397. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 22 Iter 178: loss 0.17884. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.06it/s]
Epoch 22 Iter 178: loss 0.17884. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 22 Iter 179: loss 0.18779. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 22 Iter 179: loss 0.18779. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 22 Iter 180: loss 0.18293. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.06it/s]
Epoch 22 Iter 180: loss 0.18293. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.06it/s]
Epoch 22 Iter 181: loss 0.15340. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.06it/s]
Epoch 22 Iter 181: loss 0.15340. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 22 Iter 182: loss 0.17696. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.05it/s]
Epoch 22 Iter 182: loss 0.17696. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.05it/s]
Epoch 22 Iter 183: loss 0.15909. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.05it/s]
Epoch 22 Iter 183: loss 0.15909. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 22 Iter 184: loss 0.15637. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.05it/s]
Epoch 22 Iter 184: loss 0.15637. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.03it/s]
Epoch 22 Iter 185: loss 0.15500. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.03it/s]
Epoch 22 Iter 185: loss 0.15500. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.03it/s]
Epoch 22 Iter 186: loss 0.15492. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:19,  2.03it/s]
Epoch 22 Iter 186: loss 0.15492. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.04it/s]
Epoch 22 Iter 187: loss 0.18397. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.04it/s]
Epoch 22 Iter 187: loss 0.18397. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.02it/s]
Epoch 22 Iter 188: loss 0.14684. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:18,  2.02it/s]
Epoch 22 Iter 188: loss 0.14684. :  84%|████████████████████████████████████       | 188/224 [01:32<00:18,  1.99it/s]
Epoch 22 Iter 189: loss 0.17791. :  84%|████████████████████████████████████       | 188/224 [01:32<00:18,  1.99it/s]
Epoch 22 Iter 189: loss 0.17791. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  1.99it/s]
Epoch 22 Iter 190: loss 0.16994. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:17,  1.99it/s]
Epoch 22 Iter 190: loss 0.16994. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.02it/s]
Epoch 22 Iter 191: loss 0.17738. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.02it/s]
Epoch 22 Iter 191: loss 0.17738. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.01it/s]
Epoch 22 Iter 192: loss 0.17080. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:16,  2.01it/s]
Epoch 22 Iter 192: loss 0.17080. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:16,  2.00it/s]
Epoch 22 Iter 193: loss 0.16002. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:16,  2.00it/s]
Epoch 22 Iter 193: loss 0.16002. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  1.99it/s]
Epoch 22 Iter 194: loss 0.16814. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:15,  1.99it/s]
Epoch 22 Iter 194: loss 0.16814. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:15,  1.99it/s]
Epoch 22 Iter 195: loss 0.14474. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:15,  1.99it/s]
Epoch 22 Iter 195: loss 0.14474. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.00it/s]
Epoch 22 Iter 196: loss 0.16734. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:14,  2.00it/s]
Epoch 22 Iter 196: loss 0.16734. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:14,  1.99it/s]
Epoch 22 Iter 197: loss 0.17397. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:14,  1.99it/s]
Epoch 22 Iter 197: loss 0.17397. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  1.97it/s]
Epoch 22 Iter 198: loss 0.15891. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  1.97it/s]
Epoch 22 Iter 198: loss 0.15891. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:13,  1.98it/s]
Epoch 22 Iter 199: loss 0.19407. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:13,  1.98it/s]
Epoch 22 Iter 199: loss 0.19407. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  1.97it/s]
Epoch 22 Iter 200: loss 0.14790. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  1.97it/s]
Epoch 22 Iter 200: loss 0.14790. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:12,  1.99it/s]
Epoch 22 Iter 201: loss 0.18762. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:12,  1.99it/s]
Epoch 22 Iter 201: loss 0.18762. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.01it/s]
Epoch 22 Iter 202: loss 0.15429. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.01it/s]
Epoch 22 Iter 202: loss 0.15429. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.02it/s]
Epoch 22 Iter 203: loss 0.18073. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.02it/s]
Epoch 22 Iter 203: loss 0.18073. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.03it/s]
Epoch 22 Iter 204: loss 0.14150. :  91%|██████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.03it/s]
Epoch 22 Iter 204: loss 0.14150. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.03it/s]
Epoch 22 Iter 205: loss 0.16845. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.03it/s]
Epoch 22 Iter 205: loss 0.16845. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  1.99it/s]
Epoch 22 Iter 206: loss 0.17115. :  92%|███████████████████████████████████████▎   | 205/224 [01:41<00:09,  1.99it/s]
Epoch 22 Iter 206: loss 0.17115. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:09,  2.00it/s]
Epoch 22 Iter 207: loss 0.14605. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:09,  2.00it/s]
Epoch 22 Iter 207: loss 0.14605. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.00it/s]
Epoch 22 Iter 208: loss 0.19040. :  92%|███████████████████████████████████████▋   | 207/224 [01:42<00:08,  2.00it/s]
Epoch 22 Iter 208: loss 0.19040. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:08,  1.99it/s]
Epoch 22 Iter 209: loss 0.15876. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:08,  1.99it/s]
Epoch 22 Iter 209: loss 0.15876. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  1.96it/s]
Epoch 22 Iter 210: loss 0.15351. :  93%|████████████████████████████████████████   | 209/224 [01:43<00:07,  1.96it/s]
Epoch 22 Iter 210: loss 0.15351. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:07,  1.96it/s]
Epoch 22 Iter 211: loss 0.15712. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:07,  1.96it/s]
Epoch 22 Iter 211: loss 0.15712. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  1.97it/s]
Epoch 22 Iter 212: loss 0.14550. :  94%|████████████████████████████████████████▌  | 211/224 [01:44<00:06,  1.97it/s]
Epoch 22 Iter 212: loss 0.14550. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:06,  1.98it/s]
Epoch 22 Iter 213: loss 0.16936. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:06,  1.98it/s]
Epoch 22 Iter 213: loss 0.16936. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  1.98it/s]
Epoch 22 Iter 214: loss 0.16131. :  95%|████████████████████████████████████████▉  | 213/224 [01:45<00:05,  1.98it/s]
Epoch 22 Iter 214: loss 0.16131. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:05,  1.99it/s]
Epoch 22 Iter 215: loss 0.17125. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:05,  1.99it/s]
Epoch 22 Iter 215: loss 0.17125. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.02it/s]
Epoch 22 Iter 216: loss 0.16104. :  96%|█████████████████████████████████████████▎ | 215/224 [01:46<00:04,  2.02it/s]
Epoch 22 Iter 216: loss 0.16104. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.02it/s]
Epoch 22 Iter 217: loss 0.17018. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.02it/s]
Epoch 22 Iter 217: loss 0.17018. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.02it/s]
Epoch 22 Iter 218: loss 0.16929. :  97%|█████████████████████████████████████████▋ | 217/224 [01:47<00:03,  2.02it/s]
Epoch 22 Iter 218: loss 0.16929. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.01it/s]
Epoch 22 Iter 219: loss 0.15348. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.01it/s]
Epoch 22 Iter 219: loss 0.15348. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.01it/s]
Epoch 22 Iter 220: loss 0.14860. :  98%|██████████████████████████████████████████ | 219/224 [01:48<00:02,  2.01it/s]
Epoch 22 Iter 220: loss 0.14860. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.02it/s]
Epoch 22 Iter 221: loss 0.16802. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.02it/s]
Epoch 22 Iter 221: loss 0.16802. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.02it/s]
Epoch 22 Iter 222: loss 0.18234. :  99%|██████████████████████████████████████████▍| 221/224 [01:49<00:01,  2.02it/s]
Epoch 22 Iter 222: loss 0.18234. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.01it/s]
Epoch 22 Iter 223: loss 0.16866. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.01it/s]
Epoch 22 Iter 223: loss 0.16866. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.02it/s]
Epoch 22 Iter 224: loss 0.17166. : 100%|██████████████████████████████████████████▊| 223/224 [01:50<00:00,  2.02it/s]
Epoch 22 Iter 224: loss 0.17166. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  2.04it/s]
Epoch 22 Iter 224: loss 0.17166. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  2.03it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.15574. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.15574. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 23 Iter 2: loss 0.16607. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 23 Iter 2: loss 0.16607. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 23 Iter 3: loss 0.17506. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 23 Iter 3: loss 0.17506. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.17661. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.17661. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 23 Iter 5: loss 0.17757. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 23 Iter 5: loss 0.17757. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.16374. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.16374. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 23 Iter 7: loss 0.15565. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 23 Iter 7: loss 0.15565. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 23 Iter 8: loss 0.19008. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 23 Iter 8: loss 0.19008. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.15705. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.15705. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.16057. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.16057. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 11: loss 0.17157. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 23 Iter 11: loss 0.17157. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 23 Iter 12: loss 0.17161. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 23 Iter 12: loss 0.17161. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 23 Iter 13: loss 0.15164. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 13: loss 0.15164. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 14: loss 0.16104. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 14: loss 0.16104. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 15: loss 0.17535. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.06it/s]
Epoch 23 Iter 15: loss 0.17535. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 23 Iter 16: loss 0.20003. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 23 Iter 16: loss 0.20003. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 23 Iter 17: loss 0.16648. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 23 Iter 17: loss 0.16648. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.16403. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.16403. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 23 Iter 19: loss 0.15754. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 23 Iter 19: loss 0.15754. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.15987. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.15987. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 21: loss 0.17063. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 23 Iter 21: loss 0.17063. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 23 Iter 22: loss 0.14987. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 23 Iter 22: loss 0.14987. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 23 Iter 23: loss 0.17578. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 23 Iter 23: loss 0.17578. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 23 Iter 24: loss 0.17058. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 23 Iter 24: loss 0.17058. :  11%|████▊                                        | 24/224 [00:11<01:35,  2.09it/s]
Epoch 23 Iter 25: loss 0.15275. :  11%|████▊                                        | 24/224 [00:12<01:35,  2.09it/s]
Epoch 23 Iter 25: loss 0.15275. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 23 Iter 26: loss 0.15340. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 23 Iter 26: loss 0.15340. :  12%|█████▏                                       | 26/224 [00:12<01:34,  2.09it/s]
Epoch 23 Iter 27: loss 0.16229. :  12%|█████▏                                       | 26/224 [00:13<01:34,  2.09it/s]
Epoch 23 Iter 27: loss 0.16229. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.17467. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.17467. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 23 Iter 29: loss 0.16518. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 29: loss 0.16518. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 30: loss 0.16834. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 30: loss 0.16834. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.16475. :  13%|██████                                       | 30/224 [00:15<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.16475. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.17865. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.17865. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.15701. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.15701. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 34: loss 0.15171. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 23 Iter 34: loss 0.15171. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 23 Iter 35: loss 0.16125. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 23 Iter 35: loss 0.16125. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 23 Iter 36: loss 0.17450. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 23 Iter 36: loss 0.17450. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.16494. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.16494. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 23 Iter 38: loss 0.17812. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 38: loss 0.17812. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 39: loss 0.16177. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 39: loss 0.16177. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 40: loss 0.15361. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.08it/s]
Epoch 23 Iter 40: loss 0.15361. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 23 Iter 41: loss 0.16568. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 23 Iter 41: loss 0.16568. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 23 Iter 42: loss 0.17163. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 42: loss 0.17163. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.17223. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.17223. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 23 Iter 44: loss 0.15455. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 23 Iter 44: loss 0.15455. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.18055. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.18055. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.17791. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.17791. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 23 Iter 47: loss 0.17037. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 23 Iter 47: loss 0.17037. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.17625. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.17625. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.16687. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.16687. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 23 Iter 50: loss 0.16708. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 23 Iter 50: loss 0.16708. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 23 Iter 51: loss 0.17709. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 23 Iter 51: loss 0.17709. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 23 Iter 52: loss 0.15419. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 23 Iter 52: loss 0.15419. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.18187. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.18187. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 23 Iter 54: loss 0.17678. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 54: loss 0.17678. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 55: loss 0.15725. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 55: loss 0.15725. :  25%|███████████                                  | 55/224 [00:26<01:23,  2.03it/s]
Epoch 23 Iter 56: loss 0.17116. :  25%|███████████                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 23 Iter 56: loss 0.17116. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.02it/s]
Epoch 23 Iter 57: loss 0.16259. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.02it/s]
Epoch 23 Iter 57: loss 0.16259. :  25%|███████████▍                                 | 57/224 [00:27<01:23,  2.00it/s]
Epoch 23 Iter 58: loss 0.18166. :  25%|███████████▍                                 | 57/224 [00:28<01:23,  2.00it/s]
Epoch 23 Iter 58: loss 0.18166. :  26%|███████████▋                                 | 58/224 [00:28<01:31,  1.82it/s]
Epoch 23 Iter 59: loss 0.16968. :  26%|███████████▋                                 | 58/224 [00:28<01:31,  1.82it/s]
Epoch 23 Iter 59: loss 0.16968. :  26%|███████████▊                                 | 59/224 [00:28<01:29,  1.84it/s]
Epoch 23 Iter 60: loss 0.14376. :  26%|███████████▊                                 | 59/224 [00:29<01:29,  1.84it/s]
Epoch 23 Iter 60: loss 0.14376. :  27%|████████████                                 | 60/224 [00:29<01:27,  1.87it/s]
Epoch 23 Iter 61: loss 0.16602. :  27%|████████████                                 | 60/224 [00:29<01:27,  1.87it/s]
Epoch 23 Iter 61: loss 0.16602. :  27%|████████████▎                                | 61/224 [00:29<01:26,  1.89it/s]
Epoch 23 Iter 62: loss 0.17736. :  27%|████████████▎                                | 61/224 [00:30<01:26,  1.89it/s]
Epoch 23 Iter 62: loss 0.17736. :  28%|████████████▍                                | 62/224 [00:30<01:24,  1.92it/s]
Epoch 23 Iter 63: loss 0.17832. :  28%|████████████▍                                | 62/224 [00:30<01:24,  1.92it/s]
Epoch 23 Iter 63: loss 0.17832. :  28%|████████████▋                                | 63/224 [00:30<01:22,  1.95it/s]
Epoch 23 Iter 64: loss 0.17788. :  28%|████████████▋                                | 63/224 [00:31<01:22,  1.95it/s]
Epoch 23 Iter 64: loss 0.17788. :  29%|████████████▊                                | 64/224 [00:31<01:21,  1.95it/s]
Epoch 23 Iter 65: loss 0.16598. :  29%|████████████▊                                | 64/224 [00:31<01:21,  1.95it/s]
Epoch 23 Iter 65: loss 0.16598. :  29%|█████████████                                | 65/224 [00:31<01:21,  1.96it/s]
Epoch 23 Iter 66: loss 0.18056. :  29%|█████████████                                | 65/224 [00:32<01:21,  1.96it/s]
Epoch 23 Iter 66: loss 0.18056. :  29%|█████████████▎                               | 66/224 [00:32<01:20,  1.95it/s]
Epoch 23 Iter 67: loss 0.16303. :  29%|█████████████▎                               | 66/224 [00:32<01:20,  1.95it/s]
Epoch 23 Iter 67: loss 0.16303. :  30%|█████████████▍                               | 67/224 [00:32<01:20,  1.94it/s]
Epoch 23 Iter 68: loss 0.18027. :  30%|█████████████▍                               | 67/224 [00:33<01:20,  1.94it/s]
Epoch 23 Iter 68: loss 0.18027. :  30%|█████████████▋                               | 68/224 [00:33<01:20,  1.95it/s]
Epoch 23 Iter 69: loss 0.16768. :  30%|█████████████▋                               | 68/224 [00:33<01:20,  1.95it/s]
Epoch 23 Iter 69: loss 0.16768. :  31%|█████████████▊                               | 69/224 [00:33<01:19,  1.95it/s]
Epoch 23 Iter 70: loss 0.16032. :  31%|█████████████▊                               | 69/224 [00:34<01:19,  1.95it/s]
Epoch 23 Iter 70: loss 0.16032. :  31%|██████████████                               | 70/224 [00:34<01:18,  1.95it/s]
Epoch 23 Iter 71: loss 0.15710. :  31%|██████████████                               | 70/224 [00:34<01:18,  1.95it/s]
Epoch 23 Iter 71: loss 0.15710. :  32%|██████████████▎                              | 71/224 [00:34<01:18,  1.96it/s]
Epoch 23 Iter 72: loss 0.15743. :  32%|██████████████▎                              | 71/224 [00:35<01:18,  1.96it/s]
Epoch 23 Iter 72: loss 0.15743. :  32%|██████████████▍                              | 72/224 [00:35<01:17,  1.96it/s]
Epoch 23 Iter 73: loss 0.17859. :  32%|██████████████▍                              | 72/224 [00:36<01:17,  1.96it/s]
Epoch 23 Iter 73: loss 0.17859. :  33%|██████████████▋                              | 73/224 [00:36<01:17,  1.96it/s]
Epoch 23 Iter 74: loss 0.16494. :  33%|██████████████▋                              | 73/224 [00:36<01:17,  1.96it/s]
Epoch 23 Iter 74: loss 0.16494. :  33%|██████████████▊                              | 74/224 [00:36<01:16,  1.95it/s]
Epoch 23 Iter 75: loss 0.16282. :  33%|██████████████▊                              | 74/224 [00:37<01:16,  1.95it/s]
Epoch 23 Iter 75: loss 0.16282. :  33%|███████████████                              | 75/224 [00:37<01:16,  1.95it/s]
Epoch 23 Iter 76: loss 0.15793. :  33%|███████████████                              | 75/224 [00:37<01:16,  1.95it/s]
Epoch 23 Iter 76: loss 0.15793. :  34%|███████████████▎                             | 76/224 [00:37<01:15,  1.97it/s]
Epoch 23 Iter 77: loss 0.16080. :  34%|███████████████▎                             | 76/224 [00:38<01:15,  1.97it/s]
Epoch 23 Iter 77: loss 0.16080. :  34%|███████████████▍                             | 77/224 [00:38<01:14,  1.97it/s]
Epoch 23 Iter 78: loss 0.17088. :  34%|███████████████▍                             | 77/224 [00:38<01:14,  1.97it/s]
Epoch 23 Iter 78: loss 0.17088. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.01it/s]
Epoch 23 Iter 79: loss 0.16604. :  35%|███████████████▋                             | 78/224 [00:39<01:12,  2.01it/s]
Epoch 23 Iter 79: loss 0.16604. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.00it/s]
Epoch 23 Iter 80: loss 0.17252. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.00it/s]
Epoch 23 Iter 80: loss 0.17252. :  36%|████████████████                             | 80/224 [00:39<01:12,  1.99it/s]
Epoch 23 Iter 81: loss 0.16604. :  36%|████████████████                             | 80/224 [00:40<01:12,  1.99it/s]
Epoch 23 Iter 81: loss 0.16604. :  36%|████████████████▎                            | 81/224 [00:40<01:12,  1.98it/s]
Epoch 23 Iter 82: loss 0.16544. :  36%|████████████████▎                            | 81/224 [00:40<01:12,  1.98it/s]
Epoch 23 Iter 82: loss 0.16544. :  37%|████████████████▍                            | 82/224 [00:40<01:11,  2.00it/s]
Epoch 23 Iter 83: loss 0.16376. :  37%|████████████████▍                            | 82/224 [00:41<01:11,  2.00it/s]
Epoch 23 Iter 83: loss 0.16376. :  37%|████████████████▋                            | 83/224 [00:41<01:10,  2.01it/s]
Epoch 23 Iter 84: loss 0.16023. :  37%|████████████████▋                            | 83/224 [00:41<01:10,  2.01it/s]
Epoch 23 Iter 84: loss 0.16023. :  38%|████████████████▉                            | 84/224 [00:41<01:09,  2.03it/s]
Epoch 23 Iter 85: loss 0.14801. :  38%|████████████████▉                            | 84/224 [00:41<01:09,  2.03it/s]
Epoch 23 Iter 85: loss 0.14801. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 23 Iter 86: loss 0.17481. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.04it/s]
Epoch 23 Iter 86: loss 0.17481. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 23 Iter 87: loss 0.15136. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 23 Iter 87: loss 0.15136. :  39%|█████████████████▍                           | 87/224 [00:42<01:08,  2.01it/s]
Epoch 23 Iter 88: loss 0.15979. :  39%|█████████████████▍                           | 87/224 [00:43<01:08,  2.01it/s]
Epoch 23 Iter 88: loss 0.15979. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.00it/s]
Epoch 23 Iter 89: loss 0.15892. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.00it/s]
Epoch 23 Iter 89: loss 0.15892. :  40%|█████████████████▉                           | 89/224 [00:43<01:07,  2.00it/s]
Epoch 23 Iter 90: loss 0.14914. :  40%|█████████████████▉                           | 89/224 [00:44<01:07,  2.00it/s]
Epoch 23 Iter 90: loss 0.14914. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 23 Iter 91: loss 0.19283. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 23 Iter 91: loss 0.19283. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.02it/s]
Epoch 23 Iter 92: loss 0.16403. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.02it/s]
Epoch 23 Iter 92: loss 0.16403. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.02it/s]
Epoch 23 Iter 93: loss 0.16848. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.02it/s]
Epoch 23 Iter 93: loss 0.16848. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.03it/s]
Epoch 23 Iter 94: loss 0.16704. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.03it/s]
Epoch 23 Iter 94: loss 0.16704. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 23 Iter 95: loss 0.18308. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 23 Iter 95: loss 0.18308. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 23 Iter 96: loss 0.15326. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.04it/s]
Epoch 23 Iter 96: loss 0.15326. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.00it/s]
Epoch 23 Iter 97: loss 0.15709. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.00it/s]
Epoch 23 Iter 97: loss 0.15709. :  43%|███████████████████▍                         | 97/224 [00:47<01:04,  1.97it/s]
Epoch 23 Iter 98: loss 0.14907. :  43%|███████████████████▍                         | 97/224 [00:48<01:04,  1.97it/s]
Epoch 23 Iter 98: loss 0.14907. :  44%|███████████████████▋                         | 98/224 [00:48<01:04,  1.95it/s]
Epoch 23 Iter 99: loss 0.16075. :  44%|███████████████████▋                         | 98/224 [00:49<01:04,  1.95it/s]
Epoch 23 Iter 99: loss 0.16075. :  44%|███████████████████▉                         | 99/224 [00:49<01:04,  1.94it/s]
Epoch 23 Iter 100: loss 0.15604. :  44%|███████████████████▍                        | 99/224 [00:49<01:04,  1.94it/s]
Epoch 23 Iter 100: loss 0.15604. :  45%|███████████████████▏                       | 100/224 [00:49<01:03,  1.96it/s]
Epoch 23 Iter 101: loss 0.17294. :  45%|███████████████████▏                       | 100/224 [00:50<01:03,  1.96it/s]
Epoch 23 Iter 101: loss 0.17294. :  45%|███████████████████▍                       | 101/224 [00:50<01:01,  1.99it/s]
Epoch 23 Iter 102: loss 0.15516. :  45%|███████████████████▍                       | 101/224 [00:50<01:01,  1.99it/s]
Epoch 23 Iter 102: loss 0.15516. :  46%|███████████████████▌                       | 102/224 [00:50<01:01,  1.99it/s]
Epoch 23 Iter 103: loss 0.16226. :  46%|███████████████████▌                       | 102/224 [00:50<01:01,  1.99it/s]
Epoch 23 Iter 103: loss 0.16226. :  46%|███████████████████▊                       | 103/224 [00:50<01:00,  2.00it/s]
Epoch 23 Iter 104: loss 0.18591. :  46%|███████████████████▊                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 23 Iter 104: loss 0.18591. :  46%|███████████████████▉                       | 104/224 [00:51<01:00,  1.99it/s]
Epoch 23 Iter 105: loss 0.14826. :  46%|███████████████████▉                       | 104/224 [00:52<01:00,  1.99it/s]
Epoch 23 Iter 105: loss 0.14826. :  47%|████████████████████▏                      | 105/224 [00:52<00:59,  1.99it/s]
Epoch 23 Iter 106: loss 0.17893. :  47%|████████████████████▏                      | 105/224 [00:52<00:59,  1.99it/s]
Epoch 23 Iter 106: loss 0.17893. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.01it/s]
Epoch 23 Iter 107: loss 0.15912. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.01it/s]
Epoch 23 Iter 107: loss 0.15912. :  48%|████████████████████▌                      | 107/224 [00:52<00:58,  2.01it/s]
Epoch 23 Iter 108: loss 0.16665. :  48%|████████████████████▌                      | 107/224 [00:53<00:58,  2.01it/s]
Epoch 23 Iter 108: loss 0.16665. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.01it/s]
Epoch 23 Iter 109: loss 0.17199. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.01it/s]
Epoch 23 Iter 109: loss 0.17199. :  49%|████████████████████▉                      | 109/224 [00:53<00:57,  2.01it/s]
Epoch 23 Iter 110: loss 0.16480. :  49%|████████████████████▉                      | 109/224 [00:54<00:57,  2.01it/s]
Epoch 23 Iter 110: loss 0.16480. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.02it/s]
Epoch 23 Iter 111: loss 0.15201. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.02it/s]
Epoch 23 Iter 111: loss 0.15201. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.03it/s]
Epoch 23 Iter 112: loss 0.15405. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 23 Iter 112: loss 0.15405. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 23 Iter 113: loss 0.15904. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 23 Iter 113: loss 0.15904. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 23 Iter 114: loss 0.14693. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.05it/s]
Epoch 23 Iter 114: loss 0.14693. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.05it/s]
Epoch 23 Iter 115: loss 0.14615. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.05it/s]
Epoch 23 Iter 115: loss 0.14615. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.16856. :  51%|██████████████████████                     | 115/224 [00:57<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.16856. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.06it/s]
Epoch 23 Iter 117: loss 0.17388. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.06it/s]
Epoch 23 Iter 117: loss 0.17388. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 23 Iter 118: loss 0.17454. :  52%|██████████████████████▍                    | 117/224 [00:58<00:51,  2.06it/s]
Epoch 23 Iter 118: loss 0.17454. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.07it/s]
Epoch 23 Iter 119: loss 0.18066. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.07it/s]
Epoch 23 Iter 119: loss 0.18066. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 23 Iter 120: loss 0.15490. :  53%|██████████████████████▊                    | 119/224 [00:59<00:50,  2.07it/s]
Epoch 23 Iter 120: loss 0.15490. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.07it/s]
Epoch 23 Iter 121: loss 0.17873. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.07it/s]
Epoch 23 Iter 121: loss 0.17873. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 23 Iter 122: loss 0.15954. :  54%|███████████████████████▏                   | 121/224 [01:00<00:49,  2.06it/s]
Epoch 23 Iter 122: loss 0.15954. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.06it/s]
Epoch 23 Iter 123: loss 0.16271. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.06it/s]
Epoch 23 Iter 123: loss 0.16271. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 23 Iter 124: loss 0.15186. :  55%|███████████████████████▌                   | 123/224 [01:01<00:49,  2.06it/s]
Epoch 23 Iter 124: loss 0.15186. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.05it/s]
Epoch 23 Iter 125: loss 0.17363. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.05it/s]
Epoch 23 Iter 125: loss 0.17363. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 23 Iter 126: loss 0.17826. :  56%|███████████████████████▉                   | 125/224 [01:02<00:48,  2.06it/s]
Epoch 23 Iter 126: loss 0.17826. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.16129. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.16129. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 23 Iter 128: loss 0.16118. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.06it/s]
Epoch 23 Iter 128: loss 0.16118. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.15823. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.15823. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.15204. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.15204. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.05it/s]
Epoch 23 Iter 131: loss 0.16759. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.05it/s]
Epoch 23 Iter 131: loss 0.16759. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 23 Iter 132: loss 0.16616. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:45,  2.06it/s]
Epoch 23 Iter 132: loss 0.16616. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 23 Iter 133: loss 0.14574. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 23 Iter 133: loss 0.14574. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 23 Iter 134: loss 0.16671. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:44,  2.06it/s]
Epoch 23 Iter 134: loss 0.16671. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.06it/s]
Epoch 23 Iter 135: loss 0.15123. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.06it/s]
Epoch 23 Iter 135: loss 0.15123. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 23 Iter 136: loss 0.16199. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:43,  2.05it/s]
Epoch 23 Iter 136: loss 0.16199. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.07it/s]
Epoch 23 Iter 137: loss 0.16029. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.07it/s]
Epoch 23 Iter 137: loss 0.16029. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 23 Iter 138: loss 0.15816. :  61%|██████████████████████████▎                | 137/224 [01:08<00:42,  2.06it/s]
Epoch 23 Iter 138: loss 0.15816. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 23 Iter 139: loss 0.15623. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 23 Iter 139: loss 0.15623. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 23 Iter 140: loss 0.15175. :  62%|██████████████████████████▋                | 139/224 [01:09<00:41,  2.05it/s]
Epoch 23 Iter 140: loss 0.15175. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 23 Iter 141: loss 0.16634. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 23 Iter 141: loss 0.16634. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.07it/s]
Epoch 23 Iter 142: loss 0.16347. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.07it/s]
Epoch 23 Iter 142: loss 0.16347. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 23 Iter 143: loss 0.18978. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.07it/s]
Epoch 23 Iter 143: loss 0.18978. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 23 Iter 144: loss 0.16134. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 23 Iter 144: loss 0.16134. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.05it/s]
Epoch 23 Iter 145: loss 0.16987. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.05it/s]
Epoch 23 Iter 145: loss 0.16987. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.07it/s]
Epoch 23 Iter 146: loss 0.17059. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.07it/s]
Epoch 23 Iter 146: loss 0.17059. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 23 Iter 147: loss 0.16177. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.08it/s]
Epoch 23 Iter 147: loss 0.16177. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.07it/s]
Epoch 23 Iter 148: loss 0.15190. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.07it/s]
Epoch 23 Iter 148: loss 0.15190. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 23 Iter 149: loss 0.16900. :  66%|████████████████████████████▍              | 148/224 [01:13<00:36,  2.07it/s]
Epoch 23 Iter 149: loss 0.16900. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.07it/s]
Epoch 23 Iter 150: loss 0.17902. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.07it/s]
Epoch 23 Iter 150: loss 0.17902. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 23 Iter 151: loss 0.17012. :  67%|████████████████████████████▊              | 150/224 [01:14<00:35,  2.07it/s]
Epoch 23 Iter 151: loss 0.17012. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 23 Iter 152: loss 0.19144. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 23 Iter 152: loss 0.19144. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 23 Iter 153: loss 0.16177. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:34,  2.06it/s]
Epoch 23 Iter 153: loss 0.16177. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 23 Iter 154: loss 0.16976. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 23 Iter 154: loss 0.16976. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 23 Iter 155: loss 0.16941. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:33,  2.06it/s]
Epoch 23 Iter 155: loss 0.16941. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.06it/s]
Epoch 23 Iter 156: loss 0.16663. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.06it/s]
Epoch 23 Iter 156: loss 0.16663. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 23 Iter 157: loss 0.17938. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:33,  2.06it/s]
Epoch 23 Iter 157: loss 0.17938. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.05it/s]
Epoch 23 Iter 158: loss 0.17626. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.05it/s]
Epoch 23 Iter 158: loss 0.17626. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 23 Iter 159: loss 0.16168. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:31,  2.07it/s]
Epoch 23 Iter 159: loss 0.16168. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 23 Iter 160: loss 0.17076. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 23 Iter 160: loss 0.17076. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 23 Iter 161: loss 0.16024. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.06it/s]
Epoch 23 Iter 161: loss 0.16024. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.05it/s]
Epoch 23 Iter 162: loss 0.15664. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.05it/s]
Epoch 23 Iter 162: loss 0.15664. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.08it/s]
Epoch 23 Iter 163: loss 0.15715. :  72%|███████████████████████████████            | 162/224 [01:20<00:29,  2.08it/s]
Epoch 23 Iter 163: loss 0.15715. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.17273. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.17273. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 23 Iter 165: loss 0.17273. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:29,  2.06it/s]
Epoch 23 Iter 165: loss 0.17273. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.06it/s]
Epoch 23 Iter 166: loss 0.19173. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.06it/s]
Epoch 23 Iter 166: loss 0.19173. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 23 Iter 167: loss 0.17042. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.07it/s]
Epoch 23 Iter 167: loss 0.17042. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.06it/s]
Epoch 23 Iter 168: loss 0.18582. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.06it/s]
Epoch 23 Iter 168: loss 0.18582. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 23 Iter 169: loss 0.15587. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.07it/s]
Epoch 23 Iter 169: loss 0.15587. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.17406. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.17406. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 23 Iter 171: loss 0.18043. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.06it/s]
Epoch 23 Iter 171: loss 0.18043. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 23 Iter 172: loss 0.15896. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 23 Iter 172: loss 0.15896. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 23 Iter 173: loss 0.16827. :  77%|█████████████████████████████████          | 172/224 [01:25<00:25,  2.07it/s]
Epoch 23 Iter 173: loss 0.16827. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.06it/s]
Epoch 23 Iter 174: loss 0.17281. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.06it/s]
Epoch 23 Iter 174: loss 0.17281. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.16673. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.16673. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 23 Iter 176: loss 0.16195. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.08it/s]
Epoch 23 Iter 176: loss 0.16195. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.07it/s]
Epoch 23 Iter 177: loss 0.17536. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.07it/s]
Epoch 23 Iter 177: loss 0.17536. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 23 Iter 178: loss 0.16588. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.08it/s]
Epoch 23 Iter 178: loss 0.16588. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 23 Iter 179: loss 0.15646. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 23 Iter 179: loss 0.15646. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 23 Iter 180: loss 0.17059. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.07it/s]
Epoch 23 Iter 180: loss 0.17059. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 23 Iter 181: loss 0.17914. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 23 Iter 181: loss 0.17914. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.17719. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.17719. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.16830. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.16830. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 23 Iter 184: loss 0.16362. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.08it/s]
Epoch 23 Iter 184: loss 0.16362. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.08it/s]
Epoch 23 Iter 185: loss 0.16719. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.08it/s]
Epoch 23 Iter 185: loss 0.16719. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.08it/s]
Epoch 23 Iter 186: loss 0.14503. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.08it/s]
Epoch 23 Iter 186: loss 0.14503. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.08it/s]
Epoch 23 Iter 187: loss 0.14379. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.08it/s]
Epoch 23 Iter 187: loss 0.14379. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 23 Iter 188: loss 0.16976. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.07it/s]
Epoch 23 Iter 188: loss 0.16976. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.07it/s]
Epoch 23 Iter 189: loss 0.15658. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.07it/s]
Epoch 23 Iter 189: loss 0.15658. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 23 Iter 190: loss 0.17518. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:16,  2.07it/s]
Epoch 23 Iter 190: loss 0.17518. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.06it/s]
Epoch 23 Iter 191: loss 0.14749. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.06it/s]
Epoch 23 Iter 191: loss 0.14749. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 23 Iter 192: loss 0.14992. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:15,  2.07it/s]
Epoch 23 Iter 192: loss 0.14992. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 23 Iter 193: loss 0.15346. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 23 Iter 193: loss 0.15346. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 23 Iter 194: loss 0.17145. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:14,  2.07it/s]
Epoch 23 Iter 194: loss 0.17145. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.07it/s]
Epoch 23 Iter 195: loss 0.17789. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.07it/s]
Epoch 23 Iter 195: loss 0.17789. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 23 Iter 196: loss 0.17400. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:14,  2.07it/s]
Epoch 23 Iter 196: loss 0.17400. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.06it/s]
Epoch 23 Iter 197: loss 0.17251. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.06it/s]
Epoch 23 Iter 197: loss 0.17251. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 23 Iter 198: loss 0.17416. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  2.05it/s]
Epoch 23 Iter 198: loss 0.17416. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 23 Iter 199: loss 0.16181. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 23 Iter 199: loss 0.16181. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.16892. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.16892. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.05it/s]
Epoch 23 Iter 201: loss 0.16041. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.05it/s]
Epoch 23 Iter 201: loss 0.16041. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 23 Iter 202: loss 0.15616. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.06it/s]
Epoch 23 Iter 202: loss 0.15616. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.05it/s]
Epoch 23 Iter 203: loss 0.16620. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.05it/s]
Epoch 23 Iter 203: loss 0.16620. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 23 Iter 204: loss 0.16893. :  91%|██████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.06it/s]
Epoch 23 Iter 204: loss 0.16893. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.06it/s]
Epoch 23 Iter 205: loss 0.17751. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.06it/s]
Epoch 23 Iter 205: loss 0.17751. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 23 Iter 206: loss 0.17539. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 23 Iter 206: loss 0.17539. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 23 Iter 207: loss 0.18509. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.08it/s]
Epoch 23 Iter 207: loss 0.18509. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.09it/s]
Epoch 23 Iter 208: loss 0.15549. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.09it/s]
Epoch 23 Iter 208: loss 0.15549. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 23 Iter 209: loss 0.17703. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.08it/s]
Epoch 23 Iter 209: loss 0.17703. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.06it/s]
Epoch 23 Iter 210: loss 0.16627. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.06it/s]
Epoch 23 Iter 210: loss 0.16627. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 23 Iter 211: loss 0.17694. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.06it/s]
Epoch 23 Iter 211: loss 0.17694. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 23 Iter 212: loss 0.17558. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 23 Iter 212: loss 0.17558. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 23 Iter 213: loss 0.15513. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.07it/s]
Epoch 23 Iter 213: loss 0.15513. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 23 Iter 214: loss 0.15658. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 23 Iter 214: loss 0.15658. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 215: loss 0.14149. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.07it/s]
Epoch 23 Iter 215: loss 0.14149. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.17300. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.17300. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 23 Iter 217: loss 0.14867. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.07it/s]
Epoch 23 Iter 217: loss 0.14867. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.06it/s]
Epoch 23 Iter 218: loss 0.15367. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.06it/s]
Epoch 23 Iter 218: loss 0.15367. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 23 Iter 219: loss 0.16616. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.06it/s]
Epoch 23 Iter 219: loss 0.16616. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.07it/s]
Epoch 23 Iter 220: loss 0.14904. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.07it/s]
Epoch 23 Iter 220: loss 0.14904. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 23 Iter 221: loss 0.17271. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.07it/s]
Epoch 23 Iter 221: loss 0.17271. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.06it/s]
Epoch 23 Iter 222: loss 0.17625. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.06it/s]
Epoch 23 Iter 222: loss 0.17625. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 23 Iter 223: loss 0.14690. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.07it/s]
Epoch 23 Iter 223: loss 0.14690. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.10it/s]
Epoch 23 Iter 224: loss 0.16932. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.10it/s]
Epoch 23 Iter 224: loss 0.16932. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.11it/s]
Epoch 23 Iter 224: loss 0.16932. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.04it/s]

    Train loss: 0.16591
    Valid loss: 0.17084
       Valid loss recons: 0.17084
       Valid loss KL-D:   55649.34268
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.15121. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.15121. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.16308. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.16308. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 3: loss 0.16562. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 24 Iter 3: loss 0.16562. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 24 Iter 4: loss 0.17918. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 24 Iter 4: loss 0.17918. :   2%|▊                                              | 4/224 [00:01<01:47,  2.06it/s]
Epoch 24 Iter 5: loss 0.15837. :   2%|▊                                              | 4/224 [00:02<01:47,  2.06it/s]
Epoch 24 Iter 5: loss 0.15837. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 24 Iter 6: loss 0.19006. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 24 Iter 6: loss 0.19006. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 24 Iter 7: loss 0.14361. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 24 Iter 7: loss 0.14361. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 24 Iter 8: loss 0.19076. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 24 Iter 8: loss 0.19076. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 24 Iter 9: loss 0.14496. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 9: loss 0.14496. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.18063. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.18063. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 24 Iter 11: loss 0.18539. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 24 Iter 11: loss 0.18539. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 24 Iter 12: loss 0.16421. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 24 Iter 12: loss 0.16421. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 24 Iter 13: loss 0.15655. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 24 Iter 13: loss 0.15655. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 24 Iter 14: loss 0.17554. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 24 Iter 14: loss 0.17554. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 24 Iter 15: loss 0.18197. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 24 Iter 15: loss 0.18197. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 24 Iter 16: loss 0.16880. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 24 Iter 16: loss 0.16880. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.04it/s]
Epoch 24 Iter 17: loss 0.15892. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.04it/s]
Epoch 24 Iter 17: loss 0.15892. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 24 Iter 18: loss 0.16415. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 24 Iter 18: loss 0.16415. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 24 Iter 19: loss 0.15479. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 24 Iter 19: loss 0.15479. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 24 Iter 20: loss 0.16465. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 24 Iter 20: loss 0.16465. :   9%|████                                         | 20/224 [00:09<01:40,  2.04it/s]
Epoch 24 Iter 21: loss 0.15222. :   9%|████                                         | 20/224 [00:10<01:40,  2.04it/s]
Epoch 24 Iter 21: loss 0.15222. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 24 Iter 22: loss 0.15628. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 24 Iter 22: loss 0.15628. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 24 Iter 23: loss 0.16040. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 24 Iter 23: loss 0.16040. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 24 Iter 24: loss 0.16867. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 24 Iter 24: loss 0.16867. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 24 Iter 25: loss 0.17270. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 24 Iter 25: loss 0.17270. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 24 Iter 26: loss 0.17607. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 24 Iter 26: loss 0.17607. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 24 Iter 27: loss 0.15989. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 24 Iter 27: loss 0.15989. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 24 Iter 28: loss 0.16665. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 24 Iter 28: loss 0.16665. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 24 Iter 29: loss 0.16563. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 24 Iter 29: loss 0.16563. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 24 Iter 30: loss 0.16924. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 24 Iter 30: loss 0.16924. :  13%|██████                                       | 30/224 [00:14<01:35,  2.03it/s]
Epoch 24 Iter 31: loss 0.15038. :  13%|██████                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 24 Iter 31: loss 0.15038. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.03it/s]
Epoch 24 Iter 32: loss 0.17940. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.03it/s]
Epoch 24 Iter 32: loss 0.17940. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 24 Iter 33: loss 0.16103. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 24 Iter 33: loss 0.16103. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 24 Iter 34: loss 0.16926. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 24 Iter 34: loss 0.16926. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 24 Iter 35: loss 0.18217. :  15%|██████▊                                      | 34/224 [00:17<01:31,  2.07it/s]
Epoch 24 Iter 35: loss 0.18217. :  16%|███████                                      | 35/224 [00:17<01:30,  2.08it/s]
Epoch 24 Iter 36: loss 0.16528. :  16%|███████                                      | 35/224 [00:17<01:30,  2.08it/s]
Epoch 24 Iter 36: loss 0.16528. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 24 Iter 37: loss 0.16340. :  16%|███████▏                                     | 36/224 [00:18<01:30,  2.07it/s]
Epoch 24 Iter 37: loss 0.16340. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 24 Iter 38: loss 0.17786. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 24 Iter 38: loss 0.17786. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 24 Iter 39: loss 0.14912. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 24 Iter 39: loss 0.14912. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 24 Iter 40: loss 0.16634. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 24 Iter 40: loss 0.16634. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 24 Iter 41: loss 0.15178. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 24 Iter 41: loss 0.15178. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 24 Iter 42: loss 0.17526. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 24 Iter 42: loss 0.17526. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 24 Iter 43: loss 0.16891. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 24 Iter 43: loss 0.16891. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 24 Iter 44: loss 0.14224. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 24 Iter 44: loss 0.14224. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 24 Iter 45: loss 0.16228. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 24 Iter 45: loss 0.16228. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 24 Iter 46: loss 0.14394. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 24 Iter 46: loss 0.14394. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 24 Iter 47: loss 0.15858. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 24 Iter 47: loss 0.15858. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 24 Iter 48: loss 0.15546. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 24 Iter 48: loss 0.15546. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 24 Iter 49: loss 0.15801. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 24 Iter 49: loss 0.15801. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.17193. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.17193. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 24 Iter 51: loss 0.16394. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 24 Iter 51: loss 0.16394. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 24 Iter 52: loss 0.15463. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 24 Iter 52: loss 0.15463. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 24 Iter 53: loss 0.16837. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 24 Iter 53: loss 0.16837. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 24 Iter 54: loss 0.14809. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 24 Iter 54: loss 0.14809. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 24 Iter 55: loss 0.15875. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 24 Iter 55: loss 0.15875. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 24 Iter 56: loss 0.16788. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 24 Iter 56: loss 0.16788. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 57: loss 0.15788. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 57: loss 0.15788. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 58: loss 0.14827. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 24 Iter 58: loss 0.14827. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 24 Iter 59: loss 0.16351. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 24 Iter 59: loss 0.16351. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 24 Iter 60: loss 0.16000. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 24 Iter 60: loss 0.16000. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 24 Iter 61: loss 0.18789. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 24 Iter 61: loss 0.18789. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 24 Iter 62: loss 0.17586. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 24 Iter 62: loss 0.17586. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 24 Iter 63: loss 0.17539. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 24 Iter 63: loss 0.17539. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 24 Iter 64: loss 0.16417. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 24 Iter 64: loss 0.16417. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.05it/s]
Epoch 24 Iter 65: loss 0.16410. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.05it/s]
Epoch 24 Iter 65: loss 0.16410. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 24 Iter 66: loss 0.14472. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 24 Iter 66: loss 0.14472. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 24 Iter 67: loss 0.17509. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 24 Iter 67: loss 0.17509. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.04it/s]
Epoch 24 Iter 68: loss 0.14345. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.04it/s]
Epoch 24 Iter 68: loss 0.14345. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 24 Iter 69: loss 0.18109. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 24 Iter 69: loss 0.18109. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.04it/s]
Epoch 24 Iter 70: loss 0.16637. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.04it/s]
Epoch 24 Iter 70: loss 0.16637. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 24 Iter 71: loss 0.15243. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 24 Iter 71: loss 0.15243. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 24 Iter 72: loss 0.19377. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 24 Iter 72: loss 0.19377. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 24 Iter 73: loss 0.15733. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 24 Iter 73: loss 0.15733. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 24 Iter 74: loss 0.17178. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 24 Iter 74: loss 0.17178. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 24 Iter 75: loss 0.17937. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 24 Iter 75: loss 0.17937. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 24 Iter 76: loss 0.17605. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 24 Iter 76: loss 0.17605. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 24 Iter 77: loss 0.18221. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 24 Iter 77: loss 0.18221. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 24 Iter 78: loss 0.16371. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 24 Iter 78: loss 0.16371. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 24 Iter 79: loss 0.15930. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 79: loss 0.15930. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.16431. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.16431. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 24 Iter 81: loss 0.18192. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 81: loss 0.18192. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.18975. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.18975. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 24 Iter 83: loss 0.14761. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 24 Iter 83: loss 0.14761. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 24 Iter 84: loss 0.16813. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 24 Iter 84: loss 0.16813. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 24 Iter 85: loss 0.13815. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 85: loss 0.13815. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.18340. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.18340. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 24 Iter 87: loss 0.15951. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 24 Iter 87: loss 0.15951. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 24 Iter 88: loss 0.15455. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 24 Iter 88: loss 0.15455. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.15282. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.15282. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 24 Iter 90: loss 0.18363. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 24 Iter 90: loss 0.18363. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 24 Iter 91: loss 0.16339. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 24 Iter 91: loss 0.16339. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 24 Iter 92: loss 0.16660. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 24 Iter 92: loss 0.16660. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 24 Iter 93: loss 0.16168. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 24 Iter 93: loss 0.16168. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 24 Iter 94: loss 0.15976. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 24 Iter 94: loss 0.15976. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.15428. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.15428. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 24 Iter 96: loss 0.17179. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 24 Iter 96: loss 0.17179. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 24 Iter 97: loss 0.16684. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 24 Iter 97: loss 0.16684. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 24 Iter 98: loss 0.15436. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 24 Iter 98: loss 0.15436. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 24 Iter 99: loss 0.16920. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 24 Iter 99: loss 0.16920. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 24 Iter 100: loss 0.17206. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 24 Iter 100: loss 0.17206. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 24 Iter 101: loss 0.16990. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 24 Iter 101: loss 0.16990. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 24 Iter 102: loss 0.16292. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 24 Iter 102: loss 0.16292. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 24 Iter 103: loss 0.17802. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 24 Iter 103: loss 0.17802. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 24 Iter 104: loss 0.17232. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 24 Iter 104: loss 0.17232. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 24 Iter 105: loss 0.14942. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 24 Iter 105: loss 0.14942. :  47%|████████████████████▏                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 24 Iter 106: loss 0.14836. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 24 Iter 106: loss 0.14836. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 24 Iter 107: loss 0.17762. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 24 Iter 107: loss 0.17762. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 24 Iter 108: loss 0.18112. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 24 Iter 108: loss 0.18112. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 24 Iter 109: loss 0.14619. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 24 Iter 109: loss 0.14619. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 24 Iter 110: loss 0.15160. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 24 Iter 110: loss 0.15160. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 24 Iter 111: loss 0.14583. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 24 Iter 111: loss 0.14583. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 24 Iter 112: loss 0.16596. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 24 Iter 112: loss 0.16596. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 24 Iter 113: loss 0.16118. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 24 Iter 113: loss 0.16118. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 24 Iter 114: loss 0.19135. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.08it/s]
Epoch 24 Iter 114: loss 0.19135. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 24 Iter 115: loss 0.17533. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 24 Iter 115: loss 0.17533. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 24 Iter 116: loss 0.17417. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.08it/s]
Epoch 24 Iter 116: loss 0.17417. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 24 Iter 117: loss 0.14119. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 24 Iter 117: loss 0.14119. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 24 Iter 118: loss 0.15444. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 24 Iter 118: loss 0.15444. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 24 Iter 119: loss 0.16705. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 24 Iter 119: loss 0.16705. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 24 Iter 120: loss 0.17343. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 24 Iter 120: loss 0.17343. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 24 Iter 121: loss 0.16429. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 24 Iter 121: loss 0.16429. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 24 Iter 122: loss 0.15496. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 24 Iter 122: loss 0.15496. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 24 Iter 123: loss 0.15712. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 24 Iter 123: loss 0.15712. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 24 Iter 124: loss 0.16217. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 124: loss 0.16217. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.16098. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.16098. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.15341. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.15341. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.18149. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.18149. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 24 Iter 128: loss 0.18456. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 24 Iter 128: loss 0.18456. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.18360. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.18360. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 24 Iter 130: loss 0.16171. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 130: loss 0.16171. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.16155. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.16155. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 24 Iter 132: loss 0.16683. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 24 Iter 132: loss 0.16683. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 24 Iter 133: loss 0.18426. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 24 Iter 133: loss 0.18426. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 24 Iter 134: loss 0.18479. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 24 Iter 134: loss 0.18479. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.09it/s]
Epoch 24 Iter 135: loss 0.17444. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.09it/s]
Epoch 24 Iter 135: loss 0.17444. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.10it/s]
Epoch 24 Iter 136: loss 0.16144. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.10it/s]
Epoch 24 Iter 136: loss 0.16144. :  61%|██████████████████████████                 | 136/224 [01:05<00:41,  2.10it/s]
Epoch 24 Iter 137: loss 0.16684. :  61%|██████████████████████████                 | 136/224 [01:06<00:41,  2.10it/s]
Epoch 24 Iter 137: loss 0.16684. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 24 Iter 138: loss 0.16866. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 24 Iter 138: loss 0.16866. :  62%|██████████████████████████▍                | 138/224 [01:06<00:40,  2.11it/s]
Epoch 24 Iter 139: loss 0.16312. :  62%|██████████████████████████▍                | 138/224 [01:07<00:40,  2.11it/s]
Epoch 24 Iter 139: loss 0.16312. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 24 Iter 140: loss 0.18320. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 24 Iter 140: loss 0.18320. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.09it/s]
Epoch 24 Iter 141: loss 0.16699. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.09it/s]
Epoch 24 Iter 141: loss 0.16699. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 24 Iter 142: loss 0.15714. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 24 Iter 142: loss 0.15714. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.15886. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.15886. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 24 Iter 144: loss 0.16139. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 24 Iter 144: loss 0.16139. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 24 Iter 145: loss 0.17789. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 145: loss 0.17789. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.15940. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.15940. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 24 Iter 147: loss 0.16236. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 24 Iter 147: loss 0.16236. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 24 Iter 148: loss 0.15789. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 24 Iter 148: loss 0.15789. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 24 Iter 149: loss 0.15812. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 149: loss 0.15812. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 150: loss 0.13091. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 150: loss 0.13091. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 24 Iter 151: loss 0.16563. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 151: loss 0.16563. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 152: loss 0.16134. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 152: loss 0.16134. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 24 Iter 153: loss 0.16229. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 24 Iter 153: loss 0.16229. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 24 Iter 154: loss 0.19976. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 24 Iter 154: loss 0.19976. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 24 Iter 155: loss 0.18128. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 155: loss 0.18128. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.16943. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.16943. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 24 Iter 157: loss 0.17713. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 24 Iter 157: loss 0.17713. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 24 Iter 158: loss 0.17978. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 24 Iter 158: loss 0.17978. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 24 Iter 159: loss 0.15727. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 24 Iter 159: loss 0.15727. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.18492. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.18492. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 24 Iter 161: loss 0.17419. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 24 Iter 161: loss 0.17419. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 24 Iter 162: loss 0.15534. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 24 Iter 162: loss 0.15534. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 24 Iter 163: loss 0.17110. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 24 Iter 163: loss 0.17110. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.05it/s]
Epoch 24 Iter 164: loss 0.17271. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 24 Iter 164: loss 0.17271. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 165: loss 0.14914. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 165: loss 0.14914. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 24 Iter 166: loss 0.16702. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 24 Iter 166: loss 0.16702. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 24 Iter 167: loss 0.15891. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 24 Iter 167: loss 0.15891. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 24 Iter 168: loss 0.17298. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 24 Iter 168: loss 0.17298. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.19529. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.19529. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 24 Iter 170: loss 0.16991. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 170: loss 0.16991. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 171: loss 0.17487. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 171: loss 0.17487. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 24 Iter 172: loss 0.17233. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 172: loss 0.17233. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.15288. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.15288. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 24 Iter 174: loss 0.16140. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 24 Iter 174: loss 0.16140. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 175: loss 0.13839. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 175: loss 0.13839. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 24 Iter 176: loss 0.17197. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 24 Iter 176: loss 0.17197. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 24 Iter 177: loss 0.14593. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 24 Iter 177: loss 0.14593. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:23,  2.04it/s]
Epoch 24 Iter 178: loss 0.16230. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:23,  2.04it/s]
Epoch 24 Iter 178: loss 0.16230. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 24 Iter 179: loss 0.18245. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 24 Iter 179: loss 0.18245. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 24 Iter 180: loss 0.16414. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 24 Iter 180: loss 0.16414. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 24 Iter 181: loss 0.15768. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 24 Iter 181: loss 0.15768. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 24 Iter 182: loss 0.18150. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 24 Iter 182: loss 0.18150. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 24 Iter 183: loss 0.16932. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 24 Iter 183: loss 0.16932. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 24 Iter 184: loss 0.15570. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 184: loss 0.15570. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 185: loss 0.15900. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 185: loss 0.15900. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 24 Iter 186: loss 0.15319. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 24 Iter 186: loss 0.15319. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 24 Iter 187: loss 0.19059. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 24 Iter 187: loss 0.19059. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 24 Iter 188: loss 0.16288. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 24 Iter 188: loss 0.16288. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 24 Iter 189: loss 0.17255. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 24 Iter 189: loss 0.17255. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 24 Iter 190: loss 0.15870. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 24 Iter 190: loss 0.15870. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 24 Iter 191: loss 0.17090. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 24 Iter 191: loss 0.17090. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 24 Iter 192: loss 0.15703. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 192: loss 0.15703. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.17386. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.17386. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 194: loss 0.16963. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 24 Iter 194: loss 0.16963. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 24 Iter 195: loss 0.17734. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 24 Iter 195: loss 0.17734. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 24 Iter 196: loss 0.15024. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 24 Iter 196: loss 0.15024. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 197: loss 0.17234. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 197: loss 0.17234. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 198: loss 0.17665. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 198: loss 0.17665. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 24 Iter 199: loss 0.17935. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 24 Iter 199: loss 0.17935. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 24 Iter 200: loss 0.16965. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 24 Iter 200: loss 0.16965. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 24 Iter 201: loss 0.14751. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 24 Iter 201: loss 0.14751. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 24 Iter 202: loss 0.16233. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 24 Iter 202: loss 0.16233. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 24 Iter 203: loss 0.16175. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 24 Iter 203: loss 0.16175. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 24 Iter 204: loss 0.15411. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 24 Iter 204: loss 0.15411. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 24 Iter 205: loss 0.17130. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 24 Iter 205: loss 0.17130. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 24 Iter 206: loss 0.15513. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 24 Iter 206: loss 0.15513. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.05it/s]
Epoch 24 Iter 207: loss 0.17126. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 24 Iter 207: loss 0.17126. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 24 Iter 208: loss 0.15846. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 24 Iter 208: loss 0.15846. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 24 Iter 209: loss 0.15644. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 24 Iter 209: loss 0.15644. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.17144. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.17144. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 24 Iter 211: loss 0.16404. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 211: loss 0.16404. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.15839. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.15839. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.16420. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.16420. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.18615. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.18615. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 24 Iter 215: loss 0.15489. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.09it/s]
Epoch 24 Iter 215: loss 0.15489. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 24 Iter 216: loss 0.14925. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 24 Iter 216: loss 0.14925. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 24 Iter 217: loss 0.17801. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 24 Iter 217: loss 0.17801. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 24 Iter 218: loss 0.19447. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 24 Iter 218: loss 0.19447. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 24 Iter 219: loss 0.16722. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 24 Iter 219: loss 0.16722. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 24 Iter 220: loss 0.15641. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 24 Iter 220: loss 0.15641. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 24 Iter 221: loss 0.15564. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 24 Iter 221: loss 0.15564. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 24 Iter 222: loss 0.15764. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 24 Iter 222: loss 0.15764. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 24 Iter 223: loss 0.17902. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.08it/s]
Epoch 24 Iter 223: loss 0.17902. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.16973. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.16973. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 24 Iter 224: loss 0.16973. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.16854. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.16854. :   0%|▏                                              | 1/224 [00:00<01:45,  2.11it/s]
Epoch 25 Iter 2: loss 0.18121. :   0%|▏                                              | 1/224 [00:00<01:45,  2.11it/s]
Epoch 25 Iter 2: loss 0.18121. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 25 Iter 3: loss 0.15735. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 25 Iter 3: loss 0.15735. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 25 Iter 4: loss 0.15873. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 25 Iter 4: loss 0.15873. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 25 Iter 5: loss 0.14577. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 25 Iter 5: loss 0.14577. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 25 Iter 6: loss 0.16588. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 25 Iter 6: loss 0.16588. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 25 Iter 7: loss 0.15021. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 25 Iter 7: loss 0.15021. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 8: loss 0.18915. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 8: loss 0.18915. :   4%|█▋                                             | 8/224 [00:03<01:43,  2.08it/s]
Epoch 25 Iter 9: loss 0.16164. :   4%|█▋                                             | 8/224 [00:04<01:43,  2.08it/s]
Epoch 25 Iter 9: loss 0.16164. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.08it/s]
Epoch 25 Iter 10: loss 0.17481. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 25 Iter 10: loss 0.17481. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 25 Iter 11: loss 0.14797. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 25 Iter 11: loss 0.14797. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 25 Iter 12: loss 0.16512. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 25 Iter 12: loss 0.16512. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 25 Iter 13: loss 0.15761. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 25 Iter 13: loss 0.15761. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 25 Iter 14: loss 0.17032. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 25 Iter 14: loss 0.17032. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 25 Iter 15: loss 0.17347. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 25 Iter 15: loss 0.17347. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 16: loss 0.17817. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 16: loss 0.17817. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 25 Iter 17: loss 0.15945. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 25 Iter 17: loss 0.15945. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 18: loss 0.15901. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 18: loss 0.15901. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 19: loss 0.15262. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 25 Iter 19: loss 0.15262. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 25 Iter 20: loss 0.17215. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 25 Iter 20: loss 0.17215. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 25 Iter 21: loss 0.19074. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 25 Iter 21: loss 0.19074. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 25 Iter 22: loss 0.15344. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 25 Iter 22: loss 0.15344. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 25 Iter 23: loss 0.15310. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 25 Iter 23: loss 0.15310. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.16585. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.16585. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 25 Iter 25: loss 0.17427. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 25: loss 0.17427. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 26: loss 0.16936. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 26: loss 0.16936. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 25 Iter 27: loss 0.16892. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 25 Iter 27: loss 0.16892. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.08it/s]
Epoch 25 Iter 28: loss 0.15594. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.08it/s]
Epoch 25 Iter 28: loss 0.15594. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 25 Iter 29: loss 0.17490. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 25 Iter 29: loss 0.17490. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 25 Iter 30: loss 0.15620. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 25 Iter 30: loss 0.15620. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 25 Iter 31: loss 0.16407. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 25 Iter 31: loss 0.16407. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.16143. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.16143. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.18161. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.18161. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.08it/s]
Epoch 25 Iter 34: loss 0.17993. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.08it/s]
Epoch 25 Iter 34: loss 0.17993. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 35: loss 0.17927. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 35: loss 0.17927. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 36: loss 0.16869. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 25 Iter 36: loss 0.16869. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 37: loss 0.15616. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 37: loss 0.15616. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 38: loss 0.15947. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 25 Iter 38: loss 0.15947. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 39: loss 0.17143. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 39: loss 0.17143. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 40: loss 0.16850. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 25 Iter 40: loss 0.16850. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.17519. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.17519. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.15754. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.15754. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 25 Iter 43: loss 0.15434. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 25 Iter 43: loss 0.15434. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 25 Iter 44: loss 0.15422. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 25 Iter 44: loss 0.15422. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 45: loss 0.16380. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 45: loss 0.16380. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 46: loss 0.16701. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 25 Iter 46: loss 0.16701. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 25 Iter 47: loss 0.16346. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 25 Iter 47: loss 0.16346. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 25 Iter 48: loss 0.16383. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 25 Iter 48: loss 0.16383. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 25 Iter 49: loss 0.15503. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 25 Iter 49: loss 0.15503. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 25 Iter 50: loss 0.15254. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 50: loss 0.15254. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 51: loss 0.15785. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 51: loss 0.15785. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 25 Iter 52: loss 0.16251. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 52: loss 0.16251. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.17008. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.17008. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 25 Iter 54: loss 0.16210. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 25 Iter 54: loss 0.16210. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 55: loss 0.15943. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 55: loss 0.15943. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 25 Iter 56: loss 0.14786. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 25 Iter 56: loss 0.14786. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 25 Iter 57: loss 0.16912. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 25 Iter 57: loss 0.16912. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.09it/s]
Epoch 25 Iter 58: loss 0.18033. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.09it/s]
Epoch 25 Iter 58: loss 0.18033. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 25 Iter 59: loss 0.16734. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 25 Iter 59: loss 0.16734. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 25 Iter 60: loss 0.15653. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 25 Iter 60: loss 0.15653. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.16094. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.16094. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 25 Iter 62: loss 0.16220. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 25 Iter 62: loss 0.16220. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 25 Iter 63: loss 0.16454. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 25 Iter 63: loss 0.16454. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 25 Iter 64: loss 0.15177. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 25 Iter 64: loss 0.15177. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.08it/s]
Epoch 25 Iter 65: loss 0.16778. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.08it/s]
Epoch 25 Iter 65: loss 0.16778. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 25 Iter 66: loss 0.16886. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 25 Iter 66: loss 0.16886. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 25 Iter 67: loss 0.16405. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 25 Iter 67: loss 0.16405. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 25 Iter 68: loss 0.16532. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 25 Iter 68: loss 0.16532. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.08it/s]
Epoch 25 Iter 69: loss 0.16399. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 25 Iter 69: loss 0.16399. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 25 Iter 70: loss 0.17867. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 25 Iter 70: loss 0.17867. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.16824. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.16824. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 25 Iter 72: loss 0.18400. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 25 Iter 72: loss 0.18400. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 25 Iter 73: loss 0.16803. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 25 Iter 73: loss 0.16803. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 25 Iter 74: loss 0.17803. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 25 Iter 74: loss 0.17803. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 25 Iter 75: loss 0.14678. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 25 Iter 75: loss 0.14678. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 25 Iter 76: loss 0.16626. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 25 Iter 76: loss 0.16626. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.16046. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.16046. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.16399. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.16399. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.15557. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.15557. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.02it/s]
Epoch 25 Iter 80: loss 0.14964. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.02it/s]
Epoch 25 Iter 80: loss 0.14964. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.03it/s]
Epoch 25 Iter 81: loss 0.16910. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 25 Iter 81: loss 0.16910. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.04it/s]
Epoch 25 Iter 82: loss 0.16451. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.04it/s]
Epoch 25 Iter 82: loss 0.16451. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 25 Iter 83: loss 0.15527. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 25 Iter 83: loss 0.15527. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 25 Iter 84: loss 0.16250. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 25 Iter 84: loss 0.16250. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.16654. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.16654. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 25 Iter 86: loss 0.17017. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 25 Iter 86: loss 0.17017. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.15251. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.15251. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.17836. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.17836. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 25 Iter 89: loss 0.17552. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 25 Iter 89: loss 0.17552. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 25 Iter 90: loss 0.17069. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 25 Iter 90: loss 0.17069. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 25 Iter 91: loss 0.16613. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 25 Iter 91: loss 0.16613. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 92: loss 0.16447. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 92: loss 0.16447. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.19146. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.19146. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 94: loss 0.15073. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 94: loss 0.15073. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 95: loss 0.15518. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 25 Iter 95: loss 0.15518. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 25 Iter 96: loss 0.16759. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 25 Iter 96: loss 0.16759. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 25 Iter 97: loss 0.16594. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 25 Iter 97: loss 0.16594. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.07it/s]
Epoch 25 Iter 98: loss 0.15657. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 25 Iter 98: loss 0.15657. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 25 Iter 99: loss 0.17601. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 25 Iter 99: loss 0.17601. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.08it/s]
Epoch 25 Iter 100: loss 0.14277. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 25 Iter 100: loss 0.14277. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 25 Iter 101: loss 0.19989. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 25 Iter 101: loss 0.19989. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.05it/s]
Epoch 25 Iter 102: loss 0.16761. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 102: loss 0.16761. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 103: loss 0.15953. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 103: loss 0.15953. :  46%|███████████████████▊                       | 103/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 104: loss 0.15787. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 25 Iter 104: loss 0.15787. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 25 Iter 105: loss 0.16370. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 25 Iter 105: loss 0.16370. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 25 Iter 106: loss 0.15766. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 25 Iter 106: loss 0.15766. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 25 Iter 107: loss 0.15623. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 25 Iter 107: loss 0.15623. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 25 Iter 108: loss 0.15377. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 108: loss 0.15377. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 109: loss 0.15563. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 109: loss 0.15563. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 25 Iter 110: loss 0.16595. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 25 Iter 110: loss 0.16595. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 25 Iter 111: loss 0.16939. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 25 Iter 111: loss 0.16939. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 25 Iter 112: loss 0.18464. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 112: loss 0.18464. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.16416. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.16416. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.15215. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.15215. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.18814. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.18814. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.18369. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.18369. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 25 Iter 117: loss 0.15096. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 25 Iter 117: loss 0.15096. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 25 Iter 118: loss 0.17211. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 25 Iter 118: loss 0.17211. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.15811. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.15811. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 25 Iter 120: loss 0.16788. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 25 Iter 120: loss 0.16788. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 25 Iter 121: loss 0.17725. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 25 Iter 121: loss 0.17725. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.09it/s]
Epoch 25 Iter 122: loss 0.15558. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.09it/s]
Epoch 25 Iter 122: loss 0.15558. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 25 Iter 123: loss 0.17047. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 25 Iter 123: loss 0.17047. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 25 Iter 124: loss 0.16157. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 25 Iter 124: loss 0.16157. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 25 Iter 125: loss 0.17668. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 25 Iter 125: loss 0.17668. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 25 Iter 126: loss 0.16878. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.08it/s]
Epoch 25 Iter 126: loss 0.16878. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 127: loss 0.15335. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 127: loss 0.15335. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 25 Iter 128: loss 0.14274. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 25 Iter 128: loss 0.14274. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.16038. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.16038. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.16181. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.16181. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 25 Iter 131: loss 0.14958. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 25 Iter 131: loss 0.14958. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.15743. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.15743. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 25 Iter 133: loss 0.18320. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 25 Iter 133: loss 0.18320. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 25 Iter 134: loss 0.18083. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 25 Iter 134: loss 0.18083. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 25 Iter 135: loss 0.15902. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 25 Iter 135: loss 0.15902. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 25 Iter 136: loss 0.15240. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 25 Iter 136: loss 0.15240. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 25 Iter 137: loss 0.15415. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 25 Iter 137: loss 0.15415. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 25 Iter 138: loss 0.18689. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 25 Iter 138: loss 0.18689. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 25 Iter 139: loss 0.17571. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 25 Iter 139: loss 0.17571. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 25 Iter 140: loss 0.15119. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 25 Iter 140: loss 0.15119. :  62%|██████████████████████████▉                | 140/224 [01:07<00:41,  2.05it/s]
Epoch 25 Iter 141: loss 0.16932. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.05it/s]
Epoch 25 Iter 141: loss 0.16932. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 142: loss 0.16931. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 142: loss 0.16931. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 25 Iter 143: loss 0.16843. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 25 Iter 143: loss 0.16843. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 25 Iter 144: loss 0.16405. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 25 Iter 144: loss 0.16405. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 25 Iter 145: loss 0.16568. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 25 Iter 145: loss 0.16568. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 25 Iter 146: loss 0.16164. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 25 Iter 146: loss 0.16164. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 25 Iter 147: loss 0.15422. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 25 Iter 147: loss 0.15422. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.09it/s]
Epoch 25 Iter 148: loss 0.16466. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.09it/s]
Epoch 25 Iter 148: loss 0.16466. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 25 Iter 149: loss 0.17732. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 25 Iter 149: loss 0.17732. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 25 Iter 150: loss 0.17135. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 25 Iter 150: loss 0.17135. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 25 Iter 151: loss 0.16264. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 25 Iter 151: loss 0.16264. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 25 Iter 152: loss 0.15813. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 25 Iter 152: loss 0.15813. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 25 Iter 153: loss 0.15386. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 153: loss 0.15386. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 154: loss 0.15038. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 154: loss 0.15038. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 25 Iter 155: loss 0.17453. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 25 Iter 155: loss 0.17453. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 25 Iter 156: loss 0.19757. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 25 Iter 156: loss 0.19757. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 25 Iter 157: loss 0.16153. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 25 Iter 157: loss 0.16153. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 25 Iter 158: loss 0.19134. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 25 Iter 158: loss 0.19134. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 25 Iter 159: loss 0.15155. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 25 Iter 159: loss 0.15155. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.17357. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.17357. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 161: loss 0.16591. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 25 Iter 161: loss 0.16591. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 25 Iter 162: loss 0.17666. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 25 Iter 162: loss 0.17666. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 25 Iter 163: loss 0.17365. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 25 Iter 163: loss 0.17365. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.16695. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.16695. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 25 Iter 165: loss 0.16753. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 25 Iter 165: loss 0.16753. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 25 Iter 166: loss 0.17365. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 25 Iter 166: loss 0.17365. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 25 Iter 167: loss 0.15861. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 25 Iter 167: loss 0.15861. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 25 Iter 168: loss 0.17207. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 25 Iter 168: loss 0.17207. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 25 Iter 169: loss 0.16846. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 25 Iter 169: loss 0.16846. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 25 Iter 170: loss 0.15812. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 25 Iter 170: loss 0.15812. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 25 Iter 171: loss 0.16509. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 25 Iter 171: loss 0.16509. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 25 Iter 172: loss 0.14384. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 25 Iter 172: loss 0.14384. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 25 Iter 173: loss 0.18663. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 25 Iter 173: loss 0.18663. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 25 Iter 174: loss 0.14625. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 25 Iter 174: loss 0.14625. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.17386. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.17386. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 25 Iter 176: loss 0.15297. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 25 Iter 176: loss 0.15297. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 25 Iter 177: loss 0.16486. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 25 Iter 177: loss 0.16486. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 25 Iter 178: loss 0.17697. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 25 Iter 178: loss 0.17697. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 25 Iter 179: loss 0.17981. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 25 Iter 179: loss 0.17981. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 25 Iter 180: loss 0.16525. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 25 Iter 180: loss 0.16525. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 25 Iter 181: loss 0.16669. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 25 Iter 181: loss 0.16669. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 25 Iter 182: loss 0.15892. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 25 Iter 182: loss 0.15892. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 25 Iter 183: loss 0.16458. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 25 Iter 183: loss 0.16458. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 25 Iter 184: loss 0.16357. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 25 Iter 184: loss 0.16357. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 25 Iter 185: loss 0.18709. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 25 Iter 185: loss 0.18709. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 25 Iter 186: loss 0.16161. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 25 Iter 186: loss 0.16161. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 25 Iter 187: loss 0.16954. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 25 Iter 187: loss 0.16954. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 25 Iter 188: loss 0.14322. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 25 Iter 188: loss 0.14322. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 25 Iter 189: loss 0.15687. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 25 Iter 189: loss 0.15687. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 25 Iter 190: loss 0.16131. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 25 Iter 190: loss 0.16131. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 25 Iter 191: loss 0.16859. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 25 Iter 191: loss 0.16859. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 25 Iter 192: loss 0.18276. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 25 Iter 192: loss 0.18276. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 25 Iter 193: loss 0.16713. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 25 Iter 193: loss 0.16713. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.07it/s]
Epoch 25 Iter 194: loss 0.15689. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.07it/s]
Epoch 25 Iter 194: loss 0.15689. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 25 Iter 195: loss 0.17802. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 195: loss 0.17802. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 196: loss 0.15326. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 196: loss 0.15326. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 25 Iter 197: loss 0.15403. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 197: loss 0.15403. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 198: loss 0.16386. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 198: loss 0.16386. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.10it/s]
Epoch 25 Iter 199: loss 0.17868. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.10it/s]
Epoch 25 Iter 199: loss 0.17868. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 25 Iter 200: loss 0.14722. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 25 Iter 200: loss 0.14722. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.17443. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.17443. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.13598. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.13598. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 25 Iter 203: loss 0.16594. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 25 Iter 203: loss 0.16594. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 204: loss 0.17372. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 204: loss 0.17372. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 25 Iter 205: loss 0.16136. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 25 Iter 205: loss 0.16136. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 25 Iter 206: loss 0.17009. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 25 Iter 206: loss 0.17009. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 25 Iter 207: loss 0.17416. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 25 Iter 207: loss 0.17416. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 25 Iter 208: loss 0.15658. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 25 Iter 208: loss 0.15658. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 25 Iter 209: loss 0.16799. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 25 Iter 209: loss 0.16799. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 25 Iter 210: loss 0.16107. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 25 Iter 210: loss 0.16107. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 25 Iter 211: loss 0.17055. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 25 Iter 211: loss 0.17055. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.09it/s]
Epoch 25 Iter 212: loss 0.18397. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.09it/s]
Epoch 25 Iter 212: loss 0.18397. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.09it/s]
Epoch 25 Iter 213: loss 0.15407. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.09it/s]
Epoch 25 Iter 213: loss 0.15407. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 25 Iter 214: loss 0.19723. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 25 Iter 214: loss 0.19723. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 25 Iter 215: loss 0.17425. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 25 Iter 215: loss 0.17425. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 25 Iter 216: loss 0.17189. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 25 Iter 216: loss 0.17189. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 25 Iter 217: loss 0.16968. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 25 Iter 217: loss 0.16968. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 25 Iter 218: loss 0.18438. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 25 Iter 218: loss 0.18438. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 25 Iter 219: loss 0.16775. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 25 Iter 219: loss 0.16775. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 25 Iter 220: loss 0.17419. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 25 Iter 220: loss 0.17419. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 25 Iter 221: loss 0.17133. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 25 Iter 221: loss 0.17133. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 25 Iter 222: loss 0.15020. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 25 Iter 222: loss 0.15020. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 25 Iter 223: loss 0.16068. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 25 Iter 223: loss 0.16068. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 25 Iter 224: loss 0.14871. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 25 Iter 224: loss 0.14871. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 25 Iter 224: loss 0.14871. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.16546
    Valid loss: 0.17042
       Valid loss recons: 0.17042
       Valid loss KL-D:   63958.05273
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.15103. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.15103. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 26 Iter 2: loss 0.15026. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 26 Iter 2: loss 0.15026. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 26 Iter 3: loss 0.17917. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 26 Iter 3: loss 0.17917. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 26 Iter 4: loss 0.17884. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 26 Iter 4: loss 0.17884. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 26 Iter 5: loss 0.15753. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 26 Iter 5: loss 0.15753. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 26 Iter 6: loss 0.17622. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 26 Iter 6: loss 0.17622. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 26 Iter 7: loss 0.19054. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 26 Iter 7: loss 0.19054. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 26 Iter 8: loss 0.17185. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 26 Iter 8: loss 0.17185. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 26 Iter 9: loss 0.16168. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 26 Iter 9: loss 0.16168. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 26 Iter 10: loss 0.14428. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 26 Iter 10: loss 0.14428. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 26 Iter 11: loss 0.15499. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 26 Iter 11: loss 0.15499. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 26 Iter 12: loss 0.14838. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 26 Iter 12: loss 0.14838. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.04it/s]
Epoch 26 Iter 13: loss 0.17832. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.04it/s]
Epoch 26 Iter 13: loss 0.17832. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.04it/s]
Epoch 26 Iter 14: loss 0.18880. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.04it/s]
Epoch 26 Iter 14: loss 0.18880. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 26 Iter 15: loss 0.17278. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 26 Iter 15: loss 0.17278. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 26 Iter 16: loss 0.15810. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 26 Iter 16: loss 0.15810. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 26 Iter 17: loss 0.17176. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 26 Iter 17: loss 0.17176. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 26 Iter 18: loss 0.18332. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 26 Iter 18: loss 0.18332. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 26 Iter 19: loss 0.17164. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 26 Iter 19: loss 0.17164. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 26 Iter 20: loss 0.15895. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 26 Iter 20: loss 0.15895. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 26 Iter 21: loss 0.16932. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 26 Iter 21: loss 0.16932. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 26 Iter 22: loss 0.16118. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 26 Iter 22: loss 0.16118. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 26 Iter 23: loss 0.15446. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 26 Iter 23: loss 0.15446. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 26 Iter 24: loss 0.16354. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 26 Iter 24: loss 0.16354. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 26 Iter 25: loss 0.16103. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 26 Iter 25: loss 0.16103. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 26 Iter 26: loss 0.15700. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 26 Iter 26: loss 0.15700. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 26 Iter 27: loss 0.15162. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 27: loss 0.15162. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 26 Iter 28: loss 0.15574. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 26 Iter 28: loss 0.15574. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 26 Iter 29: loss 0.16607. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 26 Iter 29: loss 0.16607. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 26 Iter 30: loss 0.15666. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 26 Iter 30: loss 0.15666. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 26 Iter 31: loss 0.16092. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 26 Iter 31: loss 0.16092. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 26 Iter 32: loss 0.14820. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 26 Iter 32: loss 0.14820. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.04it/s]
Epoch 26 Iter 33: loss 0.14467. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.04it/s]
Epoch 26 Iter 33: loss 0.14467. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 26 Iter 34: loss 0.15812. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 26 Iter 34: loss 0.15812. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 26 Iter 35: loss 0.16067. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 26 Iter 35: loss 0.16067. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 26 Iter 36: loss 0.16538. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 26 Iter 36: loss 0.16538. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 26 Iter 37: loss 0.17442. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 26 Iter 37: loss 0.17442. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 26 Iter 38: loss 0.15122. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 26 Iter 38: loss 0.15122. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 26 Iter 39: loss 0.15602. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 26 Iter 39: loss 0.15602. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 26 Iter 40: loss 0.17329. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 26 Iter 40: loss 0.17329. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 41: loss 0.14055. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 41: loss 0.14055. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 42: loss 0.15778. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 26 Iter 42: loss 0.15778. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 26 Iter 43: loss 0.17295. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 26 Iter 43: loss 0.17295. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 26 Iter 44: loss 0.17033. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 26 Iter 44: loss 0.17033. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 26 Iter 45: loss 0.15228. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 26 Iter 45: loss 0.15228. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 26 Iter 46: loss 0.16841. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 26 Iter 46: loss 0.16841. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 47: loss 0.16924. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 47: loss 0.16924. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 48: loss 0.16508. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 26 Iter 48: loss 0.16508. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 26 Iter 49: loss 0.16915. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 26 Iter 49: loss 0.16915. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 26 Iter 50: loss 0.16196. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 26 Iter 50: loss 0.16196. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.05it/s]
Epoch 26 Iter 51: loss 0.18286. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.05it/s]
Epoch 26 Iter 51: loss 0.18286. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 26 Iter 52: loss 0.17304. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 26 Iter 52: loss 0.17304. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 26 Iter 53: loss 0.18109. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 26 Iter 53: loss 0.18109. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 26 Iter 54: loss 0.15199. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 26 Iter 54: loss 0.15199. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 26 Iter 55: loss 0.16177. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 26 Iter 55: loss 0.16177. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 26 Iter 56: loss 0.16549. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 26 Iter 56: loss 0.16549. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 57: loss 0.16126. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 57: loss 0.16126. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 58: loss 0.16914. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 26 Iter 58: loss 0.16914. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 59: loss 0.17488. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 59: loss 0.17488. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.16773. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.16773. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.18373. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.18373. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 26 Iter 62: loss 0.17375. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 26 Iter 62: loss 0.17375. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 26 Iter 63: loss 0.16837. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 26 Iter 63: loss 0.16837. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 26 Iter 64: loss 0.17772. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 26 Iter 64: loss 0.17772. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 26 Iter 65: loss 0.16564. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 26 Iter 65: loss 0.16564. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 26 Iter 66: loss 0.16192. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 26 Iter 66: loss 0.16192. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.16845. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.16845. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 26 Iter 68: loss 0.15664. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 26 Iter 68: loss 0.15664. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 26 Iter 69: loss 0.16099. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 26 Iter 69: loss 0.16099. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 26 Iter 70: loss 0.17254. :  31%|█████████████▊                               | 69/224 [00:34<01:14,  2.07it/s]
Epoch 26 Iter 70: loss 0.17254. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 26 Iter 71: loss 0.15642. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 26 Iter 71: loss 0.15642. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 26 Iter 72: loss 0.16808. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.05it/s]
Epoch 26 Iter 72: loss 0.16808. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 26 Iter 73: loss 0.14751. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 26 Iter 73: loss 0.14751. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 26 Iter 74: loss 0.16217. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 26 Iter 74: loss 0.16217. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.05it/s]
Epoch 26 Iter 75: loss 0.15521. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 26 Iter 75: loss 0.15521. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 26 Iter 76: loss 0.17944. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 26 Iter 76: loss 0.17944. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.04it/s]
Epoch 26 Iter 77: loss 0.16360. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.04it/s]
Epoch 26 Iter 77: loss 0.16360. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 26 Iter 78: loss 0.14458. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 26 Iter 78: loss 0.14458. :  35%|███████████████▋                             | 78/224 [00:37<01:12,  2.03it/s]
Epoch 26 Iter 79: loss 0.16950. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.03it/s]
Epoch 26 Iter 79: loss 0.16950. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.02it/s]
Epoch 26 Iter 80: loss 0.15261. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.02it/s]
Epoch 26 Iter 80: loss 0.15261. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.03it/s]
Epoch 26 Iter 81: loss 0.16977. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 26 Iter 81: loss 0.16977. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 26 Iter 82: loss 0.16603. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 26 Iter 82: loss 0.16603. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 26 Iter 83: loss 0.17100. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 26 Iter 83: loss 0.17100. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.04it/s]
Epoch 26 Iter 84: loss 0.16007. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.04it/s]
Epoch 26 Iter 84: loss 0.16007. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.04it/s]
Epoch 26 Iter 85: loss 0.16459. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 26 Iter 85: loss 0.16459. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 26 Iter 86: loss 0.18177. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 26 Iter 86: loss 0.18177. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 26 Iter 87: loss 0.17019. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 26 Iter 87: loss 0.17019. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 26 Iter 88: loss 0.16833. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 26 Iter 88: loss 0.16833. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 26 Iter 89: loss 0.16282. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 26 Iter 89: loss 0.16282. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 26 Iter 90: loss 0.17929. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 26 Iter 90: loss 0.17929. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 26 Iter 91: loss 0.15851. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 26 Iter 91: loss 0.15851. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 26 Iter 92: loss 0.16634. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 26 Iter 92: loss 0.16634. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 26 Iter 93: loss 0.17397. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 93: loss 0.17397. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.15397. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.15397. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 26 Iter 95: loss 0.15781. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 95: loss 0.15781. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 96: loss 0.16580. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 96: loss 0.16580. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 26 Iter 97: loss 0.18975. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 26 Iter 97: loss 0.18975. :  43%|███████████████████▍                         | 97/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 98: loss 0.16778. :  43%|███████████████████▍                         | 97/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 98: loss 0.16778. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 99: loss 0.14214. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 26 Iter 99: loss 0.14214. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.08it/s]
Epoch 26 Iter 100: loss 0.16701. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 26 Iter 100: loss 0.16701. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 26 Iter 101: loss 0.16400. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.08it/s]
Epoch 26 Iter 101: loss 0.16400. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 26 Iter 102: loss 0.17247. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 26 Iter 102: loss 0.17247. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 26 Iter 103: loss 0.14231. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 26 Iter 103: loss 0.14231. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 26 Iter 104: loss 0.18648. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 26 Iter 104: loss 0.18648. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 26 Iter 105: loss 0.17136. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.07it/s]
Epoch 26 Iter 105: loss 0.17136. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 26 Iter 106: loss 0.14878. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 26 Iter 106: loss 0.14878. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 26 Iter 107: loss 0.14611. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 26 Iter 107: loss 0.14611. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 26 Iter 108: loss 0.15567. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 26 Iter 108: loss 0.15567. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 26 Iter 109: loss 0.15359. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 26 Iter 109: loss 0.15359. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 26 Iter 110: loss 0.18618. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 26 Iter 110: loss 0.18618. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 26 Iter 111: loss 0.16068. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 26 Iter 111: loss 0.16068. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 26 Iter 112: loss 0.16802. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 26 Iter 112: loss 0.16802. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 26 Iter 113: loss 0.16511. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 26 Iter 113: loss 0.16511. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 26 Iter 114: loss 0.17300. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 26 Iter 114: loss 0.17300. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 115: loss 0.14559. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 115: loss 0.14559. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 26 Iter 116: loss 0.18634. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 26 Iter 116: loss 0.18634. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 26 Iter 117: loss 0.17901. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 26 Iter 117: loss 0.17901. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 26 Iter 118: loss 0.17778. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 26 Iter 118: loss 0.17778. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 26 Iter 119: loss 0.16552. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 26 Iter 119: loss 0.16552. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 26 Iter 120: loss 0.18564. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 26 Iter 120: loss 0.18564. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 26 Iter 121: loss 0.16743. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 26 Iter 121: loss 0.16743. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 26 Iter 122: loss 0.15024. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 26 Iter 122: loss 0.15024. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 26 Iter 123: loss 0.16910. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 26 Iter 123: loss 0.16910. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 26 Iter 124: loss 0.18230. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 26 Iter 124: loss 0.18230. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 26 Iter 125: loss 0.16549. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 26 Iter 125: loss 0.16549. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 126: loss 0.16361. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 26 Iter 126: loss 0.16361. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 26 Iter 127: loss 0.16693. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 26 Iter 127: loss 0.16693. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 26 Iter 128: loss 0.16040. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 26 Iter 128: loss 0.16040. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 26 Iter 129: loss 0.16061. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 26 Iter 129: loss 0.16061. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.07it/s]
Epoch 26 Iter 130: loss 0.16484. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.07it/s]
Epoch 26 Iter 130: loss 0.16484. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 26 Iter 131: loss 0.16365. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 26 Iter 131: loss 0.16365. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 26 Iter 132: loss 0.17195. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 26 Iter 132: loss 0.17195. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 26 Iter 133: loss 0.16205. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 26 Iter 133: loss 0.16205. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 26 Iter 134: loss 0.17982. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.07it/s]
Epoch 26 Iter 134: loss 0.17982. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 26 Iter 135: loss 0.17304. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 26 Iter 135: loss 0.17304. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 26 Iter 136: loss 0.13941. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 26 Iter 136: loss 0.13941. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 26 Iter 137: loss 0.15872. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 26 Iter 137: loss 0.15872. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.03it/s]
Epoch 26 Iter 138: loss 0.17194. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.03it/s]
Epoch 26 Iter 138: loss 0.17194. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 26 Iter 139: loss 0.17230. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 26 Iter 139: loss 0.17230. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 26 Iter 140: loss 0.15676. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 26 Iter 140: loss 0.15676. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.05it/s]
Epoch 26 Iter 141: loss 0.15401. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.05it/s]
Epoch 26 Iter 141: loss 0.15401. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 26 Iter 142: loss 0.16423. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 26 Iter 142: loss 0.16423. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 26 Iter 143: loss 0.15803. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 26 Iter 143: loss 0.15803. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 26 Iter 144: loss 0.16310. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 26 Iter 144: loss 0.16310. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 26 Iter 145: loss 0.17564. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 26 Iter 145: loss 0.17564. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 26 Iter 146: loss 0.16247. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 26 Iter 146: loss 0.16247. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.09it/s]
Epoch 26 Iter 147: loss 0.15300. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 26 Iter 147: loss 0.15300. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 26 Iter 148: loss 0.17090. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 26 Iter 148: loss 0.17090. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 26 Iter 149: loss 0.16569. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 26 Iter 149: loss 0.16569. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 26 Iter 150: loss 0.15636. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 26 Iter 150: loss 0.15636. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 26 Iter 151: loss 0.17850. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 26 Iter 151: loss 0.17850. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 26 Iter 152: loss 0.17542. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 26 Iter 152: loss 0.17542. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 26 Iter 153: loss 0.16601. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 153: loss 0.16601. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 154: loss 0.16238. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 154: loss 0.16238. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 155: loss 0.17557. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 26 Iter 155: loss 0.17557. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 26 Iter 156: loss 0.15549. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 26 Iter 156: loss 0.15549. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 26 Iter 157: loss 0.16961. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 26 Iter 157: loss 0.16961. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 26 Iter 158: loss 0.17524. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 26 Iter 158: loss 0.17524. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.04it/s]
Epoch 26 Iter 159: loss 0.16215. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.04it/s]
Epoch 26 Iter 159: loss 0.16215. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 160: loss 0.17091. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 160: loss 0.17091. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 161: loss 0.18043. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 26 Iter 161: loss 0.18043. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 26 Iter 162: loss 0.17532. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 26 Iter 162: loss 0.17532. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.04it/s]
Epoch 26 Iter 163: loss 0.15903. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.04it/s]
Epoch 26 Iter 163: loss 0.15903. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 26 Iter 164: loss 0.18277. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 26 Iter 164: loss 0.18277. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 26 Iter 165: loss 0.14899. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 26 Iter 165: loss 0.14899. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 166: loss 0.17050. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 166: loss 0.17050. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 26 Iter 167: loss 0.16127. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 26 Iter 167: loss 0.16127. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 26 Iter 168: loss 0.15505. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 26 Iter 168: loss 0.15505. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 26 Iter 169: loss 0.16005. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 26 Iter 169: loss 0.16005. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 170: loss 0.14546. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 170: loss 0.14546. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 171: loss 0.15148. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 26 Iter 171: loss 0.15148. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 26 Iter 172: loss 0.15334. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 26 Iter 172: loss 0.15334. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 26 Iter 173: loss 0.14338. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 26 Iter 173: loss 0.14338. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 26 Iter 174: loss 0.15670. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 26 Iter 174: loss 0.15670. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 26 Iter 175: loss 0.18276. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 26 Iter 175: loss 0.18276. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 26 Iter 176: loss 0.16453. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 26 Iter 176: loss 0.16453. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 26 Iter 177: loss 0.15679. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 26 Iter 177: loss 0.15679. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 26 Iter 178: loss 0.15797. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 26 Iter 178: loss 0.15797. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 26 Iter 179: loss 0.14645. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 26 Iter 179: loss 0.14645. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 26 Iter 180: loss 0.17161. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 26 Iter 180: loss 0.17161. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 26 Iter 181: loss 0.17538. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 26 Iter 181: loss 0.17538. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.17957. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.17957. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 26 Iter 183: loss 0.18712. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 26 Iter 183: loss 0.18712. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 26 Iter 184: loss 0.17414. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 26 Iter 184: loss 0.17414. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.15677. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.15677. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.16846. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.16846. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 26 Iter 187: loss 0.15614. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 26 Iter 187: loss 0.15614. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.17422. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.17422. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.16675. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.16675. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 26 Iter 190: loss 0.16285. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 26 Iter 190: loss 0.16285. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 26 Iter 191: loss 0.16991. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 26 Iter 191: loss 0.16991. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 26 Iter 192: loss 0.17615. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 26 Iter 192: loss 0.17615. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 26 Iter 193: loss 0.16115. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 26 Iter 193: loss 0.16115. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 26 Iter 194: loss 0.17714. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 26 Iter 194: loss 0.17714. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 26 Iter 195: loss 0.16727. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 26 Iter 195: loss 0.16727. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 26 Iter 196: loss 0.14887. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 26 Iter 196: loss 0.14887. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.16935. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.16935. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 26 Iter 198: loss 0.18344. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 26 Iter 198: loss 0.18344. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 26 Iter 199: loss 0.16566. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 26 Iter 199: loss 0.16566. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 26 Iter 200: loss 0.16457. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 26 Iter 200: loss 0.16457. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.16698. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.16698. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 26 Iter 202: loss 0.15227. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 26 Iter 202: loss 0.15227. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 26 Iter 203: loss 0.17140. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 26 Iter 203: loss 0.17140. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.16231. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.16231. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 26 Iter 205: loss 0.17032. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 26 Iter 205: loss 0.17032. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 26 Iter 206: loss 0.14992. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 26 Iter 206: loss 0.14992. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 26 Iter 207: loss 0.17465. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 26 Iter 207: loss 0.17465. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 26 Iter 208: loss 0.18778. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.07it/s]
Epoch 26 Iter 208: loss 0.18778. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 26 Iter 209: loss 0.18115. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 26 Iter 209: loss 0.18115. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 26 Iter 210: loss 0.17485. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 26 Iter 210: loss 0.17485. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 26 Iter 211: loss 0.16183. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 26 Iter 211: loss 0.16183. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 26 Iter 212: loss 0.15969. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 26 Iter 212: loss 0.15969. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 26 Iter 213: loss 0.15036. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 26 Iter 213: loss 0.15036. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 26 Iter 214: loss 0.17598. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 26 Iter 214: loss 0.17598. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 26 Iter 215: loss 0.15267. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 26 Iter 215: loss 0.15267. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 26 Iter 216: loss 0.15153. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 26 Iter 216: loss 0.15153. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 26 Iter 217: loss 0.15195. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 26 Iter 217: loss 0.15195. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 26 Iter 218: loss 0.16100. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 26 Iter 218: loss 0.16100. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 26 Iter 219: loss 0.17479. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 26 Iter 219: loss 0.17479. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 26 Iter 220: loss 0.17885. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 26 Iter 220: loss 0.17885. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 26 Iter 221: loss 0.16682. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 26 Iter 221: loss 0.16682. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.04it/s]
Epoch 26 Iter 222: loss 0.17892. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.04it/s]
Epoch 26 Iter 222: loss 0.17892. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 26 Iter 223: loss 0.16853. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 26 Iter 223: loss 0.16853. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 26 Iter 224: loss 0.17880. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 26 Iter 224: loss 0.17880. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 26 Iter 224: loss 0.17880. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.16283. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.16283. :   0%|▏                                              | 1/224 [00:00<01:51,  2.01it/s]
Epoch 27 Iter 2: loss 0.15400. :   0%|▏                                              | 1/224 [00:00<01:51,  2.01it/s]
Epoch 27 Iter 2: loss 0.15400. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 27 Iter 3: loss 0.16689. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 27 Iter 3: loss 0.16689. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 27 Iter 4: loss 0.16025. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 27 Iter 4: loss 0.16025. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 27 Iter 5: loss 0.15568. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 27 Iter 5: loss 0.15568. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 27 Iter 6: loss 0.17760. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 27 Iter 6: loss 0.17760. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 27 Iter 7: loss 0.17555. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 27 Iter 7: loss 0.17555. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 27 Iter 8: loss 0.14923. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 27 Iter 8: loss 0.14923. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 27 Iter 9: loss 0.16398. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 27 Iter 9: loss 0.16398. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 27 Iter 10: loss 0.16547. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 27 Iter 10: loss 0.16547. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 27 Iter 11: loss 0.16300. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 27 Iter 11: loss 0.16300. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 27 Iter 12: loss 0.15158. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 27 Iter 12: loss 0.15158. :   5%|██▍                                          | 12/224 [00:05<01:44,  2.03it/s]
Epoch 27 Iter 13: loss 0.15373. :   5%|██▍                                          | 12/224 [00:06<01:44,  2.03it/s]
Epoch 27 Iter 13: loss 0.15373. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 27 Iter 14: loss 0.14779. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 27 Iter 14: loss 0.14779. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 27 Iter 15: loss 0.16176. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 27 Iter 15: loss 0.16176. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 16: loss 0.13861. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 16: loss 0.13861. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 17: loss 0.15969. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 27 Iter 17: loss 0.15969. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 27 Iter 18: loss 0.14748. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.05it/s]
Epoch 27 Iter 18: loss 0.14748. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.03it/s]
Epoch 27 Iter 19: loss 0.17080. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.03it/s]
Epoch 27 Iter 19: loss 0.17080. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 27 Iter 20: loss 0.16066. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 27 Iter 20: loss 0.16066. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 27 Iter 21: loss 0.18510. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 27 Iter 21: loss 0.18510. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 27 Iter 22: loss 0.17043. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 27 Iter 22: loss 0.17043. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.04it/s]
Epoch 27 Iter 23: loss 0.15489. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.04it/s]
Epoch 27 Iter 23: loss 0.15489. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 27 Iter 24: loss 0.16498. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 27 Iter 24: loss 0.16498. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.04it/s]
Epoch 27 Iter 25: loss 0.16564. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.04it/s]
Epoch 27 Iter 25: loss 0.16564. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 27 Iter 26: loss 0.13411. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 27 Iter 26: loss 0.13411. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 27 Iter 27: loss 0.15984. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 27 Iter 27: loss 0.15984. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 27 Iter 28: loss 0.15290. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 27 Iter 28: loss 0.15290. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 27 Iter 29: loss 0.17357. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 27 Iter 29: loss 0.17357. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 27 Iter 30: loss 0.16745. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 27 Iter 30: loss 0.16745. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 27 Iter 31: loss 0.16421. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 27 Iter 31: loss 0.16421. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 27 Iter 32: loss 0.15320. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 27 Iter 32: loss 0.15320. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.04it/s]
Epoch 27 Iter 33: loss 0.16065. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.04it/s]
Epoch 27 Iter 33: loss 0.16065. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 27 Iter 34: loss 0.17523. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 27 Iter 34: loss 0.17523. :  15%|██████▊                                      | 34/224 [00:16<01:33,  2.03it/s]
Epoch 27 Iter 35: loss 0.17744. :  15%|██████▊                                      | 34/224 [00:17<01:33,  2.03it/s]
Epoch 27 Iter 35: loss 0.17744. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 27 Iter 36: loss 0.17920. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 27 Iter 36: loss 0.17920. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 27 Iter 37: loss 0.16709. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 27 Iter 37: loss 0.16709. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 27 Iter 38: loss 0.14815. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 27 Iter 38: loss 0.14815. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.04it/s]
Epoch 27 Iter 39: loss 0.16048. :  17%|███████▋                                     | 38/224 [00:19<01:31,  2.04it/s]
Epoch 27 Iter 39: loss 0.16048. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 27 Iter 40: loss 0.16234. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 27 Iter 40: loss 0.16234. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 27 Iter 41: loss 0.15485. :  18%|████████                                     | 40/224 [00:20<01:30,  2.04it/s]
Epoch 27 Iter 41: loss 0.15485. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 27 Iter 42: loss 0.16556. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 27 Iter 42: loss 0.16556. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 27 Iter 43: loss 0.18146. :  19%|████████▍                                    | 42/224 [00:21<01:28,  2.05it/s]
Epoch 27 Iter 43: loss 0.18146. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 27 Iter 44: loss 0.16991. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 27 Iter 44: loss 0.16991. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.05it/s]
Epoch 27 Iter 45: loss 0.17028. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.05it/s]
Epoch 27 Iter 45: loss 0.17028. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 27 Iter 46: loss 0.18785. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 27 Iter 46: loss 0.18785. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 27 Iter 47: loss 0.18357. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 27 Iter 47: loss 0.18357. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 27 Iter 48: loss 0.17511. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 27 Iter 48: loss 0.17511. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 27 Iter 49: loss 0.16685. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 27 Iter 49: loss 0.16685. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 27 Iter 50: loss 0.15706. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 27 Iter 50: loss 0.15706. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 27 Iter 51: loss 0.17648. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 27 Iter 51: loss 0.17648. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 27 Iter 52: loss 0.17132. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 27 Iter 52: loss 0.17132. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 27 Iter 53: loss 0.17426. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 27 Iter 53: loss 0.17426. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 27 Iter 54: loss 0.18037. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 27 Iter 54: loss 0.18037. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 27 Iter 55: loss 0.17125. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 27 Iter 55: loss 0.17125. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 27 Iter 56: loss 0.17640. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 27 Iter 56: loss 0.17640. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.05it/s]
Epoch 27 Iter 57: loss 0.15699. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.05it/s]
Epoch 27 Iter 57: loss 0.15699. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 27 Iter 58: loss 0.16363. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 27 Iter 58: loss 0.16363. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 27 Iter 59: loss 0.16989. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 27 Iter 59: loss 0.16989. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 27 Iter 60: loss 0.17474. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 27 Iter 60: loss 0.17474. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 27 Iter 61: loss 0.16784. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 27 Iter 61: loss 0.16784. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 27 Iter 62: loss 0.16913. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 27 Iter 62: loss 0.16913. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 27 Iter 63: loss 0.14843. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 27 Iter 63: loss 0.14843. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 27 Iter 64: loss 0.17230. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 27 Iter 64: loss 0.17230. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 27 Iter 65: loss 0.15886. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 27 Iter 65: loss 0.15886. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 27 Iter 66: loss 0.15071. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 27 Iter 66: loss 0.15071. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 27 Iter 67: loss 0.16700. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 27 Iter 67: loss 0.16700. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 27 Iter 68: loss 0.20705. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 27 Iter 68: loss 0.20705. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 27 Iter 69: loss 0.18171. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 27 Iter 69: loss 0.18171. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 27 Iter 70: loss 0.16485. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 27 Iter 70: loss 0.16485. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 27 Iter 71: loss 0.15648. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 27 Iter 71: loss 0.15648. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 27 Iter 72: loss 0.15174. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.05it/s]
Epoch 27 Iter 72: loss 0.15174. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 27 Iter 73: loss 0.16003. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 27 Iter 73: loss 0.16003. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 27 Iter 74: loss 0.15124. :  33%|██████████████▋                              | 73/224 [00:36<01:13,  2.05it/s]
Epoch 27 Iter 74: loss 0.15124. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 27 Iter 75: loss 0.17689. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 27 Iter 75: loss 0.17689. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 27 Iter 76: loss 0.17413. :  33%|███████████████                              | 75/224 [00:37<01:12,  2.05it/s]
Epoch 27 Iter 76: loss 0.17413. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 27 Iter 77: loss 0.16094. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 27 Iter 77: loss 0.16094. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 27 Iter 78: loss 0.16702. :  34%|███████████████▍                             | 77/224 [00:38<01:11,  2.05it/s]
Epoch 27 Iter 78: loss 0.16702. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 27 Iter 79: loss 0.15737. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 27 Iter 79: loss 0.15737. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 27 Iter 80: loss 0.14380. :  35%|███████████████▊                             | 79/224 [00:39<01:10,  2.05it/s]
Epoch 27 Iter 80: loss 0.14380. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 27 Iter 81: loss 0.16694. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 27 Iter 81: loss 0.16694. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 27 Iter 82: loss 0.15995. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 27 Iter 82: loss 0.15995. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 27 Iter 83: loss 0.17141. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 27 Iter 83: loss 0.17141. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 27 Iter 84: loss 0.17260. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 27 Iter 84: loss 0.17260. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 27 Iter 85: loss 0.17245. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 27 Iter 85: loss 0.17245. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 27 Iter 86: loss 0.17175. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 27 Iter 86: loss 0.17175. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 27 Iter 87: loss 0.17874. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 27 Iter 87: loss 0.17874. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 27 Iter 88: loss 0.18260. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 27 Iter 88: loss 0.18260. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 27 Iter 89: loss 0.18215. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 27 Iter 89: loss 0.18215. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 27 Iter 90: loss 0.18622. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 27 Iter 90: loss 0.18622. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 27 Iter 91: loss 0.15743. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 27 Iter 91: loss 0.15743. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 27 Iter 92: loss 0.15369. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 27 Iter 92: loss 0.15369. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 27 Iter 93: loss 0.15698. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 27 Iter 93: loss 0.15698. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 27 Iter 94: loss 0.16456. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 27 Iter 94: loss 0.16456. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 27 Iter 95: loss 0.16134. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 27 Iter 95: loss 0.16134. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 27 Iter 96: loss 0.17721. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 27 Iter 96: loss 0.17721. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.17209. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.17209. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.17473. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.17473. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.16774. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.16774. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.14828. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.14828. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 27 Iter 101: loss 0.15094. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 27 Iter 101: loss 0.15094. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 27 Iter 102: loss 0.15157. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 27 Iter 102: loss 0.15157. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 27 Iter 103: loss 0.15884. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.07it/s]
Epoch 27 Iter 103: loss 0.15884. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.15155. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.15155. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.16776. :  46%|███████████████████▉                       | 104/224 [00:51<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.16776. :  47%|████████████████████▏                      | 105/224 [00:51<00:56,  2.09it/s]
Epoch 27 Iter 106: loss 0.17247. :  47%|████████████████████▏                      | 105/224 [00:51<00:56,  2.09it/s]
Epoch 27 Iter 106: loss 0.17247. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.10it/s]
Epoch 27 Iter 107: loss 0.16505. :  47%|████████████████████▎                      | 106/224 [00:52<00:56,  2.10it/s]
Epoch 27 Iter 107: loss 0.16505. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 27 Iter 108: loss 0.16752. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 27 Iter 108: loss 0.16752. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 27 Iter 109: loss 0.16313. :  48%|████████████████████▋                      | 108/224 [00:53<00:55,  2.08it/s]
Epoch 27 Iter 109: loss 0.16313. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 27 Iter 110: loss 0.15358. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 27 Iter 110: loss 0.15358. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 27 Iter 111: loss 0.18069. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 27 Iter 111: loss 0.18069. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 27 Iter 112: loss 0.16977. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 27 Iter 112: loss 0.16977. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 27 Iter 113: loss 0.16400. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 27 Iter 113: loss 0.16400. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 27 Iter 114: loss 0.16438. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 27 Iter 114: loss 0.16438. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.04it/s]
Epoch 27 Iter 115: loss 0.16657. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.04it/s]
Epoch 27 Iter 115: loss 0.16657. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 27 Iter 116: loss 0.14520. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 27 Iter 116: loss 0.14520. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 27 Iter 117: loss 0.14257. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 27 Iter 117: loss 0.14257. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 27 Iter 118: loss 0.17442. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 27 Iter 118: loss 0.17442. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.15056. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.15056. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.15089. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.15089. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 27 Iter 121: loss 0.16269. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 27 Iter 121: loss 0.16269. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 27 Iter 122: loss 0.15404. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 27 Iter 122: loss 0.15404. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.16399. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.16399. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 27 Iter 124: loss 0.14871. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 27 Iter 124: loss 0.14871. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 27 Iter 125: loss 0.15259. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 27 Iter 125: loss 0.15259. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 27 Iter 126: loss 0.16114. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 27 Iter 126: loss 0.16114. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 27 Iter 127: loss 0.16921. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 27 Iter 127: loss 0.16921. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 27 Iter 128: loss 0.15985. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 128: loss 0.15985. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 129: loss 0.15078. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 129: loss 0.15078. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 27 Iter 130: loss 0.16771. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 27 Iter 130: loss 0.16771. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.17732. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.17732. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 27 Iter 132: loss 0.18824. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 27 Iter 132: loss 0.18824. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 27 Iter 133: loss 0.17246. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 27 Iter 133: loss 0.17246. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 27 Iter 134: loss 0.16589. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 27 Iter 134: loss 0.16589. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 135: loss 0.14579. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 135: loss 0.14579. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 27 Iter 136: loss 0.15883. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 27 Iter 136: loss 0.15883. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 27 Iter 137: loss 0.16570. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 27 Iter 137: loss 0.16570. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 27 Iter 138: loss 0.16975. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 27 Iter 138: loss 0.16975. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 27 Iter 139: loss 0.15252. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 27 Iter 139: loss 0.15252. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 27 Iter 140: loss 0.17652. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 27 Iter 140: loss 0.17652. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 27 Iter 141: loss 0.14787. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 27 Iter 141: loss 0.14787. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 27 Iter 142: loss 0.16192. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 27 Iter 142: loss 0.16192. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.05it/s]
Epoch 27 Iter 143: loss 0.18318. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.05it/s]
Epoch 27 Iter 143: loss 0.18318. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 27 Iter 144: loss 0.15492. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.05it/s]
Epoch 27 Iter 144: loss 0.15492. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 27 Iter 145: loss 0.18766. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 27 Iter 145: loss 0.18766. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 27 Iter 146: loss 0.16815. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 27 Iter 146: loss 0.16815. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 27 Iter 147: loss 0.16919. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 27 Iter 147: loss 0.16919. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 27 Iter 148: loss 0.15747. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 27 Iter 148: loss 0.15747. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.05it/s]
Epoch 27 Iter 149: loss 0.17050. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 149: loss 0.17050. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 150: loss 0.15821. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 150: loss 0.15821. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.04it/s]
Epoch 27 Iter 151: loss 0.14418. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 27 Iter 151: loss 0.14418. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 27 Iter 152: loss 0.17434. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 27 Iter 152: loss 0.17434. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 27 Iter 153: loss 0.16197. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 27 Iter 153: loss 0.16197. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 27 Iter 154: loss 0.17896. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 27 Iter 154: loss 0.17896. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 27 Iter 155: loss 0.16752. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 27 Iter 155: loss 0.16752. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 27 Iter 156: loss 0.18165. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 27 Iter 156: loss 0.18165. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 27 Iter 157: loss 0.13903. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.05it/s]
Epoch 27 Iter 157: loss 0.13903. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 27 Iter 158: loss 0.16220. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 27 Iter 158: loss 0.16220. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.04it/s]
Epoch 27 Iter 159: loss 0.14580. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.04it/s]
Epoch 27 Iter 159: loss 0.14580. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 27 Iter 160: loss 0.15977. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 27 Iter 160: loss 0.15977. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 27 Iter 161: loss 0.16680. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 27 Iter 161: loss 0.16680. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 27 Iter 162: loss 0.16626. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 27 Iter 162: loss 0.16626. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 27 Iter 163: loss 0.16154. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 27 Iter 163: loss 0.16154. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 27 Iter 164: loss 0.17771. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 27 Iter 164: loss 0.17771. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 27 Iter 165: loss 0.18972. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 27 Iter 165: loss 0.18972. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.14241. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.14241. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 167: loss 0.15695. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 27 Iter 167: loss 0.15695. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 27 Iter 168: loss 0.15410. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 27 Iter 168: loss 0.15410. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 27 Iter 169: loss 0.14962. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 27 Iter 169: loss 0.14962. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 27 Iter 170: loss 0.15951. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 27 Iter 170: loss 0.15951. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 27 Iter 171: loss 0.14094. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.07it/s]
Epoch 27 Iter 171: loss 0.14094. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 172: loss 0.16443. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 172: loss 0.16443. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 27 Iter 173: loss 0.16669. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.05it/s]
Epoch 27 Iter 173: loss 0.16669. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 27 Iter 174: loss 0.15897. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 27 Iter 174: loss 0.15897. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 27 Iter 175: loss 0.17310. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 27 Iter 175: loss 0.17310. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 27 Iter 176: loss 0.18403. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 27 Iter 176: loss 0.18403. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 27 Iter 177: loss 0.17560. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 27 Iter 177: loss 0.17560. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 27 Iter 178: loss 0.17650. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 27 Iter 178: loss 0.17650. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.16961. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.16961. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 27 Iter 180: loss 0.18196. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 27 Iter 180: loss 0.18196. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 27 Iter 181: loss 0.15393. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 27 Iter 181: loss 0.15393. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 27 Iter 182: loss 0.16093. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 27 Iter 182: loss 0.16093. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 27 Iter 183: loss 0.16757. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 27 Iter 183: loss 0.16757. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 27 Iter 184: loss 0.13224. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 27 Iter 184: loss 0.13224. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 27 Iter 185: loss 0.16313. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 27 Iter 185: loss 0.16313. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 27 Iter 186: loss 0.18262. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 27 Iter 186: loss 0.18262. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 27 Iter 187: loss 0.17434. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 27 Iter 187: loss 0.17434. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.17018. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.17018. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 27 Iter 189: loss 0.16549. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 27 Iter 189: loss 0.16549. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 27 Iter 190: loss 0.16053. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 190: loss 0.16053. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 191: loss 0.13858. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 191: loss 0.13858. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 27 Iter 192: loss 0.15527. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 192: loss 0.15527. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 193: loss 0.16698. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 193: loss 0.16698. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 194: loss 0.14731. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 27 Iter 194: loss 0.14731. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 27 Iter 195: loss 0.17804. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 27 Iter 195: loss 0.17804. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 27 Iter 196: loss 0.15738. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 27 Iter 196: loss 0.15738. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 27 Iter 197: loss 0.17460. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 27 Iter 197: loss 0.17460. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 27 Iter 198: loss 0.17168. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 27 Iter 198: loss 0.17168. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 27 Iter 199: loss 0.15903. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 27 Iter 199: loss 0.15903. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 27 Iter 200: loss 0.18348. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 27 Iter 200: loss 0.18348. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 201: loss 0.19107. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 201: loss 0.19107. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 202: loss 0.17666. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 27 Iter 202: loss 0.17666. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 203: loss 0.17860. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 203: loss 0.17860. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 27 Iter 204: loss 0.18617. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.04it/s]
Epoch 27 Iter 204: loss 0.18617. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.17213. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.17213. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.04it/s]
Epoch 27 Iter 206: loss 0.16678. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.04it/s]
Epoch 27 Iter 206: loss 0.16678. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.15450. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.15450. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.16469. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.16469. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.16733. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.16733. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 27 Iter 210: loss 0.17267. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 27 Iter 210: loss 0.17267. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 27 Iter 211: loss 0.18629. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 27 Iter 211: loss 0.18629. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 27 Iter 212: loss 0.18596. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.05it/s]
Epoch 27 Iter 212: loss 0.18596. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 27 Iter 213: loss 0.16750. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 27 Iter 213: loss 0.16750. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 27 Iter 214: loss 0.18891. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.07it/s]
Epoch 27 Iter 214: loss 0.18891. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 27 Iter 215: loss 0.16690. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 27 Iter 215: loss 0.16690. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 27 Iter 216: loss 0.16517. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 27 Iter 216: loss 0.16517. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 27 Iter 217: loss 0.16966. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 27 Iter 217: loss 0.16966. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 27 Iter 218: loss 0.16968. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 27 Iter 218: loss 0.16968. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 27 Iter 219: loss 0.16276. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 27 Iter 219: loss 0.16276. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 27 Iter 220: loss 0.16052. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 27 Iter 220: loss 0.16052. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 27 Iter 221: loss 0.17922. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 27 Iter 221: loss 0.17922. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 27 Iter 222: loss 0.18573. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 27 Iter 222: loss 0.18573. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 27 Iter 223: loss 0.14937. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 27 Iter 223: loss 0.14937. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 27 Iter 224: loss 0.16834. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 27 Iter 224: loss 0.16834. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 27 Iter 224: loss 0.16834. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16528
    Valid loss: 0.17075
       Valid loss recons: 0.17075
       Valid loss KL-D:   69728.40643
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.15048. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.15048. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 28 Iter 2: loss 0.16033. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 28 Iter 2: loss 0.16033. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 28 Iter 3: loss 0.16424. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 28 Iter 3: loss 0.16424. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 28 Iter 4: loss 0.16485. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 28 Iter 4: loss 0.16485. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 28 Iter 5: loss 0.15238. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 28 Iter 5: loss 0.15238. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 28 Iter 6: loss 0.16396. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 28 Iter 6: loss 0.16396. :   3%|█▎                                             | 6/224 [00:02<01:48,  2.02it/s]
Epoch 28 Iter 7: loss 0.15905. :   3%|█▎                                             | 6/224 [00:03<01:48,  2.02it/s]
Epoch 28 Iter 7: loss 0.15905. :   3%|█▍                                             | 7/224 [00:03<01:47,  2.03it/s]
Epoch 28 Iter 8: loss 0.16362. :   3%|█▍                                             | 7/224 [00:03<01:47,  2.03it/s]
Epoch 28 Iter 8: loss 0.16362. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 28 Iter 9: loss 0.16914. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 28 Iter 9: loss 0.16914. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 28 Iter 10: loss 0.17409. :   4%|█▊                                            | 9/224 [00:04<01:46,  2.02it/s]
Epoch 28 Iter 10: loss 0.17409. :   4%|██                                           | 10/224 [00:04<01:45,  2.03it/s]
Epoch 28 Iter 11: loss 0.16744. :   4%|██                                           | 10/224 [00:05<01:45,  2.03it/s]
Epoch 28 Iter 11: loss 0.16744. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 28 Iter 12: loss 0.17435. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 28 Iter 12: loss 0.17435. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 28 Iter 13: loss 0.17229. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 28 Iter 13: loss 0.17229. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 14: loss 0.16290. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 14: loss 0.16290. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 15: loss 0.17254. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 28 Iter 15: loss 0.17254. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 28 Iter 16: loss 0.15976. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 28 Iter 16: loss 0.15976. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 28 Iter 17: loss 0.16025. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 28 Iter 17: loss 0.16025. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 28 Iter 18: loss 0.17033. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 28 Iter 18: loss 0.17033. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 28 Iter 19: loss 0.17319. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 28 Iter 19: loss 0.17319. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 28 Iter 20: loss 0.17435. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 28 Iter 20: loss 0.17435. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.15808. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.15808. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 28 Iter 22: loss 0.17497. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 28 Iter 22: loss 0.17497. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.15455. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.15455. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 24: loss 0.16981. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 24: loss 0.16981. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 28 Iter 25: loss 0.16776. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 25: loss 0.16776. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 26: loss 0.17267. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 26: loss 0.17267. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 28 Iter 27: loss 0.15083. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 28 Iter 27: loss 0.15083. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 28 Iter 28: loss 0.17294. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 28 Iter 28: loss 0.17294. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 28 Iter 29: loss 0.16030. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 29: loss 0.16030. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 30: loss 0.16798. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 30: loss 0.16798. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 28 Iter 31: loss 0.16450. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 28 Iter 31: loss 0.16450. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 28 Iter 32: loss 0.19407. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 28 Iter 32: loss 0.19407. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 28 Iter 33: loss 0.15233. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 33: loss 0.15233. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 34: loss 0.14844. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 34: loss 0.14844. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.16058. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.16058. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 28 Iter 36: loss 0.15460. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 28 Iter 36: loss 0.15460. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.15408. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.15408. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 28 Iter 38: loss 0.17567. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 28 Iter 38: loss 0.17567. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.17934. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.17934. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 40: loss 0.18106. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 28 Iter 40: loss 0.18106. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 28 Iter 41: loss 0.16204. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 28 Iter 41: loss 0.16204. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 28 Iter 42: loss 0.15296. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 28 Iter 42: loss 0.15296. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.14514. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.14514. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 44: loss 0.15733. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 28 Iter 44: loss 0.15733. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 45: loss 0.17369. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 45: loss 0.17369. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.17177. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.17177. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 28 Iter 47: loss 0.14503. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 28 Iter 47: loss 0.14503. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.05it/s]
Epoch 28 Iter 48: loss 0.14053. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.05it/s]
Epoch 28 Iter 48: loss 0.14053. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 28 Iter 49: loss 0.15376. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 28 Iter 49: loss 0.15376. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.04it/s]
Epoch 28 Iter 50: loss 0.14652. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.04it/s]
Epoch 28 Iter 50: loss 0.14652. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 28 Iter 51: loss 0.16169. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 28 Iter 51: loss 0.16169. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.16698. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.16698. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.14249. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.14249. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 28 Iter 54: loss 0.16680. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 28 Iter 54: loss 0.16680. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 28 Iter 55: loss 0.16006. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 28 Iter 55: loss 0.16006. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.17285. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.17285. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 57: loss 0.17514. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 57: loss 0.17514. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 28 Iter 58: loss 0.14619. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 28 Iter 58: loss 0.14619. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 28 Iter 59: loss 0.16386. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 28 Iter 59: loss 0.16386. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.15458. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.15458. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 61: loss 0.18507. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 61: loss 0.18507. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.15445. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.15445. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.18170. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.18170. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.16025. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.16025. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 28 Iter 65: loss 0.17723. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 28 Iter 65: loss 0.17723. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 28 Iter 66: loss 0.17116. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 28 Iter 66: loss 0.17116. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 28 Iter 67: loss 0.18428. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 28 Iter 67: loss 0.18428. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 28 Iter 68: loss 0.15591. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 28 Iter 68: loss 0.15591. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 69: loss 0.14883. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 69: loss 0.14883. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 28 Iter 70: loss 0.18961. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 28 Iter 70: loss 0.18961. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 28 Iter 71: loss 0.17091. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 28 Iter 71: loss 0.17091. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 28 Iter 72: loss 0.17027. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 28 Iter 72: loss 0.17027. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 28 Iter 73: loss 0.13963. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 28 Iter 73: loss 0.13963. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 28 Iter 74: loss 0.15950. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 28 Iter 74: loss 0.15950. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.05it/s]
Epoch 28 Iter 75: loss 0.19663. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 28 Iter 75: loss 0.19663. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 28 Iter 76: loss 0.17790. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 28 Iter 76: loss 0.17790. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 28 Iter 77: loss 0.17381. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 28 Iter 77: loss 0.17381. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 28 Iter 78: loss 0.15920. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 28 Iter 78: loss 0.15920. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 28 Iter 79: loss 0.17520. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 28 Iter 79: loss 0.17520. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 28 Iter 80: loss 0.17455. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 28 Iter 80: loss 0.17455. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 28 Iter 81: loss 0.14973. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 28 Iter 81: loss 0.14973. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 28 Iter 82: loss 0.16061. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 28 Iter 82: loss 0.16061. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 28 Iter 83: loss 0.15388. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 28 Iter 83: loss 0.15388. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 28 Iter 84: loss 0.16202. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 28 Iter 84: loss 0.16202. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 28 Iter 85: loss 0.16157. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 28 Iter 85: loss 0.16157. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 28 Iter 86: loss 0.15212. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 28 Iter 86: loss 0.15212. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 28 Iter 87: loss 0.16335. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 87: loss 0.16335. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 88: loss 0.18044. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 88: loss 0.18044. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 28 Iter 89: loss 0.15594. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 28 Iter 89: loss 0.15594. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 28 Iter 90: loss 0.15707. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 28 Iter 90: loss 0.15707. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 28 Iter 91: loss 0.17361. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 28 Iter 91: loss 0.17361. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 28 Iter 92: loss 0.16773. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 28 Iter 92: loss 0.16773. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.14920. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.14920. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.17636. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.17636. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 95: loss 0.16587. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 28 Iter 95: loss 0.16587. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 28 Iter 96: loss 0.14803. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 28 Iter 96: loss 0.14803. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 28 Iter 97: loss 0.15556. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 28 Iter 97: loss 0.15556. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 98: loss 0.17272. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 98: loss 0.17272. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 99: loss 0.14709. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 28 Iter 99: loss 0.14709. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.05it/s]
Epoch 28 Iter 100: loss 0.15289. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.05it/s]
Epoch 28 Iter 100: loss 0.15289. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 28 Iter 101: loss 0.18574. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 28 Iter 101: loss 0.18574. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 28 Iter 102: loss 0.14947. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 28 Iter 102: loss 0.14947. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 28 Iter 103: loss 0.15995. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 28 Iter 103: loss 0.15995. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.16883. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.16883. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 105: loss 0.18322. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.07it/s]
Epoch 28 Iter 105: loss 0.18322. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.15467. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.15467. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.15796. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.15796. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 28 Iter 108: loss 0.14273. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 28 Iter 108: loss 0.14273. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 28 Iter 109: loss 0.17288. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 28 Iter 109: loss 0.17288. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 28 Iter 110: loss 0.15081. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 28 Iter 110: loss 0.15081. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 28 Iter 111: loss 0.16040. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 28 Iter 111: loss 0.16040. :  50%|█████████████████████▎                     | 111/224 [00:53<00:53,  2.09it/s]
Epoch 28 Iter 112: loss 0.17969. :  50%|█████████████████████▎                     | 111/224 [00:54<00:53,  2.09it/s]
Epoch 28 Iter 112: loss 0.17969. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.10it/s]
Epoch 28 Iter 113: loss 0.16139. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.10it/s]
Epoch 28 Iter 113: loss 0.16139. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.09it/s]
Epoch 28 Iter 114: loss 0.15159. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.09it/s]
Epoch 28 Iter 114: loss 0.15159. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.10it/s]
Epoch 28 Iter 115: loss 0.16212. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.10it/s]
Epoch 28 Iter 115: loss 0.16212. :  51%|██████████████████████                     | 115/224 [00:55<00:51,  2.10it/s]
Epoch 28 Iter 116: loss 0.15216. :  51%|██████████████████████                     | 115/224 [00:56<00:51,  2.10it/s]
Epoch 28 Iter 116: loss 0.15216. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.10it/s]
Epoch 28 Iter 117: loss 0.15900. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.10it/s]
Epoch 28 Iter 117: loss 0.15900. :  52%|██████████████████████▍                    | 117/224 [00:56<00:50,  2.13it/s]
Epoch 28 Iter 118: loss 0.15542. :  52%|██████████████████████▍                    | 117/224 [00:57<00:50,  2.13it/s]
Epoch 28 Iter 118: loss 0.15542. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.11it/s]
Epoch 28 Iter 119: loss 0.15154. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.11it/s]
Epoch 28 Iter 119: loss 0.15154. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.09it/s]
Epoch 28 Iter 120: loss 0.16941. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.09it/s]
Epoch 28 Iter 120: loss 0.16941. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.08it/s]
Epoch 28 Iter 121: loss 0.15506. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.08it/s]
Epoch 28 Iter 121: loss 0.15506. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 28 Iter 122: loss 0.18357. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 28 Iter 122: loss 0.18357. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.16925. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.16925. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 28 Iter 124: loss 0.17697. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 28 Iter 124: loss 0.17697. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.15755. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.15755. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.15852. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.15852. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 28 Iter 127: loss 0.15077. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 28 Iter 127: loss 0.15077. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 28 Iter 128: loss 0.15938. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 28 Iter 128: loss 0.15938. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 28 Iter 129: loss 0.18666. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 28 Iter 129: loss 0.18666. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 28 Iter 130: loss 0.15330. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 28 Iter 130: loss 0.15330. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 28 Iter 131: loss 0.16307. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 28 Iter 131: loss 0.16307. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 132: loss 0.14579. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 132: loss 0.14579. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.16942. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.16942. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 28 Iter 134: loss 0.17499. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 28 Iter 134: loss 0.17499. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:42,  2.10it/s]
Epoch 28 Iter 135: loss 0.17307. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:42,  2.10it/s]
Epoch 28 Iter 135: loss 0.17307. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.10it/s]
Epoch 28 Iter 136: loss 0.15025. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.10it/s]
Epoch 28 Iter 136: loss 0.15025. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.08it/s]
Epoch 28 Iter 137: loss 0.16213. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 28 Iter 137: loss 0.16213. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 28 Iter 138: loss 0.19074. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 28 Iter 138: loss 0.19074. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 28 Iter 139: loss 0.14070. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 28 Iter 139: loss 0.14070. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 28 Iter 140: loss 0.17278. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 28 Iter 140: loss 0.17278. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 28 Iter 141: loss 0.18731. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 28 Iter 141: loss 0.18731. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 28 Iter 142: loss 0.18223. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 28 Iter 142: loss 0.18223. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 28 Iter 143: loss 0.15905. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 28 Iter 143: loss 0.15905. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 28 Iter 144: loss 0.17484. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 28 Iter 144: loss 0.17484. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 28 Iter 145: loss 0.18438. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 28 Iter 145: loss 0.18438. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 28 Iter 146: loss 0.17142. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 28 Iter 146: loss 0.17142. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.17528. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.17528. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 28 Iter 148: loss 0.17600. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 28 Iter 148: loss 0.17600. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 28 Iter 149: loss 0.15309. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 28 Iter 149: loss 0.15309. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 28 Iter 150: loss 0.16003. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 28 Iter 150: loss 0.16003. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 28 Iter 151: loss 0.17954. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 28 Iter 151: loss 0.17954. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 28 Iter 152: loss 0.15541. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 28 Iter 152: loss 0.15541. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 28 Iter 153: loss 0.15496. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 28 Iter 153: loss 0.15496. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 28 Iter 154: loss 0.18268. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 28 Iter 154: loss 0.18268. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 28 Iter 155: loss 0.17915. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 28 Iter 155: loss 0.17915. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 28 Iter 156: loss 0.15258. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 28 Iter 156: loss 0.15258. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 28 Iter 157: loss 0.14788. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 28 Iter 157: loss 0.14788. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 28 Iter 158: loss 0.17460. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 28 Iter 158: loss 0.17460. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 28 Iter 159: loss 0.15406. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 28 Iter 159: loss 0.15406. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 28 Iter 160: loss 0.17912. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 28 Iter 160: loss 0.17912. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 28 Iter 161: loss 0.18060. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 28 Iter 161: loss 0.18060. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 28 Iter 162: loss 0.16094. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 28 Iter 162: loss 0.16094. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 28 Iter 163: loss 0.17891. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 28 Iter 163: loss 0.17891. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 28 Iter 164: loss 0.18869. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 28 Iter 164: loss 0.18869. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 28 Iter 165: loss 0.15339. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 28 Iter 165: loss 0.15339. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 28 Iter 166: loss 0.16871. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 28 Iter 166: loss 0.16871. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 28 Iter 167: loss 0.15542. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 28 Iter 167: loss 0.15542. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 28 Iter 168: loss 0.17441. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 168: loss 0.17441. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 169: loss 0.17379. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 169: loss 0.17379. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 28 Iter 170: loss 0.16137. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 28 Iter 170: loss 0.16137. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 28 Iter 171: loss 0.16089. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 28 Iter 171: loss 0.16089. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 28 Iter 172: loss 0.17300. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 28 Iter 172: loss 0.17300. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.04it/s]
Epoch 28 Iter 173: loss 0.16297. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.04it/s]
Epoch 28 Iter 173: loss 0.16297. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 28 Iter 174: loss 0.17125. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 28 Iter 174: loss 0.17125. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 28 Iter 175: loss 0.16355. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 28 Iter 175: loss 0.16355. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:24,  2.04it/s]
Epoch 28 Iter 176: loss 0.15791. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:24,  2.04it/s]
Epoch 28 Iter 176: loss 0.15791. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 28 Iter 177: loss 0.18459. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 28 Iter 177: loss 0.18459. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 28 Iter 178: loss 0.16508. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 28 Iter 178: loss 0.16508. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 28 Iter 179: loss 0.17415. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 28 Iter 179: loss 0.17415. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:22,  2.04it/s]
Epoch 28 Iter 180: loss 0.16479. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:22,  2.04it/s]
Epoch 28 Iter 180: loss 0.16479. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.04it/s]
Epoch 28 Iter 181: loss 0.16428. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.04it/s]
Epoch 28 Iter 181: loss 0.16428. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:21,  2.04it/s]
Epoch 28 Iter 182: loss 0.14336. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:21,  2.04it/s]
Epoch 28 Iter 182: loss 0.14336. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.02it/s]
Epoch 28 Iter 183: loss 0.17671. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.02it/s]
Epoch 28 Iter 183: loss 0.17671. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:20,  2.04it/s]
Epoch 28 Iter 184: loss 0.14696. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:20,  2.04it/s]
Epoch 28 Iter 184: loss 0.14696. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 28 Iter 185: loss 0.17272. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 28 Iter 185: loss 0.17272. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 28 Iter 186: loss 0.15629. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 28 Iter 186: loss 0.15629. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 28 Iter 187: loss 0.16273. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 28 Iter 187: loss 0.16273. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 28 Iter 188: loss 0.14605. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 28 Iter 188: loss 0.14605. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 28 Iter 189: loss 0.14773. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 28 Iter 189: loss 0.14773. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 28 Iter 190: loss 0.14617. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 28 Iter 190: loss 0.14617. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 28 Iter 191: loss 0.17231. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 28 Iter 191: loss 0.17231. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 28 Iter 192: loss 0.15378. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 192: loss 0.15378. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 193: loss 0.18710. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 193: loss 0.18710. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 194: loss 0.15917. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 28 Iter 194: loss 0.15917. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 28 Iter 195: loss 0.16789. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 28 Iter 195: loss 0.16789. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 28 Iter 196: loss 0.16585. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 28 Iter 196: loss 0.16585. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 28 Iter 197: loss 0.15396. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 28 Iter 197: loss 0.15396. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 28 Iter 198: loss 0.18353. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 28 Iter 198: loss 0.18353. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 28 Iter 199: loss 0.16290. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 28 Iter 199: loss 0.16290. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 28 Iter 200: loss 0.15450. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 28 Iter 200: loss 0.15450. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 28 Iter 201: loss 0.15818. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 28 Iter 201: loss 0.15818. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 28 Iter 202: loss 0.17864. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 28 Iter 202: loss 0.17864. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 28 Iter 203: loss 0.17691. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 28 Iter 203: loss 0.17691. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 28 Iter 204: loss 0.16167. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 28 Iter 204: loss 0.16167. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 28 Iter 205: loss 0.17914. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 28 Iter 205: loss 0.17914. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 28 Iter 206: loss 0.17441. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 28 Iter 206: loss 0.17441. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 28 Iter 207: loss 0.16720. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 28 Iter 207: loss 0.16720. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 28 Iter 208: loss 0.17176. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 28 Iter 208: loss 0.17176. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 28 Iter 209: loss 0.14051. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 28 Iter 209: loss 0.14051. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 28 Iter 210: loss 0.16285. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 28 Iter 210: loss 0.16285. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.16042. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.16042. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.17814. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.17814. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.15419. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.15419. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 214: loss 0.19525. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 214: loss 0.19525. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 28 Iter 215: loss 0.17664. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 28 Iter 215: loss 0.17664. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.02it/s]
Epoch 28 Iter 216: loss 0.16106. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.02it/s]
Epoch 28 Iter 216: loss 0.16106. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 28 Iter 217: loss 0.16671. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 28 Iter 217: loss 0.16671. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 28 Iter 218: loss 0.16951. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 28 Iter 218: loss 0.16951. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 28 Iter 219: loss 0.15163. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.04it/s]
Epoch 28 Iter 219: loss 0.15163. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 28 Iter 220: loss 0.16357. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 28 Iter 220: loss 0.16357. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 28 Iter 221: loss 0.18000. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 28 Iter 221: loss 0.18000. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 28 Iter 222: loss 0.16052. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 28 Iter 222: loss 0.16052. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.04it/s]
Epoch 28 Iter 223: loss 0.16063. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.04it/s]
Epoch 28 Iter 223: loss 0.16063. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 28 Iter 224: loss 0.17814. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 28 Iter 224: loss 0.17814. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.17814. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.16857. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.16857. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 29 Iter 2: loss 0.15436. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 29 Iter 2: loss 0.15436. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 29 Iter 3: loss 0.15007. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 29 Iter 3: loss 0.15007. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 29 Iter 4: loss 0.15535. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 29 Iter 4: loss 0.15535. :   2%|▊                                              | 4/224 [00:01<01:47,  2.04it/s]
Epoch 29 Iter 5: loss 0.19486. :   2%|▊                                              | 4/224 [00:02<01:47,  2.04it/s]
Epoch 29 Iter 5: loss 0.19486. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 29 Iter 6: loss 0.15642. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 29 Iter 6: loss 0.15642. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 29 Iter 7: loss 0.17148. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 29 Iter 7: loss 0.17148. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 29 Iter 8: loss 0.19445. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 29 Iter 8: loss 0.19445. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 29 Iter 9: loss 0.16920. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 29 Iter 9: loss 0.16920. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 29 Iter 10: loss 0.15316. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 29 Iter 10: loss 0.15316. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.16528. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.16528. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 29 Iter 12: loss 0.17133. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 29 Iter 12: loss 0.17133. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 29 Iter 13: loss 0.16189. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 29 Iter 13: loss 0.16189. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 29 Iter 14: loss 0.19416. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 29 Iter 14: loss 0.19416. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 29 Iter 15: loss 0.15121. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 29 Iter 15: loss 0.15121. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 29 Iter 16: loss 0.16793. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 29 Iter 16: loss 0.16793. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.04it/s]
Epoch 29 Iter 17: loss 0.15373. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.04it/s]
Epoch 29 Iter 17: loss 0.15373. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 29 Iter 18: loss 0.17040. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 29 Iter 18: loss 0.17040. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 29 Iter 19: loss 0.16858. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 29 Iter 19: loss 0.16858. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 29 Iter 20: loss 0.18258. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 29 Iter 20: loss 0.18258. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 29 Iter 21: loss 0.14847. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 29 Iter 21: loss 0.14847. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 29 Iter 22: loss 0.15679. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 29 Iter 22: loss 0.15679. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 29 Iter 23: loss 0.17680. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 23: loss 0.17680. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.17000. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.17000. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 29 Iter 25: loss 0.15453. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 29 Iter 25: loss 0.15453. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.16810. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.16810. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 29 Iter 27: loss 0.13475. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 29 Iter 27: loss 0.13475. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 29 Iter 28: loss 0.15420. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 29 Iter 28: loss 0.15420. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 29 Iter 29: loss 0.15687. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 29 Iter 29: loss 0.15687. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 29 Iter 30: loss 0.15397. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 29 Iter 30: loss 0.15397. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 29 Iter 31: loss 0.17594. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 29 Iter 31: loss 0.17594. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 29 Iter 32: loss 0.15389. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 29 Iter 32: loss 0.15389. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 29 Iter 33: loss 0.15487. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 29 Iter 33: loss 0.15487. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 34: loss 0.19498. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 34: loss 0.19498. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 35: loss 0.16202. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 29 Iter 35: loss 0.16202. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 29 Iter 36: loss 0.16450. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 29 Iter 36: loss 0.16450. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 29 Iter 37: loss 0.15166. :  16%|███████▏                                     | 36/224 [00:18<01:30,  2.07it/s]
Epoch 29 Iter 37: loss 0.15166. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 29 Iter 38: loss 0.17974. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 29 Iter 38: loss 0.17974. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.09it/s]
Epoch 29 Iter 39: loss 0.18864. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.09it/s]
Epoch 29 Iter 39: loss 0.18864. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 29 Iter 40: loss 0.15570. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 29 Iter 40: loss 0.15570. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 29 Iter 41: loss 0.14099. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 29 Iter 41: loss 0.14099. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.08it/s]
Epoch 29 Iter 42: loss 0.16929. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.08it/s]
Epoch 29 Iter 42: loss 0.16929. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 29 Iter 43: loss 0.16427. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 29 Iter 43: loss 0.16427. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 29 Iter 44: loss 0.16518. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 29 Iter 44: loss 0.16518. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 29 Iter 45: loss 0.15574. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 29 Iter 45: loss 0.15574. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 29 Iter 46: loss 0.17530. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 29 Iter 46: loss 0.17530. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 29 Iter 47: loss 0.15369. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 29 Iter 47: loss 0.15369. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 29 Iter 48: loss 0.16533. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 29 Iter 48: loss 0.16533. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 29 Iter 49: loss 0.16590. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 29 Iter 49: loss 0.16590. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 29 Iter 50: loss 0.15185. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 29 Iter 50: loss 0.15185. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 29 Iter 51: loss 0.15109. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 29 Iter 51: loss 0.15109. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 29 Iter 52: loss 0.14616. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 29 Iter 52: loss 0.14616. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 29 Iter 53: loss 0.14969. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 29 Iter 53: loss 0.14969. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 29 Iter 54: loss 0.18323. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 29 Iter 54: loss 0.18323. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 29 Iter 55: loss 0.16749. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 29 Iter 55: loss 0.16749. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.04it/s]
Epoch 29 Iter 56: loss 0.16415. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 29 Iter 56: loss 0.16415. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 29 Iter 57: loss 0.16225. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 29 Iter 57: loss 0.16225. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 29 Iter 58: loss 0.15425. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 29 Iter 58: loss 0.15425. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 29 Iter 59: loss 0.16084. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 29 Iter 59: loss 0.16084. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 29 Iter 60: loss 0.15810. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 29 Iter 60: loss 0.15810. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 29 Iter 61: loss 0.15961. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 29 Iter 61: loss 0.15961. :  27%|████████████▎                                | 61/224 [00:29<01:20,  2.04it/s]
Epoch 29 Iter 62: loss 0.18567. :  27%|████████████▎                                | 61/224 [00:30<01:20,  2.04it/s]
Epoch 29 Iter 62: loss 0.18567. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 29 Iter 63: loss 0.15158. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 29 Iter 63: loss 0.15158. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 29 Iter 64: loss 0.16968. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 29 Iter 64: loss 0.16968. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 29 Iter 65: loss 0.18186. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 29 Iter 65: loss 0.18186. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.05it/s]
Epoch 29 Iter 66: loss 0.16188. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.05it/s]
Epoch 29 Iter 66: loss 0.16188. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 29 Iter 67: loss 0.17155. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 29 Iter 67: loss 0.17155. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 29 Iter 68: loss 0.15714. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 29 Iter 68: loss 0.15714. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 29 Iter 69: loss 0.16709. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 29 Iter 69: loss 0.16709. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 29 Iter 70: loss 0.15618. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.06it/s]
Epoch 29 Iter 70: loss 0.15618. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 29 Iter 71: loss 0.16041. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 29 Iter 71: loss 0.16041. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 29 Iter 72: loss 0.16255. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.05it/s]
Epoch 29 Iter 72: loss 0.16255. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 29 Iter 73: loss 0.15640. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 29 Iter 73: loss 0.15640. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 29 Iter 74: loss 0.16875. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 29 Iter 74: loss 0.16875. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 29 Iter 75: loss 0.14190. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 29 Iter 75: loss 0.14190. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 29 Iter 76: loss 0.15248. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 29 Iter 76: loss 0.15248. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 29 Iter 77: loss 0.18053. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 29 Iter 77: loss 0.18053. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 29 Iter 78: loss 0.18138. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 29 Iter 78: loss 0.18138. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 29 Iter 79: loss 0.15945. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 29 Iter 79: loss 0.15945. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 29 Iter 80: loss 0.15665. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 29 Iter 80: loss 0.15665. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.04it/s]
Epoch 29 Iter 81: loss 0.18823. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 29 Iter 81: loss 0.18823. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.02it/s]
Epoch 29 Iter 82: loss 0.15841. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.02it/s]
Epoch 29 Iter 82: loss 0.15841. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 29 Iter 83: loss 0.15695. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 29 Iter 83: loss 0.15695. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 29 Iter 84: loss 0.16078. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 29 Iter 84: loss 0.16078. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.04it/s]
Epoch 29 Iter 85: loss 0.16097. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 29 Iter 85: loss 0.16097. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 29 Iter 86: loss 0.15591. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 29 Iter 86: loss 0.15591. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 29 Iter 87: loss 0.16824. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 29 Iter 87: loss 0.16824. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 29 Iter 88: loss 0.15337. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 29 Iter 88: loss 0.15337. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 29 Iter 89: loss 0.16830. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 29 Iter 89: loss 0.16830. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 29 Iter 90: loss 0.16687. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 29 Iter 90: loss 0.16687. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 29 Iter 91: loss 0.15147. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 29 Iter 91: loss 0.15147. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 29 Iter 92: loss 0.14922. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 29 Iter 92: loss 0.14922. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 29 Iter 93: loss 0.14641. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 29 Iter 93: loss 0.14641. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 29 Iter 94: loss 0.16640. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 29 Iter 94: loss 0.16640. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 29 Iter 95: loss 0.14552. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 29 Iter 95: loss 0.14552. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 29 Iter 96: loss 0.16695. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 29 Iter 96: loss 0.16695. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 29 Iter 97: loss 0.16236. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 29 Iter 97: loss 0.16236. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 29 Iter 98: loss 0.15866. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 29 Iter 98: loss 0.15866. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 29 Iter 99: loss 0.16388. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 29 Iter 99: loss 0.16388. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 29 Iter 100: loss 0.17129. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 29 Iter 100: loss 0.17129. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 29 Iter 101: loss 0.16458. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 29 Iter 101: loss 0.16458. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 29 Iter 102: loss 0.18786. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 29 Iter 102: loss 0.18786. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 29 Iter 103: loss 0.19574. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 29 Iter 103: loss 0.19574. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 29 Iter 104: loss 0.17555. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 29 Iter 104: loss 0.17555. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 29 Iter 105: loss 0.16471. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 29 Iter 105: loss 0.16471. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 29 Iter 106: loss 0.15975. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 29 Iter 106: loss 0.15975. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 29 Iter 107: loss 0.16734. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 29 Iter 107: loss 0.16734. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 29 Iter 108: loss 0.18101. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 29 Iter 108: loss 0.18101. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 29 Iter 109: loss 0.15994. :  48%|████████████████████▋                      | 108/224 [00:53<00:55,  2.07it/s]
Epoch 29 Iter 109: loss 0.15994. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 29 Iter 110: loss 0.17619. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 29 Iter 110: loss 0.17619. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 29 Iter 111: loss 0.15117. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 29 Iter 111: loss 0.15117. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.05it/s]
Epoch 29 Iter 112: loss 0.15729. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.05it/s]
Epoch 29 Iter 112: loss 0.15729. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 29 Iter 113: loss 0.15301. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 29 Iter 113: loss 0.15301. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 29 Iter 114: loss 0.15961. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 29 Iter 114: loss 0.15961. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 29 Iter 115: loss 0.16191. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 29 Iter 115: loss 0.16191. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.04it/s]
Epoch 29 Iter 116: loss 0.17771. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.04it/s]
Epoch 29 Iter 116: loss 0.17771. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 117: loss 0.16329. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 117: loss 0.16329. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 29 Iter 118: loss 0.17145. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 29 Iter 118: loss 0.17145. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.16618. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.16618. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 120: loss 0.16132. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 29 Iter 120: loss 0.16132. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 29 Iter 121: loss 0.15249. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 29 Iter 121: loss 0.15249. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 29 Iter 122: loss 0.18134. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 29 Iter 122: loss 0.18134. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 29 Iter 123: loss 0.14763. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 29 Iter 123: loss 0.14763. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 29 Iter 124: loss 0.16302. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 29 Iter 124: loss 0.16302. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 29 Iter 125: loss 0.17681. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 29 Iter 125: loss 0.17681. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 29 Iter 126: loss 0.18213. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 29 Iter 126: loss 0.18213. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 29 Iter 127: loss 0.17282. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 29 Iter 127: loss 0.17282. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.15025. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.15025. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 29 Iter 129: loss 0.16957. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 29 Iter 129: loss 0.16957. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 29 Iter 130: loss 0.16209. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 29 Iter 130: loss 0.16209. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 29 Iter 131: loss 0.15704. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 29 Iter 131: loss 0.15704. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 29 Iter 132: loss 0.16131. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 29 Iter 132: loss 0.16131. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 29 Iter 133: loss 0.16001. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 29 Iter 133: loss 0.16001. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 29 Iter 134: loss 0.18013. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 29 Iter 134: loss 0.18013. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.15935. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.15935. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 29 Iter 136: loss 0.15617. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.07it/s]
Epoch 29 Iter 136: loss 0.15617. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 29 Iter 137: loss 0.14408. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 29 Iter 137: loss 0.14408. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 29 Iter 138: loss 0.16915. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 29 Iter 138: loss 0.16915. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 29 Iter 139: loss 0.17333. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 29 Iter 139: loss 0.17333. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 29 Iter 140: loss 0.15918. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 29 Iter 140: loss 0.15918. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 29 Iter 141: loss 0.16566. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 29 Iter 141: loss 0.16566. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 29 Iter 142: loss 0.17019. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 29 Iter 142: loss 0.17019. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 29 Iter 143: loss 0.16248. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 29 Iter 143: loss 0.16248. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 29 Iter 144: loss 0.15346. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 29 Iter 144: loss 0.15346. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 29 Iter 145: loss 0.15237. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 29 Iter 145: loss 0.15237. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 29 Iter 146: loss 0.16538. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 29 Iter 146: loss 0.16538. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 29 Iter 147: loss 0.15966. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 29 Iter 147: loss 0.15966. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 29 Iter 148: loss 0.13976. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 29 Iter 148: loss 0.13976. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 29 Iter 149: loss 0.14271. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 149: loss 0.14271. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 150: loss 0.15347. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 150: loss 0.15347. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 29 Iter 151: loss 0.16695. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 29 Iter 151: loss 0.16695. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 29 Iter 152: loss 0.17651. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 29 Iter 152: loss 0.17651. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 29 Iter 153: loss 0.18247. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 29 Iter 153: loss 0.18247. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 29 Iter 154: loss 0.14665. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 29 Iter 154: loss 0.14665. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 29 Iter 155: loss 0.17151. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 29 Iter 155: loss 0.17151. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 156: loss 0.17515. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 156: loss 0.17515. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 157: loss 0.15497. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 29 Iter 157: loss 0.15497. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 29 Iter 158: loss 0.17250. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 29 Iter 158: loss 0.17250. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.16282. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.16282. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.17038. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.17038. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 161: loss 0.18425. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 29 Iter 161: loss 0.18425. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 29 Iter 162: loss 0.14091. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 29 Iter 162: loss 0.14091. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 29 Iter 163: loss 0.18563. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.05it/s]
Epoch 29 Iter 163: loss 0.18563. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 29 Iter 164: loss 0.17392. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 29 Iter 164: loss 0.17392. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 29 Iter 165: loss 0.16271. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 29 Iter 165: loss 0.16271. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.16921. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.16921. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 29 Iter 167: loss 0.14245. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 29 Iter 167: loss 0.14245. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.16574. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.16574. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.17230. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.17230. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 170: loss 0.15438. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 170: loss 0.15438. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 171: loss 0.15944. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 29 Iter 171: loss 0.15944. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 172: loss 0.16551. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 172: loss 0.16551. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 29 Iter 173: loss 0.16295. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 29 Iter 173: loss 0.16295. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 29 Iter 174: loss 0.16525. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 29 Iter 174: loss 0.16525. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 29 Iter 175: loss 0.16791. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 29 Iter 175: loss 0.16791. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 29 Iter 176: loss 0.17694. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 29 Iter 176: loss 0.17694. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 29 Iter 177: loss 0.16028. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 29 Iter 177: loss 0.16028. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 29 Iter 178: loss 0.15175. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 29 Iter 178: loss 0.15175. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 29 Iter 179: loss 0.18072. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 29 Iter 179: loss 0.18072. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 29 Iter 180: loss 0.14841. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 180: loss 0.14841. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 181: loss 0.15694. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 181: loss 0.15694. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 29 Iter 182: loss 0.17463. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 29 Iter 182: loss 0.17463. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 29 Iter 183: loss 0.16823. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 29 Iter 183: loss 0.16823. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 29 Iter 184: loss 0.17443. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 29 Iter 184: loss 0.17443. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 29 Iter 185: loss 0.16112. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 29 Iter 185: loss 0.16112. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 29 Iter 186: loss 0.15393. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 29 Iter 186: loss 0.15393. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 29 Iter 187: loss 0.17457. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 29 Iter 187: loss 0.17457. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 29 Iter 188: loss 0.16422. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 29 Iter 188: loss 0.16422. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 29 Iter 189: loss 0.17001. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 29 Iter 189: loss 0.17001. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 29 Iter 190: loss 0.13824. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 190: loss 0.13824. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 191: loss 0.15813. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 191: loss 0.15813. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 192: loss 0.17164. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 29 Iter 192: loss 0.17164. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 29 Iter 193: loss 0.17584. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 29 Iter 193: loss 0.17584. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 29 Iter 194: loss 0.17732. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 29 Iter 194: loss 0.17732. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 29 Iter 195: loss 0.18294. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 29 Iter 195: loss 0.18294. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 29 Iter 196: loss 0.15764. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 29 Iter 196: loss 0.15764. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.15887. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.15887. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.08it/s]
Epoch 29 Iter 198: loss 0.15759. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.08it/s]
Epoch 29 Iter 198: loss 0.15759. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.16316. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.16316. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.08it/s]
Epoch 29 Iter 200: loss 0.17215. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:11,  2.08it/s]
Epoch 29 Iter 200: loss 0.17215. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 29 Iter 201: loss 0.15838. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 29 Iter 201: loss 0.15838. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 29 Iter 202: loss 0.17047. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.08it/s]
Epoch 29 Iter 202: loss 0.17047. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 29 Iter 203: loss 0.17319. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 29 Iter 203: loss 0.17319. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 29 Iter 204: loss 0.15332. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 29 Iter 204: loss 0.15332. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 29 Iter 205: loss 0.15502. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 29 Iter 205: loss 0.15502. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 29 Iter 206: loss 0.16093. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 29 Iter 206: loss 0.16093. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 207: loss 0.17328. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 207: loss 0.17328. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.17048. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.17048. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.18896. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.18896. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 29 Iter 210: loss 0.16741. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 29 Iter 210: loss 0.16741. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.14711. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.14711. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 212: loss 0.20166. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 212: loss 0.20166. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 29 Iter 213: loss 0.18726. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 29 Iter 213: loss 0.18726. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.17846. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.17846. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 29 Iter 215: loss 0.16141. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 29 Iter 215: loss 0.16141. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 29 Iter 216: loss 0.16150. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 29 Iter 216: loss 0.16150. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 29 Iter 217: loss 0.16638. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 29 Iter 217: loss 0.16638. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 29 Iter 218: loss 0.17341. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 29 Iter 218: loss 0.17341. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 29 Iter 219: loss 0.16805. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 29 Iter 219: loss 0.16805. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 29 Iter 220: loss 0.16965. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 29 Iter 220: loss 0.16965. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 29 Iter 221: loss 0.16098. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 29 Iter 221: loss 0.16098. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 29 Iter 222: loss 0.18440. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 29 Iter 222: loss 0.18440. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 29 Iter 223: loss 0.15123. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 29 Iter 223: loss 0.15123. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 29 Iter 224: loss 0.18264. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 29 Iter 224: loss 0.18264. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 29 Iter 224: loss 0.18264. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16458
    Valid loss: 0.17047
       Valid loss recons: 0.17047
       Valid loss KL-D:   82830.27095
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.14766. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.14766. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 30 Iter 2: loss 0.14780. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 30 Iter 2: loss 0.14780. :   1%|▍                                              | 2/224 [00:00<01:49,  2.02it/s]
Epoch 30 Iter 3: loss 0.16846. :   1%|▍                                              | 2/224 [00:01<01:49,  2.02it/s]
Epoch 30 Iter 3: loss 0.16846. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 30 Iter 4: loss 0.17648. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 30 Iter 4: loss 0.17648. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 30 Iter 5: loss 0.16746. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 30 Iter 5: loss 0.16746. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 30 Iter 6: loss 0.15884. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 30 Iter 6: loss 0.15884. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 30 Iter 7: loss 0.17467. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 30 Iter 7: loss 0.17467. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 30 Iter 8: loss 0.15299. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 30 Iter 8: loss 0.15299. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 30 Iter 9: loss 0.17044. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 30 Iter 9: loss 0.17044. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 30 Iter 10: loss 0.17675. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 30 Iter 10: loss 0.17675. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 30 Iter 11: loss 0.15043. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 11: loss 0.15043. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 12: loss 0.14838. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 12: loss 0.14838. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 30 Iter 13: loss 0.16981. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 30 Iter 13: loss 0.16981. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 30 Iter 14: loss 0.15809. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 30 Iter 14: loss 0.15809. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 30 Iter 15: loss 0.15267. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 30 Iter 15: loss 0.15267. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 30 Iter 16: loss 0.17842. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 30 Iter 16: loss 0.17842. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 30 Iter 17: loss 0.15647. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 30 Iter 17: loss 0.15647. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 30 Iter 18: loss 0.16253. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 30 Iter 18: loss 0.16253. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 30 Iter 19: loss 0.15479. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 30 Iter 19: loss 0.15479. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 30 Iter 20: loss 0.15922. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 30 Iter 20: loss 0.15922. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 30 Iter 21: loss 0.16942. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 30 Iter 21: loss 0.16942. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 30 Iter 22: loss 0.16112. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 30 Iter 22: loss 0.16112. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 30 Iter 23: loss 0.17293. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 30 Iter 23: loss 0.17293. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.14005. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.14005. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.16781. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.16781. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 26: loss 0.16411. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 26: loss 0.16411. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 30 Iter 27: loss 0.17608. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 30 Iter 27: loss 0.17608. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 30 Iter 28: loss 0.17458. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 30 Iter 28: loss 0.17458. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 30 Iter 29: loss 0.17325. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 30 Iter 29: loss 0.17325. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 30: loss 0.16176. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 30: loss 0.16176. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 31: loss 0.17373. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 30 Iter 31: loss 0.17373. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.14870. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.14870. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 30 Iter 33: loss 0.17386. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 30 Iter 33: loss 0.17386. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 30 Iter 34: loss 0.15910. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 30 Iter 34: loss 0.15910. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 30 Iter 35: loss 0.15498. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 30 Iter 35: loss 0.15498. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 30 Iter 36: loss 0.16854. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 30 Iter 36: loss 0.16854. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 30 Iter 37: loss 0.19288. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 30 Iter 37: loss 0.19288. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 30 Iter 38: loss 0.17069. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 30 Iter 38: loss 0.17069. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 30 Iter 39: loss 0.16561. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 30 Iter 39: loss 0.16561. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 30 Iter 40: loss 0.16998. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 30 Iter 40: loss 0.16998. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 30 Iter 41: loss 0.15848. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 30 Iter 41: loss 0.15848. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 30 Iter 42: loss 0.15023. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 30 Iter 42: loss 0.15023. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 43: loss 0.15818. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 43: loss 0.15818. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 30 Iter 44: loss 0.16754. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 30 Iter 44: loss 0.16754. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 30 Iter 45: loss 0.16136. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 30 Iter 45: loss 0.16136. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 30 Iter 46: loss 0.18200. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 30 Iter 46: loss 0.18200. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 30 Iter 47: loss 0.15484. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 30 Iter 47: loss 0.15484. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.08it/s]
Epoch 30 Iter 48: loss 0.16311. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.08it/s]
Epoch 30 Iter 48: loss 0.16311. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 30 Iter 49: loss 0.16159. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 30 Iter 49: loss 0.16159. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 30 Iter 50: loss 0.15491. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 30 Iter 50: loss 0.15491. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 30 Iter 51: loss 0.16219. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 30 Iter 51: loss 0.16219. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.15922. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.15922. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 30 Iter 53: loss 0.16979. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 30 Iter 53: loss 0.16979. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 30 Iter 54: loss 0.14574. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 30 Iter 54: loss 0.14574. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 30 Iter 55: loss 0.14403. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 30 Iter 55: loss 0.14403. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 30 Iter 56: loss 0.18577. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 56: loss 0.18577. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 57: loss 0.15917. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 57: loss 0.15917. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.18181. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.18181. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.17096. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.17096. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.09it/s]
Epoch 30 Iter 60: loss 0.16419. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.09it/s]
Epoch 30 Iter 60: loss 0.16419. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 30 Iter 61: loss 0.16900. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 30 Iter 61: loss 0.16900. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 30 Iter 62: loss 0.16315. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 30 Iter 62: loss 0.16315. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 30 Iter 63: loss 0.16180. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 30 Iter 63: loss 0.16180. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 64: loss 0.15835. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 64: loss 0.15835. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 30 Iter 65: loss 0.15505. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 30 Iter 65: loss 0.15505. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 66: loss 0.15655. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 66: loss 0.15655. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 30 Iter 67: loss 0.16772. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 30 Iter 67: loss 0.16772. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 30 Iter 68: loss 0.14404. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 30 Iter 68: loss 0.14404. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.16190. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.16190. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 30 Iter 70: loss 0.16292. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 30 Iter 70: loss 0.16292. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 30 Iter 71: loss 0.17265. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 30 Iter 71: loss 0.17265. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 30 Iter 72: loss 0.17177. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 30 Iter 72: loss 0.17177. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.08it/s]
Epoch 30 Iter 73: loss 0.15748. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.08it/s]
Epoch 30 Iter 73: loss 0.15748. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 30 Iter 74: loss 0.17162. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 30 Iter 74: loss 0.17162. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 30 Iter 75: loss 0.17791. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 30 Iter 75: loss 0.17791. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 30 Iter 76: loss 0.16109. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 30 Iter 76: loss 0.16109. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 30 Iter 77: loss 0.18834. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 30 Iter 77: loss 0.18834. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 30 Iter 78: loss 0.16761. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 30 Iter 78: loss 0.16761. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 30 Iter 79: loss 0.17881. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 30 Iter 79: loss 0.17881. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 30 Iter 80: loss 0.14999. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 30 Iter 80: loss 0.14999. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 30 Iter 81: loss 0.16676. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 30 Iter 81: loss 0.16676. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 30 Iter 82: loss 0.13607. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 30 Iter 82: loss 0.13607. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 30 Iter 83: loss 0.15584. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 83: loss 0.15584. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 84: loss 0.14737. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 84: loss 0.14737. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 30 Iter 85: loss 0.18684. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 30 Iter 85: loss 0.18684. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 30 Iter 86: loss 0.15687. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 30 Iter 86: loss 0.15687. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 30 Iter 87: loss 0.16912. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 30 Iter 87: loss 0.16912. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 30 Iter 88: loss 0.16619. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 30 Iter 88: loss 0.16619. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 30 Iter 89: loss 0.15409. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 89: loss 0.15409. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 90: loss 0.17107. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 90: loss 0.17107. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 30 Iter 91: loss 0.15402. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.06it/s]
Epoch 30 Iter 91: loss 0.15402. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 30 Iter 92: loss 0.15616. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 30 Iter 92: loss 0.15616. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 30 Iter 93: loss 0.15485. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 30 Iter 93: loss 0.15485. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 30 Iter 94: loss 0.18305. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 30 Iter 94: loss 0.18305. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 30 Iter 95: loss 0.18321. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 30 Iter 95: loss 0.18321. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.06it/s]
Epoch 30 Iter 96: loss 0.16268. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 96: loss 0.16268. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 97: loss 0.15557. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 97: loss 0.15557. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.15918. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.15918. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.16292. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.16292. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.16229. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.16229. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.16183. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.16183. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.17608. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.17608. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.17885. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.17885. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.17653. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.17653. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 105: loss 0.16856. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 105: loss 0.16856. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.16432. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.16432. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 30 Iter 107: loss 0.16926. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 30 Iter 107: loss 0.16926. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 30 Iter 108: loss 0.15489. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 30 Iter 108: loss 0.15489. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 30 Iter 109: loss 0.16378. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 30 Iter 109: loss 0.16378. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 30 Iter 110: loss 0.15271. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 30 Iter 110: loss 0.15271. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 30 Iter 111: loss 0.18225. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 30 Iter 111: loss 0.18225. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 30 Iter 112: loss 0.18248. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 30 Iter 112: loss 0.18248. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 30 Iter 113: loss 0.13653. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 30 Iter 113: loss 0.13653. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 30 Iter 114: loss 0.15115. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 30 Iter 114: loss 0.15115. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 30 Iter 115: loss 0.15054. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 30 Iter 115: loss 0.15054. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 30 Iter 116: loss 0.17816. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 30 Iter 116: loss 0.17816. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 30 Iter 117: loss 0.18370. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 30 Iter 117: loss 0.18370. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 30 Iter 118: loss 0.16254. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 118: loss 0.16254. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 119: loss 0.16054. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 119: loss 0.16054. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 30 Iter 120: loss 0.14669. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 30 Iter 120: loss 0.14669. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 30 Iter 121: loss 0.16264. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 30 Iter 121: loss 0.16264. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 30 Iter 122: loss 0.17167. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 30 Iter 122: loss 0.17167. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 30 Iter 123: loss 0.15145. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 30 Iter 123: loss 0.15145. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 30 Iter 124: loss 0.16230. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 30 Iter 124: loss 0.16230. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 30 Iter 125: loss 0.18057. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 30 Iter 125: loss 0.18057. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 30 Iter 126: loss 0.16158. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 30 Iter 126: loss 0.16158. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 30 Iter 127: loss 0.17262. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 30 Iter 127: loss 0.17262. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 128: loss 0.14970. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 128: loss 0.14970. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 129: loss 0.15790. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 30 Iter 129: loss 0.15790. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 130: loss 0.16332. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 130: loss 0.16332. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.16399. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.16399. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 30 Iter 132: loss 0.17272. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 30 Iter 132: loss 0.17272. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 30 Iter 133: loss 0.17006. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 30 Iter 133: loss 0.17006. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 30 Iter 134: loss 0.16947. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 30 Iter 134: loss 0.16947. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 30 Iter 135: loss 0.16042. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 30 Iter 135: loss 0.16042. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 30 Iter 136: loss 0.19884. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 30 Iter 136: loss 0.19884. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 30 Iter 137: loss 0.17421. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 137: loss 0.17421. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 138: loss 0.17189. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 138: loss 0.17189. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 30 Iter 139: loss 0.17795. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 30 Iter 139: loss 0.17795. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 30 Iter 140: loss 0.17161. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 30 Iter 140: loss 0.17161. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 30 Iter 141: loss 0.15548. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 30 Iter 141: loss 0.15548. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 30 Iter 142: loss 0.14347. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 30 Iter 142: loss 0.14347. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 30 Iter 143: loss 0.18680. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 30 Iter 143: loss 0.18680. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 30 Iter 144: loss 0.15538. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 30 Iter 144: loss 0.15538. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 30 Iter 145: loss 0.16171. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 30 Iter 145: loss 0.16171. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 30 Iter 146: loss 0.14226. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 30 Iter 146: loss 0.14226. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 30 Iter 147: loss 0.14743. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 147: loss 0.14743. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.15812. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.15812. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 30 Iter 149: loss 0.16212. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 30 Iter 149: loss 0.16212. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 30 Iter 150: loss 0.18000. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 30 Iter 150: loss 0.18000. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.09it/s]
Epoch 30 Iter 151: loss 0.16323. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.09it/s]
Epoch 30 Iter 151: loss 0.16323. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.09it/s]
Epoch 30 Iter 152: loss 0.15556. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.09it/s]
Epoch 30 Iter 152: loss 0.15556. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 30 Iter 153: loss 0.18262. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 30 Iter 153: loss 0.18262. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 30 Iter 154: loss 0.17052. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 30 Iter 154: loss 0.17052. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.17387. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.17387. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.19341. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.19341. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 30 Iter 157: loss 0.14751. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 30 Iter 157: loss 0.14751. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.05it/s]
Epoch 30 Iter 158: loss 0.15219. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 30 Iter 158: loss 0.15219. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 30 Iter 159: loss 0.15544. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 30 Iter 159: loss 0.15544. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.05it/s]
Epoch 30 Iter 160: loss 0.17454. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 30 Iter 160: loss 0.17454. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 30 Iter 161: loss 0.15071. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 30 Iter 161: loss 0.15071. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 30 Iter 162: loss 0.15501. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 30 Iter 162: loss 0.15501. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 30 Iter 163: loss 0.17361. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 30 Iter 163: loss 0.17361. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 30 Iter 164: loss 0.16915. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 30 Iter 164: loss 0.16915. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 30 Iter 165: loss 0.16544. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 30 Iter 165: loss 0.16544. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.10it/s]
Epoch 30 Iter 166: loss 0.15723. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.10it/s]
Epoch 30 Iter 166: loss 0.15723. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 30 Iter 167: loss 0.17382. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 30 Iter 167: loss 0.17382. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 30 Iter 168: loss 0.15112. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 30 Iter 168: loss 0.15112. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 30 Iter 169: loss 0.17778. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 30 Iter 169: loss 0.17778. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 30 Iter 170: loss 0.17093. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 30 Iter 170: loss 0.17093. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.08it/s]
Epoch 30 Iter 171: loss 0.16595. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.08it/s]
Epoch 30 Iter 171: loss 0.16595. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.16725. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.16725. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 30 Iter 173: loss 0.16032. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 30 Iter 173: loss 0.16032. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 30 Iter 174: loss 0.15903. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 30 Iter 174: loss 0.15903. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 30 Iter 175: loss 0.17029. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 30 Iter 175: loss 0.17029. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 30 Iter 176: loss 0.16674. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 30 Iter 176: loss 0.16674. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 30 Iter 177: loss 0.15955. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 30 Iter 177: loss 0.15955. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 30 Iter 178: loss 0.15981. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 30 Iter 178: loss 0.15981. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 30 Iter 179: loss 0.17199. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 30 Iter 179: loss 0.17199. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 30 Iter 180: loss 0.16409. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 30 Iter 180: loss 0.16409. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 30 Iter 181: loss 0.16948. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 30 Iter 181: loss 0.16948. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 30 Iter 182: loss 0.17237. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 30 Iter 182: loss 0.17237. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 30 Iter 183: loss 0.17744. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 30 Iter 183: loss 0.17744. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 30 Iter 184: loss 0.17342. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 30 Iter 184: loss 0.17342. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 30 Iter 185: loss 0.18224. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 30 Iter 185: loss 0.18224. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 30 Iter 186: loss 0.17809. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 30 Iter 186: loss 0.17809. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 30 Iter 187: loss 0.15138. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 30 Iter 187: loss 0.15138. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 30 Iter 188: loss 0.15604. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 30 Iter 188: loss 0.15604. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 30 Iter 189: loss 0.15218. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 30 Iter 189: loss 0.15218. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 190: loss 0.16810. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 190: loss 0.16810. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 191: loss 0.16343. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 30 Iter 191: loss 0.16343. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 30 Iter 192: loss 0.14837. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 30 Iter 192: loss 0.14837. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 30 Iter 193: loss 0.16076. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 30 Iter 193: loss 0.16076. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 30 Iter 194: loss 0.15454. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 30 Iter 194: loss 0.15454. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 30 Iter 195: loss 0.15685. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 30 Iter 195: loss 0.15685. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 30 Iter 196: loss 0.16600. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 30 Iter 196: loss 0.16600. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.03it/s]
Epoch 30 Iter 197: loss 0.16768. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.03it/s]
Epoch 30 Iter 197: loss 0.16768. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.03it/s]
Epoch 30 Iter 198: loss 0.16132. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.03it/s]
Epoch 30 Iter 198: loss 0.16132. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.03it/s]
Epoch 30 Iter 199: loss 0.16891. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.03it/s]
Epoch 30 Iter 199: loss 0.16891. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.03it/s]
Epoch 30 Iter 200: loss 0.16115. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.03it/s]
Epoch 30 Iter 200: loss 0.16115. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.03it/s]
Epoch 30 Iter 201: loss 0.13945. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.03it/s]
Epoch 30 Iter 201: loss 0.13945. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.03it/s]
Epoch 30 Iter 202: loss 0.13756. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.03it/s]
Epoch 30 Iter 202: loss 0.13756. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.02it/s]
Epoch 30 Iter 203: loss 0.16466. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.02it/s]
Epoch 30 Iter 203: loss 0.16466. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.03it/s]
Epoch 30 Iter 204: loss 0.17162. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.03it/s]
Epoch 30 Iter 204: loss 0.17162. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.04it/s]
Epoch 30 Iter 205: loss 0.15672. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.04it/s]
Epoch 30 Iter 205: loss 0.15672. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.04it/s]
Epoch 30 Iter 206: loss 0.16685. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.04it/s]
Epoch 30 Iter 206: loss 0.16685. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.04it/s]
Epoch 30 Iter 207: loss 0.15556. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 30 Iter 207: loss 0.15556. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 30 Iter 208: loss 0.16326. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 30 Iter 208: loss 0.16326. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 30 Iter 209: loss 0.14648. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 30 Iter 209: loss 0.14648. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 30 Iter 210: loss 0.16612. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 30 Iter 210: loss 0.16612. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 30 Iter 211: loss 0.17123. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 30 Iter 211: loss 0.17123. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 30 Iter 212: loss 0.17840. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 30 Iter 212: loss 0.17840. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 30 Iter 213: loss 0.17323. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 213: loss 0.17323. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.18725. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.18725. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.16025. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.16025. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 216: loss 0.18648. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 216: loss 0.18648. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 30 Iter 217: loss 0.16821. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 217: loss 0.16821. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 218: loss 0.14952. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 218: loss 0.14952. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 30 Iter 219: loss 0.18034. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 30 Iter 219: loss 0.18034. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 30 Iter 220: loss 0.16215. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 30 Iter 220: loss 0.16215. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 30 Iter 221: loss 0.17661. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.08it/s]
Epoch 30 Iter 221: loss 0.17661. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 30 Iter 222: loss 0.16284. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 30 Iter 222: loss 0.16284. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 30 Iter 223: loss 0.15067. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 30 Iter 223: loss 0.15067. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.17546. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.17546. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.17546. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.16123. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.16123. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.14168. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.14168. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.16828. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.16828. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 31 Iter 4: loss 0.15705. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 31 Iter 4: loss 0.15705. :   2%|▊                                              | 4/224 [00:01<01:45,  2.08it/s]
Epoch 31 Iter 5: loss 0.16511. :   2%|▊                                              | 4/224 [00:02<01:45,  2.08it/s]
Epoch 31 Iter 5: loss 0.16511. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 31 Iter 6: loss 0.16052. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 31 Iter 6: loss 0.16052. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 31 Iter 7: loss 0.16312. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 31 Iter 7: loss 0.16312. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 8: loss 0.16113. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 8: loss 0.16113. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 31 Iter 9: loss 0.16125. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 31 Iter 9: loss 0.16125. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 10: loss 0.18110. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 10: loss 0.18110. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.14861. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.14861. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.16755. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.16755. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.18316. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.18316. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.15634. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.15634. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 31 Iter 15: loss 0.15386. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 31 Iter 15: loss 0.15386. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 16: loss 0.16424. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 16: loss 0.16424. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 31 Iter 17: loss 0.14883. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 31 Iter 17: loss 0.14883. :   8%|███▍                                         | 17/224 [00:08<01:38,  2.09it/s]
Epoch 31 Iter 18: loss 0.14469. :   8%|███▍                                         | 17/224 [00:08<01:38,  2.09it/s]
Epoch 31 Iter 18: loss 0.14469. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 31 Iter 19: loss 0.17045. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 31 Iter 19: loss 0.17045. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 31 Iter 20: loss 0.16708. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 31 Iter 20: loss 0.16708. :   9%|████                                         | 20/224 [00:09<01:38,  2.08it/s]
Epoch 31 Iter 21: loss 0.16142. :   9%|████                                         | 20/224 [00:10<01:38,  2.08it/s]
Epoch 31 Iter 21: loss 0.16142. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.09it/s]
Epoch 31 Iter 22: loss 0.14306. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.09it/s]
Epoch 31 Iter 22: loss 0.14306. :  10%|████▍                                        | 22/224 [00:10<01:36,  2.09it/s]
Epoch 31 Iter 23: loss 0.13304. :  10%|████▍                                        | 22/224 [00:11<01:36,  2.09it/s]
Epoch 31 Iter 23: loss 0.13304. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.09it/s]
Epoch 31 Iter 24: loss 0.17823. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.09it/s]
Epoch 31 Iter 24: loss 0.17823. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.08it/s]
Epoch 31 Iter 25: loss 0.16725. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.08it/s]
Epoch 31 Iter 25: loss 0.16725. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 31 Iter 26: loss 0.14707. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 31 Iter 26: loss 0.14707. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 31 Iter 27: loss 0.16063. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 31 Iter 27: loss 0.16063. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 31 Iter 28: loss 0.17170. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 31 Iter 28: loss 0.17170. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 31 Iter 29: loss 0.16720. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 31 Iter 29: loss 0.16720. :  13%|█████▊                                       | 29/224 [00:13<01:34,  2.07it/s]
Epoch 31 Iter 30: loss 0.14730. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 31 Iter 30: loss 0.14730. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 31 Iter 31: loss 0.17670. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 31 Iter 31: loss 0.17670. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 31 Iter 32: loss 0.15121. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 31 Iter 32: loss 0.15121. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.09it/s]
Epoch 31 Iter 33: loss 0.16775. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.09it/s]
Epoch 31 Iter 33: loss 0.16775. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.09it/s]
Epoch 31 Iter 34: loss 0.15193. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.09it/s]
Epoch 31 Iter 34: loss 0.15193. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 31 Iter 35: loss 0.14723. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 31 Iter 35: loss 0.14723. :  16%|███████                                      | 35/224 [00:16<01:30,  2.09it/s]
Epoch 31 Iter 36: loss 0.14577. :  16%|███████                                      | 35/224 [00:17<01:30,  2.09it/s]
Epoch 31 Iter 36: loss 0.14577. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.09it/s]
Epoch 31 Iter 37: loss 0.14136. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.09it/s]
Epoch 31 Iter 37: loss 0.14136. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 31 Iter 38: loss 0.16185. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 31 Iter 38: loss 0.16185. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 31 Iter 39: loss 0.15603. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 31 Iter 39: loss 0.15603. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 31 Iter 40: loss 0.17505. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 31 Iter 40: loss 0.17505. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 31 Iter 41: loss 0.17299. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 31 Iter 41: loss 0.17299. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 31 Iter 42: loss 0.16873. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 31 Iter 42: loss 0.16873. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 31 Iter 43: loss 0.15874. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 31 Iter 43: loss 0.15874. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 31 Iter 44: loss 0.17176. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 31 Iter 44: loss 0.17176. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 31 Iter 45: loss 0.15787. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 31 Iter 45: loss 0.15787. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 31 Iter 46: loss 0.17353. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 31 Iter 46: loss 0.17353. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 31 Iter 47: loss 0.17549. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 31 Iter 47: loss 0.17549. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.08it/s]
Epoch 31 Iter 48: loss 0.16803. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.08it/s]
Epoch 31 Iter 48: loss 0.16803. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 31 Iter 49: loss 0.14946. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 31 Iter 49: loss 0.14946. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 31 Iter 50: loss 0.16186. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 31 Iter 50: loss 0.16186. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 51: loss 0.15286. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 51: loss 0.15286. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.17155. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.17155. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 31 Iter 53: loss 0.15972. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 31 Iter 53: loss 0.15972. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.17198. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.17198. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 31 Iter 55: loss 0.17359. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 31 Iter 55: loss 0.17359. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 31 Iter 56: loss 0.18211. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 31 Iter 56: loss 0.18211. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 31 Iter 57: loss 0.18411. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 31 Iter 57: loss 0.18411. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 31 Iter 58: loss 0.18611. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 31 Iter 58: loss 0.18611. :  26%|███████████▋                                 | 58/224 [00:27<01:20,  2.07it/s]
Epoch 31 Iter 59: loss 0.15644. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 31 Iter 59: loss 0.15644. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 31 Iter 60: loss 0.14974. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 31 Iter 60: loss 0.14974. :  27%|████████████                                 | 60/224 [00:28<01:18,  2.08it/s]
Epoch 31 Iter 61: loss 0.16185. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 31 Iter 61: loss 0.16185. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 31 Iter 62: loss 0.15890. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 31 Iter 62: loss 0.15890. :  28%|████████████▍                                | 62/224 [00:29<01:17,  2.08it/s]
Epoch 31 Iter 63: loss 0.16665. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 63: loss 0.16665. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.17105. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.17105. :  29%|████████████▊                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 31 Iter 65: loss 0.18872. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 31 Iter 65: loss 0.18872. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 31 Iter 66: loss 0.17836. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 31 Iter 66: loss 0.17836. :  29%|█████████████▎                               | 66/224 [00:31<01:15,  2.09it/s]
Epoch 31 Iter 67: loss 0.15150. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.09it/s]
Epoch 31 Iter 67: loss 0.15150. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.09it/s]
Epoch 31 Iter 68: loss 0.15572. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.09it/s]
Epoch 31 Iter 68: loss 0.15572. :  30%|█████████████▋                               | 68/224 [00:32<01:14,  2.08it/s]
Epoch 31 Iter 69: loss 0.15639. :  30%|█████████████▋                               | 68/224 [00:33<01:14,  2.08it/s]
Epoch 31 Iter 69: loss 0.15639. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 31 Iter 70: loss 0.13712. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 31 Iter 70: loss 0.13712. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 31 Iter 71: loss 0.16056. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 31 Iter 71: loss 0.16056. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 31 Iter 72: loss 0.15623. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 31 Iter 72: loss 0.15623. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.08it/s]
Epoch 31 Iter 73: loss 0.17213. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.08it/s]
Epoch 31 Iter 73: loss 0.17213. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.14721. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.14721. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 31 Iter 75: loss 0.17557. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 31 Iter 75: loss 0.17557. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 31 Iter 76: loss 0.14766. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 31 Iter 76: loss 0.14766. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 31 Iter 77: loss 0.17031. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 31 Iter 77: loss 0.17031. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 31 Iter 78: loss 0.15818. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 31 Iter 78: loss 0.15818. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 31 Iter 79: loss 0.16416. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 31 Iter 79: loss 0.16416. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 31 Iter 80: loss 0.15560. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 31 Iter 80: loss 0.15560. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 31 Iter 81: loss 0.16800. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 31 Iter 81: loss 0.16800. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 31 Iter 82: loss 0.13875. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 31 Iter 82: loss 0.13875. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 31 Iter 83: loss 0.18590. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 31 Iter 83: loss 0.18590. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 31 Iter 84: loss 0.16440. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 31 Iter 84: loss 0.16440. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 31 Iter 85: loss 0.19708. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 31 Iter 85: loss 0.19708. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 31 Iter 86: loss 0.16068. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 31 Iter 86: loss 0.16068. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 31 Iter 87: loss 0.18157. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 31 Iter 87: loss 0.18157. :  39%|█████████████████▍                           | 87/224 [00:41<01:06,  2.07it/s]
Epoch 31 Iter 88: loss 0.17503. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 31 Iter 88: loss 0.17503. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 31 Iter 89: loss 0.19444. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 31 Iter 89: loss 0.19444. :  40%|█████████████████▉                           | 89/224 [00:42<01:05,  2.06it/s]
Epoch 31 Iter 90: loss 0.19586. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 31 Iter 90: loss 0.19586. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 31 Iter 91: loss 0.15675. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 31 Iter 91: loss 0.15675. :  41%|██████████████████▎                          | 91/224 [00:43<01:04,  2.07it/s]
Epoch 31 Iter 92: loss 0.16533. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 31 Iter 92: loss 0.16533. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 31 Iter 93: loss 0.15232. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 31 Iter 93: loss 0.15232. :  42%|██████████████████▋                          | 93/224 [00:44<01:02,  2.08it/s]
Epoch 31 Iter 94: loss 0.16338. :  42%|██████████████████▋                          | 93/224 [00:45<01:02,  2.08it/s]
Epoch 31 Iter 94: loss 0.16338. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 31 Iter 95: loss 0.16066. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 31 Iter 95: loss 0.16066. :  42%|███████████████████                          | 95/224 [00:45<01:01,  2.09it/s]
Epoch 31 Iter 96: loss 0.15917. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 31 Iter 96: loss 0.15917. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 31 Iter 97: loss 0.17198. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 31 Iter 97: loss 0.17198. :  43%|███████████████████▍                         | 97/224 [00:46<01:00,  2.09it/s]
Epoch 31 Iter 98: loss 0.14148. :  43%|███████████████████▍                         | 97/224 [00:47<01:00,  2.09it/s]
Epoch 31 Iter 98: loss 0.14148. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 31 Iter 99: loss 0.19554. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 31 Iter 99: loss 0.19554. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.08it/s]
Epoch 31 Iter 100: loss 0.15302. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 31 Iter 100: loss 0.15302. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 31 Iter 101: loss 0.15618. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 31 Iter 101: loss 0.15618. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.15767. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.15767. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 31 Iter 103: loss 0.18756. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 31 Iter 103: loss 0.18756. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 31 Iter 104: loss 0.17258. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 31 Iter 104: loss 0.17258. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 31 Iter 105: loss 0.16267. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 31 Iter 105: loss 0.16267. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.17420. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.17420. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 107: loss 0.14826. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 107: loss 0.14826. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.16641. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.16641. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.16425. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.16425. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.17834. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.17834. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 111: loss 0.16818. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 111: loss 0.16818. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 112: loss 0.18760. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 31 Iter 112: loss 0.18760. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 31 Iter 113: loss 0.16746. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 31 Iter 113: loss 0.16746. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 31 Iter 114: loss 0.16339. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 31 Iter 114: loss 0.16339. :  51%|█████████████████████▉                     | 114/224 [00:54<00:52,  2.08it/s]
Epoch 31 Iter 115: loss 0.15063. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 31 Iter 115: loss 0.15063. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 31 Iter 116: loss 0.14444. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 31 Iter 116: loss 0.14444. :  52%|██████████████████████▎                    | 116/224 [00:55<00:52,  2.06it/s]
Epoch 31 Iter 117: loss 0.17569. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 31 Iter 117: loss 0.17569. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 31 Iter 118: loss 0.16113. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 31 Iter 118: loss 0.16113. :  53%|██████████████████████▋                    | 118/224 [00:56<00:51,  2.06it/s]
Epoch 31 Iter 119: loss 0.16836. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 31 Iter 119: loss 0.16836. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 31 Iter 120: loss 0.15918. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 31 Iter 120: loss 0.15918. :  54%|███████████████████████                    | 120/224 [00:57<00:49,  2.08it/s]
Epoch 31 Iter 121: loss 0.15828. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.08it/s]
Epoch 31 Iter 121: loss 0.15828. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 31 Iter 122: loss 0.15756. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 31 Iter 122: loss 0.15756. :  54%|███████████████████████▍                   | 122/224 [00:58<00:48,  2.08it/s]
Epoch 31 Iter 123: loss 0.16365. :  54%|███████████████████████▍                   | 122/224 [00:59<00:48,  2.08it/s]
Epoch 31 Iter 123: loss 0.16365. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.09it/s]
Epoch 31 Iter 124: loss 0.17676. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.09it/s]
Epoch 31 Iter 124: loss 0.17676. :  55%|███████████████████████▊                   | 124/224 [00:59<00:47,  2.10it/s]
Epoch 31 Iter 125: loss 0.17693. :  55%|███████████████████████▊                   | 124/224 [01:00<00:47,  2.10it/s]
Epoch 31 Iter 125: loss 0.17693. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.10it/s]
Epoch 31 Iter 126: loss 0.15827. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.10it/s]
Epoch 31 Iter 126: loss 0.15827. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.08it/s]
Epoch 31 Iter 127: loss 0.15029. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 31 Iter 127: loss 0.15029. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 31 Iter 128: loss 0.15533. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 31 Iter 128: loss 0.15533. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 31 Iter 129: loss 0.16119. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 31 Iter 129: loss 0.16119. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 31 Iter 130: loss 0.18595. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 31 Iter 130: loss 0.18595. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 31 Iter 131: loss 0.16918. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 31 Iter 131: loss 0.16918. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 31 Iter 132: loss 0.16311. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 31 Iter 132: loss 0.16311. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 31 Iter 133: loss 0.16302. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 31 Iter 133: loss 0.16302. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 31 Iter 134: loss 0.15376. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 31 Iter 134: loss 0.15376. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 31 Iter 135: loss 0.16645. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 31 Iter 135: loss 0.16645. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 31 Iter 136: loss 0.15279. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 31 Iter 136: loss 0.15279. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 31 Iter 137: loss 0.14295. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 31 Iter 137: loss 0.14295. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 31 Iter 138: loss 0.16090. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 31 Iter 138: loss 0.16090. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 31 Iter 139: loss 0.15100. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 31 Iter 139: loss 0.15100. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 31 Iter 140: loss 0.17177. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 31 Iter 140: loss 0.17177. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 31 Iter 141: loss 0.15734. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 31 Iter 141: loss 0.15734. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 31 Iter 142: loss 0.16009. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 31 Iter 142: loss 0.16009. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 31 Iter 143: loss 0.16578. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 31 Iter 143: loss 0.16578. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 31 Iter 144: loss 0.17360. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 31 Iter 144: loss 0.17360. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 31 Iter 145: loss 0.16639. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 31 Iter 145: loss 0.16639. :  65%|███████████████████████████▊               | 145/224 [01:09<00:38,  2.06it/s]
Epoch 31 Iter 146: loss 0.20203. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 31 Iter 146: loss 0.20203. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 31 Iter 147: loss 0.15958. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 31 Iter 147: loss 0.15958. :  66%|████████████████████████████▏              | 147/224 [01:10<00:37,  2.05it/s]
Epoch 31 Iter 148: loss 0.16945. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 31 Iter 148: loss 0.16945. :  66%|████████████████████████████▍              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 31 Iter 149: loss 0.18115. :  66%|████████████████████████████▍              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 31 Iter 149: loss 0.18115. :  67%|████████████████████████████▌              | 149/224 [01:11<00:36,  2.05it/s]
Epoch 31 Iter 150: loss 0.15063. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 31 Iter 150: loss 0.15063. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 31 Iter 151: loss 0.15837. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 31 Iter 151: loss 0.15837. :  67%|████████████████████████████▉              | 151/224 [01:12<00:35,  2.06it/s]
Epoch 31 Iter 152: loss 0.16434. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 31 Iter 152: loss 0.16434. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 31 Iter 153: loss 0.16709. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 31 Iter 153: loss 0.16709. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.06it/s]
Epoch 31 Iter 154: loss 0.14602. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 31 Iter 154: loss 0.14602. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 31 Iter 155: loss 0.18624. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 31 Iter 155: loss 0.18624. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.05it/s]
Epoch 31 Iter 156: loss 0.15960. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 31 Iter 156: loss 0.15960. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 31 Iter 157: loss 0.14659. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 31 Iter 157: loss 0.14659. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.05it/s]
Epoch 31 Iter 158: loss 0.14585. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 31 Iter 158: loss 0.14585. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 31 Iter 159: loss 0.16003. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 31 Iter 159: loss 0.16003. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.05it/s]
Epoch 31 Iter 160: loss 0.15223. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 31 Iter 160: loss 0.15223. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 31 Iter 161: loss 0.16523. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 31 Iter 161: loss 0.16523. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 31 Iter 162: loss 0.16465. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 31 Iter 162: loss 0.16465. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 31 Iter 163: loss 0.16682. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 31 Iter 163: loss 0.16682. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 31 Iter 164: loss 0.16059. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 164: loss 0.16059. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 165: loss 0.17339. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 165: loss 0.17339. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.17383. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.17383. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 31 Iter 167: loss 0.18407. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 31 Iter 167: loss 0.18407. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 31 Iter 168: loss 0.17232. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 31 Iter 168: loss 0.17232. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 31 Iter 169: loss 0.17512. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 31 Iter 169: loss 0.17512. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 31 Iter 170: loss 0.16935. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 31 Iter 170: loss 0.16935. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 31 Iter 171: loss 0.15198. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 31 Iter 171: loss 0.15198. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 31 Iter 172: loss 0.15903. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 172: loss 0.15903. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 173: loss 0.15974. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 173: loss 0.15974. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 31 Iter 174: loss 0.14393. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 31 Iter 174: loss 0.14393. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 31 Iter 175: loss 0.15191. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 31 Iter 175: loss 0.15191. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 31 Iter 176: loss 0.15108. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 31 Iter 176: loss 0.15108. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 31 Iter 177: loss 0.18128. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 31 Iter 177: loss 0.18128. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.16232. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.16232. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 31 Iter 179: loss 0.17993. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 31 Iter 179: loss 0.17993. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 31 Iter 180: loss 0.17213. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 31 Iter 180: loss 0.17213. :  80%|██████████████████████████████████▌        | 180/224 [01:26<00:21,  2.08it/s]
Epoch 31 Iter 181: loss 0.17971. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 31 Iter 181: loss 0.17971. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 31 Iter 182: loss 0.17320. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 31 Iter 182: loss 0.17320. :  81%|██████████████████████████████████▉        | 182/224 [01:27<00:20,  2.07it/s]
Epoch 31 Iter 183: loss 0.15997. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 31 Iter 183: loss 0.15997. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.05it/s]
Epoch 31 Iter 184: loss 0.15336. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.05it/s]
Epoch 31 Iter 184: loss 0.15336. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.05it/s]
Epoch 31 Iter 185: loss 0.17145. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 31 Iter 185: loss 0.17145. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 31 Iter 186: loss 0.17128. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 31 Iter 186: loss 0.17128. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.04it/s]
Epoch 31 Iter 187: loss 0.16303. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 31 Iter 187: loss 0.16303. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 31 Iter 188: loss 0.15719. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 31 Iter 188: loss 0.15719. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.05it/s]
Epoch 31 Iter 189: loss 0.16705. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 31 Iter 189: loss 0.16705. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 31 Iter 190: loss 0.16965. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 31 Iter 190: loss 0.16965. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 31 Iter 191: loss 0.16395. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 31 Iter 191: loss 0.16395. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 192: loss 0.16874. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 192: loss 0.16874. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.05it/s]
Epoch 31 Iter 193: loss 0.16783. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 193: loss 0.16783. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.17233. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.17233. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.05it/s]
Epoch 31 Iter 195: loss 0.15646. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 31 Iter 195: loss 0.15646. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 31 Iter 196: loss 0.17463. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 31 Iter 196: loss 0.17463. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 31 Iter 197: loss 0.16410. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 31 Iter 197: loss 0.16410. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 31 Iter 198: loss 0.16480. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 31 Iter 198: loss 0.16480. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 31 Iter 199: loss 0.16984. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 199: loss 0.16984. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.04it/s]
Epoch 31 Iter 200: loss 0.17202. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.04it/s]
Epoch 31 Iter 200: loss 0.17202. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 31 Iter 201: loss 0.16646. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 31 Iter 201: loss 0.16646. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 31 Iter 202: loss 0.17321. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 31 Iter 202: loss 0.17321. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 31 Iter 203: loss 0.14969. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 31 Iter 203: loss 0.14969. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 31 Iter 204: loss 0.15725. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 31 Iter 204: loss 0.15725. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 31 Iter 205: loss 0.18052. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 205: loss 0.18052. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 206: loss 0.18027. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 206: loss 0.18027. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.09it/s]
Epoch 31 Iter 207: loss 0.14473. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.09it/s]
Epoch 31 Iter 207: loss 0.14473. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 31 Iter 208: loss 0.15395. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 31 Iter 208: loss 0.15395. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 31 Iter 209: loss 0.18359. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 31 Iter 209: loss 0.18359. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 31 Iter 210: loss 0.14418. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 31 Iter 210: loss 0.14418. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 31 Iter 211: loss 0.16911. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 31 Iter 211: loss 0.16911. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 31 Iter 212: loss 0.16501. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 31 Iter 212: loss 0.16501. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 31 Iter 213: loss 0.17380. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 31 Iter 213: loss 0.17380. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.07it/s]
Epoch 31 Iter 214: loss 0.16311. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 31 Iter 214: loss 0.16311. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 31 Iter 215: loss 0.16083. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 31 Iter 215: loss 0.16083. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.07it/s]
Epoch 31 Iter 216: loss 0.16602. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 31 Iter 216: loss 0.16602. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 31 Iter 217: loss 0.15982. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 31 Iter 217: loss 0.15982. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.07it/s]
Epoch 31 Iter 218: loss 0.18752. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 31 Iter 218: loss 0.18752. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 31 Iter 219: loss 0.15472. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 31 Iter 219: loss 0.15472. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 31 Iter 220: loss 0.17223. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 31 Iter 220: loss 0.17223. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 31 Iter 221: loss 0.15210. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 31 Iter 221: loss 0.15210. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 31 Iter 222: loss 0.17517. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 31 Iter 222: loss 0.17517. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.16773. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.16773. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 224: loss 0.15769. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 31 Iter 224: loss 0.15769. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 31 Iter 224: loss 0.15769. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.16421
    Valid loss: 0.17027
       Valid loss recons: 0.17027
       Valid loss KL-D:   91047.0087
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.17082. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.17082. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 32 Iter 2: loss 0.14415. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 32 Iter 2: loss 0.14415. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 32 Iter 3: loss 0.17097. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 32 Iter 3: loss 0.17097. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 32 Iter 4: loss 0.17236. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 32 Iter 4: loss 0.17236. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 32 Iter 5: loss 0.18333. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 32 Iter 5: loss 0.18333. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 32 Iter 6: loss 0.16657. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 32 Iter 6: loss 0.16657. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 32 Iter 7: loss 0.16400. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 32 Iter 7: loss 0.16400. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 32 Iter 8: loss 0.17315. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 32 Iter 8: loss 0.17315. :   4%|█▋                                             | 8/224 [00:03<01:43,  2.08it/s]
Epoch 32 Iter 9: loss 0.17379. :   4%|█▋                                             | 8/224 [00:04<01:43,  2.08it/s]
Epoch 32 Iter 9: loss 0.17379. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 10: loss 0.18499. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 10: loss 0.18499. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 11: loss 0.17196. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 32 Iter 11: loss 0.17196. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 32 Iter 12: loss 0.14727. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 32 Iter 12: loss 0.14727. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 32 Iter 13: loss 0.15411. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 32 Iter 13: loss 0.15411. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 32 Iter 14: loss 0.16450. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 32 Iter 14: loss 0.16450. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 32 Iter 15: loss 0.15880. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 32 Iter 15: loss 0.15880. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 32 Iter 16: loss 0.16504. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 32 Iter 16: loss 0.16504. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 32 Iter 17: loss 0.16055. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 32 Iter 17: loss 0.16055. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 32 Iter 18: loss 0.14204. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 32 Iter 18: loss 0.14204. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 32 Iter 19: loss 0.16560. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 32 Iter 19: loss 0.16560. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 32 Iter 20: loss 0.17192. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 32 Iter 20: loss 0.17192. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 32 Iter 21: loss 0.19340. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 32 Iter 21: loss 0.19340. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 32 Iter 22: loss 0.14951. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 32 Iter 22: loss 0.14951. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 32 Iter 23: loss 0.16184. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 23: loss 0.16184. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 32 Iter 24: loss 0.16924. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 32 Iter 24: loss 0.16924. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 32 Iter 25: loss 0.15613. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 32 Iter 25: loss 0.15613. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 32 Iter 26: loss 0.17309. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 32 Iter 26: loss 0.17309. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 32 Iter 27: loss 0.17093. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 32 Iter 27: loss 0.17093. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 32 Iter 28: loss 0.16608. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 32 Iter 28: loss 0.16608. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 32 Iter 29: loss 0.14264. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 32 Iter 29: loss 0.14264. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 32 Iter 30: loss 0.15109. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 32 Iter 30: loss 0.15109. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 32 Iter 31: loss 0.15812. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 32 Iter 31: loss 0.15812. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 32 Iter 32: loss 0.14661. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 32 Iter 32: loss 0.14661. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 32 Iter 33: loss 0.18034. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 32 Iter 33: loss 0.18034. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 34: loss 0.16427. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 34: loss 0.16427. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 32 Iter 35: loss 0.15743. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 32 Iter 35: loss 0.15743. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 32 Iter 36: loss 0.15712. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 32 Iter 36: loss 0.15712. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 37: loss 0.15311. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 37: loss 0.15311. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 38: loss 0.17037. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 32 Iter 38: loss 0.17037. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 32 Iter 39: loss 0.16459. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 32 Iter 39: loss 0.16459. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.06it/s]
Epoch 32 Iter 40: loss 0.14179. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.06it/s]
Epoch 32 Iter 40: loss 0.14179. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 32 Iter 41: loss 0.16868. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 32 Iter 41: loss 0.16868. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.08it/s]
Epoch 32 Iter 42: loss 0.16462. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.08it/s]
Epoch 32 Iter 42: loss 0.16462. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 32 Iter 43: loss 0.16205. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 32 Iter 43: loss 0.16205. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 32 Iter 44: loss 0.16444. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 32 Iter 44: loss 0.16444. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 32 Iter 45: loss 0.17238. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 32 Iter 45: loss 0.17238. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 32 Iter 46: loss 0.15963. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 32 Iter 46: loss 0.15963. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 32 Iter 47: loss 0.15497. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 32 Iter 47: loss 0.15497. :  21%|█████████▍                                   | 47/224 [00:22<01:24,  2.09it/s]
Epoch 32 Iter 48: loss 0.16660. :  21%|█████████▍                                   | 47/224 [00:23<01:24,  2.09it/s]
Epoch 32 Iter 48: loss 0.16660. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 32 Iter 49: loss 0.16261. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 32 Iter 49: loss 0.16261. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.08it/s]
Epoch 32 Iter 50: loss 0.16254. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.08it/s]
Epoch 32 Iter 50: loss 0.16254. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 32 Iter 51: loss 0.16114. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 32 Iter 51: loss 0.16114. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 32 Iter 52: loss 0.14568. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 32 Iter 52: loss 0.14568. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 53: loss 0.17989. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 53: loss 0.17989. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.16133. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.16133. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.03it/s]
Epoch 32 Iter 55: loss 0.16493. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.03it/s]
Epoch 32 Iter 55: loss 0.16493. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 32 Iter 56: loss 0.15882. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 32 Iter 56: loss 0.15882. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 32 Iter 57: loss 0.15482. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 32 Iter 57: loss 0.15482. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 32 Iter 58: loss 0.15908. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 32 Iter 58: loss 0.15908. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 32 Iter 59: loss 0.17076. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 32 Iter 59: loss 0.17076. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 32 Iter 60: loss 0.14289. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 60: loss 0.14289. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 61: loss 0.15344. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 61: loss 0.15344. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 32 Iter 62: loss 0.16686. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 32 Iter 62: loss 0.16686. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 32 Iter 63: loss 0.15835. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 32 Iter 63: loss 0.15835. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 32 Iter 64: loss 0.17352. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 32 Iter 64: loss 0.17352. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 32 Iter 65: loss 0.16373. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 32 Iter 65: loss 0.16373. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 66: loss 0.16889. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 32 Iter 66: loss 0.16889. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 32 Iter 67: loss 0.17735. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 32 Iter 67: loss 0.17735. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.04it/s]
Epoch 32 Iter 68: loss 0.16370. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.04it/s]
Epoch 32 Iter 68: loss 0.16370. :  30%|█████████████▋                               | 68/224 [00:32<01:16,  2.05it/s]
Epoch 32 Iter 69: loss 0.17975. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 32 Iter 69: loss 0.17975. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.16684. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.16684. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.03it/s]
Epoch 32 Iter 71: loss 0.15415. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 32 Iter 71: loss 0.15415. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 32 Iter 72: loss 0.17332. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 32 Iter 72: loss 0.17332. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.16964. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.16964. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.04it/s]
Epoch 32 Iter 74: loss 0.15885. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.04it/s]
Epoch 32 Iter 74: loss 0.15885. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.05it/s]
Epoch 32 Iter 75: loss 0.15325. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 32 Iter 75: loss 0.15325. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 32 Iter 76: loss 0.16501. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 32 Iter 76: loss 0.16501. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.04it/s]
Epoch 32 Iter 77: loss 0.17007. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.04it/s]
Epoch 32 Iter 77: loss 0.17007. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 32 Iter 78: loss 0.19351. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 32 Iter 78: loss 0.19351. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 32 Iter 79: loss 0.15644. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 32 Iter 79: loss 0.15644. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 32 Iter 80: loss 0.16224. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 32 Iter 80: loss 0.16224. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.04it/s]
Epoch 32 Iter 81: loss 0.16513. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 32 Iter 81: loss 0.16513. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.14204. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.14204. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 32 Iter 83: loss 0.16840. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 32 Iter 83: loss 0.16840. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 32 Iter 84: loss 0.16185. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 32 Iter 84: loss 0.16185. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 32 Iter 85: loss 0.16032. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 32 Iter 85: loss 0.16032. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.18186. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.18186. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 32 Iter 87: loss 0.15334. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 32 Iter 87: loss 0.15334. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 32 Iter 88: loss 0.13564. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 32 Iter 88: loss 0.13564. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.17227. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.17227. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 32 Iter 90: loss 0.15225. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 32 Iter 90: loss 0.15225. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.04it/s]
Epoch 32 Iter 91: loss 0.17296. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 32 Iter 91: loss 0.17296. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 32 Iter 92: loss 0.15042. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 32 Iter 92: loss 0.15042. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 32 Iter 93: loss 0.16275. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 32 Iter 93: loss 0.16275. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 32 Iter 94: loss 0.16261. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 32 Iter 94: loss 0.16261. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 32 Iter 95: loss 0.17676. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 32 Iter 95: loss 0.17676. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 32 Iter 96: loss 0.16310. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 32 Iter 96: loss 0.16310. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 32 Iter 97: loss 0.16803. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 32 Iter 97: loss 0.16803. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 32 Iter 98: loss 0.16654. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 32 Iter 98: loss 0.16654. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 32 Iter 99: loss 0.16567. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 99: loss 0.16567. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 100: loss 0.16234. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 100: loss 0.16234. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 32 Iter 101: loss 0.16108. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 32 Iter 101: loss 0.16108. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 32 Iter 102: loss 0.15793. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 32 Iter 102: loss 0.15793. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 32 Iter 103: loss 0.16346. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.07it/s]
Epoch 32 Iter 103: loss 0.16346. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 32 Iter 104: loss 0.16647. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 32 Iter 104: loss 0.16647. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 32 Iter 105: loss 0.17555. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 32 Iter 105: loss 0.17555. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 32 Iter 106: loss 0.16551. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 32 Iter 106: loss 0.16551. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 32 Iter 107: loss 0.16894. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 32 Iter 107: loss 0.16894. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 32 Iter 108: loss 0.15679. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 32 Iter 108: loss 0.15679. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 32 Iter 109: loss 0.14777. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 32 Iter 109: loss 0.14777. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 32 Iter 110: loss 0.17476. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 32 Iter 110: loss 0.17476. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 32 Iter 111: loss 0.13961. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 32 Iter 111: loss 0.13961. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 32 Iter 112: loss 0.16598. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 32 Iter 112: loss 0.16598. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 32 Iter 113: loss 0.18923. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 32 Iter 113: loss 0.18923. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 32 Iter 114: loss 0.16430. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 32 Iter 114: loss 0.16430. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 32 Iter 115: loss 0.17638. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 32 Iter 115: loss 0.17638. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 32 Iter 116: loss 0.15994. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 32 Iter 116: loss 0.15994. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 32 Iter 117: loss 0.18237. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 32 Iter 117: loss 0.18237. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 32 Iter 118: loss 0.16294. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 32 Iter 118: loss 0.16294. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 32 Iter 119: loss 0.17332. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 32 Iter 119: loss 0.17332. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 32 Iter 120: loss 0.16275. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 32 Iter 120: loss 0.16275. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 32 Iter 121: loss 0.15679. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 32 Iter 121: loss 0.15679. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 32 Iter 122: loss 0.17341. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 32 Iter 122: loss 0.17341. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 32 Iter 123: loss 0.17035. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 32 Iter 123: loss 0.17035. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 32 Iter 124: loss 0.17125. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 32 Iter 124: loss 0.17125. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 32 Iter 125: loss 0.14665. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 32 Iter 125: loss 0.14665. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 32 Iter 126: loss 0.17451. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.08it/s]
Epoch 32 Iter 126: loss 0.17451. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 32 Iter 127: loss 0.17147. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 32 Iter 127: loss 0.17147. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 32 Iter 128: loss 0.15554. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 32 Iter 128: loss 0.15554. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.09it/s]
Epoch 32 Iter 129: loss 0.15720. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.09it/s]
Epoch 32 Iter 129: loss 0.15720. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 32 Iter 130: loss 0.18756. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.08it/s]
Epoch 32 Iter 130: loss 0.18756. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.16917. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.16917. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 132: loss 0.16707. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 32 Iter 132: loss 0.16707. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 32 Iter 133: loss 0.16840. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 32 Iter 133: loss 0.16840. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.03it/s]
Epoch 32 Iter 134: loss 0.16122. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.03it/s]
Epoch 32 Iter 134: loss 0.16122. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.04it/s]
Epoch 32 Iter 135: loss 0.16574. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.04it/s]
Epoch 32 Iter 135: loss 0.16574. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 136: loss 0.15855. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 32 Iter 136: loss 0.15855. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 32 Iter 137: loss 0.15068. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 32 Iter 137: loss 0.15068. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 32 Iter 138: loss 0.18026. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 32 Iter 138: loss 0.18026. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 139: loss 0.15146. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 139: loss 0.15146. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 140: loss 0.16584. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 140: loss 0.16584. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 32 Iter 141: loss 0.16463. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 32 Iter 141: loss 0.16463. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 142: loss 0.15087. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 142: loss 0.15087. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 32 Iter 143: loss 0.16034. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 32 Iter 143: loss 0.16034. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 32 Iter 144: loss 0.15977. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 32 Iter 144: loss 0.15977. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.14611. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.14611. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 146: loss 0.17391. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 146: loss 0.17391. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 32 Iter 147: loss 0.20023. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 32 Iter 147: loss 0.20023. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 32 Iter 148: loss 0.14649. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 32 Iter 148: loss 0.14649. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 32 Iter 149: loss 0.15081. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 32 Iter 149: loss 0.15081. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 32 Iter 150: loss 0.17325. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 32 Iter 150: loss 0.17325. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 32 Iter 151: loss 0.15674. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 32 Iter 151: loss 0.15674. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 32 Iter 152: loss 0.15609. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 32 Iter 152: loss 0.15609. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.18307. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.18307. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 154: loss 0.18082. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 154: loss 0.18082. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 32 Iter 155: loss 0.17617. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 32 Iter 155: loss 0.17617. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 32 Iter 156: loss 0.15051. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 32 Iter 156: loss 0.15051. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 32 Iter 157: loss 0.17094. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 32 Iter 157: loss 0.17094. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 32 Iter 158: loss 0.17578. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 32 Iter 158: loss 0.17578. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 32 Iter 159: loss 0.16154. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 32 Iter 159: loss 0.16154. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 32 Iter 160: loss 0.13585. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 32 Iter 160: loss 0.13585. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 32 Iter 161: loss 0.16035. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 32 Iter 161: loss 0.16035. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 32 Iter 162: loss 0.15466. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 32 Iter 162: loss 0.15466. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.04it/s]
Epoch 32 Iter 163: loss 0.16208. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.04it/s]
Epoch 32 Iter 163: loss 0.16208. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.04it/s]
Epoch 32 Iter 164: loss 0.18062. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.04it/s]
Epoch 32 Iter 164: loss 0.18062. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 32 Iter 165: loss 0.16397. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 32 Iter 165: loss 0.16397. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 166: loss 0.16364. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 166: loss 0.16364. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.15501. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.15501. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.17173. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.17173. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 169: loss 0.13331. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 32 Iter 169: loss 0.13331. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 32 Iter 170: loss 0.17984. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 32 Iter 170: loss 0.17984. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 32 Iter 171: loss 0.16440. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 32 Iter 171: loss 0.16440. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 32 Iter 172: loss 0.15898. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 32 Iter 172: loss 0.15898. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 32 Iter 173: loss 0.14875. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 32 Iter 173: loss 0.14875. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 32 Iter 174: loss 0.16680. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 32 Iter 174: loss 0.16680. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 175: loss 0.15679. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 175: loss 0.15679. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 32 Iter 176: loss 0.15894. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 32 Iter 176: loss 0.15894. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 32 Iter 177: loss 0.17674. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 32 Iter 177: loss 0.17674. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 32 Iter 178: loss 0.16286. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 178: loss 0.16286. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 179: loss 0.17334. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 179: loss 0.17334. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 32 Iter 180: loss 0.16790. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 180: loss 0.16790. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 181: loss 0.16533. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 181: loss 0.16533. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 32 Iter 182: loss 0.16796. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 32 Iter 182: loss 0.16796. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 32 Iter 183: loss 0.16996. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 32 Iter 183: loss 0.16996. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 32 Iter 184: loss 0.16212. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 32 Iter 184: loss 0.16212. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 32 Iter 185: loss 0.17859. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 32 Iter 185: loss 0.17859. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 32 Iter 186: loss 0.17938. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 32 Iter 186: loss 0.17938. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 32 Iter 187: loss 0.14901. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 32 Iter 187: loss 0.14901. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 32 Iter 188: loss 0.17800. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 32 Iter 188: loss 0.17800. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 32 Iter 189: loss 0.13773. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 32 Iter 189: loss 0.13773. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 32 Iter 190: loss 0.17943. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 32 Iter 190: loss 0.17943. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 32 Iter 191: loss 0.15097. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 32 Iter 191: loss 0.15097. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 32 Iter 192: loss 0.16988. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 32 Iter 192: loss 0.16988. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 32 Iter 193: loss 0.17674. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 32 Iter 193: loss 0.17674. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 32 Iter 194: loss 0.16729. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 32 Iter 194: loss 0.16729. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 32 Iter 195: loss 0.14844. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 32 Iter 195: loss 0.14844. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 32 Iter 196: loss 0.16178. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 196: loss 0.16178. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 197: loss 0.15983. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 197: loss 0.15983. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 198: loss 0.17681. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 32 Iter 198: loss 0.17681. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 32 Iter 199: loss 0.16072. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 32 Iter 199: loss 0.16072. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 32 Iter 200: loss 0.15497. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:11,  2.09it/s]
Epoch 32 Iter 200: loss 0.15497. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.18002. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.18002. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 202: loss 0.18795. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.07it/s]
Epoch 32 Iter 202: loss 0.18795. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 32 Iter 203: loss 0.16881. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 32 Iter 203: loss 0.16881. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 32 Iter 204: loss 0.16510. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 32 Iter 204: loss 0.16510. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 32 Iter 205: loss 0.16504. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 32 Iter 205: loss 0.16504. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 32 Iter 206: loss 0.15380. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 32 Iter 206: loss 0.15380. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 32 Iter 207: loss 0.16352. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 32 Iter 207: loss 0.16352. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 32 Iter 208: loss 0.15290. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 32 Iter 208: loss 0.15290. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 32 Iter 209: loss 0.15863. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 32 Iter 209: loss 0.15863. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 32 Iter 210: loss 0.15482. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 32 Iter 210: loss 0.15482. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 32 Iter 211: loss 0.18192. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 32 Iter 211: loss 0.18192. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 32 Iter 212: loss 0.17081. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 32 Iter 212: loss 0.17081. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.15673. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.15673. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 32 Iter 214: loss 0.14897. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 32 Iter 214: loss 0.14897. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 32 Iter 215: loss 0.16386. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 32 Iter 215: loss 0.16386. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.16322. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.16322. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 32 Iter 217: loss 0.17211. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 32 Iter 217: loss 0.17211. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.15213. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.15213. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 32 Iter 219: loss 0.18110. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 32 Iter 219: loss 0.18110. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 32 Iter 220: loss 0.17603. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 32 Iter 220: loss 0.17603. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 32 Iter 221: loss 0.16206. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 32 Iter 221: loss 0.16206. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.15473. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.15473. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 32 Iter 223: loss 0.15371. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 32 Iter 223: loss 0.15371. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 32 Iter 224: loss 0.15470. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 32 Iter 224: loss 0.15470. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 32 Iter 224: loss 0.15470. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.16852. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.16852. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 33 Iter 2: loss 0.15809. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 33 Iter 2: loss 0.15809. :   1%|▍                                              | 2/224 [00:00<01:49,  2.03it/s]
Epoch 33 Iter 3: loss 0.16361. :   1%|▍                                              | 2/224 [00:01<01:49,  2.03it/s]
Epoch 33 Iter 3: loss 0.16361. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 33 Iter 4: loss 0.16853. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 33 Iter 4: loss 0.16853. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 33 Iter 5: loss 0.16965. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 33 Iter 5: loss 0.16965. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 33 Iter 6: loss 0.16552. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 33 Iter 6: loss 0.16552. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 33 Iter 7: loss 0.18024. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 33 Iter 7: loss 0.18024. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 33 Iter 8: loss 0.17551. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 33 Iter 8: loss 0.17551. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 33 Iter 9: loss 0.14951. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 33 Iter 9: loss 0.14951. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 33 Iter 10: loss 0.16658. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 33 Iter 10: loss 0.16658. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 33 Iter 11: loss 0.16073. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 33 Iter 11: loss 0.16073. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 33 Iter 12: loss 0.18405. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 33 Iter 12: loss 0.18405. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.08it/s]
Epoch 33 Iter 13: loss 0.15649. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.08it/s]
Epoch 33 Iter 13: loss 0.15649. :   6%|██▌                                          | 13/224 [00:06<01:40,  2.09it/s]
Epoch 33 Iter 14: loss 0.16743. :   6%|██▌                                          | 13/224 [00:06<01:40,  2.09it/s]
Epoch 33 Iter 14: loss 0.16743. :   6%|██▊                                          | 14/224 [00:06<01:40,  2.09it/s]
Epoch 33 Iter 15: loss 0.14783. :   6%|██▊                                          | 14/224 [00:07<01:40,  2.09it/s]
Epoch 33 Iter 15: loss 0.14783. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 16: loss 0.15186. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 16: loss 0.15186. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 17: loss 0.15939. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 17: loss 0.15939. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 33 Iter 18: loss 0.17666. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 33 Iter 18: loss 0.17666. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 33 Iter 19: loss 0.16136. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 33 Iter 19: loss 0.16136. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 33 Iter 20: loss 0.17575. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 33 Iter 20: loss 0.17575. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 33 Iter 21: loss 0.14921. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 33 Iter 21: loss 0.14921. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 22: loss 0.14620. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 22: loss 0.14620. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 33 Iter 23: loss 0.15834. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 23: loss 0.15834. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 33 Iter 24: loss 0.16085. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 33 Iter 24: loss 0.16085. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 33 Iter 25: loss 0.18550. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 33 Iter 25: loss 0.18550. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 33 Iter 26: loss 0.15774. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 33 Iter 26: loss 0.15774. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.16574. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.16574. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 28: loss 0.13306. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 28: loss 0.13306. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 33 Iter 29: loss 0.16786. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 33 Iter 29: loss 0.16786. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 30: loss 0.17608. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 30: loss 0.17608. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.15640. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.15640. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.14394. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.14394. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 33: loss 0.17585. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 33: loss 0.17585. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 33 Iter 34: loss 0.14855. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 33 Iter 34: loss 0.14855. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 33 Iter 35: loss 0.14760. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 33 Iter 35: loss 0.14760. :  16%|███████                                      | 35/224 [00:16<01:30,  2.08it/s]
Epoch 33 Iter 36: loss 0.15326. :  16%|███████                                      | 35/224 [00:17<01:30,  2.08it/s]
Epoch 33 Iter 36: loss 0.15326. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 33 Iter 37: loss 0.15397. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 33 Iter 37: loss 0.15397. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 33 Iter 38: loss 0.13942. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 33 Iter 38: loss 0.13942. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 33 Iter 39: loss 0.16041. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 33 Iter 39: loss 0.16041. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.09it/s]
Epoch 33 Iter 40: loss 0.15413. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.09it/s]
Epoch 33 Iter 40: loss 0.15413. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 33 Iter 41: loss 0.14918. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 33 Iter 41: loss 0.14918. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 33 Iter 42: loss 0.16730. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 33 Iter 42: loss 0.16730. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 33 Iter 43: loss 0.17688. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 33 Iter 43: loss 0.17688. :  19%|████████▋                                    | 43/224 [00:20<01:26,  2.10it/s]
Epoch 33 Iter 44: loss 0.17650. :  19%|████████▋                                    | 43/224 [00:21<01:26,  2.10it/s]
Epoch 33 Iter 44: loss 0.17650. :  20%|████████▊                                    | 44/224 [00:21<01:25,  2.10it/s]
Epoch 33 Iter 45: loss 0.17056. :  20%|████████▊                                    | 44/224 [00:21<01:25,  2.10it/s]
Epoch 33 Iter 45: loss 0.17056. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 33 Iter 46: loss 0.15187. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 33 Iter 46: loss 0.15187. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.16444. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.16444. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 48: loss 0.15871. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.08it/s]
Epoch 33 Iter 48: loss 0.15871. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 33 Iter 49: loss 0.15353. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 33 Iter 49: loss 0.15353. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 33 Iter 50: loss 0.16657. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 33 Iter 50: loss 0.16657. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 33 Iter 51: loss 0.17020. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 33 Iter 51: loss 0.17020. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 33 Iter 52: loss 0.18253. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 33 Iter 52: loss 0.18253. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 53: loss 0.16195. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 53: loss 0.16195. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 54: loss 0.17196. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 33 Iter 54: loss 0.17196. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 33 Iter 55: loss 0.16708. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 33 Iter 55: loss 0.16708. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 33 Iter 56: loss 0.15190. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 33 Iter 56: loss 0.15190. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 57: loss 0.16710. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 57: loss 0.16710. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 33 Iter 58: loss 0.17566. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 33 Iter 58: loss 0.17566. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 33 Iter 59: loss 0.15432. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 33 Iter 59: loss 0.15432. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 33 Iter 60: loss 0.16514. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 33 Iter 60: loss 0.16514. :  27%|████████████                                 | 60/224 [00:28<01:18,  2.08it/s]
Epoch 33 Iter 61: loss 0.16660. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 33 Iter 61: loss 0.16660. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 33 Iter 62: loss 0.16062. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 33 Iter 62: loss 0.16062. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.07it/s]
Epoch 33 Iter 63: loss 0.17004. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 33 Iter 63: loss 0.17004. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 33 Iter 64: loss 0.17190. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 33 Iter 64: loss 0.17190. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.06it/s]
Epoch 33 Iter 65: loss 0.18017. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 33 Iter 65: loss 0.18017. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 33 Iter 66: loss 0.12935. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 33 Iter 66: loss 0.12935. :  29%|█████████████▎                               | 66/224 [00:31<01:17,  2.04it/s]
Epoch 33 Iter 67: loss 0.17042. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 33 Iter 67: loss 0.17042. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.04it/s]
Epoch 33 Iter 68: loss 0.18684. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.04it/s]
Epoch 33 Iter 68: loss 0.18684. :  30%|█████████████▋                               | 68/224 [00:32<01:16,  2.04it/s]
Epoch 33 Iter 69: loss 0.17338. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 33 Iter 69: loss 0.17338. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 33 Iter 70: loss 0.17253. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 33 Iter 70: loss 0.17253. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 33 Iter 71: loss 0.16105. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 33 Iter 71: loss 0.16105. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 33 Iter 72: loss 0.15382. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 33 Iter 72: loss 0.15382. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.04it/s]
Epoch 33 Iter 73: loss 0.16260. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 33 Iter 73: loss 0.16260. :  33%|██████████████▋                              | 73/224 [00:35<01:15,  1.99it/s]
Epoch 33 Iter 74: loss 0.18919. :  33%|██████████████▋                              | 73/224 [00:35<01:15,  1.99it/s]
Epoch 33 Iter 74: loss 0.18919. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.03it/s]
Epoch 33 Iter 75: loss 0.16307. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 33 Iter 75: loss 0.16307. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.04it/s]
Epoch 33 Iter 76: loss 0.16312. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.04it/s]
Epoch 33 Iter 76: loss 0.16312. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 33 Iter 77: loss 0.15568. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 33 Iter 77: loss 0.15568. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 33 Iter 78: loss 0.16184. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 33 Iter 78: loss 0.16184. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.06it/s]
Epoch 33 Iter 79: loss 0.16538. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.06it/s]
Epoch 33 Iter 79: loss 0.16538. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 33 Iter 80: loss 0.16586. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 33 Iter 80: loss 0.16586. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 33 Iter 81: loss 0.14016. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 33 Iter 81: loss 0.14016. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 33 Iter 82: loss 0.16957. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 33 Iter 82: loss 0.16957. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.16340. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.16340. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 33 Iter 84: loss 0.16963. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 33 Iter 84: loss 0.16963. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 33 Iter 85: loss 0.14934. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 33 Iter 85: loss 0.14934. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 86: loss 0.16940. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 86: loss 0.16940. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 33 Iter 87: loss 0.17043. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 87: loss 0.17043. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.15976. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.15976. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 89: loss 0.16499. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 33 Iter 89: loss 0.16499. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 33 Iter 90: loss 0.16282. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 33 Iter 90: loss 0.16282. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.14482. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.14482. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 33 Iter 92: loss 0.16935. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 33 Iter 92: loss 0.16935. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 33 Iter 93: loss 0.15657. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 33 Iter 93: loss 0.15657. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 94: loss 0.15044. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 94: loss 0.15044. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.16794. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.16794. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 96: loss 0.17175. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 96: loss 0.17175. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.16695. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.16695. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.16075. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.16075. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.16586. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.16586. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 33 Iter 100: loss 0.15514. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 100: loss 0.15514. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 33 Iter 101: loss 0.15532. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 33 Iter 101: loss 0.15532. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 33 Iter 102: loss 0.17216. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 33 Iter 102: loss 0.17216. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 33 Iter 103: loss 0.17331. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 33 Iter 103: loss 0.17331. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 33 Iter 104: loss 0.16532. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 33 Iter 104: loss 0.16532. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 33 Iter 105: loss 0.15987. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 33 Iter 105: loss 0.15987. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 33 Iter 106: loss 0.18551. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 106: loss 0.18551. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 107: loss 0.15821. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 107: loss 0.15821. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 33 Iter 108: loss 0.15524. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 33 Iter 108: loss 0.15524. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 33 Iter 109: loss 0.15724. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 33 Iter 109: loss 0.15724. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.17678. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.17678. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.16641. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.16641. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.15258. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.15258. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 113: loss 0.15353. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 113: loss 0.15353. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 33 Iter 114: loss 0.17804. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 33 Iter 114: loss 0.17804. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 33 Iter 115: loss 0.18282. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 33 Iter 115: loss 0.18282. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 33 Iter 116: loss 0.16405. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 33 Iter 116: loss 0.16405. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 33 Iter 117: loss 0.14371. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 33 Iter 117: loss 0.14371. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 33 Iter 118: loss 0.16747. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 33 Iter 118: loss 0.16747. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 33 Iter 119: loss 0.15838. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 33 Iter 119: loss 0.15838. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 33 Iter 120: loss 0.17768. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 33 Iter 120: loss 0.17768. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 33 Iter 121: loss 0.17249. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 33 Iter 121: loss 0.17249. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 33 Iter 122: loss 0.17552. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 33 Iter 122: loss 0.17552. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 33 Iter 123: loss 0.14215. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 33 Iter 123: loss 0.14215. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.15475. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.15475. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 125: loss 0.16438. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 125: loss 0.16438. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 126: loss 0.14154. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 33 Iter 126: loss 0.14154. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 33 Iter 127: loss 0.15939. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 33 Iter 127: loss 0.15939. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 33 Iter 128: loss 0.18102. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 33 Iter 128: loss 0.18102. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 33 Iter 129: loss 0.17720. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 33 Iter 129: loss 0.17720. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.04it/s]
Epoch 33 Iter 130: loss 0.17040. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.04it/s]
Epoch 33 Iter 130: loss 0.17040. :  58%|████████████████████████▉                  | 130/224 [01:03<00:46,  2.04it/s]
Epoch 33 Iter 131: loss 0.15742. :  58%|████████████████████████▉                  | 130/224 [01:03<00:46,  2.04it/s]
Epoch 33 Iter 131: loss 0.15742. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 33 Iter 132: loss 0.17677. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 33 Iter 132: loss 0.17677. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:45,  2.03it/s]
Epoch 33 Iter 133: loss 0.15368. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:45,  2.03it/s]
Epoch 33 Iter 133: loss 0.15368. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 33 Iter 134: loss 0.17667. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 33 Iter 134: loss 0.17667. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 33 Iter 135: loss 0.16782. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 33 Iter 135: loss 0.16782. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 33 Iter 136: loss 0.18143. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 33 Iter 136: loss 0.18143. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 33 Iter 137: loss 0.14705. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 33 Iter 137: loss 0.14705. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 33 Iter 138: loss 0.16369. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 33 Iter 138: loss 0.16369. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.16954. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.16954. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.16414. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.16414. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.15718. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.15718. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 33 Iter 142: loss 0.17059. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 33 Iter 142: loss 0.17059. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 33 Iter 143: loss 0.13899. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 33 Iter 143: loss 0.13899. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.15525. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.15525. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 33 Iter 145: loss 0.15841. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 145: loss 0.15841. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 146: loss 0.17523. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 146: loss 0.17523. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 33 Iter 147: loss 0.16117. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 147: loss 0.16117. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.16309. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.16309. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.15084. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.15084. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 33 Iter 150: loss 0.16782. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 33 Iter 150: loss 0.16782. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 33 Iter 151: loss 0.16416. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 33 Iter 151: loss 0.16416. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 33 Iter 152: loss 0.17218. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 33 Iter 152: loss 0.17218. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 33 Iter 153: loss 0.17204. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 33 Iter 153: loss 0.17204. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 33 Iter 154: loss 0.15375. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 33 Iter 154: loss 0.15375. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 33 Iter 155: loss 0.17047. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 33 Iter 155: loss 0.17047. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 33 Iter 156: loss 0.18320. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 33 Iter 156: loss 0.18320. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 33 Iter 157: loss 0.17255. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 33 Iter 157: loss 0.17255. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 33 Iter 158: loss 0.17429. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 33 Iter 158: loss 0.17429. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 33 Iter 159: loss 0.18750. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 33 Iter 159: loss 0.18750. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 33 Iter 160: loss 0.14924. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 33 Iter 160: loss 0.14924. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 33 Iter 161: loss 0.16967. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 33 Iter 161: loss 0.16967. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 33 Iter 162: loss 0.16242. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 33 Iter 162: loss 0.16242. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 33 Iter 163: loss 0.16161. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.05it/s]
Epoch 33 Iter 163: loss 0.16161. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 33 Iter 164: loss 0.15917. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 33 Iter 164: loss 0.15917. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 33 Iter 165: loss 0.16575. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 33 Iter 165: loss 0.16575. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 33 Iter 166: loss 0.18346. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 166: loss 0.18346. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 167: loss 0.15748. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 167: loss 0.15748. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 33 Iter 168: loss 0.15334. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 33 Iter 168: loss 0.15334. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 33 Iter 169: loss 0.16748. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 33 Iter 169: loss 0.16748. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 33 Iter 170: loss 0.16775. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 33 Iter 170: loss 0.16775. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 33 Iter 171: loss 0.19047. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 33 Iter 171: loss 0.19047. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 33 Iter 172: loss 0.15623. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 172: loss 0.15623. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.16193. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.16193. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 33 Iter 174: loss 0.15051. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 33 Iter 174: loss 0.15051. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 33 Iter 175: loss 0.15044. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 33 Iter 175: loss 0.15044. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 33 Iter 176: loss 0.16529. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 33 Iter 176: loss 0.16529. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 33 Iter 177: loss 0.16133. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 33 Iter 177: loss 0.16133. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 33 Iter 178: loss 0.15940. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 33 Iter 178: loss 0.15940. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 33 Iter 179: loss 0.16024. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 33 Iter 179: loss 0.16024. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 33 Iter 180: loss 0.17763. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 33 Iter 180: loss 0.17763. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 33 Iter 181: loss 0.16118. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 33 Iter 181: loss 0.16118. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 33 Iter 182: loss 0.16702. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 182: loss 0.16702. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 183: loss 0.19101. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 183: loss 0.19101. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 33 Iter 184: loss 0.18681. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 184: loss 0.18681. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 185: loss 0.17667. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 185: loss 0.17667. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 33 Iter 186: loss 0.15932. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 33 Iter 186: loss 0.15932. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 33 Iter 187: loss 0.15793. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 33 Iter 187: loss 0.15793. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 33 Iter 188: loss 0.15981. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 33 Iter 188: loss 0.15981. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 33 Iter 189: loss 0.15690. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 33 Iter 189: loss 0.15690. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 33 Iter 190: loss 0.15620. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 33 Iter 190: loss 0.15620. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 33 Iter 191: loss 0.17099. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 33 Iter 191: loss 0.17099. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 33 Iter 192: loss 0.14615. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.08it/s]
Epoch 33 Iter 192: loss 0.14615. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 33 Iter 193: loss 0.18481. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 33 Iter 193: loss 0.18481. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 33 Iter 194: loss 0.15812. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 33 Iter 194: loss 0.15812. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.16567. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.16567. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 196: loss 0.13787. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 33 Iter 196: loss 0.13787. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 33 Iter 197: loss 0.17021. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 33 Iter 197: loss 0.17021. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 33 Iter 198: loss 0.15770. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 33 Iter 198: loss 0.15770. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 33 Iter 199: loss 0.16348. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 199: loss 0.16348. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 200: loss 0.16130. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 200: loss 0.16130. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 33 Iter 201: loss 0.15946. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 201: loss 0.15946. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 202: loss 0.18068. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 202: loss 0.18068. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 33 Iter 203: loss 0.16597. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 203: loss 0.16597. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.17964. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.17964. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 33 Iter 205: loss 0.15832. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 205: loss 0.15832. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.15409. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.15409. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.16583. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.16583. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 208: loss 0.17509. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 208: loss 0.17509. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.17257. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.17257. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 33 Iter 210: loss 0.18440. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 33 Iter 210: loss 0.18440. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.16656. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.16656. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 212: loss 0.18246. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 212: loss 0.18246. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 33 Iter 213: loss 0.17056. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 33 Iter 213: loss 0.17056. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 33 Iter 214: loss 0.15354. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 33 Iter 214: loss 0.15354. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 33 Iter 215: loss 0.15141. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 33 Iter 215: loss 0.15141. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 33 Iter 216: loss 0.15777. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 33 Iter 216: loss 0.15777. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 33 Iter 217: loss 0.17588. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 217: loss 0.17588. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 33 Iter 218: loss 0.16899. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 33 Iter 218: loss 0.16899. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 33 Iter 219: loss 0.13799. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 33 Iter 219: loss 0.13799. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.17425. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.17425. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.16533. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.16533. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 222: loss 0.16785. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 222: loss 0.16785. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 33 Iter 223: loss 0.15205. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 33 Iter 223: loss 0.15205. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 33 Iter 224: loss 0.15779. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 33 Iter 224: loss 0.15779. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 33 Iter 224: loss 0.15779. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16404
    Valid loss: 0.17056
       Valid loss recons: 0.17056
       Valid loss KL-D:   98225.00053
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.16473. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.16473. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 34 Iter 2: loss 0.16578. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 34 Iter 2: loss 0.16578. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.15094. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.15094. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 34 Iter 4: loss 0.16481. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 34 Iter 4: loss 0.16481. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 34 Iter 5: loss 0.18459. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 34 Iter 5: loss 0.18459. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 34 Iter 6: loss 0.16151. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 34 Iter 6: loss 0.16151. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 34 Iter 7: loss 0.17308. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 7: loss 0.17308. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 8: loss 0.17224. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 8: loss 0.17224. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 34 Iter 9: loss 0.16962. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 34 Iter 9: loss 0.16962. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 34 Iter 10: loss 0.14855. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 34 Iter 10: loss 0.14855. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.14567. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.14567. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 34 Iter 12: loss 0.16646. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 34 Iter 12: loss 0.16646. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 34 Iter 13: loss 0.17737. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 34 Iter 13: loss 0.17737. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 34 Iter 14: loss 0.15345. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 34 Iter 14: loss 0.15345. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 34 Iter 15: loss 0.15266. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 34 Iter 15: loss 0.15266. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 34 Iter 16: loss 0.16703. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 34 Iter 16: loss 0.16703. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 34 Iter 17: loss 0.16829. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 34 Iter 17: loss 0.16829. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 34 Iter 18: loss 0.17827. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 34 Iter 18: loss 0.17827. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.03it/s]
Epoch 34 Iter 19: loss 0.18538. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.03it/s]
Epoch 34 Iter 19: loss 0.18538. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 34 Iter 20: loss 0.15320. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 34 Iter 20: loss 0.15320. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.15802. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.15802. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 34 Iter 22: loss 0.15359. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 34 Iter 22: loss 0.15359. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.04it/s]
Epoch 34 Iter 23: loss 0.18766. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 23: loss 0.18766. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 24: loss 0.17741. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 24: loss 0.17741. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 34 Iter 25: loss 0.13858. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 34 Iter 25: loss 0.13858. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 34 Iter 26: loss 0.16500. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 34 Iter 26: loss 0.16500. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 34 Iter 27: loss 0.15465. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 34 Iter 27: loss 0.15465. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 34 Iter 28: loss 0.15396. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 34 Iter 28: loss 0.15396. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 34 Iter 29: loss 0.13852. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 34 Iter 29: loss 0.13852. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 34 Iter 30: loss 0.17261. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 34 Iter 30: loss 0.17261. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 34 Iter 31: loss 0.16209. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 34 Iter 31: loss 0.16209. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 34 Iter 32: loss 0.16384. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 34 Iter 32: loss 0.16384. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 34 Iter 33: loss 0.16089. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 34 Iter 33: loss 0.16089. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 34 Iter 34: loss 0.18130. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 34 Iter 34: loss 0.18130. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.07it/s]
Epoch 34 Iter 35: loss 0.15907. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.07it/s]
Epoch 34 Iter 35: loss 0.15907. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 34 Iter 36: loss 0.16027. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 34 Iter 36: loss 0.16027. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 37: loss 0.15904. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 37: loss 0.15904. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 34 Iter 38: loss 0.16085. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 38: loss 0.16085. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 39: loss 0.15034. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 39: loss 0.15034. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.04it/s]
Epoch 34 Iter 40: loss 0.15055. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 34 Iter 40: loss 0.15055. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 34 Iter 41: loss 0.14220. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 34 Iter 41: loss 0.14220. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 34 Iter 42: loss 0.18672. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 34 Iter 42: loss 0.18672. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 34 Iter 43: loss 0.14409. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 34 Iter 43: loss 0.14409. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 34 Iter 44: loss 0.16141. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 34 Iter 44: loss 0.16141. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 34 Iter 45: loss 0.15791. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 34 Iter 45: loss 0.15791. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 34 Iter 46: loss 0.15262. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 34 Iter 46: loss 0.15262. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 34 Iter 47: loss 0.15038. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 34 Iter 47: loss 0.15038. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.17242. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.17242. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 34 Iter 49: loss 0.17579. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 34 Iter 49: loss 0.17579. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 34 Iter 50: loss 0.16127. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 34 Iter 50: loss 0.16127. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 34 Iter 51: loss 0.16102. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 34 Iter 51: loss 0.16102. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 34 Iter 52: loss 0.15526. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 52: loss 0.15526. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 53: loss 0.14790. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 53: loss 0.14790. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 54: loss 0.16452. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 34 Iter 54: loss 0.16452. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 34 Iter 55: loss 0.18620. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 34 Iter 55: loss 0.18620. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.06it/s]
Epoch 34 Iter 56: loss 0.16620. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.06it/s]
Epoch 34 Iter 56: loss 0.16620. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 34 Iter 57: loss 0.16929. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 34 Iter 57: loss 0.16929. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 34 Iter 58: loss 0.17694. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 34 Iter 58: loss 0.17694. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.15073. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.15073. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.19905. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.19905. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.16237. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.16237. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 34 Iter 62: loss 0.17562. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 34 Iter 62: loss 0.17562. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.16792. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.16792. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.14969. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.14969. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 65: loss 0.18448. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 65: loss 0.18448. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 66: loss 0.16732. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.08it/s]
Epoch 34 Iter 66: loss 0.16732. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 34 Iter 67: loss 0.15312. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 34 Iter 67: loss 0.15312. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 34 Iter 68: loss 0.17978. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 34 Iter 68: loss 0.17978. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 34 Iter 69: loss 0.16257. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 34 Iter 69: loss 0.16257. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 70: loss 0.18379. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 70: loss 0.18379. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.18768. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.18768. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 34 Iter 72: loss 0.14505. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 34 Iter 72: loss 0.14505. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.08it/s]
Epoch 34 Iter 73: loss 0.15691. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.08it/s]
Epoch 34 Iter 73: loss 0.15691. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 34 Iter 74: loss 0.18583. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 34 Iter 74: loss 0.18583. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 34 Iter 75: loss 0.17431. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 34 Iter 75: loss 0.17431. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 34 Iter 76: loss 0.18884. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 34 Iter 76: loss 0.18884. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 34 Iter 77: loss 0.15569. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 77: loss 0.15569. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 34 Iter 78: loss 0.16800. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 34 Iter 78: loss 0.16800. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 34 Iter 79: loss 0.16985. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 34 Iter 79: loss 0.16985. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 80: loss 0.14774. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 80: loss 0.14774. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.04it/s]
Epoch 34 Iter 81: loss 0.17134. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 34 Iter 81: loss 0.17134. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 34 Iter 82: loss 0.17084. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 34 Iter 82: loss 0.17084. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 34 Iter 83: loss 0.18926. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 34 Iter 83: loss 0.18926. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 34 Iter 84: loss 0.15729. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 34 Iter 84: loss 0.15729. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.15499. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.15499. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 34 Iter 86: loss 0.15904. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 34 Iter 86: loss 0.15904. :  38%|█████████████████▎                           | 86/224 [00:41<01:08,  2.03it/s]
Epoch 34 Iter 87: loss 0.13158. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.03it/s]
Epoch 34 Iter 87: loss 0.13158. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 34 Iter 88: loss 0.15356. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 34 Iter 88: loss 0.15356. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 34 Iter 89: loss 0.14892. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 34 Iter 89: loss 0.14892. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 34 Iter 90: loss 0.16737. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 34 Iter 90: loss 0.16737. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 34 Iter 91: loss 0.18159. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 34 Iter 91: loss 0.18159. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 34 Iter 92: loss 0.14662. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 34 Iter 92: loss 0.14662. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 34 Iter 93: loss 0.15292. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 34 Iter 93: loss 0.15292. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 34 Iter 94: loss 0.15046. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 34 Iter 94: loss 0.15046. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 34 Iter 95: loss 0.17226. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 34 Iter 95: loss 0.17226. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.05it/s]
Epoch 34 Iter 96: loss 0.17471. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.05it/s]
Epoch 34 Iter 96: loss 0.17471. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.15826. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.15826. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 34 Iter 98: loss 0.16940. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 34 Iter 98: loss 0.16940. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 34 Iter 99: loss 0.16521. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 34 Iter 99: loss 0.16521. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 34 Iter 100: loss 0.15217. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 34 Iter 100: loss 0.15217. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 34 Iter 101: loss 0.16873. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 34 Iter 101: loss 0.16873. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 102: loss 0.16419. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 102: loss 0.16419. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 103: loss 0.14392. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 34 Iter 103: loss 0.14392. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 34 Iter 104: loss 0.14162. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 34 Iter 104: loss 0.14162. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 34 Iter 105: loss 0.20206. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.05it/s]
Epoch 34 Iter 105: loss 0.20206. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.05it/s]
Epoch 34 Iter 106: loss 0.16435. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.05it/s]
Epoch 34 Iter 106: loss 0.16435. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 34 Iter 107: loss 0.16607. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 34 Iter 107: loss 0.16607. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 34 Iter 108: loss 0.15625. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 108: loss 0.15625. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 109: loss 0.15976. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 109: loss 0.15976. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 34 Iter 110: loss 0.16378. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 34 Iter 110: loss 0.16378. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.15634. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.15634. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 34 Iter 112: loss 0.17821. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 112: loss 0.17821. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 113: loss 0.17679. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 113: loss 0.17679. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 34 Iter 114: loss 0.16259. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 34 Iter 114: loss 0.16259. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 34 Iter 115: loss 0.17462. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 34 Iter 115: loss 0.17462. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 34 Iter 116: loss 0.15889. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 34 Iter 116: loss 0.15889. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 34 Iter 117: loss 0.19050. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 34 Iter 117: loss 0.19050. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 34 Iter 118: loss 0.18075. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 34 Iter 118: loss 0.18075. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 34 Iter 119: loss 0.16000. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 34 Iter 119: loss 0.16000. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 34 Iter 120: loss 0.15518. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 34 Iter 120: loss 0.15518. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 34 Iter 121: loss 0.17551. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 34 Iter 121: loss 0.17551. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 34 Iter 122: loss 0.17126. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 34 Iter 122: loss 0.17126. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 34 Iter 123: loss 0.16266. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 34 Iter 123: loss 0.16266. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 34 Iter 124: loss 0.16434. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 124: loss 0.16434. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 125: loss 0.15228. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 125: loss 0.15228. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 126: loss 0.16299. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 34 Iter 126: loss 0.16299. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 34 Iter 127: loss 0.14142. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 34 Iter 127: loss 0.14142. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 34 Iter 128: loss 0.18242. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 34 Iter 128: loss 0.18242. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 34 Iter 129: loss 0.16371. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 34 Iter 129: loss 0.16371. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 34 Iter 130: loss 0.16431. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 34 Iter 130: loss 0.16431. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.04it/s]
Epoch 34 Iter 131: loss 0.17730. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.04it/s]
Epoch 34 Iter 131: loss 0.17730. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 34 Iter 132: loss 0.16497. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 34 Iter 132: loss 0.16497. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 34 Iter 133: loss 0.15995. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 34 Iter 133: loss 0.15995. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.16461. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.16461. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 135: loss 0.15196. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 135: loss 0.15196. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.16547. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.16547. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.05it/s]
Epoch 34 Iter 137: loss 0.17119. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.05it/s]
Epoch 34 Iter 137: loss 0.17119. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 34 Iter 138: loss 0.15450. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.04it/s]
Epoch 34 Iter 138: loss 0.15450. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 34 Iter 139: loss 0.17175. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 34 Iter 139: loss 0.17175. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.04it/s]
Epoch 34 Iter 140: loss 0.17092. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.04it/s]
Epoch 34 Iter 140: loss 0.17092. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 34 Iter 141: loss 0.15551. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 34 Iter 141: loss 0.15551. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 34 Iter 142: loss 0.14637. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.05it/s]
Epoch 34 Iter 142: loss 0.14637. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.17591. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.17591. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.15540. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.15540. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 34 Iter 145: loss 0.16676. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 145: loss 0.16676. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.15716. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.15716. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 34 Iter 147: loss 0.15917. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 34 Iter 147: loss 0.15917. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.15859. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.15859. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.17245. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.17245. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 34 Iter 150: loss 0.17273. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 34 Iter 150: loss 0.17273. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.16042. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.16042. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.15633. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.15633. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 153: loss 0.18247. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 34 Iter 153: loss 0.18247. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 34 Iter 154: loss 0.16676. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 34 Iter 154: loss 0.16676. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 34 Iter 155: loss 0.16436. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 34 Iter 155: loss 0.16436. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 34 Iter 156: loss 0.17071. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 34 Iter 156: loss 0.17071. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 34 Iter 157: loss 0.14640. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.05it/s]
Epoch 34 Iter 157: loss 0.14640. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 158: loss 0.17428. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 158: loss 0.17428. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.14861. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.14861. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 34 Iter 160: loss 0.16124. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 34 Iter 160: loss 0.16124. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 34 Iter 161: loss 0.15513. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 34 Iter 161: loss 0.15513. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 34 Iter 162: loss 0.16852. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 34 Iter 162: loss 0.16852. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 34 Iter 163: loss 0.15718. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 34 Iter 163: loss 0.15718. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 34 Iter 164: loss 0.16581. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 34 Iter 164: loss 0.16581. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 34 Iter 165: loss 0.16448. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 34 Iter 165: loss 0.16448. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 34 Iter 166: loss 0.16708. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 34 Iter 166: loss 0.16708. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 34 Iter 167: loss 0.17275. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 34 Iter 167: loss 0.17275. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 34 Iter 168: loss 0.16869. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 34 Iter 168: loss 0.16869. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 34 Iter 169: loss 0.15186. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 34 Iter 169: loss 0.15186. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 34 Iter 170: loss 0.17403. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 34 Iter 170: loss 0.17403. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 34 Iter 171: loss 0.14264. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.07it/s]
Epoch 34 Iter 171: loss 0.14264. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 172: loss 0.15555. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 172: loss 0.15555. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.08it/s]
Epoch 34 Iter 173: loss 0.17481. :  77%|█████████████████████████████████          | 172/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 173: loss 0.17481. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.14266. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.14266. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.16235. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.16235. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.16643. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.16643. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.16617. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.16617. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.19514. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.19514. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 179: loss 0.15518. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 179: loss 0.15518. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 34 Iter 180: loss 0.16327. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 180: loss 0.16327. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.16294. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.16294. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.16066. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.16066. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 183: loss 0.16686. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 183: loss 0.16686. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.19776. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.19776. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.13315. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.13315. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.18074. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.18074. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.16954. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.16954. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 34 Iter 188: loss 0.13939. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 188: loss 0.13939. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.16064. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.16064. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.15628. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.15628. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 34 Iter 191: loss 0.17297. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 34 Iter 191: loss 0.17297. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 34 Iter 192: loss 0.15738. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 34 Iter 192: loss 0.15738. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 34 Iter 193: loss 0.14610. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 34 Iter 193: loss 0.14610. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.07it/s]
Epoch 34 Iter 194: loss 0.15809. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.07it/s]
Epoch 34 Iter 194: loss 0.15809. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 34 Iter 195: loss 0.17393. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 34 Iter 195: loss 0.17393. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 34 Iter 196: loss 0.17700. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 34 Iter 196: loss 0.17700. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 34 Iter 197: loss 0.17608. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 34 Iter 197: loss 0.17608. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 34 Iter 198: loss 0.16559. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 34 Iter 198: loss 0.16559. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 34 Iter 199: loss 0.17068. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 34 Iter 199: loss 0.17068. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 34 Iter 200: loss 0.15724. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.07it/s]
Epoch 34 Iter 200: loss 0.15724. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 34 Iter 201: loss 0.15763. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 34 Iter 201: loss 0.15763. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.16394. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.16394. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 203: loss 0.15925. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 203: loss 0.15925. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.15811. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.15811. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.17123. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.17123. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 34 Iter 206: loss 0.15645. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.08it/s]
Epoch 34 Iter 206: loss 0.15645. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 207: loss 0.15423. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 207: loss 0.15423. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 208: loss 0.14878. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 208: loss 0.14878. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.16285. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.16285. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.16285. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.16285. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.15895. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.15895. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.15626. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.15626. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.16384. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.16384. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 34 Iter 214: loss 0.16242. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 34 Iter 214: loss 0.16242. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.03it/s]
Epoch 34 Iter 215: loss 0.16436. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.03it/s]
Epoch 34 Iter 215: loss 0.16436. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 34 Iter 216: loss 0.15330. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 34 Iter 216: loss 0.15330. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 34 Iter 217: loss 0.17504. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.04it/s]
Epoch 34 Iter 217: loss 0.17504. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 34 Iter 218: loss 0.15319. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 34 Iter 218: loss 0.15319. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.03it/s]
Epoch 34 Iter 219: loss 0.15672. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.03it/s]
Epoch 34 Iter 219: loss 0.15672. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.03it/s]
Epoch 34 Iter 220: loss 0.16230. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.03it/s]
Epoch 34 Iter 220: loss 0.16230. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 34 Iter 221: loss 0.17845. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 34 Iter 221: loss 0.17845. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 34 Iter 222: loss 0.15496. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 34 Iter 222: loss 0.15496. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.17136. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.17136. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.16199. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.16199. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.16199. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.14719. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.14719. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 35 Iter 2: loss 0.17003. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 35 Iter 2: loss 0.17003. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 35 Iter 3: loss 0.16637. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 35 Iter 3: loss 0.16637. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.16933. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.16933. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.16897. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.16897. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 35 Iter 6: loss 0.16859. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 35 Iter 6: loss 0.16859. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 35 Iter 7: loss 0.16846. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 35 Iter 7: loss 0.16846. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 35 Iter 8: loss 0.16518. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 35 Iter 8: loss 0.16518. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 35 Iter 9: loss 0.16004. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 35 Iter 9: loss 0.16004. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 35 Iter 10: loss 0.15170. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 35 Iter 10: loss 0.15170. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 35 Iter 11: loss 0.16387. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 35 Iter 11: loss 0.16387. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 35 Iter 12: loss 0.15271. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 35 Iter 12: loss 0.15271. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 35 Iter 13: loss 0.17626. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 35 Iter 13: loss 0.17626. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 35 Iter 14: loss 0.14836. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 35 Iter 14: loss 0.14836. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 35 Iter 15: loss 0.16031. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 35 Iter 15: loss 0.16031. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 35 Iter 16: loss 0.17493. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 35 Iter 16: loss 0.17493. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 35 Iter 17: loss 0.14604. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 35 Iter 17: loss 0.14604. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 35 Iter 18: loss 0.15752. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 35 Iter 18: loss 0.15752. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 35 Iter 19: loss 0.17354. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 35 Iter 19: loss 0.17354. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 35 Iter 20: loss 0.18201. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 35 Iter 20: loss 0.18201. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 35 Iter 21: loss 0.15713. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 35 Iter 21: loss 0.15713. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 35 Iter 22: loss 0.18255. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 35 Iter 22: loss 0.18255. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 35 Iter 23: loss 0.16339. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 35 Iter 23: loss 0.16339. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 35 Iter 24: loss 0.16916. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 35 Iter 24: loss 0.16916. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 35 Iter 25: loss 0.16257. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 35 Iter 25: loss 0.16257. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 35 Iter 26: loss 0.16706. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 35 Iter 26: loss 0.16706. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 35 Iter 27: loss 0.15176. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 35 Iter 27: loss 0.15176. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 35 Iter 28: loss 0.16524. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 35 Iter 28: loss 0.16524. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 35 Iter 29: loss 0.15528. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 35 Iter 29: loss 0.15528. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 35 Iter 30: loss 0.17000. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 35 Iter 30: loss 0.17000. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 35 Iter 31: loss 0.16127. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 35 Iter 31: loss 0.16127. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 35 Iter 32: loss 0.16034. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 35 Iter 32: loss 0.16034. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 35 Iter 33: loss 0.17147. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 35 Iter 33: loss 0.17147. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.18748. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.18748. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 35 Iter 35: loss 0.16500. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 35 Iter 35: loss 0.16500. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 35 Iter 36: loss 0.17130. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 35 Iter 36: loss 0.17130. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 35 Iter 37: loss 0.14892. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 35 Iter 37: loss 0.14892. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 35 Iter 38: loss 0.16193. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 38: loss 0.16193. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 35 Iter 39: loss 0.17058. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 35 Iter 39: loss 0.17058. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 35 Iter 40: loss 0.16765. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 40: loss 0.16765. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.15631. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.15631. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.15809. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.15809. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 35 Iter 43: loss 0.17970. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 35 Iter 43: loss 0.17970. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 35 Iter 44: loss 0.17482. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 35 Iter 44: loss 0.17482. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 35 Iter 45: loss 0.14638. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 35 Iter 45: loss 0.14638. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 35 Iter 46: loss 0.16250. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 35 Iter 46: loss 0.16250. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 35 Iter 47: loss 0.14998. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 35 Iter 47: loss 0.14998. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 35 Iter 48: loss 0.17491. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 48: loss 0.17491. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 49: loss 0.17844. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 49: loss 0.17844. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 35 Iter 50: loss 0.17283. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 35 Iter 50: loss 0.17283. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 35 Iter 51: loss 0.15915. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 35 Iter 51: loss 0.15915. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 35 Iter 52: loss 0.16756. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 35 Iter 52: loss 0.16756. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 35 Iter 53: loss 0.18027. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 35 Iter 53: loss 0.18027. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 35 Iter 54: loss 0.17174. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 35 Iter 54: loss 0.17174. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 35 Iter 55: loss 0.17948. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 35 Iter 55: loss 0.17948. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 35 Iter 56: loss 0.15472. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 35 Iter 56: loss 0.15472. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 35 Iter 57: loss 0.16778. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 35 Iter 57: loss 0.16778. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 35 Iter 58: loss 0.16778. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 35 Iter 58: loss 0.16778. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.14781. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.14781. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 35 Iter 60: loss 0.18765. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 35 Iter 60: loss 0.18765. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 35 Iter 61: loss 0.17331. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 35 Iter 61: loss 0.17331. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.09it/s]
Epoch 35 Iter 62: loss 0.15274. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.09it/s]
Epoch 35 Iter 62: loss 0.15274. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 35 Iter 63: loss 0.16055. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 35 Iter 63: loss 0.16055. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 35 Iter 64: loss 0.17648. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 35 Iter 64: loss 0.17648. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.08it/s]
Epoch 35 Iter 65: loss 0.17817. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.08it/s]
Epoch 35 Iter 65: loss 0.17817. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 35 Iter 66: loss 0.15293. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 35 Iter 66: loss 0.15293. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 35 Iter 67: loss 0.17625. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 35 Iter 67: loss 0.17625. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.15315. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.15315. :  30%|█████████████▋                               | 68/224 [00:32<01:16,  2.05it/s]
Epoch 35 Iter 69: loss 0.17425. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 35 Iter 69: loss 0.17425. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 35 Iter 70: loss 0.16371. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 35 Iter 70: loss 0.16371. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.05it/s]
Epoch 35 Iter 71: loss 0.15875. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.05it/s]
Epoch 35 Iter 71: loss 0.15875. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 35 Iter 72: loss 0.14828. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 35 Iter 72: loss 0.14828. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.05it/s]
Epoch 35 Iter 73: loss 0.15531. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 35 Iter 73: loss 0.15531. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 35 Iter 74: loss 0.15257. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 35 Iter 74: loss 0.15257. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 35 Iter 75: loss 0.15962. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 75: loss 0.15962. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 76: loss 0.16722. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 76: loss 0.16722. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 35 Iter 77: loss 0.15786. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 77: loss 0.15786. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 35 Iter 78: loss 0.17143. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 35 Iter 78: loss 0.17143. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 35 Iter 79: loss 0.15369. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 35 Iter 79: loss 0.15369. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 35 Iter 80: loss 0.16765. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 35 Iter 80: loss 0.16765. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 35 Iter 81: loss 0.14017. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 35 Iter 81: loss 0.14017. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 35 Iter 82: loss 0.16519. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 35 Iter 82: loss 0.16519. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 35 Iter 83: loss 0.16612. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 35 Iter 83: loss 0.16612. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.15619. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.15619. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 35 Iter 85: loss 0.16614. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 35 Iter 85: loss 0.16614. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 35 Iter 86: loss 0.15038. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 35 Iter 86: loss 0.15038. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 35 Iter 87: loss 0.16642. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 87: loss 0.16642. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 88: loss 0.15508. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 88: loss 0.15508. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 35 Iter 89: loss 0.14965. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 35 Iter 89: loss 0.14965. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 35 Iter 90: loss 0.15501. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 35 Iter 90: loss 0.15501. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 35 Iter 91: loss 0.17385. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 35 Iter 91: loss 0.17385. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 35 Iter 92: loss 0.14557. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 35 Iter 92: loss 0.14557. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.15426. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.15426. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 94: loss 0.15678. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 94: loss 0.15678. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.09it/s]
Epoch 35 Iter 95: loss 0.16207. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.09it/s]
Epoch 35 Iter 95: loss 0.16207. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 35 Iter 96: loss 0.15629. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 35 Iter 96: loss 0.15629. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 35 Iter 97: loss 0.16942. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 35 Iter 97: loss 0.16942. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.07it/s]
Epoch 35 Iter 98: loss 0.16566. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 35 Iter 98: loss 0.16566. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 35 Iter 99: loss 0.16237. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 35 Iter 99: loss 0.16237. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 35 Iter 100: loss 0.16829. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 35 Iter 100: loss 0.16829. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 35 Iter 101: loss 0.15141. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 35 Iter 101: loss 0.15141. :  45%|███████████████████▍                       | 101/224 [00:48<01:00,  2.05it/s]
Epoch 35 Iter 102: loss 0.17037. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 35 Iter 102: loss 0.17037. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 35 Iter 103: loss 0.15846. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 35 Iter 103: loss 0.15846. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 35 Iter 104: loss 0.15383. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 104: loss 0.15383. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 105: loss 0.16006. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 105: loss 0.16006. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 35 Iter 106: loss 0.18564. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 106: loss 0.18564. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 107: loss 0.16533. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 107: loss 0.16533. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 35 Iter 108: loss 0.18154. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 35 Iter 108: loss 0.18154. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 35 Iter 109: loss 0.15738. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 35 Iter 109: loss 0.15738. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 35 Iter 110: loss 0.16674. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 35 Iter 110: loss 0.16674. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 35 Iter 111: loss 0.15770. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 35 Iter 111: loss 0.15770. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 35 Iter 112: loss 0.15987. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 112: loss 0.15987. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 113: loss 0.16549. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 113: loss 0.16549. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 35 Iter 114: loss 0.16391. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 114: loss 0.16391. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 115: loss 0.14841. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 115: loss 0.14841. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 35 Iter 116: loss 0.16588. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 35 Iter 116: loss 0.16588. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 35 Iter 117: loss 0.15680. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 35 Iter 117: loss 0.15680. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 35 Iter 118: loss 0.17745. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 35 Iter 118: loss 0.17745. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 35 Iter 119: loss 0.16540. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 35 Iter 119: loss 0.16540. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 35 Iter 120: loss 0.15883. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 35 Iter 120: loss 0.15883. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 121: loss 0.15122. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 121: loss 0.15122. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 122: loss 0.14862. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 35 Iter 122: loss 0.14862. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 35 Iter 123: loss 0.16999. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 35 Iter 123: loss 0.16999. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 35 Iter 124: loss 0.15231. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 35 Iter 124: loss 0.15231. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 125: loss 0.16723. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 125: loss 0.16723. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 126: loss 0.17367. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 35 Iter 126: loss 0.17367. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 35 Iter 127: loss 0.17971. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 35 Iter 127: loss 0.17971. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 35 Iter 128: loss 0.15611. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 35 Iter 128: loss 0.15611. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 35 Iter 129: loss 0.15477. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 35 Iter 129: loss 0.15477. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 35 Iter 130: loss 0.16475. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 35 Iter 130: loss 0.16475. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 35 Iter 131: loss 0.18437. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 35 Iter 131: loss 0.18437. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 35 Iter 132: loss 0.14847. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 35 Iter 132: loss 0.14847. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 35 Iter 133: loss 0.16385. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 35 Iter 133: loss 0.16385. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 35 Iter 134: loss 0.16377. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 35 Iter 134: loss 0.16377. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 35 Iter 135: loss 0.17241. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 35 Iter 135: loss 0.17241. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 35 Iter 136: loss 0.16163. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 35 Iter 136: loss 0.16163. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 35 Iter 137: loss 0.14003. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 35 Iter 137: loss 0.14003. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 35 Iter 138: loss 0.16459. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 35 Iter 138: loss 0.16459. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.15444. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.15444. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 35 Iter 140: loss 0.15140. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 35 Iter 140: loss 0.15140. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.05it/s]
Epoch 35 Iter 141: loss 0.16534. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 35 Iter 141: loss 0.16534. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 35 Iter 142: loss 0.16122. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 35 Iter 142: loss 0.16122. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.14925. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.14925. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 144: loss 0.16392. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 144: loss 0.16392. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.15527. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.15527. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 35 Iter 146: loss 0.15200. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 35 Iter 146: loss 0.15200. :  65%|████████████████████████████               | 146/224 [01:10<00:38,  2.05it/s]
Epoch 35 Iter 147: loss 0.15992. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.05it/s]
Epoch 35 Iter 147: loss 0.15992. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 35 Iter 148: loss 0.16842. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 35 Iter 148: loss 0.16842. :  66%|████████████████████████████▍              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 35 Iter 149: loss 0.14845. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 35 Iter 149: loss 0.14845. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 35 Iter 150: loss 0.15983. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 35 Iter 150: loss 0.15983. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 35 Iter 151: loss 0.15988. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 35 Iter 151: loss 0.15988. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.16686. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.16686. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 35 Iter 153: loss 0.18793. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 153: loss 0.18793. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 154: loss 0.15324. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 154: loss 0.15324. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 35 Iter 155: loss 0.16661. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 155: loss 0.16661. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 156: loss 0.16218. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 156: loss 0.16218. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.16725. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.16725. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.17613. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.17613. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.17842. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.17842. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 35 Iter 160: loss 0.15538. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 35 Iter 160: loss 0.15538. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 35 Iter 161: loss 0.15961. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 161: loss 0.15961. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 162: loss 0.15941. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 162: loss 0.15941. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 163: loss 0.17979. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 35 Iter 163: loss 0.17979. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 164: loss 0.18349. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 164: loss 0.18349. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.16363. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.16363. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 35 Iter 166: loss 0.14463. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 35 Iter 166: loss 0.14463. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 35 Iter 167: loss 0.14235. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 35 Iter 167: loss 0.14235. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.14853. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.14853. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 169: loss 0.15269. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 169: loss 0.15269. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 35 Iter 170: loss 0.15498. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 170: loss 0.15498. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.15873. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.15873. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.16037. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.16037. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 173: loss 0.15798. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 173: loss 0.15798. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 35 Iter 174: loss 0.18726. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 35 Iter 174: loss 0.18726. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 35 Iter 175: loss 0.15595. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 35 Iter 175: loss 0.15595. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 35 Iter 176: loss 0.18937. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 35 Iter 176: loss 0.18937. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.18245. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.18245. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.14075. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.14075. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 35 Iter 179: loss 0.19144. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 35 Iter 179: loss 0.19144. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 35 Iter 180: loss 0.15085. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 35 Iter 180: loss 0.15085. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 35 Iter 181: loss 0.15560. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 35 Iter 181: loss 0.15560. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 35 Iter 182: loss 0.15987. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 35 Iter 182: loss 0.15987. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 35 Iter 183: loss 0.15281. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 35 Iter 183: loss 0.15281. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 35 Iter 184: loss 0.16586. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 35 Iter 184: loss 0.16586. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 35 Iter 185: loss 0.18031. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 35 Iter 185: loss 0.18031. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 35 Iter 186: loss 0.17201. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 35 Iter 186: loss 0.17201. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 35 Iter 187: loss 0.16148. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 35 Iter 187: loss 0.16148. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 35 Iter 188: loss 0.17880. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 35 Iter 188: loss 0.17880. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 35 Iter 189: loss 0.16927. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 35 Iter 189: loss 0.16927. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 35 Iter 190: loss 0.15929. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 190: loss 0.15929. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 191: loss 0.16487. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 191: loss 0.16487. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 35 Iter 192: loss 0.15807. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 35 Iter 192: loss 0.15807. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 35 Iter 193: loss 0.18968. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 35 Iter 193: loss 0.18968. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.04it/s]
Epoch 35 Iter 194: loss 0.17573. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.04it/s]
Epoch 35 Iter 194: loss 0.17573. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 195: loss 0.17090. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 195: loss 0.17090. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 196: loss 0.18853. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 35 Iter 196: loss 0.18853. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.16705. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.16705. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.00it/s]
Epoch 35 Iter 198: loss 0.16338. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.00it/s]
Epoch 35 Iter 198: loss 0.16338. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.02it/s]
Epoch 35 Iter 199: loss 0.14811. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.02it/s]
Epoch 35 Iter 199: loss 0.14811. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.03it/s]
Epoch 35 Iter 200: loss 0.14914. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.03it/s]
Epoch 35 Iter 200: loss 0.14914. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.04it/s]
Epoch 35 Iter 201: loss 0.17666. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.04it/s]
Epoch 35 Iter 201: loss 0.17666. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.03it/s]
Epoch 35 Iter 202: loss 0.17264. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.03it/s]
Epoch 35 Iter 202: loss 0.17264. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 35 Iter 203: loss 0.16993. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 35 Iter 203: loss 0.16993. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 35 Iter 204: loss 0.14409. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.04it/s]
Epoch 35 Iter 204: loss 0.14409. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.04it/s]
Epoch 35 Iter 205: loss 0.16024. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.04it/s]
Epoch 35 Iter 205: loss 0.16024. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 35 Iter 206: loss 0.18256. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 35 Iter 206: loss 0.18256. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.04it/s]
Epoch 35 Iter 207: loss 0.16206. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 35 Iter 207: loss 0.16206. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 35 Iter 208: loss 0.16237. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 35 Iter 208: loss 0.16237. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 35 Iter 209: loss 0.16731. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 35 Iter 209: loss 0.16731. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 35 Iter 210: loss 0.15895. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 35 Iter 210: loss 0.15895. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 35 Iter 211: loss 0.15157. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 35 Iter 211: loss 0.15157. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 35 Iter 212: loss 0.15225. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 35 Iter 212: loss 0.15225. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 35 Iter 213: loss 0.15679. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 35 Iter 213: loss 0.15679. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 35 Iter 214: loss 0.17551. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 35 Iter 214: loss 0.17551. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 35 Iter 215: loss 0.14565. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 35 Iter 215: loss 0.14565. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 35 Iter 216: loss 0.19759. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 35 Iter 216: loss 0.19759. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.14683. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.14683. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 35 Iter 218: loss 0.18614. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 35 Iter 218: loss 0.18614. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 35 Iter 219: loss 0.17477. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 35 Iter 219: loss 0.17477. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 35 Iter 220: loss 0.15495. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 35 Iter 220: loss 0.15495. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 35 Iter 221: loss 0.15831. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 35 Iter 221: loss 0.15831. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 35 Iter 222: loss 0.16093. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 35 Iter 222: loss 0.16093. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 35 Iter 223: loss 0.15510. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 35 Iter 223: loss 0.15510. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 35 Iter 224: loss 0.15318. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 35 Iter 224: loss 0.15318. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 35 Iter 224: loss 0.15318. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16353
    Valid loss: 0.17032
       Valid loss recons: 0.17032
       Valid loss KL-D:   111927.51811
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.17181. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.17181. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 36 Iter 2: loss 0.16438. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 36 Iter 2: loss 0.16438. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 36 Iter 3: loss 0.17840. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 36 Iter 3: loss 0.17840. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 4: loss 0.15526. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 4: loss 0.15526. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 36 Iter 5: loss 0.15538. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 36 Iter 5: loss 0.15538. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.17174. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.17174. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 36 Iter 7: loss 0.16472. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 7: loss 0.16472. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 8: loss 0.17838. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 8: loss 0.17838. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 36 Iter 9: loss 0.15988. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 9: loss 0.15988. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.15527. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.15527. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 36 Iter 11: loss 0.18359. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 36 Iter 11: loss 0.18359. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 12: loss 0.15075. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 12: loss 0.15075. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 36 Iter 13: loss 0.18940. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 13: loss 0.18940. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 14: loss 0.16021. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 14: loss 0.16021. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 15: loss 0.13617. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.06it/s]
Epoch 36 Iter 15: loss 0.13617. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 36 Iter 16: loss 0.16013. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 36 Iter 16: loss 0.16013. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 17: loss 0.17378. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 36 Iter 17: loss 0.17378. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 36 Iter 18: loss 0.16788. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 36 Iter 18: loss 0.16788. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.16422. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.16422. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.15498. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.15498. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.16904. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.16904. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 36 Iter 22: loss 0.15766. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 36 Iter 22: loss 0.15766. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 36 Iter 23: loss 0.15004. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 36 Iter 23: loss 0.15004. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 36 Iter 24: loss 0.16838. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 36 Iter 24: loss 0.16838. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 36 Iter 25: loss 0.15050. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 25: loss 0.15050. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 26: loss 0.17554. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 26: loss 0.17554. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 36 Iter 27: loss 0.16695. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 36 Iter 27: loss 0.16695. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.16621. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.16621. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 29: loss 0.17078. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 36 Iter 29: loss 0.17078. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 36 Iter 30: loss 0.16398. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 36 Iter 30: loss 0.16398. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 36 Iter 31: loss 0.17041. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 36 Iter 31: loss 0.17041. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 36 Iter 32: loss 0.15161. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 36 Iter 32: loss 0.15161. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 36 Iter 33: loss 0.14641. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 36 Iter 33: loss 0.14641. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 36 Iter 34: loss 0.14036. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 36 Iter 34: loss 0.14036. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 36 Iter 35: loss 0.15585. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 36 Iter 35: loss 0.15585. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 36 Iter 36: loss 0.15324. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 36 Iter 36: loss 0.15324. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 36 Iter 37: loss 0.19155. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 36 Iter 37: loss 0.19155. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 36 Iter 38: loss 0.17806. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 36 Iter 38: loss 0.17806. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 36 Iter 39: loss 0.15557. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 36 Iter 39: loss 0.15557. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 36 Iter 40: loss 0.14025. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 36 Iter 40: loss 0.14025. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 36 Iter 41: loss 0.16044. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 36 Iter 41: loss 0.16044. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 36 Iter 42: loss 0.15712. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 36 Iter 42: loss 0.15712. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 43: loss 0.16683. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 43: loss 0.16683. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 36 Iter 44: loss 0.16398. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 36 Iter 44: loss 0.16398. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 36 Iter 45: loss 0.16476. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 36 Iter 45: loss 0.16476. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 36 Iter 46: loss 0.15705. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 36 Iter 46: loss 0.15705. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 36 Iter 47: loss 0.16366. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 36 Iter 47: loss 0.16366. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 36 Iter 48: loss 0.16531. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 36 Iter 48: loss 0.16531. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 36 Iter 49: loss 0.16554. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 36 Iter 49: loss 0.16554. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 36 Iter 50: loss 0.16116. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 36 Iter 50: loss 0.16116. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 36 Iter 51: loss 0.15456. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 36 Iter 51: loss 0.15456. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 36 Iter 52: loss 0.14722. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 36 Iter 52: loss 0.14722. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 36 Iter 53: loss 0.17912. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 36 Iter 53: loss 0.17912. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 36 Iter 54: loss 0.15821. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 36 Iter 54: loss 0.15821. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 36 Iter 55: loss 0.17845. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 36 Iter 55: loss 0.17845. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 36 Iter 56: loss 0.16771. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 36 Iter 56: loss 0.16771. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 36 Iter 57: loss 0.18118. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 36 Iter 57: loss 0.18118. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 36 Iter 58: loss 0.17487. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 36 Iter 58: loss 0.17487. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 36 Iter 59: loss 0.15617. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 36 Iter 59: loss 0.15617. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 36 Iter 60: loss 0.14432. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 36 Iter 60: loss 0.14432. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 61: loss 0.16842. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 61: loss 0.16842. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 62: loss 0.15694. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 36 Iter 62: loss 0.15694. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.08it/s]
Epoch 36 Iter 63: loss 0.16595. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.08it/s]
Epoch 36 Iter 63: loss 0.16595. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 36 Iter 64: loss 0.16428. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 36 Iter 64: loss 0.16428. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 36 Iter 65: loss 0.15237. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 36 Iter 65: loss 0.15237. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 36 Iter 66: loss 0.17487. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 36 Iter 66: loss 0.17487. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 36 Iter 67: loss 0.16718. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 36 Iter 67: loss 0.16718. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 36 Iter 68: loss 0.16709. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 36 Iter 68: loss 0.16709. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 36 Iter 69: loss 0.19007. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 36 Iter 69: loss 0.19007. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 36 Iter 70: loss 0.15369. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 36 Iter 70: loss 0.15369. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.05it/s]
Epoch 36 Iter 71: loss 0.16021. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.05it/s]
Epoch 36 Iter 71: loss 0.16021. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 36 Iter 72: loss 0.14848. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 36 Iter 72: loss 0.14848. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 36 Iter 73: loss 0.16286. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 36 Iter 73: loss 0.16286. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 36 Iter 74: loss 0.16619. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 36 Iter 74: loss 0.16619. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 36 Iter 75: loss 0.14786. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 36 Iter 75: loss 0.14786. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 36 Iter 76: loss 0.17522. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 36 Iter 76: loss 0.17522. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 36 Iter 77: loss 0.16901. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 36 Iter 77: loss 0.16901. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 36 Iter 78: loss 0.15716. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 36 Iter 78: loss 0.15716. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 36 Iter 79: loss 0.16591. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 36 Iter 79: loss 0.16591. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 36 Iter 80: loss 0.15965. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 36 Iter 80: loss 0.15965. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 36 Iter 81: loss 0.17556. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 36 Iter 81: loss 0.17556. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 36 Iter 82: loss 0.15023. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 36 Iter 82: loss 0.15023. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 36 Iter 83: loss 0.18527. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 36 Iter 83: loss 0.18527. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 36 Iter 84: loss 0.18073. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 36 Iter 84: loss 0.18073. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 36 Iter 85: loss 0.16948. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 36 Iter 85: loss 0.16948. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.16130. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.16130. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 87: loss 0.16048. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 36 Iter 87: loss 0.16048. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 36 Iter 88: loss 0.14161. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 36 Iter 88: loss 0.14161. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 36 Iter 89: loss 0.17552. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 36 Iter 89: loss 0.17552. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 36 Iter 90: loss 0.17184. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 36 Iter 90: loss 0.17184. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 36 Iter 91: loss 0.16109. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 36 Iter 91: loss 0.16109. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 36 Iter 92: loss 0.17495. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 36 Iter 92: loss 0.17495. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 36 Iter 93: loss 0.18330. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 36 Iter 93: loss 0.18330. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 36 Iter 94: loss 0.16175. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 36 Iter 94: loss 0.16175. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 36 Iter 95: loss 0.16192. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 36 Iter 95: loss 0.16192. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 36 Iter 96: loss 0.18487. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 36 Iter 96: loss 0.18487. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 36 Iter 97: loss 0.18068. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 36 Iter 97: loss 0.18068. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 98: loss 0.14976. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 98: loss 0.14976. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 36 Iter 99: loss 0.15554. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 36 Iter 99: loss 0.15554. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 36 Iter 100: loss 0.17683. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 36 Iter 100: loss 0.17683. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 36 Iter 101: loss 0.15984. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.07it/s]
Epoch 36 Iter 101: loss 0.15984. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 102: loss 0.17549. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 102: loss 0.17549. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.15327. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.15327. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 36 Iter 104: loss 0.16916. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 104: loss 0.16916. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 105: loss 0.14119. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 105: loss 0.14119. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 36 Iter 106: loss 0.17299. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 36 Iter 106: loss 0.17299. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 36 Iter 107: loss 0.14616. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 36 Iter 107: loss 0.14616. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 36 Iter 108: loss 0.14575. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 36 Iter 108: loss 0.14575. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 109: loss 0.15691. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 109: loss 0.15691. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 110: loss 0.17669. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 36 Iter 110: loss 0.17669. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 36 Iter 111: loss 0.17110. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 36 Iter 111: loss 0.17110. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 36 Iter 112: loss 0.17274. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 112: loss 0.17274. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 113: loss 0.16516. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 113: loss 0.16516. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 36 Iter 114: loss 0.15325. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 36 Iter 114: loss 0.15325. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 36 Iter 115: loss 0.16741. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 36 Iter 115: loss 0.16741. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 36 Iter 116: loss 0.17567. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 36 Iter 116: loss 0.17567. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 36 Iter 117: loss 0.15472. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 36 Iter 117: loss 0.15472. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 36 Iter 118: loss 0.15957. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 36 Iter 118: loss 0.15957. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 119: loss 0.15173. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 119: loss 0.15173. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 36 Iter 120: loss 0.16324. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 36 Iter 120: loss 0.16324. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 36 Iter 121: loss 0.16961. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 36 Iter 121: loss 0.16961. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 36 Iter 122: loss 0.15103. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 122: loss 0.15103. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 123: loss 0.19075. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 123: loss 0.19075. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 36 Iter 124: loss 0.17698. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 36 Iter 124: loss 0.17698. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.04it/s]
Epoch 36 Iter 125: loss 0.17011. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.04it/s]
Epoch 36 Iter 125: loss 0.17011. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.04it/s]
Epoch 36 Iter 126: loss 0.17316. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.04it/s]
Epoch 36 Iter 126: loss 0.17316. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 36 Iter 127: loss 0.16999. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 36 Iter 127: loss 0.16999. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 36 Iter 128: loss 0.17231. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 36 Iter 128: loss 0.17231. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 36 Iter 129: loss 0.17494. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 36 Iter 129: loss 0.17494. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.16322. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.16322. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 36 Iter 131: loss 0.16775. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 36 Iter 131: loss 0.16775. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 36 Iter 132: loss 0.15728. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 36 Iter 132: loss 0.15728. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 36 Iter 133: loss 0.15381. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 36 Iter 133: loss 0.15381. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.03it/s]
Epoch 36 Iter 134: loss 0.19264. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.03it/s]
Epoch 36 Iter 134: loss 0.19264. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.04it/s]
Epoch 36 Iter 135: loss 0.17588. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.04it/s]
Epoch 36 Iter 135: loss 0.17588. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.04it/s]
Epoch 36 Iter 136: loss 0.15688. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.04it/s]
Epoch 36 Iter 136: loss 0.15688. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 36 Iter 137: loss 0.17313. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 36 Iter 137: loss 0.17313. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 36 Iter 138: loss 0.16936. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 36 Iter 138: loss 0.16936. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.02it/s]
Epoch 36 Iter 139: loss 0.18636. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.02it/s]
Epoch 36 Iter 139: loss 0.18636. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.03it/s]
Epoch 36 Iter 140: loss 0.15359. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.03it/s]
Epoch 36 Iter 140: loss 0.15359. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 36 Iter 141: loss 0.16011. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 141: loss 0.16011. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 36 Iter 142: loss 0.15786. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 36 Iter 142: loss 0.15786. :  63%|███████████████████████████▎               | 142/224 [01:08<00:40,  2.04it/s]
Epoch 36 Iter 143: loss 0.16330. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.04it/s]
Epoch 36 Iter 143: loss 0.16330. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 36 Iter 144: loss 0.15732. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 36 Iter 144: loss 0.15732. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.09it/s]
Epoch 36 Iter 145: loss 0.18698. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.09it/s]
Epoch 36 Iter 145: loss 0.18698. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 36 Iter 146: loss 0.17623. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 36 Iter 146: loss 0.17623. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 36 Iter 147: loss 0.14529. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 36 Iter 147: loss 0.14529. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 36 Iter 148: loss 0.17039. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 36 Iter 148: loss 0.17039. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 36 Iter 149: loss 0.15601. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 36 Iter 149: loss 0.15601. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 36 Iter 150: loss 0.14981. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 36 Iter 150: loss 0.14981. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 36 Iter 151: loss 0.17121. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 36 Iter 151: loss 0.17121. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 36 Iter 152: loss 0.12102. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 36 Iter 152: loss 0.12102. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 36 Iter 153: loss 0.18680. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 36 Iter 153: loss 0.18680. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 36 Iter 154: loss 0.15444. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 36 Iter 154: loss 0.15444. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 36 Iter 155: loss 0.16211. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 36 Iter 155: loss 0.16211. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 36 Iter 156: loss 0.14972. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 36 Iter 156: loss 0.14972. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 36 Iter 157: loss 0.15252. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 36 Iter 157: loss 0.15252. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 36 Iter 158: loss 0.16675. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 36 Iter 158: loss 0.16675. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 36 Iter 159: loss 0.17345. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 36 Iter 159: loss 0.17345. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 36 Iter 160: loss 0.15401. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 36 Iter 160: loss 0.15401. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 36 Iter 161: loss 0.16433. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 36 Iter 161: loss 0.16433. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.03it/s]
Epoch 36 Iter 162: loss 0.13477. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.03it/s]
Epoch 36 Iter 162: loss 0.13477. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.03it/s]
Epoch 36 Iter 163: loss 0.16727. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.03it/s]
Epoch 36 Iter 163: loss 0.16727. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:30,  2.03it/s]
Epoch 36 Iter 164: loss 0.15608. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:30,  2.03it/s]
Epoch 36 Iter 164: loss 0.15608. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.03it/s]
Epoch 36 Iter 165: loss 0.17247. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.03it/s]
Epoch 36 Iter 165: loss 0.17247. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 36 Iter 166: loss 0.16096. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 36 Iter 166: loss 0.16096. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 36 Iter 167: loss 0.15922. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.04it/s]
Epoch 36 Iter 167: loss 0.15922. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.04it/s]
Epoch 36 Iter 168: loss 0.14870. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.04it/s]
Epoch 36 Iter 168: loss 0.14870. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 36 Iter 169: loss 0.17232. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.04it/s]
Epoch 36 Iter 169: loss 0.17232. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 36 Iter 170: loss 0.17111. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 36 Iter 170: loss 0.17111. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 36 Iter 171: loss 0.15137. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 36 Iter 171: loss 0.15137. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 36 Iter 172: loss 0.17467. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 36 Iter 172: loss 0.17467. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 36 Iter 173: loss 0.16348. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.05it/s]
Epoch 36 Iter 173: loss 0.16348. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 36 Iter 174: loss 0.17524. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 36 Iter 174: loss 0.17524. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 36 Iter 175: loss 0.15321. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 36 Iter 175: loss 0.15321. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 36 Iter 176: loss 0.16544. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 36 Iter 176: loss 0.16544. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 36 Iter 177: loss 0.17050. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 36 Iter 177: loss 0.17050. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 36 Iter 178: loss 0.16545. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 36 Iter 178: loss 0.16545. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 36 Iter 179: loss 0.14745. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 36 Iter 179: loss 0.14745. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 36 Iter 180: loss 0.16433. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 36 Iter 180: loss 0.16433. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 36 Iter 181: loss 0.16736. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 36 Iter 181: loss 0.16736. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 36 Iter 182: loss 0.17105. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 36 Iter 182: loss 0.17105. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 36 Iter 183: loss 0.17665. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 36 Iter 183: loss 0.17665. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 36 Iter 184: loss 0.16477. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 36 Iter 184: loss 0.16477. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 36 Iter 185: loss 0.17016. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 36 Iter 185: loss 0.17016. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 36 Iter 186: loss 0.16077. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 36 Iter 186: loss 0.16077. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 36 Iter 187: loss 0.15881. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 36 Iter 187: loss 0.15881. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 36 Iter 188: loss 0.18386. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 188: loss 0.18386. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 189: loss 0.15855. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 189: loss 0.15855. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 36 Iter 190: loss 0.17328. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 36 Iter 190: loss 0.17328. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 36 Iter 191: loss 0.16004. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 36 Iter 191: loss 0.16004. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 36 Iter 192: loss 0.15106. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 36 Iter 192: loss 0.15106. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 36 Iter 193: loss 0.17108. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 36 Iter 193: loss 0.17108. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 36 Iter 194: loss 0.17834. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 36 Iter 194: loss 0.17834. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 36 Iter 195: loss 0.15273. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 36 Iter 195: loss 0.15273. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 36 Iter 196: loss 0.12418. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 36 Iter 196: loss 0.12418. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 36 Iter 197: loss 0.15982. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 36 Iter 197: loss 0.15982. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 36 Iter 198: loss 0.15949. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 36 Iter 198: loss 0.15949. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 36 Iter 199: loss 0.16497. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 36 Iter 199: loss 0.16497. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 36 Iter 200: loss 0.14172. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 36 Iter 200: loss 0.14172. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 36 Iter 201: loss 0.17495. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 36 Iter 201: loss 0.17495. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 36 Iter 202: loss 0.15982. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 36 Iter 202: loss 0.15982. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 36 Iter 203: loss 0.15379. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 36 Iter 203: loss 0.15379. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 36 Iter 204: loss 0.17599. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 36 Iter 204: loss 0.17599. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 36 Iter 205: loss 0.13397. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 36 Iter 205: loss 0.13397. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 36 Iter 206: loss 0.16186. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.05it/s]
Epoch 36 Iter 206: loss 0.16186. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 36 Iter 207: loss 0.15890. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 36 Iter 207: loss 0.15890. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 36 Iter 208: loss 0.18287. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 36 Iter 208: loss 0.18287. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 36 Iter 209: loss 0.15373. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 36 Iter 209: loss 0.15373. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 36 Iter 210: loss 0.16796. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 36 Iter 210: loss 0.16796. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 36 Iter 211: loss 0.16418. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 36 Iter 211: loss 0.16418. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 36 Iter 212: loss 0.17006. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 36 Iter 212: loss 0.17006. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 213: loss 0.16379. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 213: loss 0.16379. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 214: loss 0.17398. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 36 Iter 214: loss 0.17398. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 36 Iter 215: loss 0.15493. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 36 Iter 215: loss 0.15493. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 36 Iter 216: loss 0.15518. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 36 Iter 216: loss 0.15518. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 36 Iter 217: loss 0.16843. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.04it/s]
Epoch 36 Iter 217: loss 0.16843. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 36 Iter 218: loss 0.14926. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 36 Iter 218: loss 0.14926. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.03it/s]
Epoch 36 Iter 219: loss 0.15405. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.03it/s]
Epoch 36 Iter 219: loss 0.15405. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 36 Iter 220: loss 0.14448. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 36 Iter 220: loss 0.14448. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.04it/s]
Epoch 36 Iter 221: loss 0.17411. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.04it/s]
Epoch 36 Iter 221: loss 0.17411. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.03it/s]
Epoch 36 Iter 222: loss 0.14198. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.03it/s]
Epoch 36 Iter 222: loss 0.14198. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.04it/s]
Epoch 36 Iter 223: loss 0.17477. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.04it/s]
Epoch 36 Iter 223: loss 0.17477. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 36 Iter 224: loss 0.16991. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 36 Iter 224: loss 0.16991. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 36 Iter 224: loss 0.16991. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.17552. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.17552. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 37 Iter 2: loss 0.14976. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 37 Iter 2: loss 0.14976. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.16248. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.16248. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 37 Iter 4: loss 0.14572. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 37 Iter 4: loss 0.14572. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 37 Iter 5: loss 0.16027. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 37 Iter 5: loss 0.16027. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.14784. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.14784. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 7: loss 0.16306. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.06it/s]
Epoch 37 Iter 7: loss 0.16306. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 8: loss 0.14530. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 8: loss 0.14530. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 37 Iter 9: loss 0.18985. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 37 Iter 9: loss 0.18985. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 37 Iter 10: loss 0.16560. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 37 Iter 10: loss 0.16560. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 37 Iter 11: loss 0.15873. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 37 Iter 11: loss 0.15873. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 37 Iter 12: loss 0.17399. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 37 Iter 12: loss 0.17399. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 37 Iter 13: loss 0.19633. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 37 Iter 13: loss 0.19633. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 37 Iter 14: loss 0.16845. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 37 Iter 14: loss 0.16845. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 37 Iter 15: loss 0.16347. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 37 Iter 15: loss 0.16347. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 37 Iter 16: loss 0.17642. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 37 Iter 16: loss 0.17642. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 37 Iter 17: loss 0.15408. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 37 Iter 17: loss 0.15408. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 37 Iter 18: loss 0.17473. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 37 Iter 18: loss 0.17473. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 37 Iter 19: loss 0.19679. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 37 Iter 19: loss 0.19679. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 37 Iter 20: loss 0.15497. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 37 Iter 20: loss 0.15497. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 37 Iter 21: loss 0.16663. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 37 Iter 21: loss 0.16663. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 37 Iter 22: loss 0.16313. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 37 Iter 22: loss 0.16313. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.04it/s]
Epoch 37 Iter 23: loss 0.15915. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.04it/s]
Epoch 37 Iter 23: loss 0.15915. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 37 Iter 24: loss 0.13743. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 37 Iter 24: loss 0.13743. :  11%|████▊                                        | 24/224 [00:11<01:38,  2.04it/s]
Epoch 37 Iter 25: loss 0.17035. :  11%|████▊                                        | 24/224 [00:12<01:38,  2.04it/s]
Epoch 37 Iter 25: loss 0.17035. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 37 Iter 26: loss 0.16080. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 37 Iter 26: loss 0.16080. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 37 Iter 27: loss 0.16917. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 37 Iter 27: loss 0.16917. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 37 Iter 28: loss 0.15178. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 37 Iter 28: loss 0.15178. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 37 Iter 29: loss 0.15389. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 37 Iter 29: loss 0.15389. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 37 Iter 30: loss 0.15652. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 37 Iter 30: loss 0.15652. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 37 Iter 31: loss 0.17467. :  13%|██████                                       | 30/224 [00:15<01:33,  2.08it/s]
Epoch 37 Iter 31: loss 0.17467. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 37 Iter 32: loss 0.15072. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 37 Iter 32: loss 0.15072. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 37 Iter 33: loss 0.15768. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.08it/s]
Epoch 37 Iter 33: loss 0.15768. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 37 Iter 34: loss 0.15490. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 37 Iter 34: loss 0.15490. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 37 Iter 35: loss 0.17047. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 37 Iter 35: loss 0.17047. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 37 Iter 36: loss 0.15749. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 37 Iter 36: loss 0.15749. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 37 Iter 37: loss 0.16806. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 37 Iter 37: loss 0.16806. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 37 Iter 38: loss 0.15640. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 38: loss 0.15640. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 39: loss 0.16759. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 39: loss 0.16759. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.05it/s]
Epoch 37 Iter 40: loss 0.15967. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 37 Iter 40: loss 0.15967. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 37 Iter 41: loss 0.14396. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 37 Iter 41: loss 0.14396. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 37 Iter 42: loss 0.18196. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 37 Iter 42: loss 0.18196. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 37 Iter 43: loss 0.17027. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 37 Iter 43: loss 0.17027. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 37 Iter 44: loss 0.15955. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 37 Iter 44: loss 0.15955. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 37 Iter 45: loss 0.18193. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 37 Iter 45: loss 0.18193. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 37 Iter 46: loss 0.18090. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 37 Iter 46: loss 0.18090. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 37 Iter 47: loss 0.14283. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 37 Iter 47: loss 0.14283. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 37 Iter 48: loss 0.16362. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 37 Iter 48: loss 0.16362. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 37 Iter 49: loss 0.15203. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 37 Iter 49: loss 0.15203. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 37 Iter 50: loss 0.17011. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 37 Iter 50: loss 0.17011. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 51: loss 0.17291. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 51: loss 0.17291. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 52: loss 0.14924. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 52: loss 0.14924. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 37 Iter 53: loss 0.17085. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 37 Iter 53: loss 0.17085. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 37 Iter 54: loss 0.16587. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 37 Iter 54: loss 0.16587. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 37 Iter 55: loss 0.17321. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 37 Iter 55: loss 0.17321. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 37 Iter 56: loss 0.16945. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 37 Iter 56: loss 0.16945. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 37 Iter 57: loss 0.16807. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 37 Iter 57: loss 0.16807. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 37 Iter 58: loss 0.18041. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 37 Iter 58: loss 0.18041. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 37 Iter 59: loss 0.16250. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 37 Iter 59: loss 0.16250. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 37 Iter 60: loss 0.14870. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 37 Iter 60: loss 0.14870. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 37 Iter 61: loss 0.14197. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 37 Iter 61: loss 0.14197. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 37 Iter 62: loss 0.16050. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 37 Iter 62: loss 0.16050. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 37 Iter 63: loss 0.16040. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 37 Iter 63: loss 0.16040. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 37 Iter 64: loss 0.15697. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 37 Iter 64: loss 0.15697. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 37 Iter 65: loss 0.15692. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 37 Iter 65: loss 0.15692. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 37 Iter 66: loss 0.15506. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 37 Iter 66: loss 0.15506. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 37 Iter 67: loss 0.13513. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 37 Iter 67: loss 0.13513. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 37 Iter 68: loss 0.20148. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 37 Iter 68: loss 0.20148. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 37 Iter 69: loss 0.17469. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 37 Iter 69: loss 0.17469. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 37 Iter 70: loss 0.16942. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 37 Iter 70: loss 0.16942. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 37 Iter 71: loss 0.14967. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 37 Iter 71: loss 0.14967. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 37 Iter 72: loss 0.14123. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 37 Iter 72: loss 0.14123. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 37 Iter 73: loss 0.15395. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 37 Iter 73: loss 0.15395. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 37 Iter 74: loss 0.17163. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 37 Iter 74: loss 0.17163. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 37 Iter 75: loss 0.17636. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 37 Iter 75: loss 0.17636. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 37 Iter 76: loss 0.17577. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 37 Iter 76: loss 0.17577. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 37 Iter 77: loss 0.15765. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 37 Iter 77: loss 0.15765. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 37 Iter 78: loss 0.16868. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 37 Iter 78: loss 0.16868. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 37 Iter 79: loss 0.16616. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 37 Iter 79: loss 0.16616. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 37 Iter 80: loss 0.16151. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 37 Iter 80: loss 0.16151. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 37 Iter 81: loss 0.17433. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 37 Iter 81: loss 0.17433. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 37 Iter 82: loss 0.16059. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 37 Iter 82: loss 0.16059. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 37 Iter 83: loss 0.15655. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 37 Iter 83: loss 0.15655. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 37 Iter 84: loss 0.17212. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 37 Iter 84: loss 0.17212. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.04it/s]
Epoch 37 Iter 85: loss 0.17002. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 37 Iter 85: loss 0.17002. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 37 Iter 86: loss 0.16441. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 37 Iter 86: loss 0.16441. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 37 Iter 87: loss 0.18843. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 37 Iter 87: loss 0.18843. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 37 Iter 88: loss 0.16988. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 37 Iter 88: loss 0.16988. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 37 Iter 89: loss 0.17280. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 37 Iter 89: loss 0.17280. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 37 Iter 90: loss 0.15791. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 37 Iter 90: loss 0.15791. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 37 Iter 91: loss 0.16502. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 91: loss 0.16502. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 92: loss 0.16226. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 92: loss 0.16226. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.16559. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.16559. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 94: loss 0.17377. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 94: loss 0.17377. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 37 Iter 95: loss 0.15003. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.08it/s]
Epoch 37 Iter 95: loss 0.15003. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 37 Iter 96: loss 0.18082. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 37 Iter 96: loss 0.18082. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 37 Iter 97: loss 0.15977. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 37 Iter 97: loss 0.15977. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 37 Iter 98: loss 0.15195. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 37 Iter 98: loss 0.15195. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 37 Iter 99: loss 0.15565. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 37 Iter 99: loss 0.15565. :  44%|███████████████████▉                         | 99/224 [00:48<00:59,  2.09it/s]
Epoch 37 Iter 100: loss 0.15800. :  44%|███████████████████▍                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 37 Iter 100: loss 0.15800. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 37 Iter 101: loss 0.14055. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.09it/s]
Epoch 37 Iter 101: loss 0.14055. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 37 Iter 102: loss 0.17165. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 37 Iter 102: loss 0.17165. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 37 Iter 103: loss 0.15951. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 37 Iter 103: loss 0.15951. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 37 Iter 104: loss 0.16336. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 37 Iter 104: loss 0.16336. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.10it/s]
Epoch 37 Iter 105: loss 0.17240. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.10it/s]
Epoch 37 Iter 105: loss 0.17240. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 37 Iter 106: loss 0.15920. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 37 Iter 106: loss 0.15920. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 37 Iter 107: loss 0.16264. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 37 Iter 107: loss 0.16264. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.09it/s]
Epoch 37 Iter 108: loss 0.15680. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 37 Iter 108: loss 0.15680. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 37 Iter 109: loss 0.16591. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 37 Iter 109: loss 0.16591. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 37 Iter 110: loss 0.16057. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 37 Iter 110: loss 0.16057. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 37 Iter 111: loss 0.15190. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 37 Iter 111: loss 0.15190. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 37 Iter 112: loss 0.17977. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 37 Iter 112: loss 0.17977. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.15980. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.15980. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.15012. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.15012. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 37 Iter 115: loss 0.17245. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 37 Iter 115: loss 0.17245. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 37 Iter 116: loss 0.16090. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.08it/s]
Epoch 37 Iter 116: loss 0.16090. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 37 Iter 117: loss 0.15781. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 37 Iter 117: loss 0.15781. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 37 Iter 118: loss 0.15457. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 37 Iter 118: loss 0.15457. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 37 Iter 119: loss 0.14804. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 37 Iter 119: loss 0.14804. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 37 Iter 120: loss 0.16153. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 37 Iter 120: loss 0.16153. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 37 Iter 121: loss 0.17968. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 37 Iter 121: loss 0.17968. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 37 Iter 122: loss 0.15450. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 37 Iter 122: loss 0.15450. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 123: loss 0.14909. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 123: loss 0.14909. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 124: loss 0.15897. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 37 Iter 124: loss 0.15897. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 37 Iter 125: loss 0.15252. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 37 Iter 125: loss 0.15252. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 37 Iter 126: loss 0.18151. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 37 Iter 126: loss 0.18151. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 37 Iter 127: loss 0.18541. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 37 Iter 127: loss 0.18541. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 37 Iter 128: loss 0.17041. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 37 Iter 128: loss 0.17041. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 37 Iter 129: loss 0.15474. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 37 Iter 129: loss 0.15474. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 37 Iter 130: loss 0.14772. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 37 Iter 130: loss 0.14772. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 131: loss 0.17074. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 131: loss 0.17074. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 132: loss 0.15847. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 132: loss 0.15847. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 37 Iter 133: loss 0.15497. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 37 Iter 133: loss 0.15497. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 37 Iter 134: loss 0.19197. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 37 Iter 134: loss 0.19197. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 37 Iter 135: loss 0.18143. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 37 Iter 135: loss 0.18143. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 37 Iter 136: loss 0.17004. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 37 Iter 136: loss 0.17004. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 37 Iter 137: loss 0.17660. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 37 Iter 137: loss 0.17660. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 138: loss 0.14661. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 138: loss 0.14661. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 37 Iter 139: loss 0.17040. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 37 Iter 139: loss 0.17040. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 37 Iter 140: loss 0.17437. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 37 Iter 140: loss 0.17437. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 37 Iter 141: loss 0.15728. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 37 Iter 141: loss 0.15728. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 37 Iter 142: loss 0.14618. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 37 Iter 142: loss 0.14618. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 37 Iter 143: loss 0.14367. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 37 Iter 143: loss 0.14367. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 37 Iter 144: loss 0.17365. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 37 Iter 144: loss 0.17365. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 37 Iter 145: loss 0.16165. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 37 Iter 145: loss 0.16165. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 37 Iter 146: loss 0.13517. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 37 Iter 146: loss 0.13517. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 37 Iter 147: loss 0.16771. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 37 Iter 147: loss 0.16771. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 37 Iter 148: loss 0.17029. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 37 Iter 148: loss 0.17029. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 37 Iter 149: loss 0.16382. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 37 Iter 149: loss 0.16382. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 37 Iter 150: loss 0.14268. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 37 Iter 150: loss 0.14268. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 37 Iter 151: loss 0.17648. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 37 Iter 151: loss 0.17648. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 37 Iter 152: loss 0.14689. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 37 Iter 152: loss 0.14689. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 37 Iter 153: loss 0.15819. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 37 Iter 153: loss 0.15819. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 37 Iter 154: loss 0.17483. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 37 Iter 154: loss 0.17483. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 37 Iter 155: loss 0.17493. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 37 Iter 155: loss 0.17493. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 37 Iter 156: loss 0.17296. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 37 Iter 156: loss 0.17296. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 37 Iter 157: loss 0.15610. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 157: loss 0.15610. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 158: loss 0.14147. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 158: loss 0.14147. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 37 Iter 159: loss 0.14991. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 159: loss 0.14991. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 160: loss 0.17730. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 160: loss 0.17730. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 37 Iter 161: loss 0.15502. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 161: loss 0.15502. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 162: loss 0.15660. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 162: loss 0.15660. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 163: loss 0.15730. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.07it/s]
Epoch 37 Iter 163: loss 0.15730. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 164: loss 0.17029. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 164: loss 0.17029. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 165: loss 0.17829. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 165: loss 0.17829. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 37 Iter 166: loss 0.17321. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 37 Iter 166: loss 0.17321. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 37 Iter 167: loss 0.14835. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 37 Iter 167: loss 0.14835. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 37 Iter 168: loss 0.14130. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 168: loss 0.14130. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 169: loss 0.14780. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 169: loss 0.14780. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 37 Iter 170: loss 0.14482. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 37 Iter 170: loss 0.14482. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 37 Iter 171: loss 0.17179. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 37 Iter 171: loss 0.17179. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 37 Iter 172: loss 0.19629. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 37 Iter 172: loss 0.19629. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 37 Iter 173: loss 0.15766. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 37 Iter 173: loss 0.15766. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 37 Iter 174: loss 0.14503. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 37 Iter 174: loss 0.14503. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 37 Iter 175: loss 0.17753. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 37 Iter 175: loss 0.17753. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 37 Iter 176: loss 0.17241. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 176: loss 0.17241. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 177: loss 0.18733. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 177: loss 0.18733. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 37 Iter 178: loss 0.14398. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 37 Iter 178: loss 0.14398. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 37 Iter 179: loss 0.16603. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 37 Iter 179: loss 0.16603. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 37 Iter 180: loss 0.19479. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 37 Iter 180: loss 0.19479. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 37 Iter 181: loss 0.16667. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 37 Iter 181: loss 0.16667. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 37 Iter 182: loss 0.16655. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 37 Iter 182: loss 0.16655. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 37 Iter 183: loss 0.16246. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 37 Iter 183: loss 0.16246. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 37 Iter 184: loss 0.16884. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 37 Iter 184: loss 0.16884. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 37 Iter 185: loss 0.16057. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 37 Iter 185: loss 0.16057. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 37 Iter 186: loss 0.13566. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 37 Iter 186: loss 0.13566. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 37 Iter 187: loss 0.17596. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 37 Iter 187: loss 0.17596. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 37 Iter 188: loss 0.15598. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 37 Iter 188: loss 0.15598. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 37 Iter 189: loss 0.14639. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 37 Iter 189: loss 0.14639. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 37 Iter 190: loss 0.16071. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 37 Iter 190: loss 0.16071. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 37 Iter 191: loss 0.14973. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 37 Iter 191: loss 0.14973. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 37 Iter 192: loss 0.18226. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 37 Iter 192: loss 0.18226. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 37 Iter 193: loss 0.16803. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 37 Iter 193: loss 0.16803. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 37 Iter 194: loss 0.17548. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 37 Iter 194: loss 0.17548. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 37 Iter 195: loss 0.15461. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 37 Iter 195: loss 0.15461. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 37 Iter 196: loss 0.15527. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 37 Iter 196: loss 0.15527. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 37 Iter 197: loss 0.16413. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 37 Iter 197: loss 0.16413. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 37 Iter 198: loss 0.16545. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 37 Iter 198: loss 0.16545. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 37 Iter 199: loss 0.16181. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 37 Iter 199: loss 0.16181. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 37 Iter 200: loss 0.17430. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 37 Iter 200: loss 0.17430. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 37 Iter 201: loss 0.16504. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 37 Iter 201: loss 0.16504. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 37 Iter 202: loss 0.16430. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 37 Iter 202: loss 0.16430. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 37 Iter 203: loss 0.18477. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 37 Iter 203: loss 0.18477. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 37 Iter 204: loss 0.15482. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 37 Iter 204: loss 0.15482. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 37 Iter 205: loss 0.16186. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 205: loss 0.16186. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 206: loss 0.17344. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 206: loss 0.17344. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 37 Iter 207: loss 0.16172. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 37 Iter 207: loss 0.16172. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 37 Iter 208: loss 0.17103. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 37 Iter 208: loss 0.17103. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 37 Iter 209: loss 0.15042. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 209: loss 0.15042. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 37 Iter 210: loss 0.17936. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 37 Iter 210: loss 0.17936. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.16454. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.16454. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 37 Iter 212: loss 0.14689. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 37 Iter 212: loss 0.14689. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 37 Iter 213: loss 0.15664. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 37 Iter 213: loss 0.15664. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.16501. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.16501. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 37 Iter 215: loss 0.16989. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 215: loss 0.16989. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.17484. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.17484. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 37 Iter 217: loss 0.15953. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 37 Iter 217: loss 0.15953. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 37 Iter 218: loss 0.15034. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 37 Iter 218: loss 0.15034. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 37 Iter 219: loss 0.16595. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 37 Iter 219: loss 0.16595. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 37 Iter 220: loss 0.16326. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 37 Iter 220: loss 0.16326. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 37 Iter 221: loss 0.18388. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 221: loss 0.18388. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 222: loss 0.16188. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 222: loss 0.16188. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 37 Iter 223: loss 0.15107. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 223: loss 0.15107. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.16265. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.16265. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 37 Iter 224: loss 0.16265. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16337
    Valid loss: 0.17081
       Valid loss recons: 0.17081
       Valid loss KL-D:   139181.14666
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.17605. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.17605. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 38 Iter 2: loss 0.17756. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 38 Iter 2: loss 0.17756. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 38 Iter 3: loss 0.17806. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 38 Iter 3: loss 0.17806. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 38 Iter 4: loss 0.15508. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 38 Iter 4: loss 0.15508. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 38 Iter 5: loss 0.18839. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 38 Iter 5: loss 0.18839. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 38 Iter 6: loss 0.16426. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 38 Iter 6: loss 0.16426. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 38 Iter 7: loss 0.17489. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 38 Iter 7: loss 0.17489. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 38 Iter 8: loss 0.17457. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 38 Iter 8: loss 0.17457. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.06it/s]
Epoch 38 Iter 9: loss 0.16590. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.06it/s]
Epoch 38 Iter 9: loss 0.16590. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 38 Iter 10: loss 0.19131. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 38 Iter 10: loss 0.19131. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 38 Iter 11: loss 0.15414. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 38 Iter 11: loss 0.15414. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 38 Iter 12: loss 0.17495. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 38 Iter 12: loss 0.17495. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.04it/s]
Epoch 38 Iter 13: loss 0.17504. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.04it/s]
Epoch 38 Iter 13: loss 0.17504. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 38 Iter 14: loss 0.16440. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 38 Iter 14: loss 0.16440. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 38 Iter 15: loss 0.16142. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 38 Iter 15: loss 0.16142. :   7%|███                                          | 15/224 [00:07<01:43,  2.02it/s]
Epoch 38 Iter 16: loss 0.17443. :   7%|███                                          | 15/224 [00:07<01:43,  2.02it/s]
Epoch 38 Iter 16: loss 0.17443. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.03it/s]
Epoch 38 Iter 17: loss 0.16610. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.03it/s]
Epoch 38 Iter 17: loss 0.16610. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 38 Iter 18: loss 0.16315. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 38 Iter 18: loss 0.16315. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.03it/s]
Epoch 38 Iter 19: loss 0.15939. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.03it/s]
Epoch 38 Iter 19: loss 0.15939. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 38 Iter 20: loss 0.16275. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 38 Iter 20: loss 0.16275. :   9%|████                                         | 20/224 [00:09<01:39,  2.04it/s]
Epoch 38 Iter 21: loss 0.15998. :   9%|████                                         | 20/224 [00:10<01:39,  2.04it/s]
Epoch 38 Iter 21: loss 0.15998. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 38 Iter 22: loss 0.15469. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 38 Iter 22: loss 0.15469. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 38 Iter 23: loss 0.17105. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 38 Iter 23: loss 0.17105. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 38 Iter 24: loss 0.15694. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 38 Iter 24: loss 0.15694. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 38 Iter 25: loss 0.16302. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 38 Iter 25: loss 0.16302. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 38 Iter 26: loss 0.16581. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 38 Iter 26: loss 0.16581. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 27: loss 0.15527. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 38 Iter 27: loss 0.15527. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 38 Iter 28: loss 0.17621. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 38 Iter 28: loss 0.17621. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 29: loss 0.14984. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 38 Iter 29: loss 0.14984. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.16515. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.16515. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 38 Iter 31: loss 0.18798. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 38 Iter 31: loss 0.18798. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.15326. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.15326. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 38 Iter 33: loss 0.16911. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.08it/s]
Epoch 38 Iter 33: loss 0.16911. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.09it/s]
Epoch 38 Iter 34: loss 0.18235. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.09it/s]
Epoch 38 Iter 34: loss 0.18235. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.16074. :  15%|██████▊                                      | 34/224 [00:17<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.16074. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 38 Iter 36: loss 0.15966. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 38 Iter 36: loss 0.15966. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 38 Iter 37: loss 0.13407. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 38 Iter 37: loss 0.13407. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 38 Iter 38: loss 0.16927. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 38 Iter 38: loss 0.16927. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 38 Iter 39: loss 0.16445. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 38 Iter 39: loss 0.16445. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 38 Iter 40: loss 0.17282. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 38 Iter 40: loss 0.17282. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 38 Iter 41: loss 0.14648. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 38 Iter 41: loss 0.14648. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.14704. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.14704. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.15716. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.15716. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 44: loss 0.16078. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 38 Iter 44: loss 0.16078. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 38 Iter 45: loss 0.14562. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 38 Iter 45: loss 0.14562. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 38 Iter 46: loss 0.17301. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 38 Iter 46: loss 0.17301. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 38 Iter 47: loss 0.17309. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 38 Iter 47: loss 0.17309. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 38 Iter 48: loss 0.17324. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 38 Iter 48: loss 0.17324. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 38 Iter 49: loss 0.15576. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 38 Iter 49: loss 0.15576. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 38 Iter 50: loss 0.17462. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 38 Iter 50: loss 0.17462. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 38 Iter 51: loss 0.14513. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 38 Iter 51: loss 0.14513. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 38 Iter 52: loss 0.16800. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 52: loss 0.16800. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 53: loss 0.15017. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 53: loss 0.15017. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.16153. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.16153. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 38 Iter 55: loss 0.15428. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 38 Iter 55: loss 0.15428. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.16297. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.16297. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 38 Iter 57: loss 0.16612. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 38 Iter 57: loss 0.16612. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 38 Iter 58: loss 0.15565. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 38 Iter 58: loss 0.15565. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.09it/s]
Epoch 38 Iter 59: loss 0.18152. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.09it/s]
Epoch 38 Iter 59: loss 0.18152. :  26%|███████████▊                                 | 59/224 [00:28<01:18,  2.09it/s]
Epoch 38 Iter 60: loss 0.14659. :  26%|███████████▊                                 | 59/224 [00:29<01:18,  2.09it/s]
Epoch 38 Iter 60: loss 0.14659. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 38 Iter 61: loss 0.17070. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 38 Iter 61: loss 0.17070. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 38 Iter 62: loss 0.17906. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 38 Iter 62: loss 0.17906. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.09it/s]
Epoch 38 Iter 63: loss 0.16642. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.09it/s]
Epoch 38 Iter 63: loss 0.16642. :  28%|████████████▋                                | 63/224 [00:30<01:16,  2.09it/s]
Epoch 38 Iter 64: loss 0.16280. :  28%|████████████▋                                | 63/224 [00:31<01:16,  2.09it/s]
Epoch 38 Iter 64: loss 0.16280. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 38 Iter 65: loss 0.16739. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 38 Iter 65: loss 0.16739. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 38 Iter 66: loss 0.16642. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.09it/s]
Epoch 38 Iter 66: loss 0.16642. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 38 Iter 67: loss 0.14777. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 38 Iter 67: loss 0.14777. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.09it/s]
Epoch 38 Iter 68: loss 0.16340. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.09it/s]
Epoch 38 Iter 68: loss 0.16340. :  30%|█████████████▋                               | 68/224 [00:32<01:14,  2.09it/s]
Epoch 38 Iter 69: loss 0.16109. :  30%|█████████████▋                               | 68/224 [00:33<01:14,  2.09it/s]
Epoch 38 Iter 69: loss 0.16109. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.16503. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.16503. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 38 Iter 71: loss 0.17148. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 38 Iter 71: loss 0.17148. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 38 Iter 72: loss 0.16935. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 38 Iter 72: loss 0.16935. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 38 Iter 73: loss 0.17984. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 38 Iter 73: loss 0.17984. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 38 Iter 74: loss 0.16447. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 38 Iter 74: loss 0.16447. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 38 Iter 75: loss 0.17116. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 38 Iter 75: loss 0.17116. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 38 Iter 76: loss 0.17403. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 38 Iter 76: loss 0.17403. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 38 Iter 77: loss 0.15609. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 38 Iter 77: loss 0.15609. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 38 Iter 78: loss 0.17640. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 38 Iter 78: loss 0.17640. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 38 Iter 79: loss 0.16955. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 38 Iter 79: loss 0.16955. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 38 Iter 80: loss 0.17258. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 38 Iter 80: loss 0.17258. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 38 Iter 81: loss 0.15858. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 38 Iter 81: loss 0.15858. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.07it/s]
Epoch 38 Iter 82: loss 0.15150. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.07it/s]
Epoch 38 Iter 82: loss 0.15150. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 38 Iter 83: loss 0.16867. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 38 Iter 83: loss 0.16867. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 38 Iter 84: loss 0.16257. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 38 Iter 84: loss 0.16257. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.08it/s]
Epoch 38 Iter 85: loss 0.16595. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.08it/s]
Epoch 38 Iter 85: loss 0.16595. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 38 Iter 86: loss 0.16504. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 38 Iter 86: loss 0.16504. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 38 Iter 87: loss 0.14627. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 38 Iter 87: loss 0.14627. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 38 Iter 88: loss 0.15162. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 38 Iter 88: loss 0.15162. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 38 Iter 89: loss 0.16392. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 38 Iter 89: loss 0.16392. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 38 Iter 90: loss 0.14951. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 38 Iter 90: loss 0.14951. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 38 Iter 91: loss 0.14558. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 38 Iter 91: loss 0.14558. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 38 Iter 92: loss 0.15656. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 38 Iter 92: loss 0.15656. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 38 Iter 93: loss 0.15683. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.06it/s]
Epoch 38 Iter 93: loss 0.15683. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 38 Iter 94: loss 0.16200. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 38 Iter 94: loss 0.16200. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.04it/s]
Epoch 38 Iter 95: loss 0.16418. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.04it/s]
Epoch 38 Iter 95: loss 0.16418. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.05it/s]
Epoch 38 Iter 96: loss 0.17919. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 38 Iter 96: loss 0.17919. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 38 Iter 97: loss 0.15860. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 38 Iter 97: loss 0.15860. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.05it/s]
Epoch 38 Iter 98: loss 0.17260. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 38 Iter 98: loss 0.17260. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 38 Iter 99: loss 0.19656. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 38 Iter 99: loss 0.19656. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 38 Iter 100: loss 0.16267. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 38 Iter 100: loss 0.16267. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 38 Iter 101: loss 0.17491. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 38 Iter 101: loss 0.17491. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 38 Iter 102: loss 0.15672. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 38 Iter 102: loss 0.15672. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 38 Iter 103: loss 0.16067. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 38 Iter 103: loss 0.16067. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 38 Iter 104: loss 0.14711. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 38 Iter 104: loss 0.14711. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 38 Iter 105: loss 0.16981. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 38 Iter 105: loss 0.16981. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 38 Iter 106: loss 0.15779. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 38 Iter 106: loss 0.15779. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 38 Iter 107: loss 0.17357. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 38 Iter 107: loss 0.17357. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 38 Iter 108: loss 0.16375. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 108: loss 0.16375. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 109: loss 0.18010. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 109: loss 0.18010. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 38 Iter 110: loss 0.15433. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 38 Iter 110: loss 0.15433. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 38 Iter 111: loss 0.15877. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 38 Iter 111: loss 0.15877. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 38 Iter 112: loss 0.15047. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 38 Iter 112: loss 0.15047. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 38 Iter 113: loss 0.13844. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 38 Iter 113: loss 0.13844. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.17945. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.17945. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 115: loss 0.16363. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 115: loss 0.16363. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 116: loss 0.14970. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 38 Iter 116: loss 0.14970. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.17652. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.17652. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.15301. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.15301. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 119: loss 0.18181. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 119: loss 0.18181. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 120: loss 0.17752. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 38 Iter 120: loss 0.17752. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 38 Iter 121: loss 0.15134. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 38 Iter 121: loss 0.15134. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 38 Iter 122: loss 0.15416. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 38 Iter 122: loss 0.15416. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 38 Iter 123: loss 0.14547. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 38 Iter 123: loss 0.14547. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 38 Iter 124: loss 0.15377. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 38 Iter 124: loss 0.15377. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 38 Iter 125: loss 0.15437. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 38 Iter 125: loss 0.15437. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 38 Iter 126: loss 0.18215. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 38 Iter 126: loss 0.18215. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 38 Iter 127: loss 0.18142. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 38 Iter 127: loss 0.18142. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 38 Iter 128: loss 0.14567. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 38 Iter 128: loss 0.14567. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 38 Iter 129: loss 0.16530. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 38 Iter 129: loss 0.16530. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 38 Iter 130: loss 0.16682. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 38 Iter 130: loss 0.16682. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 38 Iter 131: loss 0.16295. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 38 Iter 131: loss 0.16295. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 38 Iter 132: loss 0.15888. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 38 Iter 132: loss 0.15888. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 38 Iter 133: loss 0.14537. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 38 Iter 133: loss 0.14537. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 134: loss 0.16741. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 134: loss 0.16741. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 135: loss 0.17634. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 38 Iter 135: loss 0.17634. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.14753. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.14753. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.16281. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.16281. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 38 Iter 138: loss 0.15593. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 38 Iter 138: loss 0.15593. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 38 Iter 139: loss 0.15850. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 38 Iter 139: loss 0.15850. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 38 Iter 140: loss 0.17280. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 38 Iter 140: loss 0.17280. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 38 Iter 141: loss 0.16801. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 38 Iter 141: loss 0.16801. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 38 Iter 142: loss 0.16652. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 38 Iter 142: loss 0.16652. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 38 Iter 143: loss 0.16316. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 38 Iter 143: loss 0.16316. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 38 Iter 144: loss 0.15631. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 38 Iter 144: loss 0.15631. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 38 Iter 145: loss 0.14353. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 38 Iter 145: loss 0.14353. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 38 Iter 146: loss 0.16684. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 38 Iter 146: loss 0.16684. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.14991. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.14991. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 38 Iter 148: loss 0.16945. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 38 Iter 148: loss 0.16945. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 38 Iter 149: loss 0.15282. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 38 Iter 149: loss 0.15282. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 38 Iter 150: loss 0.14734. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 38 Iter 150: loss 0.14734. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.09it/s]
Epoch 38 Iter 151: loss 0.16273. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.09it/s]
Epoch 38 Iter 151: loss 0.16273. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 38 Iter 152: loss 0.14495. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 38 Iter 152: loss 0.14495. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.10it/s]
Epoch 38 Iter 153: loss 0.15650. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.10it/s]
Epoch 38 Iter 153: loss 0.15650. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:33,  2.11it/s]
Epoch 38 Iter 154: loss 0.14446. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:33,  2.11it/s]
Epoch 38 Iter 154: loss 0.14446. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.11it/s]
Epoch 38 Iter 155: loss 0.17672. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.11it/s]
Epoch 38 Iter 155: loss 0.17672. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:32,  2.10it/s]
Epoch 38 Iter 156: loss 0.15666. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 38 Iter 156: loss 0.15666. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 38 Iter 157: loss 0.16412. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 38 Iter 157: loss 0.16412. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 158: loss 0.17176. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 38 Iter 158: loss 0.17176. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 38 Iter 159: loss 0.15788. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 38 Iter 159: loss 0.15788. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.16037. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.16037. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 38 Iter 161: loss 0.15544. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 38 Iter 161: loss 0.15544. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 38 Iter 162: loss 0.16781. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 38 Iter 162: loss 0.16781. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.10it/s]
Epoch 38 Iter 163: loss 0.15094. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.10it/s]
Epoch 38 Iter 163: loss 0.15094. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 38 Iter 164: loss 0.18202. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 38 Iter 164: loss 0.18202. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 38 Iter 165: loss 0.16985. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 38 Iter 165: loss 0.16985. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.09it/s]
Epoch 38 Iter 166: loss 0.14666. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.09it/s]
Epoch 38 Iter 166: loss 0.14666. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.09it/s]
Epoch 38 Iter 167: loss 0.16701. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.09it/s]
Epoch 38 Iter 167: loss 0.16701. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.09it/s]
Epoch 38 Iter 168: loss 0.16596. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.09it/s]
Epoch 38 Iter 168: loss 0.16596. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 38 Iter 169: loss 0.15102. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 38 Iter 169: loss 0.15102. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 38 Iter 170: loss 0.15372. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 170: loss 0.15372. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.16270. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.16270. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 38 Iter 172: loss 0.16374. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 172: loss 0.16374. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 173: loss 0.17120. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 173: loss 0.17120. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 38 Iter 174: loss 0.16926. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 174: loss 0.16926. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 38 Iter 175: loss 0.17899. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 38 Iter 175: loss 0.17899. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 38 Iter 176: loss 0.16952. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 38 Iter 176: loss 0.16952. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 38 Iter 177: loss 0.14189. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 38 Iter 177: loss 0.14189. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.09it/s]
Epoch 38 Iter 178: loss 0.15261. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.09it/s]
Epoch 38 Iter 178: loss 0.15261. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 38 Iter 179: loss 0.17439. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 38 Iter 179: loss 0.17439. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.11it/s]
Epoch 38 Iter 180: loss 0.15388. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.11it/s]
Epoch 38 Iter 180: loss 0.15388. :  80%|██████████████████████████████████▌        | 180/224 [01:26<00:21,  2.09it/s]
Epoch 38 Iter 181: loss 0.17351. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.09it/s]
Epoch 38 Iter 181: loss 0.17351. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.10it/s]
Epoch 38 Iter 182: loss 0.15216. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.10it/s]
Epoch 38 Iter 182: loss 0.15216. :  81%|██████████████████████████████████▉        | 182/224 [01:27<00:20,  2.09it/s]
Epoch 38 Iter 183: loss 0.19800. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 38 Iter 183: loss 0.19800. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.10it/s]
Epoch 38 Iter 184: loss 0.15702. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.10it/s]
Epoch 38 Iter 184: loss 0.15702. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:18,  2.11it/s]
Epoch 38 Iter 185: loss 0.16294. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:18,  2.11it/s]
Epoch 38 Iter 185: loss 0.16294. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.10it/s]
Epoch 38 Iter 186: loss 0.16328. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.10it/s]
Epoch 38 Iter 186: loss 0.16328. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.10it/s]
Epoch 38 Iter 187: loss 0.15218. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.10it/s]
Epoch 38 Iter 187: loss 0.15218. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.13it/s]
Epoch 38 Iter 188: loss 0.15882. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.13it/s]
Epoch 38 Iter 188: loss 0.15882. :  84%|████████████████████████████████████       | 188/224 [01:30<00:16,  2.13it/s]
Epoch 38 Iter 189: loss 0.17495. :  84%|████████████████████████████████████       | 188/224 [01:31<00:16,  2.13it/s]
Epoch 38 Iter 189: loss 0.17495. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.12it/s]
Epoch 38 Iter 190: loss 0.14579. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.12it/s]
Epoch 38 Iter 190: loss 0.14579. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.10it/s]
Epoch 38 Iter 191: loss 0.14821. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.10it/s]
Epoch 38 Iter 191: loss 0.14821. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 38 Iter 192: loss 0.14731. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 38 Iter 192: loss 0.14731. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.08it/s]
Epoch 38 Iter 193: loss 0.14895. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 38 Iter 193: loss 0.14895. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 38 Iter 194: loss 0.16418. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 38 Iter 194: loss 0.16418. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.02it/s]
Epoch 38 Iter 195: loss 0.17410. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.02it/s]
Epoch 38 Iter 195: loss 0.17410. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.02it/s]
Epoch 38 Iter 196: loss 0.15902. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.02it/s]
Epoch 38 Iter 196: loss 0.15902. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.04it/s]
Epoch 38 Iter 197: loss 0.15547. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 38 Iter 197: loss 0.15547. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 38 Iter 198: loss 0.15561. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 38 Iter 198: loss 0.15561. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 38 Iter 199: loss 0.16957. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 38 Iter 199: loss 0.16957. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 38 Iter 200: loss 0.15343. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 38 Iter 200: loss 0.15343. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 38 Iter 201: loss 0.19457. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 38 Iter 201: loss 0.19457. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 38 Iter 202: loss 0.16437. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 38 Iter 202: loss 0.16437. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 38 Iter 203: loss 0.16498. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 38 Iter 203: loss 0.16498. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 38 Iter 204: loss 0.18912. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 38 Iter 204: loss 0.18912. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 38 Iter 205: loss 0.14193. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 38 Iter 205: loss 0.14193. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 38 Iter 206: loss 0.17579. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 38 Iter 206: loss 0.17579. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.15714. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.15714. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 208: loss 0.15316. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 208: loss 0.15316. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 38 Iter 209: loss 0.17254. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 38 Iter 209: loss 0.17254. :  93%|████████████████████████████████████████   | 209/224 [01:40<00:07,  2.06it/s]
Epoch 38 Iter 210: loss 0.15262. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 38 Iter 210: loss 0.15262. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 38 Iter 211: loss 0.18120. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 38 Iter 211: loss 0.18120. :  94%|████████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.06it/s]
Epoch 38 Iter 212: loss 0.17066. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 38 Iter 212: loss 0.17066. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 38 Iter 213: loss 0.15819. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 38 Iter 213: loss 0.15819. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.07it/s]
Epoch 38 Iter 214: loss 0.15505. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 38 Iter 214: loss 0.15505. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 215: loss 0.14616. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 215: loss 0.14616. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 216: loss 0.16348. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.09it/s]
Epoch 38 Iter 216: loss 0.16348. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.17657. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.17657. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 218: loss 0.14866. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 38 Iter 218: loss 0.14866. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 38 Iter 219: loss 0.16365. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 38 Iter 219: loss 0.16365. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.10it/s]
Epoch 38 Iter 220: loss 0.19150. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.10it/s]
Epoch 38 Iter 220: loss 0.19150. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 38 Iter 221: loss 0.17307. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 38 Iter 221: loss 0.17307. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 38 Iter 222: loss 0.16561. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 38 Iter 222: loss 0.16561. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 223: loss 0.17666. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 223: loss 0.17666. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 224: loss 0.15736. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 38 Iter 224: loss 0.15736. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 38 Iter 224: loss 0.15736. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.16612. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.16612. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 39 Iter 2: loss 0.18531. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 39 Iter 2: loss 0.18531. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 39 Iter 3: loss 0.17398. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 39 Iter 3: loss 0.17398. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 39 Iter 4: loss 0.15524. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 39 Iter 4: loss 0.15524. :   2%|▊                                              | 4/224 [00:01<01:45,  2.08it/s]
Epoch 39 Iter 5: loss 0.16001. :   2%|▊                                              | 4/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 5: loss 0.16001. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.18145. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.18145. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 39 Iter 7: loss 0.16310. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 39 Iter 7: loss 0.16310. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 8: loss 0.15092. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 8: loss 0.15092. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 39 Iter 9: loss 0.15534. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 9: loss 0.15534. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 10: loss 0.16534. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 10: loss 0.16534. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.15372. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.15372. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 12: loss 0.15305. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 12: loss 0.15305. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 13: loss 0.16216. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.06it/s]
Epoch 39 Iter 13: loss 0.16216. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 39 Iter 14: loss 0.15366. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 39 Iter 14: loss 0.15366. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 39 Iter 15: loss 0.15693. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 39 Iter 15: loss 0.15693. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 39 Iter 16: loss 0.16150. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 39 Iter 16: loss 0.16150. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 39 Iter 17: loss 0.15164. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 39 Iter 17: loss 0.15164. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 39 Iter 18: loss 0.15044. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 39 Iter 18: loss 0.15044. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 39 Iter 19: loss 0.16346. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 39 Iter 19: loss 0.16346. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 39 Iter 20: loss 0.17283. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 39 Iter 20: loss 0.17283. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 39 Iter 21: loss 0.16103. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 39 Iter 21: loss 0.16103. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 39 Iter 22: loss 0.18769. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 39 Iter 22: loss 0.18769. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 39 Iter 23: loss 0.16293. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 39 Iter 23: loss 0.16293. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 24: loss 0.15768. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 24: loss 0.15768. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.14009. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.14009. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 26: loss 0.15786. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 26: loss 0.15786. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 39 Iter 27: loss 0.18729. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 39 Iter 27: loss 0.18729. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 39 Iter 28: loss 0.14823. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 39 Iter 28: loss 0.14823. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.15670. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.15670. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 30: loss 0.15159. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 30: loss 0.15159. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.15528. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.15528. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.18356. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.18356. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 33: loss 0.16433. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 33: loss 0.16433. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 39 Iter 34: loss 0.16450. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 39 Iter 34: loss 0.16450. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 35: loss 0.17009. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 35: loss 0.17009. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 36: loss 0.17098. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 39 Iter 36: loss 0.17098. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 39 Iter 37: loss 0.19016. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 39 Iter 37: loss 0.19016. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 39 Iter 38: loss 0.14614. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 38: loss 0.14614. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 39: loss 0.15951. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 39: loss 0.15951. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.17623. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.17623. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 41: loss 0.15806. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 41: loss 0.15806. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.17150. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.17150. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 39 Iter 43: loss 0.19217. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 39 Iter 43: loss 0.19217. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.06it/s]
Epoch 39 Iter 44: loss 0.17225. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.06it/s]
Epoch 39 Iter 44: loss 0.17225. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 39 Iter 45: loss 0.17110. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 39 Iter 45: loss 0.17110. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 39 Iter 46: loss 0.17189. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 39 Iter 46: loss 0.17189. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 39 Iter 47: loss 0.16695. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 39 Iter 47: loss 0.16695. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 39 Iter 48: loss 0.15787. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 39 Iter 48: loss 0.15787. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 39 Iter 49: loss 0.14798. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 39 Iter 49: loss 0.14798. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 39 Iter 50: loss 0.17175. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 39 Iter 50: loss 0.17175. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 39 Iter 51: loss 0.14246. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 39 Iter 51: loss 0.14246. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 39 Iter 52: loss 0.15474. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 39 Iter 52: loss 0.15474. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 39 Iter 53: loss 0.16376. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 39 Iter 53: loss 0.16376. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 39 Iter 54: loss 0.16375. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 39 Iter 54: loss 0.16375. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 39 Iter 55: loss 0.16815. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 39 Iter 55: loss 0.16815. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 39 Iter 56: loss 0.16882. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 39 Iter 56: loss 0.16882. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.14220. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.14220. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.15615. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.15615. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.16145. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.16145. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.17559. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.17559. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.18308. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.18308. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.15728. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.15728. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 63: loss 0.15240. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 63: loss 0.15240. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 64: loss 0.18268. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 39 Iter 64: loss 0.18268. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.17601. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.17601. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 39 Iter 66: loss 0.16760. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 39 Iter 66: loss 0.16760. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 39 Iter 67: loss 0.16217. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 67: loss 0.16217. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 68: loss 0.15069. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 68: loss 0.15069. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 39 Iter 69: loss 0.15792. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 69: loss 0.15792. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 70: loss 0.15067. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 70: loss 0.15067. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 39 Iter 71: loss 0.15872. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 39 Iter 71: loss 0.15872. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 39 Iter 72: loss 0.15826. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 39 Iter 72: loss 0.15826. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.05it/s]
Epoch 39 Iter 73: loss 0.15029. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.05it/s]
Epoch 39 Iter 73: loss 0.15029. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.17440. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.17440. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 39 Iter 75: loss 0.15106. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 75: loss 0.15106. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 76: loss 0.17087. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 76: loss 0.17087. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 39 Iter 77: loss 0.15043. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 39 Iter 77: loss 0.15043. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 39 Iter 78: loss 0.15214. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 39 Iter 78: loss 0.15214. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 39 Iter 79: loss 0.14223. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 79: loss 0.14223. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 80: loss 0.17772. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 80: loss 0.17772. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 39 Iter 81: loss 0.16895. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 39 Iter 81: loss 0.16895. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 39 Iter 82: loss 0.17343. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 39 Iter 82: loss 0.17343. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 39 Iter 83: loss 0.15874. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 83: loss 0.15874. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 84: loss 0.14725. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 84: loss 0.14725. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 39 Iter 85: loss 0.16279. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 85: loss 0.16279. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 86: loss 0.18384. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 86: loss 0.18384. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 39 Iter 87: loss 0.15948. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 39 Iter 87: loss 0.15948. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 39 Iter 88: loss 0.18535. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 39 Iter 88: loss 0.18535. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.14119. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.14119. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 90: loss 0.15141. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 90: loss 0.15141. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 39 Iter 91: loss 0.15001. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 39 Iter 91: loss 0.15001. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 39 Iter 92: loss 0.16322. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 39 Iter 92: loss 0.16322. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 39 Iter 93: loss 0.15896. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 39 Iter 93: loss 0.15896. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.15804. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.15804. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 95: loss 0.14327. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 39 Iter 95: loss 0.14327. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 39 Iter 96: loss 0.16580. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 39 Iter 96: loss 0.16580. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 39 Iter 97: loss 0.16277. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 39 Iter 97: loss 0.16277. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 39 Iter 98: loss 0.17127. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 39 Iter 98: loss 0.17127. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 39 Iter 99: loss 0.16270. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 39 Iter 99: loss 0.16270. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 39 Iter 100: loss 0.15345. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 39 Iter 100: loss 0.15345. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 39 Iter 101: loss 0.15816. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 39 Iter 101: loss 0.15816. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 39 Iter 102: loss 0.16832. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 39 Iter 102: loss 0.16832. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 39 Iter 103: loss 0.15590. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 39 Iter 103: loss 0.15590. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 39 Iter 104: loss 0.17685. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 39 Iter 104: loss 0.17685. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 39 Iter 105: loss 0.15015. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 39 Iter 105: loss 0.15015. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 39 Iter 106: loss 0.15995. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 39 Iter 106: loss 0.15995. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 39 Iter 107: loss 0.16462. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 39 Iter 107: loss 0.16462. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 39 Iter 108: loss 0.13629. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 39 Iter 108: loss 0.13629. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 39 Iter 109: loss 0.15109. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 39 Iter 109: loss 0.15109. :  49%|████████████████████▉                      | 109/224 [00:52<00:54,  2.10it/s]
Epoch 39 Iter 110: loss 0.15621. :  49%|████████████████████▉                      | 109/224 [00:53<00:54,  2.10it/s]
Epoch 39 Iter 110: loss 0.15621. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 111: loss 0.14951. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 111: loss 0.14951. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 112: loss 0.14942. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 39 Iter 112: loss 0.14942. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 113: loss 0.15972. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 113: loss 0.15972. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 114: loss 0.16537. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.08it/s]
Epoch 39 Iter 114: loss 0.16537. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 39 Iter 115: loss 0.15482. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 39 Iter 115: loss 0.15482. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 39 Iter 116: loss 0.17137. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 39 Iter 116: loss 0.17137. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 39 Iter 117: loss 0.15612. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 39 Iter 117: loss 0.15612. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 39 Iter 118: loss 0.14221. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 39 Iter 118: loss 0.14221. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 39 Iter 119: loss 0.17692. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 39 Iter 119: loss 0.17692. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 39 Iter 120: loss 0.13834. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 120: loss 0.13834. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 121: loss 0.19173. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 121: loss 0.19173. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 39 Iter 122: loss 0.15723. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 39 Iter 122: loss 0.15723. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 39 Iter 123: loss 0.16465. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 39 Iter 123: loss 0.16465. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 39 Iter 124: loss 0.16528. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 39 Iter 124: loss 0.16528. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 39 Iter 125: loss 0.16688. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 39 Iter 125: loss 0.16688. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 39 Iter 126: loss 0.17071. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 39 Iter 126: loss 0.17071. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 39 Iter 127: loss 0.15447. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 39 Iter 127: loss 0.15447. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 39 Iter 128: loss 0.16844. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 39 Iter 128: loss 0.16844. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 39 Iter 129: loss 0.16030. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 39 Iter 129: loss 0.16030. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.18730. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.18730. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 131: loss 0.15316. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 39 Iter 131: loss 0.15316. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 39 Iter 132: loss 0.18558. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 39 Iter 132: loss 0.18558. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 39 Iter 133: loss 0.15835. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 39 Iter 133: loss 0.15835. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 39 Iter 134: loss 0.15146. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 39 Iter 134: loss 0.15146. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 39 Iter 135: loss 0.15501. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 39 Iter 135: loss 0.15501. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 39 Iter 136: loss 0.14142. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 39 Iter 136: loss 0.14142. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 39 Iter 137: loss 0.14269. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 39 Iter 137: loss 0.14269. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 39 Iter 138: loss 0.17533. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 39 Iter 138: loss 0.17533. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 39 Iter 139: loss 0.18439. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 39 Iter 139: loss 0.18439. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 39 Iter 140: loss 0.17461. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 39 Iter 140: loss 0.17461. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 39 Iter 141: loss 0.14859. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 39 Iter 141: loss 0.14859. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 39 Iter 142: loss 0.16283. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 39 Iter 142: loss 0.16283. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.17729. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.17729. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 144: loss 0.15903. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 144: loss 0.15903. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 39 Iter 145: loss 0.15151. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 145: loss 0.15151. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 39 Iter 146: loss 0.15220. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 39 Iter 146: loss 0.15220. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 39 Iter 147: loss 0.18031. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 39 Iter 147: loss 0.18031. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 39 Iter 148: loss 0.15438. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 39 Iter 148: loss 0.15438. :  66%|████████████████████████████▍              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 39 Iter 149: loss 0.17804. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 39 Iter 149: loss 0.17804. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 39 Iter 150: loss 0.14404. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 39 Iter 150: loss 0.14404. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 39 Iter 151: loss 0.17045. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 39 Iter 151: loss 0.17045. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 39 Iter 152: loss 0.14446. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 39 Iter 152: loss 0.14446. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 39 Iter 153: loss 0.17883. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 39 Iter 153: loss 0.17883. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 39 Iter 154: loss 0.17382. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 39 Iter 154: loss 0.17382. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 39 Iter 155: loss 0.17432. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 39 Iter 155: loss 0.17432. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 39 Iter 156: loss 0.18524. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 39 Iter 156: loss 0.18524. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 39 Iter 157: loss 0.16405. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 39 Iter 157: loss 0.16405. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 39 Iter 158: loss 0.16067. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 39 Iter 158: loss 0.16067. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 39 Iter 159: loss 0.17480. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 39 Iter 159: loss 0.17480. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 39 Iter 160: loss 0.17790. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 39 Iter 160: loss 0.17790. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 39 Iter 161: loss 0.15837. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 39 Iter 161: loss 0.15837. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.06it/s]
Epoch 39 Iter 162: loss 0.16282. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 39 Iter 162: loss 0.16282. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 39 Iter 163: loss 0.15460. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 39 Iter 163: loss 0.15460. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 39 Iter 164: loss 0.16540. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 164: loss 0.16540. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 39 Iter 165: loss 0.16161. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 39 Iter 165: loss 0.16161. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.17258. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.17258. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 39 Iter 167: loss 0.14901. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 39 Iter 167: loss 0.14901. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 39 Iter 168: loss 0.15478. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 39 Iter 168: loss 0.15478. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.09it/s]
Epoch 39 Iter 169: loss 0.16885. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.09it/s]
Epoch 39 Iter 169: loss 0.16885. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.10it/s]
Epoch 39 Iter 170: loss 0.16783. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.10it/s]
Epoch 39 Iter 170: loss 0.16783. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 39 Iter 171: loss 0.17693. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 39 Iter 171: loss 0.17693. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 39 Iter 172: loss 0.17549. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 39 Iter 172: loss 0.17549. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.09it/s]
Epoch 39 Iter 173: loss 0.16132. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.09it/s]
Epoch 39 Iter 173: loss 0.16132. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 39 Iter 174: loss 0.17302. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 39 Iter 174: loss 0.17302. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 39 Iter 175: loss 0.15257. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 39 Iter 175: loss 0.15257. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 39 Iter 176: loss 0.15762. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 39 Iter 176: loss 0.15762. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.09it/s]
Epoch 39 Iter 177: loss 0.15785. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.09it/s]
Epoch 39 Iter 177: loss 0.15785. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 39 Iter 178: loss 0.17356. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 39 Iter 178: loss 0.17356. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 39 Iter 179: loss 0.16181. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 39 Iter 179: loss 0.16181. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 39 Iter 180: loss 0.17614. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 39 Iter 180: loss 0.17614. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 39 Iter 181: loss 0.16240. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 39 Iter 181: loss 0.16240. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 39 Iter 182: loss 0.16664. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 39 Iter 182: loss 0.16664. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 39 Iter 183: loss 0.15286. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 39 Iter 183: loss 0.15286. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 39 Iter 184: loss 0.17710. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 39 Iter 184: loss 0.17710. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 39 Iter 185: loss 0.18156. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 39 Iter 185: loss 0.18156. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.14483. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.14483. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 39 Iter 187: loss 0.17413. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 39 Iter 187: loss 0.17413. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 39 Iter 188: loss 0.14840. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 39 Iter 188: loss 0.14840. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 39 Iter 189: loss 0.14719. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 39 Iter 189: loss 0.14719. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.17801. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.17801. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 39 Iter 191: loss 0.17623. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 39 Iter 191: loss 0.17623. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 39 Iter 192: loss 0.15496. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 39 Iter 192: loss 0.15496. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.16363. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.16363. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.16039. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.16039. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 39 Iter 195: loss 0.16336. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 195: loss 0.16336. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 39 Iter 196: loss 0.16969. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 39 Iter 196: loss 0.16969. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 39 Iter 197: loss 0.16647. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 197: loss 0.16647. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 198: loss 0.16014. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 198: loss 0.16014. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 39 Iter 199: loss 0.14753. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 199: loss 0.14753. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 200: loss 0.17057. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 200: loss 0.17057. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 39 Iter 201: loss 0.18097. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 39 Iter 201: loss 0.18097. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 39 Iter 202: loss 0.18748. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 39 Iter 202: loss 0.18748. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 39 Iter 203: loss 0.19079. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 203: loss 0.19079. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.17260. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.17260. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 39 Iter 205: loss 0.16922. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 205: loss 0.16922. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.14150. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.14150. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 39 Iter 207: loss 0.16111. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 39 Iter 207: loss 0.16111. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 39 Iter 208: loss 0.16763. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 39 Iter 208: loss 0.16763. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 39 Iter 209: loss 0.16496. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 39 Iter 209: loss 0.16496. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 210: loss 0.15708. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 210: loss 0.15708. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 39 Iter 211: loss 0.13930. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 39 Iter 211: loss 0.13930. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 212: loss 0.20081. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 212: loss 0.20081. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 39 Iter 213: loss 0.16428. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 39 Iter 213: loss 0.16428. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 39 Iter 214: loss 0.16775. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 39 Iter 214: loss 0.16775. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 39 Iter 215: loss 0.15013. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 39 Iter 215: loss 0.15013. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 39 Iter 216: loss 0.16812. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 39 Iter 216: loss 0.16812. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 39 Iter 217: loss 0.16251. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 39 Iter 217: loss 0.16251. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 39 Iter 218: loss 0.17898. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 39 Iter 218: loss 0.17898. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 39 Iter 219: loss 0.16900. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 39 Iter 219: loss 0.16900. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.08it/s]
Epoch 39 Iter 220: loss 0.15431. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 39 Iter 220: loss 0.15431. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 39 Iter 221: loss 0.18151. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 39 Iter 221: loss 0.18151. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 39 Iter 222: loss 0.16122. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 39 Iter 222: loss 0.16122. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 39 Iter 223: loss 0.15198. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 39 Iter 223: loss 0.15198. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 39 Iter 224: loss 0.13697. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 39 Iter 224: loss 0.13697. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.13697. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.16315
    Valid loss: 0.17059
       Valid loss recons: 0.17059
       Valid loss KL-D:   124065.27947
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.18343. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.18343. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 40 Iter 2: loss 0.15728. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 40 Iter 2: loss 0.15728. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 40 Iter 3: loss 0.17197. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 40 Iter 3: loss 0.17197. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 4: loss 0.16554. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 4: loss 0.16554. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 5: loss 0.17841. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 40 Iter 5: loss 0.17841. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 40 Iter 6: loss 0.15921. :   2%|█                                              | 5/224 [00:02<01:46,  2.07it/s]
Epoch 40 Iter 6: loss 0.15921. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 40 Iter 7: loss 0.15698. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 40 Iter 7: loss 0.15698. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 8: loss 0.17029. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 8: loss 0.17029. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 9: loss 0.17129. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 40 Iter 9: loss 0.17129. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.08it/s]
Epoch 40 Iter 10: loss 0.16543. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 40 Iter 10: loss 0.16543. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 40 Iter 11: loss 0.18187. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 40 Iter 11: loss 0.18187. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 40 Iter 12: loss 0.19023. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 40 Iter 12: loss 0.19023. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 40 Iter 13: loss 0.17052. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 40 Iter 13: loss 0.17052. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 40 Iter 14: loss 0.14558. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 40 Iter 14: loss 0.14558. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 15: loss 0.17352. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 40 Iter 15: loss 0.17352. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.15615. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.15615. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 40 Iter 17: loss 0.17412. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 40 Iter 17: loss 0.17412. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 40 Iter 18: loss 0.14762. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 40 Iter 18: loss 0.14762. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 40 Iter 19: loss 0.16900. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 40 Iter 19: loss 0.16900. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 40 Iter 20: loss 0.18092. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 40 Iter 20: loss 0.18092. :   9%|████                                         | 20/224 [00:09<01:39,  2.04it/s]
Epoch 40 Iter 21: loss 0.17798. :   9%|████                                         | 20/224 [00:10<01:39,  2.04it/s]
Epoch 40 Iter 21: loss 0.17798. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 40 Iter 22: loss 0.15602. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 40 Iter 22: loss 0.15602. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 40 Iter 23: loss 0.15883. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 40 Iter 23: loss 0.15883. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 40 Iter 24: loss 0.17939. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 40 Iter 24: loss 0.17939. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 40 Iter 25: loss 0.16566. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 40 Iter 25: loss 0.16566. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 40 Iter 26: loss 0.17298. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 40 Iter 26: loss 0.17298. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 40 Iter 27: loss 0.16477. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 40 Iter 27: loss 0.16477. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 40 Iter 28: loss 0.15734. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 40 Iter 28: loss 0.15734. :  12%|█████▋                                       | 28/224 [00:13<01:36,  2.02it/s]
Epoch 40 Iter 29: loss 0.16691. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.02it/s]
Epoch 40 Iter 29: loss 0.16691. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.02it/s]
Epoch 40 Iter 30: loss 0.15002. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.02it/s]
Epoch 40 Iter 30: loss 0.15002. :  13%|██████                                       | 30/224 [00:14<01:35,  2.04it/s]
Epoch 40 Iter 31: loss 0.17692. :  13%|██████                                       | 30/224 [00:15<01:35,  2.04it/s]
Epoch 40 Iter 31: loss 0.17692. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 40 Iter 32: loss 0.17572. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 40 Iter 32: loss 0.17572. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 40 Iter 33: loss 0.20055. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 40 Iter 33: loss 0.20055. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 40 Iter 34: loss 0.15670. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 40 Iter 34: loss 0.15670. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 40 Iter 35: loss 0.14534. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 40 Iter 35: loss 0.14534. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.15097. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.15097. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.15914. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.15914. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.17628. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.17628. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.15609. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.15609. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.16915. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.16915. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 41: loss 0.16631. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 41: loss 0.16631. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 40 Iter 42: loss 0.16466. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 40 Iter 42: loss 0.16466. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.18036. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.18036. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 44: loss 0.15687. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 40 Iter 44: loss 0.15687. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 40 Iter 45: loss 0.15881. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 40 Iter 45: loss 0.15881. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 40 Iter 46: loss 0.15381. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 40 Iter 46: loss 0.15381. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 40 Iter 47: loss 0.15537. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 40 Iter 47: loss 0.15537. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 40 Iter 48: loss 0.14954. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 48: loss 0.14954. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.18071. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.18071. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 40 Iter 50: loss 0.16565. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 40 Iter 50: loss 0.16565. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.16574. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.16574. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 40 Iter 52: loss 0.15338. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 40 Iter 52: loss 0.15338. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 53: loss 0.16753. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 53: loss 0.16753. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.14209. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.14209. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 40 Iter 55: loss 0.18412. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 40 Iter 55: loss 0.18412. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.15976. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.15976. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 40 Iter 57: loss 0.17158. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 40 Iter 57: loss 0.17158. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 40 Iter 58: loss 0.18070. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 58: loss 0.18070. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 59: loss 0.15218. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 59: loss 0.15218. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 40 Iter 60: loss 0.16245. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 60: loss 0.16245. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 61: loss 0.16812. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 61: loss 0.16812. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.14132. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.14132. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 63: loss 0.16612. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 63: loss 0.16612. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 64: loss 0.15563. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 40 Iter 64: loss 0.15563. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 40 Iter 65: loss 0.16027. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 40 Iter 65: loss 0.16027. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.16276. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.16276. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 40 Iter 67: loss 0.13767. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 40 Iter 67: loss 0.13767. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.16489. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.16489. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 40 Iter 69: loss 0.15872. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 40 Iter 69: loss 0.15872. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 40 Iter 70: loss 0.14399. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 40 Iter 70: loss 0.14399. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 40 Iter 71: loss 0.16031. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 40 Iter 71: loss 0.16031. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 40 Iter 72: loss 0.15505. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 40 Iter 72: loss 0.15505. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.05it/s]
Epoch 40 Iter 73: loss 0.18071. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 40 Iter 73: loss 0.18071. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 40 Iter 74: loss 0.16328. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 40 Iter 74: loss 0.16328. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 40 Iter 75: loss 0.14886. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 40 Iter 75: loss 0.14886. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 40 Iter 76: loss 0.16350. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 40 Iter 76: loss 0.16350. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 40 Iter 77: loss 0.15095. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 77: loss 0.15095. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 78: loss 0.16404. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 78: loss 0.16404. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 40 Iter 79: loss 0.16330. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 40 Iter 79: loss 0.16330. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 40 Iter 80: loss 0.14815. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 40 Iter 80: loss 0.14815. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.06it/s]
Epoch 40 Iter 81: loss 0.17398. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.06it/s]
Epoch 40 Iter 81: loss 0.17398. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 40 Iter 82: loss 0.16127. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 40 Iter 82: loss 0.16127. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 40 Iter 83: loss 0.15960. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 40 Iter 83: loss 0.15960. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 40 Iter 84: loss 0.16694. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 40 Iter 84: loss 0.16694. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 40 Iter 85: loss 0.15079. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 40 Iter 85: loss 0.15079. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 40 Iter 86: loss 0.16084. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 40 Iter 86: loss 0.16084. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 87: loss 0.16720. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 40 Iter 87: loss 0.16720. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 40 Iter 88: loss 0.16524. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 40 Iter 88: loss 0.16524. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 40 Iter 89: loss 0.16625. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 40 Iter 89: loss 0.16625. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 40 Iter 90: loss 0.16678. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 40 Iter 90: loss 0.16678. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.04it/s]
Epoch 40 Iter 91: loss 0.15949. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 40 Iter 91: loss 0.15949. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 40 Iter 92: loss 0.16386. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 40 Iter 92: loss 0.16386. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.03it/s]
Epoch 40 Iter 93: loss 0.13439. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.03it/s]
Epoch 40 Iter 93: loss 0.13439. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.03it/s]
Epoch 40 Iter 94: loss 0.15954. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.03it/s]
Epoch 40 Iter 94: loss 0.15954. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 40 Iter 95: loss 0.17051. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 40 Iter 95: loss 0.17051. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 40 Iter 96: loss 0.19215. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 40 Iter 96: loss 0.19215. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 40 Iter 97: loss 0.14931. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 40 Iter 97: loss 0.14931. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 98: loss 0.15445. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 98: loss 0.15445. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 99: loss 0.16677. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 40 Iter 99: loss 0.16677. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 40 Iter 100: loss 0.16299. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 40 Iter 100: loss 0.16299. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 40 Iter 101: loss 0.15833. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 40 Iter 101: loss 0.15833. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 40 Iter 102: loss 0.15880. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 40 Iter 102: loss 0.15880. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 40 Iter 103: loss 0.14925. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.07it/s]
Epoch 40 Iter 103: loss 0.14925. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 40 Iter 104: loss 0.15621. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 40 Iter 104: loss 0.15621. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 40 Iter 105: loss 0.16304. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 40 Iter 105: loss 0.16304. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.15749. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.15749. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 40 Iter 107: loss 0.15093. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 40 Iter 107: loss 0.15093. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 40 Iter 108: loss 0.16621. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 108: loss 0.16621. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.16530. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.16530. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 40 Iter 110: loss 0.15348. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 40 Iter 110: loss 0.15348. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 40 Iter 111: loss 0.16953. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 40 Iter 111: loss 0.16953. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 40 Iter 112: loss 0.14535. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 40 Iter 112: loss 0.14535. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 40 Iter 113: loss 0.17116. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 40 Iter 113: loss 0.17116. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 40 Iter 114: loss 0.16530. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 40 Iter 114: loss 0.16530. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.16272. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.16272. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.16078. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.16078. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 40 Iter 117: loss 0.14545. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 40 Iter 117: loss 0.14545. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 40 Iter 118: loss 0.16861. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 40 Iter 118: loss 0.16861. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 40 Iter 119: loss 0.15482. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 40 Iter 119: loss 0.15482. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 40 Iter 120: loss 0.14825. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 40 Iter 120: loss 0.14825. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 40 Iter 121: loss 0.17418. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 40 Iter 121: loss 0.17418. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 40 Iter 122: loss 0.15628. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 40 Iter 122: loss 0.15628. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 40 Iter 123: loss 0.15638. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 40 Iter 123: loss 0.15638. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 40 Iter 124: loss 0.17365. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 40 Iter 124: loss 0.17365. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 40 Iter 125: loss 0.15207. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 40 Iter 125: loss 0.15207. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 40 Iter 126: loss 0.16270. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.06it/s]
Epoch 40 Iter 126: loss 0.16270. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 40 Iter 127: loss 0.17143. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 40 Iter 127: loss 0.17143. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 40 Iter 128: loss 0.16663. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 40 Iter 128: loss 0.16663. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 40 Iter 129: loss 0.15127. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 40 Iter 129: loss 0.15127. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 40 Iter 130: loss 0.17255. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 40 Iter 130: loss 0.17255. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 40 Iter 131: loss 0.13653. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 40 Iter 131: loss 0.13653. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 132: loss 0.15747. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 40 Iter 132: loss 0.15747. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 40 Iter 133: loss 0.15236. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 40 Iter 133: loss 0.15236. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 40 Iter 134: loss 0.16076. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.09it/s]
Epoch 40 Iter 134: loss 0.16076. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 40 Iter 135: loss 0.14852. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 40 Iter 135: loss 0.14852. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 40 Iter 136: loss 0.16611. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.08it/s]
Epoch 40 Iter 136: loss 0.16611. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 40 Iter 137: loss 0.19072. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 40 Iter 137: loss 0.19072. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 40 Iter 138: loss 0.15214. :  61%|██████████████████████████▎                | 137/224 [01:07<00:41,  2.07it/s]
Epoch 40 Iter 138: loss 0.15214. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 40 Iter 139: loss 0.16195. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 40 Iter 139: loss 0.16195. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 40 Iter 140: loss 0.17021. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 40 Iter 140: loss 0.17021. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 40 Iter 141: loss 0.14705. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 40 Iter 141: loss 0.14705. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 40 Iter 142: loss 0.17163. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 40 Iter 142: loss 0.17163. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.15756. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.15756. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.16441. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.16441. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 40 Iter 145: loss 0.16403. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 145: loss 0.16403. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 146: loss 0.15664. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 146: loss 0.15664. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.15630. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.15630. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 40 Iter 148: loss 0.16464. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 40 Iter 148: loss 0.16464. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 40 Iter 149: loss 0.15138. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 40 Iter 149: loss 0.15138. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 150: loss 0.16452. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 150: loss 0.16452. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 151: loss 0.16508. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.06it/s]
Epoch 40 Iter 151: loss 0.16508. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 152: loss 0.17320. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 152: loss 0.17320. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 153: loss 0.18137. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 40 Iter 153: loss 0.18137. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 40 Iter 154: loss 0.16134. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 40 Iter 154: loss 0.16134. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 40 Iter 155: loss 0.16422. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 40 Iter 155: loss 0.16422. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 40 Iter 156: loss 0.16149. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 40 Iter 156: loss 0.16149. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 40 Iter 157: loss 0.18073. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 40 Iter 157: loss 0.18073. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 40 Iter 158: loss 0.14394. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 40 Iter 158: loss 0.14394. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 40 Iter 159: loss 0.16093. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 159: loss 0.16093. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 160: loss 0.15276. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 160: loss 0.15276. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.03it/s]
Epoch 40 Iter 161: loss 0.15363. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.03it/s]
Epoch 40 Iter 161: loss 0.15363. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 40 Iter 162: loss 0.15652. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.04it/s]
Epoch 40 Iter 162: loss 0.15652. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 40 Iter 163: loss 0.16844. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 40 Iter 163: loss 0.16844. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 40 Iter 164: loss 0.15640. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 40 Iter 164: loss 0.15640. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.19552. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.19552. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 40 Iter 166: loss 0.17074. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 40 Iter 166: loss 0.17074. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 40 Iter 167: loss 0.17738. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 40 Iter 167: loss 0.17738. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.09it/s]
Epoch 40 Iter 168: loss 0.16191. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.09it/s]
Epoch 40 Iter 168: loss 0.16191. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.11it/s]
Epoch 40 Iter 169: loss 0.15617. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.11it/s]
Epoch 40 Iter 169: loss 0.15617. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.10it/s]
Epoch 40 Iter 170: loss 0.13989. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.10it/s]
Epoch 40 Iter 170: loss 0.13989. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 40 Iter 171: loss 0.15689. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 40 Iter 171: loss 0.15689. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 40 Iter 172: loss 0.16164. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 40 Iter 172: loss 0.16164. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 40 Iter 173: loss 0.18898. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 40 Iter 173: loss 0.18898. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 40 Iter 174: loss 0.16689. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 40 Iter 174: loss 0.16689. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 40 Iter 175: loss 0.16641. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 40 Iter 175: loss 0.16641. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.09it/s]
Epoch 40 Iter 176: loss 0.15495. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.09it/s]
Epoch 40 Iter 176: loss 0.15495. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.09it/s]
Epoch 40 Iter 177: loss 0.14814. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.09it/s]
Epoch 40 Iter 177: loss 0.14814. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.10it/s]
Epoch 40 Iter 178: loss 0.18519. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.10it/s]
Epoch 40 Iter 178: loss 0.18519. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 40 Iter 179: loss 0.16064. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 40 Iter 179: loss 0.16064. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 40 Iter 180: loss 0.16467. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 40 Iter 180: loss 0.16467. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 40 Iter 181: loss 0.18507. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 40 Iter 181: loss 0.18507. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 40 Iter 182: loss 0.16857. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 40 Iter 182: loss 0.16857. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 40 Iter 183: loss 0.15286. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 40 Iter 183: loss 0.15286. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 40 Iter 184: loss 0.16404. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 184: loss 0.16404. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 185: loss 0.15456. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 185: loss 0.15456. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 40 Iter 186: loss 0.16711. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.04it/s]
Epoch 40 Iter 186: loss 0.16711. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 40 Iter 187: loss 0.16223. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 40 Iter 187: loss 0.16223. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 40 Iter 188: loss 0.13667. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 40 Iter 188: loss 0.13667. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 40 Iter 189: loss 0.16037. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 40 Iter 189: loss 0.16037. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.03it/s]
Epoch 40 Iter 190: loss 0.17304. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.03it/s]
Epoch 40 Iter 190: loss 0.17304. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.04it/s]
Epoch 40 Iter 191: loss 0.16905. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.04it/s]
Epoch 40 Iter 191: loss 0.16905. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.14977. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.14977. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 40 Iter 193: loss 0.16580. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 40 Iter 193: loss 0.16580. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 40 Iter 194: loss 0.17838. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 40 Iter 194: loss 0.17838. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.16057. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.16057. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 40 Iter 196: loss 0.17570. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 40 Iter 196: loss 0.17570. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.14810. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.14810. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 40 Iter 198: loss 0.13487. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 40 Iter 198: loss 0.13487. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 40 Iter 199: loss 0.14989. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 40 Iter 199: loss 0.14989. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 40 Iter 200: loss 0.15817. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 40 Iter 200: loss 0.15817. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 40 Iter 201: loss 0.15236. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 40 Iter 201: loss 0.15236. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 40 Iter 202: loss 0.16514. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 40 Iter 202: loss 0.16514. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 40 Iter 203: loss 0.16741. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 40 Iter 203: loss 0.16741. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 40 Iter 204: loss 0.13884. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 40 Iter 204: loss 0.13884. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.08it/s]
Epoch 40 Iter 205: loss 0.13792. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.08it/s]
Epoch 40 Iter 205: loss 0.13792. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 40 Iter 206: loss 0.14621. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 40 Iter 206: loss 0.14621. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 40 Iter 207: loss 0.14854. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 40 Iter 207: loss 0.14854. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 40 Iter 208: loss 0.17431. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 40 Iter 208: loss 0.17431. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 40 Iter 209: loss 0.16110. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 40 Iter 209: loss 0.16110. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 40 Iter 210: loss 0.14971. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 40 Iter 210: loss 0.14971. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 40 Iter 211: loss 0.17700. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 40 Iter 211: loss 0.17700. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 40 Iter 212: loss 0.16417. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 40 Iter 212: loss 0.16417. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 40 Iter 213: loss 0.17787. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 40 Iter 213: loss 0.17787. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 40 Iter 214: loss 0.15413. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 40 Iter 214: loss 0.15413. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.04it/s]
Epoch 40 Iter 215: loss 0.15249. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.04it/s]
Epoch 40 Iter 215: loss 0.15249. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 40 Iter 216: loss 0.16282. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 40 Iter 216: loss 0.16282. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 40 Iter 217: loss 0.14670. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 217: loss 0.14670. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 218: loss 0.15582. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 218: loss 0.15582. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 40 Iter 219: loss 0.14465. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 40 Iter 219: loss 0.14465. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 40 Iter 220: loss 0.16345. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 40 Iter 220: loss 0.16345. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 40 Iter 221: loss 0.17109. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 40 Iter 221: loss 0.17109. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 40 Iter 222: loss 0.16801. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 40 Iter 222: loss 0.16801. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 40 Iter 223: loss 0.17002. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 40 Iter 223: loss 0.17002. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 40 Iter 224: loss 0.17830. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 40 Iter 224: loss 0.17830. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 40 Iter 224: loss 0.17830. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.14446. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.14446. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 41 Iter 2: loss 0.15644. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 41 Iter 2: loss 0.15644. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.15848. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.15848. :   1%|▋                                              | 3/224 [00:01<01:45,  2.09it/s]
Epoch 41 Iter 4: loss 0.16433. :   1%|▋                                              | 3/224 [00:01<01:45,  2.09it/s]
Epoch 41 Iter 4: loss 0.16433. :   2%|▊                                              | 4/224 [00:01<01:45,  2.09it/s]
Epoch 41 Iter 5: loss 0.15934. :   2%|▊                                              | 4/224 [00:02<01:45,  2.09it/s]
Epoch 41 Iter 5: loss 0.15934. :   2%|█                                              | 5/224 [00:02<01:44,  2.09it/s]
Epoch 41 Iter 6: loss 0.16513. :   2%|█                                              | 5/224 [00:02<01:44,  2.09it/s]
Epoch 41 Iter 6: loss 0.16513. :   3%|█▎                                             | 6/224 [00:02<01:44,  2.09it/s]
Epoch 41 Iter 7: loss 0.14673. :   3%|█▎                                             | 6/224 [00:03<01:44,  2.09it/s]
Epoch 41 Iter 7: loss 0.14673. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.09it/s]
Epoch 41 Iter 8: loss 0.14839. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.09it/s]
Epoch 41 Iter 8: loss 0.14839. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.08it/s]
Epoch 41 Iter 9: loss 0.15827. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.08it/s]
Epoch 41 Iter 9: loss 0.15827. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 10: loss 0.16652. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 10: loss 0.16652. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 11: loss 0.18898. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 41 Iter 11: loss 0.18898. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 41 Iter 12: loss 0.16887. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 41 Iter 12: loss 0.16887. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.15590. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.15590. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 14: loss 0.17686. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 14: loss 0.17686. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 41 Iter 15: loss 0.18763. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 41 Iter 15: loss 0.18763. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 41 Iter 16: loss 0.14704. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 41 Iter 16: loss 0.14704. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.02it/s]
Epoch 41 Iter 17: loss 0.18088. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.02it/s]
Epoch 41 Iter 17: loss 0.18088. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 41 Iter 18: loss 0.17776. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 41 Iter 18: loss 0.17776. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.04it/s]
Epoch 41 Iter 19: loss 0.15799. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.04it/s]
Epoch 41 Iter 19: loss 0.15799. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.03it/s]
Epoch 41 Iter 20: loss 0.14814. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.03it/s]
Epoch 41 Iter 20: loss 0.14814. :   9%|████                                         | 20/224 [00:09<01:40,  2.04it/s]
Epoch 41 Iter 21: loss 0.16334. :   9%|████                                         | 20/224 [00:10<01:40,  2.04it/s]
Epoch 41 Iter 21: loss 0.16334. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 41 Iter 22: loss 0.14234. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 41 Iter 22: loss 0.14234. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 41 Iter 23: loss 0.15962. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 41 Iter 23: loss 0.15962. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 41 Iter 24: loss 0.16326. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 41 Iter 24: loss 0.16326. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 41 Iter 25: loss 0.14316. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 41 Iter 25: loss 0.14316. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 26: loss 0.16055. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 26: loss 0.16055. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 27: loss 0.14186. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 41 Iter 27: loss 0.14186. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 41 Iter 28: loss 0.16393. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 41 Iter 28: loss 0.16393. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.15974. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.15974. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 30: loss 0.15764. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 30: loss 0.15764. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 31: loss 0.14913. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 41 Iter 31: loss 0.14913. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 32: loss 0.15447. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 32: loss 0.15447. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 41 Iter 33: loss 0.15148. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 41 Iter 33: loss 0.15148. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 41 Iter 34: loss 0.15614. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 41 Iter 34: loss 0.15614. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.16603. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.16603. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 36: loss 0.16848. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 41 Iter 36: loss 0.16848. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 41 Iter 37: loss 0.14310. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 41 Iter 37: loss 0.14310. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.05it/s]
Epoch 41 Iter 38: loss 0.15126. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 41 Iter 38: loss 0.15126. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 39: loss 0.16163. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 39: loss 0.16163. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.05it/s]
Epoch 41 Iter 40: loss 0.16393. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 41 Iter 40: loss 0.16393. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 41 Iter 41: loss 0.16203. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 41 Iter 41: loss 0.16203. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 41 Iter 42: loss 0.17062. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 41 Iter 42: loss 0.17062. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 41 Iter 43: loss 0.16482. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 41 Iter 43: loss 0.16482. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 41 Iter 44: loss 0.15887. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 41 Iter 44: loss 0.15887. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 41 Iter 45: loss 0.13724. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 41 Iter 45: loss 0.13724. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 41 Iter 46: loss 0.17615. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 41 Iter 46: loss 0.17615. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 41 Iter 47: loss 0.16934. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 41 Iter 47: loss 0.16934. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.05it/s]
Epoch 41 Iter 48: loss 0.17351. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.05it/s]
Epoch 41 Iter 48: loss 0.17351. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 41 Iter 49: loss 0.16336. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 41 Iter 49: loss 0.16336. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 41 Iter 50: loss 0.17219. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 41 Iter 50: loss 0.17219. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 41 Iter 51: loss 0.15677. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 41 Iter 51: loss 0.15677. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 41 Iter 52: loss 0.16960. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 41 Iter 52: loss 0.16960. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.05it/s]
Epoch 41 Iter 53: loss 0.14591. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.05it/s]
Epoch 41 Iter 53: loss 0.14591. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.04it/s]
Epoch 41 Iter 54: loss 0.14127. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.04it/s]
Epoch 41 Iter 54: loss 0.14127. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 41 Iter 55: loss 0.16972. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 41 Iter 55: loss 0.16972. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 41 Iter 56: loss 0.15013. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 41 Iter 56: loss 0.15013. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 41 Iter 57: loss 0.16821. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 41 Iter 57: loss 0.16821. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 41 Iter 58: loss 0.15047. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 41 Iter 58: loss 0.15047. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 41 Iter 59: loss 0.17117. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 41 Iter 59: loss 0.17117. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.04it/s]
Epoch 41 Iter 60: loss 0.16589. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.04it/s]
Epoch 41 Iter 60: loss 0.16589. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 41 Iter 61: loss 0.16691. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 41 Iter 61: loss 0.16691. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 41 Iter 62: loss 0.14820. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 41 Iter 62: loss 0.14820. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 41 Iter 63: loss 0.17683. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 41 Iter 63: loss 0.17683. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.06it/s]
Epoch 41 Iter 64: loss 0.16406. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.06it/s]
Epoch 41 Iter 64: loss 0.16406. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.14905. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.14905. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.17973. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.17973. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.15897. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.15897. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 41 Iter 68: loss 0.17547. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 41 Iter 68: loss 0.17547. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 41 Iter 69: loss 0.15521. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 41 Iter 69: loss 0.15521. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 41 Iter 70: loss 0.14679. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 41 Iter 70: loss 0.14679. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 71: loss 0.17645. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 71: loss 0.17645. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 72: loss 0.16391. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 72: loss 0.16391. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 41 Iter 73: loss 0.15478. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 41 Iter 73: loss 0.15478. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 41 Iter 74: loss 0.15548. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 41 Iter 74: loss 0.15548. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 41 Iter 75: loss 0.17417. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 41 Iter 75: loss 0.17417. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 41 Iter 76: loss 0.14873. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 41 Iter 76: loss 0.14873. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 41 Iter 77: loss 0.17624. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 41 Iter 77: loss 0.17624. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 41 Iter 78: loss 0.17441. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 41 Iter 78: loss 0.17441. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 41 Iter 79: loss 0.14167. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 41 Iter 79: loss 0.14167. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 41 Iter 80: loss 0.16583. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 41 Iter 80: loss 0.16583. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 41 Iter 81: loss 0.14519. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 41 Iter 81: loss 0.14519. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 41 Iter 82: loss 0.14633. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 41 Iter 82: loss 0.14633. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 41 Iter 83: loss 0.15816. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 41 Iter 83: loss 0.15816. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 41 Iter 84: loss 0.15579. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 41 Iter 84: loss 0.15579. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 41 Iter 85: loss 0.15379. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 41 Iter 85: loss 0.15379. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 41 Iter 86: loss 0.16200. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 41 Iter 86: loss 0.16200. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 41 Iter 87: loss 0.15441. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 41 Iter 87: loss 0.15441. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 41 Iter 88: loss 0.15227. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 41 Iter 88: loss 0.15227. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 41 Iter 89: loss 0.16607. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 41 Iter 89: loss 0.16607. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 41 Iter 90: loss 0.18282. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 41 Iter 90: loss 0.18282. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 41 Iter 91: loss 0.15100. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 41 Iter 91: loss 0.15100. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 41 Iter 92: loss 0.18517. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 41 Iter 92: loss 0.18517. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 41 Iter 93: loss 0.18008. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 41 Iter 93: loss 0.18008. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 41 Iter 94: loss 0.15769. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 41 Iter 94: loss 0.15769. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 41 Iter 95: loss 0.16110. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 41 Iter 95: loss 0.16110. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 41 Iter 96: loss 0.16877. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 41 Iter 96: loss 0.16877. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 41 Iter 97: loss 0.16727. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 41 Iter 97: loss 0.16727. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 41 Iter 98: loss 0.19026. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 41 Iter 98: loss 0.19026. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 41 Iter 99: loss 0.15251. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 41 Iter 99: loss 0.15251. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 41 Iter 100: loss 0.15709. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 41 Iter 100: loss 0.15709. :  45%|███████████████████▏                       | 100/224 [00:48<01:01,  2.03it/s]
Epoch 41 Iter 101: loss 0.16405. :  45%|███████████████████▏                       | 100/224 [00:49<01:01,  2.03it/s]
Epoch 41 Iter 101: loss 0.16405. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 41 Iter 102: loss 0.19990. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 41 Iter 102: loss 0.19990. :  46%|███████████████████▌                       | 102/224 [00:49<01:00,  2.02it/s]
Epoch 41 Iter 103: loss 0.16206. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.02it/s]
Epoch 41 Iter 103: loss 0.16206. :  46%|███████████████████▊                       | 103/224 [00:50<01:00,  2.01it/s]
Epoch 41 Iter 104: loss 0.17116. :  46%|███████████████████▊                       | 103/224 [00:50<01:00,  2.01it/s]
Epoch 41 Iter 104: loss 0.17116. :  46%|███████████████████▉                       | 104/224 [00:50<00:59,  2.03it/s]
Epoch 41 Iter 105: loss 0.15149. :  46%|███████████████████▉                       | 104/224 [00:51<00:59,  2.03it/s]
Epoch 41 Iter 105: loss 0.15149. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.04it/s]
Epoch 41 Iter 106: loss 0.16656. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.04it/s]
Epoch 41 Iter 106: loss 0.16656. :  47%|████████████████████▎                      | 106/224 [00:51<00:58,  2.03it/s]
Epoch 41 Iter 107: loss 0.14608. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.03it/s]
Epoch 41 Iter 107: loss 0.14608. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.04it/s]
Epoch 41 Iter 108: loss 0.17005. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.04it/s]
Epoch 41 Iter 108: loss 0.17005. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 41 Iter 109: loss 0.16308. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.05it/s]
Epoch 41 Iter 109: loss 0.16308. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.03it/s]
Epoch 41 Iter 110: loss 0.17160. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.03it/s]
Epoch 41 Iter 110: loss 0.17160. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.04it/s]
Epoch 41 Iter 111: loss 0.15374. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.04it/s]
Epoch 41 Iter 111: loss 0.15374. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.05it/s]
Epoch 41 Iter 112: loss 0.16801. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.05it/s]
Epoch 41 Iter 112: loss 0.16801. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 41 Iter 113: loss 0.17537. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 41 Iter 113: loss 0.17537. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.06it/s]
Epoch 41 Iter 114: loss 0.15952. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.06it/s]
Epoch 41 Iter 114: loss 0.15952. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 41 Iter 115: loss 0.15408. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 41 Iter 115: loss 0.15408. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 41 Iter 116: loss 0.14235. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 41 Iter 116: loss 0.14235. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 41 Iter 117: loss 0.16060. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 41 Iter 117: loss 0.16060. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 41 Iter 118: loss 0.17450. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 41 Iter 118: loss 0.17450. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 41 Iter 119: loss 0.15573. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 41 Iter 119: loss 0.15573. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.16342. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.16342. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.16511. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.16511. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 122: loss 0.17122. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 41 Iter 122: loss 0.17122. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 41 Iter 123: loss 0.17087. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 41 Iter 123: loss 0.17087. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 41 Iter 124: loss 0.16774. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 41 Iter 124: loss 0.16774. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 41 Iter 125: loss 0.15741. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 41 Iter 125: loss 0.15741. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 41 Iter 126: loss 0.15384. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 41 Iter 126: loss 0.15384. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 41 Iter 127: loss 0.15866. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 41 Iter 127: loss 0.15866. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 41 Iter 128: loss 0.15056. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 41 Iter 128: loss 0.15056. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 41 Iter 129: loss 0.16809. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 41 Iter 129: loss 0.16809. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 41 Iter 130: loss 0.14940. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 41 Iter 130: loss 0.14940. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 41 Iter 131: loss 0.15096. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 41 Iter 131: loss 0.15096. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 41 Iter 132: loss 0.16367. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 41 Iter 132: loss 0.16367. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.16262. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.16262. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 134: loss 0.14377. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 41 Iter 134: loss 0.14377. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 135: loss 0.16427. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 135: loss 0.16427. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 136: loss 0.18102. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 41 Iter 136: loss 0.18102. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.05it/s]
Epoch 41 Iter 137: loss 0.15749. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.05it/s]
Epoch 41 Iter 137: loss 0.15749. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 41 Iter 138: loss 0.15613. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 41 Iter 138: loss 0.15613. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 41 Iter 139: loss 0.14769. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 41 Iter 139: loss 0.14769. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 41 Iter 140: loss 0.16094. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 41 Iter 140: loss 0.16094. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 41 Iter 141: loss 0.15901. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 41 Iter 141: loss 0.15901. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 41 Iter 142: loss 0.17251. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 41 Iter 142: loss 0.17251. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 41 Iter 143: loss 0.15560. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 41 Iter 143: loss 0.15560. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 144: loss 0.15246. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 41 Iter 144: loss 0.15246. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 41 Iter 145: loss 0.15793. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 41 Iter 145: loss 0.15793. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 41 Iter 146: loss 0.16955. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 41 Iter 146: loss 0.16955. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 147: loss 0.18279. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 147: loss 0.18279. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 148: loss 0.18081. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 148: loss 0.18081. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 41 Iter 149: loss 0.16462. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 149: loss 0.16462. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 41 Iter 150: loss 0.18318. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 41 Iter 150: loss 0.18318. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 41 Iter 151: loss 0.15271. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 41 Iter 151: loss 0.15271. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 41 Iter 152: loss 0.16108. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 41 Iter 152: loss 0.16108. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 41 Iter 153: loss 0.15177. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 41 Iter 153: loss 0.15177. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 41 Iter 154: loss 0.17050. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 41 Iter 154: loss 0.17050. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 41 Iter 155: loss 0.17239. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 41 Iter 155: loss 0.17239. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 41 Iter 156: loss 0.16123. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 41 Iter 156: loss 0.16123. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 41 Iter 157: loss 0.17210. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.08it/s]
Epoch 41 Iter 157: loss 0.17210. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 41 Iter 158: loss 0.13930. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 41 Iter 158: loss 0.13930. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 41 Iter 159: loss 0.16804. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 41 Iter 159: loss 0.16804. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 41 Iter 160: loss 0.15182. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 41 Iter 160: loss 0.15182. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.16986. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.16986. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.16768. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.16768. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 41 Iter 163: loss 0.17105. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.08it/s]
Epoch 41 Iter 163: loss 0.17105. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.15483. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.15483. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 41 Iter 165: loss 0.19073. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.09it/s]
Epoch 41 Iter 165: loss 0.19073. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.09it/s]
Epoch 41 Iter 166: loss 0.14918. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.09it/s]
Epoch 41 Iter 166: loss 0.14918. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 41 Iter 167: loss 0.15635. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:27,  2.08it/s]
Epoch 41 Iter 167: loss 0.15635. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 41 Iter 168: loss 0.16381. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 41 Iter 168: loss 0.16381. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 41 Iter 169: loss 0.17455. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:26,  2.08it/s]
Epoch 41 Iter 169: loss 0.17455. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 41 Iter 170: loss 0.14121. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 41 Iter 170: loss 0.14121. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 41 Iter 171: loss 0.16789. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:25,  2.08it/s]
Epoch 41 Iter 171: loss 0.16789. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 41 Iter 172: loss 0.16899. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 41 Iter 172: loss 0.16899. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 41 Iter 173: loss 0.14699. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.08it/s]
Epoch 41 Iter 173: loss 0.14699. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 41 Iter 174: loss 0.16598. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 41 Iter 174: loss 0.16598. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 41 Iter 175: loss 0.16530. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 41 Iter 175: loss 0.16530. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 41 Iter 176: loss 0.16966. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 41 Iter 176: loss 0.16966. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 41 Iter 177: loss 0.17718. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 41 Iter 177: loss 0.17718. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 41 Iter 178: loss 0.16981. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 41 Iter 178: loss 0.16981. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 41 Iter 179: loss 0.16945. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 41 Iter 179: loss 0.16945. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 41 Iter 180: loss 0.16736. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 41 Iter 180: loss 0.16736. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 41 Iter 181: loss 0.15748. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 41 Iter 181: loss 0.15748. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 41 Iter 182: loss 0.15865. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 41 Iter 182: loss 0.15865. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 41 Iter 183: loss 0.17124. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 41 Iter 183: loss 0.17124. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 41 Iter 184: loss 0.16536. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 41 Iter 184: loss 0.16536. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 41 Iter 185: loss 0.13802. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 41 Iter 185: loss 0.13802. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 41 Iter 186: loss 0.17338. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 41 Iter 186: loss 0.17338. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 41 Iter 187: loss 0.15701. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 41 Iter 187: loss 0.15701. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 41 Iter 188: loss 0.18506. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 41 Iter 188: loss 0.18506. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 41 Iter 189: loss 0.15274. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 41 Iter 189: loss 0.15274. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 41 Iter 190: loss 0.15982. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 41 Iter 190: loss 0.15982. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 41 Iter 191: loss 0.16138. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 41 Iter 191: loss 0.16138. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 41 Iter 192: loss 0.14937. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 41 Iter 192: loss 0.14937. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 41 Iter 193: loss 0.17327. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 41 Iter 193: loss 0.17327. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 41 Iter 194: loss 0.15673. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 41 Iter 194: loss 0.15673. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 41 Iter 195: loss 0.15816. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 41 Iter 195: loss 0.15816. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 41 Iter 196: loss 0.16910. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.08it/s]
Epoch 41 Iter 196: loss 0.16910. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.10it/s]
Epoch 41 Iter 197: loss 0.15308. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.10it/s]
Epoch 41 Iter 197: loss 0.15308. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 41 Iter 198: loss 0.16395. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:12,  2.08it/s]
Epoch 41 Iter 198: loss 0.16395. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.09it/s]
Epoch 41 Iter 199: loss 0.16077. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.09it/s]
Epoch 41 Iter 199: loss 0.16077. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 41 Iter 200: loss 0.16857. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:11,  2.09it/s]
Epoch 41 Iter 200: loss 0.16857. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.11it/s]
Epoch 41 Iter 201: loss 0.16349. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.11it/s]
Epoch 41 Iter 201: loss 0.16349. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 41 Iter 202: loss 0.14640. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 41 Iter 202: loss 0.14640. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 41 Iter 203: loss 0.18930. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 41 Iter 203: loss 0.18930. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 41 Iter 204: loss 0.15198. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 41 Iter 204: loss 0.15198. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.08it/s]
Epoch 41 Iter 205: loss 0.16115. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.08it/s]
Epoch 41 Iter 205: loss 0.16115. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 41 Iter 206: loss 0.14564. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 41 Iter 206: loss 0.14564. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.15353. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.15353. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 41 Iter 208: loss 0.15703. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 41 Iter 208: loss 0.15703. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 41 Iter 209: loss 0.15515. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 41 Iter 209: loss 0.15515. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 41 Iter 210: loss 0.15316. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 41 Iter 210: loss 0.15316. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 41 Iter 211: loss 0.16707. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 41 Iter 211: loss 0.16707. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 41 Iter 212: loss 0.15428. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 41 Iter 212: loss 0.15428. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.17160. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.17160. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 41 Iter 214: loss 0.15969. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 41 Iter 214: loss 0.15969. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 41 Iter 215: loss 0.17273. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 41 Iter 215: loss 0.17273. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.16686. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.16686. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 41 Iter 217: loss 0.17199. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 41 Iter 217: loss 0.17199. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 41 Iter 218: loss 0.14811. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 41 Iter 218: loss 0.14811. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 41 Iter 219: loss 0.15566. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.08it/s]
Epoch 41 Iter 219: loss 0.15566. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 41 Iter 220: loss 0.15994. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 41 Iter 220: loss 0.15994. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 41 Iter 221: loss 0.17805. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.08it/s]
Epoch 41 Iter 221: loss 0.17805. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 41 Iter 222: loss 0.16067. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 41 Iter 222: loss 0.16067. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 41 Iter 223: loss 0.16327. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 41 Iter 223: loss 0.16327. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.17536. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.17536. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 41 Iter 224: loss 0.17536. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16203
    Valid loss: 0.17041
       Valid loss recons: 0.17041
       Valid loss KL-D:   145108.80824
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.15465. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.15465. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 42 Iter 2: loss 0.15935. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 42 Iter 2: loss 0.15935. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 3: loss 0.16943. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 42 Iter 3: loss 0.16943. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 42 Iter 4: loss 0.13761. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 42 Iter 4: loss 0.13761. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 42 Iter 5: loss 0.14248. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 5: loss 0.14248. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.14604. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.14604. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 42 Iter 7: loss 0.17659. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 42 Iter 7: loss 0.17659. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 42 Iter 8: loss 0.17064. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 42 Iter 8: loss 0.17064. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 42 Iter 9: loss 0.16079. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 42 Iter 9: loss 0.16079. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 42 Iter 10: loss 0.16138. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 42 Iter 10: loss 0.16138. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 11: loss 0.17725. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 42 Iter 11: loss 0.17725. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 42 Iter 12: loss 0.17087. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 42 Iter 12: loss 0.17087. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 42 Iter 13: loss 0.17423. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 42 Iter 13: loss 0.17423. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 42 Iter 14: loss 0.17261. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 42 Iter 14: loss 0.17261. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 42 Iter 15: loss 0.17070. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 15: loss 0.17070. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.13949. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.13949. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 42 Iter 17: loss 0.15962. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 42 Iter 17: loss 0.15962. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.17669. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.17669. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 42 Iter 19: loss 0.14547. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 42 Iter 19: loss 0.14547. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 42 Iter 20: loss 0.14081. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 42 Iter 20: loss 0.14081. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 42 Iter 21: loss 0.17724. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 42 Iter 21: loss 0.17724. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 42 Iter 22: loss 0.15507. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 42 Iter 22: loss 0.15507. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.04it/s]
Epoch 42 Iter 23: loss 0.16891. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.04it/s]
Epoch 42 Iter 23: loss 0.16891. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 42 Iter 24: loss 0.17611. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 42 Iter 24: loss 0.17611. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 42 Iter 25: loss 0.15995. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 42 Iter 25: loss 0.15995. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 42 Iter 26: loss 0.17258. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 42 Iter 26: loss 0.17258. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 42 Iter 27: loss 0.16688. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 42 Iter 27: loss 0.16688. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 42 Iter 28: loss 0.17674. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 42 Iter 28: loss 0.17674. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 42 Iter 29: loss 0.14350. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 29: loss 0.14350. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 30: loss 0.14547. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 30: loss 0.14547. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.15638. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.15638. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 42 Iter 32: loss 0.16497. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 42 Iter 32: loss 0.16497. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 42 Iter 33: loss 0.16044. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 42 Iter 33: loss 0.16044. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 42 Iter 34: loss 0.16886. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 42 Iter 34: loss 0.16886. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 42 Iter 35: loss 0.14887. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 42 Iter 35: loss 0.14887. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 42 Iter 36: loss 0.17116. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 42 Iter 36: loss 0.17116. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 42 Iter 37: loss 0.18288. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 42 Iter 37: loss 0.18288. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.05it/s]
Epoch 42 Iter 38: loss 0.16044. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.05it/s]
Epoch 42 Iter 38: loss 0.16044. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 42 Iter 39: loss 0.17412. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 42 Iter 39: loss 0.17412. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 42 Iter 40: loss 0.16104. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 42 Iter 40: loss 0.16104. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 42 Iter 41: loss 0.17758. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 42 Iter 41: loss 0.17758. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 42 Iter 42: loss 0.15757. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 42 Iter 42: loss 0.15757. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 42 Iter 43: loss 0.16105. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 42 Iter 43: loss 0.16105. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 42 Iter 44: loss 0.17210. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 42 Iter 44: loss 0.17210. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 42 Iter 45: loss 0.15864. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 42 Iter 45: loss 0.15864. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 42 Iter 46: loss 0.16900. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 42 Iter 46: loss 0.16900. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 42 Iter 47: loss 0.14835. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 42 Iter 47: loss 0.14835. :  21%|█████████▍                                   | 47/224 [00:22<01:27,  2.03it/s]
Epoch 42 Iter 48: loss 0.15985. :  21%|█████████▍                                   | 47/224 [00:23<01:27,  2.03it/s]
Epoch 42 Iter 48: loss 0.15985. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 42 Iter 49: loss 0.16478. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 42 Iter 49: loss 0.16478. :  22%|█████████▊                                   | 49/224 [00:23<01:26,  2.03it/s]
Epoch 42 Iter 50: loss 0.16135. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 42 Iter 50: loss 0.16135. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 42 Iter 51: loss 0.14732. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 42 Iter 51: loss 0.14732. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 42 Iter 52: loss 0.14153. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 42 Iter 52: loss 0.14153. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.03it/s]
Epoch 42 Iter 53: loss 0.15110. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.03it/s]
Epoch 42 Iter 53: loss 0.15110. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.04it/s]
Epoch 42 Iter 54: loss 0.15219. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.04it/s]
Epoch 42 Iter 54: loss 0.15219. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 42 Iter 55: loss 0.15121. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 42 Iter 55: loss 0.15121. :  25%|███████████                                  | 55/224 [00:26<01:23,  2.03it/s]
Epoch 42 Iter 56: loss 0.16925. :  25%|███████████                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 42 Iter 56: loss 0.16925. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 42 Iter 57: loss 0.17364. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 42 Iter 57: loss 0.17364. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 42 Iter 58: loss 0.16477. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 42 Iter 58: loss 0.16477. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 42 Iter 59: loss 0.14495. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 42 Iter 59: loss 0.14495. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 42 Iter 60: loss 0.16383. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 42 Iter 60: loss 0.16383. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 42 Iter 61: loss 0.12638. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 42 Iter 61: loss 0.12638. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 42 Iter 62: loss 0.17577. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 42 Iter 62: loss 0.17577. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 42 Iter 63: loss 0.14440. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 42 Iter 63: loss 0.14440. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 64: loss 0.17212. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 42 Iter 64: loss 0.17212. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 42 Iter 65: loss 0.15151. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 42 Iter 65: loss 0.15151. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 42 Iter 66: loss 0.17055. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 42 Iter 66: loss 0.17055. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.03it/s]
Epoch 42 Iter 67: loss 0.17114. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.03it/s]
Epoch 42 Iter 67: loss 0.17114. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 42 Iter 68: loss 0.14628. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 42 Iter 68: loss 0.14628. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 42 Iter 69: loss 0.14147. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 42 Iter 69: loss 0.14147. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 42 Iter 70: loss 0.16381. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 42 Iter 70: loss 0.16381. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 42 Iter 71: loss 0.17505. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 42 Iter 71: loss 0.17505. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.03it/s]
Epoch 42 Iter 72: loss 0.15649. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.03it/s]
Epoch 42 Iter 72: loss 0.15649. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 42 Iter 73: loss 0.16151. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 42 Iter 73: loss 0.16151. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.04it/s]
Epoch 42 Iter 74: loss 0.15339. :  33%|██████████████▋                              | 73/224 [00:36<01:13,  2.04it/s]
Epoch 42 Iter 74: loss 0.15339. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 42 Iter 75: loss 0.15974. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 42 Iter 75: loss 0.15974. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.04it/s]
Epoch 42 Iter 76: loss 0.15047. :  33%|███████████████                              | 75/224 [00:37<01:12,  2.04it/s]
Epoch 42 Iter 76: loss 0.15047. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 42 Iter 77: loss 0.14583. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 42 Iter 77: loss 0.14583. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.04it/s]
Epoch 42 Iter 78: loss 0.19229. :  34%|███████████████▍                             | 77/224 [00:38<01:12,  2.04it/s]
Epoch 42 Iter 78: loss 0.19229. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.04it/s]
Epoch 42 Iter 79: loss 0.15751. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.04it/s]
Epoch 42 Iter 79: loss 0.15751. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 42 Iter 80: loss 0.17382. :  35%|███████████████▊                             | 79/224 [00:39<01:10,  2.05it/s]
Epoch 42 Iter 80: loss 0.17382. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 42 Iter 81: loss 0.15107. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 42 Iter 81: loss 0.15107. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 42 Iter 82: loss 0.16930. :  36%|████████████████▎                            | 81/224 [00:40<01:10,  2.04it/s]
Epoch 42 Iter 82: loss 0.16930. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 42 Iter 83: loss 0.17060. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 42 Iter 83: loss 0.17060. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 42 Iter 84: loss 0.15218. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.04it/s]
Epoch 42 Iter 84: loss 0.15218. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 42 Iter 85: loss 0.16502. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 42 Iter 85: loss 0.16502. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 42 Iter 86: loss 0.16034. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 42 Iter 86: loss 0.16034. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 42 Iter 87: loss 0.15775. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 42 Iter 87: loss 0.15775. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 42 Iter 88: loss 0.16654. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 42 Iter 88: loss 0.16654. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 42 Iter 89: loss 0.17199. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 42 Iter 89: loss 0.17199. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 90: loss 0.16722. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 90: loss 0.16722. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 42 Iter 91: loss 0.16163. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 42 Iter 91: loss 0.16163. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 42 Iter 92: loss 0.16787. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 42 Iter 92: loss 0.16787. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 42 Iter 93: loss 0.14478. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 42 Iter 93: loss 0.14478. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 42 Iter 94: loss 0.16913. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 42 Iter 94: loss 0.16913. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 42 Iter 95: loss 0.17174. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 42 Iter 95: loss 0.17174. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 42 Iter 96: loss 0.15513. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 42 Iter 96: loss 0.15513. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 42 Iter 97: loss 0.15445. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 42 Iter 97: loss 0.15445. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 42 Iter 98: loss 0.15505. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 42 Iter 98: loss 0.15505. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 42 Iter 99: loss 0.15938. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 42 Iter 99: loss 0.15938. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 100: loss 0.17514. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 100: loss 0.17514. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 101: loss 0.17259. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 42 Iter 101: loss 0.17259. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 42 Iter 102: loss 0.14979. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 42 Iter 102: loss 0.14979. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 42 Iter 103: loss 0.14249. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.08it/s]
Epoch 42 Iter 103: loss 0.14249. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 42 Iter 104: loss 0.18493. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 42 Iter 104: loss 0.18493. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 42 Iter 105: loss 0.14754. :  46%|███████████████████▉                       | 104/224 [00:51<00:57,  2.07it/s]
Epoch 42 Iter 105: loss 0.14754. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 42 Iter 106: loss 0.15511. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 42 Iter 106: loss 0.15511. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 42 Iter 107: loss 0.17270. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 42 Iter 107: loss 0.17270. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 42 Iter 108: loss 0.15335. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 42 Iter 108: loss 0.15335. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 42 Iter 109: loss 0.14663. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.06it/s]
Epoch 42 Iter 109: loss 0.14663. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.19123. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.19123. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 111: loss 0.15151. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.06it/s]
Epoch 42 Iter 111: loss 0.15151. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.16842. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.16842. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.15517. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.15517. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.16682. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.16682. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 42 Iter 115: loss 0.18367. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.06it/s]
Epoch 42 Iter 115: loss 0.18367. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 42 Iter 116: loss 0.16170. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 42 Iter 116: loss 0.16170. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 42 Iter 117: loss 0.16130. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 42 Iter 117: loss 0.16130. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.16294. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.16294. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.16193. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.16193. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 42 Iter 120: loss 0.17382. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 120: loss 0.17382. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.16549. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.16549. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.15833. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.15833. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 42 Iter 123: loss 0.16383. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 42 Iter 123: loss 0.16383. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 42 Iter 124: loss 0.15000. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 42 Iter 124: loss 0.15000. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 125: loss 0.15955. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 125: loss 0.15955. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 42 Iter 126: loss 0.16395. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 42 Iter 126: loss 0.16395. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.16879. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.16879. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 128: loss 0.15691. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 42 Iter 128: loss 0.15691. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 129: loss 0.15820. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 129: loss 0.15820. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.16168. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.16168. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 131: loss 0.15425. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 131: loss 0.15425. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 132: loss 0.17145. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 42 Iter 132: loss 0.17145. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 42 Iter 133: loss 0.15775. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 42 Iter 133: loss 0.15775. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 42 Iter 134: loss 0.14821. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.08it/s]
Epoch 42 Iter 134: loss 0.14821. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 42 Iter 135: loss 0.16991. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 42 Iter 135: loss 0.16991. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 42 Iter 136: loss 0.16035. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.08it/s]
Epoch 42 Iter 136: loss 0.16035. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 42 Iter 137: loss 0.17344. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 42 Iter 137: loss 0.17344. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 42 Iter 138: loss 0.15674. :  61%|██████████████████████████▎                | 137/224 [01:07<00:41,  2.07it/s]
Epoch 42 Iter 138: loss 0.15674. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 42 Iter 139: loss 0.16499. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 42 Iter 139: loss 0.16499. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 42 Iter 140: loss 0.17229. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 42 Iter 140: loss 0.17229. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 141: loss 0.14083. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 141: loss 0.14083. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 42 Iter 142: loss 0.16977. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 42 Iter 142: loss 0.16977. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 42 Iter 143: loss 0.14813. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 42 Iter 143: loss 0.14813. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 42 Iter 144: loss 0.15255. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 42 Iter 144: loss 0.15255. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 42 Iter 145: loss 0.15014. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 42 Iter 145: loss 0.15014. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 42 Iter 146: loss 0.15797. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 42 Iter 146: loss 0.15797. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.15777. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.15777. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 42 Iter 148: loss 0.16757. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.05it/s]
Epoch 42 Iter 148: loss 0.16757. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.04it/s]
Epoch 42 Iter 149: loss 0.16954. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.04it/s]
Epoch 42 Iter 149: loss 0.16954. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 42 Iter 150: loss 0.17572. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 42 Iter 150: loss 0.17572. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.17086. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.17086. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 152: loss 0.17333. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 152: loss 0.17333. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 42 Iter 153: loss 0.17039. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 42 Iter 153: loss 0.17039. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 42 Iter 154: loss 0.14321. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 42 Iter 154: loss 0.14321. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.09it/s]
Epoch 42 Iter 155: loss 0.14782. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.09it/s]
Epoch 42 Iter 155: loss 0.14782. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 42 Iter 156: loss 0.17087. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 42 Iter 156: loss 0.17087. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 42 Iter 157: loss 0.15478. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 42 Iter 157: loss 0.15478. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 42 Iter 158: loss 0.14943. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 42 Iter 158: loss 0.14943. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.01it/s]
Epoch 42 Iter 159: loss 0.17146. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.01it/s]
Epoch 42 Iter 159: loss 0.17146. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 42 Iter 160: loss 0.16320. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 42 Iter 160: loss 0.16320. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 42 Iter 161: loss 0.17306. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 42 Iter 161: loss 0.17306. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 42 Iter 162: loss 0.14472. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 42 Iter 162: loss 0.14472. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 42 Iter 163: loss 0.16140. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 42 Iter 163: loss 0.16140. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 42 Iter 164: loss 0.15490. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 42 Iter 164: loss 0.15490. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 42 Iter 165: loss 0.17502. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.07it/s]
Epoch 42 Iter 165: loss 0.17502. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 42 Iter 166: loss 0.18010. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 42 Iter 166: loss 0.18010. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 42 Iter 167: loss 0.17452. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 42 Iter 167: loss 0.17452. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 42 Iter 168: loss 0.17068. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 42 Iter 168: loss 0.17068. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 42 Iter 169: loss 0.15853. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 42 Iter 169: loss 0.15853. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 42 Iter 170: loss 0.14452. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 42 Iter 170: loss 0.14452. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 42 Iter 171: loss 0.15261. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 42 Iter 171: loss 0.15261. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 42 Iter 172: loss 0.16095. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 42 Iter 172: loss 0.16095. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 42 Iter 173: loss 0.17692. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 42 Iter 173: loss 0.17692. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 42 Iter 174: loss 0.16728. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 42 Iter 174: loss 0.16728. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 42 Iter 175: loss 0.14401. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 42 Iter 175: loss 0.14401. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.16044. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.16044. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 42 Iter 177: loss 0.16155. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 42 Iter 177: loss 0.16155. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 42 Iter 178: loss 0.18285. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 42 Iter 178: loss 0.18285. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 42 Iter 179: loss 0.18042. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 42 Iter 179: loss 0.18042. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.17233. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.17233. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 42 Iter 181: loss 0.16571. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 42 Iter 181: loss 0.16571. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.17627. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.17627. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 42 Iter 183: loss 0.17142. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 42 Iter 183: loss 0.17142. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 42 Iter 184: loss 0.15019. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 42 Iter 184: loss 0.15019. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 42 Iter 185: loss 0.16160. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 42 Iter 185: loss 0.16160. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 42 Iter 186: loss 0.18220. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.09it/s]
Epoch 42 Iter 186: loss 0.18220. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 42 Iter 187: loss 0.15227. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 42 Iter 187: loss 0.15227. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 42 Iter 188: loss 0.16780. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.08it/s]
Epoch 42 Iter 188: loss 0.16780. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.08it/s]
Epoch 42 Iter 189: loss 0.16884. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.08it/s]
Epoch 42 Iter 189: loss 0.16884. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 42 Iter 190: loss 0.18014. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 42 Iter 190: loss 0.18014. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 42 Iter 191: loss 0.16930. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 42 Iter 191: loss 0.16930. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 42 Iter 192: loss 0.15910. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 42 Iter 192: loss 0.15910. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 193: loss 0.14901. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 193: loss 0.14901. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 194: loss 0.15634. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 42 Iter 194: loss 0.15634. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 42 Iter 195: loss 0.17583. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 42 Iter 195: loss 0.17583. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 42 Iter 196: loss 0.17308. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 42 Iter 196: loss 0.17308. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 42 Iter 197: loss 0.15652. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 42 Iter 197: loss 0.15652. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 42 Iter 198: loss 0.15647. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 42 Iter 198: loss 0.15647. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 199: loss 0.16851. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 199: loss 0.16851. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 200: loss 0.16220. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 42 Iter 200: loss 0.16220. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 42 Iter 201: loss 0.15775. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 42 Iter 201: loss 0.15775. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 42 Iter 202: loss 0.14205. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.08it/s]
Epoch 42 Iter 202: loss 0.14205. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.09it/s]
Epoch 42 Iter 203: loss 0.14633. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.09it/s]
Epoch 42 Iter 203: loss 0.14633. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 42 Iter 204: loss 0.14867. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 42 Iter 204: loss 0.14867. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.17565. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.17565. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 42 Iter 206: loss 0.14873. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.08it/s]
Epoch 42 Iter 206: loss 0.14873. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 207: loss 0.16735. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 207: loss 0.16735. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 208: loss 0.16154. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.07it/s]
Epoch 42 Iter 208: loss 0.16154. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 42 Iter 209: loss 0.17314. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 42 Iter 209: loss 0.17314. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 42 Iter 210: loss 0.16117. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.08it/s]
Epoch 42 Iter 210: loss 0.16117. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.04it/s]
Epoch 42 Iter 211: loss 0.18667. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.04it/s]
Epoch 42 Iter 211: loss 0.18667. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 42 Iter 212: loss 0.15543. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 42 Iter 212: loss 0.15543. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.04it/s]
Epoch 42 Iter 213: loss 0.15499. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.04it/s]
Epoch 42 Iter 213: loss 0.15499. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 42 Iter 214: loss 0.16142. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 42 Iter 214: loss 0.16142. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 42 Iter 215: loss 0.17411. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 215: loss 0.17411. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 216: loss 0.15486. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 216: loss 0.15486. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 42 Iter 217: loss 0.15430. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 42 Iter 217: loss 0.15430. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 42 Iter 218: loss 0.15734. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 42 Iter 218: loss 0.15734. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 42 Iter 219: loss 0.15259. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 42 Iter 219: loss 0.15259. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 42 Iter 220: loss 0.16715. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 42 Iter 220: loss 0.16715. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 42 Iter 221: loss 0.17356. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 42 Iter 221: loss 0.17356. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 42 Iter 222: loss 0.15199. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 42 Iter 222: loss 0.15199. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 42 Iter 223: loss 0.14992. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 42 Iter 223: loss 0.14992. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 42 Iter 224: loss 0.16203. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 42 Iter 224: loss 0.16203. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.10it/s]
Epoch 42 Iter 224: loss 0.16203. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.15887. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.15887. :   0%|▏                                              | 1/224 [00:00<01:50,  2.02it/s]
Epoch 43 Iter 2: loss 0.15054. :   0%|▏                                              | 1/224 [00:00<01:50,  2.02it/s]
Epoch 43 Iter 2: loss 0.15054. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 43 Iter 3: loss 0.16119. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 43 Iter 3: loss 0.16119. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 43 Iter 4: loss 0.16380. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 43 Iter 4: loss 0.16380. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 43 Iter 5: loss 0.16583. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 43 Iter 5: loss 0.16583. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 6: loss 0.15655. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 6: loss 0.15655. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 7: loss 0.16482. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 43 Iter 7: loss 0.16482. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 43 Iter 8: loss 0.15388. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 43 Iter 8: loss 0.15388. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 43 Iter 9: loss 0.15522. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 43 Iter 9: loss 0.15522. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.07it/s]
Epoch 43 Iter 10: loss 0.17251. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.07it/s]
Epoch 43 Iter 10: loss 0.17251. :   4%|██                                           | 10/224 [00:04<01:42,  2.08it/s]
Epoch 43 Iter 11: loss 0.16527. :   4%|██                                           | 10/224 [00:05<01:42,  2.08it/s]
Epoch 43 Iter 11: loss 0.16527. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 43 Iter 12: loss 0.13825. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 43 Iter 12: loss 0.13825. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 43 Iter 13: loss 0.17502. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 43 Iter 13: loss 0.17502. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 43 Iter 14: loss 0.15278. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 43 Iter 14: loss 0.15278. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 43 Iter 15: loss 0.17441. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 43 Iter 15: loss 0.17441. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 43 Iter 16: loss 0.14735. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 43 Iter 16: loss 0.14735. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 43 Iter 17: loss 0.16473. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 43 Iter 17: loss 0.16473. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 43 Iter 18: loss 0.16989. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 43 Iter 18: loss 0.16989. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 43 Iter 19: loss 0.15133. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 43 Iter 19: loss 0.15133. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 43 Iter 20: loss 0.16427. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 43 Iter 20: loss 0.16427. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 43 Iter 21: loss 0.17043. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 43 Iter 21: loss 0.17043. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 43 Iter 22: loss 0.16068. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 43 Iter 22: loss 0.16068. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 43 Iter 23: loss 0.17683. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 43 Iter 23: loss 0.17683. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 43 Iter 24: loss 0.16857. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 43 Iter 24: loss 0.16857. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 43 Iter 25: loss 0.17242. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 25: loss 0.17242. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 26: loss 0.17757. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 26: loss 0.17757. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.15398. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.15398. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 43 Iter 28: loss 0.14913. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 43 Iter 28: loss 0.14913. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.16904. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.16904. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 43 Iter 30: loss 0.14737. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 43 Iter 30: loss 0.14737. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 43 Iter 31: loss 0.14859. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 43 Iter 31: loss 0.14859. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 43 Iter 32: loss 0.15342. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 43 Iter 32: loss 0.15342. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 43 Iter 33: loss 0.15886. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 43 Iter 33: loss 0.15886. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.06it/s]
Epoch 43 Iter 34: loss 0.17878. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 43 Iter 34: loss 0.17878. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 43 Iter 35: loss 0.17134. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 43 Iter 35: loss 0.17134. :  16%|███████                                      | 35/224 [00:16<01:31,  2.08it/s]
Epoch 43 Iter 36: loss 0.14913. :  16%|███████                                      | 35/224 [00:17<01:31,  2.08it/s]
Epoch 43 Iter 36: loss 0.14913. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 43 Iter 37: loss 0.17178. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 43 Iter 37: loss 0.17178. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 43 Iter 38: loss 0.15608. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 43 Iter 38: loss 0.15608. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 43 Iter 39: loss 0.14571. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 43 Iter 39: loss 0.14571. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.05it/s]
Epoch 43 Iter 40: loss 0.15743. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 43 Iter 40: loss 0.15743. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 43 Iter 41: loss 0.16451. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 43 Iter 41: loss 0.16451. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.08it/s]
Epoch 43 Iter 42: loss 0.14467. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 42: loss 0.14467. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 43: loss 0.15514. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 43: loss 0.15514. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 44: loss 0.14381. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 43 Iter 44: loss 0.14381. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 43 Iter 45: loss 0.18183. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 43 Iter 45: loss 0.18183. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 43 Iter 46: loss 0.16151. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 43 Iter 46: loss 0.16151. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 43 Iter 47: loss 0.15061. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 43 Iter 47: loss 0.15061. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 43 Iter 48: loss 0.15220. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 43 Iter 48: loss 0.15220. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 43 Iter 49: loss 0.16320. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 43 Iter 49: loss 0.16320. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 43 Iter 50: loss 0.16204. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 43 Iter 50: loss 0.16204. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 43 Iter 51: loss 0.21354. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 43 Iter 51: loss 0.21354. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 43 Iter 52: loss 0.15313. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 43 Iter 52: loss 0.15313. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 43 Iter 53: loss 0.14924. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 43 Iter 53: loss 0.14924. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.17553. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.17553. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 43 Iter 55: loss 0.14920. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 43 Iter 55: loss 0.14920. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 43 Iter 56: loss 0.16742. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 43 Iter 56: loss 0.16742. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 43 Iter 57: loss 0.16279. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 43 Iter 57: loss 0.16279. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 43 Iter 58: loss 0.16605. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 43 Iter 58: loss 0.16605. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 59: loss 0.16706. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 59: loss 0.16706. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.16424. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.16424. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.18276. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.18276. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 62: loss 0.15740. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 43 Iter 62: loss 0.15740. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 43 Iter 63: loss 0.15968. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.04it/s]
Epoch 43 Iter 63: loss 0.15968. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.04it/s]
Epoch 43 Iter 64: loss 0.16350. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 64: loss 0.16350. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 65: loss 0.16297. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 65: loss 0.16297. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 43 Iter 66: loss 0.15784. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 43 Iter 66: loss 0.15784. :  29%|█████████████▎                               | 66/224 [00:31<01:17,  2.04it/s]
Epoch 43 Iter 67: loss 0.16187. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 43 Iter 67: loss 0.16187. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 43 Iter 68: loss 0.17541. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 43 Iter 68: loss 0.17541. :  30%|█████████████▋                               | 68/224 [00:32<01:16,  2.04it/s]
Epoch 43 Iter 69: loss 0.16010. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 43 Iter 69: loss 0.16010. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 43 Iter 70: loss 0.15230. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 43 Iter 70: loss 0.15230. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.04it/s]
Epoch 43 Iter 71: loss 0.18235. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 43 Iter 71: loss 0.18235. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 43 Iter 72: loss 0.18011. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 43 Iter 72: loss 0.18011. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.05it/s]
Epoch 43 Iter 73: loss 0.16986. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 43 Iter 73: loss 0.16986. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.14931. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.14931. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 75: loss 0.13834. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 43 Iter 75: loss 0.13834. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.15934. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.15934. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.18790. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.18790. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.15926. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.15926. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.19309. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.19309. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 43 Iter 80: loss 0.14758. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 43 Iter 80: loss 0.14758. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 43 Iter 81: loss 0.15016. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 43 Iter 81: loss 0.15016. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 43 Iter 82: loss 0.15378. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 43 Iter 82: loss 0.15378. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 43 Iter 83: loss 0.17086. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 83: loss 0.17086. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 84: loss 0.15512. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 84: loss 0.15512. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 43 Iter 85: loss 0.14538. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 43 Iter 85: loss 0.14538. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 43 Iter 86: loss 0.17245. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 43 Iter 86: loss 0.17245. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 43 Iter 87: loss 0.15425. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 43 Iter 87: loss 0.15425. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 43 Iter 88: loss 0.18278. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 43 Iter 88: loss 0.18278. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 43 Iter 89: loss 0.18263. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 43 Iter 89: loss 0.18263. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 43 Iter 90: loss 0.16104. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 43 Iter 90: loss 0.16104. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 43 Iter 91: loss 0.14331. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.06it/s]
Epoch 43 Iter 91: loss 0.14331. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.15630. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.15630. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 43 Iter 93: loss 0.15818. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 43 Iter 93: loss 0.15818. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 43 Iter 94: loss 0.18850. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 43 Iter 94: loss 0.18850. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 43 Iter 95: loss 0.14853. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 43 Iter 95: loss 0.14853. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 96: loss 0.16755. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 96: loss 0.16755. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 43 Iter 97: loss 0.16546. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 43 Iter 97: loss 0.16546. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 98: loss 0.15428. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 98: loss 0.15428. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 99: loss 0.17264. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 43 Iter 99: loss 0.17264. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 43 Iter 100: loss 0.18395. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 43 Iter 100: loss 0.18395. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 43 Iter 101: loss 0.17569. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 101: loss 0.17569. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 102: loss 0.15894. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 102: loss 0.15894. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 103: loss 0.16407. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 103: loss 0.16407. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 43 Iter 104: loss 0.15674. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 43 Iter 104: loss 0.15674. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 43 Iter 105: loss 0.16885. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 43 Iter 105: loss 0.16885. :  47%|████████████████████▏                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 43 Iter 106: loss 0.16226. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 43 Iter 106: loss 0.16226. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 43 Iter 107: loss 0.16351. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 43 Iter 107: loss 0.16351. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 43 Iter 108: loss 0.17694. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 43 Iter 108: loss 0.17694. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 109: loss 0.15325. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 109: loss 0.15325. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.17113. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.17113. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 111: loss 0.16261. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 111: loss 0.16261. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.04it/s]
Epoch 43 Iter 112: loss 0.16614. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.04it/s]
Epoch 43 Iter 112: loss 0.16614. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 43 Iter 113: loss 0.16098. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 43 Iter 113: loss 0.16098. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 43 Iter 114: loss 0.17506. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 43 Iter 114: loss 0.17506. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.04it/s]
Epoch 43 Iter 115: loss 0.13999. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.04it/s]
Epoch 43 Iter 115: loss 0.13999. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 116: loss 0.16203. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 43 Iter 116: loss 0.16203. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 43 Iter 117: loss 0.15595. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 43 Iter 117: loss 0.15595. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 43 Iter 118: loss 0.16990. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 43 Iter 118: loss 0.16990. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 43 Iter 119: loss 0.18221. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 43 Iter 119: loss 0.18221. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 43 Iter 120: loss 0.14330. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 43 Iter 120: loss 0.14330. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 43 Iter 121: loss 0.14856. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 43 Iter 121: loss 0.14856. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 43 Iter 122: loss 0.15409. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 122: loss 0.15409. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 43 Iter 123: loss 0.15424. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 43 Iter 123: loss 0.15424. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 124: loss 0.15947. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 43 Iter 124: loss 0.15947. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 43 Iter 125: loss 0.15666. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 43 Iter 125: loss 0.15666. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 43 Iter 126: loss 0.16567. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 126: loss 0.16567. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 43 Iter 127: loss 0.16077. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 43 Iter 127: loss 0.16077. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 43 Iter 128: loss 0.17236. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 128: loss 0.17236. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.15681. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.15681. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 43 Iter 130: loss 0.16396. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 43 Iter 130: loss 0.16396. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 43 Iter 131: loss 0.15032. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 43 Iter 131: loss 0.15032. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 43 Iter 132: loss 0.16428. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 43 Iter 132: loss 0.16428. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.18146. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.18146. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 134: loss 0.13174. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 43 Iter 134: loss 0.13174. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 43 Iter 135: loss 0.13445. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 43 Iter 135: loss 0.13445. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 43 Iter 136: loss 0.18147. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 43 Iter 136: loss 0.18147. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 43 Iter 137: loss 0.16527. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 43 Iter 137: loss 0.16527. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 43 Iter 138: loss 0.16188. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 43 Iter 138: loss 0.16188. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 43 Iter 139: loss 0.14684. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 43 Iter 139: loss 0.14684. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 43 Iter 140: loss 0.13619. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 43 Iter 140: loss 0.13619. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 43 Iter 141: loss 0.15086. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 141: loss 0.15086. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 142: loss 0.14237. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 142: loss 0.14237. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 43 Iter 143: loss 0.18522. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 43 Iter 143: loss 0.18522. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.14598. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.14598. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.17677. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.17677. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 43 Iter 146: loss 0.16400. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 43 Iter 146: loss 0.16400. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.14228. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.14228. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.17200. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.17200. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 43 Iter 149: loss 0.14861. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 43 Iter 149: loss 0.14861. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 150: loss 0.16533. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 150: loss 0.16533. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 151: loss 0.17312. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 43 Iter 151: loss 0.17312. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 43 Iter 152: loss 0.14481. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 43 Iter 152: loss 0.14481. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 43 Iter 153: loss 0.16471. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 153: loss 0.16471. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 154: loss 0.19308. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 154: loss 0.19308. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 43 Iter 155: loss 0.14768. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 43 Iter 155: loss 0.14768. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 43 Iter 156: loss 0.18233. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 43 Iter 156: loss 0.18233. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 43 Iter 157: loss 0.17442. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 43 Iter 157: loss 0.17442. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 43 Iter 158: loss 0.16989. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 43 Iter 158: loss 0.16989. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 43 Iter 159: loss 0.16881. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 43 Iter 159: loss 0.16881. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 43 Iter 160: loss 0.16425. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 43 Iter 160: loss 0.16425. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 43 Iter 161: loss 0.16741. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 43 Iter 161: loss 0.16741. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 43 Iter 162: loss 0.16269. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 43 Iter 162: loss 0.16269. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 43 Iter 163: loss 0.13958. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 43 Iter 163: loss 0.13958. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 43 Iter 164: loss 0.15554. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 43 Iter 164: loss 0.15554. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 43 Iter 165: loss 0.16912. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.07it/s]
Epoch 43 Iter 165: loss 0.16912. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.16961. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.16961. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 43 Iter 167: loss 0.15838. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 43 Iter 167: loss 0.15838. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 43 Iter 168: loss 0.15947. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 43 Iter 168: loss 0.15947. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 43 Iter 169: loss 0.14879. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 43 Iter 169: loss 0.14879. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:27,  2.03it/s]
Epoch 43 Iter 170: loss 0.17648. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:27,  2.03it/s]
Epoch 43 Iter 170: loss 0.17648. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 43 Iter 171: loss 0.16452. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 43 Iter 171: loss 0.16452. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 43 Iter 172: loss 0.16459. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 172: loss 0.16459. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 173: loss 0.16468. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 173: loss 0.16468. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 43 Iter 174: loss 0.15309. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 174: loss 0.15309. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 175: loss 0.15528. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 175: loss 0.15528. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 43 Iter 176: loss 0.15913. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 176: loss 0.15913. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 177: loss 0.16681. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 177: loss 0.16681. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.15292. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.15292. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 179: loss 0.18094. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 179: loss 0.18094. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 43 Iter 180: loss 0.16302. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 180: loss 0.16302. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 181: loss 0.16014. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 181: loss 0.16014. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 43 Iter 182: loss 0.16685. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 43 Iter 182: loss 0.16685. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.04it/s]
Epoch 43 Iter 183: loss 0.15971. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.04it/s]
Epoch 43 Iter 183: loss 0.15971. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:20,  2.05it/s]
Epoch 43 Iter 184: loss 0.14671. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:20,  2.05it/s]
Epoch 43 Iter 184: loss 0.14671. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 43 Iter 185: loss 0.13134. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 43 Iter 185: loss 0.13134. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 43 Iter 186: loss 0.15127. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.04it/s]
Epoch 43 Iter 186: loss 0.15127. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 43 Iter 187: loss 0.15182. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 43 Iter 187: loss 0.15182. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 43 Iter 188: loss 0.16674. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 43 Iter 188: loss 0.16674. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 43 Iter 189: loss 0.16471. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 43 Iter 189: loss 0.16471. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 43 Iter 190: loss 0.18021. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 43 Iter 190: loss 0.18021. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 43 Iter 191: loss 0.16211. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 43 Iter 191: loss 0.16211. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 43 Iter 192: loss 0.16901. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 43 Iter 192: loss 0.16901. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 43 Iter 193: loss 0.15292. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 43 Iter 193: loss 0.15292. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 43 Iter 194: loss 0.17001. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 43 Iter 194: loss 0.17001. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 43 Iter 195: loss 0.14074. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 43 Iter 195: loss 0.14074. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 43 Iter 196: loss 0.15238. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.05it/s]
Epoch 43 Iter 196: loss 0.15238. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 43 Iter 197: loss 0.15912. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 43 Iter 197: loss 0.15912. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 43 Iter 198: loss 0.17157. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.04it/s]
Epoch 43 Iter 198: loss 0.17157. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 43 Iter 199: loss 0.14678. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 43 Iter 199: loss 0.14678. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 43 Iter 200: loss 0.16243. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 43 Iter 200: loss 0.16243. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 43 Iter 201: loss 0.18407. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 43 Iter 201: loss 0.18407. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 43 Iter 202: loss 0.16677. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.05it/s]
Epoch 43 Iter 202: loss 0.16677. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 43 Iter 203: loss 0.17739. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 43 Iter 203: loss 0.17739. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 43 Iter 204: loss 0.18246. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 43 Iter 204: loss 0.18246. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 43 Iter 205: loss 0.15458. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 43 Iter 205: loss 0.15458. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 43 Iter 206: loss 0.15822. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 43 Iter 206: loss 0.15822. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 43 Iter 207: loss 0.16409. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 43 Iter 207: loss 0.16409. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 43 Iter 208: loss 0.14162. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 43 Iter 208: loss 0.14162. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 43 Iter 209: loss 0.15609. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 43 Iter 209: loss 0.15609. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 43 Iter 210: loss 0.16316. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 43 Iter 210: loss 0.16316. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.14823. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.14823. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 43 Iter 212: loss 0.16908. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 43 Iter 212: loss 0.16908. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.15669. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.15669. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 43 Iter 214: loss 0.15537. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 43 Iter 214: loss 0.15537. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 43 Iter 215: loss 0.17084. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 43 Iter 215: loss 0.17084. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 43 Iter 216: loss 0.16801. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 43 Iter 216: loss 0.16801. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 43 Iter 217: loss 0.15682. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 43 Iter 217: loss 0.15682. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 43 Iter 218: loss 0.17353. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 43 Iter 218: loss 0.17353. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 43 Iter 219: loss 0.16253. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.04it/s]
Epoch 43 Iter 219: loss 0.16253. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 43 Iter 220: loss 0.16575. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 43 Iter 220: loss 0.16575. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 43 Iter 221: loss 0.14687. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 43 Iter 221: loss 0.14687. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 43 Iter 222: loss 0.16198. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 43 Iter 222: loss 0.16198. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 43 Iter 223: loss 0.14614. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 43 Iter 223: loss 0.14614. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 43 Iter 224: loss 0.18122. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 43 Iter 224: loss 0.18122. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 43 Iter 224: loss 0.18122. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16188
    Valid loss: 0.17059
       Valid loss recons: 0.17059
       Valid loss KL-D:   143107.65625
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.16784. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.16784. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 44 Iter 2: loss 0.14764. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 44 Iter 2: loss 0.14764. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 44 Iter 3: loss 0.16611. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 44 Iter 3: loss 0.16611. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 44 Iter 4: loss 0.16133. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 44 Iter 4: loss 0.16133. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 44 Iter 5: loss 0.16204. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 44 Iter 5: loss 0.16204. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 44 Iter 6: loss 0.17753. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 44 Iter 6: loss 0.17753. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 44 Iter 7: loss 0.16657. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 44 Iter 7: loss 0.16657. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 44 Iter 8: loss 0.15895. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 44 Iter 8: loss 0.15895. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.08it/s]
Epoch 44 Iter 9: loss 0.17043. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.08it/s]
Epoch 44 Iter 9: loss 0.17043. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 44 Iter 10: loss 0.15405. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 44 Iter 10: loss 0.15405. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 44 Iter 11: loss 0.14181. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 44 Iter 11: loss 0.14181. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 44 Iter 12: loss 0.16604. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 44 Iter 12: loss 0.16604. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.16241. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.16241. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 44 Iter 14: loss 0.16470. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 44 Iter 14: loss 0.16470. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 44 Iter 15: loss 0.14725. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 44 Iter 15: loss 0.14725. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 44 Iter 16: loss 0.15570. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 44 Iter 16: loss 0.15570. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 44 Iter 17: loss 0.14751. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 44 Iter 17: loss 0.14751. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 44 Iter 18: loss 0.15495. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 44 Iter 18: loss 0.15495. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 44 Iter 19: loss 0.17059. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 44 Iter 19: loss 0.17059. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 44 Iter 20: loss 0.19374. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 44 Iter 20: loss 0.19374. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 44 Iter 21: loss 0.14868. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 44 Iter 21: loss 0.14868. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 44 Iter 22: loss 0.14214. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 44 Iter 22: loss 0.14214. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 44 Iter 23: loss 0.17772. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 44 Iter 23: loss 0.17772. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 44 Iter 24: loss 0.15377. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 44 Iter 24: loss 0.15377. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 44 Iter 25: loss 0.16503. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 44 Iter 25: loss 0.16503. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 44 Iter 26: loss 0.15781. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 44 Iter 26: loss 0.15781. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 44 Iter 27: loss 0.16724. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 44 Iter 27: loss 0.16724. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 28: loss 0.14467. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 28: loss 0.14467. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.16183. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.16183. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 44 Iter 30: loss 0.16301. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 44 Iter 30: loss 0.16301. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 44 Iter 31: loss 0.16823. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 31: loss 0.16823. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 32: loss 0.14916. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 32: loss 0.14916. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 44 Iter 33: loss 0.16443. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 44 Iter 33: loss 0.16443. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 44 Iter 34: loss 0.16609. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 44 Iter 34: loss 0.16609. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.16289. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.16289. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 44 Iter 36: loss 0.16943. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 44 Iter 36: loss 0.16943. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 37: loss 0.16317. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 37: loss 0.16317. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.14528. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.14528. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 39: loss 0.17115. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 39: loss 0.17115. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 44 Iter 40: loss 0.19210. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 44 Iter 40: loss 0.19210. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 44 Iter 41: loss 0.16778. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 44 Iter 41: loss 0.16778. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 44 Iter 42: loss 0.13236. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 44 Iter 42: loss 0.13236. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.15224. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.15224. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 44 Iter 44: loss 0.15850. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 44 Iter 44: loss 0.15850. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 45: loss 0.15513. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 45: loss 0.15513. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.16734. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.16734. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.15744. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.15744. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 48: loss 0.17455. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 44 Iter 48: loss 0.17455. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 44 Iter 49: loss 0.16572. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 44 Iter 49: loss 0.16572. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.15994. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.15994. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 44 Iter 51: loss 0.15929. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 44 Iter 51: loss 0.15929. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 44 Iter 52: loss 0.16379. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 44 Iter 52: loss 0.16379. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.03it/s]
Epoch 44 Iter 53: loss 0.16070. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.03it/s]
Epoch 44 Iter 53: loss 0.16070. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.04it/s]
Epoch 44 Iter 54: loss 0.15715. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.04it/s]
Epoch 44 Iter 54: loss 0.15715. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 44 Iter 55: loss 0.17694. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 44 Iter 55: loss 0.17694. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.04it/s]
Epoch 44 Iter 56: loss 0.16094. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 44 Iter 56: loss 0.16094. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 44 Iter 57: loss 0.17578. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 44 Iter 57: loss 0.17578. :  25%|███████████▍                                 | 57/224 [00:27<01:22,  2.03it/s]
Epoch 44 Iter 58: loss 0.15434. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 44 Iter 58: loss 0.15434. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 44 Iter 59: loss 0.17964. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 44 Iter 59: loss 0.17964. :  26%|███████████▊                                 | 59/224 [00:28<01:21,  2.04it/s]
Epoch 44 Iter 60: loss 0.16384. :  26%|███████████▊                                 | 59/224 [00:29<01:21,  2.04it/s]
Epoch 44 Iter 60: loss 0.16384. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 44 Iter 61: loss 0.17233. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 44 Iter 61: loss 0.17233. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 44 Iter 62: loss 0.14859. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 44 Iter 62: loss 0.14859. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.09it/s]
Epoch 44 Iter 63: loss 0.16970. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.09it/s]
Epoch 44 Iter 63: loss 0.16970. :  28%|████████████▋                                | 63/224 [00:30<01:16,  2.09it/s]
Epoch 44 Iter 64: loss 0.15246. :  28%|████████████▋                                | 63/224 [00:31<01:16,  2.09it/s]
Epoch 44 Iter 64: loss 0.15246. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.09it/s]
Epoch 44 Iter 65: loss 0.15563. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.09it/s]
Epoch 44 Iter 65: loss 0.15563. :  29%|█████████████                                | 65/224 [00:31<01:15,  2.09it/s]
Epoch 44 Iter 66: loss 0.13483. :  29%|█████████████                                | 65/224 [00:32<01:15,  2.09it/s]
Epoch 44 Iter 66: loss 0.13483. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 44 Iter 67: loss 0.16336. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 44 Iter 67: loss 0.16336. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 44 Iter 68: loss 0.14747. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 44 Iter 68: loss 0.14747. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 69: loss 0.14924. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 69: loss 0.14924. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 44 Iter 70: loss 0.16168. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 44 Iter 70: loss 0.16168. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.16949. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.16949. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.16705. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.16705. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 44 Iter 73: loss 0.17461. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 44 Iter 73: loss 0.17461. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 44 Iter 74: loss 0.15920. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 44 Iter 74: loss 0.15920. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 75: loss 0.16074. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 44 Iter 75: loss 0.16074. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 44 Iter 76: loss 0.16816. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 44 Iter 76: loss 0.16816. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 44 Iter 77: loss 0.17844. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 44 Iter 77: loss 0.17844. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.18678. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.18678. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.16027. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.16027. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 44 Iter 80: loss 0.17019. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 44 Iter 80: loss 0.17019. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 44 Iter 81: loss 0.16659. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 81: loss 0.16659. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 82: loss 0.16564. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 82: loss 0.16564. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 44 Iter 83: loss 0.14798. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 44 Iter 83: loss 0.14798. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 44 Iter 84: loss 0.16689. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 44 Iter 84: loss 0.16689. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.16918. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.16918. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 44 Iter 86: loss 0.16088. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 44 Iter 86: loss 0.16088. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.15172. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.15172. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 44 Iter 88: loss 0.15064. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 44 Iter 88: loss 0.15064. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 44 Iter 89: loss 0.16841. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 44 Iter 89: loss 0.16841. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 44 Iter 90: loss 0.15888. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 44 Iter 90: loss 0.15888. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 44 Iter 91: loss 0.17013. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 91: loss 0.17013. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 44 Iter 92: loss 0.15154. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 44 Iter 92: loss 0.15154. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 44 Iter 93: loss 0.16464. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 44 Iter 93: loss 0.16464. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.05it/s]
Epoch 44 Iter 94: loss 0.16304. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.05it/s]
Epoch 44 Iter 94: loss 0.16304. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 44 Iter 95: loss 0.16540. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 44 Iter 95: loss 0.16540. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 44 Iter 96: loss 0.16292. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 44 Iter 96: loss 0.16292. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 44 Iter 97: loss 0.16036. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 44 Iter 97: loss 0.16036. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 44 Iter 98: loss 0.14829. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 44 Iter 98: loss 0.14829. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 44 Iter 99: loss 0.15023. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 44 Iter 99: loss 0.15023. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 44 Iter 100: loss 0.14997. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 44 Iter 100: loss 0.14997. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 44 Iter 101: loss 0.15479. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 44 Iter 101: loss 0.15479. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 44 Iter 102: loss 0.14965. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 44 Iter 102: loss 0.14965. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 44 Iter 103: loss 0.16094. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 44 Iter 103: loss 0.16094. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.05it/s]
Epoch 44 Iter 104: loss 0.17143. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 44 Iter 104: loss 0.17143. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 44 Iter 105: loss 0.15005. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 44 Iter 105: loss 0.15005. :  47%|████████████████████▏                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 44 Iter 106: loss 0.16803. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 44 Iter 106: loss 0.16803. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 44 Iter 107: loss 0.17070. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 44 Iter 107: loss 0.17070. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 44 Iter 108: loss 0.15768. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 44 Iter 108: loss 0.15768. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 44 Iter 109: loss 0.14223. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 44 Iter 109: loss 0.14223. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.16333. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.16333. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 44 Iter 111: loss 0.16614. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 44 Iter 111: loss 0.16614. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.16465. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.16465. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 113: loss 0.15174. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 113: loss 0.15174. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.14534. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.14534. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.17227. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.17227. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 44 Iter 116: loss 0.14223. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 116: loss 0.14223. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 117: loss 0.16626. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 117: loss 0.16626. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 44 Iter 118: loss 0.15793. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 118: loss 0.15793. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 119: loss 0.15054. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 119: loss 0.15054. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 44 Iter 120: loss 0.15552. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 44 Iter 120: loss 0.15552. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.16982. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.16982. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.16525. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.16525. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 44 Iter 123: loss 0.16033. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 44 Iter 123: loss 0.16033. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.15535. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.15535. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 44 Iter 125: loss 0.14254. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 44 Iter 125: loss 0.14254. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 44 Iter 126: loss 0.14782. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 44 Iter 126: loss 0.14782. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 44 Iter 127: loss 0.15550. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 44 Iter 127: loss 0.15550. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 44 Iter 128: loss 0.14503. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 44 Iter 128: loss 0.14503. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.14890. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.14890. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 44 Iter 130: loss 0.16211. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 44 Iter 130: loss 0.16211. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 44 Iter 131: loss 0.15823. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 44 Iter 131: loss 0.15823. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 44 Iter 132: loss 0.17032. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 44 Iter 132: loss 0.17032. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 44 Iter 133: loss 0.15801. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 44 Iter 133: loss 0.15801. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 44 Iter 134: loss 0.16100. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 44 Iter 134: loss 0.16100. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 135: loss 0.16952. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 135: loss 0.16952. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 44 Iter 136: loss 0.14626. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 44 Iter 136: loss 0.14626. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 44 Iter 137: loss 0.15905. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 137: loss 0.15905. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 138: loss 0.16450. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 138: loss 0.16450. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 44 Iter 139: loss 0.16981. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 44 Iter 139: loss 0.16981. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 44 Iter 140: loss 0.16231. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 44 Iter 140: loss 0.16231. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 44 Iter 141: loss 0.16699. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 44 Iter 141: loss 0.16699. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.10it/s]
Epoch 44 Iter 142: loss 0.17923. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.10it/s]
Epoch 44 Iter 142: loss 0.17923. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 44 Iter 143: loss 0.18147. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 44 Iter 143: loss 0.18147. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 44 Iter 144: loss 0.15055. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 44 Iter 144: loss 0.15055. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 44 Iter 145: loss 0.15060. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 44 Iter 145: loss 0.15060. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 44 Iter 146: loss 0.16942. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 44 Iter 146: loss 0.16942. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.09it/s]
Epoch 44 Iter 147: loss 0.16509. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 44 Iter 147: loss 0.16509. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.10it/s]
Epoch 44 Iter 148: loss 0.15596. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.10it/s]
Epoch 44 Iter 148: loss 0.15596. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 44 Iter 149: loss 0.15142. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 44 Iter 149: loss 0.15142. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 44 Iter 150: loss 0.15300. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 44 Iter 150: loss 0.15300. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.10it/s]
Epoch 44 Iter 151: loss 0.16752. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.10it/s]
Epoch 44 Iter 151: loss 0.16752. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 44 Iter 152: loss 0.15299. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 44 Iter 152: loss 0.15299. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 44 Iter 153: loss 0.18283. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 44 Iter 153: loss 0.18283. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 44 Iter 154: loss 0.14765. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 44 Iter 154: loss 0.14765. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 44 Iter 155: loss 0.18029. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 44 Iter 155: loss 0.18029. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 44 Iter 156: loss 0.17873. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 44 Iter 156: loss 0.17873. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 44 Iter 157: loss 0.16989. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.09it/s]
Epoch 44 Iter 157: loss 0.16989. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 44 Iter 158: loss 0.17798. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 44 Iter 158: loss 0.17798. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 44 Iter 159: loss 0.16193. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.10it/s]
Epoch 44 Iter 159: loss 0.16193. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 44 Iter 160: loss 0.14963. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 44 Iter 160: loss 0.14963. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 44 Iter 161: loss 0.16991. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 44 Iter 161: loss 0.16991. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 44 Iter 162: loss 0.15893. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 44 Iter 162: loss 0.15893. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 44 Iter 163: loss 0.17250. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 44 Iter 163: loss 0.17250. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 44 Iter 164: loss 0.15336. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 44 Iter 164: loss 0.15336. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 44 Iter 165: loss 0.16102. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 44 Iter 165: loss 0.16102. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 44 Iter 166: loss 0.16590. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 44 Iter 166: loss 0.16590. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 44 Iter 167: loss 0.16802. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 44 Iter 167: loss 0.16802. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 44 Iter 168: loss 0.15998. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 44 Iter 168: loss 0.15998. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 44 Iter 169: loss 0.16355. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 44 Iter 169: loss 0.16355. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 44 Iter 170: loss 0.16039. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 44 Iter 170: loss 0.16039. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 44 Iter 171: loss 0.15922. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 44 Iter 171: loss 0.15922. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 44 Iter 172: loss 0.15798. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 44 Iter 172: loss 0.15798. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 44 Iter 173: loss 0.15437. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 44 Iter 173: loss 0.15437. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 44 Iter 174: loss 0.14540. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 44 Iter 174: loss 0.14540. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 44 Iter 175: loss 0.16568. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 44 Iter 175: loss 0.16568. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 44 Iter 176: loss 0.15944. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 44 Iter 176: loss 0.15944. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 44 Iter 177: loss 0.16568. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 44 Iter 177: loss 0.16568. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 44 Iter 178: loss 0.18010. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 44 Iter 178: loss 0.18010. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 44 Iter 179: loss 0.15762. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 44 Iter 179: loss 0.15762. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 44 Iter 180: loss 0.15013. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 44 Iter 180: loss 0.15013. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 44 Iter 181: loss 0.16089. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 44 Iter 181: loss 0.16089. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 44 Iter 182: loss 0.16394. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 182: loss 0.16394. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 183: loss 0.16608. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 183: loss 0.16608. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 44 Iter 184: loss 0.15622. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 44 Iter 184: loss 0.15622. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 185: loss 0.17005. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 185: loss 0.17005. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 44 Iter 186: loss 0.16347. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 44 Iter 186: loss 0.16347. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 44 Iter 187: loss 0.18084. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 44 Iter 187: loss 0.18084. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.16135. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.16135. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 189: loss 0.15000. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 189: loss 0.15000. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 44 Iter 190: loss 0.14555. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 190: loss 0.14555. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 191: loss 0.14326. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 191: loss 0.14326. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 44 Iter 192: loss 0.15067. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 44 Iter 192: loss 0.15067. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 44 Iter 193: loss 0.18246. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 44 Iter 193: loss 0.18246. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 44 Iter 194: loss 0.15877. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 44 Iter 194: loss 0.15877. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.16144. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.16144. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 44 Iter 196: loss 0.18643. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 44 Iter 196: loss 0.18643. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.15374. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.15374. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 44 Iter 198: loss 0.15877. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 44 Iter 198: loss 0.15877. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 44 Iter 199: loss 0.16491. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 44 Iter 199: loss 0.16491. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.10it/s]
Epoch 44 Iter 200: loss 0.16925. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.10it/s]
Epoch 44 Iter 200: loss 0.16925. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 44 Iter 201: loss 0.16755. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 44 Iter 201: loss 0.16755. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.09it/s]
Epoch 44 Iter 202: loss 0.14874. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.09it/s]
Epoch 44 Iter 202: loss 0.14874. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.09it/s]
Epoch 44 Iter 203: loss 0.15981. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.09it/s]
Epoch 44 Iter 203: loss 0.15981. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 44 Iter 204: loss 0.15851. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 44 Iter 204: loss 0.15851. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 44 Iter 205: loss 0.18093. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 44 Iter 205: loss 0.18093. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 44 Iter 206: loss 0.15490. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 44 Iter 206: loss 0.15490. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 44 Iter 207: loss 0.16921. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 44 Iter 207: loss 0.16921. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 44 Iter 208: loss 0.16400. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 44 Iter 208: loss 0.16400. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 44 Iter 209: loss 0.17862. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 209: loss 0.17862. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 210: loss 0.15366. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 210: loss 0.15366. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 44 Iter 211: loss 0.16843. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 44 Iter 211: loss 0.16843. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 44 Iter 212: loss 0.16341. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 44 Iter 212: loss 0.16341. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 44 Iter 213: loss 0.15974. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 44 Iter 213: loss 0.15974. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 44 Iter 214: loss 0.15157. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 44 Iter 214: loss 0.15157. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 44 Iter 215: loss 0.16581. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 215: loss 0.16581. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 216: loss 0.17369. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 216: loss 0.17369. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 44 Iter 217: loss 0.17251. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 44 Iter 217: loss 0.17251. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 44 Iter 218: loss 0.15687. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 44 Iter 218: loss 0.15687. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 44 Iter 219: loss 0.15704. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 44 Iter 219: loss 0.15704. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 44 Iter 220: loss 0.16533. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 44 Iter 220: loss 0.16533. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 44 Iter 221: loss 0.16946. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 44 Iter 221: loss 0.16946. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 44 Iter 222: loss 0.16253. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 44 Iter 222: loss 0.16253. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.18558. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.18558. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 44 Iter 224: loss 0.17213. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 44 Iter 224: loss 0.17213. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 44 Iter 224: loss 0.17213. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.16556. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.16556. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 45 Iter 2: loss 0.16959. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 45 Iter 2: loss 0.16959. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 45 Iter 3: loss 0.17412. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 45 Iter 3: loss 0.17412. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 45 Iter 4: loss 0.16266. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 45 Iter 4: loss 0.16266. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 45 Iter 5: loss 0.18551. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 45 Iter 5: loss 0.18551. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 45 Iter 6: loss 0.16007. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 45 Iter 6: loss 0.16007. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.16666. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.16666. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 45 Iter 8: loss 0.14937. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 45 Iter 8: loss 0.14937. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.15377. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.15377. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 10: loss 0.14706. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 10: loss 0.14706. :   4%|██                                           | 10/224 [00:04<01:42,  2.08it/s]
Epoch 45 Iter 11: loss 0.15868. :   4%|██                                           | 10/224 [00:05<01:42,  2.08it/s]
Epoch 45 Iter 11: loss 0.15868. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 45 Iter 12: loss 0.17043. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 45 Iter 12: loss 0.17043. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.08it/s]
Epoch 45 Iter 13: loss 0.17416. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.08it/s]
Epoch 45 Iter 13: loss 0.17416. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 45 Iter 14: loss 0.14794. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 45 Iter 14: loss 0.14794. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 45 Iter 15: loss 0.17637. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 45 Iter 15: loss 0.17637. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 45 Iter 16: loss 0.14193. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 45 Iter 16: loss 0.14193. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 45 Iter 17: loss 0.14712. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 45 Iter 17: loss 0.14712. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.09it/s]
Epoch 45 Iter 18: loss 0.16502. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.09it/s]
Epoch 45 Iter 18: loss 0.16502. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 45 Iter 19: loss 0.16880. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 45 Iter 19: loss 0.16880. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 45 Iter 20: loss 0.13462. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 45 Iter 20: loss 0.13462. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 45 Iter 21: loss 0.16773. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 45 Iter 21: loss 0.16773. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 45 Iter 22: loss 0.15995. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 45 Iter 22: loss 0.15995. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 45 Iter 23: loss 0.16491. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 45 Iter 23: loss 0.16491. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 45 Iter 24: loss 0.15667. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 45 Iter 24: loss 0.15667. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 45 Iter 25: loss 0.15592. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 45 Iter 25: loss 0.15592. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 45 Iter 26: loss 0.16333. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 45 Iter 26: loss 0.16333. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 45 Iter 27: loss 0.16369. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 45 Iter 27: loss 0.16369. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.02it/s]
Epoch 45 Iter 28: loss 0.15020. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.02it/s]
Epoch 45 Iter 28: loss 0.15020. :  12%|█████▋                                       | 28/224 [00:13<01:36,  2.03it/s]
Epoch 45 Iter 29: loss 0.14698. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.03it/s]
Epoch 45 Iter 29: loss 0.14698. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 45 Iter 30: loss 0.17966. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 45 Iter 30: loss 0.17966. :  13%|██████                                       | 30/224 [00:14<01:35,  2.04it/s]
Epoch 45 Iter 31: loss 0.17525. :  13%|██████                                       | 30/224 [00:15<01:35,  2.04it/s]
Epoch 45 Iter 31: loss 0.17525. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 45 Iter 32: loss 0.16905. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 45 Iter 32: loss 0.16905. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 45 Iter 33: loss 0.14864. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 45 Iter 33: loss 0.14864. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 45 Iter 34: loss 0.16175. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 45 Iter 34: loss 0.16175. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 45 Iter 35: loss 0.16129. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 45 Iter 35: loss 0.16129. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 45 Iter 36: loss 0.19292. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 45 Iter 36: loss 0.19292. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 45 Iter 37: loss 0.15964. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 45 Iter 37: loss 0.15964. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 45 Iter 38: loss 0.17461. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 45 Iter 38: loss 0.17461. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 39: loss 0.15003. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 39: loss 0.15003. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 40: loss 0.15639. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 45 Iter 40: loss 0.15639. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 45 Iter 41: loss 0.18033. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 45 Iter 41: loss 0.18033. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 45 Iter 42: loss 0.15322. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 45 Iter 42: loss 0.15322. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 45 Iter 43: loss 0.16554. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 45 Iter 43: loss 0.16554. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 45 Iter 44: loss 0.17695. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 45 Iter 44: loss 0.17695. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 45 Iter 45: loss 0.16442. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 45 Iter 45: loss 0.16442. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 45 Iter 46: loss 0.16568. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 46: loss 0.16568. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 47: loss 0.17875. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 47: loss 0.17875. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.16490. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.16490. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.15314. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.15314. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 45 Iter 50: loss 0.16185. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 45 Iter 50: loss 0.16185. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 45 Iter 51: loss 0.14766. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 45 Iter 51: loss 0.14766. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.16720. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.16720. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 45 Iter 53: loss 0.16821. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 45 Iter 53: loss 0.16821. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 45 Iter 54: loss 0.17218. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 45 Iter 54: loss 0.17218. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 45 Iter 55: loss 0.15553. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 45 Iter 55: loss 0.15553. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 45 Iter 56: loss 0.16040. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 45 Iter 56: loss 0.16040. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 45 Iter 57: loss 0.16887. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 45 Iter 57: loss 0.16887. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 45 Iter 58: loss 0.16581. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 58: loss 0.16581. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.19318. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.19318. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.16780. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.16780. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 45 Iter 61: loss 0.16435. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 45 Iter 61: loss 0.16435. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 45 Iter 62: loss 0.14816. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 62: loss 0.14816. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 45 Iter 63: loss 0.14341. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 45 Iter 63: loss 0.14341. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.17156. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.17156. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.14340. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.14340. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 45 Iter 66: loss 0.16808. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 45 Iter 66: loss 0.16808. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.14797. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.14797. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.16412. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.16412. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 69: loss 0.16849. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 45 Iter 69: loss 0.16849. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 45 Iter 70: loss 0.18851. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 45 Iter 70: loss 0.18851. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 45 Iter 71: loss 0.15212. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 45 Iter 71: loss 0.15212. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 72: loss 0.16093. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 72: loss 0.16093. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 73: loss 0.15056. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 45 Iter 73: loss 0.15056. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 45 Iter 74: loss 0.18499. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 45 Iter 74: loss 0.18499. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 45 Iter 75: loss 0.15173. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 45 Iter 75: loss 0.15173. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 45 Iter 76: loss 0.16447. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 45 Iter 76: loss 0.16447. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 45 Iter 77: loss 0.14604. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 45 Iter 77: loss 0.14604. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 45 Iter 78: loss 0.15190. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 45 Iter 78: loss 0.15190. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 45 Iter 79: loss 0.16356. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 45 Iter 79: loss 0.16356. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 45 Iter 80: loss 0.17479. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 45 Iter 80: loss 0.17479. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 45 Iter 81: loss 0.17598. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 45 Iter 81: loss 0.17598. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 45 Iter 82: loss 0.16327. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 45 Iter 82: loss 0.16327. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 45 Iter 83: loss 0.15335. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 83: loss 0.15335. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 84: loss 0.17748. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 84: loss 0.17748. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 85: loss 0.15432. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 45 Iter 85: loss 0.15432. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 45 Iter 86: loss 0.14776. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 45 Iter 86: loss 0.14776. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 45 Iter 87: loss 0.14649. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 45 Iter 87: loss 0.14649. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 45 Iter 88: loss 0.16065. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 45 Iter 88: loss 0.16065. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 45 Iter 89: loss 0.16962. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 45 Iter 89: loss 0.16962. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 45 Iter 90: loss 0.18169. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 45 Iter 90: loss 0.18169. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 45 Iter 91: loss 0.17928. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 45 Iter 91: loss 0.17928. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 45 Iter 92: loss 0.15515. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 45 Iter 92: loss 0.15515. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 45 Iter 93: loss 0.16891. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 45 Iter 93: loss 0.16891. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 45 Iter 94: loss 0.15057. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 45 Iter 94: loss 0.15057. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 45 Iter 95: loss 0.15250. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.08it/s]
Epoch 45 Iter 95: loss 0.15250. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 45 Iter 96: loss 0.15114. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 45 Iter 96: loss 0.15114. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 45 Iter 97: loss 0.14263. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 45 Iter 97: loss 0.14263. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 45 Iter 98: loss 0.19026. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 45 Iter 98: loss 0.19026. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 45 Iter 99: loss 0.15320. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 45 Iter 99: loss 0.15320. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 45 Iter 100: loss 0.16018. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 45 Iter 100: loss 0.16018. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 45 Iter 101: loss 0.15710. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 45 Iter 101: loss 0.15710. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 45 Iter 102: loss 0.17291. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 45 Iter 102: loss 0.17291. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 45 Iter 103: loss 0.15552. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 45 Iter 103: loss 0.15552. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 45 Iter 104: loss 0.15288. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 45 Iter 104: loss 0.15288. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 45 Iter 105: loss 0.16033. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 45 Iter 105: loss 0.16033. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 45 Iter 106: loss 0.16253. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 45 Iter 106: loss 0.16253. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 45 Iter 107: loss 0.15453. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 45 Iter 107: loss 0.15453. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 45 Iter 108: loss 0.15041. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 45 Iter 108: loss 0.15041. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 45 Iter 109: loss 0.15533. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 45 Iter 109: loss 0.15533. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 45 Iter 110: loss 0.14792. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 45 Iter 110: loss 0.14792. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 45 Iter 111: loss 0.17927. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 45 Iter 111: loss 0.17927. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 45 Iter 112: loss 0.16327. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 45 Iter 112: loss 0.16327. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 45 Iter 113: loss 0.14691. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 45 Iter 113: loss 0.14691. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 45 Iter 114: loss 0.16266. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 114: loss 0.16266. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 115: loss 0.13760. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 115: loss 0.13760. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 45 Iter 116: loss 0.16999. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 45 Iter 116: loss 0.16999. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 45 Iter 117: loss 0.16604. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 45 Iter 117: loss 0.16604. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.15664. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.15664. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 45 Iter 119: loss 0.18090. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 45 Iter 119: loss 0.18090. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 45 Iter 120: loss 0.15010. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 120: loss 0.15010. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 121: loss 0.13505. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 121: loss 0.13505. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 45 Iter 122: loss 0.16381. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 45 Iter 122: loss 0.16381. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.17209. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.17209. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 124: loss 0.16373. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 45 Iter 124: loss 0.16373. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 45 Iter 125: loss 0.14253. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 45 Iter 125: loss 0.14253. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 45 Iter 126: loss 0.15473. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 45 Iter 126: loss 0.15473. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 127: loss 0.13742. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 127: loss 0.13742. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 45 Iter 128: loss 0.15901. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 45 Iter 128: loss 0.15901. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.15161. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.15161. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 130: loss 0.15765. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 130: loss 0.15765. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 45 Iter 131: loss 0.14917. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 131: loss 0.14917. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.16205. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.16205. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.18290. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.18290. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 134: loss 0.16887. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 134: loss 0.16887. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.05it/s]
Epoch 45 Iter 135: loss 0.15629. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 45 Iter 135: loss 0.15629. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 45 Iter 136: loss 0.17670. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 45 Iter 136: loss 0.17670. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 45 Iter 137: loss 0.16614. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 137: loss 0.16614. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 138: loss 0.14752. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 138: loss 0.14752. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 45 Iter 139: loss 0.16857. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 139: loss 0.16857. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 140: loss 0.16513. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 140: loss 0.16513. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.05it/s]
Epoch 45 Iter 141: loss 0.16302. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 45 Iter 141: loss 0.16302. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 45 Iter 142: loss 0.16019. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 45 Iter 142: loss 0.16019. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.09it/s]
Epoch 45 Iter 143: loss 0.15789. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.09it/s]
Epoch 45 Iter 143: loss 0.15789. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 45 Iter 144: loss 0.16735. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 45 Iter 144: loss 0.16735. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 45 Iter 145: loss 0.18591. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 45 Iter 145: loss 0.18591. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 45 Iter 146: loss 0.16287. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 45 Iter 146: loss 0.16287. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 45 Iter 147: loss 0.16396. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 45 Iter 147: loss 0.16396. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 45 Iter 148: loss 0.15263. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 45 Iter 148: loss 0.15263. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 45 Iter 149: loss 0.16185. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 45 Iter 149: loss 0.16185. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 45 Iter 150: loss 0.14117. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 45 Iter 150: loss 0.14117. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 45 Iter 151: loss 0.19806. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 151: loss 0.19806. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.16417. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.16417. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 45 Iter 153: loss 0.17499. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 153: loss 0.17499. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.17003. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.17003. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.17043. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.17043. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.15844. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.15844. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 157: loss 0.17804. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 45 Iter 157: loss 0.17804. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 45 Iter 158: loss 0.15214. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 45 Iter 158: loss 0.15214. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.16445. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.16445. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.14574. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.14574. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.17296. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.17296. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 45 Iter 162: loss 0.15221. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 45 Iter 162: loss 0.15221. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.16630. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.16630. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 45 Iter 164: loss 0.15869. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 45 Iter 164: loss 0.15869. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.17483. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.17483. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.16072. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.16072. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 167: loss 0.16176. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 167: loss 0.16176. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 45 Iter 168: loss 0.16689. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 45 Iter 168: loss 0.16689. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 45 Iter 169: loss 0.17556. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 45 Iter 169: loss 0.17556. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 45 Iter 170: loss 0.14198. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 45 Iter 170: loss 0.14198. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 45 Iter 171: loss 0.15707. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 45 Iter 171: loss 0.15707. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 45 Iter 172: loss 0.18010. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 45 Iter 172: loss 0.18010. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.11it/s]
Epoch 45 Iter 173: loss 0.15749. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.11it/s]
Epoch 45 Iter 173: loss 0.15749. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.09it/s]
Epoch 45 Iter 174: loss 0.17725. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 45 Iter 174: loss 0.17725. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 45 Iter 175: loss 0.16754. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 45 Iter 175: loss 0.16754. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 45 Iter 176: loss 0.15816. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 45 Iter 176: loss 0.15816. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.10it/s]
Epoch 45 Iter 177: loss 0.18980. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.10it/s]
Epoch 45 Iter 177: loss 0.18980. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.09it/s]
Epoch 45 Iter 178: loss 0.16319. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.09it/s]
Epoch 45 Iter 178: loss 0.16319. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.10it/s]
Epoch 45 Iter 179: loss 0.16211. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.10it/s]
Epoch 45 Iter 179: loss 0.16211. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.09it/s]
Epoch 45 Iter 180: loss 0.17339. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.09it/s]
Epoch 45 Iter 180: loss 0.17339. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 45 Iter 181: loss 0.16419. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 45 Iter 181: loss 0.16419. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 45 Iter 182: loss 0.15310. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 45 Iter 182: loss 0.15310. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 45 Iter 183: loss 0.18570. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 45 Iter 183: loss 0.18570. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 45 Iter 184: loss 0.16152. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 45 Iter 184: loss 0.16152. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 45 Iter 185: loss 0.15315. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 45 Iter 185: loss 0.15315. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 45 Iter 186: loss 0.15351. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 45 Iter 186: loss 0.15351. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 45 Iter 187: loss 0.14915. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 45 Iter 187: loss 0.14915. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 45 Iter 188: loss 0.15317. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 45 Iter 188: loss 0.15317. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 189: loss 0.17438. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 189: loss 0.17438. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 190: loss 0.15433. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 190: loss 0.15433. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.04it/s]
Epoch 45 Iter 191: loss 0.14804. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.04it/s]
Epoch 45 Iter 191: loss 0.14804. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 45 Iter 192: loss 0.15468. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 45 Iter 192: loss 0.15468. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.05it/s]
Epoch 45 Iter 193: loss 0.15380. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 45 Iter 193: loss 0.15380. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 45 Iter 194: loss 0.17218. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 45 Iter 194: loss 0.17218. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.15996. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.15996. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 196: loss 0.14631. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 196: loss 0.14631. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 45 Iter 197: loss 0.15736. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 45 Iter 197: loss 0.15736. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 45 Iter 198: loss 0.16100. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 45 Iter 198: loss 0.16100. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.05it/s]
Epoch 45 Iter 199: loss 0.16601. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 45 Iter 199: loss 0.16601. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 45 Iter 200: loss 0.15584. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 45 Iter 200: loss 0.15584. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 45 Iter 201: loss 0.16661. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 201: loss 0.16661. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.16957. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.16957. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 45 Iter 203: loss 0.16268. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 45 Iter 203: loss 0.16268. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 45 Iter 204: loss 0.15084. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 45 Iter 204: loss 0.15084. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 45 Iter 205: loss 0.17164. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 45 Iter 205: loss 0.17164. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 45 Iter 206: loss 0.14892. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 45 Iter 206: loss 0.14892. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 45 Iter 207: loss 0.16788. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 45 Iter 207: loss 0.16788. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 45 Iter 208: loss 0.16887. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 45 Iter 208: loss 0.16887. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 45 Iter 209: loss 0.14270. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 209: loss 0.14270. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.16005. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.16005. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 45 Iter 211: loss 0.15770. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 45 Iter 211: loss 0.15770. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.16014. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.16014. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.16612. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.16612. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 45 Iter 214: loss 0.14564. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 45 Iter 214: loss 0.14564. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 45 Iter 215: loss 0.14858. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 45 Iter 215: loss 0.14858. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 45 Iter 216: loss 0.17352. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 45 Iter 216: loss 0.17352. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 45 Iter 217: loss 0.14516. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 45 Iter 217: loss 0.14516. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.15820. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.15820. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 45 Iter 219: loss 0.16287. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 45 Iter 219: loss 0.16287. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 45 Iter 220: loss 0.16215. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 45 Iter 220: loss 0.16215. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 45 Iter 221: loss 0.16532. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 45 Iter 221: loss 0.16532. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 45 Iter 222: loss 0.14724. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 45 Iter 222: loss 0.14724. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 45 Iter 223: loss 0.17088. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 223: loss 0.17088. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 224: loss 0.14545. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 224: loss 0.14545. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 224: loss 0.14545. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16172
    Valid loss: 0.17059
       Valid loss recons: 0.17059
       Valid loss KL-D:   139593.10866
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.14492. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.14492. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 46 Iter 2: loss 0.18410. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 46 Iter 2: loss 0.18410. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 46 Iter 3: loss 0.16866. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 3: loss 0.16866. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 4: loss 0.17951. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 4: loss 0.17951. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 46 Iter 5: loss 0.14013. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 5: loss 0.14013. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.15223. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.15223. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 46 Iter 7: loss 0.17535. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 46 Iter 7: loss 0.17535. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 46 Iter 8: loss 0.16184. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 46 Iter 8: loss 0.16184. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 46 Iter 9: loss 0.17076. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 46 Iter 9: loss 0.17076. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 46 Iter 10: loss 0.15886. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 46 Iter 10: loss 0.15886. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 46 Iter 11: loss 0.15511. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 46 Iter 11: loss 0.15511. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 46 Iter 12: loss 0.15159. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 46 Iter 12: loss 0.15159. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 46 Iter 13: loss 0.15959. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 46 Iter 13: loss 0.15959. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 46 Iter 14: loss 0.14765. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 46 Iter 14: loss 0.14765. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 46 Iter 15: loss 0.16114. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 46 Iter 15: loss 0.16114. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 46 Iter 16: loss 0.15864. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 46 Iter 16: loss 0.15864. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.16608. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.16608. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 46 Iter 18: loss 0.16138. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 46 Iter 18: loss 0.16138. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 19: loss 0.16170. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 46 Iter 19: loss 0.16170. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.13609. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.13609. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 46 Iter 21: loss 0.16900. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 46 Iter 21: loss 0.16900. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 46 Iter 22: loss 0.16195. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 46 Iter 22: loss 0.16195. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 46 Iter 23: loss 0.15281. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 46 Iter 23: loss 0.15281. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 46 Iter 24: loss 0.16431. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 46 Iter 24: loss 0.16431. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 46 Iter 25: loss 0.14006. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 46 Iter 25: loss 0.14006. :  11%|█████                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 46 Iter 26: loss 0.17187. :  11%|█████                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 46 Iter 26: loss 0.17187. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 46 Iter 27: loss 0.17015. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 46 Iter 27: loss 0.17015. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 46 Iter 28: loss 0.16561. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 46 Iter 28: loss 0.16561. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.06it/s]
Epoch 46 Iter 29: loss 0.17705. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.06it/s]
Epoch 46 Iter 29: loss 0.17705. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 46 Iter 30: loss 0.16078. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 46 Iter 30: loss 0.16078. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 46 Iter 31: loss 0.14706. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 46 Iter 31: loss 0.14706. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 46 Iter 32: loss 0.16019. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 46 Iter 32: loss 0.16019. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.09it/s]
Epoch 46 Iter 33: loss 0.15677. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.09it/s]
Epoch 46 Iter 33: loss 0.15677. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 46 Iter 34: loss 0.15876. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 46 Iter 34: loss 0.15876. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 46 Iter 35: loss 0.15510. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 46 Iter 35: loss 0.15510. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 46 Iter 36: loss 0.15659. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 46 Iter 36: loss 0.15659. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 46 Iter 37: loss 0.18298. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 46 Iter 37: loss 0.18298. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 46 Iter 38: loss 0.16819. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 46 Iter 38: loss 0.16819. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 46 Iter 39: loss 0.16201. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 46 Iter 39: loss 0.16201. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 46 Iter 40: loss 0.15901. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 46 Iter 40: loss 0.15901. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 46 Iter 41: loss 0.15813. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 46 Iter 41: loss 0.15813. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.08it/s]
Epoch 46 Iter 42: loss 0.16718. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.08it/s]
Epoch 46 Iter 42: loss 0.16718. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.17954. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.17954. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.14414. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.14414. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 46 Iter 45: loss 0.17620. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 46 Iter 45: loss 0.17620. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 46 Iter 46: loss 0.16618. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 46 Iter 46: loss 0.16618. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 46 Iter 47: loss 0.14991. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 46 Iter 47: loss 0.14991. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.16046. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.16046. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.15301. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.15301. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.15587. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.15587. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 46 Iter 51: loss 0.16498. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 46 Iter 51: loss 0.16498. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 46 Iter 52: loss 0.16809. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 46 Iter 52: loss 0.16809. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 46 Iter 53: loss 0.16080. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 46 Iter 53: loss 0.16080. :  24%|██████████▋                                  | 53/224 [00:25<01:21,  2.09it/s]
Epoch 46 Iter 54: loss 0.17966. :  24%|██████████▋                                  | 53/224 [00:26<01:21,  2.09it/s]
Epoch 46 Iter 54: loss 0.17966. :  24%|██████████▊                                  | 54/224 [00:26<01:20,  2.10it/s]
Epoch 46 Iter 55: loss 0.17208. :  24%|██████████▊                                  | 54/224 [00:26<01:20,  2.10it/s]
Epoch 46 Iter 55: loss 0.17208. :  25%|███████████                                  | 55/224 [00:26<01:20,  2.09it/s]
Epoch 46 Iter 56: loss 0.15091. :  25%|███████████                                  | 55/224 [00:27<01:20,  2.09it/s]
Epoch 46 Iter 56: loss 0.15091. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 46 Iter 57: loss 0.16084. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 46 Iter 57: loss 0.16084. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.09it/s]
Epoch 46 Iter 58: loss 0.17093. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.09it/s]
Epoch 46 Iter 58: loss 0.17093. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.09it/s]
Epoch 46 Iter 59: loss 0.18633. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.09it/s]
Epoch 46 Iter 59: loss 0.18633. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 46 Iter 60: loss 0.15571. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 46 Iter 60: loss 0.15571. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.09it/s]
Epoch 46 Iter 61: loss 0.18142. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.09it/s]
Epoch 46 Iter 61: loss 0.18142. :  27%|████████████▎                                | 61/224 [00:29<01:17,  2.09it/s]
Epoch 46 Iter 62: loss 0.16700. :  27%|████████████▎                                | 61/224 [00:29<01:17,  2.09it/s]
Epoch 46 Iter 62: loss 0.16700. :  28%|████████████▍                                | 62/224 [00:29<01:17,  2.08it/s]
Epoch 46 Iter 63: loss 0.15211. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 46 Iter 63: loss 0.15211. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.09it/s]
Epoch 46 Iter 64: loss 0.16390. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.09it/s]
Epoch 46 Iter 64: loss 0.16390. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 46 Iter 65: loss 0.14746. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 46 Iter 65: loss 0.14746. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 46 Iter 66: loss 0.16069. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 46 Iter 66: loss 0.16069. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 46 Iter 67: loss 0.15802. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 67: loss 0.15802. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.14746. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.14746. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 46 Iter 69: loss 0.15436. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 46 Iter 69: loss 0.15436. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 46 Iter 70: loss 0.15926. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 46 Iter 70: loss 0.15926. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 46 Iter 71: loss 0.16999. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 46 Iter 71: loss 0.16999. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 46 Iter 72: loss 0.15841. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 46 Iter 72: loss 0.15841. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 46 Iter 73: loss 0.15388. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 46 Iter 73: loss 0.15388. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 74: loss 0.16600. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 74: loss 0.16600. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 46 Iter 75: loss 0.14014. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 46 Iter 75: loss 0.14014. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 46 Iter 76: loss 0.14796. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 46 Iter 76: loss 0.14796. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 46 Iter 77: loss 0.15009. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 46 Iter 77: loss 0.15009. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 46 Iter 78: loss 0.16498. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 46 Iter 78: loss 0.16498. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 46 Iter 79: loss 0.15289. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 46 Iter 79: loss 0.15289. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.14390. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.14390. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 46 Iter 81: loss 0.15774. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 46 Iter 81: loss 0.15774. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 46 Iter 82: loss 0.14381. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 46 Iter 82: loss 0.14381. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 46 Iter 83: loss 0.17259. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 46 Iter 83: loss 0.17259. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 46 Iter 84: loss 0.16267. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 46 Iter 84: loss 0.16267. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 46 Iter 85: loss 0.16240. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 46 Iter 85: loss 0.16240. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 46 Iter 86: loss 0.16818. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 46 Iter 86: loss 0.16818. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 46 Iter 87: loss 0.18391. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 46 Iter 87: loss 0.18391. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 46 Iter 88: loss 0.14293. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 46 Iter 88: loss 0.14293. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 46 Iter 89: loss 0.14350. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 46 Iter 89: loss 0.14350. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 46 Iter 90: loss 0.15488. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 46 Iter 90: loss 0.15488. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 46 Iter 91: loss 0.16199. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 46 Iter 91: loss 0.16199. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 46 Iter 92: loss 0.16807. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 46 Iter 92: loss 0.16807. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 46 Iter 93: loss 0.16804. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 46 Iter 93: loss 0.16804. :  42%|██████████████████▋                          | 93/224 [00:44<01:03,  2.08it/s]
Epoch 46 Iter 94: loss 0.16536. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 46 Iter 94: loss 0.16536. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 95: loss 0.17465. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 95: loss 0.17465. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 96: loss 0.16512. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 46 Iter 96: loss 0.16512. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 46 Iter 97: loss 0.18140. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 46 Iter 97: loss 0.18140. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.05it/s]
Epoch 46 Iter 98: loss 0.16510. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 46 Iter 98: loss 0.16510. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 46 Iter 99: loss 0.13314. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 46 Iter 99: loss 0.13314. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.05it/s]
Epoch 46 Iter 100: loss 0.16076. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.05it/s]
Epoch 46 Iter 100: loss 0.16076. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 46 Iter 101: loss 0.18107. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 46 Iter 101: loss 0.18107. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 46 Iter 102: loss 0.15366. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 46 Iter 102: loss 0.15366. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 46 Iter 103: loss 0.16899. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 46 Iter 103: loss 0.16899. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 46 Iter 104: loss 0.15517. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 46 Iter 104: loss 0.15517. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 46 Iter 105: loss 0.16332. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 46 Iter 105: loss 0.16332. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 46 Iter 106: loss 0.16831. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 46 Iter 106: loss 0.16831. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 107: loss 0.15028. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 107: loss 0.15028. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.13395. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.13395. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 46 Iter 109: loss 0.16304. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 46 Iter 109: loss 0.16304. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 46 Iter 110: loss 0.16697. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 46 Iter 110: loss 0.16697. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 111: loss 0.16872. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 111: loss 0.16872. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 46 Iter 112: loss 0.14395. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 112: loss 0.14395. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 113: loss 0.17037. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 113: loss 0.17037. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.15425. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.15425. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 115: loss 0.16171. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 115: loss 0.16171. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 46 Iter 116: loss 0.16666. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 46 Iter 116: loss 0.16666. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 117: loss 0.16807. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 117: loss 0.16807. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 118: loss 0.17217. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 46 Iter 118: loss 0.17217. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 46 Iter 119: loss 0.15666. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 46 Iter 119: loss 0.15666. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 46 Iter 120: loss 0.16310. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 46 Iter 120: loss 0.16310. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 121: loss 0.16495. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 121: loss 0.16495. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 122: loss 0.17438. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 46 Iter 122: loss 0.17438. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 46 Iter 123: loss 0.16226. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 46 Iter 123: loss 0.16226. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 46 Iter 124: loss 0.15112. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 46 Iter 124: loss 0.15112. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 46 Iter 125: loss 0.15893. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 46 Iter 125: loss 0.15893. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 46 Iter 126: loss 0.16124. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.06it/s]
Epoch 46 Iter 126: loss 0.16124. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 46 Iter 127: loss 0.14582. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 46 Iter 127: loss 0.14582. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 46 Iter 128: loss 0.17097. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 46 Iter 128: loss 0.17097. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 46 Iter 129: loss 0.15506. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 46 Iter 129: loss 0.15506. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 46 Iter 130: loss 0.17408. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 46 Iter 130: loss 0.17408. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 46 Iter 131: loss 0.15296. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 46 Iter 131: loss 0.15296. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 46 Iter 132: loss 0.17338. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 46 Iter 132: loss 0.17338. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 46 Iter 133: loss 0.13822. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 46 Iter 133: loss 0.13822. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 46 Iter 134: loss 0.15053. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 46 Iter 134: loss 0.15053. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:44,  2.04it/s]
Epoch 46 Iter 135: loss 0.16540. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.04it/s]
Epoch 46 Iter 135: loss 0.16540. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 46 Iter 136: loss 0.14900. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 46 Iter 136: loss 0.14900. :  61%|██████████████████████████                 | 136/224 [01:05<00:43,  2.04it/s]
Epoch 46 Iter 137: loss 0.16848. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 46 Iter 137: loss 0.16848. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 46 Iter 138: loss 0.17521. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 46 Iter 138: loss 0.17521. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 46 Iter 139: loss 0.16524. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 46 Iter 139: loss 0.16524. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.16300. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.16300. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 46 Iter 141: loss 0.16504. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 46 Iter 141: loss 0.16504. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 46 Iter 142: loss 0.15276. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 46 Iter 142: loss 0.15276. :  63%|███████████████████████████▎               | 142/224 [01:08<00:40,  2.03it/s]
Epoch 46 Iter 143: loss 0.15111. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.03it/s]
Epoch 46 Iter 143: loss 0.15111. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 46 Iter 144: loss 0.17317. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 46 Iter 144: loss 0.17317. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 46 Iter 145: loss 0.16942. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 145: loss 0.16942. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.16143. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.16143. :  65%|████████████████████████████               | 146/224 [01:10<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.17786. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.17786. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 46 Iter 148: loss 0.19449. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 46 Iter 148: loss 0.19449. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 46 Iter 149: loss 0.16832. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 46 Iter 149: loss 0.16832. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 46 Iter 150: loss 0.16059. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 46 Iter 150: loss 0.16059. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 46 Iter 151: loss 0.14843. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 46 Iter 151: loss 0.14843. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.16556. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.16556. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 46 Iter 153: loss 0.16106. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 46 Iter 153: loss 0.16106. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 46 Iter 154: loss 0.16488. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 46 Iter 154: loss 0.16488. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 46 Iter 155: loss 0.16458. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 46 Iter 155: loss 0.16458. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.15644. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.15644. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 46 Iter 157: loss 0.18172. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 46 Iter 157: loss 0.18172. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 46 Iter 158: loss 0.16554. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 46 Iter 158: loss 0.16554. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 46 Iter 159: loss 0.15399. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 46 Iter 159: loss 0.15399. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 46 Iter 160: loss 0.17227. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 46 Iter 160: loss 0.17227. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 46 Iter 161: loss 0.14296. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 46 Iter 161: loss 0.14296. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 46 Iter 162: loss 0.15855. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 46 Iter 162: loss 0.15855. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 46 Iter 163: loss 0.15240. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 46 Iter 163: loss 0.15240. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 46 Iter 164: loss 0.16803. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 46 Iter 164: loss 0.16803. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 46 Iter 165: loss 0.16194. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 46 Iter 165: loss 0.16194. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 46 Iter 166: loss 0.14870. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 46 Iter 166: loss 0.14870. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 46 Iter 167: loss 0.14272. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 46 Iter 167: loss 0.14272. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 46 Iter 168: loss 0.14276. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 46 Iter 168: loss 0.14276. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 46 Iter 169: loss 0.18609. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 46 Iter 169: loss 0.18609. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 46 Iter 170: loss 0.17823. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 46 Iter 170: loss 0.17823. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 46 Iter 171: loss 0.14901. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 46 Iter 171: loss 0.14901. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 46 Iter 172: loss 0.18127. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 46 Iter 172: loss 0.18127. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 46 Iter 173: loss 0.16266. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 46 Iter 173: loss 0.16266. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.04it/s]
Epoch 46 Iter 174: loss 0.16904. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.04it/s]
Epoch 46 Iter 174: loss 0.16904. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 46 Iter 175: loss 0.16231. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 46 Iter 175: loss 0.16231. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.17096. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.17096. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 46 Iter 177: loss 0.16778. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 46 Iter 177: loss 0.16778. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.17279. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.17279. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 46 Iter 179: loss 0.16991. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 46 Iter 179: loss 0.16991. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 46 Iter 180: loss 0.17183. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 46 Iter 180: loss 0.17183. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 46 Iter 181: loss 0.16100. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 46 Iter 181: loss 0.16100. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.15788. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.15788. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 46 Iter 183: loss 0.18109. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 46 Iter 183: loss 0.18109. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 46 Iter 184: loss 0.16605. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 184: loss 0.16605. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.15502. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.15502. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 46 Iter 186: loss 0.16162. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 46 Iter 186: loss 0.16162. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 46 Iter 187: loss 0.14838. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 46 Iter 187: loss 0.14838. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.15158. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.15158. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.18615. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.18615. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.15919. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.15919. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 46 Iter 191: loss 0.16251. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 46 Iter 191: loss 0.16251. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.14925. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.14925. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.17526. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.17526. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 46 Iter 194: loss 0.16068. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 46 Iter 194: loss 0.16068. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 195: loss 0.14528. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 195: loss 0.14528. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 196: loss 0.16074. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 196: loss 0.16074. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 46 Iter 197: loss 0.17053. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 46 Iter 197: loss 0.17053. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 46 Iter 198: loss 0.16718. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 46 Iter 198: loss 0.16718. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 46 Iter 199: loss 0.15904. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 46 Iter 199: loss 0.15904. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 46 Iter 200: loss 0.16927. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 46 Iter 200: loss 0.16927. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 46 Iter 201: loss 0.16802. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 46 Iter 201: loss 0.16802. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 46 Iter 202: loss 0.15905. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 46 Iter 202: loss 0.15905. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 46 Iter 203: loss 0.16111. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 203: loss 0.16111. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 204: loss 0.15883. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 204: loss 0.15883. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 46 Iter 205: loss 0.15693. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 46 Iter 205: loss 0.15693. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.16427. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.16427. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 46 Iter 207: loss 0.16405. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 46 Iter 207: loss 0.16405. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 46 Iter 208: loss 0.13635. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 46 Iter 208: loss 0.13635. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 46 Iter 209: loss 0.15489. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 46 Iter 209: loss 0.15489. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 46 Iter 210: loss 0.16300. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 46 Iter 210: loss 0.16300. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.04it/s]
Epoch 46 Iter 211: loss 0.14781. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.04it/s]
Epoch 46 Iter 211: loss 0.14781. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 46 Iter 212: loss 0.16710. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 46 Iter 212: loss 0.16710. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 46 Iter 213: loss 0.14789. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 213: loss 0.14789. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 214: loss 0.15764. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 214: loss 0.15764. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 46 Iter 215: loss 0.16356. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 46 Iter 215: loss 0.16356. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 46 Iter 216: loss 0.16676. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 46 Iter 216: loss 0.16676. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 46 Iter 217: loss 0.15678. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 217: loss 0.15678. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 218: loss 0.15680. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 218: loss 0.15680. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 46 Iter 219: loss 0.15477. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 219: loss 0.15477. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 220: loss 0.17387. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 220: loss 0.17387. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 46 Iter 221: loss 0.18133. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 46 Iter 221: loss 0.18133. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 46 Iter 222: loss 0.16085. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 46 Iter 222: loss 0.16085. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 46 Iter 223: loss 0.16184. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 46 Iter 223: loss 0.16184. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 46 Iter 224: loss 0.17197. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 46 Iter 224: loss 0.17197. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 46 Iter 224: loss 0.17197. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.15934. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.15934. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 47 Iter 2: loss 0.14468. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 47 Iter 2: loss 0.14468. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 47 Iter 3: loss 0.14689. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 47 Iter 3: loss 0.14689. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 47 Iter 4: loss 0.18131. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 47 Iter 4: loss 0.18131. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 47 Iter 5: loss 0.15711. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 47 Iter 5: loss 0.15711. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 47 Iter 6: loss 0.16019. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 47 Iter 6: loss 0.16019. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 47 Iter 7: loss 0.16048. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 47 Iter 7: loss 0.16048. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 47 Iter 8: loss 0.15406. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 47 Iter 8: loss 0.15406. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 47 Iter 9: loss 0.16296. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 47 Iter 9: loss 0.16296. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 47 Iter 10: loss 0.16119. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 47 Iter 10: loss 0.16119. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 47 Iter 11: loss 0.14678. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 47 Iter 11: loss 0.14678. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 47 Iter 12: loss 0.16829. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 47 Iter 12: loss 0.16829. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 47 Iter 13: loss 0.15936. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 13: loss 0.15936. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 14: loss 0.17164. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 14: loss 0.17164. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.16642. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.16642. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 47 Iter 16: loss 0.14582. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 47 Iter 16: loss 0.14582. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 47 Iter 17: loss 0.18890. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 47 Iter 17: loss 0.18890. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 47 Iter 18: loss 0.16311. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 47 Iter 18: loss 0.16311. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 47 Iter 19: loss 0.15076. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 19: loss 0.15076. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 20: loss 0.16230. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 20: loss 0.16230. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 47 Iter 21: loss 0.17408. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 47 Iter 21: loss 0.17408. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 47 Iter 22: loss 0.15505. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 47 Iter 22: loss 0.15505. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 47 Iter 23: loss 0.16669. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 47 Iter 23: loss 0.16669. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 47 Iter 24: loss 0.15454. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 47 Iter 24: loss 0.15454. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 47 Iter 25: loss 0.15317. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 47 Iter 25: loss 0.15317. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 26: loss 0.14023. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 26: loss 0.14023. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 47 Iter 27: loss 0.17321. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 47 Iter 27: loss 0.17321. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 47 Iter 28: loss 0.17860. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 47 Iter 28: loss 0.17860. :  12%|█████▋                                       | 28/224 [00:13<01:36,  2.03it/s]
Epoch 47 Iter 29: loss 0.15315. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.03it/s]
Epoch 47 Iter 29: loss 0.15315. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.03it/s]
Epoch 47 Iter 30: loss 0.15049. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.03it/s]
Epoch 47 Iter 30: loss 0.15049. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 47 Iter 31: loss 0.15273. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 47 Iter 31: loss 0.15273. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 47 Iter 32: loss 0.15223. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 47 Iter 32: loss 0.15223. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 47 Iter 33: loss 0.16684. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 47 Iter 33: loss 0.16684. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 47 Iter 34: loss 0.15949. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 47 Iter 34: loss 0.15949. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 47 Iter 35: loss 0.15515. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 47 Iter 35: loss 0.15515. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 47 Iter 36: loss 0.17701. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 47 Iter 36: loss 0.17701. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 47 Iter 37: loss 0.17829. :  16%|███████▏                                     | 36/224 [00:18<01:32,  2.04it/s]
Epoch 47 Iter 37: loss 0.17829. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 47 Iter 38: loss 0.16802. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 47 Iter 38: loss 0.16802. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.04it/s]
Epoch 47 Iter 39: loss 0.15611. :  17%|███████▋                                     | 38/224 [00:19<01:31,  2.04it/s]
Epoch 47 Iter 39: loss 0.15611. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.03it/s]
Epoch 47 Iter 40: loss 0.16519. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.03it/s]
Epoch 47 Iter 40: loss 0.16519. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 47 Iter 41: loss 0.17108. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 47 Iter 41: loss 0.17108. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 47 Iter 42: loss 0.14970. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 47 Iter 42: loss 0.14970. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 47 Iter 43: loss 0.16316. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 47 Iter 43: loss 0.16316. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 47 Iter 44: loss 0.17493. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 47 Iter 44: loss 0.17493. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 47 Iter 45: loss 0.15807. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 47 Iter 45: loss 0.15807. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.06it/s]
Epoch 47 Iter 46: loss 0.16426. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.06it/s]
Epoch 47 Iter 46: loss 0.16426. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 47 Iter 47: loss 0.17672. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 47 Iter 47: loss 0.17672. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 47 Iter 48: loss 0.14947. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 47 Iter 48: loss 0.14947. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 47 Iter 49: loss 0.17080. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 47 Iter 49: loss 0.17080. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 47 Iter 50: loss 0.15280. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 47 Iter 50: loss 0.15280. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 47 Iter 51: loss 0.15686. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 47 Iter 51: loss 0.15686. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 47 Iter 52: loss 0.16425. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 47 Iter 52: loss 0.16425. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 47 Iter 53: loss 0.17476. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 47 Iter 53: loss 0.17476. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 47 Iter 54: loss 0.15347. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 47 Iter 54: loss 0.15347. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 47 Iter 55: loss 0.15211. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 47 Iter 55: loss 0.15211. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 47 Iter 56: loss 0.16798. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 47 Iter 56: loss 0.16798. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 47 Iter 57: loss 0.17990. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 47 Iter 57: loss 0.17990. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 47 Iter 58: loss 0.12272. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 47 Iter 58: loss 0.12272. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 47 Iter 59: loss 0.15291. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 47 Iter 59: loss 0.15291. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 47 Iter 60: loss 0.15368. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 47 Iter 60: loss 0.15368. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 47 Iter 61: loss 0.13584. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 47 Iter 61: loss 0.13584. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 47 Iter 62: loss 0.17561. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 47 Iter 62: loss 0.17561. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 47 Iter 63: loss 0.17240. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 47 Iter 63: loss 0.17240. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 47 Iter 64: loss 0.17663. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 47 Iter 64: loss 0.17663. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 47 Iter 65: loss 0.17732. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 47 Iter 65: loss 0.17732. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 47 Iter 66: loss 0.14964. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 47 Iter 66: loss 0.14964. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 67: loss 0.14717. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 67: loss 0.14717. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 68: loss 0.15273. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 47 Iter 68: loss 0.15273. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.05it/s]
Epoch 47 Iter 69: loss 0.13968. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.05it/s]
Epoch 47 Iter 69: loss 0.13968. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 47 Iter 70: loss 0.14412. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.06it/s]
Epoch 47 Iter 70: loss 0.14412. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 47 Iter 71: loss 0.17274. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 47 Iter 71: loss 0.17274. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 47 Iter 72: loss 0.15912. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.06it/s]
Epoch 47 Iter 72: loss 0.15912. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 47 Iter 73: loss 0.16336. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 47 Iter 73: loss 0.16336. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 74: loss 0.17240. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 74: loss 0.17240. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 47 Iter 75: loss 0.15296. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 47 Iter 75: loss 0.15296. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 47 Iter 76: loss 0.15987. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 47 Iter 76: loss 0.15987. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 47 Iter 77: loss 0.14600. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 47 Iter 77: loss 0.14600. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 47 Iter 78: loss 0.18315. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 47 Iter 78: loss 0.18315. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 47 Iter 79: loss 0.17404. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 47 Iter 79: loss 0.17404. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 47 Iter 80: loss 0.14818. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 47 Iter 80: loss 0.14818. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 47 Iter 81: loss 0.17807. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 47 Iter 81: loss 0.17807. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.16982. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.16982. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 47 Iter 83: loss 0.16425. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 47 Iter 83: loss 0.16425. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 47 Iter 84: loss 0.15258. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 47 Iter 84: loss 0.15258. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 47 Iter 85: loss 0.18864. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 47 Iter 85: loss 0.18864. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 47 Iter 86: loss 0.16274. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 47 Iter 86: loss 0.16274. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 47 Iter 87: loss 0.18222. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 87: loss 0.18222. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 47 Iter 88: loss 0.15094. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 47 Iter 88: loss 0.15094. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 47 Iter 89: loss 0.17348. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 47 Iter 89: loss 0.17348. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 47 Iter 90: loss 0.13906. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 47 Iter 90: loss 0.13906. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 47 Iter 91: loss 0.16496. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 47 Iter 91: loss 0.16496. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 47 Iter 92: loss 0.15276. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 47 Iter 92: loss 0.15276. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 47 Iter 93: loss 0.17002. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 47 Iter 93: loss 0.17002. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 47 Iter 94: loss 0.15293. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 47 Iter 94: loss 0.15293. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 47 Iter 95: loss 0.16203. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 47 Iter 95: loss 0.16203. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 47 Iter 96: loss 0.18074. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 47 Iter 96: loss 0.18074. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 47 Iter 97: loss 0.15816. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 47 Iter 97: loss 0.15816. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 47 Iter 98: loss 0.15691. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 47 Iter 98: loss 0.15691. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 47 Iter 99: loss 0.15280. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 47 Iter 99: loss 0.15280. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.05it/s]
Epoch 47 Iter 100: loss 0.16959. :  44%|███████████████████▍                        | 99/224 [00:48<01:01,  2.05it/s]
Epoch 47 Iter 100: loss 0.16959. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 47 Iter 101: loss 0.17920. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 47 Iter 101: loss 0.17920. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 47 Iter 102: loss 0.14782. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 47 Iter 102: loss 0.14782. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 47 Iter 103: loss 0.17672. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 47 Iter 103: loss 0.17672. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 47 Iter 104: loss 0.15679. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 47 Iter 104: loss 0.15679. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 47 Iter 105: loss 0.15895. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 47 Iter 105: loss 0.15895. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 47 Iter 106: loss 0.16445. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 47 Iter 106: loss 0.16445. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 47 Iter 107: loss 0.15652. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 47 Iter 107: loss 0.15652. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 47 Iter 108: loss 0.15963. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 108: loss 0.15963. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.15460. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.15460. :  49%|████████████████████▉                      | 109/224 [00:52<00:56,  2.05it/s]
Epoch 47 Iter 110: loss 0.15103. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.05it/s]
Epoch 47 Iter 110: loss 0.15103. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 111: loss 0.17539. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 111: loss 0.17539. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.04it/s]
Epoch 47 Iter 112: loss 0.17470. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.04it/s]
Epoch 47 Iter 112: loss 0.17470. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 47 Iter 113: loss 0.15781. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 47 Iter 113: loss 0.15781. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.04it/s]
Epoch 47 Iter 114: loss 0.13819. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.04it/s]
Epoch 47 Iter 114: loss 0.13819. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.16301. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.16301. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 47 Iter 116: loss 0.16834. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 116: loss 0.16834. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 47 Iter 117: loss 0.17280. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 47 Iter 117: loss 0.17280. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 47 Iter 118: loss 0.17430. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 47 Iter 118: loss 0.17430. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 119: loss 0.16696. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 119: loss 0.16696. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 120: loss 0.14845. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.09it/s]
Epoch 47 Iter 120: loss 0.14845. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.09it/s]
Epoch 47 Iter 121: loss 0.16845. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.09it/s]
Epoch 47 Iter 121: loss 0.16845. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.09it/s]
Epoch 47 Iter 122: loss 0.17973. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.09it/s]
Epoch 47 Iter 122: loss 0.17973. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 47 Iter 123: loss 0.17962. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 47 Iter 123: loss 0.17962. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 47 Iter 124: loss 0.14963. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 47 Iter 124: loss 0.14963. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 125: loss 0.17522. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 125: loss 0.17522. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 47 Iter 126: loss 0.14903. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 47 Iter 126: loss 0.14903. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 47 Iter 127: loss 0.14538. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 47 Iter 127: loss 0.14538. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 47 Iter 128: loss 0.16321. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 47 Iter 128: loss 0.16321. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 47 Iter 129: loss 0.17597. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 47 Iter 129: loss 0.17597. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.07it/s]
Epoch 47 Iter 130: loss 0.14823. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.07it/s]
Epoch 47 Iter 130: loss 0.14823. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 47 Iter 131: loss 0.15797. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 47 Iter 131: loss 0.15797. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 47 Iter 132: loss 0.15619. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 132: loss 0.15619. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 133: loss 0.14735. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 133: loss 0.14735. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 47 Iter 134: loss 0.16989. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 47 Iter 134: loss 0.16989. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.05it/s]
Epoch 47 Iter 135: loss 0.15656. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.05it/s]
Epoch 47 Iter 135: loss 0.15656. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.04it/s]
Epoch 47 Iter 136: loss 0.14916. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.04it/s]
Epoch 47 Iter 136: loss 0.14916. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 47 Iter 137: loss 0.17736. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 47 Iter 137: loss 0.17736. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 47 Iter 138: loss 0.14011. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 47 Iter 138: loss 0.14011. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 47 Iter 139: loss 0.16703. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 47 Iter 139: loss 0.16703. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 47 Iter 140: loss 0.17689. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 47 Iter 140: loss 0.17689. :  62%|██████████████████████████▉                | 140/224 [01:07<00:41,  2.04it/s]
Epoch 47 Iter 141: loss 0.13529. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.04it/s]
Epoch 47 Iter 141: loss 0.13529. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 47 Iter 142: loss 0.18209. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 47 Iter 142: loss 0.18209. :  63%|███████████████████████████▎               | 142/224 [01:08<00:40,  2.05it/s]
Epoch 47 Iter 143: loss 0.14897. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.05it/s]
Epoch 47 Iter 143: loss 0.14897. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 144: loss 0.15818. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 144: loss 0.15818. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.04it/s]
Epoch 47 Iter 145: loss 0.17216. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.04it/s]
Epoch 47 Iter 145: loss 0.17216. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 47 Iter 146: loss 0.15944. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 47 Iter 146: loss 0.15944. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 47 Iter 147: loss 0.15655. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 47 Iter 147: loss 0.15655. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 47 Iter 148: loss 0.15922. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 47 Iter 148: loss 0.15922. :  66%|████████████████████████████▍              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 47 Iter 149: loss 0.16326. :  66%|████████████████████████████▍              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 47 Iter 149: loss 0.16326. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 150: loss 0.15413. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 150: loss 0.15413. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 151: loss 0.15520. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 47 Iter 151: loss 0.15520. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 152: loss 0.14066. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 152: loss 0.14066. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 153: loss 0.16497. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 47 Iter 153: loss 0.16497. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 154: loss 0.15749. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 154: loss 0.15749. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.04it/s]
Epoch 47 Iter 155: loss 0.15123. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.04it/s]
Epoch 47 Iter 155: loss 0.15123. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 47 Iter 156: loss 0.14735. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 47 Iter 156: loss 0.14735. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 47 Iter 157: loss 0.14701. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 47 Iter 157: loss 0.14701. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 47 Iter 158: loss 0.16079. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 47 Iter 158: loss 0.16079. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 47 Iter 159: loss 0.15928. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 47 Iter 159: loss 0.15928. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 47 Iter 160: loss 0.17225. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 47 Iter 160: loss 0.17225. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.15634. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.15634. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 47 Iter 162: loss 0.17712. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 47 Iter 162: loss 0.17712. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 47 Iter 163: loss 0.15119. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.07it/s]
Epoch 47 Iter 163: loss 0.15119. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 47 Iter 164: loss 0.16017. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 47 Iter 164: loss 0.16017. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 47 Iter 165: loss 0.15980. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.08it/s]
Epoch 47 Iter 165: loss 0.15980. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 47 Iter 166: loss 0.14721. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 47 Iter 166: loss 0.14721. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 47 Iter 167: loss 0.16309. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:27,  2.08it/s]
Epoch 47 Iter 167: loss 0.16309. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 47 Iter 168: loss 0.18307. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 47 Iter 168: loss 0.18307. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 47 Iter 169: loss 0.15169. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 47 Iter 169: loss 0.15169. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 170: loss 0.15850. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 170: loss 0.15850. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 171: loss 0.15564. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 47 Iter 171: loss 0.15564. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 47 Iter 172: loss 0.16166. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 47 Iter 172: loss 0.16166. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 47 Iter 173: loss 0.15692. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 47 Iter 173: loss 0.15692. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 47 Iter 174: loss 0.15791. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 47 Iter 174: loss 0.15791. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 47 Iter 175: loss 0.15291. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 47 Iter 175: loss 0.15291. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 47 Iter 176: loss 0.17330. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 47 Iter 176: loss 0.17330. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 47 Iter 177: loss 0.15591. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 47 Iter 177: loss 0.15591. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 47 Iter 178: loss 0.18701. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 47 Iter 178: loss 0.18701. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 47 Iter 179: loss 0.14124. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 47 Iter 179: loss 0.14124. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 47 Iter 180: loss 0.17027. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 47 Iter 180: loss 0.17027. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 47 Iter 181: loss 0.15380. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 47 Iter 181: loss 0.15380. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 47 Iter 182: loss 0.14246. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 47 Iter 182: loss 0.14246. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 47 Iter 183: loss 0.17712. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 47 Iter 183: loss 0.17712. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 47 Iter 184: loss 0.17653. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 47 Iter 184: loss 0.17653. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 47 Iter 185: loss 0.16345. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 47 Iter 185: loss 0.16345. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 47 Iter 186: loss 0.16550. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 47 Iter 186: loss 0.16550. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 47 Iter 187: loss 0.16058. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 47 Iter 187: loss 0.16058. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.16518. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.16518. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.15843. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.15843. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.14914. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.14914. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 191: loss 0.17665. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 191: loss 0.17665. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 47 Iter 192: loss 0.16279. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 192: loss 0.16279. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 193: loss 0.14838. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 193: loss 0.14838. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 47 Iter 194: loss 0.15608. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 47 Iter 194: loss 0.15608. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 47 Iter 195: loss 0.16949. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 47 Iter 195: loss 0.16949. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 47 Iter 196: loss 0.16093. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.04it/s]
Epoch 47 Iter 196: loss 0.16093. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 47 Iter 197: loss 0.15500. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 47 Iter 197: loss 0.15500. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 47 Iter 198: loss 0.16659. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 47 Iter 198: loss 0.16659. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 47 Iter 199: loss 0.17755. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 47 Iter 199: loss 0.17755. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.15955. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.15955. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 201: loss 0.16773. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 201: loss 0.16773. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.17241. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.17241. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 47 Iter 203: loss 0.15288. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 47 Iter 203: loss 0.15288. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.16408. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.16408. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.15774. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.15774. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 47 Iter 206: loss 0.15857. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 47 Iter 206: loss 0.15857. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.11it/s]
Epoch 47 Iter 207: loss 0.18095. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.11it/s]
Epoch 47 Iter 207: loss 0.18095. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 47 Iter 208: loss 0.17083. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 47 Iter 208: loss 0.17083. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.09it/s]
Epoch 47 Iter 209: loss 0.16626. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.09it/s]
Epoch 47 Iter 209: loss 0.16626. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 47 Iter 210: loss 0.17896. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 47 Iter 210: loss 0.17896. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.09it/s]
Epoch 47 Iter 211: loss 0.15846. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.09it/s]
Epoch 47 Iter 211: loss 0.15846. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 47 Iter 212: loss 0.15299. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 47 Iter 212: loss 0.15299. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 47 Iter 213: loss 0.17335. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 47 Iter 213: loss 0.17335. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 47 Iter 214: loss 0.16344. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 47 Iter 214: loss 0.16344. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 47 Iter 215: loss 0.15132. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 215: loss 0.15132. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 216: loss 0.15590. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 216: loss 0.15590. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 47 Iter 217: loss 0.16654. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 47 Iter 217: loss 0.16654. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 47 Iter 218: loss 0.15268. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 47 Iter 218: loss 0.15268. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 47 Iter 219: loss 0.16525. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 47 Iter 219: loss 0.16525. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 47 Iter 220: loss 0.18723. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 47 Iter 220: loss 0.18723. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 47 Iter 221: loss 0.16861. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 47 Iter 221: loss 0.16861. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 47 Iter 222: loss 0.17986. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 47 Iter 222: loss 0.17986. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.16305. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.16305. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.15934. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.15934. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.03it/s]
Epoch 47 Iter 224: loss 0.15934. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16159
    Valid loss: 0.17082
       Valid loss recons: 0.17082
       Valid loss KL-D:   136183.92259
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.14612. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.14612. :   0%|▏                                              | 1/224 [00:00<01:45,  2.11it/s]
Epoch 48 Iter 2: loss 0.13541. :   0%|▏                                              | 1/224 [00:00<01:45,  2.11it/s]
Epoch 48 Iter 2: loss 0.13541. :   1%|▍                                              | 2/224 [00:00<01:45,  2.10it/s]
Epoch 48 Iter 3: loss 0.16119. :   1%|▍                                              | 2/224 [00:01<01:45,  2.10it/s]
Epoch 48 Iter 3: loss 0.16119. :   1%|▋                                              | 3/224 [00:01<01:44,  2.11it/s]
Epoch 48 Iter 4: loss 0.13958. :   1%|▋                                              | 3/224 [00:01<01:44,  2.11it/s]
Epoch 48 Iter 4: loss 0.13958. :   2%|▊                                              | 4/224 [00:01<01:45,  2.09it/s]
Epoch 48 Iter 5: loss 0.15612. :   2%|▊                                              | 4/224 [00:02<01:45,  2.09it/s]
Epoch 48 Iter 5: loss 0.15612. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 48 Iter 6: loss 0.16058. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 48 Iter 6: loss 0.16058. :   3%|█▎                                             | 6/224 [00:02<01:44,  2.08it/s]
Epoch 48 Iter 7: loss 0.15053. :   3%|█▎                                             | 6/224 [00:03<01:44,  2.08it/s]
Epoch 48 Iter 7: loss 0.15053. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 48 Iter 8: loss 0.15927. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 48 Iter 8: loss 0.15927. :   4%|█▋                                             | 8/224 [00:03<01:43,  2.08it/s]
Epoch 48 Iter 9: loss 0.15904. :   4%|█▋                                             | 8/224 [00:04<01:43,  2.08it/s]
Epoch 48 Iter 9: loss 0.15904. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.08it/s]
Epoch 48 Iter 10: loss 0.15032. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 48 Iter 10: loss 0.15032. :   4%|██                                           | 10/224 [00:04<01:42,  2.08it/s]
Epoch 48 Iter 11: loss 0.16153. :   4%|██                                           | 10/224 [00:05<01:42,  2.08it/s]
Epoch 48 Iter 11: loss 0.16153. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 48 Iter 12: loss 0.16362. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 48 Iter 12: loss 0.16362. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.08it/s]
Epoch 48 Iter 13: loss 0.16550. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.08it/s]
Epoch 48 Iter 13: loss 0.16550. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 48 Iter 14: loss 0.15265. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 48 Iter 14: loss 0.15265. :   6%|██▊                                          | 14/224 [00:06<01:40,  2.09it/s]
Epoch 48 Iter 15: loss 0.14936. :   6%|██▊                                          | 14/224 [00:07<01:40,  2.09it/s]
Epoch 48 Iter 15: loss 0.14936. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 48 Iter 16: loss 0.15055. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 48 Iter 16: loss 0.15055. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 48 Iter 17: loss 0.16439. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 48 Iter 17: loss 0.16439. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.15965. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.15965. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 48 Iter 19: loss 0.19707. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 48 Iter 19: loss 0.19707. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 48 Iter 20: loss 0.15502. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 48 Iter 20: loss 0.15502. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 48 Iter 21: loss 0.18104. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 48 Iter 21: loss 0.18104. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 48 Iter 22: loss 0.16779. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 48 Iter 22: loss 0.16779. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.04it/s]
Epoch 48 Iter 23: loss 0.16774. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.04it/s]
Epoch 48 Iter 23: loss 0.16774. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 48 Iter 24: loss 0.17854. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 48 Iter 24: loss 0.17854. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 48 Iter 25: loss 0.16587. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 48 Iter 25: loss 0.16587. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 48 Iter 26: loss 0.14494. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 48 Iter 26: loss 0.14494. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 48 Iter 27: loss 0.16970. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 48 Iter 27: loss 0.16970. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 48 Iter 28: loss 0.14646. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 48 Iter 28: loss 0.14646. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.04it/s]
Epoch 48 Iter 29: loss 0.14884. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.04it/s]
Epoch 48 Iter 29: loss 0.14884. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 48 Iter 30: loss 0.14812. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 48 Iter 30: loss 0.14812. :  13%|██████                                       | 30/224 [00:14<01:34,  2.04it/s]
Epoch 48 Iter 31: loss 0.13827. :  13%|██████                                       | 30/224 [00:15<01:34,  2.04it/s]
Epoch 48 Iter 31: loss 0.13827. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 48 Iter 32: loss 0.17025. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 48 Iter 32: loss 0.17025. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 48 Iter 33: loss 0.17149. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 48 Iter 33: loss 0.17149. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.06it/s]
Epoch 48 Iter 34: loss 0.16330. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 48 Iter 34: loss 0.16330. :  15%|██████▊                                      | 34/224 [00:16<01:33,  2.03it/s]
Epoch 48 Iter 35: loss 0.16208. :  15%|██████▊                                      | 34/224 [00:16<01:33,  2.03it/s]
Epoch 48 Iter 35: loss 0.16208. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 48 Iter 36: loss 0.15210. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 48 Iter 36: loss 0.15210. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 48 Iter 37: loss 0.17457. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 48 Iter 37: loss 0.17457. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.04it/s]
Epoch 48 Iter 38: loss 0.13830. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 48 Iter 38: loss 0.13830. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.04it/s]
Epoch 48 Iter 39: loss 0.17599. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.04it/s]
Epoch 48 Iter 39: loss 0.17599. :  17%|███████▊                                     | 39/224 [00:18<01:30,  2.05it/s]
Epoch 48 Iter 40: loss 0.14978. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.05it/s]
Epoch 48 Iter 40: loss 0.14978. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 48 Iter 41: loss 0.16065. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 48 Iter 41: loss 0.16065. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 48 Iter 42: loss 0.18699. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 48 Iter 42: loss 0.18699. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 48 Iter 43: loss 0.13686. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 48 Iter 43: loss 0.13686. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 48 Iter 44: loss 0.16345. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 48 Iter 44: loss 0.16345. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.03it/s]
Epoch 48 Iter 45: loss 0.16216. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.03it/s]
Epoch 48 Iter 45: loss 0.16216. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 48 Iter 46: loss 0.17221. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 48 Iter 46: loss 0.17221. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 48 Iter 47: loss 0.15025. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 48 Iter 47: loss 0.15025. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.04it/s]
Epoch 48 Iter 48: loss 0.15394. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 48 Iter 48: loss 0.15394. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 48 Iter 49: loss 0.16226. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 48 Iter 49: loss 0.16226. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.04it/s]
Epoch 48 Iter 50: loss 0.14709. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 50: loss 0.14709. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 51: loss 0.16010. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 51: loss 0.16010. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 48 Iter 52: loss 0.17641. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 48 Iter 52: loss 0.17641. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 48 Iter 53: loss 0.15495. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 48 Iter 53: loss 0.15495. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 48 Iter 54: loss 0.15303. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 48 Iter 54: loss 0.15303. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 48 Iter 55: loss 0.17147. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 48 Iter 55: loss 0.17147. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 48 Iter 56: loss 0.18772. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 48 Iter 56: loss 0.18772. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 48 Iter 57: loss 0.16274. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 48 Iter 57: loss 0.16274. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 48 Iter 58: loss 0.16802. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 48 Iter 58: loss 0.16802. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 48 Iter 59: loss 0.18197. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 48 Iter 59: loss 0.18197. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 48 Iter 60: loss 0.14726. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 48 Iter 60: loss 0.14726. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 48 Iter 61: loss 0.16758. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.05it/s]
Epoch 48 Iter 61: loss 0.16758. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 48 Iter 62: loss 0.15517. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 48 Iter 62: loss 0.15517. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 48 Iter 63: loss 0.16879. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 48 Iter 63: loss 0.16879. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.06it/s]
Epoch 48 Iter 64: loss 0.15981. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 64: loss 0.15981. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 65: loss 0.15880. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 65: loss 0.15880. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.14904. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.14904. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 48 Iter 67: loss 0.15782. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 48 Iter 67: loss 0.15782. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.14387. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.14387. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 48 Iter 69: loss 0.17811. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 48 Iter 69: loss 0.17811. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 48 Iter 70: loss 0.14174. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.07it/s]
Epoch 48 Iter 70: loss 0.14174. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 48 Iter 71: loss 0.16104. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 48 Iter 71: loss 0.16104. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.09it/s]
Epoch 48 Iter 72: loss 0.16715. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.09it/s]
Epoch 48 Iter 72: loss 0.16715. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.08it/s]
Epoch 48 Iter 73: loss 0.16148. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.08it/s]
Epoch 48 Iter 73: loss 0.16148. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 48 Iter 74: loss 0.16120. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 48 Iter 74: loss 0.16120. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 48 Iter 75: loss 0.15406. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 48 Iter 75: loss 0.15406. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 48 Iter 76: loss 0.14938. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 48 Iter 76: loss 0.14938. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 48 Iter 77: loss 0.14158. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 48 Iter 77: loss 0.14158. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 48 Iter 78: loss 0.16654. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 48 Iter 78: loss 0.16654. :  35%|███████████████▋                             | 78/224 [00:37<01:09,  2.09it/s]
Epoch 48 Iter 79: loss 0.16186. :  35%|███████████████▋                             | 78/224 [00:38<01:09,  2.09it/s]
Epoch 48 Iter 79: loss 0.16186. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 48 Iter 80: loss 0.14888. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 48 Iter 80: loss 0.14888. :  36%|████████████████                             | 80/224 [00:38<01:08,  2.09it/s]
Epoch 48 Iter 81: loss 0.15406. :  36%|████████████████                             | 80/224 [00:39<01:08,  2.09it/s]
Epoch 48 Iter 81: loss 0.15406. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 48 Iter 82: loss 0.14320. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 48 Iter 82: loss 0.14320. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 48 Iter 83: loss 0.16944. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 48 Iter 83: loss 0.16944. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.07it/s]
Epoch 48 Iter 84: loss 0.15116. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.07it/s]
Epoch 48 Iter 84: loss 0.15116. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 48 Iter 85: loss 0.16281. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 48 Iter 85: loss 0.16281. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 48 Iter 86: loss 0.17699. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 48 Iter 86: loss 0.17699. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 48 Iter 87: loss 0.16452. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 48 Iter 87: loss 0.16452. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 48 Iter 88: loss 0.16389. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 48 Iter 88: loss 0.16389. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.16599. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.16599. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.14328. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.14328. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.16507. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.16507. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 48 Iter 92: loss 0.15743. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 48 Iter 92: loss 0.15743. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 48 Iter 93: loss 0.13907. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 48 Iter 93: loss 0.13907. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.17120. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.17120. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 95: loss 0.17564. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 48 Iter 95: loss 0.17564. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 48 Iter 96: loss 0.13094. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 48 Iter 96: loss 0.13094. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 48 Iter 97: loss 0.15615. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 48 Iter 97: loss 0.15615. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.16577. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.16577. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 48 Iter 99: loss 0.15841. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 48 Iter 99: loss 0.15841. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.15197. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.15197. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 48 Iter 101: loss 0.17255. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 48 Iter 101: loss 0.17255. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 48 Iter 102: loss 0.14881. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 48 Iter 102: loss 0.14881. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 48 Iter 103: loss 0.16375. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 48 Iter 103: loss 0.16375. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 48 Iter 104: loss 0.17807. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 48 Iter 104: loss 0.17807. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 48 Iter 105: loss 0.16348. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 48 Iter 105: loss 0.16348. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.15477. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.15477. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 48 Iter 107: loss 0.15660. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 48 Iter 107: loss 0.15660. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.05it/s]
Epoch 48 Iter 108: loss 0.16207. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.05it/s]
Epoch 48 Iter 108: loss 0.16207. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 109: loss 0.17515. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 109: loss 0.17515. :  49%|████████████████████▉                      | 109/224 [00:52<00:56,  2.05it/s]
Epoch 48 Iter 110: loss 0.16801. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.05it/s]
Epoch 48 Iter 110: loss 0.16801. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 48 Iter 111: loss 0.17193. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 48 Iter 111: loss 0.17193. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.04it/s]
Epoch 48 Iter 112: loss 0.16308. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.04it/s]
Epoch 48 Iter 112: loss 0.16308. :  50%|█████████████████████▌                     | 112/224 [00:54<00:55,  2.03it/s]
Epoch 48 Iter 113: loss 0.16465. :  50%|█████████████████████▌                     | 112/224 [00:54<00:55,  2.03it/s]
Epoch 48 Iter 113: loss 0.16465. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.04it/s]
Epoch 48 Iter 114: loss 0.15667. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.04it/s]
Epoch 48 Iter 114: loss 0.15667. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 48 Iter 115: loss 0.16495. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 48 Iter 115: loss 0.16495. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 48 Iter 116: loss 0.15767. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 48 Iter 116: loss 0.15767. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 48 Iter 117: loss 0.16098. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 48 Iter 117: loss 0.16098. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.04it/s]
Epoch 48 Iter 118: loss 0.17540. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 48 Iter 118: loss 0.17540. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 48 Iter 119: loss 0.16849. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 48 Iter 119: loss 0.16849. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.03it/s]
Epoch 48 Iter 120: loss 0.16281. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.03it/s]
Epoch 48 Iter 120: loss 0.16281. :  54%|███████████████████████                    | 120/224 [00:58<00:51,  2.03it/s]
Epoch 48 Iter 121: loss 0.15689. :  54%|███████████████████████                    | 120/224 [00:58<00:51,  2.03it/s]
Epoch 48 Iter 121: loss 0.15689. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.04it/s]
Epoch 48 Iter 122: loss 0.16115. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.04it/s]
Epoch 48 Iter 122: loss 0.16115. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 48 Iter 123: loss 0.16549. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 48 Iter 123: loss 0.16549. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 48 Iter 124: loss 0.18114. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 48 Iter 124: loss 0.18114. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 48 Iter 125: loss 0.14836. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 48 Iter 125: loss 0.14836. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 48 Iter 126: loss 0.16682. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 48 Iter 126: loss 0.16682. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 48 Iter 127: loss 0.14707. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 48 Iter 127: loss 0.14707. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 48 Iter 128: loss 0.17092. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 48 Iter 128: loss 0.17092. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 48 Iter 129: loss 0.14350. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 48 Iter 129: loss 0.14350. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 48 Iter 130: loss 0.13851. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 48 Iter 130: loss 0.13851. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 48 Iter 131: loss 0.13624. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 48 Iter 131: loss 0.13624. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.03it/s]
Epoch 48 Iter 132: loss 0.18051. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.03it/s]
Epoch 48 Iter 132: loss 0.18051. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 48 Iter 133: loss 0.18164. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 48 Iter 133: loss 0.18164. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 48 Iter 134: loss 0.15506. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.04it/s]
Epoch 48 Iter 134: loss 0.15506. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.03it/s]
Epoch 48 Iter 135: loss 0.16094. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.03it/s]
Epoch 48 Iter 135: loss 0.16094. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 48 Iter 136: loss 0.15550. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 48 Iter 136: loss 0.15550. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 48 Iter 137: loss 0.15629. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 48 Iter 137: loss 0.15629. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 48 Iter 138: loss 0.16201. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 48 Iter 138: loss 0.16201. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 48 Iter 139: loss 0.18158. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 48 Iter 139: loss 0.18158. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 48 Iter 140: loss 0.16045. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 48 Iter 140: loss 0.16045. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 141: loss 0.16123. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 141: loss 0.16123. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 48 Iter 142: loss 0.16475. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 48 Iter 142: loss 0.16475. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 48 Iter 143: loss 0.16793. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 143: loss 0.16793. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 144: loss 0.16811. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 144: loss 0.16811. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 48 Iter 145: loss 0.17337. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 48 Iter 145: loss 0.17337. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 48 Iter 146: loss 0.19258. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 48 Iter 146: loss 0.19258. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.05it/s]
Epoch 48 Iter 147: loss 0.15367. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.05it/s]
Epoch 48 Iter 147: loss 0.15367. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 48 Iter 148: loss 0.14711. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 48 Iter 148: loss 0.14711. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 48 Iter 149: loss 0.14957. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 149: loss 0.14957. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 150: loss 0.14408. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 150: loss 0.14408. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 48 Iter 151: loss 0.14308. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 48 Iter 151: loss 0.14308. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 48 Iter 152: loss 0.14333. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 48 Iter 152: loss 0.14333. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.14452. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.14452. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.15423. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.15423. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 48 Iter 155: loss 0.14956. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 155: loss 0.14956. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.17466. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.17466. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.15360. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.15360. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.14757. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.14757. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.19237. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.19237. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 48 Iter 160: loss 0.16087. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 48 Iter 160: loss 0.16087. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 48 Iter 161: loss 0.14432. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 48 Iter 161: loss 0.14432. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 48 Iter 162: loss 0.15820. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 48 Iter 162: loss 0.15820. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.09it/s]
Epoch 48 Iter 163: loss 0.17660. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.09it/s]
Epoch 48 Iter 163: loss 0.17660. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 48 Iter 164: loss 0.13988. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 48 Iter 164: loss 0.13988. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 48 Iter 165: loss 0.15322. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.08it/s]
Epoch 48 Iter 165: loss 0.15322. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.16877. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.16877. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.15169. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.15169. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.15026. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.15026. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 48 Iter 169: loss 0.15570. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 48 Iter 169: loss 0.15570. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.18116. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.18116. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.17672. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.17672. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 48 Iter 172: loss 0.15568. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 48 Iter 172: loss 0.15568. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 48 Iter 173: loss 0.17566. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 48 Iter 173: loss 0.17566. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 48 Iter 174: loss 0.18078. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 174: loss 0.18078. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.15300. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.15300. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 48 Iter 176: loss 0.18327. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 48 Iter 176: loss 0.18327. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 48 Iter 177: loss 0.14507. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 48 Iter 177: loss 0.14507. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 48 Iter 178: loss 0.16492. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 178: loss 0.16492. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 179: loss 0.18335. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 179: loss 0.18335. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 48 Iter 180: loss 0.15181. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 48 Iter 180: loss 0.15181. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 48 Iter 181: loss 0.15757. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 48 Iter 181: loss 0.15757. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 48 Iter 182: loss 0.18881. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 182: loss 0.18881. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.15227. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.15227. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 48 Iter 184: loss 0.16718. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 48 Iter 184: loss 0.16718. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.16095. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.16095. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 48 Iter 186: loss 0.16070. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 48 Iter 186: loss 0.16070. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.16272. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.16272. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 48 Iter 188: loss 0.14933. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 188: loss 0.14933. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 189: loss 0.15055. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 189: loss 0.15055. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.15055. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.15055. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.03it/s]
Epoch 48 Iter 191: loss 0.15436. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.03it/s]
Epoch 48 Iter 191: loss 0.15436. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.03it/s]
Epoch 48 Iter 192: loss 0.15889. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.03it/s]
Epoch 48 Iter 192: loss 0.15889. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 48 Iter 193: loss 0.18455. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 48 Iter 193: loss 0.18455. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 48 Iter 194: loss 0.18392. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 48 Iter 194: loss 0.18392. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.04it/s]
Epoch 48 Iter 195: loss 0.16346. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.04it/s]
Epoch 48 Iter 195: loss 0.16346. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 48 Iter 196: loss 0.17298. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.04it/s]
Epoch 48 Iter 196: loss 0.17298. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 197: loss 0.18735. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 197: loss 0.18735. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 48 Iter 198: loss 0.15664. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.04it/s]
Epoch 48 Iter 198: loss 0.15664. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.17962. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.17962. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.16499. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.16499. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 48 Iter 201: loss 0.15386. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 48 Iter 201: loss 0.15386. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 48 Iter 202: loss 0.16011. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 48 Iter 202: loss 0.16011. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 48 Iter 203: loss 0.15649. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 48 Iter 203: loss 0.15649. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.16304. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.16304. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.19524. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.19524. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 206: loss 0.15636. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 206: loss 0.15636. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 48 Iter 207: loss 0.16688. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 207: loss 0.16688. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 48 Iter 208: loss 0.17694. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 48 Iter 208: loss 0.17694. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.04it/s]
Epoch 48 Iter 209: loss 0.17656. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.04it/s]
Epoch 48 Iter 209: loss 0.17656. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.04it/s]
Epoch 48 Iter 210: loss 0.16449. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.04it/s]
Epoch 48 Iter 210: loss 0.16449. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 48 Iter 211: loss 0.19882. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 211: loss 0.19882. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.16114. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.16114. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 48 Iter 213: loss 0.16238. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 48 Iter 213: loss 0.16238. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 48 Iter 214: loss 0.16762. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 48 Iter 214: loss 0.16762. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 48 Iter 215: loss 0.14548. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.09it/s]
Epoch 48 Iter 215: loss 0.14548. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 48 Iter 216: loss 0.16217. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 48 Iter 216: loss 0.16217. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.09it/s]
Epoch 48 Iter 217: loss 0.15846. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.09it/s]
Epoch 48 Iter 217: loss 0.15846. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 48 Iter 218: loss 0.15550. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 48 Iter 218: loss 0.15550. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 48 Iter 219: loss 0.16717. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.09it/s]
Epoch 48 Iter 219: loss 0.16717. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.10it/s]
Epoch 48 Iter 220: loss 0.14572. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.10it/s]
Epoch 48 Iter 220: loss 0.14572. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 48 Iter 221: loss 0.15469. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.08it/s]
Epoch 48 Iter 221: loss 0.15469. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 48 Iter 222: loss 0.16479. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 48 Iter 222: loss 0.16479. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 48 Iter 223: loss 0.14772. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.08it/s]
Epoch 48 Iter 223: loss 0.14772. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 48 Iter 224: loss 0.15383. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 48 Iter 224: loss 0.15383. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 48 Iter 224: loss 0.15383. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.15117. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.15117. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 49 Iter 2: loss 0.17595. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 49 Iter 2: loss 0.17595. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 49 Iter 3: loss 0.16007. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 49 Iter 3: loss 0.16007. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 49 Iter 4: loss 0.19189. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 49 Iter 4: loss 0.19189. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 49 Iter 5: loss 0.15371. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 49 Iter 5: loss 0.15371. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 49 Iter 6: loss 0.15408. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 49 Iter 6: loss 0.15408. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 49 Iter 7: loss 0.15741. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 49 Iter 7: loss 0.15741. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 49 Iter 8: loss 0.15982. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 49 Iter 8: loss 0.15982. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 49 Iter 9: loss 0.16224. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 49 Iter 9: loss 0.16224. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.04it/s]
Epoch 49 Iter 10: loss 0.16669. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.04it/s]
Epoch 49 Iter 10: loss 0.16669. :   4%|██                                           | 10/224 [00:04<01:44,  2.04it/s]
Epoch 49 Iter 11: loss 0.16163. :   4%|██                                           | 10/224 [00:05<01:44,  2.04it/s]
Epoch 49 Iter 11: loss 0.16163. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 49 Iter 12: loss 0.15417. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 49 Iter 12: loss 0.15417. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 49 Iter 13: loss 0.17115. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 49 Iter 13: loss 0.17115. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 49 Iter 14: loss 0.16000. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 49 Iter 14: loss 0.16000. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 49 Iter 15: loss 0.17293. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 49 Iter 15: loss 0.17293. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 49 Iter 16: loss 0.16975. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 49 Iter 16: loss 0.16975. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 49 Iter 17: loss 0.16969. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 49 Iter 17: loss 0.16969. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 49 Iter 18: loss 0.16431. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 49 Iter 18: loss 0.16431. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.04it/s]
Epoch 49 Iter 19: loss 0.16093. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.04it/s]
Epoch 49 Iter 19: loss 0.16093. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 49 Iter 20: loss 0.19602. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 49 Iter 20: loss 0.19602. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 49 Iter 21: loss 0.15310. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 49 Iter 21: loss 0.15310. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 49 Iter 22: loss 0.16669. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 49 Iter 22: loss 0.16669. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 49 Iter 23: loss 0.15487. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 23: loss 0.15487. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 24: loss 0.14263. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 24: loss 0.14263. :  11%|████▊                                        | 24/224 [00:11<01:38,  2.03it/s]
Epoch 49 Iter 25: loss 0.15446. :  11%|████▊                                        | 24/224 [00:12<01:38,  2.03it/s]
Epoch 49 Iter 25: loss 0.15446. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 49 Iter 26: loss 0.16703. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 49 Iter 26: loss 0.16703. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 49 Iter 27: loss 0.16771. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 49 Iter 27: loss 0.16771. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 49 Iter 28: loss 0.16659. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 49 Iter 28: loss 0.16659. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 49 Iter 29: loss 0.15724. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 49 Iter 29: loss 0.15724. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 49 Iter 30: loss 0.15346. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 49 Iter 30: loss 0.15346. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 49 Iter 31: loss 0.14893. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 49 Iter 31: loss 0.14893. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 49 Iter 32: loss 0.15263. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 49 Iter 32: loss 0.15263. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 49 Iter 33: loss 0.15220. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 49 Iter 33: loss 0.15220. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 49 Iter 34: loss 0.16588. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 49 Iter 34: loss 0.16588. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 49 Iter 35: loss 0.15395. :  15%|██████▊                                      | 34/224 [00:17<01:31,  2.07it/s]
Epoch 49 Iter 35: loss 0.15395. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 36: loss 0.15875. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 36: loss 0.15875. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 37: loss 0.18870. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 49 Iter 37: loss 0.18870. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 49 Iter 38: loss 0.14389. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 49 Iter 38: loss 0.14389. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 49 Iter 39: loss 0.16443. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 49 Iter 39: loss 0.16443. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.08it/s]
Epoch 49 Iter 40: loss 0.19238. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.08it/s]
Epoch 49 Iter 40: loss 0.19238. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 49 Iter 41: loss 0.16370. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 49 Iter 41: loss 0.16370. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 49 Iter 42: loss 0.16603. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 49 Iter 42: loss 0.16603. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 49 Iter 43: loss 0.16637. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 49 Iter 43: loss 0.16637. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 49 Iter 44: loss 0.15033. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 49 Iter 44: loss 0.15033. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 49 Iter 45: loss 0.16895. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 49 Iter 45: loss 0.16895. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 49 Iter 46: loss 0.15373. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 49 Iter 46: loss 0.15373. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 49 Iter 47: loss 0.16510. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 49 Iter 47: loss 0.16510. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 49 Iter 48: loss 0.16193. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 49 Iter 48: loss 0.16193. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 49 Iter 49: loss 0.15563. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 49 Iter 49: loss 0.15563. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 49 Iter 50: loss 0.19139. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 49 Iter 50: loss 0.19139. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 49 Iter 51: loss 0.15070. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 49 Iter 51: loss 0.15070. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 49 Iter 52: loss 0.16757. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 49 Iter 52: loss 0.16757. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 49 Iter 53: loss 0.15026. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 49 Iter 53: loss 0.15026. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 49 Iter 54: loss 0.14039. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 49 Iter 54: loss 0.14039. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 49 Iter 55: loss 0.15406. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 49 Iter 55: loss 0.15406. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 49 Iter 56: loss 0.15329. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 49 Iter 56: loss 0.15329. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 49 Iter 57: loss 0.15116. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 49 Iter 57: loss 0.15116. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 49 Iter 58: loss 0.15252. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 49 Iter 58: loss 0.15252. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 49 Iter 59: loss 0.18153. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 49 Iter 59: loss 0.18153. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 49 Iter 60: loss 0.14669. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 49 Iter 60: loss 0.14669. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 49 Iter 61: loss 0.17179. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 49 Iter 61: loss 0.17179. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 49 Iter 62: loss 0.17142. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 49 Iter 62: loss 0.17142. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 63: loss 0.16389. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 63: loss 0.16389. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 49 Iter 64: loss 0.19529. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 49 Iter 64: loss 0.19529. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 49 Iter 65: loss 0.14395. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 49 Iter 65: loss 0.14395. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 49 Iter 66: loss 0.15525. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 66: loss 0.15525. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 67: loss 0.15542. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 67: loss 0.15542. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 49 Iter 68: loss 0.16263. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 49 Iter 68: loss 0.16263. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 49 Iter 69: loss 0.14249. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 49 Iter 69: loss 0.14249. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 49 Iter 70: loss 0.14736. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 49 Iter 70: loss 0.14736. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 49 Iter 71: loss 0.14402. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 49 Iter 71: loss 0.14402. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 49 Iter 72: loss 0.15030. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 49 Iter 72: loss 0.15030. :  32%|██████████████▍                              | 72/224 [00:34<01:12,  2.09it/s]
Epoch 49 Iter 73: loss 0.16230. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.09it/s]
Epoch 49 Iter 73: loss 0.16230. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 49 Iter 74: loss 0.15590. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 49 Iter 74: loss 0.15590. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 49 Iter 75: loss 0.16057. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 49 Iter 75: loss 0.16057. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 49 Iter 76: loss 0.17207. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 49 Iter 76: loss 0.17207. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 49 Iter 77: loss 0.16336. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 49 Iter 77: loss 0.16336. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 49 Iter 78: loss 0.15314. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 49 Iter 78: loss 0.15314. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 49 Iter 79: loss 0.16010. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 49 Iter 79: loss 0.16010. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 49 Iter 80: loss 0.16839. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 49 Iter 80: loss 0.16839. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 49 Iter 81: loss 0.15123. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 49 Iter 81: loss 0.15123. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 49 Iter 82: loss 0.16861. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 49 Iter 82: loss 0.16861. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 49 Iter 83: loss 0.15739. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 49 Iter 83: loss 0.15739. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 49 Iter 84: loss 0.17864. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 49 Iter 84: loss 0.17864. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 49 Iter 85: loss 0.15682. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 49 Iter 85: loss 0.15682. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 49 Iter 86: loss 0.15368. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 49 Iter 86: loss 0.15368. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 49 Iter 87: loss 0.15283. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 49 Iter 87: loss 0.15283. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 49 Iter 88: loss 0.16395. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 49 Iter 88: loss 0.16395. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 49 Iter 89: loss 0.16449. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 49 Iter 89: loss 0.16449. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 49 Iter 90: loss 0.17983. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 49 Iter 90: loss 0.17983. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 49 Iter 91: loss 0.15968. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.06it/s]
Epoch 49 Iter 91: loss 0.15968. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 49 Iter 92: loss 0.16186. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 49 Iter 92: loss 0.16186. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 49 Iter 93: loss 0.16459. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 49 Iter 93: loss 0.16459. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 49 Iter 94: loss 0.17251. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 49 Iter 94: loss 0.17251. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 49 Iter 95: loss 0.16327. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 49 Iter 95: loss 0.16327. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 49 Iter 96: loss 0.14839. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 49 Iter 96: loss 0.14839. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 49 Iter 97: loss 0.17640. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 49 Iter 97: loss 0.17640. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 49 Iter 98: loss 0.16509. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 49 Iter 98: loss 0.16509. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 49 Iter 99: loss 0.16452. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 49 Iter 99: loss 0.16452. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 49 Iter 100: loss 0.13061. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 49 Iter 100: loss 0.13061. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 49 Iter 101: loss 0.13710. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 49 Iter 101: loss 0.13710. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 49 Iter 102: loss 0.15596. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 49 Iter 102: loss 0.15596. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 49 Iter 103: loss 0.17054. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 49 Iter 103: loss 0.17054. :  46%|███████████████████▊                       | 103/224 [00:49<00:59,  2.05it/s]
Epoch 49 Iter 104: loss 0.16924. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 49 Iter 104: loss 0.16924. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 49 Iter 105: loss 0.16489. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 49 Iter 105: loss 0.16489. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.05it/s]
Epoch 49 Iter 106: loss 0.16266. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.05it/s]
Epoch 49 Iter 106: loss 0.16266. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 49 Iter 107: loss 0.14372. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 49 Iter 107: loss 0.14372. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 49 Iter 108: loss 0.15369. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 49 Iter 108: loss 0.15369. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 49 Iter 109: loss 0.15820. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 49 Iter 109: loss 0.15820. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 49 Iter 110: loss 0.16928. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 49 Iter 110: loss 0.16928. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 49 Iter 111: loss 0.16502. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 49 Iter 111: loss 0.16502. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 49 Iter 112: loss 0.15210. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 49 Iter 112: loss 0.15210. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 49 Iter 113: loss 0.16965. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 49 Iter 113: loss 0.16965. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 49 Iter 114: loss 0.15020. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 49 Iter 114: loss 0.15020. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 49 Iter 115: loss 0.16114. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 49 Iter 115: loss 0.16114. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 49 Iter 116: loss 0.15400. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 49 Iter 116: loss 0.15400. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 49 Iter 117: loss 0.15744. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 49 Iter 117: loss 0.15744. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 49 Iter 118: loss 0.15737. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 49 Iter 118: loss 0.15737. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 49 Iter 119: loss 0.12803. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 49 Iter 119: loss 0.12803. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 49 Iter 120: loss 0.17085. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 49 Iter 120: loss 0.17085. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 49 Iter 121: loss 0.15911. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 49 Iter 121: loss 0.15911. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 49 Iter 122: loss 0.14866. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 49 Iter 122: loss 0.14866. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 49 Iter 123: loss 0.15629. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 49 Iter 123: loss 0.15629. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 49 Iter 124: loss 0.15310. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 124: loss 0.15310. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 125: loss 0.18065. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 125: loss 0.18065. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 126: loss 0.17417. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 49 Iter 126: loss 0.17417. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 49 Iter 127: loss 0.15044. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 49 Iter 127: loss 0.15044. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 49 Iter 128: loss 0.17784. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 49 Iter 128: loss 0.17784. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 49 Iter 129: loss 0.16442. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 49 Iter 129: loss 0.16442. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 49 Iter 130: loss 0.18884. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 49 Iter 130: loss 0.18884. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 49 Iter 131: loss 0.15856. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 49 Iter 131: loss 0.15856. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 49 Iter 132: loss 0.16411. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 49 Iter 132: loss 0.16411. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.09it/s]
Epoch 49 Iter 133: loss 0.15842. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.09it/s]
Epoch 49 Iter 133: loss 0.15842. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 49 Iter 134: loss 0.15330. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 49 Iter 134: loss 0.15330. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.08it/s]
Epoch 49 Iter 135: loss 0.17044. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 49 Iter 135: loss 0.17044. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 49 Iter 136: loss 0.15369. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 49 Iter 136: loss 0.15369. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 49 Iter 137: loss 0.15234. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 49 Iter 137: loss 0.15234. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 49 Iter 138: loss 0.16850. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 49 Iter 138: loss 0.16850. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 49 Iter 139: loss 0.16288. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 49 Iter 139: loss 0.16288. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 49 Iter 140: loss 0.14770. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 49 Iter 140: loss 0.14770. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 49 Iter 141: loss 0.17699. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 141: loss 0.17699. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 142: loss 0.15050. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 142: loss 0.15050. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 49 Iter 143: loss 0.16041. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 49 Iter 143: loss 0.16041. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 49 Iter 144: loss 0.16211. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 49 Iter 144: loss 0.16211. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 49 Iter 145: loss 0.15449. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 49 Iter 145: loss 0.15449. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 49 Iter 146: loss 0.17896. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 49 Iter 146: loss 0.17896. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 49 Iter 147: loss 0.17815. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 49 Iter 147: loss 0.17815. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 49 Iter 148: loss 0.16478. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 49 Iter 148: loss 0.16478. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 49 Iter 149: loss 0.16601. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 149: loss 0.16601. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 150: loss 0.15766. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 150: loss 0.15766. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 49 Iter 151: loss 0.15214. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 49 Iter 151: loss 0.15214. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 49 Iter 152: loss 0.16061. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 49 Iter 152: loss 0.16061. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 49 Iter 153: loss 0.17457. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 49 Iter 153: loss 0.17457. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 49 Iter 154: loss 0.16850. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 49 Iter 154: loss 0.16850. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 49 Iter 155: loss 0.18179. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 49 Iter 155: loss 0.18179. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 49 Iter 156: loss 0.13258. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 49 Iter 156: loss 0.13258. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 49 Iter 157: loss 0.15800. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 49 Iter 157: loss 0.15800. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 49 Iter 158: loss 0.16591. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 49 Iter 158: loss 0.16591. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 49 Iter 159: loss 0.15057. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 49 Iter 159: loss 0.15057. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 49 Iter 160: loss 0.14735. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 49 Iter 160: loss 0.14735. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 49 Iter 161: loss 0.16067. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 49 Iter 161: loss 0.16067. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 49 Iter 162: loss 0.16253. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 49 Iter 162: loss 0.16253. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 49 Iter 163: loss 0.17520. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 49 Iter 163: loss 0.17520. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 49 Iter 164: loss 0.16758. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 49 Iter 164: loss 0.16758. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 49 Iter 165: loss 0.15855. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 49 Iter 165: loss 0.15855. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 49 Iter 166: loss 0.16063. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 49 Iter 166: loss 0.16063. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 49 Iter 167: loss 0.15877. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 49 Iter 167: loss 0.15877. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 49 Iter 168: loss 0.16132. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 49 Iter 168: loss 0.16132. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 49 Iter 169: loss 0.16408. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 49 Iter 169: loss 0.16408. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 49 Iter 170: loss 0.15072. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 49 Iter 170: loss 0.15072. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 49 Iter 171: loss 0.16905. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 49 Iter 171: loss 0.16905. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 49 Iter 172: loss 0.14463. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 49 Iter 172: loss 0.14463. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 49 Iter 173: loss 0.16719. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 49 Iter 173: loss 0.16719. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 49 Iter 174: loss 0.14167. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 49 Iter 174: loss 0.14167. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 49 Iter 175: loss 0.15401. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 49 Iter 175: loss 0.15401. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 49 Iter 176: loss 0.15994. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 49 Iter 176: loss 0.15994. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 49 Iter 177: loss 0.15710. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 49 Iter 177: loss 0.15710. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 49 Iter 178: loss 0.17854. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 49 Iter 178: loss 0.17854. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 49 Iter 179: loss 0.16254. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 49 Iter 179: loss 0.16254. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 49 Iter 180: loss 0.15923. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 49 Iter 180: loss 0.15923. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 49 Iter 181: loss 0.15024. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 49 Iter 181: loss 0.15024. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 49 Iter 182: loss 0.15998. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 49 Iter 182: loss 0.15998. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 49 Iter 183: loss 0.14602. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 49 Iter 183: loss 0.14602. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.05it/s]
Epoch 49 Iter 184: loss 0.17154. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 49 Iter 184: loss 0.17154. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 49 Iter 185: loss 0.16989. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 49 Iter 185: loss 0.16989. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 49 Iter 186: loss 0.16277. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 49 Iter 186: loss 0.16277. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 49 Iter 187: loss 0.15648. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 49 Iter 187: loss 0.15648. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 49 Iter 188: loss 0.18254. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 49 Iter 188: loss 0.18254. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.09it/s]
Epoch 49 Iter 189: loss 0.16367. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.09it/s]
Epoch 49 Iter 189: loss 0.16367. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.10it/s]
Epoch 49 Iter 190: loss 0.16631. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.10it/s]
Epoch 49 Iter 190: loss 0.16631. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.10it/s]
Epoch 49 Iter 191: loss 0.16954. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.10it/s]
Epoch 49 Iter 191: loss 0.16954. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 49 Iter 192: loss 0.14151. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 49 Iter 192: loss 0.14151. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 49 Iter 193: loss 0.18076. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 49 Iter 193: loss 0.18076. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 49 Iter 194: loss 0.15356. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 49 Iter 194: loss 0.15356. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 49 Iter 195: loss 0.16462. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 49 Iter 195: loss 0.16462. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 49 Iter 196: loss 0.14647. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 49 Iter 196: loss 0.14647. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 49 Iter 197: loss 0.16062. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 49 Iter 197: loss 0.16062. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 49 Iter 198: loss 0.16212. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 49 Iter 198: loss 0.16212. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 49 Iter 199: loss 0.16152. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 49 Iter 199: loss 0.16152. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 49 Iter 200: loss 0.17194. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 49 Iter 200: loss 0.17194. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 49 Iter 201: loss 0.15596. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 49 Iter 201: loss 0.15596. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 49 Iter 202: loss 0.14131. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 49 Iter 202: loss 0.14131. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 49 Iter 203: loss 0.14861. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 49 Iter 203: loss 0.14861. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 49 Iter 204: loss 0.15211. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 49 Iter 204: loss 0.15211. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 49 Iter 205: loss 0.15334. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 49 Iter 205: loss 0.15334. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 49 Iter 206: loss 0.17689. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 49 Iter 206: loss 0.17689. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 49 Iter 207: loss 0.17248. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 49 Iter 207: loss 0.17248. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 49 Iter 208: loss 0.17283. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 49 Iter 208: loss 0.17283. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 49 Iter 209: loss 0.14646. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 49 Iter 209: loss 0.14646. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 49 Iter 210: loss 0.15729. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 49 Iter 210: loss 0.15729. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 49 Iter 211: loss 0.16773. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 49 Iter 211: loss 0.16773. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 49 Iter 212: loss 0.14245. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 49 Iter 212: loss 0.14245. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 49 Iter 213: loss 0.14430. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 49 Iter 213: loss 0.14430. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 49 Iter 214: loss 0.17286. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 49 Iter 214: loss 0.17286. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 49 Iter 215: loss 0.15956. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 49 Iter 215: loss 0.15956. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 49 Iter 216: loss 0.17765. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 49 Iter 216: loss 0.17765. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 49 Iter 217: loss 0.15856. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 49 Iter 217: loss 0.15856. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 49 Iter 218: loss 0.17446. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 49 Iter 218: loss 0.17446. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 49 Iter 219: loss 0.14899. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 49 Iter 219: loss 0.14899. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 49 Iter 220: loss 0.15260. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 49 Iter 220: loss 0.15260. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 49 Iter 221: loss 0.15343. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 49 Iter 221: loss 0.15343. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 49 Iter 222: loss 0.16771. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 49 Iter 222: loss 0.16771. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 49 Iter 223: loss 0.18114. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 49 Iter 223: loss 0.18114. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 49 Iter 224: loss 0.16536. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 49 Iter 224: loss 0.16536. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 49 Iter 224: loss 0.16536. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.16108
    Valid loss: 0.17067
       Valid loss recons: 0.17067
       Valid loss KL-D:   146256.02876
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.17273. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.17273. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 50 Iter 2: loss 0.16020. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 50 Iter 2: loss 0.16020. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 50 Iter 3: loss 0.15515. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 50 Iter 3: loss 0.15515. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 50 Iter 4: loss 0.16504. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 50 Iter 4: loss 0.16504. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 50 Iter 5: loss 0.16059. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 50 Iter 5: loss 0.16059. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 50 Iter 6: loss 0.14009. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 50 Iter 6: loss 0.14009. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 50 Iter 7: loss 0.16441. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 50 Iter 7: loss 0.16441. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 50 Iter 8: loss 0.16360. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 50 Iter 8: loss 0.16360. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 50 Iter 9: loss 0.16806. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 50 Iter 9: loss 0.16806. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 50 Iter 10: loss 0.15735. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 50 Iter 10: loss 0.15735. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 50 Iter 11: loss 0.18627. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 50 Iter 11: loss 0.18627. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 50 Iter 12: loss 0.15042. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 50 Iter 12: loss 0.15042. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 50 Iter 13: loss 0.15749. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 50 Iter 13: loss 0.15749. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 50 Iter 14: loss 0.15527. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 50 Iter 14: loss 0.15527. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 50 Iter 15: loss 0.16436. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 50 Iter 15: loss 0.16436. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 50 Iter 16: loss 0.17452. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 50 Iter 16: loss 0.17452. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 50 Iter 17: loss 0.15440. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 50 Iter 17: loss 0.15440. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 50 Iter 18: loss 0.19188. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 50 Iter 18: loss 0.19188. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 50 Iter 19: loss 0.17007. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 50 Iter 19: loss 0.17007. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 50 Iter 20: loss 0.13461. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 50 Iter 20: loss 0.13461. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 50 Iter 21: loss 0.17932. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 50 Iter 21: loss 0.17932. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 50 Iter 22: loss 0.15452. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 50 Iter 22: loss 0.15452. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 50 Iter 23: loss 0.15661. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 50 Iter 23: loss 0.15661. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 50 Iter 24: loss 0.14686. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 50 Iter 24: loss 0.14686. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.04it/s]
Epoch 50 Iter 25: loss 0.15276. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.04it/s]
Epoch 50 Iter 25: loss 0.15276. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 50 Iter 26: loss 0.15603. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 50 Iter 26: loss 0.15603. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 50 Iter 27: loss 0.17831. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 50 Iter 27: loss 0.17831. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 50 Iter 28: loss 0.15050. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 50 Iter 28: loss 0.15050. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 50 Iter 29: loss 0.15828. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 50 Iter 29: loss 0.15828. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 50 Iter 30: loss 0.14749. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 50 Iter 30: loss 0.14749. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 50 Iter 31: loss 0.15711. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 50 Iter 31: loss 0.15711. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 50 Iter 32: loss 0.16097. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 50 Iter 32: loss 0.16097. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 50 Iter 33: loss 0.14700. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 50 Iter 33: loss 0.14700. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 50 Iter 34: loss 0.17126. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 50 Iter 34: loss 0.17126. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 50 Iter 35: loss 0.16996. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 50 Iter 35: loss 0.16996. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 50 Iter 36: loss 0.15932. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 50 Iter 36: loss 0.15932. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 50 Iter 37: loss 0.15604. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 50 Iter 37: loss 0.15604. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 50 Iter 38: loss 0.16100. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 50 Iter 38: loss 0.16100. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 50 Iter 39: loss 0.16815. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 50 Iter 39: loss 0.16815. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 50 Iter 40: loss 0.16091. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 50 Iter 40: loss 0.16091. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 50 Iter 41: loss 0.16279. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 50 Iter 41: loss 0.16279. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 50 Iter 42: loss 0.15949. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 50 Iter 42: loss 0.15949. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 50 Iter 43: loss 0.14814. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 50 Iter 43: loss 0.14814. :  19%|████████▋                                    | 43/224 [00:20<01:26,  2.09it/s]
Epoch 50 Iter 44: loss 0.16787. :  19%|████████▋                                    | 43/224 [00:21<01:26,  2.09it/s]
Epoch 50 Iter 44: loss 0.16787. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 50 Iter 45: loss 0.14766. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 50 Iter 45: loss 0.14766. :  20%|█████████                                    | 45/224 [00:21<01:25,  2.09it/s]
Epoch 50 Iter 46: loss 0.18319. :  20%|█████████                                    | 45/224 [00:22<01:25,  2.09it/s]
Epoch 50 Iter 46: loss 0.18319. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 50 Iter 47: loss 0.18504. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 50 Iter 47: loss 0.18504. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 50 Iter 48: loss 0.14384. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 50 Iter 48: loss 0.14384. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 50 Iter 49: loss 0.16502. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 50 Iter 49: loss 0.16502. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 50 Iter 50: loss 0.15514. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 50 Iter 50: loss 0.15514. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 50 Iter 51: loss 0.15059. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 50 Iter 51: loss 0.15059. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 50 Iter 52: loss 0.17347. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 50 Iter 52: loss 0.17347. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 50 Iter 53: loss 0.15997. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 50 Iter 53: loss 0.15997. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 50 Iter 54: loss 0.16868. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 50 Iter 54: loss 0.16868. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 50 Iter 55: loss 0.14602. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 50 Iter 55: loss 0.14602. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 50 Iter 56: loss 0.18100. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 50 Iter 56: loss 0.18100. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.01it/s]
Epoch 50 Iter 57: loss 0.17669. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.01it/s]
Epoch 50 Iter 57: loss 0.17669. :  25%|███████████▍                                 | 57/224 [00:27<01:22,  2.03it/s]
Epoch 50 Iter 58: loss 0.16158. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 50 Iter 58: loss 0.16158. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 50 Iter 59: loss 0.16748. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 50 Iter 59: loss 0.16748. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.04it/s]
Epoch 50 Iter 60: loss 0.14749. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.04it/s]
Epoch 50 Iter 60: loss 0.14749. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 50 Iter 61: loss 0.14067. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 50 Iter 61: loss 0.14067. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 50 Iter 62: loss 0.14802. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 50 Iter 62: loss 0.14802. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 50 Iter 63: loss 0.16071. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 50 Iter 63: loss 0.16071. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 50 Iter 64: loss 0.16558. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 50 Iter 64: loss 0.16558. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 50 Iter 65: loss 0.15161. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 50 Iter 65: loss 0.15161. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 50 Iter 66: loss 0.15525. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 50 Iter 66: loss 0.15525. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 50 Iter 67: loss 0.14429. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 50 Iter 67: loss 0.14429. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 50 Iter 68: loss 0.15649. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 50 Iter 68: loss 0.15649. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 50 Iter 69: loss 0.14134. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 50 Iter 69: loss 0.14134. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 50 Iter 70: loss 0.15602. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 50 Iter 70: loss 0.15602. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 50 Iter 71: loss 0.18203. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 50 Iter 71: loss 0.18203. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 50 Iter 72: loss 0.16206. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 50 Iter 72: loss 0.16206. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 50 Iter 73: loss 0.15183. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 50 Iter 73: loss 0.15183. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 50 Iter 74: loss 0.16708. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 50 Iter 74: loss 0.16708. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 50 Iter 75: loss 0.17073. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 50 Iter 75: loss 0.17073. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 50 Iter 76: loss 0.16480. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 50 Iter 76: loss 0.16480. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 50 Iter 77: loss 0.15074. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 50 Iter 77: loss 0.15074. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 50 Iter 78: loss 0.15074. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 50 Iter 78: loss 0.15074. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 50 Iter 79: loss 0.15909. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 50 Iter 79: loss 0.15909. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 50 Iter 80: loss 0.17659. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 50 Iter 80: loss 0.17659. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 50 Iter 81: loss 0.15281. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 50 Iter 81: loss 0.15281. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 50 Iter 82: loss 0.18334. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 50 Iter 82: loss 0.18334. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 50 Iter 83: loss 0.16736. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 50 Iter 83: loss 0.16736. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 50 Iter 84: loss 0.17179. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 50 Iter 84: loss 0.17179. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 50 Iter 85: loss 0.15119. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 50 Iter 85: loss 0.15119. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 50 Iter 86: loss 0.16481. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 50 Iter 86: loss 0.16481. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 50 Iter 87: loss 0.16259. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 50 Iter 87: loss 0.16259. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 50 Iter 88: loss 0.15059. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 50 Iter 88: loss 0.15059. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 50 Iter 89: loss 0.17292. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 50 Iter 89: loss 0.17292. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 50 Iter 90: loss 0.15376. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 50 Iter 90: loss 0.15376. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 50 Iter 91: loss 0.18212. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 50 Iter 91: loss 0.18212. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 50 Iter 92: loss 0.16249. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 50 Iter 92: loss 0.16249. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 50 Iter 93: loss 0.16571. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 50 Iter 93: loss 0.16571. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 50 Iter 94: loss 0.16097. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 50 Iter 94: loss 0.16097. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 50 Iter 95: loss 0.16591. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 50 Iter 95: loss 0.16591. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 50 Iter 96: loss 0.16448. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 50 Iter 96: loss 0.16448. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 50 Iter 97: loss 0.15173. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 50 Iter 97: loss 0.15173. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 50 Iter 98: loss 0.16029. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 50 Iter 98: loss 0.16029. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 50 Iter 99: loss 0.16314. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 50 Iter 99: loss 0.16314. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 50 Iter 100: loss 0.16611. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 50 Iter 100: loss 0.16611. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 50 Iter 101: loss 0.17464. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 50 Iter 101: loss 0.17464. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 50 Iter 102: loss 0.14922. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 50 Iter 102: loss 0.14922. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 50 Iter 103: loss 0.15644. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 50 Iter 103: loss 0.15644. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 50 Iter 104: loss 0.16826. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 50 Iter 104: loss 0.16826. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 50 Iter 105: loss 0.16603. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 50 Iter 105: loss 0.16603. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 50 Iter 106: loss 0.17102. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 50 Iter 106: loss 0.17102. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 50 Iter 107: loss 0.15249. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 50 Iter 107: loss 0.15249. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.05it/s]
Epoch 50 Iter 108: loss 0.18481. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.05it/s]
Epoch 50 Iter 108: loss 0.18481. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 50 Iter 109: loss 0.16951. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 50 Iter 109: loss 0.16951. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 50 Iter 110: loss 0.16305. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 50 Iter 110: loss 0.16305. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 50 Iter 111: loss 0.14973. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 50 Iter 111: loss 0.14973. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 50 Iter 112: loss 0.16322. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 50 Iter 112: loss 0.16322. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 50 Iter 113: loss 0.15149. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 50 Iter 113: loss 0.15149. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 50 Iter 114: loss 0.15343. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 50 Iter 114: loss 0.15343. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 50 Iter 115: loss 0.13180. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 50 Iter 115: loss 0.13180. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 50 Iter 116: loss 0.15319. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 50 Iter 116: loss 0.15319. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 50 Iter 117: loss 0.15988. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 50 Iter 117: loss 0.15988. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 50 Iter 118: loss 0.15389. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 50 Iter 118: loss 0.15389. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 50 Iter 119: loss 0.16624. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 50 Iter 119: loss 0.16624. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 50 Iter 120: loss 0.15765. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 50 Iter 120: loss 0.15765. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 50 Iter 121: loss 0.14211. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 50 Iter 121: loss 0.14211. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 50 Iter 122: loss 0.14035. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 50 Iter 122: loss 0.14035. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 50 Iter 123: loss 0.17517. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 50 Iter 123: loss 0.17517. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 50 Iter 124: loss 0.15769. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 50 Iter 124: loss 0.15769. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 50 Iter 125: loss 0.18129. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 50 Iter 125: loss 0.18129. :  56%|███████████████████████▉                   | 125/224 [01:00<00:49,  2.02it/s]
Epoch 50 Iter 126: loss 0.15048. :  56%|███████████████████████▉                   | 125/224 [01:01<00:49,  2.02it/s]
Epoch 50 Iter 126: loss 0.15048. :  56%|████████████████████████▏                  | 126/224 [01:01<00:48,  2.03it/s]
Epoch 50 Iter 127: loss 0.17764. :  56%|████████████████████████▏                  | 126/224 [01:01<00:48,  2.03it/s]
Epoch 50 Iter 127: loss 0.17764. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 50 Iter 128: loss 0.17927. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.04it/s]
Epoch 50 Iter 128: loss 0.17927. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 50 Iter 129: loss 0.14317. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 50 Iter 129: loss 0.14317. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 50 Iter 130: loss 0.17082. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 50 Iter 130: loss 0.17082. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.04it/s]
Epoch 50 Iter 131: loss 0.14711. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.04it/s]
Epoch 50 Iter 131: loss 0.14711. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 50 Iter 132: loss 0.16109. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.04it/s]
Epoch 50 Iter 132: loss 0.16109. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:45,  2.04it/s]
Epoch 50 Iter 133: loss 0.15294. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:45,  2.04it/s]
Epoch 50 Iter 133: loss 0.15294. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 50 Iter 134: loss 0.16885. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.04it/s]
Epoch 50 Iter 134: loss 0.16885. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.05it/s]
Epoch 50 Iter 135: loss 0.17122. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.05it/s]
Epoch 50 Iter 135: loss 0.17122. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 50 Iter 136: loss 0.16724. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.05it/s]
Epoch 50 Iter 136: loss 0.16724. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 50 Iter 137: loss 0.15318. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 50 Iter 137: loss 0.15318. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 50 Iter 138: loss 0.15664. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 50 Iter 138: loss 0.15664. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 50 Iter 139: loss 0.16064. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 50 Iter 139: loss 0.16064. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.04it/s]
Epoch 50 Iter 140: loss 0.15757. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.04it/s]
Epoch 50 Iter 140: loss 0.15757. :  62%|██████████████████████████▉                | 140/224 [01:07<00:41,  2.04it/s]
Epoch 50 Iter 141: loss 0.16626. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.04it/s]
Epoch 50 Iter 141: loss 0.16626. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 50 Iter 142: loss 0.17180. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 50 Iter 142: loss 0.17180. :  63%|███████████████████████████▎               | 142/224 [01:08<00:40,  2.05it/s]
Epoch 50 Iter 143: loss 0.17160. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.05it/s]
Epoch 50 Iter 143: loss 0.17160. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 50 Iter 144: loss 0.15208. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 50 Iter 144: loss 0.15208. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.05it/s]
Epoch 50 Iter 145: loss 0.15258. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 50 Iter 145: loss 0.15258. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 50 Iter 146: loss 0.17242. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 50 Iter 146: loss 0.17242. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 50 Iter 147: loss 0.16607. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 50 Iter 147: loss 0.16607. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 50 Iter 148: loss 0.16899. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 50 Iter 148: loss 0.16899. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 50 Iter 149: loss 0.18148. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 50 Iter 149: loss 0.18148. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 50 Iter 150: loss 0.16974. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 50 Iter 150: loss 0.16974. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.04it/s]
Epoch 50 Iter 151: loss 0.15097. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 50 Iter 151: loss 0.15097. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 50 Iter 152: loss 0.15590. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 50 Iter 152: loss 0.15590. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.06it/s]
Epoch 50 Iter 153: loss 0.17357. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.06it/s]
Epoch 50 Iter 153: loss 0.17357. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 50 Iter 154: loss 0.14742. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 50 Iter 154: loss 0.14742. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 50 Iter 155: loss 0.15742. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 50 Iter 155: loss 0.15742. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 50 Iter 156: loss 0.14673. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 50 Iter 156: loss 0.14673. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 50 Iter 157: loss 0.16090. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 50 Iter 157: loss 0.16090. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 50 Iter 158: loss 0.15295. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 50 Iter 158: loss 0.15295. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.04it/s]
Epoch 50 Iter 159: loss 0.14090. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.04it/s]
Epoch 50 Iter 159: loss 0.14090. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 50 Iter 160: loss 0.17013. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 50 Iter 160: loss 0.17013. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 50 Iter 161: loss 0.15673. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 50 Iter 161: loss 0.15673. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 50 Iter 162: loss 0.17780. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 50 Iter 162: loss 0.17780. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 50 Iter 163: loss 0.15469. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 50 Iter 163: loss 0.15469. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 50 Iter 164: loss 0.17135. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 50 Iter 164: loss 0.17135. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 50 Iter 165: loss 0.16641. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 50 Iter 165: loss 0.16641. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 50 Iter 166: loss 0.13551. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 50 Iter 166: loss 0.13551. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 50 Iter 167: loss 0.16174. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.06it/s]
Epoch 50 Iter 167: loss 0.16174. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 50 Iter 168: loss 0.16154. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 50 Iter 168: loss 0.16154. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 50 Iter 169: loss 0.14246. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 50 Iter 169: loss 0.14246. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 50 Iter 170: loss 0.14280. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 50 Iter 170: loss 0.14280. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 50 Iter 171: loss 0.16246. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.07it/s]
Epoch 50 Iter 171: loss 0.16246. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 50 Iter 172: loss 0.16164. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 50 Iter 172: loss 0.16164. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 50 Iter 173: loss 0.17529. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 50 Iter 173: loss 0.17529. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 50 Iter 174: loss 0.14930. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 50 Iter 174: loss 0.14930. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 50 Iter 175: loss 0.15435. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 50 Iter 175: loss 0.15435. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 50 Iter 176: loss 0.17582. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 50 Iter 176: loss 0.17582. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 50 Iter 177: loss 0.14965. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 50 Iter 177: loss 0.14965. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 50 Iter 178: loss 0.15720. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 50 Iter 178: loss 0.15720. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 50 Iter 179: loss 0.15112. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 50 Iter 179: loss 0.15112. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 50 Iter 180: loss 0.17133. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 50 Iter 180: loss 0.17133. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 50 Iter 181: loss 0.15223. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 50 Iter 181: loss 0.15223. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 50 Iter 182: loss 0.17022. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 50 Iter 182: loss 0.17022. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 50 Iter 183: loss 0.15766. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 50 Iter 183: loss 0.15766. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 50 Iter 184: loss 0.16588. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 50 Iter 184: loss 0.16588. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 50 Iter 185: loss 0.15699. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 50 Iter 185: loss 0.15699. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 50 Iter 186: loss 0.16591. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 50 Iter 186: loss 0.16591. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 50 Iter 187: loss 0.16154. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 50 Iter 187: loss 0.16154. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 50 Iter 188: loss 0.15352. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 50 Iter 188: loss 0.15352. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 50 Iter 189: loss 0.16159. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 50 Iter 189: loss 0.16159. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 50 Iter 190: loss 0.17482. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 50 Iter 190: loss 0.17482. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 50 Iter 191: loss 0.16149. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 50 Iter 191: loss 0.16149. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 50 Iter 192: loss 0.16640. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 50 Iter 192: loss 0.16640. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 50 Iter 193: loss 0.14852. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 50 Iter 193: loss 0.14852. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 50 Iter 194: loss 0.15600. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 50 Iter 194: loss 0.15600. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 50 Iter 195: loss 0.16088. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 50 Iter 195: loss 0.16088. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 50 Iter 196: loss 0.16779. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.07it/s]
Epoch 50 Iter 196: loss 0.16779. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 50 Iter 197: loss 0.17684. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 50 Iter 197: loss 0.17684. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 50 Iter 198: loss 0.14082. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 50 Iter 198: loss 0.14082. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 50 Iter 199: loss 0.15069. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 50 Iter 199: loss 0.15069. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 50 Iter 200: loss 0.18090. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.07it/s]
Epoch 50 Iter 200: loss 0.18090. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 50 Iter 201: loss 0.15862. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 50 Iter 201: loss 0.15862. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:10,  2.09it/s]
Epoch 50 Iter 202: loss 0.16295. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:10,  2.09it/s]
Epoch 50 Iter 202: loss 0.16295. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 50 Iter 203: loss 0.16074. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 50 Iter 203: loss 0.16074. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 50 Iter 204: loss 0.15962. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 50 Iter 204: loss 0.15962. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 50 Iter 205: loss 0.18727. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 50 Iter 205: loss 0.18727. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 50 Iter 206: loss 0.17022. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 50 Iter 206: loss 0.17022. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 50 Iter 207: loss 0.14901. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 50 Iter 207: loss 0.14901. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.03it/s]
Epoch 50 Iter 208: loss 0.14972. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.03it/s]
Epoch 50 Iter 208: loss 0.14972. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.04it/s]
Epoch 50 Iter 209: loss 0.16136. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.04it/s]
Epoch 50 Iter 209: loss 0.16136. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.04it/s]
Epoch 50 Iter 210: loss 0.15163. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.04it/s]
Epoch 50 Iter 210: loss 0.15163. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 50 Iter 211: loss 0.17321. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 50 Iter 211: loss 0.17321. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 50 Iter 212: loss 0.15648. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 50 Iter 212: loss 0.15648. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 50 Iter 213: loss 0.15561. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 50 Iter 213: loss 0.15561. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 50 Iter 214: loss 0.17953. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 50 Iter 214: loss 0.17953. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 50 Iter 215: loss 0.14470. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 50 Iter 215: loss 0.14470. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 50 Iter 216: loss 0.17241. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 50 Iter 216: loss 0.17241. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 50 Iter 217: loss 0.16366. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 50 Iter 217: loss 0.16366. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 50 Iter 218: loss 0.17560. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 50 Iter 218: loss 0.17560. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 50 Iter 219: loss 0.16496. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 50 Iter 219: loss 0.16496. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 50 Iter 220: loss 0.14007. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 50 Iter 220: loss 0.14007. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 50 Iter 221: loss 0.15101. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 50 Iter 221: loss 0.15101. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 50 Iter 222: loss 0.16500. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 50 Iter 222: loss 0.16500. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 50 Iter 223: loss 0.17450. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 50 Iter 223: loss 0.17450. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 50 Iter 224: loss 0.16562. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 50 Iter 224: loss 0.16562. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 50 Iter 224: loss 0.16562. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
    Train loss: 0.161
    Valid loss: 0.17095
       Valid loss recons: 0.17095
       Valid loss KL-D:   142635.65803
Training completed

Images vs recons¶

In [5]:
img_vs_recons(model, test_loader, device)
No description has been provided for this image

Inference¶

In [6]:
plot_recons(inference(configs,model))
No description has been provided for this image

Latent space visualization¶

In [7]:
vis_latent(test_loader, model, test_dataset)
No description has been provided for this image

Interpolation¶

In [5]:
plot_reconstructed(model, xrange=(-2000, 2000), yrange=(-2000, 2000), N=15)
No description has been provided for this image
  1. Experiment with KLD = 1e_2¶

In [4]:
seed_everything(42)

model = CVAE(latent_dim=configs["latent_dim"]).to(device)

optimizer = torch.optim.AdamW(model.parameters(), lr=configs["lr"], weight_decay=1e-5)
scheduler = torch.optim.lr_scheduler.ReduceLROnPlateau(optimizer, patience=7, factor=0.5, verbose=True)
model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
savepath, writer = makedires(configs)

train_loss, val_loss, loss_iters, val_loss_recons, val_loss_kld = train_model(
        model=model, 
        model_name=model_name,
        optimizer=optimizer,
        scheduler=scheduler if configs["use_scheduler"] else None, 
        criterion=vae_loss_function,
        lambda_kld=configs["lambda_kld"],
        train_loader=train_loader, 
        valid_loader=test_loader, 
        num_epochs=configs["num_epochs"],
        save_frequency= 10, 
        savepath=savepath,
        writer=writer
    )

epoch = configs["num_epochs"]
lambda_kld = configs["lambda_kld"]

save_model(model, model_name, optimizer, epoch = epoch,lambda_kld = lambda_kld, stats = configs )
save_config(configs)
Seed set to 42
/home/user/soltania1/.local/lib/python3.8/site-packages/torch/optim/lr_scheduler.py:60: UserWarning: The verbose parameter is deprecated. Please use get_last_lr() to access the learning rate.
  warnings.warn(
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.54591. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.54591. :   0%|▏                                               | 1/224 [00:00<02:09,  1.72it/s]
Epoch 1 Iter 2: loss 1.34620. :   0%|▏                                               | 1/224 [00:01<02:09,  1.72it/s]
Epoch 1 Iter 2: loss 1.34620. :   1%|▍                                               | 2/224 [00:01<01:57,  1.89it/s]
Epoch 1 Iter 3: loss 0.64037. :   1%|▍                                               | 2/224 [00:01<01:57,  1.89it/s]
Epoch 1 Iter 3: loss 0.64037. :   1%|▋                                               | 3/224 [00:01<01:52,  1.96it/s]
Epoch 1 Iter 4: loss 0.57654. :   1%|▋                                               | 3/224 [00:02<01:52,  1.96it/s]
Epoch 1 Iter 4: loss 0.57654. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 1 Iter 5: loss 0.60164. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 1 Iter 5: loss 0.60164. :   2%|█                                               | 5/224 [00:02<01:48,  2.02it/s]
Epoch 1 Iter 6: loss 0.57479. :   2%|█                                               | 5/224 [00:03<01:48,  2.02it/s]
Epoch 1 Iter 6: loss 0.57479. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.04it/s]
Epoch 1 Iter 7: loss 0.51540. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.04it/s]
Epoch 1 Iter 7: loss 0.51540. :   3%|█▌                                              | 7/224 [00:03<01:45,  2.05it/s]
Epoch 1 Iter 8: loss 0.48267. :   3%|█▌                                              | 7/224 [00:03<01:45,  2.05it/s]
Epoch 1 Iter 8: loss 0.48267. :   4%|█▋                                              | 8/224 [00:03<01:45,  2.05it/s]
Epoch 1 Iter 9: loss 0.45239. :   4%|█▋                                              | 8/224 [00:04<01:45,  2.05it/s]
Epoch 1 Iter 9: loss 0.45239. :   4%|█▉                                              | 9/224 [00:04<01:44,  2.05it/s]
Epoch 1 Iter 10: loss 0.50148. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 1 Iter 10: loss 0.50148. :   4%|██                                            | 10/224 [00:04<01:43,  2.06it/s]
Epoch 1 Iter 11: loss 0.45728. :   4%|██                                            | 10/224 [00:05<01:43,  2.06it/s]
Epoch 1 Iter 11: loss 0.45728. :   5%|██▎                                           | 11/224 [00:05<01:43,  2.06it/s]
Epoch 1 Iter 12: loss 0.43498. :   5%|██▎                                           | 11/224 [00:05<01:43,  2.06it/s]
Epoch 1 Iter 12: loss 0.43498. :   5%|██▍                                           | 12/224 [00:05<01:42,  2.06it/s]
Epoch 1 Iter 13: loss 0.43054. :   5%|██▍                                           | 12/224 [00:06<01:42,  2.06it/s]
Epoch 1 Iter 13: loss 0.43054. :   6%|██▋                                           | 13/224 [00:06<01:42,  2.06it/s]
Epoch 1 Iter 14: loss 0.41710. :   6%|██▋                                           | 13/224 [00:06<01:42,  2.06it/s]
Epoch 1 Iter 14: loss 0.41710. :   6%|██▉                                           | 14/224 [00:06<01:42,  2.05it/s]
Epoch 1 Iter 15: loss 0.42584. :   6%|██▉                                           | 14/224 [00:07<01:42,  2.05it/s]
Epoch 1 Iter 15: loss 0.42584. :   7%|███                                           | 15/224 [00:07<01:41,  2.05it/s]
Epoch 1 Iter 16: loss 0.38974. :   7%|███                                           | 15/224 [00:07<01:41,  2.05it/s]
Epoch 1 Iter 16: loss 0.38974. :   7%|███▎                                          | 16/224 [00:07<01:41,  2.05it/s]
Epoch 1 Iter 17: loss 0.37945. :   7%|███▎                                          | 16/224 [00:08<01:41,  2.05it/s]
Epoch 1 Iter 17: loss 0.37945. :   8%|███▍                                          | 17/224 [00:08<01:40,  2.06it/s]
Epoch 1 Iter 18: loss 0.38927. :   8%|███▍                                          | 17/224 [00:08<01:40,  2.06it/s]
Epoch 1 Iter 18: loss 0.38927. :   8%|███▋                                          | 18/224 [00:08<01:39,  2.06it/s]
Epoch 1 Iter 19: loss 0.35174. :   8%|███▋                                          | 18/224 [00:09<01:39,  2.06it/s]
Epoch 1 Iter 19: loss 0.35174. :   8%|███▉                                          | 19/224 [00:09<01:39,  2.06it/s]
Epoch 1 Iter 20: loss 0.37564. :   8%|███▉                                          | 19/224 [00:09<01:39,  2.06it/s]
Epoch 1 Iter 20: loss 0.37564. :   9%|████                                          | 20/224 [00:09<01:38,  2.06it/s]
Epoch 1 Iter 21: loss 0.35746. :   9%|████                                          | 20/224 [00:10<01:38,  2.06it/s]
Epoch 1 Iter 21: loss 0.35746. :   9%|████▎                                         | 21/224 [00:10<01:38,  2.06it/s]
Epoch 1 Iter 22: loss 0.35843. :   9%|████▎                                         | 21/224 [00:10<01:38,  2.06it/s]
Epoch 1 Iter 22: loss 0.35843. :  10%|████▌                                         | 22/224 [00:10<01:38,  2.06it/s]
Epoch 1 Iter 23: loss 0.33375. :  10%|████▌                                         | 22/224 [00:11<01:38,  2.06it/s]
Epoch 1 Iter 23: loss 0.33375. :  10%|████▋                                         | 23/224 [00:11<01:37,  2.07it/s]
Epoch 1 Iter 24: loss 0.36865. :  10%|████▋                                         | 23/224 [00:11<01:37,  2.07it/s]
Epoch 1 Iter 24: loss 0.36865. :  11%|████▉                                         | 24/224 [00:11<01:37,  2.06it/s]
Epoch 1 Iter 25: loss 0.33944. :  11%|████▉                                         | 24/224 [00:12<01:37,  2.06it/s]
Epoch 1 Iter 25: loss 0.33944. :  11%|█████▏                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 1 Iter 26: loss 0.36365. :  11%|█████▏                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 1 Iter 26: loss 0.36365. :  12%|█████▎                                        | 26/224 [00:12<01:36,  2.05it/s]
Epoch 1 Iter 27: loss 0.31081. :  12%|█████▎                                        | 26/224 [00:13<01:36,  2.05it/s]
Epoch 1 Iter 27: loss 0.31081. :  12%|█████▌                                        | 27/224 [00:13<01:35,  2.07it/s]
Epoch 1 Iter 28: loss 0.28896. :  12%|█████▌                                        | 27/224 [00:13<01:35,  2.07it/s]
Epoch 1 Iter 28: loss 0.28896. :  12%|█████▊                                        | 28/224 [00:13<01:35,  2.06it/s]
Epoch 1 Iter 29: loss 0.34330. :  12%|█████▊                                        | 28/224 [00:14<01:35,  2.06it/s]
Epoch 1 Iter 29: loss 0.34330. :  13%|█████▉                                        | 29/224 [00:14<01:34,  2.05it/s]
Epoch 1 Iter 30: loss 0.31237. :  13%|█████▉                                        | 29/224 [00:14<01:34,  2.05it/s]
Epoch 1 Iter 30: loss 0.31237. :  13%|██████▏                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 1 Iter 31: loss 0.31589. :  13%|██████▏                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 1 Iter 31: loss 0.31589. :  14%|██████▎                                       | 31/224 [00:15<01:32,  2.08it/s]
Epoch 1 Iter 32: loss 0.29971. :  14%|██████▎                                       | 31/224 [00:15<01:32,  2.08it/s]
Epoch 1 Iter 32: loss 0.29971. :  14%|██████▌                                       | 32/224 [00:15<01:33,  2.06it/s]
Epoch 1 Iter 33: loss 0.29720. :  14%|██████▌                                       | 32/224 [00:16<01:33,  2.06it/s]
Epoch 1 Iter 33: loss 0.29720. :  15%|██████▊                                       | 33/224 [00:16<01:33,  2.05it/s]
Epoch 1 Iter 34: loss 0.30859. :  15%|██████▊                                       | 33/224 [00:16<01:33,  2.05it/s]
Epoch 1 Iter 34: loss 0.30859. :  15%|██████▉                                       | 34/224 [00:16<01:32,  2.06it/s]
Epoch 1 Iter 35: loss 0.30528. :  15%|██████▉                                       | 34/224 [00:17<01:32,  2.06it/s]
Epoch 1 Iter 35: loss 0.30528. :  16%|███████▏                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 1 Iter 36: loss 0.27920. :  16%|███████▏                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 1 Iter 36: loss 0.27920. :  16%|███████▍                                      | 36/224 [00:17<01:31,  2.06it/s]
Epoch 1 Iter 37: loss 0.27995. :  16%|███████▍                                      | 36/224 [00:18<01:31,  2.06it/s]
Epoch 1 Iter 37: loss 0.27995. :  17%|███████▌                                      | 37/224 [00:18<01:30,  2.06it/s]
Epoch 1 Iter 38: loss 0.31107. :  17%|███████▌                                      | 37/224 [00:18<01:30,  2.06it/s]
Epoch 1 Iter 38: loss 0.31107. :  17%|███████▊                                      | 38/224 [00:18<01:29,  2.07it/s]
Epoch 1 Iter 39: loss 0.31389. :  17%|███████▊                                      | 38/224 [00:19<01:29,  2.07it/s]
Epoch 1 Iter 39: loss 0.31389. :  17%|████████                                      | 39/224 [00:19<01:29,  2.07it/s]
Epoch 1 Iter 40: loss 0.28178. :  17%|████████                                      | 39/224 [00:19<01:29,  2.07it/s]
Epoch 1 Iter 40: loss 0.28178. :  18%|████████▏                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 1 Iter 41: loss 0.29119. :  18%|████████▏                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 1 Iter 41: loss 0.29119. :  18%|████████▍                                     | 41/224 [00:19<01:28,  2.06it/s]
Epoch 1 Iter 42: loss 0.27913. :  18%|████████▍                                     | 41/224 [00:20<01:28,  2.06it/s]
Epoch 1 Iter 42: loss 0.27913. :  19%|████████▋                                     | 42/224 [00:20<01:28,  2.07it/s]
Epoch 1 Iter 43: loss 0.26716. :  19%|████████▋                                     | 42/224 [00:20<01:28,  2.07it/s]
Epoch 1 Iter 43: loss 0.26716. :  19%|████████▊                                     | 43/224 [00:20<01:27,  2.06it/s]
Epoch 1 Iter 44: loss 0.26250. :  19%|████████▊                                     | 43/224 [00:21<01:27,  2.06it/s]
Epoch 1 Iter 44: loss 0.26250. :  20%|█████████                                     | 44/224 [00:21<01:27,  2.06it/s]
Epoch 1 Iter 45: loss 0.29736. :  20%|█████████                                     | 44/224 [00:21<01:27,  2.06it/s]
Epoch 1 Iter 45: loss 0.29736. :  20%|█████████▏                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 1 Iter 46: loss 0.28696. :  20%|█████████▏                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 1 Iter 46: loss 0.28696. :  21%|█████████▍                                    | 46/224 [00:22<01:27,  2.04it/s]
Epoch 1 Iter 47: loss 0.27366. :  21%|█████████▍                                    | 46/224 [00:22<01:27,  2.04it/s]
Epoch 1 Iter 47: loss 0.27366. :  21%|█████████▋                                    | 47/224 [00:22<01:27,  2.01it/s]
Epoch 1 Iter 48: loss 0.26936. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.01it/s]
Epoch 1 Iter 48: loss 0.26936. :  21%|█████████▊                                    | 48/224 [00:23<01:28,  1.98it/s]
Epoch 1 Iter 49: loss 0.25844. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.98it/s]
Epoch 1 Iter 49: loss 0.25844. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.95it/s]
Epoch 1 Iter 50: loss 0.26780. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.95it/s]
Epoch 1 Iter 50: loss 0.26780. :  22%|██████████▎                                   | 50/224 [00:24<01:27,  1.99it/s]
Epoch 1 Iter 51: loss 0.27694. :  22%|██████████▎                                   | 50/224 [00:24<01:27,  1.99it/s]
Epoch 1 Iter 51: loss 0.27694. :  23%|██████████▍                                   | 51/224 [00:24<01:26,  2.01it/s]
Epoch 1 Iter 52: loss 0.30900. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.01it/s]
Epoch 1 Iter 52: loss 0.30900. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 1 Iter 53: loss 0.28964. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 1 Iter 53: loss 0.28964. :  24%|██████████▉                                   | 53/224 [00:25<01:24,  2.02it/s]
Epoch 1 Iter 54: loss 0.28822. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 1 Iter 54: loss 0.28822. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.02it/s]
Epoch 1 Iter 55: loss 0.27016. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.02it/s]
Epoch 1 Iter 55: loss 0.27016. :  25%|███████████▎                                  | 55/224 [00:26<01:23,  2.03it/s]
Epoch 1 Iter 56: loss 0.28662. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 1 Iter 56: loss 0.28662. :  25%|███████████▌                                  | 56/224 [00:27<01:26,  1.94it/s]
Epoch 1 Iter 57: loss 0.28414. :  25%|███████████▌                                  | 56/224 [00:28<01:26,  1.94it/s]
Epoch 1 Iter 57: loss 0.28414. :  25%|███████████▋                                  | 57/224 [00:28<01:30,  1.84it/s]
Epoch 1 Iter 58: loss 0.25653. :  25%|███████████▋                                  | 57/224 [00:28<01:30,  1.84it/s]
Epoch 1 Iter 58: loss 0.25653. :  26%|███████████▉                                  | 58/224 [00:28<01:40,  1.64it/s]
Epoch 1 Iter 59: loss 0.25593. :  26%|███████████▉                                  | 58/224 [00:29<01:40,  1.64it/s]
Epoch 1 Iter 59: loss 0.25593. :  26%|████████████                                  | 59/224 [00:29<01:55,  1.43it/s]
Epoch 1 Iter 60: loss 0.25382. :  26%|████████████                                  | 59/224 [00:30<01:55,  1.43it/s]
Epoch 1 Iter 60: loss 0.25382. :  27%|████████████▎                                 | 60/224 [00:30<02:10,  1.26it/s]
Epoch 1 Iter 61: loss 0.27305. :  27%|████████████▎                                 | 60/224 [00:31<02:10,  1.26it/s]
Epoch 1 Iter 61: loss 0.27305. :  27%|████████████▌                                 | 61/224 [00:31<02:18,  1.17it/s]
Epoch 1 Iter 62: loss 0.25182. :  27%|████████████▌                                 | 61/224 [00:32<02:18,  1.17it/s]
Epoch 1 Iter 62: loss 0.25182. :  28%|████████████▋                                 | 62/224 [00:32<02:13,  1.21it/s]
Epoch 1 Iter 63: loss 0.27070. :  28%|████████████▋                                 | 62/224 [00:33<02:13,  1.21it/s]
Epoch 1 Iter 63: loss 0.27070. :  28%|████████████▉                                 | 63/224 [00:33<02:28,  1.08it/s]
Epoch 1 Iter 64: loss 0.27704. :  28%|████████████▉                                 | 63/224 [00:34<02:28,  1.08it/s]
Epoch 1 Iter 64: loss 0.27704. :  29%|█████████████▏                                | 64/224 [00:34<02:36,  1.02it/s]
Epoch 1 Iter 65: loss 0.27906. :  29%|█████████████▏                                | 64/224 [00:36<02:36,  1.02it/s]
Epoch 1 Iter 65: loss 0.27906. :  29%|█████████████▎                                | 65/224 [00:36<02:51,  1.08s/it]
Epoch 1 Iter 66: loss 0.26877. :  29%|█████████████▎                                | 65/224 [00:37<02:51,  1.08s/it]
Epoch 1 Iter 66: loss 0.26877. :  29%|█████████████▌                                | 66/224 [00:37<02:53,  1.10s/it]
Epoch 1 Iter 67: loss 0.29035. :  29%|█████████████▌                                | 66/224 [00:38<02:53,  1.10s/it]
Epoch 1 Iter 67: loss 0.29035. :  30%|█████████████▊                                | 67/224 [00:38<02:53,  1.10s/it]
Epoch 1 Iter 68: loss 0.25750. :  30%|█████████████▊                                | 67/224 [00:39<02:53,  1.10s/it]
Epoch 1 Iter 68: loss 0.25750. :  30%|█████████████▉                                | 68/224 [00:39<02:41,  1.03s/it]
Epoch 1 Iter 69: loss 0.25272. :  30%|█████████████▉                                | 68/224 [00:39<02:41,  1.03s/it]
Epoch 1 Iter 69: loss 0.25272. :  31%|██████████████▏                               | 69/224 [00:39<02:17,  1.13it/s]
Epoch 1 Iter 70: loss 0.26801. :  31%|██████████████▏                               | 69/224 [00:40<02:17,  1.13it/s]
Epoch 1 Iter 70: loss 0.26801. :  31%|██████████████▍                               | 70/224 [00:40<02:08,  1.20it/s]
Epoch 1 Iter 71: loss 0.27620. :  31%|██████████████▍                               | 70/224 [00:41<02:08,  1.20it/s]
Epoch 1 Iter 71: loss 0.27620. :  32%|██████████████▌                               | 71/224 [00:41<02:17,  1.11it/s]
Epoch 1 Iter 72: loss 0.24429. :  32%|██████████████▌                               | 71/224 [00:42<02:17,  1.11it/s]
Epoch 1 Iter 72: loss 0.24429. :  32%|██████████████▊                               | 72/224 [00:42<02:36,  1.03s/it]
Epoch 1 Iter 73: loss 0.25275. :  32%|██████████████▊                               | 72/224 [00:44<02:36,  1.03s/it]
Epoch 1 Iter 73: loss 0.25275. :  33%|██████████████▉                               | 73/224 [00:44<02:49,  1.12s/it]
Epoch 1 Iter 74: loss 0.25570. :  33%|██████████████▉                               | 73/224 [00:45<02:49,  1.12s/it]
Epoch 1 Iter 74: loss 0.25570. :  33%|███████████████▏                              | 74/224 [00:45<03:01,  1.21s/it]
Epoch 1 Iter 75: loss 0.26588. :  33%|███████████████▏                              | 74/224 [00:47<03:01,  1.21s/it]
Epoch 1 Iter 75: loss 0.26588. :  33%|███████████████▍                              | 75/224 [00:47<03:07,  1.26s/it]
Epoch 1 Iter 76: loss 0.27154. :  33%|███████████████▍                              | 75/224 [00:48<03:07,  1.26s/it]
Epoch 1 Iter 76: loss 0.27154. :  34%|███████████████▌                              | 76/224 [00:48<03:08,  1.27s/it]
Epoch 1 Iter 77: loss 0.25674. :  34%|███████████████▌                              | 76/224 [00:49<03:08,  1.27s/it]
Epoch 1 Iter 77: loss 0.25674. :  34%|███████████████▊                              | 77/224 [00:49<03:09,  1.29s/it]
Epoch 1 Iter 78: loss 0.25880. :  34%|███████████████▊                              | 77/224 [00:50<03:09,  1.29s/it]
Epoch 1 Iter 78: loss 0.25880. :  35%|████████████████                              | 78/224 [00:50<02:57,  1.22s/it]
Epoch 1 Iter 79: loss 0.28333. :  35%|████████████████                              | 78/224 [00:51<02:57,  1.22s/it]
Epoch 1 Iter 79: loss 0.28333. :  35%|████████████████▏                             | 79/224 [00:51<02:54,  1.20s/it]
Epoch 1 Iter 80: loss 0.27658. :  35%|████████████████▏                             | 79/224 [00:53<02:54,  1.20s/it]
Epoch 1 Iter 80: loss 0.27658. :  36%|████████████████▍                             | 80/224 [00:53<02:52,  1.20s/it]
Epoch 1 Iter 81: loss 0.26384. :  36%|████████████████▍                             | 80/224 [00:54<02:52,  1.20s/it]
Epoch 1 Iter 81: loss 0.26384. :  36%|████████████████▋                             | 81/224 [00:54<02:45,  1.16s/it]
Epoch 1 Iter 82: loss 0.26208. :  36%|████████████████▋                             | 81/224 [00:54<02:45,  1.16s/it]
Epoch 1 Iter 82: loss 0.26208. :  37%|████████████████▊                             | 82/224 [00:54<02:17,  1.04it/s]
Epoch 1 Iter 83: loss 0.25238. :  37%|████████████████▊                             | 82/224 [00:55<02:17,  1.04it/s]
Epoch 1 Iter 83: loss 0.25238. :  37%|█████████████████                             | 83/224 [00:55<02:07,  1.11it/s]
Epoch 1 Iter 84: loss 0.26790. :  37%|█████████████████                             | 83/224 [00:56<02:07,  1.11it/s]
Epoch 1 Iter 84: loss 0.26790. :  38%|█████████████████▎                            | 84/224 [00:56<02:23,  1.03s/it]
Epoch 1 Iter 85: loss 0.25537. :  38%|█████████████████▎                            | 84/224 [00:58<02:23,  1.03s/it]
Epoch 1 Iter 85: loss 0.25537. :  38%|█████████████████▍                            | 85/224 [00:58<02:38,  1.14s/it]
Epoch 1 Iter 86: loss 0.26014. :  38%|█████████████████▍                            | 85/224 [00:59<02:38,  1.14s/it]
Epoch 1 Iter 86: loss 0.26014. :  38%|█████████████████▋                            | 86/224 [00:59<02:39,  1.15s/it]
Epoch 1 Iter 87: loss 0.25019. :  38%|█████████████████▋                            | 86/224 [01:00<02:39,  1.15s/it]
Epoch 1 Iter 87: loss 0.25019. :  39%|█████████████████▊                            | 87/224 [01:00<02:33,  1.12s/it]
Epoch 1 Iter 88: loss 0.26709. :  39%|█████████████████▊                            | 87/224 [01:01<02:33,  1.12s/it]
Epoch 1 Iter 88: loss 0.26709. :  39%|██████████████████                            | 88/224 [01:01<02:30,  1.11s/it]
Epoch 1 Iter 89: loss 0.26206. :  39%|██████████████████                            | 88/224 [01:02<02:30,  1.11s/it]
Epoch 1 Iter 89: loss 0.26206. :  40%|██████████████████▎                           | 89/224 [01:02<02:28,  1.10s/it]
Epoch 1 Iter 90: loss 0.23356. :  40%|██████████████████▎                           | 89/224 [01:03<02:28,  1.10s/it]
Epoch 1 Iter 90: loss 0.23356. :  40%|██████████████████▍                           | 90/224 [01:03<02:36,  1.17s/it]
Epoch 1 Iter 91: loss 0.27142. :  40%|██████████████████▍                           | 90/224 [01:05<02:36,  1.17s/it]
Epoch 1 Iter 91: loss 0.27142. :  41%|██████████████████▋                           | 91/224 [01:05<02:45,  1.25s/it]
Epoch 1 Iter 92: loss 0.23913. :  41%|██████████████████▋                           | 91/224 [01:06<02:45,  1.25s/it]
Epoch 1 Iter 92: loss 0.23913. :  41%|██████████████████▉                           | 92/224 [01:06<02:37,  1.19s/it]
Epoch 1 Iter 93: loss 0.25372. :  41%|██████████████████▉                           | 92/224 [01:06<02:37,  1.19s/it]
Epoch 1 Iter 93: loss 0.25372. :  42%|███████████████████                           | 93/224 [01:06<02:12,  1.01s/it]
Epoch 1 Iter 94: loss 0.26471. :  42%|███████████████████                           | 93/224 [01:07<02:12,  1.01s/it]
Epoch 1 Iter 94: loss 0.26471. :  42%|███████████████████▎                          | 94/224 [01:07<01:57,  1.11it/s]
Epoch 1 Iter 95: loss 0.24469. :  42%|███████████████████▎                          | 94/224 [01:08<01:57,  1.11it/s]
Epoch 1 Iter 95: loss 0.24469. :  42%|███████████████████▌                          | 95/224 [01:08<02:00,  1.07it/s]
Epoch 1 Iter 96: loss 0.24981. :  42%|███████████████████▌                          | 95/224 [01:09<02:00,  1.07it/s]
Epoch 1 Iter 96: loss 0.24981. :  43%|███████████████████▋                          | 96/224 [01:09<02:04,  1.03it/s]
Epoch 1 Iter 97: loss 0.25089. :  43%|███████████████████▋                          | 96/224 [01:11<02:04,  1.03it/s]
Epoch 1 Iter 97: loss 0.25089. :  43%|███████████████████▉                          | 97/224 [01:11<02:24,  1.13s/it]
Epoch 1 Iter 98: loss 0.25772. :  43%|███████████████████▉                          | 97/224 [01:12<02:24,  1.13s/it]
Epoch 1 Iter 98: loss 0.25772. :  44%|████████████████████▏                         | 98/224 [01:12<02:19,  1.11s/it]
Epoch 1 Iter 99: loss 0.25098. :  44%|████████████████████▏                         | 98/224 [01:13<02:19,  1.11s/it]
Epoch 1 Iter 99: loss 0.25098. :  44%|████████████████████▎                         | 99/224 [01:13<02:22,  1.14s/it]
Epoch 1 Iter 100: loss 0.22422. :  44%|███████████████████▉                         | 99/224 [01:14<02:22,  1.14s/it]
Epoch 1 Iter 100: loss 0.22422. :  45%|███████████████████▋                        | 100/224 [01:14<02:21,  1.14s/it]
Epoch 1 Iter 101: loss 0.24632. :  45%|███████████████████▋                        | 100/224 [01:15<02:21,  1.14s/it]
Epoch 1 Iter 101: loss 0.24632. :  45%|███████████████████▊                        | 101/224 [01:15<02:23,  1.17s/it]
Epoch 1 Iter 102: loss 0.23766. :  45%|███████████████████▊                        | 101/224 [01:16<02:23,  1.17s/it]
Epoch 1 Iter 102: loss 0.23766. :  46%|████████████████████                        | 102/224 [01:16<02:21,  1.16s/it]
Epoch 1 Iter 103: loss 0.24358. :  46%|████████████████████                        | 102/224 [01:17<02:21,  1.16s/it]
Epoch 1 Iter 103: loss 0.24358. :  46%|████████████████████▏                       | 103/224 [01:17<02:11,  1.09s/it]
Epoch 1 Iter 104: loss 0.26413. :  46%|████████████████████▏                       | 103/224 [01:18<02:11,  1.09s/it]
Epoch 1 Iter 104: loss 0.26413. :  46%|████████████████████▍                       | 104/224 [01:18<02:01,  1.02s/it]
Epoch 1 Iter 105: loss 0.25198. :  46%|████████████████████▍                       | 104/224 [01:19<02:01,  1.02s/it]
Epoch 1 Iter 105: loss 0.25198. :  47%|████████████████████▋                       | 105/224 [01:19<01:59,  1.01s/it]
Epoch 1 Iter 106: loss 0.25277. :  47%|████████████████████▋                       | 105/224 [01:20<01:59,  1.01s/it]
Epoch 1 Iter 106: loss 0.25277. :  47%|████████████████████▊                       | 106/224 [01:20<01:41,  1.16it/s]
Epoch 1 Iter 107: loss 0.26171. :  47%|████████████████████▊                       | 106/224 [01:20<01:41,  1.16it/s]
Epoch 1 Iter 107: loss 0.26171. :  48%|█████████████████████                       | 107/224 [01:20<01:27,  1.34it/s]
Epoch 1 Iter 108: loss 0.23600. :  48%|█████████████████████                       | 107/224 [01:21<01:27,  1.34it/s]
Epoch 1 Iter 108: loss 0.23600. :  48%|█████████████████████▏                      | 108/224 [01:21<01:17,  1.49it/s]
Epoch 1 Iter 109: loss 0.23346. :  48%|█████████████████████▏                      | 108/224 [01:21<01:17,  1.49it/s]
Epoch 1 Iter 109: loss 0.23346. :  49%|█████████████████████▍                      | 109/224 [01:21<01:11,  1.62it/s]
Epoch 1 Iter 110: loss 0.24447. :  49%|█████████████████████▍                      | 109/224 [01:22<01:11,  1.62it/s]
Epoch 1 Iter 110: loss 0.24447. :  49%|█████████████████████▌                      | 110/224 [01:22<01:06,  1.72it/s]
Epoch 1 Iter 111: loss 0.22846. :  49%|█████████████████████▌                      | 110/224 [01:22<01:06,  1.72it/s]
Epoch 1 Iter 111: loss 0.22846. :  50%|█████████████████████▊                      | 111/224 [01:22<01:03,  1.79it/s]
Epoch 1 Iter 112: loss 0.23370. :  50%|█████████████████████▊                      | 111/224 [01:23<01:03,  1.79it/s]
Epoch 1 Iter 112: loss 0.23370. :  50%|██████████████████████                      | 112/224 [01:23<01:00,  1.86it/s]
Epoch 1 Iter 113: loss 0.26188. :  50%|██████████████████████                      | 112/224 [01:23<01:00,  1.86it/s]
Epoch 1 Iter 113: loss 0.26188. :  50%|██████████████████████▏                     | 113/224 [01:23<00:58,  1.90it/s]
Epoch 1 Iter 114: loss 0.25628. :  50%|██████████████████████▏                     | 113/224 [01:24<00:58,  1.90it/s]
Epoch 1 Iter 114: loss 0.25628. :  51%|██████████████████████▍                     | 114/224 [01:24<00:57,  1.93it/s]
Epoch 1 Iter 115: loss 0.26423. :  51%|██████████████████████▍                     | 114/224 [01:24<00:57,  1.93it/s]
Epoch 1 Iter 115: loss 0.26423. :  51%|██████████████████████▌                     | 115/224 [01:24<00:55,  1.95it/s]
Epoch 1 Iter 116: loss 0.26932. :  51%|██████████████████████▌                     | 115/224 [01:25<00:55,  1.95it/s]
Epoch 1 Iter 116: loss 0.26932. :  52%|██████████████████████▊                     | 116/224 [01:25<00:54,  1.98it/s]
Epoch 1 Iter 117: loss 0.23389. :  52%|██████████████████████▊                     | 116/224 [01:25<00:54,  1.98it/s]
Epoch 1 Iter 117: loss 0.23389. :  52%|██████████████████████▉                     | 117/224 [01:25<00:53,  2.01it/s]
Epoch 1 Iter 118: loss 0.24622. :  52%|██████████████████████▉                     | 117/224 [01:26<00:53,  2.01it/s]
Epoch 1 Iter 118: loss 0.24622. :  53%|███████████████████████▏                    | 118/224 [01:26<00:52,  2.03it/s]
Epoch 1 Iter 119: loss 0.25139. :  53%|███████████████████████▏                    | 118/224 [01:26<00:52,  2.03it/s]
Epoch 1 Iter 119: loss 0.25139. :  53%|███████████████████████▍                    | 119/224 [01:26<00:51,  2.03it/s]
Epoch 1 Iter 120: loss 0.21646. :  53%|███████████████████████▍                    | 119/224 [01:27<00:51,  2.03it/s]
Epoch 1 Iter 120: loss 0.21646. :  54%|███████████████████████▌                    | 120/224 [01:27<00:51,  2.02it/s]
Epoch 1 Iter 121: loss 0.24534. :  54%|███████████████████████▌                    | 120/224 [01:27<00:51,  2.02it/s]
Epoch 1 Iter 121: loss 0.24534. :  54%|███████████████████████▊                    | 121/224 [01:27<00:51,  1.99it/s]
Epoch 1 Iter 122: loss 0.24305. :  54%|███████████████████████▊                    | 121/224 [01:28<00:51,  1.99it/s]
Epoch 1 Iter 122: loss 0.24305. :  54%|███████████████████████▉                    | 122/224 [01:28<00:51,  1.99it/s]
Epoch 1 Iter 123: loss 0.23536. :  54%|███████████████████████▉                    | 122/224 [01:28<00:51,  1.99it/s]
Epoch 1 Iter 123: loss 0.23536. :  55%|████████████████████████▏                   | 123/224 [01:28<00:50,  1.99it/s]
Epoch 1 Iter 124: loss 0.25899. :  55%|████████████████████████▏                   | 123/224 [01:29<00:50,  1.99it/s]
Epoch 1 Iter 124: loss 0.25899. :  55%|████████████████████████▎                   | 124/224 [01:29<00:49,  2.00it/s]
Epoch 1 Iter 125: loss 0.26724. :  55%|████████████████████████▎                   | 124/224 [01:29<00:49,  2.00it/s]
Epoch 1 Iter 125: loss 0.26724. :  56%|████████████████████████▌                   | 125/224 [01:29<00:49,  2.02it/s]
Epoch 1 Iter 126: loss 0.24358. :  56%|████████████████████████▌                   | 125/224 [01:30<00:49,  2.02it/s]
Epoch 1 Iter 126: loss 0.24358. :  56%|████████████████████████▊                   | 126/224 [01:30<00:48,  2.03it/s]
Epoch 1 Iter 127: loss 0.25458. :  56%|████████████████████████▊                   | 126/224 [01:30<00:48,  2.03it/s]
Epoch 1 Iter 127: loss 0.25458. :  57%|████████████████████████▉                   | 127/224 [01:30<00:47,  2.03it/s]
Epoch 1 Iter 128: loss 0.24292. :  57%|████████████████████████▉                   | 127/224 [01:31<00:47,  2.03it/s]
Epoch 1 Iter 128: loss 0.24292. :  57%|█████████████████████████▏                  | 128/224 [01:31<00:46,  2.05it/s]
Epoch 1 Iter 129: loss 0.24061. :  57%|█████████████████████████▏                  | 128/224 [01:31<00:46,  2.05it/s]
Epoch 1 Iter 129: loss 0.24061. :  58%|█████████████████████████▎                  | 129/224 [01:31<00:46,  2.04it/s]
Epoch 1 Iter 130: loss 0.22801. :  58%|█████████████████████████▎                  | 129/224 [01:32<00:46,  2.04it/s]
Epoch 1 Iter 130: loss 0.22801. :  58%|█████████████████████████▌                  | 130/224 [01:32<00:46,  2.04it/s]
Epoch 1 Iter 131: loss 0.25348. :  58%|█████████████████████████▌                  | 130/224 [01:32<00:46,  2.04it/s]
Epoch 1 Iter 131: loss 0.25348. :  58%|█████████████████████████▋                  | 131/224 [01:32<00:45,  2.05it/s]
Epoch 1 Iter 132: loss 0.23871. :  58%|█████████████████████████▋                  | 131/224 [01:33<00:45,  2.05it/s]
Epoch 1 Iter 132: loss 0.23871. :  59%|█████████████████████████▉                  | 132/224 [01:33<00:44,  2.05it/s]
Epoch 1 Iter 133: loss 0.25245. :  59%|█████████████████████████▉                  | 132/224 [01:33<00:44,  2.05it/s]
Epoch 1 Iter 133: loss 0.25245. :  59%|██████████████████████████▏                 | 133/224 [01:33<00:44,  2.05it/s]
Epoch 1 Iter 134: loss 0.22902. :  59%|██████████████████████████▏                 | 133/224 [01:33<00:44,  2.05it/s]
Epoch 1 Iter 134: loss 0.22902. :  60%|██████████████████████████▎                 | 134/224 [01:33<00:43,  2.05it/s]
Epoch 1 Iter 135: loss 0.23949. :  60%|██████████████████████████▎                 | 134/224 [01:34<00:43,  2.05it/s]
Epoch 1 Iter 135: loss 0.23949. :  60%|██████████████████████████▌                 | 135/224 [01:34<00:43,  2.06it/s]
Epoch 1 Iter 136: loss 0.23475. :  60%|██████████████████████████▌                 | 135/224 [01:34<00:43,  2.06it/s]
Epoch 1 Iter 136: loss 0.23475. :  61%|██████████████████████████▋                 | 136/224 [01:34<00:42,  2.06it/s]
Epoch 1 Iter 137: loss 0.25320. :  61%|██████████████████████████▋                 | 136/224 [01:35<00:42,  2.06it/s]
Epoch 1 Iter 137: loss 0.25320. :  61%|██████████████████████████▉                 | 137/224 [01:35<00:42,  2.05it/s]
Epoch 1 Iter 138: loss 0.24465. :  61%|██████████████████████████▉                 | 137/224 [01:35<00:42,  2.05it/s]
Epoch 1 Iter 138: loss 0.24465. :  62%|███████████████████████████                 | 138/224 [01:35<00:41,  2.05it/s]
Epoch 1 Iter 139: loss 0.25945. :  62%|███████████████████████████                 | 138/224 [01:36<00:41,  2.05it/s]
Epoch 1 Iter 139: loss 0.25945. :  62%|███████████████████████████▎                | 139/224 [01:36<00:41,  2.03it/s]
Epoch 1 Iter 140: loss 0.24833. :  62%|███████████████████████████▎                | 139/224 [01:36<00:41,  2.03it/s]
Epoch 1 Iter 140: loss 0.24833. :  62%|███████████████████████████▌                | 140/224 [01:36<00:41,  2.01it/s]
Epoch 1 Iter 141: loss 0.25118. :  62%|███████████████████████████▌                | 140/224 [01:37<00:41,  2.01it/s]
Epoch 1 Iter 141: loss 0.25118. :  63%|███████████████████████████▋                | 141/224 [01:37<00:41,  2.00it/s]
Epoch 1 Iter 142: loss 0.23071. :  63%|███████████████████████████▋                | 141/224 [01:37<00:41,  2.00it/s]
Epoch 1 Iter 142: loss 0.23071. :  63%|███████████████████████████▉                | 142/224 [01:37<00:41,  1.98it/s]
Epoch 1 Iter 143: loss 0.25313. :  63%|███████████████████████████▉                | 142/224 [01:38<00:41,  1.98it/s]
Epoch 1 Iter 143: loss 0.25313. :  64%|████████████████████████████                | 143/224 [01:38<00:41,  1.97it/s]
Epoch 1 Iter 144: loss 0.26179. :  64%|████████████████████████████                | 143/224 [01:39<00:41,  1.97it/s]
Epoch 1 Iter 144: loss 0.26179. :  64%|████████████████████████████▎               | 144/224 [01:39<00:41,  1.92it/s]
Epoch 1 Iter 145: loss 0.24958. :  64%|████████████████████████████▎               | 144/224 [01:39<00:41,  1.92it/s]
Epoch 1 Iter 145: loss 0.24958. :  65%|████████████████████████████▍               | 145/224 [01:39<00:42,  1.87it/s]
Epoch 1 Iter 146: loss 0.27426. :  65%|████████████████████████████▍               | 145/224 [01:40<00:42,  1.87it/s]
Epoch 1 Iter 146: loss 0.27426. :  65%|████████████████████████████▋               | 146/224 [01:40<00:40,  1.91it/s]
Epoch 1 Iter 147: loss 0.24965. :  65%|████████████████████████████▋               | 146/224 [01:40<00:40,  1.91it/s]
Epoch 1 Iter 147: loss 0.24965. :  66%|████████████████████████████▉               | 147/224 [01:40<00:39,  1.94it/s]
Epoch 1 Iter 148: loss 0.28780. :  66%|████████████████████████████▉               | 147/224 [01:41<00:39,  1.94it/s]
Epoch 1 Iter 148: loss 0.28780. :  66%|█████████████████████████████               | 148/224 [01:41<00:38,  1.96it/s]
Epoch 1 Iter 149: loss 0.25518. :  66%|█████████████████████████████               | 148/224 [01:41<00:38,  1.96it/s]
Epoch 1 Iter 149: loss 0.25518. :  67%|█████████████████████████████▎              | 149/224 [01:41<00:38,  1.97it/s]
Epoch 1 Iter 150: loss 0.26057. :  67%|█████████████████████████████▎              | 149/224 [01:42<00:38,  1.97it/s]
Epoch 1 Iter 150: loss 0.26057. :  67%|█████████████████████████████▍              | 150/224 [01:42<00:37,  1.98it/s]
Epoch 1 Iter 151: loss 0.26018. :  67%|█████████████████████████████▍              | 150/224 [01:42<00:37,  1.98it/s]
Epoch 1 Iter 151: loss 0.26018. :  67%|█████████████████████████████▋              | 151/224 [01:42<00:36,  1.98it/s]
Epoch 1 Iter 152: loss 0.25670. :  67%|█████████████████████████████▋              | 151/224 [01:43<00:36,  1.98it/s]
Epoch 1 Iter 152: loss 0.25670. :  68%|█████████████████████████████▊              | 152/224 [01:43<00:37,  1.93it/s]
Epoch 1 Iter 153: loss 0.26621. :  68%|█████████████████████████████▊              | 152/224 [01:43<00:37,  1.93it/s]
Epoch 1 Iter 153: loss 0.26621. :  68%|██████████████████████████████              | 153/224 [01:43<00:36,  1.95it/s]
Epoch 1 Iter 154: loss 0.23654. :  68%|██████████████████████████████              | 153/224 [01:44<00:36,  1.95it/s]
Epoch 1 Iter 154: loss 0.23654. :  69%|██████████████████████████████▎             | 154/224 [01:44<00:35,  1.96it/s]
Epoch 1 Iter 155: loss 0.23580. :  69%|██████████████████████████████▎             | 154/224 [01:44<00:35,  1.96it/s]
Epoch 1 Iter 155: loss 0.23580. :  69%|██████████████████████████████▍             | 155/224 [01:44<00:34,  1.98it/s]
Epoch 1 Iter 156: loss 0.25583. :  69%|██████████████████████████████▍             | 155/224 [01:45<00:34,  1.98it/s]
Epoch 1 Iter 156: loss 0.25583. :  70%|██████████████████████████████▋             | 156/224 [01:45<00:34,  1.99it/s]
Epoch 1 Iter 157: loss 0.27727. :  70%|██████████████████████████████▋             | 156/224 [01:45<00:34,  1.99it/s]
Epoch 1 Iter 157: loss 0.27727. :  70%|██████████████████████████████▊             | 157/224 [01:45<00:33,  2.00it/s]
Epoch 1 Iter 158: loss 0.24301. :  70%|██████████████████████████████▊             | 157/224 [01:46<00:33,  2.00it/s]
Epoch 1 Iter 158: loss 0.24301. :  71%|███████████████████████████████             | 158/224 [01:46<00:33,  1.99it/s]
Epoch 1 Iter 159: loss 0.24582. :  71%|███████████████████████████████             | 158/224 [01:46<00:33,  1.99it/s]
Epoch 1 Iter 159: loss 0.24582. :  71%|███████████████████████████████▏            | 159/224 [01:46<00:32,  2.01it/s]
Epoch 1 Iter 160: loss 0.26521. :  71%|███████████████████████████████▏            | 159/224 [01:47<00:32,  2.01it/s]
Epoch 1 Iter 160: loss 0.26521. :  71%|███████████████████████████████▍            | 160/224 [01:47<00:32,  1.95it/s]
Epoch 1 Iter 161: loss 0.23328. :  71%|███████████████████████████████▍            | 160/224 [01:47<00:32,  1.95it/s]
Epoch 1 Iter 161: loss 0.23328. :  72%|███████████████████████████████▋            | 161/224 [01:47<00:32,  1.97it/s]
Epoch 1 Iter 162: loss 0.24509. :  72%|███████████████████████████████▋            | 161/224 [01:48<00:32,  1.97it/s]
Epoch 1 Iter 162: loss 0.24509. :  72%|███████████████████████████████▊            | 162/224 [01:48<00:31,  1.98it/s]
Epoch 1 Iter 163: loss 0.24070. :  72%|███████████████████████████████▊            | 162/224 [01:48<00:31,  1.98it/s]
Epoch 1 Iter 163: loss 0.24070. :  73%|████████████████████████████████            | 163/224 [01:48<00:30,  2.00it/s]
Epoch 1 Iter 164: loss 0.25440. :  73%|████████████████████████████████            | 163/224 [01:49<00:30,  2.00it/s]
Epoch 1 Iter 164: loss 0.25440. :  73%|████████████████████████████████▏           | 164/224 [01:49<00:29,  2.01it/s]
Epoch 1 Iter 165: loss 0.24986. :  73%|████████████████████████████████▏           | 164/224 [01:49<00:29,  2.01it/s]
Epoch 1 Iter 165: loss 0.24986. :  74%|████████████████████████████████▍           | 165/224 [01:49<00:29,  2.02it/s]
Epoch 1 Iter 166: loss 0.25924. :  74%|████████████████████████████████▍           | 165/224 [01:50<00:29,  2.02it/s]
Epoch 1 Iter 166: loss 0.25924. :  74%|████████████████████████████████▌           | 166/224 [01:50<00:28,  2.02it/s]
Epoch 1 Iter 167: loss 0.25063. :  74%|████████████████████████████████▌           | 166/224 [01:50<00:28,  2.02it/s]
Epoch 1 Iter 167: loss 0.25063. :  75%|████████████████████████████████▊           | 167/224 [01:50<00:28,  2.02it/s]
Epoch 1 Iter 168: loss 0.25676. :  75%|████████████████████████████████▊           | 167/224 [01:51<00:28,  2.02it/s]
Epoch 1 Iter 168: loss 0.25676. :  75%|█████████████████████████████████           | 168/224 [01:51<00:27,  2.03it/s]
Epoch 1 Iter 169: loss 0.24651. :  75%|█████████████████████████████████           | 168/224 [01:51<00:27,  2.03it/s]
Epoch 1 Iter 169: loss 0.24651. :  75%|█████████████████████████████████▏          | 169/224 [01:51<00:27,  2.02it/s]
Epoch 1 Iter 170: loss 0.27739. :  75%|█████████████████████████████████▏          | 169/224 [01:52<00:27,  2.02it/s]
Epoch 1 Iter 170: loss 0.27739. :  76%|█████████████████████████████████▍          | 170/224 [01:52<00:26,  2.02it/s]
Epoch 1 Iter 171: loss 0.27593. :  76%|█████████████████████████████████▍          | 170/224 [01:52<00:26,  2.02it/s]
Epoch 1 Iter 171: loss 0.27593. :  76%|█████████████████████████████████▌          | 171/224 [01:52<00:26,  2.02it/s]
Epoch 1 Iter 172: loss 0.24596. :  76%|█████████████████████████████████▌          | 171/224 [01:53<00:26,  2.02it/s]
Epoch 1 Iter 172: loss 0.24596. :  77%|█████████████████████████████████▊          | 172/224 [01:53<00:25,  2.03it/s]
Epoch 1 Iter 173: loss 0.24655. :  77%|█████████████████████████████████▊          | 172/224 [01:53<00:25,  2.03it/s]
Epoch 1 Iter 173: loss 0.24655. :  77%|█████████████████████████████████▉          | 173/224 [01:53<00:25,  2.03it/s]
Epoch 1 Iter 174: loss 0.24780. :  77%|█████████████████████████████████▉          | 173/224 [01:54<00:25,  2.03it/s]
Epoch 1 Iter 174: loss 0.24780. :  78%|██████████████████████████████████▏         | 174/224 [01:54<00:24,  2.03it/s]
Epoch 1 Iter 175: loss 0.23499. :  78%|██████████████████████████████████▏         | 174/224 [01:54<00:24,  2.03it/s]
Epoch 1 Iter 175: loss 0.23499. :  78%|██████████████████████████████████▍         | 175/224 [01:54<00:24,  2.04it/s]
Epoch 1 Iter 176: loss 0.24994. :  78%|██████████████████████████████████▍         | 175/224 [01:55<00:24,  2.04it/s]
Epoch 1 Iter 176: loss 0.24994. :  79%|██████████████████████████████████▌         | 176/224 [01:55<00:23,  2.04it/s]
Epoch 1 Iter 177: loss 0.24320. :  79%|██████████████████████████████████▌         | 176/224 [01:55<00:23,  2.04it/s]
Epoch 1 Iter 177: loss 0.24320. :  79%|██████████████████████████████████▊         | 177/224 [01:55<00:23,  2.04it/s]
Epoch 1 Iter 178: loss 0.25554. :  79%|██████████████████████████████████▊         | 177/224 [01:56<00:23,  2.04it/s]
Epoch 1 Iter 178: loss 0.25554. :  79%|██████████████████████████████████▉         | 178/224 [01:56<00:22,  2.04it/s]
Epoch 1 Iter 179: loss 0.25492. :  79%|██████████████████████████████████▉         | 178/224 [01:56<00:22,  2.04it/s]
Epoch 1 Iter 179: loss 0.25492. :  80%|███████████████████████████████████▏        | 179/224 [01:56<00:22,  2.03it/s]
Epoch 1 Iter 180: loss 0.26333. :  80%|███████████████████████████████████▏        | 179/224 [01:57<00:22,  2.03it/s]
Epoch 1 Iter 180: loss 0.26333. :  80%|███████████████████████████████████▎        | 180/224 [01:57<00:21,  2.02it/s]
Epoch 1 Iter 181: loss 0.27191. :  80%|███████████████████████████████████▎        | 180/224 [01:57<00:21,  2.02it/s]
Epoch 1 Iter 181: loss 0.27191. :  81%|███████████████████████████████████▌        | 181/224 [01:57<00:21,  2.03it/s]
Epoch 1 Iter 182: loss 0.25580. :  81%|███████████████████████████████████▌        | 181/224 [01:58<00:21,  2.03it/s]
Epoch 1 Iter 182: loss 0.25580. :  81%|███████████████████████████████████▊        | 182/224 [01:58<00:20,  2.04it/s]
Epoch 1 Iter 183: loss 0.26406. :  81%|███████████████████████████████████▊        | 182/224 [01:58<00:20,  2.04it/s]
Epoch 1 Iter 183: loss 0.26406. :  82%|███████████████████████████████████▉        | 183/224 [01:58<00:20,  2.04it/s]
Epoch 1 Iter 184: loss 0.23473. :  82%|███████████████████████████████████▉        | 183/224 [01:58<00:20,  2.04it/s]
Epoch 1 Iter 184: loss 0.23473. :  82%|████████████████████████████████████▏       | 184/224 [01:58<00:19,  2.04it/s]
Epoch 1 Iter 185: loss 0.23358. :  82%|████████████████████████████████████▏       | 184/224 [01:59<00:19,  2.04it/s]
Epoch 1 Iter 185: loss 0.23358. :  83%|████████████████████████████████████▎       | 185/224 [01:59<00:19,  2.04it/s]
Epoch 1 Iter 186: loss 0.25928. :  83%|████████████████████████████████████▎       | 185/224 [01:59<00:19,  2.04it/s]
Epoch 1 Iter 186: loss 0.25928. :  83%|████████████████████████████████████▌       | 186/224 [01:59<00:18,  2.04it/s]
Epoch 1 Iter 187: loss 0.23669. :  83%|████████████████████████████████████▌       | 186/224 [02:00<00:18,  2.04it/s]
Epoch 1 Iter 187: loss 0.23669. :  83%|████████████████████████████████████▋       | 187/224 [02:00<00:18,  2.04it/s]
Epoch 1 Iter 188: loss 0.25153. :  83%|████████████████████████████████████▋       | 187/224 [02:00<00:18,  2.04it/s]
Epoch 1 Iter 188: loss 0.25153. :  84%|████████████████████████████████████▉       | 188/224 [02:00<00:17,  2.03it/s]
Epoch 1 Iter 189: loss 0.25457. :  84%|████████████████████████████████████▉       | 188/224 [02:01<00:17,  2.03it/s]
Epoch 1 Iter 189: loss 0.25457. :  84%|█████████████████████████████████████▏      | 189/224 [02:01<00:17,  2.03it/s]
Epoch 1 Iter 190: loss 0.22146. :  84%|█████████████████████████████████████▏      | 189/224 [02:01<00:17,  2.03it/s]
Epoch 1 Iter 190: loss 0.22146. :  85%|█████████████████████████████████████▎      | 190/224 [02:01<00:16,  2.02it/s]
Epoch 1 Iter 191: loss 0.25311. :  85%|█████████████████████████████████████▎      | 190/224 [02:02<00:16,  2.02it/s]
Epoch 1 Iter 191: loss 0.25311. :  85%|█████████████████████████████████████▌      | 191/224 [02:02<00:16,  2.02it/s]
Epoch 1 Iter 192: loss 0.23062. :  85%|█████████████████████████████████████▌      | 191/224 [02:02<00:16,  2.02it/s]
Epoch 1 Iter 192: loss 0.23062. :  86%|█████████████████████████████████████▋      | 192/224 [02:02<00:15,  2.02it/s]
Epoch 1 Iter 193: loss 0.23567. :  86%|█████████████████████████████████████▋      | 192/224 [02:03<00:15,  2.02it/s]
Epoch 1 Iter 193: loss 0.23567. :  86%|█████████████████████████████████████▉      | 193/224 [02:03<00:15,  2.02it/s]
Epoch 1 Iter 194: loss 0.25206. :  86%|█████████████████████████████████████▉      | 193/224 [02:03<00:15,  2.02it/s]
Epoch 1 Iter 194: loss 0.25206. :  87%|██████████████████████████████████████      | 194/224 [02:03<00:14,  2.02it/s]
Epoch 1 Iter 195: loss 0.23242. :  87%|██████████████████████████████████████      | 194/224 [02:04<00:14,  2.02it/s]
Epoch 1 Iter 195: loss 0.23242. :  87%|██████████████████████████████████████▎     | 195/224 [02:04<00:14,  2.02it/s]
Epoch 1 Iter 196: loss 0.23524. :  87%|██████████████████████████████████████▎     | 195/224 [02:04<00:14,  2.02it/s]
Epoch 1 Iter 196: loss 0.23524. :  88%|██████████████████████████████████████▌     | 196/224 [02:04<00:13,  2.03it/s]
Epoch 1 Iter 197: loss 0.26350. :  88%|██████████████████████████████████████▌     | 196/224 [02:05<00:13,  2.03it/s]
Epoch 1 Iter 197: loss 0.26350. :  88%|██████████████████████████████████████▋     | 197/224 [02:05<00:13,  2.03it/s]
Epoch 1 Iter 198: loss 0.26471. :  88%|██████████████████████████████████████▋     | 197/224 [02:05<00:13,  2.03it/s]
Epoch 1 Iter 198: loss 0.26471. :  88%|██████████████████████████████████████▉     | 198/224 [02:05<00:12,  2.03it/s]
Epoch 1 Iter 199: loss 0.22893. :  88%|██████████████████████████████████████▉     | 198/224 [02:06<00:12,  2.03it/s]
Epoch 1 Iter 199: loss 0.22893. :  89%|███████████████████████████████████████     | 199/224 [02:06<00:12,  2.04it/s]
Epoch 1 Iter 200: loss 0.26041. :  89%|███████████████████████████████████████     | 199/224 [02:06<00:12,  2.04it/s]
Epoch 1 Iter 200: loss 0.26041. :  89%|███████████████████████████████████████▎    | 200/224 [02:06<00:11,  2.04it/s]
Epoch 1 Iter 201: loss 0.22717. :  89%|███████████████████████████████████████▎    | 200/224 [02:07<00:11,  2.04it/s]
Epoch 1 Iter 201: loss 0.22717. :  90%|███████████████████████████████████████▍    | 201/224 [02:07<00:11,  2.03it/s]
Epoch 1 Iter 202: loss 0.27878. :  90%|███████████████████████████████████████▍    | 201/224 [02:07<00:11,  2.03it/s]
Epoch 1 Iter 202: loss 0.27878. :  90%|███████████████████████████████████████▋    | 202/224 [02:07<00:10,  2.04it/s]
Epoch 1 Iter 203: loss 0.25056. :  90%|███████████████████████████████████████▋    | 202/224 [02:08<00:10,  2.04it/s]
Epoch 1 Iter 203: loss 0.25056. :  91%|███████████████████████████████████████▉    | 203/224 [02:08<00:10,  2.04it/s]
Epoch 1 Iter 204: loss 0.24939. :  91%|███████████████████████████████████████▉    | 203/224 [02:08<00:10,  2.04it/s]
Epoch 1 Iter 204: loss 0.24939. :  91%|████████████████████████████████████████    | 204/224 [02:08<00:09,  2.04it/s]
Epoch 1 Iter 205: loss 0.22652. :  91%|████████████████████████████████████████    | 204/224 [02:09<00:09,  2.04it/s]
Epoch 1 Iter 205: loss 0.22652. :  92%|████████████████████████████████████████▎   | 205/224 [02:09<00:09,  2.03it/s]
Epoch 1 Iter 206: loss 0.25527. :  92%|████████████████████████████████████████▎   | 205/224 [02:09<00:09,  2.03it/s]
Epoch 1 Iter 206: loss 0.25527. :  92%|████████████████████████████████████████▍   | 206/224 [02:09<00:08,  2.03it/s]
Epoch 1 Iter 207: loss 0.24943. :  92%|████████████████████████████████████████▍   | 206/224 [02:10<00:08,  2.03it/s]
Epoch 1 Iter 207: loss 0.24943. :  92%|████████████████████████████████████████▋   | 207/224 [02:10<00:08,  2.04it/s]
Epoch 1 Iter 208: loss 0.25250. :  92%|████████████████████████████████████████▋   | 207/224 [02:10<00:08,  2.04it/s]
Epoch 1 Iter 208: loss 0.25250. :  93%|████████████████████████████████████████▊   | 208/224 [02:10<00:07,  2.04it/s]
Epoch 1 Iter 209: loss 0.23907. :  93%|████████████████████████████████████████▊   | 208/224 [02:11<00:07,  2.04it/s]
Epoch 1 Iter 209: loss 0.23907. :  93%|█████████████████████████████████████████   | 209/224 [02:11<00:07,  2.03it/s]
Epoch 1 Iter 210: loss 0.25193. :  93%|█████████████████████████████████████████   | 209/224 [02:11<00:07,  2.03it/s]
Epoch 1 Iter 210: loss 0.25193. :  94%|█████████████████████████████████████████▎  | 210/224 [02:11<00:06,  2.03it/s]
Epoch 1 Iter 211: loss 0.24778. :  94%|█████████████████████████████████████████▎  | 210/224 [02:12<00:06,  2.03it/s]
Epoch 1 Iter 211: loss 0.24778. :  94%|█████████████████████████████████████████▍  | 211/224 [02:12<00:06,  2.03it/s]
Epoch 1 Iter 212: loss 0.24919. :  94%|█████████████████████████████████████████▍  | 211/224 [02:12<00:06,  2.03it/s]
Epoch 1 Iter 212: loss 0.24919. :  95%|█████████████████████████████████████████▋  | 212/224 [02:12<00:05,  2.02it/s]
Epoch 1 Iter 213: loss 0.26592. :  95%|█████████████████████████████████████████▋  | 212/224 [02:13<00:05,  2.02it/s]
Epoch 1 Iter 213: loss 0.26592. :  95%|█████████████████████████████████████████▊  | 213/224 [02:13<00:05,  2.02it/s]
Epoch 1 Iter 214: loss 0.24131. :  95%|█████████████████████████████████████████▊  | 213/224 [02:13<00:05,  2.02it/s]
Epoch 1 Iter 214: loss 0.24131. :  96%|██████████████████████████████████████████  | 214/224 [02:13<00:04,  2.03it/s]
Epoch 1 Iter 215: loss 0.23161. :  96%|██████████████████████████████████████████  | 214/224 [02:14<00:04,  2.03it/s]
Epoch 1 Iter 215: loss 0.23161. :  96%|██████████████████████████████████████████▏ | 215/224 [02:14<00:04,  2.03it/s]
Epoch 1 Iter 216: loss 0.25227. :  96%|██████████████████████████████████████████▏ | 215/224 [02:14<00:04,  2.03it/s]
Epoch 1 Iter 216: loss 0.25227. :  96%|██████████████████████████████████████████▍ | 216/224 [02:14<00:03,  2.03it/s]
Epoch 1 Iter 217: loss 0.23641. :  96%|██████████████████████████████████████████▍ | 216/224 [02:15<00:03,  2.03it/s]
Epoch 1 Iter 217: loss 0.23641. :  97%|██████████████████████████████████████████▋ | 217/224 [02:15<00:03,  2.03it/s]
Epoch 1 Iter 218: loss 0.25580. :  97%|██████████████████████████████████████████▋ | 217/224 [02:15<00:03,  2.03it/s]
Epoch 1 Iter 218: loss 0.25580. :  97%|██████████████████████████████████████████▊ | 218/224 [02:15<00:02,  2.02it/s]
Epoch 1 Iter 219: loss 0.26767. :  97%|██████████████████████████████████████████▊ | 218/224 [02:16<00:02,  2.02it/s]
Epoch 1 Iter 219: loss 0.26767. :  98%|███████████████████████████████████████████ | 219/224 [02:16<00:02,  2.02it/s]
Epoch 1 Iter 220: loss 0.26566. :  98%|███████████████████████████████████████████ | 219/224 [02:16<00:02,  2.02it/s]
Epoch 1 Iter 220: loss 0.26566. :  98%|███████████████████████████████████████████▏| 220/224 [02:16<00:01,  2.03it/s]
Epoch 1 Iter 221: loss 0.24415. :  98%|███████████████████████████████████████████▏| 220/224 [02:17<00:01,  2.03it/s]
Epoch 1 Iter 221: loss 0.24415. :  99%|███████████████████████████████████████████▍| 221/224 [02:17<00:01,  2.03it/s]
Epoch 1 Iter 222: loss 0.22777. :  99%|███████████████████████████████████████████▍| 221/224 [02:17<00:01,  2.03it/s]
Epoch 1 Iter 222: loss 0.22777. :  99%|███████████████████████████████████████████▌| 222/224 [02:17<00:00,  2.02it/s]
Epoch 1 Iter 223: loss 0.22241. :  99%|███████████████████████████████████████████▌| 222/224 [02:18<00:00,  2.02it/s]
Epoch 1 Iter 223: loss 0.22241. : 100%|███████████████████████████████████████████▊| 223/224 [02:18<00:00,  2.00it/s]
Epoch 1 Iter 224: loss 0.24820. : 100%|███████████████████████████████████████████▊| 223/224 [02:18<00:00,  2.00it/s]
Epoch 1 Iter 224: loss 0.24820. : 100%|████████████████████████████████████████████| 224/224 [02:18<00:00,  2.00it/s]
Epoch 1 Iter 224: loss 0.24820. : 100%|████████████████████████████████████████████| 224/224 [02:18<00:00,  1.61it/s]

    Train loss: 0.28334
    Valid loss: 0.59458
       Valid loss recons: 0.59439
       Valid loss KL-D:   0.01889
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.24115. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.24115. :   0%|▏                                               | 1/224 [00:00<01:52,  1.98it/s]
Epoch 2 Iter 2: loss 0.24903. :   0%|▏                                               | 1/224 [00:01<01:52,  1.98it/s]
Epoch 2 Iter 2: loss 0.24903. :   1%|▍                                               | 2/224 [00:01<01:52,  1.97it/s]
Epoch 2 Iter 3: loss 0.23829. :   1%|▍                                               | 2/224 [00:01<01:52,  1.97it/s]
Epoch 2 Iter 3: loss 0.23829. :   1%|▋                                               | 3/224 [00:01<01:50,  2.00it/s]
Epoch 2 Iter 4: loss 0.25635. :   1%|▋                                               | 3/224 [00:01<01:50,  2.00it/s]
Epoch 2 Iter 4: loss 0.25635. :   2%|▊                                               | 4/224 [00:01<01:49,  2.01it/s]
Epoch 2 Iter 5: loss 0.23179. :   2%|▊                                               | 4/224 [00:02<01:49,  2.01it/s]
Epoch 2 Iter 5: loss 0.23179. :   2%|█                                               | 5/224 [00:02<01:49,  2.01it/s]
Epoch 2 Iter 6: loss 0.25987. :   2%|█                                               | 5/224 [00:03<01:49,  2.01it/s]
Epoch 2 Iter 6: loss 0.25987. :   3%|█▎                                              | 6/224 [00:03<01:49,  2.00it/s]
Epoch 2 Iter 7: loss 0.26966. :   3%|█▎                                              | 6/224 [00:03<01:49,  2.00it/s]
Epoch 2 Iter 7: loss 0.26966. :   3%|█▌                                              | 7/224 [00:03<01:49,  1.99it/s]
Epoch 2 Iter 8: loss 0.23520. :   3%|█▌                                              | 7/224 [00:04<01:49,  1.99it/s]
Epoch 2 Iter 8: loss 0.23520. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 2 Iter 9: loss 0.24975. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 2 Iter 9: loss 0.24975. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 2 Iter 10: loss 0.23959. :   4%|█▉                                             | 9/224 [00:05<01:47,  2.00it/s]
Epoch 2 Iter 10: loss 0.23959. :   4%|██                                            | 10/224 [00:05<01:47,  2.00it/s]
Epoch 2 Iter 11: loss 0.24108. :   4%|██                                            | 10/224 [00:05<01:47,  2.00it/s]
Epoch 2 Iter 11: loss 0.24108. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.01it/s]
Epoch 2 Iter 12: loss 0.24801. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.01it/s]
Epoch 2 Iter 12: loss 0.24801. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.02it/s]
Epoch 2 Iter 13: loss 0.24423. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 2 Iter 13: loss 0.24423. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.03it/s]
Epoch 2 Iter 14: loss 0.24179. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.03it/s]
Epoch 2 Iter 14: loss 0.24179. :   6%|██▉                                           | 14/224 [00:06<01:43,  2.03it/s]
Epoch 2 Iter 15: loss 0.25072. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.03it/s]
Epoch 2 Iter 15: loss 0.25072. :   7%|███                                           | 15/224 [00:07<01:43,  2.02it/s]
Epoch 2 Iter 16: loss 0.26274. :   7%|███                                           | 15/224 [00:07<01:43,  2.02it/s]
Epoch 2 Iter 16: loss 0.26274. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.02it/s]
Epoch 2 Iter 17: loss 0.24829. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.02it/s]
Epoch 2 Iter 17: loss 0.24829. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.03it/s]
Epoch 2 Iter 18: loss 0.24198. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.03it/s]
Epoch 2 Iter 18: loss 0.24198. :   8%|███▋                                          | 18/224 [00:08<01:41,  2.03it/s]
Epoch 2 Iter 19: loss 0.25124. :   8%|███▋                                          | 18/224 [00:09<01:41,  2.03it/s]
Epoch 2 Iter 19: loss 0.25124. :   8%|███▉                                          | 19/224 [00:09<01:43,  1.97it/s]
Epoch 2 Iter 20: loss 0.23728. :   8%|███▉                                          | 19/224 [00:10<01:43,  1.97it/s]
Epoch 2 Iter 20: loss 0.23728. :   9%|████                                          | 20/224 [00:10<01:44,  1.96it/s]
Epoch 2 Iter 21: loss 0.23758. :   9%|████                                          | 20/224 [00:10<01:44,  1.96it/s]
Epoch 2 Iter 21: loss 0.23758. :   9%|████▎                                         | 21/224 [00:10<01:43,  1.97it/s]
Epoch 2 Iter 22: loss 0.22826. :   9%|████▎                                         | 21/224 [00:11<01:43,  1.97it/s]
Epoch 2 Iter 22: loss 0.22826. :  10%|████▌                                         | 22/224 [00:11<01:42,  1.98it/s]
Epoch 2 Iter 23: loss 0.25485. :  10%|████▌                                         | 22/224 [00:11<01:42,  1.98it/s]
Epoch 2 Iter 23: loss 0.25485. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 2 Iter 24: loss 0.23505. :  10%|████▋                                         | 23/224 [00:12<01:40,  2.00it/s]
Epoch 2 Iter 24: loss 0.23505. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 2 Iter 25: loss 0.26061. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 2 Iter 25: loss 0.26061. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.01it/s]
Epoch 2 Iter 26: loss 0.24680. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.01it/s]
Epoch 2 Iter 26: loss 0.24680. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.01it/s]
Epoch 2 Iter 27: loss 0.24141. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.01it/s]
Epoch 2 Iter 27: loss 0.24141. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.01it/s]
Epoch 2 Iter 28: loss 0.22769. :  12%|█████▌                                        | 27/224 [00:13<01:38,  2.01it/s]
Epoch 2 Iter 28: loss 0.22769. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.01it/s]
Epoch 2 Iter 29: loss 0.24065. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.01it/s]
Epoch 2 Iter 29: loss 0.24065. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 2 Iter 30: loss 0.25090. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 2 Iter 30: loss 0.25090. :  13%|██████▏                                       | 30/224 [00:14<01:35,  2.03it/s]
Epoch 2 Iter 31: loss 0.25365. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 2 Iter 31: loss 0.25365. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 2 Iter 32: loss 0.24638. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 2 Iter 32: loss 0.24638. :  14%|██████▌                                       | 32/224 [00:15<01:34,  2.03it/s]
Epoch 2 Iter 33: loss 0.26398. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.03it/s]
Epoch 2 Iter 33: loss 0.26398. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 2 Iter 34: loss 0.25550. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 2 Iter 34: loss 0.25550. :  15%|██████▉                                       | 34/224 [00:16<01:33,  2.04it/s]
Epoch 2 Iter 35: loss 0.22742. :  15%|██████▉                                       | 34/224 [00:17<01:33,  2.04it/s]
Epoch 2 Iter 35: loss 0.22742. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 2 Iter 36: loss 0.23470. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 2 Iter 36: loss 0.23470. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.04it/s]
Epoch 2 Iter 37: loss 0.25680. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.04it/s]
Epoch 2 Iter 37: loss 0.25680. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.05it/s]
Epoch 2 Iter 38: loss 0.24252. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.05it/s]
Epoch 2 Iter 38: loss 0.24252. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.21856. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.21856. :  17%|████████                                      | 39/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 40: loss 0.23557. :  17%|████████                                      | 39/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 40: loss 0.23557. :  18%|████████▏                                     | 40/224 [00:19<01:30,  2.02it/s]
Epoch 2 Iter 41: loss 0.22703. :  18%|████████▏                                     | 40/224 [00:20<01:30,  2.02it/s]
Epoch 2 Iter 41: loss 0.22703. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.01it/s]
Epoch 2 Iter 42: loss 0.24081. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.01it/s]
Epoch 2 Iter 42: loss 0.24081. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 2 Iter 43: loss 0.23431. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 2 Iter 43: loss 0.23431. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 2 Iter 44: loss 0.24979. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 2 Iter 44: loss 0.24979. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.01it/s]
Epoch 2 Iter 45: loss 0.22793. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 2 Iter 45: loss 0.22793. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 2 Iter 46: loss 0.25012. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 2 Iter 46: loss 0.25012. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.00it/s]
Epoch 2 Iter 47: loss 0.22981. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.00it/s]
Epoch 2 Iter 47: loss 0.22981. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 2 Iter 48: loss 0.24345. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 2 Iter 48: loss 0.24345. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.00it/s]
Epoch 2 Iter 49: loss 0.25125. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 2 Iter 49: loss 0.25125. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 2 Iter 50: loss 0.25292. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 2 Iter 50: loss 0.25292. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.01it/s]
Epoch 2 Iter 51: loss 0.26182. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 2 Iter 51: loss 0.26182. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 2 Iter 52: loss 0.24165. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 2 Iter 52: loss 0.24165. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.01it/s]
Epoch 2 Iter 53: loss 0.24928. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 2 Iter 53: loss 0.24928. :  24%|██████████▉                                   | 53/224 [00:26<01:26,  1.97it/s]
Epoch 2 Iter 54: loss 0.24517. :  24%|██████████▉                                   | 53/224 [00:26<01:26,  1.97it/s]
Epoch 2 Iter 54: loss 0.24517. :  24%|███████████                                   | 54/224 [00:26<01:25,  1.99it/s]
Epoch 2 Iter 55: loss 0.25290. :  24%|███████████                                   | 54/224 [00:27<01:25,  1.99it/s]
Epoch 2 Iter 55: loss 0.25290. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 2 Iter 56: loss 0.25136. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 2 Iter 56: loss 0.25136. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.00it/s]
Epoch 2 Iter 57: loss 0.25051. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.00it/s]
Epoch 2 Iter 57: loss 0.25051. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  2.00it/s]
Epoch 2 Iter 58: loss 0.27303. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  2.00it/s]
Epoch 2 Iter 58: loss 0.27303. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.00it/s]
Epoch 2 Iter 59: loss 0.23854. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.00it/s]
Epoch 2 Iter 59: loss 0.23854. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 2 Iter 60: loss 0.25641. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 2 Iter 60: loss 0.25641. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.01it/s]
Epoch 2 Iter 61: loss 0.24681. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 2 Iter 61: loss 0.24681. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.01it/s]
Epoch 2 Iter 62: loss 0.23617. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.01it/s]
Epoch 2 Iter 62: loss 0.23617. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.01it/s]
Epoch 2 Iter 63: loss 0.24070. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 2 Iter 63: loss 0.24070. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.97it/s]
Epoch 2 Iter 64: loss 0.24923. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.97it/s]
Epoch 2 Iter 64: loss 0.24923. :  29%|█████████████▏                                | 64/224 [00:31<01:21,  1.95it/s]
Epoch 2 Iter 65: loss 0.23097. :  29%|█████████████▏                                | 64/224 [00:32<01:21,  1.95it/s]
Epoch 2 Iter 65: loss 0.23097. :  29%|█████████████▎                                | 65/224 [00:32<01:21,  1.94it/s]
Epoch 2 Iter 66: loss 0.25544. :  29%|█████████████▎                                | 65/224 [00:32<01:21,  1.94it/s]
Epoch 2 Iter 66: loss 0.25544. :  29%|█████████████▌                                | 66/224 [00:32<01:20,  1.96it/s]
Epoch 2 Iter 67: loss 0.22433. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.96it/s]
Epoch 2 Iter 67: loss 0.22433. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.98it/s]
Epoch 2 Iter 68: loss 0.25827. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.98it/s]
Epoch 2 Iter 68: loss 0.25827. :  30%|█████████████▉                                | 68/224 [00:33<01:18,  1.98it/s]
Epoch 2 Iter 69: loss 0.25300. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.98it/s]
Epoch 2 Iter 69: loss 0.25300. :  31%|██████████████▏                               | 69/224 [00:34<01:18,  1.98it/s]
Epoch 2 Iter 70: loss 0.24070. :  31%|██████████████▏                               | 69/224 [00:34<01:18,  1.98it/s]
Epoch 2 Iter 70: loss 0.24070. :  31%|██████████████▍                               | 70/224 [00:34<01:17,  1.99it/s]
Epoch 2 Iter 71: loss 0.23418. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.99it/s]
Epoch 2 Iter 71: loss 0.23418. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.97it/s]
Epoch 2 Iter 72: loss 0.24236. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.97it/s]
Epoch 2 Iter 72: loss 0.24236. :  32%|██████████████▊                               | 72/224 [00:35<01:17,  1.97it/s]
Epoch 2 Iter 73: loss 0.24614. :  32%|██████████████▊                               | 72/224 [00:36<01:17,  1.97it/s]
Epoch 2 Iter 73: loss 0.24614. :  33%|██████████████▉                               | 73/224 [00:36<01:19,  1.90it/s]
Epoch 2 Iter 74: loss 0.23397. :  33%|██████████████▉                               | 73/224 [00:37<01:19,  1.90it/s]
Epoch 2 Iter 74: loss 0.23397. :  33%|███████████████▏                              | 74/224 [00:37<01:25,  1.75it/s]
Epoch 2 Iter 75: loss 0.25540. :  33%|███████████████▏                              | 74/224 [00:37<01:25,  1.75it/s]
Epoch 2 Iter 75: loss 0.25540. :  33%|███████████████▍                              | 75/224 [00:37<01:23,  1.77it/s]
Epoch 2 Iter 76: loss 0.26026. :  33%|███████████████▍                              | 75/224 [00:38<01:23,  1.77it/s]
Epoch 2 Iter 76: loss 0.26026. :  34%|███████████████▌                              | 76/224 [00:38<01:27,  1.69it/s]
Epoch 2 Iter 77: loss 0.24403. :  34%|███████████████▌                              | 76/224 [00:39<01:27,  1.69it/s]
Epoch 2 Iter 77: loss 0.24403. :  34%|███████████████▊                              | 77/224 [00:39<01:30,  1.63it/s]
Epoch 2 Iter 78: loss 0.23078. :  34%|███████████████▊                              | 77/224 [00:39<01:30,  1.63it/s]
Epoch 2 Iter 78: loss 0.23078. :  35%|████████████████                              | 78/224 [00:39<01:31,  1.60it/s]
Epoch 2 Iter 79: loss 0.25611. :  35%|████████████████                              | 78/224 [00:40<01:31,  1.60it/s]
Epoch 2 Iter 79: loss 0.25611. :  35%|████████████████▏                             | 79/224 [00:40<01:32,  1.56it/s]
Epoch 2 Iter 80: loss 0.23339. :  35%|████████████████▏                             | 79/224 [00:40<01:32,  1.56it/s]
Epoch 2 Iter 80: loss 0.23339. :  36%|████████████████▍                             | 80/224 [00:40<01:28,  1.63it/s]
Epoch 2 Iter 81: loss 0.23907. :  36%|████████████████▍                             | 80/224 [00:41<01:28,  1.63it/s]
Epoch 2 Iter 81: loss 0.23907. :  36%|████████████████▋                             | 81/224 [00:41<01:23,  1.71it/s]
Epoch 2 Iter 82: loss 0.25958. :  36%|████████████████▋                             | 81/224 [00:41<01:23,  1.71it/s]
Epoch 2 Iter 82: loss 0.25958. :  37%|████████████████▊                             | 82/224 [00:41<01:19,  1.80it/s]
Epoch 2 Iter 83: loss 0.24409. :  37%|████████████████▊                             | 82/224 [00:42<01:19,  1.80it/s]
Epoch 2 Iter 83: loss 0.24409. :  37%|█████████████████                             | 83/224 [00:42<01:15,  1.86it/s]
Epoch 2 Iter 84: loss 0.24203. :  37%|█████████████████                             | 83/224 [00:42<01:15,  1.86it/s]
Epoch 2 Iter 84: loss 0.24203. :  38%|█████████████████▎                            | 84/224 [00:42<01:13,  1.90it/s]
Epoch 2 Iter 85: loss 0.23959. :  38%|█████████████████▎                            | 84/224 [00:43<01:13,  1.90it/s]
Epoch 2 Iter 85: loss 0.23959. :  38%|█████████████████▍                            | 85/224 [00:43<01:12,  1.93it/s]
Epoch 2 Iter 86: loss 0.24390. :  38%|█████████████████▍                            | 85/224 [00:43<01:12,  1.93it/s]
Epoch 2 Iter 86: loss 0.24390. :  38%|█████████████████▋                            | 86/224 [00:43<01:10,  1.95it/s]
Epoch 2 Iter 87: loss 0.24585. :  38%|█████████████████▋                            | 86/224 [00:44<01:10,  1.95it/s]
Epoch 2 Iter 87: loss 0.24585. :  39%|█████████████████▊                            | 87/224 [00:44<01:10,  1.95it/s]
Epoch 2 Iter 88: loss 0.24897. :  39%|█████████████████▊                            | 87/224 [00:45<01:10,  1.95it/s]
Epoch 2 Iter 88: loss 0.24897. :  39%|██████████████████                            | 88/224 [00:45<01:11,  1.90it/s]
Epoch 2 Iter 89: loss 0.22783. :  39%|██████████████████                            | 88/224 [00:45<01:11,  1.90it/s]
Epoch 2 Iter 89: loss 0.22783. :  40%|██████████████████▎                           | 89/224 [00:45<01:10,  1.91it/s]
Epoch 2 Iter 90: loss 0.23811. :  40%|██████████████████▎                           | 89/224 [00:46<01:10,  1.91it/s]
Epoch 2 Iter 90: loss 0.23811. :  40%|██████████████████▍                           | 90/224 [00:46<01:09,  1.93it/s]
Epoch 2 Iter 91: loss 0.22634. :  40%|██████████████████▍                           | 90/224 [00:46<01:09,  1.93it/s]
Epoch 2 Iter 91: loss 0.22634. :  41%|██████████████████▋                           | 91/224 [00:46<01:08,  1.94it/s]
Epoch 2 Iter 92: loss 0.25872. :  41%|██████████████████▋                           | 91/224 [00:47<01:08,  1.94it/s]
Epoch 2 Iter 92: loss 0.25872. :  41%|██████████████████▉                           | 92/224 [00:47<01:08,  1.94it/s]
Epoch 2 Iter 93: loss 0.26093. :  41%|██████████████████▉                           | 92/224 [00:47<01:08,  1.94it/s]
Epoch 2 Iter 93: loss 0.26093. :  42%|███████████████████                           | 93/224 [00:47<01:07,  1.95it/s]
Epoch 2 Iter 94: loss 0.25043. :  42%|███████████████████                           | 93/224 [00:48<01:07,  1.95it/s]
Epoch 2 Iter 94: loss 0.25043. :  42%|███████████████████▎                          | 94/224 [00:48<01:06,  1.96it/s]
Epoch 2 Iter 95: loss 0.23692. :  42%|███████████████████▎                          | 94/224 [00:48<01:06,  1.96it/s]
Epoch 2 Iter 95: loss 0.23692. :  42%|███████████████████▌                          | 95/224 [00:48<01:05,  1.97it/s]
Epoch 2 Iter 96: loss 0.23898. :  42%|███████████████████▌                          | 95/224 [00:49<01:05,  1.97it/s]
Epoch 2 Iter 96: loss 0.23898. :  43%|███████████████████▋                          | 96/224 [00:49<01:05,  1.95it/s]
Epoch 2 Iter 97: loss 0.22421. :  43%|███████████████████▋                          | 96/224 [00:49<01:05,  1.95it/s]
Epoch 2 Iter 97: loss 0.22421. :  43%|███████████████████▉                          | 97/224 [00:49<01:05,  1.95it/s]
Epoch 2 Iter 98: loss 0.24450. :  43%|███████████████████▉                          | 97/224 [00:50<01:05,  1.95it/s]
Epoch 2 Iter 98: loss 0.24450. :  44%|████████████████████▏                         | 98/224 [00:50<01:04,  1.96it/s]
Epoch 2 Iter 99: loss 0.23075. :  44%|████████████████████▏                         | 98/224 [00:50<01:04,  1.96it/s]
Epoch 2 Iter 99: loss 0.23075. :  44%|████████████████████▎                         | 99/224 [00:50<01:04,  1.95it/s]
Epoch 2 Iter 100: loss 0.24607. :  44%|███████████████████▉                         | 99/224 [00:51<01:04,  1.95it/s]
Epoch 2 Iter 100: loss 0.24607. :  45%|███████████████████▋                        | 100/224 [00:51<01:03,  1.95it/s]
Epoch 2 Iter 101: loss 0.26476. :  45%|███████████████████▋                        | 100/224 [00:51<01:03,  1.95it/s]
Epoch 2 Iter 101: loss 0.26476. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.95it/s]
Epoch 2 Iter 102: loss 0.23559. :  45%|███████████████████▊                        | 101/224 [00:52<01:02,  1.95it/s]
Epoch 2 Iter 102: loss 0.23559. :  46%|████████████████████                        | 102/224 [00:52<01:02,  1.96it/s]
Epoch 2 Iter 103: loss 0.25945. :  46%|████████████████████                        | 102/224 [00:52<01:02,  1.96it/s]
Epoch 2 Iter 103: loss 0.25945. :  46%|████████████████████▏                       | 103/224 [00:52<01:02,  1.95it/s]
Epoch 2 Iter 104: loss 0.23712. :  46%|████████████████████▏                       | 103/224 [00:53<01:02,  1.95it/s]
Epoch 2 Iter 104: loss 0.23712. :  46%|████████████████████▍                       | 104/224 [00:53<01:01,  1.96it/s]
Epoch 2 Iter 105: loss 0.25374. :  46%|████████████████████▍                       | 104/224 [00:53<01:01,  1.96it/s]
Epoch 2 Iter 105: loss 0.25374. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.97it/s]
Epoch 2 Iter 106: loss 0.23742. :  47%|████████████████████▋                       | 105/224 [00:54<01:00,  1.97it/s]
Epoch 2 Iter 106: loss 0.23742. :  47%|████████████████████▊                       | 106/224 [00:54<00:59,  1.98it/s]
Epoch 2 Iter 107: loss 0.24384. :  47%|████████████████████▊                       | 106/224 [00:54<00:59,  1.98it/s]
Epoch 2 Iter 107: loss 0.24384. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  1.99it/s]
Epoch 2 Iter 108: loss 0.24987. :  48%|█████████████████████                       | 107/224 [00:55<00:58,  1.99it/s]
Epoch 2 Iter 108: loss 0.24987. :  48%|█████████████████████▏                      | 108/224 [00:55<00:58,  1.98it/s]
Epoch 2 Iter 109: loss 0.24090. :  48%|█████████████████████▏                      | 108/224 [00:55<00:58,  1.98it/s]
Epoch 2 Iter 109: loss 0.24090. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.98it/s]
Epoch 2 Iter 110: loss 0.24467. :  49%|█████████████████████▍                      | 109/224 [00:56<00:58,  1.98it/s]
Epoch 2 Iter 110: loss 0.24467. :  49%|█████████████████████▌                      | 110/224 [00:56<00:57,  1.97it/s]
Epoch 2 Iter 111: loss 0.23249. :  49%|█████████████████████▌                      | 110/224 [00:56<00:57,  1.97it/s]
Epoch 2 Iter 111: loss 0.23249. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.97it/s]
Epoch 2 Iter 112: loss 0.26580. :  50%|█████████████████████▊                      | 111/224 [00:57<00:57,  1.97it/s]
Epoch 2 Iter 112: loss 0.26580. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.98it/s]
Epoch 2 Iter 113: loss 0.24823. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.98it/s]
Epoch 2 Iter 113: loss 0.24823. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.97it/s]
Epoch 2 Iter 114: loss 0.23800. :  50%|██████████████████████▏                     | 113/224 [00:58<00:56,  1.97it/s]
Epoch 2 Iter 114: loss 0.23800. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.98it/s]
Epoch 2 Iter 115: loss 0.23184. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.98it/s]
Epoch 2 Iter 115: loss 0.23184. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.98it/s]
Epoch 2 Iter 116: loss 0.24804. :  51%|██████████████████████▌                     | 115/224 [00:59<00:55,  1.98it/s]
Epoch 2 Iter 116: loss 0.24804. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.93it/s]
Epoch 2 Iter 117: loss 0.25138. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.93it/s]
Epoch 2 Iter 117: loss 0.25138. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.94it/s]
Epoch 2 Iter 118: loss 0.24899. :  52%|██████████████████████▉                     | 117/224 [01:00<00:55,  1.94it/s]
Epoch 2 Iter 118: loss 0.24899. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.95it/s]
Epoch 2 Iter 119: loss 0.23679. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.95it/s]
Epoch 2 Iter 119: loss 0.23679. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.96it/s]
Epoch 2 Iter 120: loss 0.25660. :  53%|███████████████████████▍                    | 119/224 [01:01<00:53,  1.96it/s]
Epoch 2 Iter 120: loss 0.25660. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.97it/s]
Epoch 2 Iter 121: loss 0.22615. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.97it/s]
Epoch 2 Iter 121: loss 0.22615. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.96it/s]
Epoch 2 Iter 122: loss 0.24605. :  54%|███████████████████████▊                    | 121/224 [01:02<00:52,  1.96it/s]
Epoch 2 Iter 122: loss 0.24605. :  54%|███████████████████████▉                    | 122/224 [01:02<00:52,  1.95it/s]
Epoch 2 Iter 123: loss 0.23765. :  54%|███████████████████████▉                    | 122/224 [01:02<00:52,  1.95it/s]
Epoch 2 Iter 123: loss 0.23765. :  55%|████████████████████████▏                   | 123/224 [01:02<00:53,  1.90it/s]
Epoch 2 Iter 124: loss 0.22568. :  55%|████████████████████████▏                   | 123/224 [01:03<00:53,  1.90it/s]
Epoch 2 Iter 124: loss 0.22568. :  55%|████████████████████████▎                   | 124/224 [01:03<00:51,  1.93it/s]
Epoch 2 Iter 125: loss 0.25227. :  55%|████████████████████████▎                   | 124/224 [01:03<00:51,  1.93it/s]
Epoch 2 Iter 125: loss 0.25227. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.95it/s]
Epoch 2 Iter 126: loss 0.24039. :  56%|████████████████████████▌                   | 125/224 [01:04<00:50,  1.95it/s]
Epoch 2 Iter 126: loss 0.24039. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.99it/s]
Epoch 2 Iter 127: loss 0.22179. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.99it/s]
Epoch 2 Iter 127: loss 0.22179. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.01it/s]
Epoch 2 Iter 128: loss 0.24608. :  57%|████████████████████████▉                   | 127/224 [01:05<00:48,  2.01it/s]
Epoch 2 Iter 128: loss 0.24608. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.98it/s]
Epoch 2 Iter 129: loss 0.22117. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.98it/s]
Epoch 2 Iter 129: loss 0.22117. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:48,  1.98it/s]
Epoch 2 Iter 130: loss 0.25471. :  58%|█████████████████████████▎                  | 129/224 [01:06<00:48,  1.98it/s]
Epoch 2 Iter 130: loss 0.25471. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:47,  1.98it/s]
Epoch 2 Iter 131: loss 0.24245. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:47,  1.98it/s]
Epoch 2 Iter 131: loss 0.24245. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  1.98it/s]
Epoch 2 Iter 132: loss 0.23647. :  58%|█████████████████████████▋                  | 131/224 [01:07<00:46,  1.98it/s]
Epoch 2 Iter 132: loss 0.23647. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:46,  1.98it/s]
Epoch 2 Iter 133: loss 0.22444. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:46,  1.98it/s]
Epoch 2 Iter 133: loss 0.22444. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.98it/s]
Epoch 2 Iter 134: loss 0.24789. :  59%|██████████████████████████▏                 | 133/224 [01:08<00:45,  1.98it/s]
Epoch 2 Iter 134: loss 0.24789. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.99it/s]
Epoch 2 Iter 135: loss 0.24276. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.99it/s]
Epoch 2 Iter 135: loss 0.24276. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  2.00it/s]
Epoch 2 Iter 136: loss 0.21843. :  60%|██████████████████████████▌                 | 135/224 [01:09<00:44,  2.00it/s]
Epoch 2 Iter 136: loss 0.21843. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 137: loss 0.23879. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 137: loss 0.23879. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 138: loss 0.23905. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:43,  2.01it/s]
Epoch 2 Iter 138: loss 0.23905. :  62%|███████████████████████████                 | 138/224 [01:10<00:42,  2.00it/s]
Epoch 2 Iter 139: loss 0.24803. :  62%|███████████████████████████                 | 138/224 [01:10<00:42,  2.00it/s]
Epoch 2 Iter 139: loss 0.24803. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.02it/s]
Epoch 2 Iter 140: loss 0.23470. :  62%|███████████████████████████▎                | 139/224 [01:11<00:42,  2.02it/s]
Epoch 2 Iter 140: loss 0.23470. :  62%|███████████████████████████▌                | 140/224 [01:11<00:41,  2.04it/s]
Epoch 2 Iter 141: loss 0.22226. :  62%|███████████████████████████▌                | 140/224 [01:11<00:41,  2.04it/s]
Epoch 2 Iter 141: loss 0.22226. :  63%|███████████████████████████▋                | 141/224 [01:11<00:40,  2.03it/s]
Epoch 2 Iter 142: loss 0.23802. :  63%|███████████████████████████▋                | 141/224 [01:12<00:40,  2.03it/s]
Epoch 2 Iter 142: loss 0.23802. :  63%|███████████████████████████▉                | 142/224 [01:12<00:40,  2.03it/s]
Epoch 2 Iter 143: loss 0.24625. :  63%|███████████████████████████▉                | 142/224 [01:12<00:40,  2.03it/s]
Epoch 2 Iter 143: loss 0.24625. :  64%|████████████████████████████                | 143/224 [01:12<00:39,  2.03it/s]
Epoch 2 Iter 144: loss 0.22634. :  64%|████████████████████████████                | 143/224 [01:13<00:39,  2.03it/s]
Epoch 2 Iter 144: loss 0.22634. :  64%|████████████████████████████▎               | 144/224 [01:13<00:39,  2.03it/s]
Epoch 2 Iter 145: loss 0.22556. :  64%|████████████████████████████▎               | 144/224 [01:13<00:39,  2.03it/s]
Epoch 2 Iter 145: loss 0.22556. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.03it/s]
Epoch 2 Iter 146: loss 0.25020. :  65%|████████████████████████████▍               | 145/224 [01:14<00:39,  2.03it/s]
Epoch 2 Iter 146: loss 0.25020. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.02it/s]
Epoch 2 Iter 147: loss 0.23912. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.02it/s]
Epoch 2 Iter 147: loss 0.23912. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.02it/s]
Epoch 2 Iter 148: loss 0.24080. :  66%|████████████████████████████▉               | 147/224 [01:15<00:38,  2.02it/s]
Epoch 2 Iter 148: loss 0.24080. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.03it/s]
Epoch 2 Iter 149: loss 0.24977. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.03it/s]
Epoch 2 Iter 149: loss 0.24977. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.02it/s]
Epoch 2 Iter 150: loss 0.24071. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:37,  2.02it/s]
Epoch 2 Iter 150: loss 0.24071. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.02it/s]
Epoch 2 Iter 151: loss 0.25003. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.02it/s]
Epoch 2 Iter 151: loss 0.25003. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.02it/s]
Epoch 2 Iter 152: loss 0.21905. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:36,  2.02it/s]
Epoch 2 Iter 152: loss 0.21905. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.02it/s]
Epoch 2 Iter 153: loss 0.25849. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.02it/s]
Epoch 2 Iter 153: loss 0.25849. :  68%|██████████████████████████████              | 153/224 [01:17<00:34,  2.03it/s]
Epoch 2 Iter 154: loss 0.25916. :  68%|██████████████████████████████              | 153/224 [01:18<00:34,  2.03it/s]
Epoch 2 Iter 154: loss 0.25916. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:34,  2.04it/s]
Epoch 2 Iter 155: loss 0.26884. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:34,  2.04it/s]
Epoch 2 Iter 155: loss 0.26884. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:33,  2.03it/s]
Epoch 2 Iter 156: loss 0.25044. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:33,  2.03it/s]
Epoch 2 Iter 156: loss 0.25044. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.03it/s]
Epoch 2 Iter 157: loss 0.24901. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.03it/s]
Epoch 2 Iter 157: loss 0.24901. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.03it/s]
Epoch 2 Iter 158: loss 0.25055. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:33,  2.03it/s]
Epoch 2 Iter 158: loss 0.25055. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.02it/s]
Epoch 2 Iter 159: loss 0.26363. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.02it/s]
Epoch 2 Iter 159: loss 0.26363. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.01it/s]
Epoch 2 Iter 160: loss 0.23062. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:32,  2.01it/s]
Epoch 2 Iter 160: loss 0.23062. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.02it/s]
Epoch 2 Iter 161: loss 0.23921. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.02it/s]
Epoch 2 Iter 161: loss 0.23921. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.99it/s]
Epoch 2 Iter 162: loss 0.24394. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:31,  1.99it/s]
Epoch 2 Iter 162: loss 0.24394. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:30,  2.00it/s]
Epoch 2 Iter 163: loss 0.26377. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:30,  2.00it/s]
Epoch 2 Iter 163: loss 0.26377. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.00it/s]
Epoch 2 Iter 164: loss 0.21819. :  73%|████████████████████████████████            | 163/224 [01:23<00:30,  2.00it/s]
Epoch 2 Iter 164: loss 0.21819. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:29,  2.01it/s]
Epoch 2 Iter 165: loss 0.25095. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:29,  2.01it/s]
Epoch 2 Iter 165: loss 0.25095. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  2.01it/s]
Epoch 2 Iter 166: loss 0.23594. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:29,  2.01it/s]
Epoch 2 Iter 166: loss 0.23594. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:28,  2.02it/s]
Epoch 2 Iter 167: loss 0.24282. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:28,  2.02it/s]
Epoch 2 Iter 167: loss 0.24282. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  2.02it/s]
Epoch 2 Iter 168: loss 0.22697. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:28,  2.02it/s]
Epoch 2 Iter 168: loss 0.22697. :  75%|█████████████████████████████████           | 168/224 [01:25<00:27,  2.03it/s]
Epoch 2 Iter 169: loss 0.22492. :  75%|█████████████████████████████████           | 168/224 [01:25<00:27,  2.03it/s]
Epoch 2 Iter 169: loss 0.22492. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:26,  2.04it/s]
Epoch 2 Iter 170: loss 0.23170. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:26,  2.04it/s]
Epoch 2 Iter 170: loss 0.23170. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.04it/s]
Epoch 2 Iter 171: loss 0.23436. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.04it/s]
Epoch 2 Iter 171: loss 0.23436. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  2.03it/s]
Epoch 2 Iter 172: loss 0.22273. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  2.03it/s]
Epoch 2 Iter 172: loss 0.22273. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.03it/s]
Epoch 2 Iter 173: loss 0.22643. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.03it/s]
Epoch 2 Iter 173: loss 0.22643. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:24,  2.05it/s]
Epoch 2 Iter 174: loss 0.24304. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:24,  2.05it/s]
Epoch 2 Iter 174: loss 0.24304. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.04it/s]
Epoch 2 Iter 175: loss 0.25043. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.04it/s]
Epoch 2 Iter 175: loss 0.25043. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.03it/s]
Epoch 2 Iter 176: loss 0.24022. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  2.03it/s]
Epoch 2 Iter 176: loss 0.24022. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.03it/s]
Epoch 2 Iter 177: loss 0.21480. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.03it/s]
Epoch 2 Iter 177: loss 0.21480. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.04it/s]
Epoch 2 Iter 178: loss 0.22860. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  2.04it/s]
Epoch 2 Iter 178: loss 0.22860. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.04it/s]
Epoch 2 Iter 179: loss 0.24241. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.04it/s]
Epoch 2 Iter 179: loss 0.24241. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.03it/s]
Epoch 2 Iter 180: loss 0.28828. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  2.03it/s]
Epoch 2 Iter 180: loss 0.28828. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.04it/s]
Epoch 2 Iter 181: loss 0.23356. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.04it/s]
Epoch 2 Iter 181: loss 0.23356. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.03it/s]
Epoch 2 Iter 182: loss 0.23860. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  2.03it/s]
Epoch 2 Iter 182: loss 0.23860. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.03it/s]
Epoch 2 Iter 183: loss 0.22764. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.03it/s]
Epoch 2 Iter 183: loss 0.22764. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.03it/s]
Epoch 2 Iter 184: loss 0.24355. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  2.03it/s]
Epoch 2 Iter 184: loss 0.24355. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:19,  2.02it/s]
Epoch 2 Iter 185: loss 0.25940. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:19,  2.02it/s]
Epoch 2 Iter 185: loss 0.25940. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  2.02it/s]
Epoch 2 Iter 186: loss 0.22721. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  2.02it/s]
Epoch 2 Iter 186: loss 0.22721. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:18,  2.02it/s]
Epoch 2 Iter 187: loss 0.22295. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:18,  2.02it/s]
Epoch 2 Iter 187: loss 0.22295. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  2.01it/s]
Epoch 2 Iter 188: loss 0.25954. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  2.01it/s]
Epoch 2 Iter 188: loss 0.25954. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:17,  2.02it/s]
Epoch 2 Iter 189: loss 0.25369. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:17,  2.02it/s]
Epoch 2 Iter 189: loss 0.25369. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  2.03it/s]
Epoch 2 Iter 190: loss 0.24004. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  2.03it/s]
Epoch 2 Iter 190: loss 0.24004. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:16,  2.03it/s]
Epoch 2 Iter 191: loss 0.26320. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:16,  2.03it/s]
Epoch 2 Iter 191: loss 0.26320. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  2.03it/s]
Epoch 2 Iter 192: loss 0.24256. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  2.03it/s]
Epoch 2 Iter 192: loss 0.24256. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:15,  2.02it/s]
Epoch 2 Iter 193: loss 0.22433. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:15,  2.02it/s]
Epoch 2 Iter 193: loss 0.22433. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.02it/s]
Epoch 2 Iter 194: loss 0.23493. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  2.02it/s]
Epoch 2 Iter 194: loss 0.23493. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.01it/s]
Epoch 2 Iter 195: loss 0.25253. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.01it/s]
Epoch 2 Iter 195: loss 0.25253. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.02it/s]
Epoch 2 Iter 196: loss 0.25472. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  2.02it/s]
Epoch 2 Iter 196: loss 0.25472. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.02it/s]
Epoch 2 Iter 197: loss 0.24967. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.02it/s]
Epoch 2 Iter 197: loss 0.24967. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.01it/s]
Epoch 2 Iter 198: loss 0.24814. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  2.01it/s]
Epoch 2 Iter 198: loss 0.24814. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.00it/s]
Epoch 2 Iter 199: loss 0.22308. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.00it/s]
Epoch 2 Iter 199: loss 0.22308. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.01it/s]
Epoch 2 Iter 200: loss 0.25785. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  2.01it/s]
Epoch 2 Iter 200: loss 0.25785. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.01it/s]
Epoch 2 Iter 201: loss 0.24871. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.01it/s]
Epoch 2 Iter 201: loss 0.24871. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  2.02it/s]
Epoch 2 Iter 202: loss 0.22501. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  2.02it/s]
Epoch 2 Iter 202: loss 0.22501. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.01it/s]
Epoch 2 Iter 203: loss 0.23121. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.01it/s]
Epoch 2 Iter 203: loss 0.23121. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.02it/s]
Epoch 2 Iter 204: loss 0.25915. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.02it/s]
Epoch 2 Iter 204: loss 0.25915. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.02it/s]
Epoch 2 Iter 205: loss 0.23696. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.02it/s]
Epoch 2 Iter 205: loss 0.23696. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.01it/s]
Epoch 2 Iter 206: loss 0.25211. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.01it/s]
Epoch 2 Iter 206: loss 0.25211. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.02it/s]
Epoch 2 Iter 207: loss 0.25611. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.02it/s]
Epoch 2 Iter 207: loss 0.25611. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.03it/s]
Epoch 2 Iter 208: loss 0.21662. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.03it/s]
Epoch 2 Iter 208: loss 0.21662. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:07,  2.02it/s]
Epoch 2 Iter 209: loss 0.23824. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 2 Iter 209: loss 0.23824. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.02it/s]
Epoch 2 Iter 210: loss 0.25643. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.02it/s]
Epoch 2 Iter 210: loss 0.25643. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:06,  2.01it/s]
Epoch 2 Iter 211: loss 0.23586. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 2 Iter 211: loss 0.23586. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.02it/s]
Epoch 2 Iter 212: loss 0.23517. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.02it/s]
Epoch 2 Iter 212: loss 0.23517. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.02it/s]
Epoch 2 Iter 213: loss 0.26707. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 2 Iter 213: loss 0.26707. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.03it/s]
Epoch 2 Iter 214: loss 0.21726. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.03it/s]
Epoch 2 Iter 214: loss 0.21726. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:04,  2.04it/s]
Epoch 2 Iter 215: loss 0.26600. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.04it/s]
Epoch 2 Iter 215: loss 0.26600. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.04it/s]
Epoch 2 Iter 216: loss 0.24469. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.04it/s]
Epoch 2 Iter 216: loss 0.24469. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:03,  2.03it/s]
Epoch 2 Iter 217: loss 0.22576. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.03it/s]
Epoch 2 Iter 217: loss 0.22576. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.03it/s]
Epoch 2 Iter 218: loss 0.25011. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.03it/s]
Epoch 2 Iter 218: loss 0.25011. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.03it/s]
Epoch 2 Iter 219: loss 0.21672. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.03it/s]
Epoch 2 Iter 219: loss 0.21672. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.02it/s]
Epoch 2 Iter 220: loss 0.24156. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.02it/s]
Epoch 2 Iter 220: loss 0.24156. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 2 Iter 221: loss 0.24617. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.99it/s]
Epoch 2 Iter 221: loss 0.24617. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.00it/s]
Epoch 2 Iter 222: loss 0.23626. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.00it/s]
Epoch 2 Iter 222: loss 0.23626. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.00it/s]
Epoch 2 Iter 223: loss 0.26124. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.00it/s]
Epoch 2 Iter 223: loss 0.26124. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.00it/s]
Epoch 2 Iter 224: loss 0.23373. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.00it/s]
Epoch 2 Iter 224: loss 0.23373. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  2.00it/s]
Epoch 2 Iter 224: loss 0.23373. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  1.98it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.25075. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.25075. :   0%|▏                                               | 1/224 [00:00<01:54,  1.95it/s]
Epoch 3 Iter 2: loss 0.25863. :   0%|▏                                               | 1/224 [00:01<01:54,  1.95it/s]
Epoch 3 Iter 2: loss 0.25863. :   1%|▍                                               | 2/224 [00:01<02:01,  1.82it/s]
Epoch 3 Iter 3: loss 0.23658. :   1%|▍                                               | 2/224 [00:01<02:01,  1.82it/s]
Epoch 3 Iter 3: loss 0.23658. :   1%|▋                                               | 3/224 [00:01<01:59,  1.85it/s]
Epoch 3 Iter 4: loss 0.24184. :   1%|▋                                               | 3/224 [00:02<01:59,  1.85it/s]
Epoch 3 Iter 4: loss 0.24184. :   2%|▊                                               | 4/224 [00:02<01:57,  1.87it/s]
Epoch 3 Iter 5: loss 0.24308. :   2%|▊                                               | 4/224 [00:02<01:57,  1.87it/s]
Epoch 3 Iter 5: loss 0.24308. :   2%|█                                               | 5/224 [00:02<01:56,  1.87it/s]
Epoch 3 Iter 6: loss 0.24215. :   2%|█                                               | 5/224 [00:03<01:56,  1.87it/s]
Epoch 3 Iter 6: loss 0.24215. :   3%|█▎                                              | 6/224 [00:03<01:54,  1.91it/s]
Epoch 3 Iter 7: loss 0.23972. :   3%|█▎                                              | 6/224 [00:03<01:54,  1.91it/s]
Epoch 3 Iter 7: loss 0.23972. :   3%|█▌                                              | 7/224 [00:03<01:52,  1.93it/s]
Epoch 3 Iter 8: loss 0.23387. :   3%|█▌                                              | 7/224 [00:04<01:52,  1.93it/s]
Epoch 3 Iter 8: loss 0.23387. :   4%|█▋                                              | 8/224 [00:04<01:50,  1.95it/s]
Epoch 3 Iter 9: loss 0.23301. :   4%|█▋                                              | 8/224 [00:04<01:50,  1.95it/s]
Epoch 3 Iter 9: loss 0.23301. :   4%|█▉                                              | 9/224 [00:04<01:49,  1.96it/s]
Epoch 3 Iter 10: loss 0.22750. :   4%|█▉                                             | 9/224 [00:05<01:49,  1.96it/s]
Epoch 3 Iter 10: loss 0.22750. :   4%|██                                            | 10/224 [00:05<01:48,  1.96it/s]
Epoch 3 Iter 11: loss 0.27550. :   4%|██                                            | 10/224 [00:05<01:48,  1.96it/s]
Epoch 3 Iter 11: loss 0.27550. :   5%|██▎                                           | 11/224 [00:05<01:48,  1.96it/s]
Epoch 3 Iter 12: loss 0.21860. :   5%|██▎                                           | 11/224 [00:06<01:48,  1.96it/s]
Epoch 3 Iter 12: loss 0.21860. :   5%|██▍                                           | 12/224 [00:06<01:47,  1.97it/s]
Epoch 3 Iter 13: loss 0.24543. :   5%|██▍                                           | 12/224 [00:06<01:47,  1.97it/s]
Epoch 3 Iter 13: loss 0.24543. :   6%|██▋                                           | 13/224 [00:06<01:46,  1.98it/s]
Epoch 3 Iter 14: loss 0.22625. :   6%|██▋                                           | 13/224 [00:07<01:46,  1.98it/s]
Epoch 3 Iter 14: loss 0.22625. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.98it/s]
Epoch 3 Iter 15: loss 0.25967. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.98it/s]
Epoch 3 Iter 15: loss 0.25967. :   7%|███                                           | 15/224 [00:07<01:44,  1.99it/s]
Epoch 3 Iter 16: loss 0.26091. :   7%|███                                           | 15/224 [00:08<01:44,  1.99it/s]
Epoch 3 Iter 16: loss 0.26091. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 3 Iter 17: loss 0.22977. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 3 Iter 17: loss 0.22977. :   8%|███▍                                          | 17/224 [00:08<01:44,  1.98it/s]
Epoch 3 Iter 18: loss 0.22668. :   8%|███▍                                          | 17/224 [00:09<01:44,  1.98it/s]
Epoch 3 Iter 18: loss 0.22668. :   8%|███▋                                          | 18/224 [00:09<01:49,  1.88it/s]
Epoch 3 Iter 19: loss 0.23961. :   8%|███▋                                          | 18/224 [00:09<01:49,  1.88it/s]
Epoch 3 Iter 19: loss 0.23961. :   8%|███▉                                          | 19/224 [00:09<01:49,  1.88it/s]
Epoch 3 Iter 20: loss 0.24095. :   8%|███▉                                          | 19/224 [00:10<01:49,  1.88it/s]
Epoch 3 Iter 20: loss 0.24095. :   9%|████                                          | 20/224 [00:10<01:46,  1.92it/s]
Epoch 3 Iter 21: loss 0.26218. :   9%|████                                          | 20/224 [00:10<01:46,  1.92it/s]
Epoch 3 Iter 21: loss 0.26218. :   9%|████▎                                         | 21/224 [00:10<01:43,  1.95it/s]
Epoch 3 Iter 22: loss 0.23185. :   9%|████▎                                         | 21/224 [00:11<01:43,  1.95it/s]
Epoch 3 Iter 22: loss 0.23185. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.98it/s]
Epoch 3 Iter 23: loss 0.25738. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.98it/s]
Epoch 3 Iter 23: loss 0.25738. :  10%|████▋                                         | 23/224 [00:11<01:41,  1.99it/s]
Epoch 3 Iter 24: loss 0.21969. :  10%|████▋                                         | 23/224 [00:12<01:41,  1.99it/s]
Epoch 3 Iter 24: loss 0.21969. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.98it/s]
Epoch 3 Iter 25: loss 0.24190. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.98it/s]
Epoch 3 Iter 25: loss 0.24190. :  11%|█████▏                                        | 25/224 [00:12<01:40,  1.99it/s]
Epoch 3 Iter 26: loss 0.24270. :  11%|█████▏                                        | 25/224 [00:13<01:40,  1.99it/s]
Epoch 3 Iter 26: loss 0.24270. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 3 Iter 27: loss 0.24138. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 3 Iter 27: loss 0.24138. :  12%|█████▌                                        | 27/224 [00:13<01:38,  1.99it/s]
Epoch 3 Iter 28: loss 0.23578. :  12%|█████▌                                        | 27/224 [00:14<01:38,  1.99it/s]
Epoch 3 Iter 28: loss 0.23578. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.00it/s]
Epoch 3 Iter 29: loss 0.22351. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.00it/s]
Epoch 3 Iter 29: loss 0.22351. :  13%|█████▉                                        | 29/224 [00:14<01:37,  2.00it/s]
Epoch 3 Iter 30: loss 0.24643. :  13%|█████▉                                        | 29/224 [00:15<01:37,  2.00it/s]
Epoch 3 Iter 30: loss 0.24643. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 3 Iter 31: loss 0.24679. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 3 Iter 31: loss 0.24679. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 3 Iter 32: loss 0.22851. :  14%|██████▎                                       | 31/224 [00:16<01:35,  2.02it/s]
Epoch 3 Iter 32: loss 0.22851. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.01it/s]
Epoch 3 Iter 33: loss 0.22460. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.01it/s]
Epoch 3 Iter 33: loss 0.22460. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.98it/s]
Epoch 3 Iter 34: loss 0.24260. :  15%|██████▊                                       | 33/224 [00:17<01:36,  1.98it/s]
Epoch 3 Iter 34: loss 0.24260. :  15%|██████▉                                       | 34/224 [00:17<01:35,  2.00it/s]
Epoch 3 Iter 35: loss 0.21577. :  15%|██████▉                                       | 34/224 [00:17<01:35,  2.00it/s]
Epoch 3 Iter 35: loss 0.21577. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 3 Iter 36: loss 0.24618. :  16%|███████▏                                      | 35/224 [00:18<01:34,  2.00it/s]
Epoch 3 Iter 36: loss 0.24618. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 3 Iter 37: loss 0.24851. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 3 Iter 37: loss 0.24851. :  17%|███████▌                                      | 37/224 [00:18<01:33,  2.01it/s]
Epoch 3 Iter 38: loss 0.24824. :  17%|███████▌                                      | 37/224 [00:19<01:33,  2.01it/s]
Epoch 3 Iter 38: loss 0.24824. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 3 Iter 39: loss 0.24045. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 3 Iter 39: loss 0.24045. :  17%|████████                                      | 39/224 [00:19<01:35,  1.95it/s]
Epoch 3 Iter 40: loss 0.24891. :  17%|████████                                      | 39/224 [00:20<01:35,  1.95it/s]
Epoch 3 Iter 40: loss 0.24891. :  18%|████████▏                                     | 40/224 [00:20<01:36,  1.91it/s]
Epoch 3 Iter 41: loss 0.24741. :  18%|████████▏                                     | 40/224 [00:20<01:36,  1.91it/s]
Epoch 3 Iter 41: loss 0.24741. :  18%|████████▍                                     | 41/224 [00:20<01:36,  1.90it/s]
Epoch 3 Iter 42: loss 0.23262. :  18%|████████▍                                     | 41/224 [00:21<01:36,  1.90it/s]
Epoch 3 Iter 42: loss 0.23262. :  19%|████████▋                                     | 42/224 [00:21<01:35,  1.90it/s]
Epoch 3 Iter 43: loss 0.23503. :  19%|████████▋                                     | 42/224 [00:21<01:35,  1.90it/s]
Epoch 3 Iter 43: loss 0.23503. :  19%|████████▊                                     | 43/224 [00:21<01:34,  1.91it/s]
Epoch 3 Iter 44: loss 0.23276. :  19%|████████▊                                     | 43/224 [00:22<01:34,  1.91it/s]
Epoch 3 Iter 44: loss 0.23276. :  20%|█████████                                     | 44/224 [00:22<01:33,  1.92it/s]
Epoch 3 Iter 45: loss 0.24229. :  20%|█████████                                     | 44/224 [00:23<01:33,  1.92it/s]
Epoch 3 Iter 45: loss 0.24229. :  20%|█████████▏                                    | 45/224 [00:23<01:32,  1.94it/s]
Epoch 3 Iter 46: loss 0.25053. :  20%|█████████▏                                    | 45/224 [00:23<01:32,  1.94it/s]
Epoch 3 Iter 46: loss 0.25053. :  21%|█████████▍                                    | 46/224 [00:23<01:31,  1.94it/s]
Epoch 3 Iter 47: loss 0.23235. :  21%|█████████▍                                    | 46/224 [00:24<01:31,  1.94it/s]
Epoch 3 Iter 47: loss 0.23235. :  21%|█████████▋                                    | 47/224 [00:24<01:30,  1.95it/s]
Epoch 3 Iter 48: loss 0.26613. :  21%|█████████▋                                    | 47/224 [00:24<01:30,  1.95it/s]
Epoch 3 Iter 48: loss 0.26613. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 3 Iter 49: loss 0.23804. :  21%|█████████▊                                    | 48/224 [00:25<01:30,  1.95it/s]
Epoch 3 Iter 49: loss 0.23804. :  22%|██████████                                    | 49/224 [00:25<01:31,  1.92it/s]
Epoch 3 Iter 50: loss 0.24043. :  22%|██████████                                    | 49/224 [00:25<01:31,  1.92it/s]
Epoch 3 Iter 50: loss 0.24043. :  22%|██████████▎                                   | 50/224 [00:25<01:29,  1.95it/s]
Epoch 3 Iter 51: loss 0.24964. :  22%|██████████▎                                   | 50/224 [00:26<01:29,  1.95it/s]
Epoch 3 Iter 51: loss 0.24964. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.97it/s]
Epoch 3 Iter 52: loss 0.24973. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.97it/s]
Epoch 3 Iter 52: loss 0.24973. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.98it/s]
Epoch 3 Iter 53: loss 0.23247. :  23%|██████████▋                                   | 52/224 [00:27<01:26,  1.98it/s]
Epoch 3 Iter 53: loss 0.23247. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  1.99it/s]
Epoch 3 Iter 54: loss 0.23318. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  1.99it/s]
Epoch 3 Iter 54: loss 0.23318. :  24%|███████████                                   | 54/224 [00:27<01:25,  2.00it/s]
Epoch 3 Iter 55: loss 0.21675. :  24%|███████████                                   | 54/224 [00:28<01:25,  2.00it/s]
Epoch 3 Iter 55: loss 0.21675. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  1.99it/s]
Epoch 3 Iter 56: loss 0.23426. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  1.99it/s]
Epoch 3 Iter 56: loss 0.23426. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  2.00it/s]
Epoch 3 Iter 57: loss 0.23696. :  25%|███████████▌                                  | 56/224 [00:29<01:24,  2.00it/s]
Epoch 3 Iter 57: loss 0.23696. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 3 Iter 58: loss 0.23211. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 3 Iter 58: loss 0.23211. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 3 Iter 59: loss 0.24318. :  26%|███████████▉                                  | 58/224 [00:30<01:23,  1.99it/s]
Epoch 3 Iter 59: loss 0.24318. :  26%|████████████                                  | 59/224 [00:30<01:22,  2.00it/s]
Epoch 3 Iter 60: loss 0.24121. :  26%|████████████                                  | 59/224 [00:30<01:22,  2.00it/s]
Epoch 3 Iter 60: loss 0.24121. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 3 Iter 61: loss 0.22836. :  27%|████████████▎                                 | 60/224 [00:31<01:21,  2.00it/s]
Epoch 3 Iter 61: loss 0.22836. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.01it/s]
Epoch 3 Iter 62: loss 0.25253. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.01it/s]
Epoch 3 Iter 62: loss 0.25253. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 3 Iter 63: loss 0.23891. :  28%|████████████▋                                 | 62/224 [00:32<01:20,  2.01it/s]
Epoch 3 Iter 63: loss 0.23891. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.01it/s]
Epoch 3 Iter 64: loss 0.25206. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.01it/s]
Epoch 3 Iter 64: loss 0.25206. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.01it/s]
Epoch 3 Iter 65: loss 0.25811. :  29%|█████████████▏                                | 64/224 [00:33<01:19,  2.01it/s]
Epoch 3 Iter 65: loss 0.25811. :  29%|█████████████▎                                | 65/224 [00:33<01:19,  2.00it/s]
Epoch 3 Iter 66: loss 0.22000. :  29%|█████████████▎                                | 65/224 [00:33<01:19,  2.00it/s]
Epoch 3 Iter 66: loss 0.22000. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 3 Iter 67: loss 0.24166. :  29%|█████████████▌                                | 66/224 [00:34<01:18,  2.01it/s]
Epoch 3 Iter 67: loss 0.24166. :  30%|█████████████▊                                | 67/224 [00:34<01:18,  2.01it/s]
Epoch 3 Iter 68: loss 0.24360. :  30%|█████████████▊                                | 67/224 [00:34<01:18,  2.01it/s]
Epoch 3 Iter 68: loss 0.24360. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.01it/s]
Epoch 3 Iter 69: loss 0.23522. :  30%|█████████████▉                                | 68/224 [00:35<01:17,  2.01it/s]
Epoch 3 Iter 69: loss 0.23522. :  31%|██████████████▏                               | 69/224 [00:35<01:17,  2.00it/s]
Epoch 3 Iter 70: loss 0.21908. :  31%|██████████████▏                               | 69/224 [00:35<01:17,  2.00it/s]
Epoch 3 Iter 70: loss 0.21908. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.99it/s]
Epoch 3 Iter 71: loss 0.23206. :  31%|██████████████▍                               | 70/224 [00:36<01:17,  1.99it/s]
Epoch 3 Iter 71: loss 0.23206. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  1.99it/s]
Epoch 3 Iter 72: loss 0.23937. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  1.99it/s]
Epoch 3 Iter 72: loss 0.23937. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 3 Iter 73: loss 0.24646. :  32%|██████████████▊                               | 72/224 [00:37<01:15,  2.01it/s]
Epoch 3 Iter 73: loss 0.24646. :  33%|██████████████▉                               | 73/224 [00:37<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.23665. :  33%|██████████████▉                               | 73/224 [00:37<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.23665. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 3 Iter 75: loss 0.24468. :  33%|███████████████▏                              | 74/224 [00:38<01:14,  2.01it/s]
Epoch 3 Iter 75: loss 0.24468. :  33%|███████████████▍                              | 75/224 [00:38<01:17,  1.93it/s]
Epoch 3 Iter 76: loss 0.25037. :  33%|███████████████▍                              | 75/224 [00:38<01:17,  1.93it/s]
Epoch 3 Iter 76: loss 0.25037. :  34%|███████████████▌                              | 76/224 [00:38<01:17,  1.91it/s]
Epoch 3 Iter 77: loss 0.24294. :  34%|███████████████▌                              | 76/224 [00:39<01:17,  1.91it/s]
Epoch 3 Iter 77: loss 0.24294. :  34%|███████████████▊                              | 77/224 [00:39<01:16,  1.91it/s]
Epoch 3 Iter 78: loss 0.24910. :  34%|███████████████▊                              | 77/224 [00:39<01:16,  1.91it/s]
Epoch 3 Iter 78: loss 0.24910. :  35%|████████████████                              | 78/224 [00:39<01:15,  1.95it/s]
Epoch 3 Iter 79: loss 0.24917. :  35%|████████████████                              | 78/224 [00:40<01:15,  1.95it/s]
Epoch 3 Iter 79: loss 0.24917. :  35%|████████████████▏                             | 79/224 [00:40<01:13,  1.96it/s]
Epoch 3 Iter 80: loss 0.25675. :  35%|████████████████▏                             | 79/224 [00:40<01:13,  1.96it/s]
Epoch 3 Iter 80: loss 0.25675. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  1.99it/s]
Epoch 3 Iter 81: loss 0.23668. :  36%|████████████████▍                             | 80/224 [00:41<01:12,  1.99it/s]
Epoch 3 Iter 81: loss 0.23668. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  2.00it/s]
Epoch 3 Iter 82: loss 0.22826. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  2.00it/s]
Epoch 3 Iter 82: loss 0.22826. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.00it/s]
Epoch 3 Iter 83: loss 0.24141. :  37%|████████████████▊                             | 82/224 [00:42<01:10,  2.00it/s]
Epoch 3 Iter 83: loss 0.24141. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.01it/s]
Epoch 3 Iter 84: loss 0.22489. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.01it/s]
Epoch 3 Iter 84: loss 0.22489. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.03it/s]
Epoch 3 Iter 85: loss 0.23956. :  38%|█████████████████▎                            | 84/224 [00:43<01:09,  2.03it/s]
Epoch 3 Iter 85: loss 0.23956. :  38%|█████████████████▍                            | 85/224 [00:43<01:08,  2.02it/s]
Epoch 3 Iter 86: loss 0.25214. :  38%|█████████████████▍                            | 85/224 [00:43<01:08,  2.02it/s]
Epoch 3 Iter 86: loss 0.25214. :  38%|█████████████████▋                            | 86/224 [00:43<01:07,  2.04it/s]
Epoch 3 Iter 87: loss 0.23577. :  38%|█████████████████▋                            | 86/224 [00:44<01:07,  2.04it/s]
Epoch 3 Iter 87: loss 0.23577. :  39%|█████████████████▊                            | 87/224 [00:44<01:07,  2.03it/s]
Epoch 3 Iter 88: loss 0.23924. :  39%|█████████████████▊                            | 87/224 [00:44<01:07,  2.03it/s]
Epoch 3 Iter 88: loss 0.23924. :  39%|██████████████████                            | 88/224 [00:44<01:06,  2.03it/s]
Epoch 3 Iter 89: loss 0.23288. :  39%|██████████████████                            | 88/224 [00:45<01:06,  2.03it/s]
Epoch 3 Iter 89: loss 0.23288. :  40%|██████████████████▎                           | 89/224 [00:45<01:06,  2.03it/s]
Epoch 3 Iter 90: loss 0.23297. :  40%|██████████████████▎                           | 89/224 [00:45<01:06,  2.03it/s]
Epoch 3 Iter 90: loss 0.23297. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.98it/s]
Epoch 3 Iter 91: loss 0.25021. :  40%|██████████████████▍                           | 90/224 [00:46<01:07,  1.98it/s]
Epoch 3 Iter 91: loss 0.25021. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.98it/s]
Epoch 3 Iter 92: loss 0.24526. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.98it/s]
Epoch 3 Iter 92: loss 0.24526. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.99it/s]
Epoch 3 Iter 93: loss 0.23101. :  41%|██████████████████▉                           | 92/224 [00:47<01:06,  1.99it/s]
Epoch 3 Iter 93: loss 0.23101. :  42%|███████████████████                           | 93/224 [00:47<01:05,  2.00it/s]
Epoch 3 Iter 94: loss 0.24174. :  42%|███████████████████                           | 93/224 [00:47<01:05,  2.00it/s]
Epoch 3 Iter 94: loss 0.24174. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.99it/s]
Epoch 3 Iter 95: loss 0.24441. :  42%|███████████████████▎                          | 94/224 [00:48<01:05,  1.99it/s]
Epoch 3 Iter 95: loss 0.24441. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 3 Iter 96: loss 0.24245. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 3 Iter 96: loss 0.24245. :  43%|███████████████████▋                          | 96/224 [00:48<01:06,  1.92it/s]
Epoch 3 Iter 97: loss 0.22700. :  43%|███████████████████▋                          | 96/224 [00:49<01:06,  1.92it/s]
Epoch 3 Iter 97: loss 0.22700. :  43%|███████████████████▉                          | 97/224 [00:49<01:09,  1.83it/s]
Epoch 3 Iter 98: loss 0.25408. :  43%|███████████████████▉                          | 97/224 [00:49<01:09,  1.83it/s]
Epoch 3 Iter 98: loss 0.25408. :  44%|████████████████████▏                         | 98/224 [00:49<01:09,  1.81it/s]
Epoch 3 Iter 99: loss 0.25293. :  44%|████████████████████▏                         | 98/224 [00:50<01:09,  1.81it/s]
Epoch 3 Iter 99: loss 0.25293. :  44%|████████████████████▎                         | 99/224 [00:50<01:07,  1.86it/s]
Epoch 3 Iter 100: loss 0.28028. :  44%|███████████████████▉                         | 99/224 [00:50<01:07,  1.86it/s]
Epoch 3 Iter 100: loss 0.28028. :  45%|███████████████████▋                        | 100/224 [00:50<01:04,  1.91it/s]
Epoch 3 Iter 101: loss 0.23658. :  45%|███████████████████▋                        | 100/224 [00:51<01:04,  1.91it/s]
Epoch 3 Iter 101: loss 0.23658. :  45%|███████████████████▊                        | 101/224 [00:51<01:03,  1.93it/s]
Epoch 3 Iter 102: loss 0.25458. :  45%|███████████████████▊                        | 101/224 [00:51<01:03,  1.93it/s]
Epoch 3 Iter 102: loss 0.25458. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 3 Iter 103: loss 0.23468. :  46%|████████████████████                        | 102/224 [00:52<01:02,  1.95it/s]
Epoch 3 Iter 103: loss 0.23468. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.98it/s]
Epoch 3 Iter 104: loss 0.22883. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.98it/s]
Epoch 3 Iter 104: loss 0.22883. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.98it/s]
Epoch 3 Iter 105: loss 0.24873. :  46%|████████████████████▍                       | 104/224 [00:53<01:00,  1.98it/s]
Epoch 3 Iter 105: loss 0.24873. :  47%|████████████████████▋                       | 105/224 [00:53<00:59,  2.00it/s]
Epoch 3 Iter 106: loss 0.22837. :  47%|████████████████████▋                       | 105/224 [00:53<00:59,  2.00it/s]
Epoch 3 Iter 106: loss 0.22837. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.99it/s]
Epoch 3 Iter 107: loss 0.24066. :  47%|████████████████████▊                       | 106/224 [00:54<00:59,  1.99it/s]
Epoch 3 Iter 107: loss 0.24066. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  2.00it/s]
Epoch 3 Iter 108: loss 0.25148. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  2.00it/s]
Epoch 3 Iter 108: loss 0.25148. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 3 Iter 109: loss 0.22916. :  48%|█████████████████████▏                      | 108/224 [00:55<00:57,  2.01it/s]
Epoch 3 Iter 109: loss 0.22916. :  49%|█████████████████████▍                      | 109/224 [00:55<00:57,  2.01it/s]
Epoch 3 Iter 110: loss 0.26462. :  49%|█████████████████████▍                      | 109/224 [00:55<00:57,  2.01it/s]
Epoch 3 Iter 110: loss 0.26462. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.02it/s]
Epoch 3 Iter 111: loss 0.23056. :  49%|█████████████████████▌                      | 110/224 [00:56<00:56,  2.02it/s]
Epoch 3 Iter 111: loss 0.23056. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  2.01it/s]
Epoch 3 Iter 112: loss 0.21683. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  2.01it/s]
Epoch 3 Iter 112: loss 0.21683. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.01it/s]
Epoch 3 Iter 113: loss 0.23020. :  50%|██████████████████████                      | 112/224 [00:57<00:55,  2.01it/s]
Epoch 3 Iter 113: loss 0.23020. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  2.01it/s]
Epoch 3 Iter 114: loss 0.23969. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  2.01it/s]
Epoch 3 Iter 114: loss 0.23969. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.01it/s]
Epoch 3 Iter 115: loss 0.24302. :  51%|██████████████████████▍                     | 114/224 [00:58<00:54,  2.01it/s]
Epoch 3 Iter 115: loss 0.24302. :  51%|██████████████████████▌                     | 115/224 [00:58<00:57,  1.88it/s]
Epoch 3 Iter 116: loss 0.24482. :  51%|██████████████████████▌                     | 115/224 [00:59<00:57,  1.88it/s]
Epoch 3 Iter 116: loss 0.24482. :  52%|██████████████████████▊                     | 116/224 [00:59<00:59,  1.83it/s]
Epoch 3 Iter 117: loss 0.24301. :  52%|██████████████████████▊                     | 116/224 [00:59<00:59,  1.83it/s]
Epoch 3 Iter 117: loss 0.24301. :  52%|██████████████████████▉                     | 117/224 [00:59<00:59,  1.81it/s]
Epoch 3 Iter 118: loss 0.23780. :  52%|██████████████████████▉                     | 117/224 [01:00<00:59,  1.81it/s]
Epoch 3 Iter 118: loss 0.23780. :  53%|███████████████████████▏                    | 118/224 [01:00<00:58,  1.81it/s]
Epoch 3 Iter 119: loss 0.23680. :  53%|███████████████████████▏                    | 118/224 [01:00<00:58,  1.81it/s]
Epoch 3 Iter 119: loss 0.23680. :  53%|███████████████████████▍                    | 119/224 [01:00<00:57,  1.84it/s]
Epoch 3 Iter 120: loss 0.23510. :  53%|███████████████████████▍                    | 119/224 [01:01<00:57,  1.84it/s]
Epoch 3 Iter 120: loss 0.23510. :  54%|███████████████████████▌                    | 120/224 [01:01<00:55,  1.89it/s]
Epoch 3 Iter 121: loss 0.24457. :  54%|███████████████████████▌                    | 120/224 [01:01<00:55,  1.89it/s]
Epoch 3 Iter 121: loss 0.24457. :  54%|███████████████████████▊                    | 121/224 [01:01<00:53,  1.91it/s]
Epoch 3 Iter 122: loss 0.24929. :  54%|███████████████████████▊                    | 121/224 [01:02<00:53,  1.91it/s]
Epoch 3 Iter 122: loss 0.24929. :  54%|███████████████████████▉                    | 122/224 [01:02<00:52,  1.94it/s]
Epoch 3 Iter 123: loss 0.24424. :  54%|███████████████████████▉                    | 122/224 [01:02<00:52,  1.94it/s]
Epoch 3 Iter 123: loss 0.24424. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.95it/s]
Epoch 3 Iter 124: loss 0.23601. :  55%|████████████████████████▏                   | 123/224 [01:03<00:51,  1.95it/s]
Epoch 3 Iter 124: loss 0.23601. :  55%|████████████████████████▎                   | 124/224 [01:03<00:50,  1.97it/s]
Epoch 3 Iter 125: loss 0.24385. :  55%|████████████████████████▎                   | 124/224 [01:03<00:50,  1.97it/s]
Epoch 3 Iter 125: loss 0.24385. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.98it/s]
Epoch 3 Iter 126: loss 0.23348. :  56%|████████████████████████▌                   | 125/224 [01:04<00:50,  1.98it/s]
Epoch 3 Iter 126: loss 0.23348. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.98it/s]
Epoch 3 Iter 127: loss 0.21375. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.98it/s]
Epoch 3 Iter 127: loss 0.21375. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  1.98it/s]
Epoch 3 Iter 128: loss 0.23282. :  57%|████████████████████████▉                   | 127/224 [01:05<00:48,  1.98it/s]
Epoch 3 Iter 128: loss 0.23282. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:50,  1.89it/s]
Epoch 3 Iter 129: loss 0.25975. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:50,  1.89it/s]
Epoch 3 Iter 129: loss 0.25975. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:50,  1.88it/s]
Epoch 3 Iter 130: loss 0.25173. :  58%|█████████████████████████▎                  | 129/224 [01:06<00:50,  1.88it/s]
Epoch 3 Iter 130: loss 0.25173. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:49,  1.90it/s]
Epoch 3 Iter 131: loss 0.23716. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:49,  1.90it/s]
Epoch 3 Iter 131: loss 0.23716. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:48,  1.92it/s]
Epoch 3 Iter 132: loss 0.22333. :  58%|█████████████████████████▋                  | 131/224 [01:07<00:48,  1.92it/s]
Epoch 3 Iter 132: loss 0.22333. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:47,  1.94it/s]
Epoch 3 Iter 133: loss 0.23223. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:47,  1.94it/s]
Epoch 3 Iter 133: loss 0.23223. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.97it/s]
Epoch 3 Iter 134: loss 0.24803. :  59%|██████████████████████████▏                 | 133/224 [01:08<00:46,  1.97it/s]
Epoch 3 Iter 134: loss 0.24803. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 3 Iter 135: loss 0.24991. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 3 Iter 135: loss 0.24991. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.99it/s]
Epoch 3 Iter 136: loss 0.23878. :  60%|██████████████████████████▌                 | 135/224 [01:09<00:44,  1.99it/s]
Epoch 3 Iter 136: loss 0.23878. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:43,  2.01it/s]
Epoch 3 Iter 137: loss 0.23723. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:43,  2.01it/s]
Epoch 3 Iter 137: loss 0.23723. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.01it/s]
Epoch 3 Iter 138: loss 0.24427. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:43,  2.01it/s]
Epoch 3 Iter 138: loss 0.24427. :  62%|███████████████████████████                 | 138/224 [01:10<00:42,  2.01it/s]
Epoch 3 Iter 139: loss 0.25736. :  62%|███████████████████████████                 | 138/224 [01:10<00:42,  2.01it/s]
Epoch 3 Iter 139: loss 0.25736. :  62%|███████████████████████████▎                | 139/224 [01:10<00:43,  1.96it/s]
Epoch 3 Iter 140: loss 0.25182. :  62%|███████████████████████████▎                | 139/224 [01:11<00:43,  1.96it/s]
Epoch 3 Iter 140: loss 0.25182. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.97it/s]
Epoch 3 Iter 141: loss 0.26719. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.97it/s]
Epoch 3 Iter 141: loss 0.26719. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  1.98it/s]
Epoch 3 Iter 142: loss 0.24973. :  63%|███████████████████████████▋                | 141/224 [01:12<00:41,  1.98it/s]
Epoch 3 Iter 142: loss 0.24973. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.98it/s]
Epoch 3 Iter 143: loss 0.24417. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.98it/s]
Epoch 3 Iter 143: loss 0.24417. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  2.00it/s]
Epoch 3 Iter 144: loss 0.24641. :  64%|████████████████████████████                | 143/224 [01:13<00:40,  2.00it/s]
Epoch 3 Iter 144: loss 0.24641. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.99it/s]
Epoch 3 Iter 145: loss 0.23336. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.99it/s]
Epoch 3 Iter 145: loss 0.23336. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.00it/s]
Epoch 3 Iter 146: loss 0.23713. :  65%|████████████████████████████▍               | 145/224 [01:14<00:39,  2.00it/s]
Epoch 3 Iter 146: loss 0.23713. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.01it/s]
Epoch 3 Iter 147: loss 0.25402. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.01it/s]
Epoch 3 Iter 147: loss 0.25402. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.01it/s]
Epoch 3 Iter 148: loss 0.24756. :  66%|████████████████████████████▉               | 147/224 [01:15<00:38,  2.01it/s]
Epoch 3 Iter 148: loss 0.24756. :  66%|█████████████████████████████               | 148/224 [01:15<00:38,  2.00it/s]
Epoch 3 Iter 149: loss 0.24228. :  66%|█████████████████████████████               | 148/224 [01:15<00:38,  2.00it/s]
Epoch 3 Iter 149: loss 0.24228. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.01it/s]
Epoch 3 Iter 150: loss 0.26487. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:37,  2.01it/s]
Epoch 3 Iter 150: loss 0.26487. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.00it/s]
Epoch 3 Iter 151: loss 0.23915. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.00it/s]
Epoch 3 Iter 151: loss 0.23915. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.01it/s]
Epoch 3 Iter 152: loss 0.22914. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:36,  2.01it/s]
Epoch 3 Iter 152: loss 0.22914. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.00it/s]
Epoch 3 Iter 153: loss 0.26894. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.00it/s]
Epoch 3 Iter 153: loss 0.26894. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.98it/s]
Epoch 3 Iter 154: loss 0.24497. :  68%|██████████████████████████████              | 153/224 [01:18<00:35,  1.98it/s]
Epoch 3 Iter 154: loss 0.24497. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  2.00it/s]
Epoch 3 Iter 155: loss 0.22368. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  2.00it/s]
Epoch 3 Iter 155: loss 0.22368. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.00it/s]
Epoch 3 Iter 156: loss 0.23222. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:34,  2.00it/s]
Epoch 3 Iter 156: loss 0.23222. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.01it/s]
Epoch 3 Iter 157: loss 0.23472. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.01it/s]
Epoch 3 Iter 157: loss 0.23472. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.01it/s]
Epoch 3 Iter 158: loss 0.23584. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:33,  2.01it/s]
Epoch 3 Iter 158: loss 0.23584. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.02it/s]
Epoch 3 Iter 159: loss 0.22277. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.02it/s]
Epoch 3 Iter 159: loss 0.22277. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.01it/s]
Epoch 3 Iter 160: loss 0.24996. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:32,  2.01it/s]
Epoch 3 Iter 160: loss 0.24996. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.01it/s]
Epoch 3 Iter 161: loss 0.24228. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.01it/s]
Epoch 3 Iter 161: loss 0.24228. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:33,  1.89it/s]
Epoch 3 Iter 162: loss 0.24628. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:33,  1.89it/s]
Epoch 3 Iter 162: loss 0.24628. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.88it/s]
Epoch 3 Iter 163: loss 0.25324. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:32,  1.88it/s]
Epoch 3 Iter 163: loss 0.25324. :  73%|████████████████████████████████            | 163/224 [01:22<00:31,  1.91it/s]
Epoch 3 Iter 164: loss 0.25099. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.91it/s]
Epoch 3 Iter 164: loss 0.25099. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:31,  1.93it/s]
Epoch 3 Iter 165: loss 0.23748. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:31,  1.93it/s]
Epoch 3 Iter 165: loss 0.23748. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.95it/s]
Epoch 3 Iter 166: loss 0.21627. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:30,  1.95it/s]
Epoch 3 Iter 166: loss 0.21627. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.97it/s]
Epoch 3 Iter 167: loss 0.25285. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.97it/s]
Epoch 3 Iter 167: loss 0.25285. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  1.99it/s]
Epoch 3 Iter 168: loss 0.23330. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:28,  1.99it/s]
Epoch 3 Iter 168: loss 0.23330. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  2.00it/s]
Epoch 3 Iter 169: loss 0.23992. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  2.00it/s]
Epoch 3 Iter 169: loss 0.23992. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  2.00it/s]
Epoch 3 Iter 170: loss 0.26024. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:27,  2.00it/s]
Epoch 3 Iter 170: loss 0.26024. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.01it/s]
Epoch 3 Iter 171: loss 0.23698. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.01it/s]
Epoch 3 Iter 171: loss 0.23698. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.24336. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.24336. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.01it/s]
Epoch 3 Iter 173: loss 0.23245. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.01it/s]
Epoch 3 Iter 173: loss 0.23245. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.01it/s]
Epoch 3 Iter 174: loss 0.23987. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  2.01it/s]
Epoch 3 Iter 174: loss 0.23987. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.98it/s]
Epoch 3 Iter 175: loss 0.22854. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.98it/s]
Epoch 3 Iter 175: loss 0.22854. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  1.99it/s]
Epoch 3 Iter 176: loss 0.22617. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  1.99it/s]
Epoch 3 Iter 176: loss 0.22617. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.01it/s]
Epoch 3 Iter 177: loss 0.25989. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.01it/s]
Epoch 3 Iter 177: loss 0.25989. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.01it/s]
Epoch 3 Iter 178: loss 0.24910. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  2.01it/s]
Epoch 3 Iter 178: loss 0.24910. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.02it/s]
Epoch 3 Iter 179: loss 0.24398. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.02it/s]
Epoch 3 Iter 179: loss 0.24398. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.03it/s]
Epoch 3 Iter 180: loss 0.25044. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  2.03it/s]
Epoch 3 Iter 180: loss 0.25044. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.02it/s]
Epoch 3 Iter 181: loss 0.25371. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.02it/s]
Epoch 3 Iter 181: loss 0.25371. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.01it/s]
Epoch 3 Iter 182: loss 0.24317. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  2.01it/s]
Epoch 3 Iter 182: loss 0.24317. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.00it/s]
Epoch 3 Iter 183: loss 0.21335. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.00it/s]
Epoch 3 Iter 183: loss 0.21335. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.02it/s]
Epoch 3 Iter 184: loss 0.23140. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  2.02it/s]
Epoch 3 Iter 184: loss 0.23140. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:19,  2.02it/s]
Epoch 3 Iter 185: loss 0.23192. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:19,  2.02it/s]
Epoch 3 Iter 185: loss 0.23192. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  2.01it/s]
Epoch 3 Iter 186: loss 0.25320. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  2.01it/s]
Epoch 3 Iter 186: loss 0.25320. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:18,  2.02it/s]
Epoch 3 Iter 187: loss 0.26008. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:18,  2.02it/s]
Epoch 3 Iter 187: loss 0.26008. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  2.03it/s]
Epoch 3 Iter 188: loss 0.23071. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  2.03it/s]
Epoch 3 Iter 188: loss 0.23071. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:17,  2.03it/s]
Epoch 3 Iter 189: loss 0.23623. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:17,  2.03it/s]
Epoch 3 Iter 189: loss 0.23623. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  2.04it/s]
Epoch 3 Iter 190: loss 0.22731. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  2.04it/s]
Epoch 3 Iter 190: loss 0.22731. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:16,  2.00it/s]
Epoch 3 Iter 191: loss 0.24805. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:16,  2.00it/s]
Epoch 3 Iter 191: loss 0.24805. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  2.02it/s]
Epoch 3 Iter 192: loss 0.24717. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  2.02it/s]
Epoch 3 Iter 192: loss 0.24717. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:15,  2.03it/s]
Epoch 3 Iter 193: loss 0.22751. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:15,  2.03it/s]
Epoch 3 Iter 193: loss 0.22751. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.22773. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.22773. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.02it/s]
Epoch 3 Iter 195: loss 0.23738. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.02it/s]
Epoch 3 Iter 195: loss 0.23738. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.01it/s]
Epoch 3 Iter 196: loss 0.22380. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  2.01it/s]
Epoch 3 Iter 196: loss 0.22380. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.01it/s]
Epoch 3 Iter 197: loss 0.24093. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.01it/s]
Epoch 3 Iter 197: loss 0.24093. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.01it/s]
Epoch 3 Iter 198: loss 0.24123. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  2.01it/s]
Epoch 3 Iter 198: loss 0.24123. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.01it/s]
Epoch 3 Iter 199: loss 0.25486. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.01it/s]
Epoch 3 Iter 199: loss 0.25486. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.02it/s]
Epoch 3 Iter 200: loss 0.23363. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  2.02it/s]
Epoch 3 Iter 200: loss 0.23363. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.02it/s]
Epoch 3 Iter 201: loss 0.22906. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.02it/s]
Epoch 3 Iter 201: loss 0.22906. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  2.00it/s]
Epoch 3 Iter 202: loss 0.24205. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  2.00it/s]
Epoch 3 Iter 202: loss 0.24205. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.00it/s]
Epoch 3 Iter 203: loss 0.25276. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.00it/s]
Epoch 3 Iter 203: loss 0.25276. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.24942. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.24942. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.01it/s]
Epoch 3 Iter 205: loss 0.22895. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.01it/s]
Epoch 3 Iter 205: loss 0.22895. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.02it/s]
Epoch 3 Iter 206: loss 0.22187. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.02it/s]
Epoch 3 Iter 206: loss 0.22187. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.03it/s]
Epoch 3 Iter 207: loss 0.24015. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.03it/s]
Epoch 3 Iter 207: loss 0.24015. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.02it/s]
Epoch 3 Iter 208: loss 0.23177. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.02it/s]
Epoch 3 Iter 208: loss 0.23177. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 3 Iter 209: loss 0.23841. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 3 Iter 209: loss 0.23841. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.03it/s]
Epoch 3 Iter 210: loss 0.24717. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.03it/s]
Epoch 3 Iter 210: loss 0.24717. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 3 Iter 211: loss 0.23917. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 3 Iter 211: loss 0.23917. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.01it/s]
Epoch 3 Iter 212: loss 0.22664. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.01it/s]
Epoch 3 Iter 212: loss 0.22664. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.01it/s]
Epoch 3 Iter 213: loss 0.23418. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.01it/s]
Epoch 3 Iter 213: loss 0.23418. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.01it/s]
Epoch 3 Iter 214: loss 0.24687. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.01it/s]
Epoch 3 Iter 214: loss 0.24687. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 3 Iter 215: loss 0.23481. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 3 Iter 215: loss 0.23481. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  1.98it/s]
Epoch 3 Iter 216: loss 0.25753. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.98it/s]
Epoch 3 Iter 216: loss 0.25753. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.93it/s]
Epoch 3 Iter 217: loss 0.21942. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.93it/s]
Epoch 3 Iter 217: loss 0.21942. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  1.93it/s]
Epoch 3 Iter 218: loss 0.23013. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.93it/s]
Epoch 3 Iter 218: loss 0.23013. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.96it/s]
Epoch 3 Iter 219: loss 0.21240. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.96it/s]
Epoch 3 Iter 219: loss 0.21240. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  1.97it/s]
Epoch 3 Iter 220: loss 0.21679. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.97it/s]
Epoch 3 Iter 220: loss 0.21679. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.98it/s]
Epoch 3 Iter 221: loss 0.25132. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.98it/s]
Epoch 3 Iter 221: loss 0.25132. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  1.99it/s]
Epoch 3 Iter 222: loss 0.24166. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.99it/s]
Epoch 3 Iter 222: loss 0.24166. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:01,  1.99it/s]
Epoch 3 Iter 223: loss 0.24481. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:01,  1.99it/s]
Epoch 3 Iter 223: loss 0.24481. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  1.98it/s]
Epoch 3 Iter 224: loss 0.22604. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.98it/s]
Epoch 3 Iter 224: loss 0.22604. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.99it/s]
Epoch 3 Iter 224: loss 0.22604. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

    Train loss: 0.24029
    Valid loss: 0.24271
       Valid loss recons: 0.2367
       Valid loss KL-D:   0.60051
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.23393. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.23393. :   0%|▏                                               | 1/224 [00:00<01:51,  2.00it/s]
Epoch 4 Iter 2: loss 0.24009. :   0%|▏                                               | 1/224 [00:01<01:51,  2.00it/s]
Epoch 4 Iter 2: loss 0.24009. :   1%|▍                                               | 2/224 [00:01<01:52,  1.98it/s]
Epoch 4 Iter 3: loss 0.24250. :   1%|▍                                               | 2/224 [00:01<01:52,  1.98it/s]
Epoch 4 Iter 3: loss 0.24250. :   1%|▋                                               | 3/224 [00:01<01:57,  1.89it/s]
Epoch 4 Iter 4: loss 0.21927. :   1%|▋                                               | 3/224 [00:02<01:57,  1.89it/s]
Epoch 4 Iter 4: loss 0.21927. :   2%|▊                                               | 4/224 [00:02<01:53,  1.93it/s]
Epoch 4 Iter 5: loss 0.25653. :   2%|▊                                               | 4/224 [00:02<01:53,  1.93it/s]
Epoch 4 Iter 5: loss 0.25653. :   2%|█                                               | 5/224 [00:02<01:52,  1.95it/s]
Epoch 4 Iter 6: loss 0.25526. :   2%|█                                               | 5/224 [00:03<01:52,  1.95it/s]
Epoch 4 Iter 6: loss 0.25526. :   3%|█▎                                              | 6/224 [00:03<01:51,  1.96it/s]
Epoch 4 Iter 7: loss 0.23551. :   3%|█▎                                              | 6/224 [00:03<01:51,  1.96it/s]
Epoch 4 Iter 7: loss 0.23551. :   3%|█▌                                              | 7/224 [00:03<01:49,  1.98it/s]
Epoch 4 Iter 8: loss 0.24882. :   3%|█▌                                              | 7/224 [00:04<01:49,  1.98it/s]
Epoch 4 Iter 8: loss 0.24882. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 4 Iter 9: loss 0.24837. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 4 Iter 9: loss 0.24837. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 4 Iter 10: loss 0.25299. :   4%|█▉                                             | 9/224 [00:05<01:47,  2.00it/s]
Epoch 4 Iter 10: loss 0.25299. :   4%|██                                            | 10/224 [00:05<01:46,  2.01it/s]
Epoch 4 Iter 11: loss 0.23467. :   4%|██                                            | 10/224 [00:05<01:46,  2.01it/s]
Epoch 4 Iter 11: loss 0.23467. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.02it/s]
Epoch 4 Iter 12: loss 0.22728. :   5%|██▎                                           | 11/224 [00:06<01:45,  2.02it/s]
Epoch 4 Iter 12: loss 0.22728. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 4 Iter 13: loss 0.21190. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 4 Iter 13: loss 0.21190. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.03it/s]
Epoch 4 Iter 14: loss 0.24649. :   6%|██▋                                           | 13/224 [00:07<01:44,  2.03it/s]
Epoch 4 Iter 14: loss 0.24649. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.03it/s]
Epoch 4 Iter 15: loss 0.22638. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.03it/s]
Epoch 4 Iter 15: loss 0.22638. :   7%|███                                           | 15/224 [00:07<01:43,  2.02it/s]
Epoch 4 Iter 16: loss 0.24811. :   7%|███                                           | 15/224 [00:08<01:43,  2.02it/s]
Epoch 4 Iter 16: loss 0.24811. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.02it/s]
Epoch 4 Iter 17: loss 0.24342. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.02it/s]
Epoch 4 Iter 17: loss 0.24342. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.00it/s]
Epoch 4 Iter 18: loss 0.24251. :   8%|███▍                                          | 17/224 [00:09<01:43,  2.00it/s]
Epoch 4 Iter 18: loss 0.24251. :   8%|███▋                                          | 18/224 [00:09<01:43,  2.00it/s]
Epoch 4 Iter 19: loss 0.24675. :   8%|███▋                                          | 18/224 [00:09<01:43,  2.00it/s]
Epoch 4 Iter 19: loss 0.24675. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.01it/s]
Epoch 4 Iter 20: loss 0.21602. :   8%|███▉                                          | 19/224 [00:10<01:42,  2.01it/s]
Epoch 4 Iter 20: loss 0.21602. :   9%|████                                          | 20/224 [00:10<01:42,  2.00it/s]
Epoch 4 Iter 21: loss 0.22461. :   9%|████                                          | 20/224 [00:10<01:42,  2.00it/s]
Epoch 4 Iter 21: loss 0.22461. :   9%|████▎                                         | 21/224 [00:10<01:41,  1.99it/s]
Epoch 4 Iter 22: loss 0.24655. :   9%|████▎                                         | 21/224 [00:11<01:41,  1.99it/s]
Epoch 4 Iter 22: loss 0.24655. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.01it/s]
Epoch 4 Iter 23: loss 0.25905. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.01it/s]
Epoch 4 Iter 23: loss 0.25905. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.01it/s]
Epoch 4 Iter 24: loss 0.23617. :  10%|████▋                                         | 23/224 [00:12<01:40,  2.01it/s]
Epoch 4 Iter 24: loss 0.23617. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 4 Iter 25: loss 0.23122. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.01it/s]
Epoch 4 Iter 25: loss 0.23122. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 4 Iter 26: loss 0.24388. :  11%|█████▏                                        | 25/224 [00:13<01:38,  2.01it/s]
Epoch 4 Iter 26: loss 0.24388. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.02it/s]
Epoch 4 Iter 27: loss 0.21221. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.02it/s]
Epoch 4 Iter 27: loss 0.21221. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.01it/s]
Epoch 4 Iter 28: loss 0.24203. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.01it/s]
Epoch 4 Iter 28: loss 0.24203. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.02it/s]
Epoch 4 Iter 29: loss 0.24190. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.02it/s]
Epoch 4 Iter 29: loss 0.24190. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.01it/s]
Epoch 4 Iter 30: loss 0.22366. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.01it/s]
Epoch 4 Iter 30: loss 0.22366. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 4 Iter 31: loss 0.24886. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 4 Iter 31: loss 0.24886. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 4 Iter 32: loss 0.24625. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 4 Iter 32: loss 0.24625. :  14%|██████▌                                       | 32/224 [00:15<01:35,  2.02it/s]
Epoch 4 Iter 33: loss 0.24699. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.02it/s]
Epoch 4 Iter 33: loss 0.24699. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 4 Iter 34: loss 0.22992. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 4 Iter 34: loss 0.22992. :  15%|██████▉                                       | 34/224 [00:16<01:34,  2.02it/s]
Epoch 4 Iter 35: loss 0.22992. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.02it/s]
Epoch 4 Iter 35: loss 0.22992. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 4 Iter 36: loss 0.24394. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 4 Iter 36: loss 0.24394. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.03it/s]
Epoch 4 Iter 37: loss 0.23864. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.03it/s]
Epoch 4 Iter 37: loss 0.23864. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 4 Iter 38: loss 0.23356. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 4 Iter 38: loss 0.23356. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.03it/s]
Epoch 4 Iter 39: loss 0.23444. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.03it/s]
Epoch 4 Iter 39: loss 0.23444. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 40: loss 0.21196. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 40: loss 0.21196. :  18%|████████▏                                     | 40/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 41: loss 0.25708. :  18%|████████▏                                     | 40/224 [00:20<01:32,  2.00it/s]
Epoch 4 Iter 41: loss 0.25708. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.00it/s]
Epoch 4 Iter 42: loss 0.24474. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.00it/s]
Epoch 4 Iter 42: loss 0.24474. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 4 Iter 43: loss 0.24247. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 4 Iter 43: loss 0.24247. :  19%|████████▊                                     | 43/224 [00:21<01:30,  1.99it/s]
Epoch 4 Iter 44: loss 0.22659. :  19%|████████▊                                     | 43/224 [00:22<01:30,  1.99it/s]
Epoch 4 Iter 44: loss 0.22659. :  20%|█████████                                     | 44/224 [00:22<01:33,  1.93it/s]
Epoch 4 Iter 45: loss 0.21398. :  20%|█████████                                     | 44/224 [00:22<01:33,  1.93it/s]
Epoch 4 Iter 45: loss 0.21398. :  20%|█████████▏                                    | 45/224 [00:22<01:31,  1.95it/s]
Epoch 4 Iter 46: loss 0.24597. :  20%|█████████▏                                    | 45/224 [00:23<01:31,  1.95it/s]
Epoch 4 Iter 46: loss 0.24597. :  21%|█████████▍                                    | 46/224 [00:23<01:30,  1.96it/s]
Epoch 4 Iter 47: loss 0.23976. :  21%|█████████▍                                    | 46/224 [00:23<01:30,  1.96it/s]
Epoch 4 Iter 47: loss 0.23976. :  21%|█████████▋                                    | 47/224 [00:23<01:29,  1.97it/s]
Epoch 4 Iter 48: loss 0.25299. :  21%|█████████▋                                    | 47/224 [00:24<01:29,  1.97it/s]
Epoch 4 Iter 48: loss 0.25299. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.99it/s]
Epoch 4 Iter 49: loss 0.22040. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.99it/s]
Epoch 4 Iter 49: loss 0.22040. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 4 Iter 50: loss 0.25032. :  22%|██████████                                    | 49/224 [00:25<01:27,  2.00it/s]
Epoch 4 Iter 50: loss 0.25032. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.00it/s]
Epoch 4 Iter 51: loss 0.23684. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.00it/s]
Epoch 4 Iter 51: loss 0.23684. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 4 Iter 52: loss 0.23851. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 4 Iter 52: loss 0.23851. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.02it/s]
Epoch 4 Iter 53: loss 0.24159. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.02it/s]
Epoch 4 Iter 53: loss 0.24159. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 4 Iter 54: loss 0.23836. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 4 Iter 54: loss 0.23836. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.02it/s]
Epoch 4 Iter 55: loss 0.23646. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.02it/s]
Epoch 4 Iter 55: loss 0.23646. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 4 Iter 56: loss 0.22390. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 4 Iter 56: loss 0.22390. :  25%|███████████▌                                  | 56/224 [00:27<01:24,  1.99it/s]
Epoch 4 Iter 57: loss 0.24492. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  1.99it/s]
Epoch 4 Iter 57: loss 0.24492. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 4 Iter 58: loss 0.25130. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 4 Iter 58: loss 0.25130. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.00it/s]
Epoch 4 Iter 59: loss 0.23504. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.00it/s]
Epoch 4 Iter 59: loss 0.23504. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 4 Iter 60: loss 0.23690. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 4 Iter 60: loss 0.23690. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.00it/s]
Epoch 4 Iter 61: loss 0.25019. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 4 Iter 61: loss 0.25019. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.01it/s]
Epoch 4 Iter 62: loss 0.24010. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.01it/s]
Epoch 4 Iter 62: loss 0.24010. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.02it/s]
Epoch 4 Iter 63: loss 0.23182. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.02it/s]
Epoch 4 Iter 63: loss 0.23182. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.01it/s]
Epoch 4 Iter 64: loss 0.23419. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.01it/s]
Epoch 4 Iter 64: loss 0.23419. :  29%|█████████████▏                                | 64/224 [00:31<01:19,  2.02it/s]
Epoch 4 Iter 65: loss 0.24203. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 4 Iter 65: loss 0.24203. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.02it/s]
Epoch 4 Iter 66: loss 0.25432. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.02it/s]
Epoch 4 Iter 66: loss 0.25432. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.01it/s]
Epoch 4 Iter 67: loss 0.23297. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 4 Iter 67: loss 0.23297. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.02it/s]
Epoch 4 Iter 68: loss 0.25583. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.02it/s]
Epoch 4 Iter 68: loss 0.25583. :  30%|█████████████▉                                | 68/224 [00:33<01:17,  2.02it/s]
Epoch 4 Iter 69: loss 0.23729. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.02it/s]
Epoch 4 Iter 69: loss 0.23729. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 4 Iter 70: loss 0.24567. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 4 Iter 70: loss 0.24567. :  31%|██████████████▍                               | 70/224 [00:34<01:16,  2.01it/s]
Epoch 4 Iter 71: loss 0.22805. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.01it/s]
Epoch 4 Iter 71: loss 0.22805. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  1.99it/s]
Epoch 4 Iter 72: loss 0.25223. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  1.99it/s]
Epoch 4 Iter 72: loss 0.25223. :  32%|██████████████▊                               | 72/224 [00:36<01:19,  1.91it/s]
Epoch 4 Iter 73: loss 0.22305. :  32%|██████████████▊                               | 72/224 [00:36<01:19,  1.91it/s]
Epoch 4 Iter 73: loss 0.22305. :  33%|██████████████▉                               | 73/224 [00:36<01:17,  1.94it/s]
Epoch 4 Iter 74: loss 0.24511. :  33%|██████████████▉                               | 73/224 [00:37<01:17,  1.94it/s]
Epoch 4 Iter 74: loss 0.24511. :  33%|███████████████▏                              | 74/224 [00:37<01:16,  1.97it/s]
Epoch 4 Iter 75: loss 0.23029. :  33%|███████████████▏                              | 74/224 [00:37<01:16,  1.97it/s]
Epoch 4 Iter 75: loss 0.23029. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  1.99it/s]
Epoch 4 Iter 76: loss 0.25703. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  1.99it/s]
Epoch 4 Iter 76: loss 0.25703. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.00it/s]
Epoch 4 Iter 77: loss 0.23214. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.00it/s]
Epoch 4 Iter 77: loss 0.23214. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 4 Iter 78: loss 0.23305. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 4 Iter 78: loss 0.23305. :  35%|████████████████                              | 78/224 [00:38<01:11,  2.03it/s]
Epoch 4 Iter 79: loss 0.24773. :  35%|████████████████                              | 78/224 [00:39<01:11,  2.03it/s]
Epoch 4 Iter 79: loss 0.24773. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.03it/s]
Epoch 4 Iter 80: loss 0.23565. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.03it/s]
Epoch 4 Iter 80: loss 0.23565. :  36%|████████████████▍                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 4 Iter 81: loss 0.22546. :  36%|████████████████▍                             | 80/224 [00:40<01:10,  2.03it/s]
Epoch 4 Iter 81: loss 0.22546. :  36%|████████████████▋                             | 81/224 [00:40<01:09,  2.05it/s]
Epoch 4 Iter 82: loss 0.24259. :  36%|████████████████▋                             | 81/224 [00:40<01:09,  2.05it/s]
Epoch 4 Iter 82: loss 0.24259. :  37%|████████████████▊                             | 82/224 [00:40<01:09,  2.05it/s]
Epoch 4 Iter 83: loss 0.24326. :  37%|████████████████▊                             | 82/224 [00:41<01:09,  2.05it/s]
Epoch 4 Iter 83: loss 0.24326. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.04it/s]
Epoch 4 Iter 84: loss 0.23962. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.04it/s]
Epoch 4 Iter 84: loss 0.23962. :  38%|█████████████████▎                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 4 Iter 85: loss 0.23807. :  38%|█████████████████▎                            | 84/224 [00:42<01:08,  2.04it/s]
Epoch 4 Iter 85: loss 0.23807. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.04it/s]
Epoch 4 Iter 86: loss 0.24066. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.04it/s]
Epoch 4 Iter 86: loss 0.24066. :  38%|█████████████████▋                            | 86/224 [00:42<01:07,  2.03it/s]
Epoch 4 Iter 87: loss 0.24788. :  38%|█████████████████▋                            | 86/224 [00:43<01:07,  2.03it/s]
Epoch 4 Iter 87: loss 0.24788. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.04it/s]
Epoch 4 Iter 88: loss 0.22903. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.04it/s]
Epoch 4 Iter 88: loss 0.22903. :  39%|██████████████████                            | 88/224 [00:43<01:06,  2.03it/s]
Epoch 4 Iter 89: loss 0.23734. :  39%|██████████████████                            | 88/224 [00:44<01:06,  2.03it/s]
Epoch 4 Iter 89: loss 0.23734. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 4 Iter 90: loss 0.22474. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 4 Iter 90: loss 0.22474. :  40%|██████████████████▍                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 4 Iter 91: loss 0.23895. :  40%|██████████████████▍                           | 90/224 [00:45<01:05,  2.04it/s]
Epoch 4 Iter 91: loss 0.23895. :  41%|██████████████████▋                           | 91/224 [00:45<01:05,  2.04it/s]
Epoch 4 Iter 92: loss 0.25356. :  41%|██████████████████▋                           | 91/224 [00:45<01:05,  2.04it/s]
Epoch 4 Iter 92: loss 0.25356. :  41%|██████████████████▉                           | 92/224 [00:45<01:04,  2.04it/s]
Epoch 4 Iter 93: loss 0.25094. :  41%|██████████████████▉                           | 92/224 [00:46<01:04,  2.04it/s]
Epoch 4 Iter 93: loss 0.25094. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 4 Iter 94: loss 0.24864. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 4 Iter 94: loss 0.24864. :  42%|███████████████████▎                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 4 Iter 95: loss 0.23756. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 4 Iter 95: loss 0.23756. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 4 Iter 96: loss 0.27501. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 4 Iter 96: loss 0.27501. :  43%|███████████████████▋                          | 96/224 [00:47<01:03,  2.00it/s]
Epoch 4 Iter 97: loss 0.22846. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.00it/s]
Epoch 4 Iter 97: loss 0.22846. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  1.99it/s]
Epoch 4 Iter 98: loss 0.23760. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  1.99it/s]
Epoch 4 Iter 98: loss 0.23760. :  44%|████████████████████▏                         | 98/224 [00:48<01:05,  1.91it/s]
Epoch 4 Iter 99: loss 0.23019. :  44%|████████████████████▏                         | 98/224 [00:49<01:05,  1.91it/s]
Epoch 4 Iter 99: loss 0.23019. :  44%|████████████████████▎                         | 99/224 [00:49<01:04,  1.94it/s]
Epoch 4 Iter 100: loss 0.23455. :  44%|███████████████████▉                         | 99/224 [00:49<01:04,  1.94it/s]
Epoch 4 Iter 100: loss 0.23455. :  45%|███████████████████▋                        | 100/224 [00:49<01:03,  1.96it/s]
Epoch 4 Iter 101: loss 0.25608. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.96it/s]
Epoch 4 Iter 101: loss 0.25608. :  45%|███████████████████▊                        | 101/224 [00:50<01:02,  1.96it/s]
Epoch 4 Iter 102: loss 0.26323. :  45%|███████████████████▊                        | 101/224 [00:50<01:02,  1.96it/s]
Epoch 4 Iter 102: loss 0.26323. :  46%|████████████████████                        | 102/224 [00:50<01:01,  1.98it/s]
Epoch 4 Iter 103: loss 0.21824. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.98it/s]
Epoch 4 Iter 103: loss 0.21824. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 4 Iter 104: loss 0.24253. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 4 Iter 104: loss 0.24253. :  46%|████████████████████▍                       | 104/224 [00:51<00:59,  2.00it/s]
Epoch 4 Iter 105: loss 0.24567. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.00it/s]
Epoch 4 Iter 105: loss 0.24567. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.00it/s]
Epoch 4 Iter 106: loss 0.24336. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.00it/s]
Epoch 4 Iter 106: loss 0.24336. :  47%|████████████████████▊                       | 106/224 [00:52<00:58,  2.00it/s]
Epoch 4 Iter 107: loss 0.24741. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.00it/s]
Epoch 4 Iter 107: loss 0.24741. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 4 Iter 108: loss 0.23192. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 4 Iter 108: loss 0.23192. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.01it/s]
Epoch 4 Iter 109: loss 0.24623. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 4 Iter 109: loss 0.24623. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 4 Iter 110: loss 0.21350. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 4 Iter 110: loss 0.21350. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.01it/s]
Epoch 4 Iter 111: loss 0.22553. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.01it/s]
Epoch 4 Iter 111: loss 0.22553. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.01it/s]
Epoch 4 Iter 112: loss 0.25018. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.01it/s]
Epoch 4 Iter 112: loss 0.25018. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.01it/s]
Epoch 4 Iter 113: loss 0.22821. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.01it/s]
Epoch 4 Iter 113: loss 0.22821. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 4 Iter 114: loss 0.21440. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 4 Iter 114: loss 0.21440. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.00it/s]
Epoch 4 Iter 115: loss 0.21736. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.00it/s]
Epoch 4 Iter 115: loss 0.21736. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.00it/s]
Epoch 4 Iter 116: loss 0.22563. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.00it/s]
Epoch 4 Iter 116: loss 0.22563. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.01it/s]
Epoch 4 Iter 117: loss 0.24152. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.01it/s]
Epoch 4 Iter 117: loss 0.24152. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.02it/s]
Epoch 4 Iter 118: loss 0.25153. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.02it/s]
Epoch 4 Iter 118: loss 0.25153. :  53%|███████████████████████▏                    | 118/224 [00:58<00:52,  2.01it/s]
Epoch 4 Iter 119: loss 0.20748. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.01it/s]
Epoch 4 Iter 119: loss 0.20748. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.02it/s]
Epoch 4 Iter 120: loss 0.23109. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.02it/s]
Epoch 4 Iter 120: loss 0.23109. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.02it/s]
Epoch 4 Iter 121: loss 0.23910. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 4 Iter 121: loss 0.23910. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.02it/s]
Epoch 4 Iter 122: loss 0.23881. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.02it/s]
Epoch 4 Iter 122: loss 0.23881. :  54%|███████████████████████▉                    | 122/224 [01:00<00:51,  2.00it/s]
Epoch 4 Iter 123: loss 0.23604. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  2.00it/s]
Epoch 4 Iter 123: loss 0.23604. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.00it/s]
Epoch 4 Iter 124: loss 0.25807. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.00it/s]
Epoch 4 Iter 124: loss 0.25807. :  55%|████████████████████████▎                   | 124/224 [01:01<00:50,  1.99it/s]
Epoch 4 Iter 125: loss 0.22709. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.99it/s]
Epoch 4 Iter 125: loss 0.22709. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  1.99it/s]
Epoch 4 Iter 126: loss 0.23462. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  1.99it/s]
Epoch 4 Iter 126: loss 0.23462. :  56%|████████████████████████▊                   | 126/224 [01:02<00:49,  1.97it/s]
Epoch 4 Iter 127: loss 0.22599. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.97it/s]
Epoch 4 Iter 127: loss 0.22599. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  1.99it/s]
Epoch 4 Iter 128: loss 0.23684. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  1.99it/s]
Epoch 4 Iter 128: loss 0.23684. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:48,  2.00it/s]
Epoch 4 Iter 129: loss 0.24462. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:48,  2.00it/s]
Epoch 4 Iter 129: loss 0.24462. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.01it/s]
Epoch 4 Iter 130: loss 0.26247. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.01it/s]
Epoch 4 Iter 130: loss 0.26247. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.01it/s]
Epoch 4 Iter 131: loss 0.24592. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 131: loss 0.24592. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 132: loss 0.24421. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 132: loss 0.24421. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.01it/s]
Epoch 4 Iter 133: loss 0.21819. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.01it/s]
Epoch 4 Iter 133: loss 0.21819. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 4 Iter 134: loss 0.23955. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 4 Iter 134: loss 0.23955. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:44,  2.02it/s]
Epoch 4 Iter 135: loss 0.25014. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.02it/s]
Epoch 4 Iter 135: loss 0.25014. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 4 Iter 136: loss 0.24218. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 4 Iter 136: loss 0.24218. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:43,  2.01it/s]
Epoch 4 Iter 137: loss 0.22167. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.01it/s]
Epoch 4 Iter 137: loss 0.22167. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 4 Iter 138: loss 0.25125. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 4 Iter 138: loss 0.25125. :  62%|███████████████████████████                 | 138/224 [01:08<00:42,  2.02it/s]
Epoch 4 Iter 139: loss 0.22267. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 4 Iter 139: loss 0.22267. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 4 Iter 140: loss 0.22808. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 4 Iter 140: loss 0.22808. :  62%|███████████████████████████▌                | 140/224 [01:09<00:41,  2.01it/s]
Epoch 4 Iter 141: loss 0.23579. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 4 Iter 141: loss 0.23579. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 4 Iter 142: loss 0.21826. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 4 Iter 142: loss 0.21826. :  63%|███████████████████████████▉                | 142/224 [01:10<00:40,  2.02it/s]
Epoch 4 Iter 143: loss 0.23498. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 4 Iter 143: loss 0.23498. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.02it/s]
Epoch 4 Iter 144: loss 0.25627. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.02it/s]
Epoch 4 Iter 144: loss 0.25627. :  64%|████████████████████████████▎               | 144/224 [01:11<00:39,  2.01it/s]
Epoch 4 Iter 145: loss 0.25147. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.01it/s]
Epoch 4 Iter 145: loss 0.25147. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.01it/s]
Epoch 4 Iter 146: loss 0.23329. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.01it/s]
Epoch 4 Iter 146: loss 0.23329. :  65%|████████████████████████████▋               | 146/224 [01:12<00:41,  1.90it/s]
Epoch 4 Iter 147: loss 0.24727. :  65%|████████████████████████████▋               | 146/224 [01:13<00:41,  1.90it/s]
Epoch 4 Iter 147: loss 0.24727. :  66%|████████████████████████████▉               | 147/224 [01:13<00:41,  1.87it/s]
Epoch 4 Iter 148: loss 0.24220. :  66%|████████████████████████████▉               | 147/224 [01:13<00:41,  1.87it/s]
Epoch 4 Iter 148: loss 0.24220. :  66%|█████████████████████████████               | 148/224 [01:13<00:39,  1.92it/s]
Epoch 4 Iter 149: loss 0.25179. :  66%|█████████████████████████████               | 148/224 [01:14<00:39,  1.92it/s]
Epoch 4 Iter 149: loss 0.25179. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:38,  1.95it/s]
Epoch 4 Iter 150: loss 0.22395. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:38,  1.95it/s]
Epoch 4 Iter 150: loss 0.22395. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:37,  1.97it/s]
Epoch 4 Iter 151: loss 0.25046. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  1.97it/s]
Epoch 4 Iter 151: loss 0.25046. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  1.99it/s]
Epoch 4 Iter 152: loss 0.23899. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  1.99it/s]
Epoch 4 Iter 152: loss 0.23899. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:36,  1.99it/s]
Epoch 4 Iter 153: loss 0.23792. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 4 Iter 153: loss 0.23792. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.01it/s]
Epoch 4 Iter 154: loss 0.24009. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.01it/s]
Epoch 4 Iter 154: loss 0.24009. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:34,  2.02it/s]
Epoch 4 Iter 155: loss 0.24110. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.02it/s]
Epoch 4 Iter 155: loss 0.24110. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.01it/s]
Epoch 4 Iter 156: loss 0.25004. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.01it/s]
Epoch 4 Iter 156: loss 0.25004. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:33,  2.02it/s]
Epoch 4 Iter 157: loss 0.24917. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.02it/s]
Epoch 4 Iter 157: loss 0.24917. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.02it/s]
Epoch 4 Iter 158: loss 0.23143. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.02it/s]
Epoch 4 Iter 158: loss 0.23143. :  71%|███████████████████████████████             | 158/224 [01:18<00:32,  2.02it/s]
Epoch 4 Iter 159: loss 0.22095. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.02it/s]
Epoch 4 Iter 159: loss 0.22095. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:31,  2.03it/s]
Epoch 4 Iter 160: loss 0.24898. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:31,  2.03it/s]
Epoch 4 Iter 160: loss 0.24898. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:31,  2.04it/s]
Epoch 4 Iter 161: loss 0.22035. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.04it/s]
Epoch 4 Iter 161: loss 0.22035. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.03it/s]
Epoch 4 Iter 162: loss 0.25511. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.03it/s]
Epoch 4 Iter 162: loss 0.25511. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:30,  2.03it/s]
Epoch 4 Iter 163: loss 0.23155. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.03it/s]
Epoch 4 Iter 163: loss 0.23155. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 4 Iter 164: loss 0.23126. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 4 Iter 164: loss 0.23126. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:29,  2.02it/s]
Epoch 4 Iter 165: loss 0.24533. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.02it/s]
Epoch 4 Iter 165: loss 0.24533. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.97it/s]
Epoch 4 Iter 166: loss 0.23681. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.97it/s]
Epoch 4 Iter 166: loss 0.23681. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:29,  1.99it/s]
Epoch 4 Iter 167: loss 0.23660. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:29,  1.99it/s]
Epoch 4 Iter 167: loss 0.23660. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 4 Iter 168: loss 0.26923. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 4 Iter 168: loss 0.26923. :  75%|█████████████████████████████████           | 168/224 [01:23<00:28,  2.00it/s]
Epoch 4 Iter 169: loss 0.21975. :  75%|█████████████████████████████████           | 168/224 [01:24<00:28,  2.00it/s]
Epoch 4 Iter 169: loss 0.21975. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.97it/s]
Epoch 4 Iter 170: loss 0.24227. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.97it/s]
Epoch 4 Iter 170: loss 0.24227. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:27,  1.99it/s]
Epoch 4 Iter 171: loss 0.22612. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:27,  1.99it/s]
Epoch 4 Iter 171: loss 0.22612. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.00it/s]
Epoch 4 Iter 172: loss 0.23989. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.00it/s]
Epoch 4 Iter 172: loss 0.23989. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.01it/s]
Epoch 4 Iter 173: loss 0.24257. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.01it/s]
Epoch 4 Iter 173: loss 0.24257. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 4 Iter 174: loss 0.25127. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 4 Iter 174: loss 0.25127. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.02it/s]
Epoch 4 Iter 175: loss 0.23294. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.02it/s]
Epoch 4 Iter 175: loss 0.23294. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.02it/s]
Epoch 4 Iter 176: loss 0.22241. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.02it/s]
Epoch 4 Iter 176: loss 0.22241. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.01it/s]
Epoch 4 Iter 177: loss 0.25085. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.01it/s]
Epoch 4 Iter 177: loss 0.25085. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.01it/s]
Epoch 4 Iter 178: loss 0.26245. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.01it/s]
Epoch 4 Iter 178: loss 0.26245. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:23,  1.95it/s]
Epoch 4 Iter 179: loss 0.25467. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:23,  1.95it/s]
Epoch 4 Iter 179: loss 0.25467. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:23,  1.95it/s]
Epoch 4 Iter 180: loss 0.24083. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:23,  1.95it/s]
Epoch 4 Iter 180: loss 0.24083. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:22,  1.95it/s]
Epoch 4 Iter 181: loss 0.24269. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:22,  1.95it/s]
Epoch 4 Iter 181: loss 0.24269. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  1.96it/s]
Epoch 4 Iter 182: loss 0.22764. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  1.96it/s]
Epoch 4 Iter 182: loss 0.22764. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:21,  1.98it/s]
Epoch 4 Iter 183: loss 0.25052. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:21,  1.98it/s]
Epoch 4 Iter 183: loss 0.25052. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.99it/s]
Epoch 4 Iter 184: loss 0.23184. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  1.99it/s]
Epoch 4 Iter 184: loss 0.23184. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.01it/s]
Epoch 4 Iter 185: loss 0.23579. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.01it/s]
Epoch 4 Iter 185: loss 0.23579. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.01it/s]
Epoch 4 Iter 186: loss 0.22729. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.01it/s]
Epoch 4 Iter 186: loss 0.22729. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.00it/s]
Epoch 4 Iter 187: loss 0.22801. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.00it/s]
Epoch 4 Iter 187: loss 0.22801. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 4 Iter 188: loss 0.23412. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  1.99it/s]
Epoch 4 Iter 188: loss 0.23412. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:18,  2.00it/s]
Epoch 4 Iter 189: loss 0.25505. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  2.00it/s]
Epoch 4 Iter 189: loss 0.25505. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.01it/s]
Epoch 4 Iter 190: loss 0.23486. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.01it/s]
Epoch 4 Iter 190: loss 0.23486. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:16,  2.01it/s]
Epoch 4 Iter 191: loss 0.22286. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:16,  2.01it/s]
Epoch 4 Iter 191: loss 0.22286. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.02it/s]
Epoch 4 Iter 192: loss 0.24637. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.02it/s]
Epoch 4 Iter 192: loss 0.24637. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:15,  2.02it/s]
Epoch 4 Iter 193: loss 0.23938. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:15,  2.02it/s]
Epoch 4 Iter 193: loss 0.23938. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.02it/s]
Epoch 4 Iter 194: loss 0.24701. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.02it/s]
Epoch 4 Iter 194: loss 0.24701. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:14,  2.02it/s]
Epoch 4 Iter 195: loss 0.23560. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.02it/s]
Epoch 4 Iter 195: loss 0.23560. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.02it/s]
Epoch 4 Iter 196: loss 0.23494. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.02it/s]
Epoch 4 Iter 196: loss 0.23494. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:13,  2.02it/s]
Epoch 4 Iter 197: loss 0.23608. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.02it/s]
Epoch 4 Iter 197: loss 0.23608. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.01it/s]
Epoch 4 Iter 198: loss 0.22449. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.01it/s]
Epoch 4 Iter 198: loss 0.22449. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.01it/s]
Epoch 4 Iter 199: loss 0.25235. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.01it/s]
Epoch 4 Iter 199: loss 0.25235. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 4 Iter 200: loss 0.26919. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 4 Iter 200: loss 0.26919. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:11,  2.01it/s]
Epoch 4 Iter 201: loss 0.22073. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.01it/s]
Epoch 4 Iter 201: loss 0.22073. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 4 Iter 202: loss 0.24030. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 4 Iter 202: loss 0.24030. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:10,  2.02it/s]
Epoch 4 Iter 203: loss 0.22635. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.02it/s]
Epoch 4 Iter 203: loss 0.22635. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.01it/s]
Epoch 4 Iter 204: loss 0.21794. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.01it/s]
Epoch 4 Iter 204: loss 0.21794. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:09,  2.01it/s]
Epoch 4 Iter 205: loss 0.24654. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.01it/s]
Epoch 4 Iter 205: loss 0.24654. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.01it/s]
Epoch 4 Iter 206: loss 0.24195. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.01it/s]
Epoch 4 Iter 206: loss 0.24195. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.03it/s]
Epoch 4 Iter 207: loss 0.20329. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.03it/s]
Epoch 4 Iter 207: loss 0.20329. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.03it/s]
Epoch 4 Iter 208: loss 0.23075. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.03it/s]
Epoch 4 Iter 208: loss 0.23075. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.03it/s]
Epoch 4 Iter 209: loss 0.26414. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:07,  2.03it/s]
Epoch 4 Iter 209: loss 0.26414. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.02it/s]
Epoch 4 Iter 210: loss 0.22782. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.02it/s]
Epoch 4 Iter 210: loss 0.22782. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:07,  1.97it/s]
Epoch 4 Iter 211: loss 0.23885. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.97it/s]
Epoch 4 Iter 211: loss 0.23885. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.97it/s]
Epoch 4 Iter 212: loss 0.22250. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.97it/s]
Epoch 4 Iter 212: loss 0.22250. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:06,  1.98it/s]
Epoch 4 Iter 213: loss 0.26318. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:06,  1.98it/s]
Epoch 4 Iter 213: loss 0.26318. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.00it/s]
Epoch 4 Iter 214: loss 0.23463. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.00it/s]
Epoch 4 Iter 214: loss 0.23463. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:04,  2.01it/s]
Epoch 4 Iter 215: loss 0.24909. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:04,  2.01it/s]
Epoch 4 Iter 215: loss 0.24909. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.02it/s]
Epoch 4 Iter 216: loss 0.23436. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.02it/s]
Epoch 4 Iter 216: loss 0.23436. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.02it/s]
Epoch 4 Iter 217: loss 0.22944. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:03,  2.02it/s]
Epoch 4 Iter 217: loss 0.22944. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.02it/s]
Epoch 4 Iter 218: loss 0.25090. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.02it/s]
Epoch 4 Iter 218: loss 0.25090. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.01it/s]
Epoch 4 Iter 219: loss 0.24300. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.01it/s]
Epoch 4 Iter 219: loss 0.24300. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.03it/s]
Epoch 4 Iter 220: loss 0.22586. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.03it/s]
Epoch 4 Iter 220: loss 0.22586. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:01,  2.02it/s]
Epoch 4 Iter 221: loss 0.22747. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:01,  2.02it/s]
Epoch 4 Iter 221: loss 0.22747. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.04it/s]
Epoch 4 Iter 222: loss 0.25162. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.04it/s]
Epoch 4 Iter 222: loss 0.25162. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.03it/s]
Epoch 4 Iter 223: loss 0.24422. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.03it/s]
Epoch 4 Iter 223: loss 0.24422. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.03it/s]
Epoch 4 Iter 224: loss 0.22248. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.03it/s]
Epoch 4 Iter 224: loss 0.22248. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.03it/s]
Epoch 4 Iter 224: loss 0.22248. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.22477. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.22477. :   0%|▏                                               | 1/224 [00:00<01:51,  2.00it/s]
Epoch 5 Iter 2: loss 0.24164. :   0%|▏                                               | 1/224 [00:01<01:51,  2.00it/s]
Epoch 5 Iter 2: loss 0.24164. :   1%|▍                                               | 2/224 [00:01<01:53,  1.96it/s]
Epoch 5 Iter 3: loss 0.23983. :   1%|▍                                               | 2/224 [00:01<01:53,  1.96it/s]
Epoch 5 Iter 3: loss 0.23983. :   1%|▋                                               | 3/224 [00:01<01:51,  1.98it/s]
Epoch 5 Iter 4: loss 0.23694. :   1%|▋                                               | 3/224 [00:02<01:51,  1.98it/s]
Epoch 5 Iter 4: loss 0.23694. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 5 Iter 5: loss 0.22898. :   2%|▊                                               | 4/224 [00:02<01:50,  1.99it/s]
Epoch 5 Iter 5: loss 0.22898. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 5 Iter 6: loss 0.24589. :   2%|█                                               | 5/224 [00:03<01:49,  2.00it/s]
Epoch 5 Iter 6: loss 0.24589. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.00it/s]
Epoch 5 Iter 7: loss 0.23347. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.00it/s]
Epoch 5 Iter 7: loss 0.23347. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 5 Iter 8: loss 0.23018. :   3%|█▌                                              | 7/224 [00:04<01:48,  2.00it/s]
Epoch 5 Iter 8: loss 0.23018. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 5 Iter 9: loss 0.24057. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 5 Iter 9: loss 0.24057. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.02it/s]
Epoch 5 Iter 10: loss 0.25382. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 5 Iter 10: loss 0.25382. :   4%|██                                            | 10/224 [00:04<01:45,  2.02it/s]
Epoch 5 Iter 11: loss 0.22154. :   4%|██                                            | 10/224 [00:05<01:45,  2.02it/s]
Epoch 5 Iter 11: loss 0.22154. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 5 Iter 12: loss 0.22427. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 5 Iter 12: loss 0.22427. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.02it/s]
Epoch 5 Iter 13: loss 0.24150. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.02it/s]
Epoch 5 Iter 13: loss 0.24150. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.03it/s]
Epoch 5 Iter 14: loss 0.21407. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.03it/s]
Epoch 5 Iter 14: loss 0.21407. :   6%|██▉                                           | 14/224 [00:06<01:43,  2.02it/s]
Epoch 5 Iter 15: loss 0.23889. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.02it/s]
Epoch 5 Iter 15: loss 0.23889. :   7%|███                                           | 15/224 [00:07<01:42,  2.04it/s]
Epoch 5 Iter 16: loss 0.25183. :   7%|███                                           | 15/224 [00:07<01:42,  2.04it/s]
Epoch 5 Iter 16: loss 0.25183. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.03it/s]
Epoch 5 Iter 17: loss 0.24765. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.03it/s]
Epoch 5 Iter 17: loss 0.24765. :   8%|███▍                                          | 17/224 [00:08<01:41,  2.03it/s]
Epoch 5 Iter 18: loss 0.22192. :   8%|███▍                                          | 17/224 [00:08<01:41,  2.03it/s]
Epoch 5 Iter 18: loss 0.22192. :   8%|███▋                                          | 18/224 [00:08<01:41,  2.04it/s]
Epoch 5 Iter 19: loss 0.24014. :   8%|███▋                                          | 18/224 [00:09<01:41,  2.04it/s]
Epoch 5 Iter 19: loss 0.24014. :   8%|███▉                                          | 19/224 [00:09<01:40,  2.03it/s]
Epoch 5 Iter 20: loss 0.23017. :   8%|███▉                                          | 19/224 [00:09<01:40,  2.03it/s]
Epoch 5 Iter 20: loss 0.23017. :   9%|████                                          | 20/224 [00:09<01:40,  2.03it/s]
Epoch 5 Iter 21: loss 0.24943. :   9%|████                                          | 20/224 [00:10<01:40,  2.03it/s]
Epoch 5 Iter 21: loss 0.24943. :   9%|████▎                                         | 21/224 [00:10<01:39,  2.03it/s]
Epoch 5 Iter 22: loss 0.24159. :   9%|████▎                                         | 21/224 [00:10<01:39,  2.03it/s]
Epoch 5 Iter 22: loss 0.24159. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.03it/s]
Epoch 5 Iter 23: loss 0.25693. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 23: loss 0.25693. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 5 Iter 24: loss 0.23063. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 5 Iter 24: loss 0.23063. :  11%|████▉                                         | 24/224 [00:11<01:40,  2.00it/s]
Epoch 5 Iter 25: loss 0.24494. :  11%|████▉                                         | 24/224 [00:12<01:40,  2.00it/s]
Epoch 5 Iter 25: loss 0.24494. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 5 Iter 26: loss 0.22444. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 5 Iter 26: loss 0.22444. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.00it/s]
Epoch 5 Iter 27: loss 0.22993. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.00it/s]
Epoch 5 Iter 27: loss 0.22993. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 5 Iter 28: loss 0.23475. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 5 Iter 28: loss 0.23475. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.02it/s]
Epoch 5 Iter 29: loss 0.22582. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.02it/s]
Epoch 5 Iter 29: loss 0.22582. :  13%|█████▉                                        | 29/224 [00:14<01:37,  2.01it/s]
Epoch 5 Iter 30: loss 0.25747. :  13%|█████▉                                        | 29/224 [00:14<01:37,  2.01it/s]
Epoch 5 Iter 30: loss 0.25747. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.02it/s]
Epoch 5 Iter 31: loss 0.23028. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.02it/s]
Epoch 5 Iter 31: loss 0.23028. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 5 Iter 32: loss 0.23611. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 5 Iter 32: loss 0.23611. :  14%|██████▌                                       | 32/224 [00:15<01:34,  2.03it/s]
Epoch 5 Iter 33: loss 0.24578. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.03it/s]
Epoch 5 Iter 33: loss 0.24578. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 5 Iter 34: loss 0.23218. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 5 Iter 34: loss 0.23218. :  15%|██████▉                                       | 34/224 [00:16<01:33,  2.04it/s]
Epoch 5 Iter 35: loss 0.23703. :  15%|██████▉                                       | 34/224 [00:17<01:33,  2.04it/s]
Epoch 5 Iter 35: loss 0.23703. :  16%|███████▏                                      | 35/224 [00:17<01:32,  2.03it/s]
Epoch 5 Iter 36: loss 0.24579. :  16%|███████▏                                      | 35/224 [00:17<01:32,  2.03it/s]
Epoch 5 Iter 36: loss 0.24579. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.03it/s]
Epoch 5 Iter 37: loss 0.23568. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.03it/s]
Epoch 5 Iter 37: loss 0.23568. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 5 Iter 38: loss 0.23725. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 5 Iter 38: loss 0.23725. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.03it/s]
Epoch 5 Iter 39: loss 0.24106. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.03it/s]
Epoch 5 Iter 39: loss 0.24106. :  17%|████████                                      | 39/224 [00:19<01:31,  2.02it/s]
Epoch 5 Iter 40: loss 0.22294. :  17%|████████                                      | 39/224 [00:19<01:31,  2.02it/s]
Epoch 5 Iter 40: loss 0.22294. :  18%|████████▏                                     | 40/224 [00:19<01:30,  2.03it/s]
Epoch 5 Iter 41: loss 0.24146. :  18%|████████▏                                     | 40/224 [00:20<01:30,  2.03it/s]
Epoch 5 Iter 41: loss 0.24146. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 5 Iter 42: loss 0.22722. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 5 Iter 42: loss 0.22722. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 5 Iter 43: loss 0.23704. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 5 Iter 43: loss 0.23704. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 5 Iter 44: loss 0.21621. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.01it/s]
Epoch 5 Iter 44: loss 0.21621. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.02it/s]
Epoch 5 Iter 45: loss 0.22366. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.02it/s]
Epoch 5 Iter 45: loss 0.22366. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  1.99it/s]
Epoch 5 Iter 46: loss 0.23493. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  1.99it/s]
Epoch 5 Iter 46: loss 0.23493. :  21%|█████████▍                                    | 46/224 [00:22<01:29,  2.00it/s]
Epoch 5 Iter 47: loss 0.23517. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  2.00it/s]
Epoch 5 Iter 47: loss 0.23517. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 5 Iter 48: loss 0.25140. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 5 Iter 48: loss 0.25140. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.00it/s]
Epoch 5 Iter 49: loss 0.22740. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 5 Iter 49: loss 0.22740. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 5 Iter 50: loss 0.22049. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 5 Iter 50: loss 0.22049. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.01it/s]
Epoch 5 Iter 51: loss 0.23018. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 5 Iter 51: loss 0.23018. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.01it/s]
Epoch 5 Iter 52: loss 0.23528. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.01it/s]
Epoch 5 Iter 52: loss 0.23528. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.01it/s]
Epoch 5 Iter 53: loss 0.24598. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 5 Iter 53: loss 0.24598. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 5 Iter 54: loss 0.23432. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.02it/s]
Epoch 5 Iter 54: loss 0.23432. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.01it/s]
Epoch 5 Iter 55: loss 0.21071. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 5 Iter 55: loss 0.21071. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 5 Iter 56: loss 0.23231. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 5 Iter 56: loss 0.23231. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.02it/s]
Epoch 5 Iter 57: loss 0.24489. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 5 Iter 57: loss 0.24489. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.02it/s]
Epoch 5 Iter 58: loss 0.24051. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.02it/s]
Epoch 5 Iter 58: loss 0.24051. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.02it/s]
Epoch 5 Iter 59: loss 0.21609. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.02it/s]
Epoch 5 Iter 59: loss 0.21609. :  26%|████████████                                  | 59/224 [00:29<01:21,  2.01it/s]
Epoch 5 Iter 60: loss 0.23408. :  26%|████████████                                  | 59/224 [00:29<01:21,  2.01it/s]
Epoch 5 Iter 60: loss 0.23408. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.02it/s]
Epoch 5 Iter 61: loss 0.23338. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.02it/s]
Epoch 5 Iter 61: loss 0.23338. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 5 Iter 62: loss 0.25481. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 5 Iter 62: loss 0.25481. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.02it/s]
Epoch 5 Iter 63: loss 0.26004. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.02it/s]
Epoch 5 Iter 63: loss 0.26004. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.03it/s]
Epoch 5 Iter 64: loss 0.22191. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.03it/s]
Epoch 5 Iter 64: loss 0.22191. :  29%|█████████████▏                                | 64/224 [00:31<01:21,  1.95it/s]
Epoch 5 Iter 65: loss 0.23391. :  29%|█████████████▏                                | 64/224 [00:32<01:21,  1.95it/s]
Epoch 5 Iter 65: loss 0.23391. :  29%|█████████████▎                                | 65/224 [00:32<01:21,  1.96it/s]
Epoch 5 Iter 66: loss 0.25404. :  29%|█████████████▎                                | 65/224 [00:32<01:21,  1.96it/s]
Epoch 5 Iter 66: loss 0.25404. :  29%|█████████████▌                                | 66/224 [00:32<01:20,  1.97it/s]
Epoch 5 Iter 67: loss 0.21262. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.97it/s]
Epoch 5 Iter 67: loss 0.21262. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.98it/s]
Epoch 5 Iter 68: loss 0.26507. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.98it/s]
Epoch 5 Iter 68: loss 0.26507. :  30%|█████████████▉                                | 68/224 [00:33<01:18,  1.99it/s]
Epoch 5 Iter 69: loss 0.22782. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.99it/s]
Epoch 5 Iter 69: loss 0.22782. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 5 Iter 70: loss 0.24858. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 5 Iter 70: loss 0.24858. :  31%|██████████████▍                               | 70/224 [00:34<01:16,  2.01it/s]
Epoch 5 Iter 71: loss 0.24247. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.01it/s]
Epoch 5 Iter 71: loss 0.24247. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.02it/s]
Epoch 5 Iter 72: loss 0.24570. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.02it/s]
Epoch 5 Iter 72: loss 0.24570. :  32%|██████████████▊                               | 72/224 [00:35<01:14,  2.03it/s]
Epoch 5 Iter 73: loss 0.24365. :  32%|██████████████▊                               | 72/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 73: loss 0.24365. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.04it/s]
Epoch 5 Iter 74: loss 0.23998. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.04it/s]
Epoch 5 Iter 74: loss 0.23998. :  33%|███████████████▏                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 5 Iter 75: loss 0.25520. :  33%|███████████████▏                              | 74/224 [00:37<01:13,  2.03it/s]
Epoch 5 Iter 75: loss 0.25520. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  2.01it/s]
Epoch 5 Iter 76: loss 0.22414. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  2.01it/s]
Epoch 5 Iter 76: loss 0.22414. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.00it/s]
Epoch 5 Iter 77: loss 0.22562. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.00it/s]
Epoch 5 Iter 77: loss 0.22562. :  34%|███████████████▊                              | 77/224 [00:38<01:13,  2.00it/s]
Epoch 5 Iter 78: loss 0.26576. :  34%|███████████████▊                              | 77/224 [00:38<01:13,  2.00it/s]
Epoch 5 Iter 78: loss 0.26576. :  35%|████████████████                              | 78/224 [00:38<01:14,  1.96it/s]
Epoch 5 Iter 79: loss 0.24644. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.96it/s]
Epoch 5 Iter 79: loss 0.24644. :  35%|████████████████▏                             | 79/224 [00:39<01:14,  1.94it/s]
Epoch 5 Iter 80: loss 0.23104. :  35%|████████████████▏                             | 79/224 [00:39<01:14,  1.94it/s]
Epoch 5 Iter 80: loss 0.23104. :  36%|████████████████▍                             | 80/224 [00:39<01:13,  1.96it/s]
Epoch 5 Iter 81: loss 0.24102. :  36%|████████████████▍                             | 80/224 [00:40<01:13,  1.96it/s]
Epoch 5 Iter 81: loss 0.24102. :  36%|████████████████▋                             | 81/224 [00:40<01:15,  1.89it/s]
Epoch 5 Iter 82: loss 0.24299. :  36%|████████████████▋                             | 81/224 [00:40<01:15,  1.89it/s]
Epoch 5 Iter 82: loss 0.24299. :  37%|████████████████▊                             | 82/224 [00:40<01:14,  1.89it/s]
Epoch 5 Iter 83: loss 0.22131. :  37%|████████████████▊                             | 82/224 [00:41<01:14,  1.89it/s]
Epoch 5 Iter 83: loss 0.22131. :  37%|█████████████████                             | 83/224 [00:41<01:13,  1.92it/s]
Epoch 5 Iter 84: loss 0.24816. :  37%|█████████████████                             | 83/224 [00:41<01:13,  1.92it/s]
Epoch 5 Iter 84: loss 0.24816. :  38%|█████████████████▎                            | 84/224 [00:41<01:13,  1.92it/s]
Epoch 5 Iter 85: loss 0.23294. :  38%|█████████████████▎                            | 84/224 [00:42<01:13,  1.92it/s]
Epoch 5 Iter 85: loss 0.23294. :  38%|█████████████████▍                            | 85/224 [00:42<01:11,  1.93it/s]
Epoch 5 Iter 86: loss 0.22796. :  38%|█████████████████▍                            | 85/224 [00:42<01:11,  1.93it/s]
Epoch 5 Iter 86: loss 0.22796. :  38%|█████████████████▋                            | 86/224 [00:42<01:10,  1.96it/s]
Epoch 5 Iter 87: loss 0.22930. :  38%|█████████████████▋                            | 86/224 [00:43<01:10,  1.96it/s]
Epoch 5 Iter 87: loss 0.22930. :  39%|█████████████████▊                            | 87/224 [00:43<01:09,  1.98it/s]
Epoch 5 Iter 88: loss 0.21825. :  39%|█████████████████▊                            | 87/224 [00:43<01:09,  1.98it/s]
Epoch 5 Iter 88: loss 0.21825. :  39%|██████████████████                            | 88/224 [00:43<01:08,  1.98it/s]
Epoch 5 Iter 89: loss 0.23329. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.98it/s]
Epoch 5 Iter 89: loss 0.23329. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  1.99it/s]
Epoch 5 Iter 90: loss 0.22875. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  1.99it/s]
Epoch 5 Iter 90: loss 0.22875. :  40%|██████████████████▍                           | 90/224 [00:44<01:07,  1.99it/s]
Epoch 5 Iter 91: loss 0.22397. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 5 Iter 91: loss 0.22397. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.98it/s]
Epoch 5 Iter 92: loss 0.23906. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.98it/s]
Epoch 5 Iter 92: loss 0.23906. :  41%|██████████████████▉                           | 92/224 [00:45<01:06,  2.00it/s]
Epoch 5 Iter 93: loss 0.22067. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  2.00it/s]
Epoch 5 Iter 93: loss 0.22067. :  42%|███████████████████                           | 93/224 [00:46<01:05,  1.99it/s]
Epoch 5 Iter 94: loss 0.25680. :  42%|███████████████████                           | 93/224 [00:46<01:05,  1.99it/s]
Epoch 5 Iter 94: loss 0.25680. :  42%|███████████████████▎                          | 94/224 [00:46<01:05,  2.00it/s]
Epoch 5 Iter 95: loss 0.24400. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  2.00it/s]
Epoch 5 Iter 95: loss 0.24400. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 5 Iter 96: loss 0.23686. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 5 Iter 96: loss 0.23686. :  43%|███████████████████▋                          | 96/224 [00:47<01:03,  2.00it/s]
Epoch 5 Iter 97: loss 0.25467. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.00it/s]
Epoch 5 Iter 97: loss 0.25467. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  1.99it/s]
Epoch 5 Iter 98: loss 0.22641. :  43%|███████████████████▉                          | 97/224 [00:49<01:03,  1.99it/s]
Epoch 5 Iter 98: loss 0.22641. :  44%|████████████████████▏                         | 98/224 [00:49<01:06,  1.90it/s]
Epoch 5 Iter 99: loss 0.24568. :  44%|████████████████████▏                         | 98/224 [00:49<01:06,  1.90it/s]
Epoch 5 Iter 99: loss 0.24568. :  44%|████████████████████▎                         | 99/224 [00:49<01:05,  1.92it/s]
Epoch 5 Iter 100: loss 0.23530. :  44%|███████████████████▉                         | 99/224 [00:50<01:05,  1.92it/s]
Epoch 5 Iter 100: loss 0.23530. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.96it/s]
Epoch 5 Iter 101: loss 0.21975. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.96it/s]
Epoch 5 Iter 101: loss 0.21975. :  45%|███████████████████▊                        | 101/224 [00:50<01:02,  1.97it/s]
Epoch 5 Iter 102: loss 0.24312. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.97it/s]
Epoch 5 Iter 102: loss 0.24312. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.99it/s]
Epoch 5 Iter 103: loss 0.21527. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.99it/s]
Epoch 5 Iter 103: loss 0.21527. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 5 Iter 104: loss 0.26472. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  2.00it/s]
Epoch 5 Iter 104: loss 0.26472. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.00it/s]
Epoch 5 Iter 105: loss 0.23251. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.00it/s]
Epoch 5 Iter 105: loss 0.23251. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.01it/s]
Epoch 5 Iter 106: loss 0.22645. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.01it/s]
Epoch 5 Iter 106: loss 0.22645. :  47%|████████████████████▊                       | 106/224 [00:52<00:58,  2.02it/s]
Epoch 5 Iter 107: loss 0.21708. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.02it/s]
Epoch 5 Iter 107: loss 0.21708. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 5 Iter 108: loss 0.26491. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 5 Iter 108: loss 0.26491. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.01it/s]
Epoch 5 Iter 109: loss 0.24551. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 5 Iter 109: loss 0.24551. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.00it/s]
Epoch 5 Iter 110: loss 0.25006. :  49%|█████████████████████▍                      | 109/224 [00:55<00:57,  2.00it/s]
Epoch 5 Iter 110: loss 0.25006. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.99it/s]
Epoch 5 Iter 111: loss 0.24328. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.99it/s]
Epoch 5 Iter 111: loss 0.24328. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.00it/s]
Epoch 5 Iter 112: loss 0.26662. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  2.00it/s]
Epoch 5 Iter 112: loss 0.26662. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  2.00it/s]
Epoch 5 Iter 113: loss 0.21318. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  2.00it/s]
Epoch 5 Iter 113: loss 0.21318. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.00it/s]
Epoch 5 Iter 114: loss 0.23376. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.00it/s]
Epoch 5 Iter 114: loss 0.23376. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.00it/s]
Epoch 5 Iter 115: loss 0.23069. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.00it/s]
Epoch 5 Iter 115: loss 0.23069. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.00it/s]
Epoch 5 Iter 116: loss 0.24446. :  51%|██████████████████████▌                     | 115/224 [00:58<00:54,  2.00it/s]
Epoch 5 Iter 116: loss 0.24446. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.99it/s]
Epoch 5 Iter 117: loss 0.22601. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.99it/s]
Epoch 5 Iter 117: loss 0.22601. :  52%|██████████████████████▉                     | 117/224 [00:58<00:54,  1.96it/s]
Epoch 5 Iter 118: loss 0.22772. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.96it/s]
Epoch 5 Iter 118: loss 0.22772. :  53%|███████████████████████▏                    | 118/224 [00:59<00:56,  1.88it/s]
Epoch 5 Iter 119: loss 0.24068. :  53%|███████████████████████▏                    | 118/224 [00:59<00:56,  1.88it/s]
Epoch 5 Iter 119: loss 0.24068. :  53%|███████████████████████▍                    | 119/224 [00:59<00:55,  1.88it/s]
Epoch 5 Iter 120: loss 0.25144. :  53%|███████████████████████▍                    | 119/224 [01:00<00:55,  1.88it/s]
Epoch 5 Iter 120: loss 0.25144. :  54%|███████████████████████▌                    | 120/224 [01:00<00:54,  1.90it/s]
Epoch 5 Iter 121: loss 0.22446. :  54%|███████████████████████▌                    | 120/224 [01:00<00:54,  1.90it/s]
Epoch 5 Iter 121: loss 0.22446. :  54%|███████████████████████▊                    | 121/224 [01:00<00:54,  1.89it/s]
Epoch 5 Iter 122: loss 0.23151. :  54%|███████████████████████▊                    | 121/224 [01:01<00:54,  1.89it/s]
Epoch 5 Iter 122: loss 0.23151. :  54%|███████████████████████▉                    | 122/224 [01:01<00:53,  1.91it/s]
Epoch 5 Iter 123: loss 0.22497. :  54%|███████████████████████▉                    | 122/224 [01:01<00:53,  1.91it/s]
Epoch 5 Iter 123: loss 0.22497. :  55%|████████████████████████▏                   | 123/224 [01:01<00:52,  1.93it/s]
Epoch 5 Iter 124: loss 0.24325. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.93it/s]
Epoch 5 Iter 124: loss 0.24325. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.97it/s]
Epoch 5 Iter 125: loss 0.24572. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.97it/s]
Epoch 5 Iter 125: loss 0.24572. :  56%|████████████████████████▌                   | 125/224 [01:02<00:50,  1.98it/s]
Epoch 5 Iter 126: loss 0.25207. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.98it/s]
Epoch 5 Iter 126: loss 0.25207. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.99it/s]
Epoch 5 Iter 127: loss 0.23243. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.99it/s]
Epoch 5 Iter 127: loss 0.23243. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.01it/s]
Epoch 5 Iter 128: loss 0.24607. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.01it/s]
Epoch 5 Iter 128: loss 0.24607. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 5 Iter 129: loss 0.23155. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 5 Iter 129: loss 0.23155. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.24723. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.24723. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 5 Iter 131: loss 0.21455. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 5 Iter 131: loss 0.21455. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.22934. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.22934. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.02it/s]
Epoch 5 Iter 133: loss 0.23945. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.02it/s]
Epoch 5 Iter 133: loss 0.23945. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.02it/s]
Epoch 5 Iter 134: loss 0.24439. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  2.02it/s]
Epoch 5 Iter 134: loss 0.24439. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.01it/s]
Epoch 5 Iter 135: loss 0.24306. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.01it/s]
Epoch 5 Iter 135: loss 0.24306. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 5 Iter 136: loss 0.23988. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  2.01it/s]
Epoch 5 Iter 136: loss 0.23988. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 137: loss 0.24071. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 137: loss 0.24071. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 138: loss 0.25279. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.02it/s]
Epoch 5 Iter 138: loss 0.25279. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 5 Iter 139: loss 0.24378. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 5 Iter 139: loss 0.24378. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.00it/s]
Epoch 5 Iter 140: loss 0.22672. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.00it/s]
Epoch 5 Iter 140: loss 0.22672. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 141: loss 0.25454. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 141: loss 0.25454. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 142: loss 0.22949. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.01it/s]
Epoch 5 Iter 142: loss 0.22949. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.24737. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.24737. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.00it/s]
Epoch 5 Iter 144: loss 0.22541. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  2.00it/s]
Epoch 5 Iter 144: loss 0.22541. :  64%|████████████████████████████▎               | 144/224 [01:12<00:41,  1.93it/s]
Epoch 5 Iter 145: loss 0.23650. :  64%|████████████████████████████▎               | 144/224 [01:12<00:41,  1.93it/s]
Epoch 5 Iter 145: loss 0.23650. :  65%|████████████████████████████▍               | 145/224 [01:12<00:40,  1.95it/s]
Epoch 5 Iter 146: loss 0.24937. :  65%|████████████████████████████▍               | 145/224 [01:13<00:40,  1.95it/s]
Epoch 5 Iter 146: loss 0.24937. :  65%|████████████████████████████▋               | 146/224 [01:13<00:39,  1.95it/s]
Epoch 5 Iter 147: loss 0.23874. :  65%|████████████████████████████▋               | 146/224 [01:13<00:39,  1.95it/s]
Epoch 5 Iter 147: loss 0.23874. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  1.98it/s]
Epoch 5 Iter 148: loss 0.24280. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  1.98it/s]
Epoch 5 Iter 148: loss 0.24280. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.99it/s]
Epoch 5 Iter 149: loss 0.25833. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.99it/s]
Epoch 5 Iter 149: loss 0.25833. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 5 Iter 150: loss 0.24110. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.00it/s]
Epoch 5 Iter 150: loss 0.24110. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  2.00it/s]
Epoch 5 Iter 151: loss 0.23496. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  2.00it/s]
Epoch 5 Iter 151: loss 0.23496. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  1.99it/s]
Epoch 5 Iter 152: loss 0.23566. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  1.99it/s]
Epoch 5 Iter 152: loss 0.23566. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 5 Iter 153: loss 0.23614. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 5 Iter 153: loss 0.23614. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 5 Iter 154: loss 0.21012. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.99it/s]
Epoch 5 Iter 154: loss 0.21012. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.01it/s]
Epoch 5 Iter 155: loss 0.23877. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.01it/s]
Epoch 5 Iter 155: loss 0.23877. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.00it/s]
Epoch 5 Iter 156: loss 0.24604. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.00it/s]
Epoch 5 Iter 156: loss 0.24604. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  2.00it/s]
Epoch 5 Iter 157: loss 0.24835. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  2.00it/s]
Epoch 5 Iter 157: loss 0.24835. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 5 Iter 158: loss 0.24089. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.00it/s]
Epoch 5 Iter 158: loss 0.24089. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.00it/s]
Epoch 5 Iter 159: loss 0.24518. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.00it/s]
Epoch 5 Iter 159: loss 0.24518. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.00it/s]
Epoch 5 Iter 160: loss 0.23579. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.00it/s]
Epoch 5 Iter 160: loss 0.23579. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  2.00it/s]
Epoch 5 Iter 161: loss 0.21674. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  2.00it/s]
Epoch 5 Iter 161: loss 0.21674. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.01it/s]
Epoch 5 Iter 162: loss 0.22804. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.01it/s]
Epoch 5 Iter 162: loss 0.22804. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 5 Iter 163: loss 0.24008. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 5 Iter 163: loss 0.24008. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.01it/s]
Epoch 5 Iter 164: loss 0.22689. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.01it/s]
Epoch 5 Iter 164: loss 0.22689. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.01it/s]
Epoch 5 Iter 165: loss 0.20471. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.01it/s]
Epoch 5 Iter 165: loss 0.20471. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:30,  1.94it/s]
Epoch 5 Iter 166: loss 0.22206. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.94it/s]
Epoch 5 Iter 166: loss 0.22206. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:30,  1.87it/s]
Epoch 5 Iter 167: loss 0.21204. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:30,  1.87it/s]
Epoch 5 Iter 167: loss 0.21204. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:30,  1.88it/s]
Epoch 5 Iter 168: loss 0.23719. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:30,  1.88it/s]
Epoch 5 Iter 168: loss 0.23719. :  75%|█████████████████████████████████           | 168/224 [01:24<00:29,  1.90it/s]
Epoch 5 Iter 169: loss 0.23268. :  75%|█████████████████████████████████           | 168/224 [01:24<00:29,  1.90it/s]
Epoch 5 Iter 169: loss 0.23268. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:29,  1.89it/s]
Epoch 5 Iter 170: loss 0.23623. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:29,  1.89it/s]
Epoch 5 Iter 170: loss 0.23623. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:28,  1.90it/s]
Epoch 5 Iter 171: loss 0.23410. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:28,  1.90it/s]
Epoch 5 Iter 171: loss 0.23410. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:27,  1.90it/s]
Epoch 5 Iter 172: loss 0.24373. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:27,  1.90it/s]
Epoch 5 Iter 172: loss 0.24373. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:27,  1.89it/s]
Epoch 5 Iter 173: loss 0.24897. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:27,  1.89it/s]
Epoch 5 Iter 173: loss 0.24897. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:27,  1.87it/s]
Epoch 5 Iter 174: loss 0.24417. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:27,  1.87it/s]
Epoch 5 Iter 174: loss 0.24417. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:26,  1.90it/s]
Epoch 5 Iter 175: loss 0.26374. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:26,  1.90it/s]
Epoch 5 Iter 175: loss 0.26374. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:25,  1.94it/s]
Epoch 5 Iter 176: loss 0.25885. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:25,  1.94it/s]
Epoch 5 Iter 176: loss 0.25885. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:24,  1.97it/s]
Epoch 5 Iter 177: loss 0.24146. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:24,  1.97it/s]
Epoch 5 Iter 177: loss 0.24146. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  1.99it/s]
Epoch 5 Iter 178: loss 0.23646. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  1.99it/s]
Epoch 5 Iter 178: loss 0.23646. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:23,  2.00it/s]
Epoch 5 Iter 179: loss 0.23604. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:23,  2.00it/s]
Epoch 5 Iter 179: loss 0.23604. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.01it/s]
Epoch 5 Iter 180: loss 0.23104. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.01it/s]
Epoch 5 Iter 180: loss 0.23104. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.01it/s]
Epoch 5 Iter 181: loss 0.22911. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.01it/s]
Epoch 5 Iter 181: loss 0.22911. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.00it/s]
Epoch 5 Iter 182: loss 0.25204. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.00it/s]
Epoch 5 Iter 182: loss 0.25204. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.00it/s]
Epoch 5 Iter 183: loss 0.24235. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.00it/s]
Epoch 5 Iter 183: loss 0.24235. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.00it/s]
Epoch 5 Iter 184: loss 0.24119. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.00it/s]
Epoch 5 Iter 184: loss 0.24119. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.00it/s]
Epoch 5 Iter 185: loss 0.24347. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.00it/s]
Epoch 5 Iter 185: loss 0.24347. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.01it/s]
Epoch 5 Iter 186: loss 0.23835. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  2.01it/s]
Epoch 5 Iter 186: loss 0.23835. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 187: loss 0.22181. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 187: loss 0.22181. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 188: loss 0.24710. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  2.02it/s]
Epoch 5 Iter 188: loss 0.24710. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:17,  2.01it/s]
Epoch 5 Iter 189: loss 0.25525. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:17,  2.01it/s]
Epoch 5 Iter 189: loss 0.25525. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.01it/s]
Epoch 5 Iter 190: loss 0.25227. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  2.01it/s]
Epoch 5 Iter 190: loss 0.25227. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:16,  2.01it/s]
Epoch 5 Iter 191: loss 0.25988. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:16,  2.01it/s]
Epoch 5 Iter 191: loss 0.25988. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.02it/s]
Epoch 5 Iter 192: loss 0.21072. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  2.02it/s]
Epoch 5 Iter 192: loss 0.21072. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:15,  2.01it/s]
Epoch 5 Iter 193: loss 0.23490. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:15,  2.01it/s]
Epoch 5 Iter 193: loss 0.23490. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.01it/s]
Epoch 5 Iter 194: loss 0.23937. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.01it/s]
Epoch 5 Iter 194: loss 0.23937. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.01it/s]
Epoch 5 Iter 195: loss 0.22888. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.01it/s]
Epoch 5 Iter 195: loss 0.22888. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.01it/s]
Epoch 5 Iter 196: loss 0.23254. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.01it/s]
Epoch 5 Iter 196: loss 0.23254. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 197: loss 0.21877. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 197: loss 0.21877. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 198: loss 0.22818. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.01it/s]
Epoch 5 Iter 198: loss 0.22818. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:13,  2.00it/s]
Epoch 5 Iter 199: loss 0.23486. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:13,  2.00it/s]
Epoch 5 Iter 199: loss 0.23486. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 5 Iter 200: loss 0.23333. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.00it/s]
Epoch 5 Iter 200: loss 0.23333. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  2.00it/s]
Epoch 5 Iter 201: loss 0.23991. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  2.00it/s]
Epoch 5 Iter 201: loss 0.23991. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 5 Iter 202: loss 0.25511. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 5 Iter 202: loss 0.25511. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.01it/s]
Epoch 5 Iter 203: loss 0.22314. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.01it/s]
Epoch 5 Iter 203: loss 0.22314. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.01it/s]
Epoch 5 Iter 204: loss 0.21532. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.01it/s]
Epoch 5 Iter 204: loss 0.21532. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.23170. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.23170. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.22201. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.22201. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.23971. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.23971. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.01it/s]
Epoch 5 Iter 208: loss 0.26349. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.01it/s]
Epoch 5 Iter 208: loss 0.26349. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.99it/s]
Epoch 5 Iter 209: loss 0.24602. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.99it/s]
Epoch 5 Iter 209: loss 0.24602. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  1.99it/s]
Epoch 5 Iter 210: loss 0.23962. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  1.99it/s]
Epoch 5 Iter 210: loss 0.23962. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:06,  2.00it/s]
Epoch 5 Iter 211: loss 0.26392. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:06,  2.00it/s]
Epoch 5 Iter 211: loss 0.26392. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.01it/s]
Epoch 5 Iter 212: loss 0.23635. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.01it/s]
Epoch 5 Iter 212: loss 0.23635. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.01it/s]
Epoch 5 Iter 213: loss 0.22495. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.01it/s]
Epoch 5 Iter 213: loss 0.22495. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.00it/s]
Epoch 5 Iter 214: loss 0.22778. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.00it/s]
Epoch 5 Iter 214: loss 0.22778. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  2.00it/s]
Epoch 5 Iter 215: loss 0.25466. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  2.00it/s]
Epoch 5 Iter 215: loss 0.25466. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.99it/s]
Epoch 5 Iter 216: loss 0.24624. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  1.99it/s]
Epoch 5 Iter 216: loss 0.24624. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.98it/s]
Epoch 5 Iter 217: loss 0.21622. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.98it/s]
Epoch 5 Iter 217: loss 0.21622. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  1.97it/s]
Epoch 5 Iter 218: loss 0.22249. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  1.97it/s]
Epoch 5 Iter 218: loss 0.22249. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.97it/s]
Epoch 5 Iter 219: loss 0.23773. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.97it/s]
Epoch 5 Iter 219: loss 0.23773. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.98it/s]
Epoch 5 Iter 220: loss 0.24643. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  1.98it/s]
Epoch 5 Iter 220: loss 0.24643. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 5 Iter 221: loss 0.25194. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 5 Iter 221: loss 0.25194. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.97it/s]
Epoch 5 Iter 222: loss 0.24896. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  1.97it/s]
Epoch 5 Iter 222: loss 0.24896. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:01,  1.97it/s]
Epoch 5 Iter 223: loss 0.22295. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:01,  1.97it/s]
Epoch 5 Iter 223: loss 0.22295. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  1.98it/s]
Epoch 5 Iter 224: loss 0.23246. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  1.98it/s]
Epoch 5 Iter 224: loss 0.23246. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  1.98it/s]
Epoch 5 Iter 224: loss 0.23246. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  1.99it/s]

    Train loss: 0.23706
    Valid loss: 0.23912
       Valid loss recons: 0.22821
       Valid loss KL-D:   1.0912
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.23981. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.23981. :   0%|▏                                               | 1/224 [00:00<01:51,  2.00it/s]
Epoch 6 Iter 2: loss 0.24156. :   0%|▏                                               | 1/224 [00:01<01:51,  2.00it/s]
Epoch 6 Iter 2: loss 0.24156. :   1%|▍                                               | 2/224 [00:01<01:51,  2.00it/s]
Epoch 6 Iter 3: loss 0.25809. :   1%|▍                                               | 2/224 [00:01<01:51,  2.00it/s]
Epoch 6 Iter 3: loss 0.25809. :   1%|▋                                               | 3/224 [00:01<01:50,  1.99it/s]
Epoch 6 Iter 4: loss 0.23655. :   1%|▋                                               | 3/224 [00:01<01:50,  1.99it/s]
Epoch 6 Iter 4: loss 0.23655. :   2%|▊                                               | 4/224 [00:01<01:49,  2.01it/s]
Epoch 6 Iter 5: loss 0.21738. :   2%|▊                                               | 4/224 [00:02<01:49,  2.01it/s]
Epoch 6 Iter 5: loss 0.21738. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 6 Iter 6: loss 0.22358. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 6 Iter 6: loss 0.22358. :   3%|█▎                                              | 6/224 [00:02<01:47,  2.03it/s]
Epoch 6 Iter 7: loss 0.24548. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.03it/s]
Epoch 6 Iter 7: loss 0.24548. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 8: loss 0.21328. :   3%|█▌                                              | 7/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 8: loss 0.21328. :   4%|█▋                                              | 8/224 [00:03<01:46,  2.03it/s]
Epoch 6 Iter 9: loss 0.24386. :   4%|█▋                                              | 8/224 [00:04<01:46,  2.03it/s]
Epoch 6 Iter 9: loss 0.24386. :   4%|█▉                                              | 9/224 [00:04<01:45,  2.03it/s]
Epoch 6 Iter 10: loss 0.23383. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.03it/s]
Epoch 6 Iter 10: loss 0.23383. :   4%|██                                            | 10/224 [00:04<01:45,  2.03it/s]
Epoch 6 Iter 11: loss 0.24422. :   4%|██                                            | 10/224 [00:05<01:45,  2.03it/s]
Epoch 6 Iter 11: loss 0.24422. :   5%|██▎                                           | 11/224 [00:05<01:44,  2.03it/s]
Epoch 6 Iter 12: loss 0.23600. :   5%|██▎                                           | 11/224 [00:05<01:44,  2.03it/s]
Epoch 6 Iter 12: loss 0.23600. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.03it/s]
Epoch 6 Iter 13: loss 0.25327. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.03it/s]
Epoch 6 Iter 13: loss 0.25327. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.02it/s]
Epoch 6 Iter 14: loss 0.22527. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.02it/s]
Epoch 6 Iter 14: loss 0.22527. :   6%|██▉                                           | 14/224 [00:06<01:44,  2.01it/s]
Epoch 6 Iter 15: loss 0.21104. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.01it/s]
Epoch 6 Iter 15: loss 0.21104. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 6 Iter 16: loss 0.23089. :   7%|███                                           | 15/224 [00:07<01:43,  2.01it/s]
Epoch 6 Iter 16: loss 0.23089. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.01it/s]
Epoch 6 Iter 17: loss 0.23726. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.01it/s]
Epoch 6 Iter 17: loss 0.23726. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.01it/s]
Epoch 6 Iter 18: loss 0.22376. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.01it/s]
Epoch 6 Iter 18: loss 0.22376. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.02it/s]
Epoch 6 Iter 19: loss 0.23137. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 6 Iter 19: loss 0.23137. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.24391. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.24391. :   9%|████                                          | 20/224 [00:09<01:40,  2.02it/s]
Epoch 6 Iter 21: loss 0.23601. :   9%|████                                          | 20/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 21: loss 0.23601. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 22: loss 0.22811. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 22: loss 0.22811. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.02it/s]
Epoch 6 Iter 23: loss 0.23836. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 23: loss 0.23836. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.23024. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.23024. :  11%|████▉                                         | 24/224 [00:11<01:38,  2.02it/s]
Epoch 6 Iter 25: loss 0.21833. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.02it/s]
Epoch 6 Iter 25: loss 0.21833. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 6 Iter 26: loss 0.23845. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 6 Iter 26: loss 0.23845. :  12%|█████▎                                        | 26/224 [00:12<01:37,  2.03it/s]
Epoch 6 Iter 27: loss 0.22895. :  12%|█████▎                                        | 26/224 [00:13<01:37,  2.03it/s]
Epoch 6 Iter 27: loss 0.22895. :  12%|█████▌                                        | 27/224 [00:13<01:36,  2.03it/s]
Epoch 6 Iter 28: loss 0.23633. :  12%|█████▌                                        | 27/224 [00:13<01:36,  2.03it/s]
Epoch 6 Iter 28: loss 0.23633. :  12%|█████▊                                        | 28/224 [00:13<01:36,  2.02it/s]
Epoch 6 Iter 29: loss 0.22296. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.02it/s]
Epoch 6 Iter 29: loss 0.22296. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 6 Iter 30: loss 0.22740. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 6 Iter 30: loss 0.22740. :  13%|██████▏                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 6 Iter 31: loss 0.24744. :  13%|██████▏                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 6 Iter 31: loss 0.24744. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 6 Iter 32: loss 0.23550. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 6 Iter 32: loss 0.23550. :  14%|██████▌                                       | 32/224 [00:15<01:35,  2.01it/s]
Epoch 6 Iter 33: loss 0.25824. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.01it/s]
Epoch 6 Iter 33: loss 0.25824. :  15%|██████▊                                       | 33/224 [00:16<01:35,  2.00it/s]
Epoch 6 Iter 34: loss 0.23613. :  15%|██████▊                                       | 33/224 [00:16<01:35,  2.00it/s]
Epoch 6 Iter 34: loss 0.23613. :  15%|██████▉                                       | 34/224 [00:16<01:34,  2.00it/s]
Epoch 6 Iter 35: loss 0.22719. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.00it/s]
Epoch 6 Iter 35: loss 0.22719. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 6 Iter 36: loss 0.23218. :  16%|███████▏                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 6 Iter 36: loss 0.23218. :  16%|███████▍                                      | 36/224 [00:17<01:35,  1.96it/s]
Epoch 6 Iter 37: loss 0.24078. :  16%|███████▍                                      | 36/224 [00:18<01:35,  1.96it/s]
Epoch 6 Iter 37: loss 0.24078. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.99it/s]
Epoch 6 Iter 38: loss 0.23343. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.99it/s]
Epoch 6 Iter 38: loss 0.23343. :  17%|███████▊                                      | 38/224 [00:18<01:34,  1.97it/s]
Epoch 6 Iter 39: loss 0.24318. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.97it/s]
Epoch 6 Iter 39: loss 0.24318. :  17%|████████                                      | 39/224 [00:19<01:33,  1.99it/s]
Epoch 6 Iter 40: loss 0.21729. :  17%|████████                                      | 39/224 [00:19<01:33,  1.99it/s]
Epoch 6 Iter 40: loss 0.21729. :  18%|████████▏                                     | 40/224 [00:19<01:32,  1.99it/s]
Epoch 6 Iter 41: loss 0.23100. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 6 Iter 41: loss 0.23100. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 6 Iter 42: loss 0.23834. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 6 Iter 42: loss 0.23834. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 6 Iter 43: loss 0.24160. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 6 Iter 43: loss 0.24160. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.25260. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.25260. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.01it/s]
Epoch 6 Iter 45: loss 0.21722. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 6 Iter 45: loss 0.21722. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 6 Iter 46: loss 0.25705. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 6 Iter 46: loss 0.25705. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 47: loss 0.23925. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.02it/s]
Epoch 6 Iter 47: loss 0.23925. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.02it/s]
Epoch 6 Iter 48: loss 0.23306. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.02it/s]
Epoch 6 Iter 48: loss 0.23306. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.02it/s]
Epoch 6 Iter 49: loss 0.25019. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.02it/s]
Epoch 6 Iter 49: loss 0.25019. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 6 Iter 50: loss 0.23207. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 6 Iter 50: loss 0.23207. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.02it/s]
Epoch 6 Iter 51: loss 0.22181. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.02it/s]
Epoch 6 Iter 51: loss 0.22181. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 52: loss 0.25229. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 6 Iter 52: loss 0.25229. :  23%|██████████▋                                   | 52/224 [00:25<01:24,  2.03it/s]
Epoch 6 Iter 53: loss 0.23284. :  23%|██████████▋                                   | 52/224 [00:26<01:24,  2.03it/s]
Epoch 6 Iter 53: loss 0.23284. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.03it/s]
Epoch 6 Iter 54: loss 0.23588. :  24%|██████████▉                                   | 53/224 [00:26<01:24,  2.03it/s]
Epoch 6 Iter 54: loss 0.23588. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.02it/s]
Epoch 6 Iter 55: loss 0.24417. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.02it/s]
Epoch 6 Iter 55: loss 0.24417. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 6 Iter 56: loss 0.26174. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 6 Iter 56: loss 0.26174. :  25%|███████████▌                                  | 56/224 [00:27<01:22,  2.03it/s]
Epoch 6 Iter 57: loss 0.23976. :  25%|███████████▌                                  | 56/224 [00:28<01:22,  2.03it/s]
Epoch 6 Iter 57: loss 0.23976. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 6 Iter 58: loss 0.22191. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 6 Iter 58: loss 0.22191. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.00it/s]
Epoch 6 Iter 59: loss 0.24751. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.00it/s]
Epoch 6 Iter 59: loss 0.24751. :  26%|████████████                                  | 59/224 [00:29<01:21,  2.02it/s]
Epoch 6 Iter 60: loss 0.25576. :  26%|████████████                                  | 59/224 [00:29<01:21,  2.02it/s]
Epoch 6 Iter 60: loss 0.25576. :  27%|████████████▎                                 | 60/224 [00:29<01:20,  2.03it/s]
Epoch 6 Iter 61: loss 0.22932. :  27%|████████████▎                                 | 60/224 [00:30<01:20,  2.03it/s]
Epoch 6 Iter 61: loss 0.22932. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 6 Iter 62: loss 0.24703. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 6 Iter 62: loss 0.24703. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.01it/s]
Epoch 6 Iter 63: loss 0.20714. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 6 Iter 63: loss 0.20714. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 6 Iter 64: loss 0.21760. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 6 Iter 64: loss 0.21760. :  29%|█████████████▏                                | 64/224 [00:31<01:19,  2.02it/s]
Epoch 6 Iter 65: loss 0.23483. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 6 Iter 65: loss 0.23483. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 6 Iter 66: loss 0.23664. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 6 Iter 66: loss 0.23664. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.01it/s]
Epoch 6 Iter 67: loss 0.24774. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 6 Iter 67: loss 0.24774. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 6 Iter 68: loss 0.23724. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 6 Iter 68: loss 0.23724. :  30%|█████████████▉                                | 68/224 [00:33<01:16,  2.03it/s]
Epoch 6 Iter 69: loss 0.25424. :  30%|█████████████▉                                | 68/224 [00:34<01:16,  2.03it/s]
Epoch 6 Iter 69: loss 0.25424. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.04it/s]
Epoch 6 Iter 70: loss 0.23298. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.04it/s]
Epoch 6 Iter 70: loss 0.23298. :  31%|██████████████▍                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 6 Iter 71: loss 0.22114. :  31%|██████████████▍                               | 70/224 [00:35<01:15,  2.04it/s]
Epoch 6 Iter 71: loss 0.22114. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.03it/s]
Epoch 6 Iter 72: loss 0.23259. :  32%|██████████████▌                               | 71/224 [00:35<01:15,  2.03it/s]
Epoch 6 Iter 72: loss 0.23259. :  32%|██████████████▊                               | 72/224 [00:35<01:15,  2.02it/s]
Epoch 6 Iter 73: loss 0.23473. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.02it/s]
Epoch 6 Iter 73: loss 0.23473. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.02it/s]
Epoch 6 Iter 74: loss 0.24040. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.02it/s]
Epoch 6 Iter 74: loss 0.24040. :  33%|███████████████▏                              | 74/224 [00:36<01:14,  2.01it/s]
Epoch 6 Iter 75: loss 0.24514. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.01it/s]
Epoch 6 Iter 75: loss 0.24514. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 6 Iter 76: loss 0.23637. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 6 Iter 76: loss 0.23637. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.02it/s]
Epoch 6 Iter 77: loss 0.27966. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 6 Iter 77: loss 0.27966. :  34%|███████████████▊                              | 77/224 [00:38<01:11,  2.05it/s]
Epoch 6 Iter 78: loss 0.24000. :  34%|███████████████▊                              | 77/224 [00:38<01:11,  2.05it/s]
Epoch 6 Iter 78: loss 0.24000. :  35%|████████████████                              | 78/224 [00:38<01:11,  2.04it/s]
Epoch 6 Iter 79: loss 0.24099. :  35%|████████████████                              | 78/224 [00:39<01:11,  2.04it/s]
Epoch 6 Iter 79: loss 0.24099. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.03it/s]
Epoch 6 Iter 80: loss 0.23672. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.03it/s]
Epoch 6 Iter 80: loss 0.23672. :  36%|████████████████▍                             | 80/224 [00:39<01:13,  1.97it/s]
Epoch 6 Iter 81: loss 0.24458. :  36%|████████████████▍                             | 80/224 [00:40<01:13,  1.97it/s]
Epoch 6 Iter 81: loss 0.24458. :  36%|████████████████▋                             | 81/224 [00:40<01:12,  1.97it/s]
Epoch 6 Iter 82: loss 0.24778. :  36%|████████████████▋                             | 81/224 [00:40<01:12,  1.97it/s]
Epoch 6 Iter 82: loss 0.24778. :  37%|████████████████▊                             | 82/224 [00:40<01:11,  1.98it/s]
Epoch 6 Iter 83: loss 0.25114. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.98it/s]
Epoch 6 Iter 83: loss 0.25114. :  37%|█████████████████                             | 83/224 [00:41<01:10,  2.01it/s]
Epoch 6 Iter 84: loss 0.24671. :  37%|█████████████████                             | 83/224 [00:41<01:10,  2.01it/s]
Epoch 6 Iter 84: loss 0.24671. :  38%|█████████████████▎                            | 84/224 [00:41<01:09,  2.00it/s]
Epoch 6 Iter 85: loss 0.25043. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.00it/s]
Epoch 6 Iter 85: loss 0.25043. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  2.01it/s]
Epoch 6 Iter 86: loss 0.23831. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  2.01it/s]
Epoch 6 Iter 86: loss 0.23831. :  38%|█████████████████▋                            | 86/224 [00:42<01:08,  2.01it/s]
Epoch 6 Iter 87: loss 0.22775. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.01it/s]
Epoch 6 Iter 87: loss 0.22775. :  39%|█████████████████▊                            | 87/224 [00:43<01:09,  1.97it/s]
Epoch 6 Iter 88: loss 0.23176. :  39%|█████████████████▊                            | 87/224 [00:43<01:09,  1.97it/s]
Epoch 6 Iter 88: loss 0.23176. :  39%|██████████████████                            | 88/224 [00:43<01:08,  1.97it/s]
Epoch 6 Iter 89: loss 0.24204. :  39%|██████████████████                            | 88/224 [00:44<01:08,  1.97it/s]
Epoch 6 Iter 89: loss 0.24204. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  1.99it/s]
Epoch 6 Iter 90: loss 0.24539. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  1.99it/s]
Epoch 6 Iter 90: loss 0.24539. :  40%|██████████████████▍                           | 90/224 [00:44<01:07,  1.99it/s]
Epoch 6 Iter 91: loss 0.23153. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 6 Iter 91: loss 0.23153. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.98it/s]
Epoch 6 Iter 92: loss 0.23252. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.98it/s]
Epoch 6 Iter 92: loss 0.23252. :  41%|██████████████████▉                           | 92/224 [00:45<01:06,  1.99it/s]
Epoch 6 Iter 93: loss 0.23135. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.99it/s]
Epoch 6 Iter 93: loss 0.23135. :  42%|███████████████████                           | 93/224 [00:46<01:07,  1.95it/s]
Epoch 6 Iter 94: loss 0.23885. :  42%|███████████████████                           | 93/224 [00:46<01:07,  1.95it/s]
Epoch 6 Iter 94: loss 0.23885. :  42%|███████████████████▎                          | 94/224 [00:46<01:06,  1.96it/s]
Epoch 6 Iter 95: loss 0.23536. :  42%|███████████████████▎                          | 94/224 [00:47<01:06,  1.96it/s]
Epoch 6 Iter 95: loss 0.23536. :  42%|███████████████████▌                          | 95/224 [00:47<01:05,  1.97it/s]
Epoch 6 Iter 96: loss 0.26717. :  42%|███████████████████▌                          | 95/224 [00:47<01:05,  1.97it/s]
Epoch 6 Iter 96: loss 0.26717. :  43%|███████████████████▋                          | 96/224 [00:47<01:04,  1.99it/s]
Epoch 6 Iter 97: loss 0.21618. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.99it/s]
Epoch 6 Iter 97: loss 0.21618. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 6 Iter 98: loss 0.24731. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 6 Iter 98: loss 0.24731. :  44%|████████████████████▏                         | 98/224 [00:48<01:02,  2.01it/s]
Epoch 6 Iter 99: loss 0.23220. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 6 Iter 99: loss 0.23220. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.00it/s]
Epoch 6 Iter 100: loss 0.23451. :  44%|███████████████████▉                         | 99/224 [00:49<01:02,  2.00it/s]
Epoch 6 Iter 100: loss 0.23451. :  45%|███████████████████▋                        | 100/224 [00:49<01:01,  2.01it/s]
Epoch 6 Iter 101: loss 0.23487. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.01it/s]
Epoch 6 Iter 101: loss 0.23487. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.02it/s]
Epoch 6 Iter 102: loss 0.24555. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.02it/s]
Epoch 6 Iter 102: loss 0.24555. :  46%|████████████████████                        | 102/224 [00:50<01:00,  2.03it/s]
Epoch 6 Iter 103: loss 0.23216. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.03it/s]
Epoch 6 Iter 103: loss 0.23216. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 6 Iter 104: loss 0.23460. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 6 Iter 104: loss 0.23460. :  46%|████████████████████▍                       | 104/224 [00:51<00:59,  2.02it/s]
Epoch 6 Iter 105: loss 0.22453. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 6 Iter 105: loss 0.22453. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.02it/s]
Epoch 6 Iter 106: loss 0.22768. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.02it/s]
Epoch 6 Iter 106: loss 0.22768. :  47%|████████████████████▊                       | 106/224 [00:52<00:58,  2.03it/s]
Epoch 6 Iter 107: loss 0.23813. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.03it/s]
Epoch 6 Iter 107: loss 0.23813. :  48%|█████████████████████                       | 107/224 [00:53<00:57,  2.02it/s]
Epoch 6 Iter 108: loss 0.25559. :  48%|█████████████████████                       | 107/224 [00:53<00:57,  2.02it/s]
Epoch 6 Iter 108: loss 0.25559. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.01it/s]
Epoch 6 Iter 109: loss 0.23273. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 6 Iter 109: loss 0.23273. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 6 Iter 110: loss 0.23614. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 6 Iter 110: loss 0.23614. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 6 Iter 111: loss 0.22189. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 6 Iter 111: loss 0.22189. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 112: loss 0.24207. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 112: loss 0.24207. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.02it/s]
Epoch 6 Iter 113: loss 0.24573. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.02it/s]
Epoch 6 Iter 113: loss 0.24573. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 6 Iter 114: loss 0.24713. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 6 Iter 114: loss 0.24713. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.02it/s]
Epoch 6 Iter 115: loss 0.23490. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.02it/s]
Epoch 6 Iter 115: loss 0.23490. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 6 Iter 116: loss 0.24836. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 6 Iter 116: loss 0.24836. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.02it/s]
Epoch 6 Iter 117: loss 0.22832. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.02it/s]
Epoch 6 Iter 117: loss 0.22832. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.01it/s]
Epoch 6 Iter 118: loss 0.23513. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.01it/s]
Epoch 6 Iter 118: loss 0.23513. :  53%|███████████████████████▏                    | 118/224 [00:58<00:52,  2.00it/s]
Epoch 6 Iter 119: loss 0.24258. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.00it/s]
Epoch 6 Iter 119: loss 0.24258. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.01it/s]
Epoch 6 Iter 120: loss 0.23926. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  2.01it/s]
Epoch 6 Iter 120: loss 0.23926. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.02it/s]
Epoch 6 Iter 121: loss 0.22792. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 6 Iter 121: loss 0.22792. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 6 Iter 122: loss 0.24646. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 6 Iter 122: loss 0.24646. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.01it/s]
Epoch 6 Iter 123: loss 0.22960. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.01it/s]
Epoch 6 Iter 123: loss 0.22960. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 6 Iter 124: loss 0.23833. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 6 Iter 124: loss 0.23833. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.01it/s]
Epoch 6 Iter 125: loss 0.22159. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 6 Iter 125: loss 0.22159. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 6 Iter 126: loss 0.24447. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 6 Iter 126: loss 0.24447. :  56%|████████████████████████▊                   | 126/224 [01:02<00:48,  2.00it/s]
Epoch 6 Iter 127: loss 0.23325. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.00it/s]
Epoch 6 Iter 127: loss 0.23325. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.02it/s]
Epoch 6 Iter 128: loss 0.24737. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.02it/s]
Epoch 6 Iter 128: loss 0.24737. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:47,  2.02it/s]
Epoch 6 Iter 129: loss 0.25074. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.02it/s]
Epoch 6 Iter 129: loss 0.25074. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.00it/s]
Epoch 6 Iter 130: loss 0.23040. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.00it/s]
Epoch 6 Iter 130: loss 0.23040. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.02it/s]
Epoch 6 Iter 131: loss 0.25993. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.02it/s]
Epoch 6 Iter 131: loss 0.25993. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:45,  2.02it/s]
Epoch 6 Iter 132: loss 0.22913. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:45,  2.02it/s]
Epoch 6 Iter 132: loss 0.22913. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.03it/s]
Epoch 6 Iter 133: loss 0.24030. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.03it/s]
Epoch 6 Iter 133: loss 0.24030. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.02it/s]
Epoch 6 Iter 134: loss 0.23368. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.02it/s]
Epoch 6 Iter 134: loss 0.23368. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:45,  1.99it/s]
Epoch 6 Iter 135: loss 0.23448. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.99it/s]
Epoch 6 Iter 135: loss 0.23448. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  1.99it/s]
Epoch 6 Iter 136: loss 0.22796. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  1.99it/s]
Epoch 6 Iter 136: loss 0.22796. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:44,  1.98it/s]
Epoch 6 Iter 137: loss 0.22797. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.98it/s]
Epoch 6 Iter 137: loss 0.22797. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  1.99it/s]
Epoch 6 Iter 138: loss 0.20678. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  1.99it/s]
Epoch 6 Iter 138: loss 0.20678. :  62%|███████████████████████████                 | 138/224 [01:08<00:43,  1.99it/s]
Epoch 6 Iter 139: loss 0.26603. :  62%|███████████████████████████                 | 138/224 [01:09<00:43,  1.99it/s]
Epoch 6 Iter 139: loss 0.26603. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.00it/s]
Epoch 6 Iter 140: loss 0.23731. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.00it/s]
Epoch 6 Iter 140: loss 0.23731. :  62%|███████████████████████████▌                | 140/224 [01:09<00:41,  2.01it/s]
Epoch 6 Iter 141: loss 0.22004. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 6 Iter 141: loss 0.22004. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 6 Iter 142: loss 0.24137. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 6 Iter 142: loss 0.24137. :  63%|███████████████████████████▉                | 142/224 [01:10<00:41,  2.00it/s]
Epoch 6 Iter 143: loss 0.21197. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  2.00it/s]
Epoch 6 Iter 143: loss 0.21197. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.00it/s]
Epoch 6 Iter 144: loss 0.25514. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.00it/s]
Epoch 6 Iter 144: loss 0.25514. :  64%|████████████████████████████▎               | 144/224 [01:11<00:39,  2.00it/s]
Epoch 6 Iter 145: loss 0.21856. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.00it/s]
Epoch 6 Iter 145: loss 0.21856. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.01it/s]
Epoch 6 Iter 146: loss 0.23391. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.01it/s]
Epoch 6 Iter 146: loss 0.23391. :  65%|████████████████████████████▋               | 146/224 [01:12<00:38,  2.01it/s]
Epoch 6 Iter 147: loss 0.23798. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 6 Iter 147: loss 0.23798. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.00it/s]
Epoch 6 Iter 148: loss 0.23102. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.00it/s]
Epoch 6 Iter 148: loss 0.23102. :  66%|█████████████████████████████               | 148/224 [01:13<00:37,  2.00it/s]
Epoch 6 Iter 149: loss 0.22644. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.00it/s]
Epoch 6 Iter 149: loss 0.22644. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 6 Iter 150: loss 0.23065. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 6 Iter 150: loss 0.23065. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:37,  2.00it/s]
Epoch 6 Iter 151: loss 0.23690. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  2.00it/s]
Epoch 6 Iter 151: loss 0.23690. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.01it/s]
Epoch 6 Iter 152: loss 0.24196. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.01it/s]
Epoch 6 Iter 152: loss 0.24196. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:35,  2.00it/s]
Epoch 6 Iter 153: loss 0.23634. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.00it/s]
Epoch 6 Iter 153: loss 0.23634. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 6 Iter 154: loss 0.24379. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  1.99it/s]
Epoch 6 Iter 154: loss 0.24379. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:35,  1.99it/s]
Epoch 6 Iter 155: loss 0.25471. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:35,  1.99it/s]
Epoch 6 Iter 155: loss 0.25471. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 6 Iter 156: loss 0.23732. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 6 Iter 156: loss 0.23732. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:34,  1.98it/s]
Epoch 6 Iter 157: loss 0.21847. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  1.98it/s]
Epoch 6 Iter 157: loss 0.21847. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 6 Iter 158: loss 0.23157. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.00it/s]
Epoch 6 Iter 158: loss 0.23157. :  71%|███████████████████████████████             | 158/224 [01:18<00:33,  2.00it/s]
Epoch 6 Iter 159: loss 0.24492. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  2.00it/s]
Epoch 6 Iter 159: loss 0.24492. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.24248. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.24248. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:31,  2.01it/s]
Epoch 6 Iter 161: loss 0.24679. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.01it/s]
Epoch 6 Iter 161: loss 0.24679. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.01it/s]
Epoch 6 Iter 162: loss 0.22546. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.01it/s]
Epoch 6 Iter 162: loss 0.22546. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:30,  2.01it/s]
Epoch 6 Iter 163: loss 0.22912. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 6 Iter 163: loss 0.22912. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 6 Iter 164: loss 0.23794. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 6 Iter 164: loss 0.23794. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:29,  2.03it/s]
Epoch 6 Iter 165: loss 0.22763. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.03it/s]
Epoch 6 Iter 165: loss 0.22763. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.02it/s]
Epoch 6 Iter 166: loss 0.22882. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.02it/s]
Epoch 6 Iter 166: loss 0.22882. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:28,  2.02it/s]
Epoch 6 Iter 167: loss 0.22412. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.02it/s]
Epoch 6 Iter 167: loss 0.22412. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 6 Iter 168: loss 0.22722. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 6 Iter 168: loss 0.22722. :  75%|█████████████████████████████████           | 168/224 [01:23<00:27,  2.01it/s]
Epoch 6 Iter 169: loss 0.22623. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.01it/s]
Epoch 6 Iter 169: loss 0.22623. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 6 Iter 170: loss 0.23519. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.02it/s]
Epoch 6 Iter 170: loss 0.23519. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:26,  2.01it/s]
Epoch 6 Iter 171: loss 0.23919. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.01it/s]
Epoch 6 Iter 171: loss 0.23919. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 6 Iter 172: loss 0.23544. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 6 Iter 172: loss 0.23544. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.02it/s]
Epoch 6 Iter 173: loss 0.23031. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.02it/s]
Epoch 6 Iter 173: loss 0.23031. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.00it/s]
Epoch 6 Iter 174: loss 0.24100. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.00it/s]
Epoch 6 Iter 174: loss 0.24100. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.00it/s]
Epoch 6 Iter 175: loss 0.24798. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.00it/s]
Epoch 6 Iter 175: loss 0.24798. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 6 Iter 176: loss 0.24538. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 6 Iter 176: loss 0.24538. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.01it/s]
Epoch 6 Iter 177: loss 0.24220. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.01it/s]
Epoch 6 Iter 177: loss 0.24220. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 6 Iter 178: loss 0.24062. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 6 Iter 178: loss 0.24062. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.02it/s]
Epoch 6 Iter 179: loss 0.23434. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.02it/s]
Epoch 6 Iter 179: loss 0.23434. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 6 Iter 180: loss 0.24579. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 6 Iter 180: loss 0.24579. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:21,  2.03it/s]
Epoch 6 Iter 181: loss 0.22491. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.03it/s]
Epoch 6 Iter 181: loss 0.22491. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 6 Iter 182: loss 0.23314. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 6 Iter 182: loss 0.23314. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.03it/s]
Epoch 6 Iter 183: loss 0.23732. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.03it/s]
Epoch 6 Iter 183: loss 0.23732. :  82%|███████████████████████████████████▉        | 183/224 [01:30<00:20,  2.04it/s]
Epoch 6 Iter 184: loss 0.23509. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.04it/s]
Epoch 6 Iter 184: loss 0.23509. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 6 Iter 185: loss 0.24439. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 6 Iter 185: loss 0.24439. :  83%|████████████████████████████████████▎       | 185/224 [01:31<00:19,  2.02it/s]
Epoch 6 Iter 186: loss 0.23470. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 6 Iter 186: loss 0.23470. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 6 Iter 187: loss 0.23417. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 6 Iter 187: loss 0.23417. :  83%|████████████████████████████████████▋       | 187/224 [01:32<00:18,  2.01it/s]
Epoch 6 Iter 188: loss 0.24245. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.01it/s]
Epoch 6 Iter 188: loss 0.24245. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:17,  2.02it/s]
Epoch 6 Iter 189: loss 0.24115. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:17,  2.02it/s]
Epoch 6 Iter 189: loss 0.24115. :  84%|█████████████████████████████████████▏      | 189/224 [01:33<00:17,  2.00it/s]
Epoch 6 Iter 190: loss 0.22602. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.00it/s]
Epoch 6 Iter 190: loss 0.22602. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  2.00it/s]
Epoch 6 Iter 191: loss 0.24696. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  2.00it/s]
Epoch 6 Iter 191: loss 0.24696. :  85%|█████████████████████████████████████▌      | 191/224 [01:34<00:16,  2.00it/s]
Epoch 6 Iter 192: loss 0.22270. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.00it/s]
Epoch 6 Iter 192: loss 0.22270. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:15,  2.00it/s]
Epoch 6 Iter 193: loss 0.26763. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:15,  2.00it/s]
Epoch 6 Iter 193: loss 0.26763. :  86%|█████████████████████████████████████▉      | 193/224 [01:35<00:15,  1.98it/s]
Epoch 6 Iter 194: loss 0.23541. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.98it/s]
Epoch 6 Iter 194: loss 0.23541. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:15,  1.99it/s]
Epoch 6 Iter 195: loss 0.21944. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:15,  1.99it/s]
Epoch 6 Iter 195: loss 0.21944. :  87%|██████████████████████████████████████▎     | 195/224 [01:36<00:14,  1.99it/s]
Epoch 6 Iter 196: loss 0.21666. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  1.99it/s]
Epoch 6 Iter 196: loss 0.21666. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:14,  1.99it/s]
Epoch 6 Iter 197: loss 0.23451. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:14,  1.99it/s]
Epoch 6 Iter 197: loss 0.23451. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  1.99it/s]
Epoch 6 Iter 198: loss 0.23864. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  1.99it/s]
Epoch 6 Iter 198: loss 0.23864. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.00it/s]
Epoch 6 Iter 199: loss 0.22836. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.00it/s]
Epoch 6 Iter 199: loss 0.22836. :  89%|███████████████████████████████████████     | 199/224 [01:38<00:12,  2.00it/s]
Epoch 6 Iter 200: loss 0.23490. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 6 Iter 200: loss 0.23490. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:12,  2.00it/s]
Epoch 6 Iter 201: loss 0.22654. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  2.00it/s]
Epoch 6 Iter 201: loss 0.22654. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 6 Iter 202: loss 0.23732. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  1.99it/s]
Epoch 6 Iter 202: loss 0.23732. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:11,  2.00it/s]
Epoch 6 Iter 203: loss 0.22395. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:11,  2.00it/s]
Epoch 6 Iter 203: loss 0.22395. :  91%|███████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.00it/s]
Epoch 6 Iter 204: loss 0.25002. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.00it/s]
Epoch 6 Iter 204: loss 0.25002. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:09,  2.00it/s]
Epoch 6 Iter 205: loss 0.22758. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.00it/s]
Epoch 6 Iter 205: loss 0.22758. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.99it/s]
Epoch 6 Iter 206: loss 0.23132. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.99it/s]
Epoch 6 Iter 206: loss 0.23132. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:09,  1.99it/s]
Epoch 6 Iter 207: loss 0.20862. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:09,  1.99it/s]
Epoch 6 Iter 207: loss 0.20862. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.00it/s]
Epoch 6 Iter 208: loss 0.21960. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.00it/s]
Epoch 6 Iter 208: loss 0.21960. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.01it/s]
Epoch 6 Iter 209: loss 0.22666. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.01it/s]
Epoch 6 Iter 209: loss 0.22666. :  93%|█████████████████████████████████████████   | 209/224 [01:43<00:07,  2.01it/s]
Epoch 6 Iter 210: loss 0.25010. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.01it/s]
Epoch 6 Iter 210: loss 0.25010. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.01it/s]
Epoch 6 Iter 211: loss 0.22844. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.01it/s]
Epoch 6 Iter 211: loss 0.22844. :  94%|█████████████████████████████████████████▍  | 211/224 [01:44<00:06,  2.02it/s]
Epoch 6 Iter 212: loss 0.22059. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.02it/s]
Epoch 6 Iter 212: loss 0.22059. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.01it/s]
Epoch 6 Iter 213: loss 0.23179. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.01it/s]
Epoch 6 Iter 213: loss 0.23179. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.93it/s]
Epoch 6 Iter 214: loss 0.24375. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.93it/s]
Epoch 6 Iter 214: loss 0.24375. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:05,  1.95it/s]
Epoch 6 Iter 215: loss 0.24739. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.95it/s]
Epoch 6 Iter 215: loss 0.24739. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.97it/s]
Epoch 6 Iter 216: loss 0.23256. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.97it/s]
Epoch 6 Iter 216: loss 0.23256. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:04,  1.98it/s]
Epoch 6 Iter 217: loss 0.25805. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.98it/s]
Epoch 6 Iter 217: loss 0.25805. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 6 Iter 218: loss 0.24297. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 6 Iter 218: loss 0.24297. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.00it/s]
Epoch 6 Iter 219: loss 0.23027. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.00it/s]
Epoch 6 Iter 219: loss 0.23027. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.01it/s]
Epoch 6 Iter 220: loss 0.24492. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  2.01it/s]
Epoch 6 Iter 220: loss 0.24492. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:01,  2.01it/s]
Epoch 6 Iter 221: loss 0.23761. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:01,  2.01it/s]
Epoch 6 Iter 221: loss 0.23761. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.02it/s]
Epoch 6 Iter 222: loss 0.23823. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.02it/s]
Epoch 6 Iter 222: loss 0.23823. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.01it/s]
Epoch 6 Iter 223: loss 0.25826. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.01it/s]
Epoch 6 Iter 223: loss 0.25826. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.02it/s]
Epoch 6 Iter 224: loss 0.24863. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.02it/s]
Epoch 6 Iter 224: loss 0.24863. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.02it/s]
Epoch 6 Iter 224: loss 0.24863. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.01it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.23061. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.23061. :   0%|▏                                               | 1/224 [00:00<01:56,  1.91it/s]
Epoch 7 Iter 2: loss 0.24219. :   0%|▏                                               | 1/224 [00:01<01:56,  1.91it/s]
Epoch 7 Iter 2: loss 0.24219. :   1%|▍                                               | 2/224 [00:01<01:55,  1.93it/s]
Epoch 7 Iter 3: loss 0.24754. :   1%|▍                                               | 2/224 [00:01<01:55,  1.93it/s]
Epoch 7 Iter 3: loss 0.24754. :   1%|▋                                               | 3/224 [00:01<01:53,  1.94it/s]
Epoch 7 Iter 4: loss 0.24256. :   1%|▋                                               | 3/224 [00:02<01:53,  1.94it/s]
Epoch 7 Iter 4: loss 0.24256. :   2%|▊                                               | 4/224 [00:02<01:52,  1.95it/s]
Epoch 7 Iter 5: loss 0.24759. :   2%|▊                                               | 4/224 [00:02<01:52,  1.95it/s]
Epoch 7 Iter 5: loss 0.24759. :   2%|█                                               | 5/224 [00:02<01:51,  1.97it/s]
Epoch 7 Iter 6: loss 0.23850. :   2%|█                                               | 5/224 [00:03<01:51,  1.97it/s]
Epoch 7 Iter 6: loss 0.23850. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.98it/s]
Epoch 7 Iter 7: loss 0.24047. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.98it/s]
Epoch 7 Iter 7: loss 0.24047. :   3%|█▌                                              | 7/224 [00:03<01:48,  1.99it/s]
Epoch 7 Iter 8: loss 0.23499. :   3%|█▌                                              | 7/224 [00:04<01:48,  1.99it/s]
Epoch 7 Iter 8: loss 0.23499. :   4%|█▋                                              | 8/224 [00:04<01:49,  1.98it/s]
Epoch 7 Iter 9: loss 0.23641. :   4%|█▋                                              | 8/224 [00:04<01:49,  1.98it/s]
Epoch 7 Iter 9: loss 0.23641. :   4%|█▉                                              | 9/224 [00:04<01:48,  1.99it/s]
Epoch 7 Iter 10: loss 0.25201. :   4%|█▉                                             | 9/224 [00:05<01:48,  1.99it/s]
Epoch 7 Iter 10: loss 0.25201. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 7 Iter 11: loss 0.25644. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 7 Iter 11: loss 0.25644. :   5%|██▎                                           | 11/224 [00:05<01:47,  1.99it/s]
Epoch 7 Iter 12: loss 0.22471. :   5%|██▎                                           | 11/224 [00:06<01:47,  1.99it/s]
Epoch 7 Iter 12: loss 0.22471. :   5%|██▍                                           | 12/224 [00:06<01:49,  1.94it/s]
Epoch 7 Iter 13: loss 0.23467. :   5%|██▍                                           | 12/224 [00:06<01:49,  1.94it/s]
Epoch 7 Iter 13: loss 0.23467. :   6%|██▋                                           | 13/224 [00:06<01:47,  1.96it/s]
Epoch 7 Iter 14: loss 0.22632. :   6%|██▋                                           | 13/224 [00:07<01:47,  1.96it/s]
Epoch 7 Iter 14: loss 0.22632. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.97it/s]
Epoch 7 Iter 15: loss 0.24730. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.97it/s]
Epoch 7 Iter 15: loss 0.24730. :   7%|███                                           | 15/224 [00:07<01:45,  1.98it/s]
Epoch 7 Iter 16: loss 0.22700. :   7%|███                                           | 15/224 [00:08<01:45,  1.98it/s]
Epoch 7 Iter 16: loss 0.22700. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.98it/s]
Epoch 7 Iter 17: loss 0.22714. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.98it/s]
Epoch 7 Iter 17: loss 0.22714. :   8%|███▍                                          | 17/224 [00:08<01:43,  1.99it/s]
Epoch 7 Iter 18: loss 0.24688. :   8%|███▍                                          | 17/224 [00:09<01:43,  1.99it/s]
Epoch 7 Iter 18: loss 0.24688. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.00it/s]
Epoch 7 Iter 19: loss 0.21684. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.00it/s]
Epoch 7 Iter 19: loss 0.21684. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 7 Iter 20: loss 0.21680. :   8%|███▉                                          | 19/224 [00:10<01:41,  2.01it/s]
Epoch 7 Iter 20: loss 0.21680. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 7 Iter 21: loss 0.25328. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 7 Iter 21: loss 0.25328. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 7 Iter 22: loss 0.25959. :   9%|████▎                                         | 21/224 [00:11<01:40,  2.01it/s]
Epoch 7 Iter 22: loss 0.25959. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.02it/s]
Epoch 7 Iter 23: loss 0.25738. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.02it/s]
Epoch 7 Iter 23: loss 0.25738. :  10%|████▋                                         | 23/224 [00:11<01:45,  1.91it/s]
Epoch 7 Iter 24: loss 0.23302. :  10%|████▋                                         | 23/224 [00:12<01:45,  1.91it/s]
Epoch 7 Iter 24: loss 0.23302. :  11%|████▉                                         | 24/224 [00:12<01:43,  1.93it/s]
Epoch 7 Iter 25: loss 0.23476. :  11%|████▉                                         | 24/224 [00:12<01:43,  1.93it/s]
Epoch 7 Iter 25: loss 0.23476. :  11%|█████▏                                        | 25/224 [00:12<01:42,  1.95it/s]
Epoch 7 Iter 26: loss 0.21364. :  11%|█████▏                                        | 25/224 [00:13<01:42,  1.95it/s]
Epoch 7 Iter 26: loss 0.21364. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.96it/s]
Epoch 7 Iter 27: loss 0.22742. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.96it/s]
Epoch 7 Iter 27: loss 0.22742. :  12%|█████▌                                        | 27/224 [00:13<01:41,  1.93it/s]
Epoch 7 Iter 28: loss 0.24791. :  12%|█████▌                                        | 27/224 [00:14<01:41,  1.93it/s]
Epoch 7 Iter 28: loss 0.24791. :  12%|█████▊                                        | 28/224 [00:14<01:40,  1.96it/s]
Epoch 7 Iter 29: loss 0.23745. :  12%|█████▊                                        | 28/224 [00:14<01:40,  1.96it/s]
Epoch 7 Iter 29: loss 0.23745. :  13%|█████▉                                        | 29/224 [00:14<01:38,  1.97it/s]
Epoch 7 Iter 30: loss 0.22864. :  13%|█████▉                                        | 29/224 [00:15<01:38,  1.97it/s]
Epoch 7 Iter 30: loss 0.22864. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 7 Iter 31: loss 0.24080. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 7 Iter 31: loss 0.24080. :  14%|██████▎                                       | 31/224 [00:15<01:37,  1.98it/s]
Epoch 7 Iter 32: loss 0.23310. :  14%|██████▎                                       | 31/224 [00:16<01:37,  1.98it/s]
Epoch 7 Iter 32: loss 0.23310. :  14%|██████▌                                       | 32/224 [00:16<01:39,  1.94it/s]
Epoch 7 Iter 33: loss 0.24453. :  14%|██████▌                                       | 32/224 [00:16<01:39,  1.94it/s]
Epoch 7 Iter 33: loss 0.24453. :  15%|██████▊                                       | 33/224 [00:16<01:37,  1.96it/s]
Epoch 7 Iter 34: loss 0.23183. :  15%|██████▊                                       | 33/224 [00:17<01:37,  1.96it/s]
Epoch 7 Iter 34: loss 0.23183. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 7 Iter 35: loss 0.24631. :  15%|██████▉                                       | 34/224 [00:17<01:36,  1.98it/s]
Epoch 7 Iter 35: loss 0.24631. :  16%|███████▏                                      | 35/224 [00:17<01:35,  1.97it/s]
Epoch 7 Iter 36: loss 0.22432. :  16%|███████▏                                      | 35/224 [00:18<01:35,  1.97it/s]
Epoch 7 Iter 36: loss 0.22432. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.99it/s]
Epoch 7 Iter 37: loss 0.24178. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.99it/s]
Epoch 7 Iter 37: loss 0.24178. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.99it/s]
Epoch 7 Iter 38: loss 0.22190. :  17%|███████▌                                      | 37/224 [00:19<01:34,  1.99it/s]
Epoch 7 Iter 38: loss 0.22190. :  17%|███████▊                                      | 38/224 [00:19<01:36,  1.92it/s]
Epoch 7 Iter 39: loss 0.23556. :  17%|███████▊                                      | 38/224 [00:19<01:36,  1.92it/s]
Epoch 7 Iter 39: loss 0.23556. :  17%|████████                                      | 39/224 [00:19<01:35,  1.94it/s]
Epoch 7 Iter 40: loss 0.22709. :  17%|████████                                      | 39/224 [00:20<01:35,  1.94it/s]
Epoch 7 Iter 40: loss 0.22709. :  18%|████████▏                                     | 40/224 [00:20<01:34,  1.95it/s]
Epoch 7 Iter 41: loss 0.22769. :  18%|████████▏                                     | 40/224 [00:20<01:34,  1.95it/s]
Epoch 7 Iter 41: loss 0.22769. :  18%|████████▍                                     | 41/224 [00:20<01:33,  1.96it/s]
Epoch 7 Iter 42: loss 0.21901. :  18%|████████▍                                     | 41/224 [00:21<01:33,  1.96it/s]
Epoch 7 Iter 42: loss 0.21901. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.98it/s]
Epoch 7 Iter 43: loss 0.24001. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.98it/s]
Epoch 7 Iter 43: loss 0.24001. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.00it/s]
Epoch 7 Iter 44: loss 0.22141. :  19%|████████▊                                     | 43/224 [00:22<01:30,  2.00it/s]
Epoch 7 Iter 44: loss 0.22141. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 7 Iter 45: loss 0.22844. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 7 Iter 45: loss 0.22844. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 7 Iter 46: loss 0.24346. :  20%|█████████▏                                    | 45/224 [00:23<01:29,  2.01it/s]
Epoch 7 Iter 46: loss 0.24346. :  21%|█████████▍                                    | 46/224 [00:23<01:32,  1.93it/s]
Epoch 7 Iter 47: loss 0.22474. :  21%|█████████▍                                    | 46/224 [00:23<01:32,  1.93it/s]
Epoch 7 Iter 47: loss 0.22474. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 7 Iter 48: loss 0.22562. :  21%|█████████▋                                    | 47/224 [00:24<01:31,  1.94it/s]
Epoch 7 Iter 48: loss 0.22562. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 7 Iter 49: loss 0.21858. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 7 Iter 49: loss 0.21858. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.96it/s]
Epoch 7 Iter 50: loss 0.23152. :  22%|██████████                                    | 49/224 [00:25<01:29,  1.96it/s]
Epoch 7 Iter 50: loss 0.23152. :  22%|██████████▎                                   | 50/224 [00:25<01:28,  1.98it/s]
Epoch 7 Iter 51: loss 0.23601. :  22%|██████████▎                                   | 50/224 [00:25<01:28,  1.98it/s]
Epoch 7 Iter 51: loss 0.23601. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.98it/s]
Epoch 7 Iter 52: loss 0.24296. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.98it/s]
Epoch 7 Iter 52: loss 0.24296. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  2.00it/s]
Epoch 7 Iter 53: loss 0.25157. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  2.00it/s]
Epoch 7 Iter 53: loss 0.25157. :  24%|██████████▉                                   | 53/224 [00:26<01:27,  1.95it/s]
Epoch 7 Iter 54: loss 0.24601. :  24%|██████████▉                                   | 53/224 [00:27<01:27,  1.95it/s]
Epoch 7 Iter 54: loss 0.24601. :  24%|███████████                                   | 54/224 [00:27<01:27,  1.95it/s]
Epoch 7 Iter 55: loss 0.26468. :  24%|███████████                                   | 54/224 [00:27<01:27,  1.95it/s]
Epoch 7 Iter 55: loss 0.26468. :  25%|███████████▎                                  | 55/224 [00:27<01:26,  1.96it/s]
Epoch 7 Iter 56: loss 0.24018. :  25%|███████████▎                                  | 55/224 [00:28<01:26,  1.96it/s]
Epoch 7 Iter 56: loss 0.24018. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.97it/s]
Epoch 7 Iter 57: loss 0.24085. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.97it/s]
Epoch 7 Iter 57: loss 0.24085. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.97it/s]
Epoch 7 Iter 58: loss 0.23900. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.97it/s]
Epoch 7 Iter 58: loss 0.23900. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.97it/s]
Epoch 7 Iter 59: loss 0.22366. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.97it/s]
Epoch 7 Iter 59: loss 0.22366. :  26%|████████████                                  | 59/224 [00:29<01:23,  1.97it/s]
Epoch 7 Iter 60: loss 0.23198. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.97it/s]
Epoch 7 Iter 60: loss 0.23198. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 7 Iter 61: loss 0.24129. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 7 Iter 61: loss 0.24129. :  27%|████████████▌                                 | 61/224 [00:30<01:22,  1.97it/s]
Epoch 7 Iter 62: loss 0.22257. :  27%|████████████▌                                 | 61/224 [00:31<01:22,  1.97it/s]
Epoch 7 Iter 62: loss 0.22257. :  28%|████████████▋                                 | 62/224 [00:31<01:25,  1.90it/s]
Epoch 7 Iter 63: loss 0.26325. :  28%|████████████▋                                 | 62/224 [00:32<01:25,  1.90it/s]
Epoch 7 Iter 63: loss 0.26325. :  28%|████████████▉                                 | 63/224 [00:32<01:23,  1.92it/s]
Epoch 7 Iter 64: loss 0.23018. :  28%|████████████▉                                 | 63/224 [00:32<01:23,  1.92it/s]
Epoch 7 Iter 64: loss 0.23018. :  29%|█████████████▏                                | 64/224 [00:32<01:22,  1.94it/s]
Epoch 7 Iter 65: loss 0.22833. :  29%|█████████████▏                                | 64/224 [00:33<01:22,  1.94it/s]
Epoch 7 Iter 65: loss 0.22833. :  29%|█████████████▎                                | 65/224 [00:33<01:21,  1.96it/s]
Epoch 7 Iter 66: loss 0.23109. :  29%|█████████████▎                                | 65/224 [00:33<01:21,  1.96it/s]
Epoch 7 Iter 66: loss 0.23109. :  29%|█████████████▌                                | 66/224 [00:33<01:21,  1.94it/s]
Epoch 7 Iter 67: loss 0.25276. :  29%|█████████████▌                                | 66/224 [00:34<01:21,  1.94it/s]
Epoch 7 Iter 67: loss 0.25276. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.97it/s]
Epoch 7 Iter 68: loss 0.23941. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.97it/s]
Epoch 7 Iter 68: loss 0.23941. :  30%|█████████████▉                                | 68/224 [00:34<01:21,  1.92it/s]
Epoch 7 Iter 69: loss 0.23662. :  30%|█████████████▉                                | 68/224 [00:35<01:21,  1.92it/s]
Epoch 7 Iter 69: loss 0.23662. :  31%|██████████████▏                               | 69/224 [00:35<01:21,  1.91it/s]
Epoch 7 Iter 70: loss 0.23083. :  31%|██████████████▏                               | 69/224 [00:35<01:21,  1.91it/s]
Epoch 7 Iter 70: loss 0.23083. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.95it/s]
Epoch 7 Iter 71: loss 0.23699. :  31%|██████████████▍                               | 70/224 [00:36<01:19,  1.95it/s]
Epoch 7 Iter 71: loss 0.23699. :  32%|██████████████▌                               | 71/224 [00:36<01:17,  1.98it/s]
Epoch 7 Iter 72: loss 0.24386. :  32%|██████████████▌                               | 71/224 [00:36<01:17,  1.98it/s]
Epoch 7 Iter 72: loss 0.24386. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  1.98it/s]
Epoch 7 Iter 73: loss 0.24436. :  32%|██████████████▊                               | 72/224 [00:37<01:16,  1.98it/s]
Epoch 7 Iter 73: loss 0.24436. :  33%|██████████████▉                               | 73/224 [00:37<01:16,  1.98it/s]
Epoch 7 Iter 74: loss 0.25509. :  33%|██████████████▉                               | 73/224 [00:37<01:16,  1.98it/s]
Epoch 7 Iter 74: loss 0.25509. :  33%|███████████████▏                              | 74/224 [00:37<01:15,  1.98it/s]
Epoch 7 Iter 75: loss 0.20399. :  33%|███████████████▏                              | 74/224 [00:38<01:15,  1.98it/s]
Epoch 7 Iter 75: loss 0.20399. :  33%|███████████████▍                              | 75/224 [00:38<01:15,  1.98it/s]
Epoch 7 Iter 76: loss 0.23697. :  33%|███████████████▍                              | 75/224 [00:38<01:15,  1.98it/s]
Epoch 7 Iter 76: loss 0.23697. :  34%|███████████████▌                              | 76/224 [00:38<01:17,  1.90it/s]
Epoch 7 Iter 77: loss 0.23814. :  34%|███████████████▌                              | 76/224 [00:39<01:17,  1.90it/s]
Epoch 7 Iter 77: loss 0.23814. :  34%|███████████████▊                              | 77/224 [00:39<01:16,  1.91it/s]
Epoch 7 Iter 78: loss 0.21743. :  34%|███████████████▊                              | 77/224 [00:39<01:16,  1.91it/s]
Epoch 7 Iter 78: loss 0.21743. :  35%|████████████████                              | 78/224 [00:39<01:16,  1.91it/s]
Epoch 7 Iter 79: loss 0.23890. :  35%|████████████████                              | 78/224 [00:40<01:16,  1.91it/s]
Epoch 7 Iter 79: loss 0.23890. :  35%|████████████████▏                             | 79/224 [00:40<01:15,  1.92it/s]
Epoch 7 Iter 80: loss 0.23104. :  35%|████████████████▏                             | 79/224 [00:40<01:15,  1.92it/s]
Epoch 7 Iter 80: loss 0.23104. :  36%|████████████████▍                             | 80/224 [00:40<01:14,  1.93it/s]
Epoch 7 Iter 81: loss 0.21847. :  36%|████████████████▍                             | 80/224 [00:41<01:14,  1.93it/s]
Epoch 7 Iter 81: loss 0.21847. :  36%|████████████████▋                             | 81/224 [00:41<01:12,  1.96it/s]
Epoch 7 Iter 82: loss 0.22228. :  36%|████████████████▋                             | 81/224 [00:41<01:12,  1.96it/s]
Epoch 7 Iter 82: loss 0.22228. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.99it/s]
Epoch 7 Iter 83: loss 0.21936. :  37%|████████████████▊                             | 82/224 [00:42<01:11,  1.99it/s]
Epoch 7 Iter 83: loss 0.21936. :  37%|█████████████████                             | 83/224 [00:42<01:10,  1.99it/s]
Epoch 7 Iter 84: loss 0.24985. :  37%|█████████████████                             | 83/224 [00:42<01:10,  1.99it/s]
Epoch 7 Iter 84: loss 0.24985. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 7 Iter 85: loss 0.24013. :  38%|█████████████████▎                            | 84/224 [00:43<01:10,  1.98it/s]
Epoch 7 Iter 85: loss 0.24013. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  1.99it/s]
Epoch 7 Iter 86: loss 0.22459. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  1.99it/s]
Epoch 7 Iter 86: loss 0.22459. :  38%|█████████████████▋                            | 86/224 [00:43<01:10,  1.97it/s]
Epoch 7 Iter 87: loss 0.22159. :  38%|█████████████████▋                            | 86/224 [00:44<01:10,  1.97it/s]
Epoch 7 Iter 87: loss 0.22159. :  39%|█████████████████▊                            | 87/224 [00:44<01:09,  1.98it/s]
Epoch 7 Iter 88: loss 0.24722. :  39%|█████████████████▊                            | 87/224 [00:44<01:09,  1.98it/s]
Epoch 7 Iter 88: loss 0.24722. :  39%|██████████████████                            | 88/224 [00:44<01:09,  1.95it/s]
Epoch 7 Iter 89: loss 0.24620. :  39%|██████████████████                            | 88/224 [00:45<01:09,  1.95it/s]
Epoch 7 Iter 89: loss 0.24620. :  40%|██████████████████▎                           | 89/224 [00:45<01:08,  1.96it/s]
Epoch 7 Iter 90: loss 0.22331. :  40%|██████████████████▎                           | 89/224 [00:45<01:08,  1.96it/s]
Epoch 7 Iter 90: loss 0.22331. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.98it/s]
Epoch 7 Iter 91: loss 0.23316. :  40%|██████████████████▍                           | 90/224 [00:46<01:07,  1.98it/s]
Epoch 7 Iter 91: loss 0.23316. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.97it/s]
Epoch 7 Iter 92: loss 0.22786. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.97it/s]
Epoch 7 Iter 92: loss 0.22786. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.98it/s]
Epoch 7 Iter 93: loss 0.23377. :  41%|██████████████████▉                           | 92/224 [00:47<01:06,  1.98it/s]
Epoch 7 Iter 93: loss 0.23377. :  42%|███████████████████                           | 93/224 [00:47<01:06,  1.98it/s]
Epoch 7 Iter 94: loss 0.23946. :  42%|███████████████████                           | 93/224 [00:47<01:06,  1.98it/s]
Epoch 7 Iter 94: loss 0.23946. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  2.00it/s]
Epoch 7 Iter 95: loss 0.23704. :  42%|███████████████████▎                          | 94/224 [00:48<01:05,  2.00it/s]
Epoch 7 Iter 95: loss 0.23704. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 7 Iter 96: loss 0.21057. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 7 Iter 96: loss 0.21057. :  43%|███████████████████▋                          | 96/224 [00:48<01:05,  1.95it/s]
Epoch 7 Iter 97: loss 0.23491. :  43%|███████████████████▋                          | 96/224 [00:49<01:05,  1.95it/s]
Epoch 7 Iter 97: loss 0.23491. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.96it/s]
Epoch 7 Iter 98: loss 0.24909. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.96it/s]
Epoch 7 Iter 98: loss 0.24909. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.97it/s]
Epoch 7 Iter 99: loss 0.22721. :  44%|████████████████████▏                         | 98/224 [00:50<01:04,  1.97it/s]
Epoch 7 Iter 99: loss 0.22721. :  44%|████████████████████▎                         | 99/224 [00:50<01:03,  1.98it/s]
Epoch 7 Iter 100: loss 0.22859. :  44%|███████████████████▉                         | 99/224 [00:50<01:03,  1.98it/s]
Epoch 7 Iter 100: loss 0.22859. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.97it/s]
Epoch 7 Iter 101: loss 0.23328. :  45%|███████████████████▋                        | 100/224 [00:51<01:03,  1.97it/s]
Epoch 7 Iter 101: loss 0.23328. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.97it/s]
Epoch 7 Iter 102: loss 0.25352. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.97it/s]
Epoch 7 Iter 102: loss 0.25352. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.98it/s]
Epoch 7 Iter 103: loss 0.21300. :  46%|████████████████████                        | 102/224 [00:52<01:01,  1.98it/s]
Epoch 7 Iter 103: loss 0.21300. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  1.99it/s]
Epoch 7 Iter 104: loss 0.22981. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  1.99it/s]
Epoch 7 Iter 104: loss 0.22981. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  2.00it/s]
Epoch 7 Iter 105: loss 0.24370. :  46%|████████████████████▍                       | 104/224 [00:53<01:00,  2.00it/s]
Epoch 7 Iter 105: loss 0.24370. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.96it/s]
Epoch 7 Iter 106: loss 0.24716. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.96it/s]
Epoch 7 Iter 106: loss 0.24716. :  47%|████████████████████▊                       | 106/224 [00:53<01:01,  1.92it/s]
Epoch 7 Iter 107: loss 0.25905. :  47%|████████████████████▊                       | 106/224 [00:54<01:01,  1.92it/s]
Epoch 7 Iter 107: loss 0.25905. :  48%|█████████████████████                       | 107/224 [00:54<00:59,  1.96it/s]
Epoch 7 Iter 108: loss 0.23952. :  48%|█████████████████████                       | 107/224 [00:54<00:59,  1.96it/s]
Epoch 7 Iter 108: loss 0.23952. :  48%|█████████████████████▏                      | 108/224 [00:54<00:58,  1.98it/s]
Epoch 7 Iter 109: loss 0.23205. :  48%|█████████████████████▏                      | 108/224 [00:55<00:58,  1.98it/s]
Epoch 7 Iter 109: loss 0.23205. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.97it/s]
Epoch 7 Iter 110: loss 0.22803. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.97it/s]
Epoch 7 Iter 110: loss 0.22803. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.98it/s]
Epoch 7 Iter 111: loss 0.25003. :  49%|█████████████████████▌                      | 110/224 [00:56<00:57,  1.98it/s]
Epoch 7 Iter 111: loss 0.25003. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  1.99it/s]
Epoch 7 Iter 112: loss 0.21904. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  1.99it/s]
Epoch 7 Iter 112: loss 0.21904. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.98it/s]
Epoch 7 Iter 113: loss 0.20995. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.98it/s]
Epoch 7 Iter 113: loss 0.20995. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.97it/s]
Epoch 7 Iter 114: loss 0.21640. :  50%|██████████████████████▏                     | 113/224 [00:58<00:56,  1.97it/s]
Epoch 7 Iter 114: loss 0.21640. :  51%|██████████████████████▍                     | 114/224 [00:58<00:57,  1.93it/s]
Epoch 7 Iter 115: loss 0.23141. :  51%|██████████████████████▍                     | 114/224 [00:58<00:57,  1.93it/s]
Epoch 7 Iter 115: loss 0.23141. :  51%|██████████████████████▌                     | 115/224 [00:58<00:56,  1.93it/s]
Epoch 7 Iter 116: loss 0.22965. :  51%|██████████████████████▌                     | 115/224 [00:59<00:56,  1.93it/s]
Epoch 7 Iter 116: loss 0.22965. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.95it/s]
Epoch 7 Iter 117: loss 0.23284. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.95it/s]
Epoch 7 Iter 117: loss 0.23284. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.95it/s]
Epoch 7 Iter 118: loss 0.24751. :  52%|██████████████████████▉                     | 117/224 [01:00<00:54,  1.95it/s]
Epoch 7 Iter 118: loss 0.24751. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.94it/s]
Epoch 7 Iter 119: loss 0.22323. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.94it/s]
Epoch 7 Iter 119: loss 0.22323. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.96it/s]
Epoch 7 Iter 120: loss 0.23488. :  53%|███████████████████████▍                    | 119/224 [01:01<00:53,  1.96it/s]
Epoch 7 Iter 120: loss 0.23488. :  54%|███████████████████████▌                    | 120/224 [01:01<00:54,  1.92it/s]
Epoch 7 Iter 121: loss 0.24350. :  54%|███████████████████████▌                    | 120/224 [01:01<00:54,  1.92it/s]
Epoch 7 Iter 121: loss 0.24350. :  54%|███████████████████████▊                    | 121/224 [01:01<00:55,  1.87it/s]
Epoch 7 Iter 122: loss 0.24722. :  54%|███████████████████████▊                    | 121/224 [01:02<00:55,  1.87it/s]
Epoch 7 Iter 122: loss 0.24722. :  54%|███████████████████████▉                    | 122/224 [01:02<00:53,  1.89it/s]
Epoch 7 Iter 123: loss 0.25000. :  54%|███████████████████████▉                    | 122/224 [01:02<00:53,  1.89it/s]
Epoch 7 Iter 123: loss 0.25000. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.91it/s]
Epoch 7 Iter 124: loss 0.24944. :  55%|████████████████████████▏                   | 123/224 [01:03<00:52,  1.91it/s]
Epoch 7 Iter 124: loss 0.24944. :  55%|████████████████████████▎                   | 124/224 [01:03<00:52,  1.91it/s]
Epoch 7 Iter 125: loss 0.22560. :  55%|████████████████████████▎                   | 124/224 [01:03<00:52,  1.91it/s]
Epoch 7 Iter 125: loss 0.22560. :  56%|████████████████████████▌                   | 125/224 [01:03<00:51,  1.93it/s]
Epoch 7 Iter 126: loss 0.22514. :  56%|████████████████████████▌                   | 125/224 [01:04<00:51,  1.93it/s]
Epoch 7 Iter 126: loss 0.22514. :  56%|████████████████████████▊                   | 126/224 [01:04<00:50,  1.94it/s]
Epoch 7 Iter 127: loss 0.23011. :  56%|████████████████████████▊                   | 126/224 [01:04<00:50,  1.94it/s]
Epoch 7 Iter 127: loss 0.23011. :  57%|████████████████████████▉                   | 127/224 [01:04<00:49,  1.95it/s]
Epoch 7 Iter 128: loss 0.24628. :  57%|████████████████████████▉                   | 127/224 [01:05<00:49,  1.95it/s]
Epoch 7 Iter 128: loss 0.24628. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:50,  1.90it/s]
Epoch 7 Iter 129: loss 0.22587. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:50,  1.90it/s]
Epoch 7 Iter 129: loss 0.22587. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:49,  1.92it/s]
Epoch 7 Iter 130: loss 0.23822. :  58%|█████████████████████████▎                  | 129/224 [01:06<00:49,  1.92it/s]
Epoch 7 Iter 130: loss 0.23822. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:49,  1.91it/s]
Epoch 7 Iter 131: loss 0.22934. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:49,  1.91it/s]
Epoch 7 Iter 131: loss 0.22934. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:48,  1.93it/s]
Epoch 7 Iter 132: loss 0.24264. :  58%|█████████████████████████▋                  | 131/224 [01:07<00:48,  1.93it/s]
Epoch 7 Iter 132: loss 0.24264. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:47,  1.94it/s]
Epoch 7 Iter 133: loss 0.20688. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:47,  1.94it/s]
Epoch 7 Iter 133: loss 0.20688. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.96it/s]
Epoch 7 Iter 134: loss 0.25151. :  59%|██████████████████████████▏                 | 133/224 [01:08<00:46,  1.96it/s]
Epoch 7 Iter 134: loss 0.25151. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:46,  1.94it/s]
Epoch 7 Iter 135: loss 0.25092. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:46,  1.94it/s]
Epoch 7 Iter 135: loss 0.25092. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:47,  1.89it/s]
Epoch 7 Iter 136: loss 0.23716. :  60%|██████████████████████████▌                 | 135/224 [01:09<00:47,  1.89it/s]
Epoch 7 Iter 136: loss 0.23716. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:46,  1.89it/s]
Epoch 7 Iter 137: loss 0.22549. :  61%|██████████████████████████▋                 | 136/224 [01:10<00:46,  1.89it/s]
Epoch 7 Iter 137: loss 0.22549. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:46,  1.88it/s]
Epoch 7 Iter 138: loss 0.24401. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:46,  1.88it/s]
Epoch 7 Iter 138: loss 0.24401. :  62%|███████████████████████████                 | 138/224 [01:10<00:45,  1.90it/s]
Epoch 7 Iter 139: loss 0.24155. :  62%|███████████████████████████                 | 138/224 [01:11<00:45,  1.90it/s]
Epoch 7 Iter 139: loss 0.24155. :  62%|███████████████████████████▎                | 139/224 [01:11<00:44,  1.92it/s]
Epoch 7 Iter 140: loss 0.23136. :  62%|███████████████████████████▎                | 139/224 [01:11<00:44,  1.92it/s]
Epoch 7 Iter 140: loss 0.23136. :  62%|███████████████████████████▌                | 140/224 [01:11<00:43,  1.94it/s]
Epoch 7 Iter 141: loss 0.24417. :  62%|███████████████████████████▌                | 140/224 [01:12<00:43,  1.94it/s]
Epoch 7 Iter 141: loss 0.24417. :  63%|███████████████████████████▋                | 141/224 [01:12<00:42,  1.95it/s]
Epoch 7 Iter 142: loss 0.23611. :  63%|███████████████████████████▋                | 141/224 [01:12<00:42,  1.95it/s]
Epoch 7 Iter 142: loss 0.23611. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.98it/s]
Epoch 7 Iter 143: loss 0.25197. :  63%|███████████████████████████▉                | 142/224 [01:13<00:41,  1.98it/s]
Epoch 7 Iter 143: loss 0.25197. :  64%|████████████████████████████                | 143/224 [01:13<00:41,  1.94it/s]
Epoch 7 Iter 144: loss 0.22777. :  64%|████████████████████████████                | 143/224 [01:13<00:41,  1.94it/s]
Epoch 7 Iter 144: loss 0.22777. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.96it/s]
Epoch 7 Iter 145: loss 0.20937. :  64%|████████████████████████████▎               | 144/224 [01:14<00:40,  1.96it/s]
Epoch 7 Iter 145: loss 0.20937. :  65%|████████████████████████████▍               | 145/224 [01:14<00:41,  1.92it/s]
Epoch 7 Iter 146: loss 0.23968. :  65%|████████████████████████████▍               | 145/224 [01:14<00:41,  1.92it/s]
Epoch 7 Iter 146: loss 0.23968. :  65%|████████████████████████████▋               | 146/224 [01:14<00:40,  1.94it/s]
Epoch 7 Iter 147: loss 0.26762. :  65%|████████████████████████████▋               | 146/224 [01:15<00:40,  1.94it/s]
Epoch 7 Iter 147: loss 0.26762. :  66%|████████████████████████████▉               | 147/224 [01:15<00:39,  1.95it/s]
Epoch 7 Iter 148: loss 0.23524. :  66%|████████████████████████████▉               | 147/224 [01:15<00:39,  1.95it/s]
Epoch 7 Iter 148: loss 0.23524. :  66%|█████████████████████████████               | 148/224 [01:15<00:38,  1.96it/s]
Epoch 7 Iter 149: loss 0.24247. :  66%|█████████████████████████████               | 148/224 [01:16<00:38,  1.96it/s]
Epoch 7 Iter 149: loss 0.24247. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:38,  1.96it/s]
Epoch 7 Iter 150: loss 0.25148. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:38,  1.96it/s]
Epoch 7 Iter 150: loss 0.25148. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:37,  1.98it/s]
Epoch 7 Iter 151: loss 0.24594. :  67%|█████████████████████████████▍              | 150/224 [01:17<00:37,  1.98it/s]
Epoch 7 Iter 151: loss 0.24594. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:37,  1.95it/s]
Epoch 7 Iter 152: loss 0.23181. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:37,  1.95it/s]
Epoch 7 Iter 152: loss 0.23181. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.95it/s]
Epoch 7 Iter 153: loss 0.22952. :  68%|█████████████████████████████▊              | 152/224 [01:18<00:36,  1.95it/s]
Epoch 7 Iter 153: loss 0.22952. :  68%|██████████████████████████████              | 153/224 [01:18<00:36,  1.96it/s]
Epoch 7 Iter 154: loss 0.24130. :  68%|██████████████████████████████              | 153/224 [01:18<00:36,  1.96it/s]
Epoch 7 Iter 154: loss 0.24130. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  1.97it/s]
Epoch 7 Iter 155: loss 0.25545. :  69%|██████████████████████████████▎             | 154/224 [01:19<00:35,  1.97it/s]
Epoch 7 Iter 155: loss 0.25545. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:34,  1.97it/s]
Epoch 7 Iter 156: loss 0.24453. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:34,  1.97it/s]
Epoch 7 Iter 156: loss 0.24453. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:34,  1.99it/s]
Epoch 7 Iter 157: loss 0.23972. :  70%|██████████████████████████████▋             | 156/224 [01:20<00:34,  1.99it/s]
Epoch 7 Iter 157: loss 0.23972. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:33,  1.99it/s]
Epoch 7 Iter 158: loss 0.22616. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:33,  1.99it/s]
Epoch 7 Iter 158: loss 0.22616. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.01it/s]
Epoch 7 Iter 159: loss 0.24758. :  71%|███████████████████████████████             | 158/224 [01:21<00:32,  2.01it/s]
Epoch 7 Iter 159: loss 0.24758. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:33,  1.91it/s]
Epoch 7 Iter 160: loss 0.22110. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:33,  1.91it/s]
Epoch 7 Iter 160: loss 0.22110. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.94it/s]
Epoch 7 Iter 161: loss 0.25719. :  71%|███████████████████████████████▍            | 160/224 [01:22<00:32,  1.94it/s]
Epoch 7 Iter 161: loss 0.25719. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:32,  1.95it/s]
Epoch 7 Iter 162: loss 0.24502. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:32,  1.95it/s]
Epoch 7 Iter 162: loss 0.24502. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.96it/s]
Epoch 7 Iter 163: loss 0.24916. :  72%|███████████████████████████████▊            | 162/224 [01:23<00:31,  1.96it/s]
Epoch 7 Iter 163: loss 0.24916. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.96it/s]
Epoch 7 Iter 164: loss 0.25387. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.96it/s]
Epoch 7 Iter 164: loss 0.25387. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.98it/s]
Epoch 7 Iter 165: loss 0.23942. :  73%|████████████████████████████████▏           | 164/224 [01:24<00:30,  1.98it/s]
Epoch 7 Iter 165: loss 0.23942. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:29,  1.99it/s]
Epoch 7 Iter 166: loss 0.24068. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:29,  1.99it/s]
Epoch 7 Iter 166: loss 0.24068. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  2.00it/s]
Epoch 7 Iter 167: loss 0.22941. :  74%|████████████████████████████████▌           | 166/224 [01:25<00:29,  2.00it/s]
Epoch 7 Iter 167: loss 0.22941. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.93it/s]
Epoch 7 Iter 168: loss 0.23855. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.93it/s]
Epoch 7 Iter 168: loss 0.23855. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.94it/s]
Epoch 7 Iter 169: loss 0.25377. :  75%|█████████████████████████████████           | 168/224 [01:26<00:28,  1.94it/s]
Epoch 7 Iter 169: loss 0.25377. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:28,  1.95it/s]
Epoch 7 Iter 170: loss 0.23161. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:28,  1.95it/s]
Epoch 7 Iter 170: loss 0.23161. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.97it/s]
Epoch 7 Iter 171: loss 0.23049. :  76%|█████████████████████████████████▍          | 170/224 [01:27<00:27,  1.97it/s]
Epoch 7 Iter 171: loss 0.23049. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  1.98it/s]
Epoch 7 Iter 172: loss 0.23603. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  1.98it/s]
Epoch 7 Iter 172: loss 0.23603. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  2.00it/s]
Epoch 7 Iter 173: loss 0.22655. :  77%|█████████████████████████████████▊          | 172/224 [01:28<00:26,  2.00it/s]
Epoch 7 Iter 173: loss 0.22655. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  2.00it/s]
Epoch 7 Iter 174: loss 0.25080. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  2.00it/s]
Epoch 7 Iter 174: loss 0.25080. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  2.00it/s]
Epoch 7 Iter 175: loss 0.22743. :  78%|██████████████████████████████████▏         | 174/224 [01:29<00:25,  2.00it/s]
Epoch 7 Iter 175: loss 0.22743. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  1.98it/s]
Epoch 7 Iter 176: loss 0.21458. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  1.98it/s]
Epoch 7 Iter 176: loss 0.21458. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.99it/s]
Epoch 7 Iter 177: loss 0.23563. :  79%|██████████████████████████████████▌         | 176/224 [01:30<00:24,  1.99it/s]
Epoch 7 Iter 177: loss 0.23563. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  2.00it/s]
Epoch 7 Iter 178: loss 0.23135. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  2.00it/s]
Epoch 7 Iter 178: loss 0.23135. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.01it/s]
Epoch 7 Iter 179: loss 0.22965. :  79%|██████████████████████████████████▉         | 178/224 [01:31<00:22,  2.01it/s]
Epoch 7 Iter 179: loss 0.22965. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  2.00it/s]
Epoch 7 Iter 180: loss 0.25546. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  2.00it/s]
Epoch 7 Iter 180: loss 0.25546. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.00it/s]
Epoch 7 Iter 181: loss 0.24443. :  80%|███████████████████████████████████▎        | 180/224 [01:32<00:21,  2.00it/s]
Epoch 7 Iter 181: loss 0.24443. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  1.99it/s]
Epoch 7 Iter 182: loss 0.23035. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  1.99it/s]
Epoch 7 Iter 182: loss 0.23035. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 7 Iter 183: loss 0.25112. :  81%|███████████████████████████████████▊        | 182/224 [01:33<00:21,  1.98it/s]
Epoch 7 Iter 183: loss 0.25112. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  1.97it/s]
Epoch 7 Iter 184: loss 0.23733. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  1.97it/s]
Epoch 7 Iter 184: loss 0.23733. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.96it/s]
Epoch 7 Iter 185: loss 0.23180. :  82%|████████████████████████████████████▏       | 184/224 [01:34<00:20,  1.96it/s]
Epoch 7 Iter 185: loss 0.23180. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  1.97it/s]
Epoch 7 Iter 186: loss 0.22714. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  1.97it/s]
Epoch 7 Iter 186: loss 0.22714. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.94it/s]
Epoch 7 Iter 187: loss 0.21790. :  83%|████████████████████████████████████▌       | 186/224 [01:35<00:19,  1.94it/s]
Epoch 7 Iter 187: loss 0.21790. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:19,  1.94it/s]
Epoch 7 Iter 188: loss 0.23893. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:19,  1.94it/s]
Epoch 7 Iter 188: loss 0.23893. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.96it/s]
Epoch 7 Iter 189: loss 0.23233. :  84%|████████████████████████████████████▉       | 188/224 [01:36<00:18,  1.96it/s]
Epoch 7 Iter 189: loss 0.23233. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  1.98it/s]
Epoch 7 Iter 190: loss 0.24230. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  1.98it/s]
Epoch 7 Iter 190: loss 0.24230. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.97it/s]
Epoch 7 Iter 191: loss 0.20740. :  85%|█████████████████████████████████████▎      | 190/224 [01:37<00:17,  1.97it/s]
Epoch 7 Iter 191: loss 0.20740. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.97it/s]
Epoch 7 Iter 192: loss 0.24934. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.97it/s]
Epoch 7 Iter 192: loss 0.24934. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.98it/s]
Epoch 7 Iter 193: loss 0.23151. :  86%|█████████████████████████████████████▋      | 192/224 [01:38<00:16,  1.98it/s]
Epoch 7 Iter 193: loss 0.23151. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.96it/s]
Epoch 7 Iter 194: loss 0.23901. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.96it/s]
Epoch 7 Iter 194: loss 0.23901. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 7 Iter 195: loss 0.22390. :  87%|██████████████████████████████████████      | 194/224 [01:39<00:15,  1.97it/s]
Epoch 7 Iter 195: loss 0.22390. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.97it/s]
Epoch 7 Iter 196: loss 0.22197. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.97it/s]
Epoch 7 Iter 196: loss 0.22197. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.95it/s]
Epoch 7 Iter 197: loss 0.21919. :  88%|██████████████████████████████████████▌     | 196/224 [01:40<00:14,  1.95it/s]
Epoch 7 Iter 197: loss 0.21919. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.95it/s]
Epoch 7 Iter 198: loss 0.22567. :  88%|██████████████████████████████████████▋     | 197/224 [01:41<00:13,  1.95it/s]
Epoch 7 Iter 198: loss 0.22567. :  88%|██████████████████████████████████████▉     | 198/224 [01:41<00:13,  1.91it/s]
Epoch 7 Iter 199: loss 0.23942. :  88%|██████████████████████████████████████▉     | 198/224 [01:41<00:13,  1.91it/s]
Epoch 7 Iter 199: loss 0.23942. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:13,  1.92it/s]
Epoch 7 Iter 200: loss 0.22465. :  89%|███████████████████████████████████████     | 199/224 [01:42<00:13,  1.92it/s]
Epoch 7 Iter 200: loss 0.22465. :  89%|███████████████████████████████████████▎    | 200/224 [01:42<00:12,  1.94it/s]
Epoch 7 Iter 201: loss 0.23220. :  89%|███████████████████████████████████████▎    | 200/224 [01:42<00:12,  1.94it/s]
Epoch 7 Iter 201: loss 0.23220. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.94it/s]
Epoch 7 Iter 202: loss 0.22066. :  90%|███████████████████████████████████████▍    | 201/224 [01:43<00:11,  1.94it/s]
Epoch 7 Iter 202: loss 0.22066. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.94it/s]
Epoch 7 Iter 203: loss 0.24556. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.94it/s]
Epoch 7 Iter 203: loss 0.24556. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.95it/s]
Epoch 7 Iter 204: loss 0.24834. :  91%|███████████████████████████████████████▉    | 203/224 [01:44<00:10,  1.95it/s]
Epoch 7 Iter 204: loss 0.24834. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.95it/s]
Epoch 7 Iter 205: loss 0.25184. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.95it/s]
Epoch 7 Iter 205: loss 0.25184. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.92it/s]
Epoch 7 Iter 206: loss 0.23760. :  92%|████████████████████████████████████████▎   | 205/224 [01:45<00:09,  1.92it/s]
Epoch 7 Iter 206: loss 0.23760. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.93it/s]
Epoch 7 Iter 207: loss 0.24164. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.93it/s]
Epoch 7 Iter 207: loss 0.24164. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  1.95it/s]
Epoch 7 Iter 208: loss 0.24917. :  92%|████████████████████████████████████████▋   | 207/224 [01:46<00:08,  1.95it/s]
Epoch 7 Iter 208: loss 0.24917. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:08,  1.97it/s]
Epoch 7 Iter 209: loss 0.23017. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:08,  1.97it/s]
Epoch 7 Iter 209: loss 0.23017. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  1.95it/s]
Epoch 7 Iter 210: loss 0.20110. :  93%|█████████████████████████████████████████   | 209/224 [01:47<00:07,  1.95it/s]
Epoch 7 Iter 210: loss 0.20110. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.97it/s]
Epoch 7 Iter 211: loss 0.22613. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.97it/s]
Epoch 7 Iter 211: loss 0.22613. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  1.94it/s]
Epoch 7 Iter 212: loss 0.24455. :  94%|█████████████████████████████████████████▍  | 211/224 [01:48<00:06,  1.94it/s]
Epoch 7 Iter 212: loss 0.24455. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.95it/s]
Epoch 7 Iter 213: loss 0.23345. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.95it/s]
Epoch 7 Iter 213: loss 0.23345. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  1.92it/s]
Epoch 7 Iter 214: loss 0.22373. :  95%|█████████████████████████████████████████▊  | 213/224 [01:49<00:05,  1.92it/s]
Epoch 7 Iter 214: loss 0.22373. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:05,  1.91it/s]
Epoch 7 Iter 215: loss 0.24284. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:05,  1.91it/s]
Epoch 7 Iter 215: loss 0.24284. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.94it/s]
Epoch 7 Iter 216: loss 0.24985. :  96%|██████████████████████████████████████████▏ | 215/224 [01:50<00:04,  1.94it/s]
Epoch 7 Iter 216: loss 0.24985. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.95it/s]
Epoch 7 Iter 217: loss 0.22324. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.95it/s]
Epoch 7 Iter 217: loss 0.22324. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.96it/s]
Epoch 7 Iter 218: loss 0.24991. :  97%|██████████████████████████████████████████▋ | 217/224 [01:51<00:03,  1.96it/s]
Epoch 7 Iter 218: loss 0.24991. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.96it/s]
Epoch 7 Iter 219: loss 0.24457. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.96it/s]
Epoch 7 Iter 219: loss 0.24457. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.97it/s]
Epoch 7 Iter 220: loss 0.24088. :  98%|███████████████████████████████████████████ | 219/224 [01:52<00:02,  1.97it/s]
Epoch 7 Iter 220: loss 0.24088. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:02,  1.93it/s]
Epoch 7 Iter 221: loss 0.24152. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:02,  1.93it/s]
Epoch 7 Iter 221: loss 0.24152. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.95it/s]
Epoch 7 Iter 222: loss 0.23954. :  99%|███████████████████████████████████████████▍| 221/224 [01:53<00:01,  1.95it/s]
Epoch 7 Iter 222: loss 0.23954. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:01,  1.96it/s]
Epoch 7 Iter 223: loss 0.23179. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:01,  1.96it/s]
Epoch 7 Iter 223: loss 0.23179. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.98it/s]
Epoch 7 Iter 224: loss 0.24733. : 100%|███████████████████████████████████████████▊| 223/224 [01:54<00:00,  1.98it/s]
Epoch 7 Iter 224: loss 0.24733. : 100%|████████████████████████████████████████████| 224/224 [01:54<00:00,  1.97it/s]
Epoch 7 Iter 224: loss 0.24733. : 100%|████████████████████████████████████████████| 224/224 [01:54<00:00,  1.96it/s]

    Train loss: 0.23593
    Valid loss: 0.23777
       Valid loss recons: 0.22683
       Valid loss KL-D:   1.094
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.24480. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.24480. :   0%|▏                                               | 1/224 [00:00<01:54,  1.95it/s]
Epoch 8 Iter 2: loss 0.22311. :   0%|▏                                               | 1/224 [00:01<01:54,  1.95it/s]
Epoch 8 Iter 2: loss 0.22311. :   1%|▍                                               | 2/224 [00:01<01:52,  1.98it/s]
Epoch 8 Iter 3: loss 0.23492. :   1%|▍                                               | 2/224 [00:01<01:52,  1.98it/s]
Epoch 8 Iter 3: loss 0.23492. :   1%|▋                                               | 3/224 [00:01<01:50,  1.99it/s]
Epoch 8 Iter 4: loss 0.23335. :   1%|▋                                               | 3/224 [00:02<01:50,  1.99it/s]
Epoch 8 Iter 4: loss 0.23335. :   2%|▊                                               | 4/224 [00:02<01:55,  1.91it/s]
Epoch 8 Iter 5: loss 0.23402. :   2%|▊                                               | 4/224 [00:02<01:55,  1.91it/s]
Epoch 8 Iter 5: loss 0.23402. :   2%|█                                               | 5/224 [00:02<01:57,  1.86it/s]
Epoch 8 Iter 6: loss 0.21821. :   2%|█                                               | 5/224 [00:03<01:57,  1.86it/s]
Epoch 8 Iter 6: loss 0.21821. :   3%|█▎                                              | 6/224 [00:03<02:19,  1.56it/s]
Epoch 8 Iter 7: loss 0.25083. :   3%|█▎                                              | 6/224 [00:04<02:19,  1.56it/s]
Epoch 8 Iter 7: loss 0.25083. :   3%|█▌                                              | 7/224 [00:04<03:15,  1.11it/s]
Epoch 8 Iter 8: loss 0.22798. :   3%|█▌                                              | 7/224 [00:06<03:15,  1.11it/s]
Epoch 8 Iter 8: loss 0.22798. :   4%|█▋                                              | 8/224 [00:06<03:58,  1.10s/it]
Epoch 8 Iter 9: loss 0.23667. :   4%|█▋                                              | 8/224 [00:07<03:58,  1.10s/it]
Epoch 8 Iter 9: loss 0.23667. :   4%|█▉                                              | 9/224 [00:07<03:53,  1.09s/it]
Epoch 8 Iter 10: loss 0.22553. :   4%|█▉                                             | 9/224 [00:08<03:53,  1.09s/it]
Epoch 8 Iter 10: loss 0.22553. :   4%|██                                            | 10/224 [00:08<03:57,  1.11s/it]
Epoch 8 Iter 11: loss 0.22458. :   4%|██                                            | 10/224 [00:10<03:57,  1.11s/it]
Epoch 8 Iter 11: loss 0.22458. :   5%|██▎                                           | 11/224 [00:10<04:27,  1.25s/it]
Epoch 8 Iter 12: loss 0.23663. :   5%|██▎                                           | 11/224 [00:11<04:27,  1.25s/it]
Epoch 8 Iter 12: loss 0.23663. :   5%|██▍                                           | 12/224 [00:11<04:30,  1.28s/it]
Epoch 8 Iter 13: loss 0.23388. :   5%|██▍                                           | 12/224 [00:12<04:30,  1.28s/it]
Epoch 8 Iter 13: loss 0.23388. :   6%|██▋                                           | 13/224 [00:12<04:36,  1.31s/it]
Epoch 8 Iter 14: loss 0.22916. :   6%|██▋                                           | 13/224 [00:14<04:36,  1.31s/it]
Epoch 8 Iter 14: loss 0.22916. :   6%|██▉                                           | 14/224 [00:14<04:20,  1.24s/it]
Epoch 8 Iter 15: loss 0.24441. :   6%|██▉                                           | 14/224 [00:15<04:20,  1.24s/it]
Epoch 8 Iter 15: loss 0.24441. :   7%|███                                           | 15/224 [00:15<04:30,  1.29s/it]
Epoch 8 Iter 16: loss 0.24446. :   7%|███                                           | 15/224 [00:16<04:30,  1.29s/it]
Epoch 8 Iter 16: loss 0.24446. :   7%|███▎                                          | 16/224 [00:16<04:08,  1.19s/it]
Epoch 8 Iter 17: loss 0.23510. :   7%|███▎                                          | 16/224 [00:17<04:08,  1.19s/it]
Epoch 8 Iter 17: loss 0.23510. :   8%|███▍                                          | 17/224 [00:17<03:54,  1.13s/it]
Epoch 8 Iter 18: loss 0.23824. :   8%|███▍                                          | 17/224 [00:18<03:54,  1.13s/it]
Epoch 8 Iter 18: loss 0.23824. :   8%|███▋                                          | 18/224 [00:18<03:21,  1.02it/s]
Epoch 8 Iter 19: loss 0.23267. :   8%|███▋                                          | 18/224 [00:18<03:21,  1.02it/s]
Epoch 8 Iter 19: loss 0.23267. :   8%|███▉                                          | 19/224 [00:18<02:59,  1.14it/s]
Epoch 8 Iter 20: loss 0.25566. :   8%|███▉                                          | 19/224 [00:19<02:59,  1.14it/s]
Epoch 8 Iter 20: loss 0.25566. :   9%|████                                          | 20/224 [00:19<03:05,  1.10it/s]
Epoch 8 Iter 21: loss 0.23836. :   9%|████                                          | 20/224 [00:20<03:05,  1.10it/s]
Epoch 8 Iter 21: loss 0.23836. :   9%|████▎                                         | 21/224 [00:20<03:24,  1.01s/it]
Epoch 8 Iter 22: loss 0.23236. :   9%|████▎                                         | 21/224 [00:22<03:24,  1.01s/it]
Epoch 8 Iter 22: loss 0.23236. :  10%|████▌                                         | 22/224 [00:22<03:35,  1.07s/it]
Epoch 8 Iter 23: loss 0.24640. :  10%|████▌                                         | 22/224 [00:23<03:35,  1.07s/it]
Epoch 8 Iter 23: loss 0.24640. :  10%|████▋                                         | 23/224 [00:23<03:43,  1.11s/it]
Epoch 8 Iter 24: loss 0.22237. :  10%|████▋                                         | 23/224 [00:24<03:43,  1.11s/it]
Epoch 8 Iter 24: loss 0.22237. :  11%|████▉                                         | 24/224 [00:24<03:39,  1.10s/it]
Epoch 8 Iter 25: loss 0.22909. :  11%|████▉                                         | 24/224 [00:25<03:39,  1.10s/it]
Epoch 8 Iter 25: loss 0.22909. :  11%|█████▏                                        | 25/224 [00:25<03:39,  1.10s/it]
Epoch 8 Iter 26: loss 0.23529. :  11%|█████▏                                        | 25/224 [00:26<03:39,  1.10s/it]
Epoch 8 Iter 26: loss 0.23529. :  12%|█████▎                                        | 26/224 [00:26<03:43,  1.13s/it]
Epoch 8 Iter 27: loss 0.23358. :  12%|█████▎                                        | 26/224 [00:27<03:43,  1.13s/it]
Epoch 8 Iter 27: loss 0.23358. :  12%|█████▌                                        | 27/224 [00:27<03:33,  1.08s/it]
Epoch 8 Iter 28: loss 0.23520. :  12%|█████▌                                        | 27/224 [00:28<03:33,  1.08s/it]
Epoch 8 Iter 28: loss 0.23520. :  12%|█████▊                                        | 28/224 [00:28<03:35,  1.10s/it]
Epoch 8 Iter 29: loss 0.21865. :  12%|█████▊                                        | 28/224 [00:30<03:35,  1.10s/it]
Epoch 8 Iter 29: loss 0.21865. :  13%|█████▉                                        | 29/224 [00:30<03:42,  1.14s/it]
Epoch 8 Iter 30: loss 0.22705. :  13%|█████▉                                        | 29/224 [00:31<03:42,  1.14s/it]
Epoch 8 Iter 30: loss 0.22705. :  13%|██████▏                                       | 30/224 [00:31<03:34,  1.11s/it]
Epoch 8 Iter 31: loss 0.24628. :  13%|██████▏                                       | 30/224 [00:31<03:34,  1.11s/it]
Epoch 8 Iter 31: loss 0.24628. :  14%|██████▎                                       | 31/224 [00:31<03:01,  1.07it/s]
Epoch 8 Iter 32: loss 0.22468. :  14%|██████▎                                       | 31/224 [00:32<03:01,  1.07it/s]
Epoch 8 Iter 32: loss 0.22468. :  14%|██████▌                                       | 32/224 [00:32<02:48,  1.14it/s]
Epoch 8 Iter 33: loss 0.26598. :  14%|██████▌                                       | 32/224 [00:33<02:48,  1.14it/s]
Epoch 8 Iter 33: loss 0.26598. :  15%|██████▊                                       | 33/224 [00:33<03:16,  1.03s/it]
Epoch 8 Iter 34: loss 0.25797. :  15%|██████▊                                       | 33/224 [00:35<03:16,  1.03s/it]
Epoch 8 Iter 34: loss 0.25797. :  15%|██████▉                                       | 34/224 [00:35<03:35,  1.14s/it]
Epoch 8 Iter 35: loss 0.24143. :  15%|██████▉                                       | 34/224 [00:36<03:35,  1.14s/it]
Epoch 8 Iter 35: loss 0.24143. :  16%|███████▏                                      | 35/224 [00:36<03:42,  1.18s/it]
Epoch 8 Iter 36: loss 0.21928. :  16%|███████▏                                      | 35/224 [00:37<03:42,  1.18s/it]
Epoch 8 Iter 36: loss 0.21928. :  16%|███████▍                                      | 36/224 [00:37<03:44,  1.19s/it]
Epoch 8 Iter 37: loss 0.23798. :  16%|███████▍                                      | 36/224 [00:38<03:44,  1.19s/it]
Epoch 8 Iter 37: loss 0.23798. :  17%|███████▌                                      | 37/224 [00:38<03:44,  1.20s/it]
Epoch 8 Iter 38: loss 0.23094. :  17%|███████▌                                      | 37/224 [00:40<03:44,  1.20s/it]
Epoch 8 Iter 38: loss 0.23094. :  17%|███████▊                                      | 38/224 [00:40<04:16,  1.38s/it]
Epoch 8 Iter 39: loss 0.21680. :  17%|███████▊                                      | 38/224 [00:41<04:16,  1.38s/it]
Epoch 8 Iter 39: loss 0.21680. :  17%|████████                                      | 39/224 [00:41<04:13,  1.37s/it]
Epoch 8 Iter 40: loss 0.21342. :  17%|████████                                      | 39/224 [00:43<04:13,  1.37s/it]
Epoch 8 Iter 40: loss 0.21342. :  18%|████████▏                                     | 40/224 [00:43<04:34,  1.49s/it]
Epoch 8 Iter 41: loss 0.24176. :  18%|████████▏                                     | 40/224 [00:45<04:34,  1.49s/it]
Epoch 8 Iter 41: loss 0.24176. :  18%|████████▍                                     | 41/224 [00:45<04:31,  1.49s/it]
Epoch 8 Iter 42: loss 0.24447. :  18%|████████▍                                     | 41/224 [00:46<04:31,  1.49s/it]
Epoch 8 Iter 42: loss 0.24447. :  19%|████████▋                                     | 42/224 [00:46<04:03,  1.34s/it]
Epoch 8 Iter 43: loss 0.23857. :  19%|████████▋                                     | 42/224 [00:47<04:03,  1.34s/it]
Epoch 8 Iter 43: loss 0.23857. :  19%|████████▊                                     | 43/224 [00:47<03:35,  1.19s/it]
Epoch 8 Iter 44: loss 0.22029. :  19%|████████▊                                     | 43/224 [00:47<03:35,  1.19s/it]
Epoch 8 Iter 44: loss 0.22029. :  20%|█████████                                     | 44/224 [00:47<03:19,  1.11s/it]
Epoch 8 Iter 45: loss 0.24243. :  20%|█████████                                     | 44/224 [00:49<03:19,  1.11s/it]
Epoch 8 Iter 45: loss 0.24243. :  20%|█████████▏                                    | 45/224 [00:49<03:15,  1.09s/it]
Epoch 8 Iter 46: loss 0.24977. :  20%|█████████▏                                    | 45/224 [00:49<03:15,  1.09s/it]
Epoch 8 Iter 46: loss 0.24977. :  21%|█████████▍                                    | 46/224 [00:49<02:52,  1.03it/s]
Epoch 8 Iter 47: loss 0.25600. :  21%|█████████▍                                    | 46/224 [00:50<02:52,  1.03it/s]
Epoch 8 Iter 47: loss 0.25600. :  21%|█████████▋                                    | 47/224 [00:50<02:43,  1.08it/s]
Epoch 8 Iter 48: loss 0.23885. :  21%|█████████▋                                    | 47/224 [00:52<02:43,  1.08it/s]
Epoch 8 Iter 48: loss 0.23885. :  21%|█████████▊                                    | 48/224 [00:52<03:21,  1.14s/it]
Epoch 8 Iter 49: loss 0.24078. :  21%|█████████▊                                    | 48/224 [00:53<03:21,  1.14s/it]
Epoch 8 Iter 49: loss 0.24078. :  22%|██████████                                    | 49/224 [00:53<03:12,  1.10s/it]
Epoch 8 Iter 50: loss 0.23870. :  22%|██████████                                    | 49/224 [00:54<03:12,  1.10s/it]
Epoch 8 Iter 50: loss 0.23870. :  22%|██████████▎                                   | 50/224 [00:54<03:13,  1.11s/it]
Epoch 8 Iter 51: loss 0.24055. :  22%|██████████▎                                   | 50/224 [00:55<03:13,  1.11s/it]
Epoch 8 Iter 51: loss 0.24055. :  23%|██████████▍                                   | 51/224 [00:55<03:06,  1.08s/it]
Epoch 8 Iter 52: loss 0.21754. :  23%|██████████▍                                   | 51/224 [00:56<03:06,  1.08s/it]
Epoch 8 Iter 52: loss 0.21754. :  23%|██████████▋                                   | 52/224 [00:56<03:13,  1.12s/it]
Epoch 8 Iter 53: loss 0.23943. :  23%|██████████▋                                   | 52/224 [00:57<03:13,  1.12s/it]
Epoch 8 Iter 53: loss 0.23943. :  24%|██████████▉                                   | 53/224 [00:57<03:01,  1.06s/it]
Epoch 8 Iter 54: loss 0.23155. :  24%|██████████▉                                   | 53/224 [00:58<03:01,  1.06s/it]
Epoch 8 Iter 54: loss 0.23155. :  24%|███████████                                   | 54/224 [00:58<03:14,  1.15s/it]
Epoch 8 Iter 55: loss 0.24022. :  24%|███████████                                   | 54/224 [00:59<03:14,  1.15s/it]
Epoch 8 Iter 55: loss 0.24022. :  25%|███████████▎                                  | 55/224 [00:59<03:06,  1.11s/it]
Epoch 8 Iter 56: loss 0.24344. :  25%|███████████▎                                  | 55/224 [01:01<03:06,  1.11s/it]
Epoch 8 Iter 56: loss 0.24344. :  25%|███████████▌                                  | 56/224 [01:01<03:11,  1.14s/it]
Epoch 8 Iter 57: loss 0.24232. :  25%|███████████▌                                  | 56/224 [01:02<03:11,  1.14s/it]
Epoch 8 Iter 57: loss 0.24232. :  25%|███████████▋                                  | 57/224 [01:02<03:13,  1.16s/it]
Epoch 8 Iter 58: loss 0.23548. :  25%|███████████▋                                  | 57/224 [01:03<03:13,  1.16s/it]
Epoch 8 Iter 58: loss 0.23548. :  26%|███████████▉                                  | 58/224 [01:03<03:21,  1.21s/it]
Epoch 8 Iter 59: loss 0.24749. :  26%|███████████▉                                  | 58/224 [01:04<03:21,  1.21s/it]
Epoch 8 Iter 59: loss 0.24749. :  26%|████████████                                  | 59/224 [01:04<03:02,  1.11s/it]
Epoch 8 Iter 60: loss 0.23962. :  26%|████████████                                  | 59/224 [01:05<03:02,  1.11s/it]
Epoch 8 Iter 60: loss 0.23962. :  27%|████████████▎                                 | 60/224 [01:05<02:36,  1.05it/s]
Epoch 8 Iter 61: loss 0.24904. :  27%|████████████▎                                 | 60/224 [01:05<02:36,  1.05it/s]
Epoch 8 Iter 61: loss 0.24904. :  27%|████████████▌                                 | 61/224 [01:05<02:26,  1.12it/s]
Epoch 8 Iter 62: loss 0.22809. :  27%|████████████▌                                 | 61/224 [01:07<02:26,  1.12it/s]
Epoch 8 Iter 62: loss 0.22809. :  28%|████████████▋                                 | 62/224 [01:07<02:57,  1.10s/it]
Epoch 8 Iter 63: loss 0.25301. :  28%|████████████▋                                 | 62/224 [01:09<02:57,  1.10s/it]
Epoch 8 Iter 63: loss 0.25301. :  28%|████████████▉                                 | 63/224 [01:09<03:23,  1.27s/it]
Epoch 8 Iter 64: loss 0.23805. :  28%|████████████▉                                 | 63/224 [01:10<03:23,  1.27s/it]
Epoch 8 Iter 64: loss 0.23805. :  29%|█████████████▏                                | 64/224 [01:10<03:35,  1.35s/it]
Epoch 8 Iter 65: loss 0.23683. :  29%|█████████████▏                                | 64/224 [01:11<03:35,  1.35s/it]
Epoch 8 Iter 65: loss 0.23683. :  29%|█████████████▎                                | 65/224 [01:11<03:27,  1.31s/it]
Epoch 8 Iter 66: loss 0.21546. :  29%|█████████████▎                                | 65/224 [01:13<03:27,  1.31s/it]
Epoch 8 Iter 66: loss 0.21546. :  29%|█████████████▌                                | 66/224 [01:13<03:26,  1.30s/it]
Epoch 8 Iter 67: loss 0.21997. :  29%|█████████████▌                                | 66/224 [01:14<03:26,  1.30s/it]
Epoch 8 Iter 67: loss 0.21997. :  30%|█████████████▊                                | 67/224 [01:14<03:27,  1.32s/it]
Epoch 8 Iter 68: loss 0.23893. :  30%|█████████████▊                                | 67/224 [01:15<03:27,  1.32s/it]
Epoch 8 Iter 68: loss 0.23893. :  30%|█████████████▉                                | 68/224 [01:15<03:24,  1.31s/it]
Epoch 8 Iter 69: loss 0.22818. :  30%|█████████████▉                                | 68/224 [01:16<03:24,  1.31s/it]
Epoch 8 Iter 69: loss 0.22818. :  31%|██████████████▏                               | 69/224 [01:16<03:04,  1.19s/it]
Epoch 8 Iter 70: loss 0.23685. :  31%|██████████████▏                               | 69/224 [01:17<03:04,  1.19s/it]
Epoch 8 Iter 70: loss 0.23685. :  31%|██████████████▍                               | 70/224 [01:17<02:59,  1.17s/it]
Epoch 8 Iter 71: loss 0.23698. :  31%|██████████████▍                               | 70/224 [01:19<02:59,  1.17s/it]
Epoch 8 Iter 71: loss 0.23698. :  32%|██████████████▌                               | 71/224 [01:19<03:07,  1.22s/it]
Epoch 8 Iter 72: loss 0.23692. :  32%|██████████████▌                               | 71/224 [01:20<03:07,  1.22s/it]
Epoch 8 Iter 72: loss 0.23692. :  32%|██████████████▊                               | 72/224 [01:20<03:04,  1.21s/it]
Epoch 8 Iter 73: loss 0.23126. :  32%|██████████████▊                               | 72/224 [01:21<03:04,  1.21s/it]
Epoch 8 Iter 73: loss 0.23126. :  33%|██████████████▉                               | 73/224 [01:21<02:55,  1.16s/it]
Epoch 8 Iter 74: loss 0.23045. :  33%|██████████████▉                               | 73/224 [01:21<02:55,  1.16s/it]
Epoch 8 Iter 74: loss 0.23045. :  33%|███████████████▏                              | 74/224 [01:21<02:26,  1.03it/s]
Epoch 8 Iter 75: loss 0.21845. :  33%|███████████████▏                              | 74/224 [01:22<02:26,  1.03it/s]
Epoch 8 Iter 75: loss 0.21845. :  33%|███████████████▍                              | 75/224 [01:22<02:03,  1.20it/s]
Epoch 8 Iter 76: loss 0.23366. :  33%|███████████████▍                              | 75/224 [01:22<02:03,  1.20it/s]
Epoch 8 Iter 76: loss 0.23366. :  34%|███████████████▌                              | 76/224 [01:22<01:48,  1.37it/s]
Epoch 8 Iter 77: loss 0.24012. :  34%|███████████████▌                              | 76/224 [01:23<01:48,  1.37it/s]
Epoch 8 Iter 77: loss 0.24012. :  34%|███████████████▊                              | 77/224 [01:23<01:37,  1.51it/s]
Epoch 8 Iter 78: loss 0.24383. :  34%|███████████████▊                              | 77/224 [01:23<01:37,  1.51it/s]
Epoch 8 Iter 78: loss 0.24383. :  35%|████████████████                              | 78/224 [01:23<01:29,  1.64it/s]
Epoch 8 Iter 79: loss 0.23365. :  35%|████████████████                              | 78/224 [01:24<01:29,  1.64it/s]
Epoch 8 Iter 79: loss 0.23365. :  35%|████████████████▏                             | 79/224 [01:24<01:23,  1.73it/s]
Epoch 8 Iter 80: loss 0.23037. :  35%|████████████████▏                             | 79/224 [01:24<01:23,  1.73it/s]
Epoch 8 Iter 80: loss 0.23037. :  36%|████████████████▍                             | 80/224 [01:24<01:19,  1.81it/s]
Epoch 8 Iter 81: loss 0.25109. :  36%|████████████████▍                             | 80/224 [01:25<01:19,  1.81it/s]
Epoch 8 Iter 81: loss 0.25109. :  36%|████████████████▋                             | 81/224 [01:25<01:16,  1.88it/s]
Epoch 8 Iter 82: loss 0.23521. :  36%|████████████████▋                             | 81/224 [01:25<01:16,  1.88it/s]
Epoch 8 Iter 82: loss 0.23521. :  37%|████████████████▊                             | 82/224 [01:25<01:14,  1.92it/s]
Epoch 8 Iter 83: loss 0.23131. :  37%|████████████████▊                             | 82/224 [01:26<01:14,  1.92it/s]
Epoch 8 Iter 83: loss 0.23131. :  37%|█████████████████                             | 83/224 [01:26<01:12,  1.95it/s]
Epoch 8 Iter 84: loss 0.23805. :  37%|█████████████████                             | 83/224 [01:26<01:12,  1.95it/s]
Epoch 8 Iter 84: loss 0.23805. :  38%|█████████████████▎                            | 84/224 [01:26<01:12,  1.92it/s]
Epoch 8 Iter 85: loss 0.24517. :  38%|█████████████████▎                            | 84/224 [01:27<01:12,  1.92it/s]
Epoch 8 Iter 85: loss 0.24517. :  38%|█████████████████▍                            | 85/224 [01:27<01:12,  1.93it/s]
Epoch 8 Iter 86: loss 0.24053. :  38%|█████████████████▍                            | 85/224 [01:27<01:12,  1.93it/s]
Epoch 8 Iter 86: loss 0.24053. :  38%|█████████████████▋                            | 86/224 [01:27<01:11,  1.92it/s]
Epoch 8 Iter 87: loss 0.22926. :  38%|█████████████████▋                            | 86/224 [01:28<01:11,  1.92it/s]
Epoch 8 Iter 87: loss 0.22926. :  39%|█████████████████▊                            | 87/224 [01:28<01:10,  1.94it/s]
Epoch 8 Iter 88: loss 0.23778. :  39%|█████████████████▊                            | 87/224 [01:28<01:10,  1.94it/s]
Epoch 8 Iter 88: loss 0.23778. :  39%|██████████████████                            | 88/224 [01:28<01:09,  1.95it/s]
Epoch 8 Iter 89: loss 0.23764. :  39%|██████████████████                            | 88/224 [01:29<01:09,  1.95it/s]
Epoch 8 Iter 89: loss 0.23764. :  40%|██████████████████▎                           | 89/224 [01:29<01:08,  1.96it/s]
Epoch 8 Iter 90: loss 0.24673. :  40%|██████████████████▎                           | 89/224 [01:29<01:08,  1.96it/s]
Epoch 8 Iter 90: loss 0.24673. :  40%|██████████████████▍                           | 90/224 [01:29<01:07,  1.98it/s]
Epoch 8 Iter 91: loss 0.23082. :  40%|██████████████████▍                           | 90/224 [01:30<01:07,  1.98it/s]
Epoch 8 Iter 91: loss 0.23082. :  41%|██████████████████▋                           | 91/224 [01:30<01:07,  1.98it/s]
Epoch 8 Iter 92: loss 0.23055. :  41%|██████████████████▋                           | 91/224 [01:30<01:07,  1.98it/s]
Epoch 8 Iter 92: loss 0.23055. :  41%|██████████████████▉                           | 92/224 [01:30<01:06,  1.98it/s]
Epoch 8 Iter 93: loss 0.22823. :  41%|██████████████████▉                           | 92/224 [01:31<01:06,  1.98it/s]
Epoch 8 Iter 93: loss 0.22823. :  42%|███████████████████                           | 93/224 [01:31<01:05,  1.99it/s]
Epoch 8 Iter 94: loss 0.23851. :  42%|███████████████████                           | 93/224 [01:31<01:05,  1.99it/s]
Epoch 8 Iter 94: loss 0.23851. :  42%|███████████████████▎                          | 94/224 [01:31<01:04,  2.00it/s]
Epoch 8 Iter 95: loss 0.21970. :  42%|███████████████████▎                          | 94/224 [01:32<01:04,  2.00it/s]
Epoch 8 Iter 95: loss 0.21970. :  42%|███████████████████▌                          | 95/224 [01:32<01:04,  2.01it/s]
Epoch 8 Iter 96: loss 0.22290. :  42%|███████████████████▌                          | 95/224 [01:32<01:04,  2.01it/s]
Epoch 8 Iter 96: loss 0.22290. :  43%|███████████████████▋                          | 96/224 [01:32<01:03,  2.00it/s]
Epoch 8 Iter 97: loss 0.24111. :  43%|███████████████████▋                          | 96/224 [01:33<01:03,  2.00it/s]
Epoch 8 Iter 97: loss 0.24111. :  43%|███████████████████▉                          | 97/224 [01:33<01:03,  1.99it/s]
Epoch 8 Iter 98: loss 0.21530. :  43%|███████████████████▉                          | 97/224 [01:33<01:03,  1.99it/s]
Epoch 8 Iter 98: loss 0.21530. :  44%|████████████████████▏                         | 98/224 [01:33<01:03,  1.99it/s]
Epoch 8 Iter 99: loss 0.21905. :  44%|████████████████████▏                         | 98/224 [01:34<01:03,  1.99it/s]
Epoch 8 Iter 99: loss 0.21905. :  44%|████████████████████▎                         | 99/224 [01:34<01:02,  1.99it/s]
Epoch 8 Iter 100: loss 0.22353. :  44%|███████████████████▉                         | 99/224 [01:34<01:02,  1.99it/s]
Epoch 8 Iter 100: loss 0.22353. :  45%|███████████████████▋                        | 100/224 [01:34<01:02,  1.99it/s]
Epoch 8 Iter 101: loss 0.23196. :  45%|███████████████████▋                        | 100/224 [01:35<01:02,  1.99it/s]
Epoch 8 Iter 101: loss 0.23196. :  45%|███████████████████▊                        | 101/224 [01:35<01:01,  1.99it/s]
Epoch 8 Iter 102: loss 0.22229. :  45%|███████████████████▊                        | 101/224 [01:35<01:01,  1.99it/s]
Epoch 8 Iter 102: loss 0.22229. :  46%|████████████████████                        | 102/224 [01:35<01:01,  2.00it/s]
Epoch 8 Iter 103: loss 0.24687. :  46%|████████████████████                        | 102/224 [01:36<01:01,  2.00it/s]
Epoch 8 Iter 103: loss 0.24687. :  46%|████████████████████▏                       | 103/224 [01:36<01:00,  1.98it/s]
Epoch 8 Iter 104: loss 0.23427. :  46%|████████████████████▏                       | 103/224 [01:36<01:00,  1.98it/s]
Epoch 8 Iter 104: loss 0.23427. :  46%|████████████████████▍                       | 104/224 [01:36<01:00,  1.98it/s]
Epoch 8 Iter 105: loss 0.22769. :  46%|████████████████████▍                       | 104/224 [01:37<01:00,  1.98it/s]
Epoch 8 Iter 105: loss 0.22769. :  47%|████████████████████▋                       | 105/224 [01:37<00:59,  1.99it/s]
Epoch 8 Iter 106: loss 0.25051. :  47%|████████████████████▋                       | 105/224 [01:37<00:59,  1.99it/s]
Epoch 8 Iter 106: loss 0.25051. :  47%|████████████████████▊                       | 106/224 [01:37<00:59,  1.97it/s]
Epoch 8 Iter 107: loss 0.25760. :  47%|████████████████████▊                       | 106/224 [01:38<00:59,  1.97it/s]
Epoch 8 Iter 107: loss 0.25760. :  48%|█████████████████████                       | 107/224 [01:38<00:59,  1.98it/s]
Epoch 8 Iter 108: loss 0.24506. :  48%|█████████████████████                       | 107/224 [01:38<00:59,  1.98it/s]
Epoch 8 Iter 108: loss 0.24506. :  48%|█████████████████████▏                      | 108/224 [01:38<00:58,  1.99it/s]
Epoch 8 Iter 109: loss 0.25780. :  48%|█████████████████████▏                      | 108/224 [01:39<00:58,  1.99it/s]
Epoch 8 Iter 109: loss 0.25780. :  49%|█████████████████████▍                      | 109/224 [01:39<00:57,  1.99it/s]
Epoch 8 Iter 110: loss 0.22218. :  49%|█████████████████████▍                      | 109/224 [01:39<00:57,  1.99it/s]
Epoch 8 Iter 110: loss 0.22218. :  49%|█████████████████████▌                      | 110/224 [01:39<00:56,  2.01it/s]
Epoch 8 Iter 111: loss 0.23899. :  49%|█████████████████████▌                      | 110/224 [01:40<00:56,  2.01it/s]
Epoch 8 Iter 111: loss 0.23899. :  50%|█████████████████████▊                      | 111/224 [01:40<00:56,  2.02it/s]
Epoch 8 Iter 112: loss 0.22351. :  50%|█████████████████████▊                      | 111/224 [01:40<00:56,  2.02it/s]
Epoch 8 Iter 112: loss 0.22351. :  50%|██████████████████████                      | 112/224 [01:40<00:55,  2.02it/s]
Epoch 8 Iter 113: loss 0.23190. :  50%|██████████████████████                      | 112/224 [01:41<00:55,  2.02it/s]
Epoch 8 Iter 113: loss 0.23190. :  50%|██████████████████████▏                     | 113/224 [01:41<00:55,  2.02it/s]
Epoch 8 Iter 114: loss 0.24498. :  50%|██████████████████████▏                     | 113/224 [01:41<00:55,  2.02it/s]
Epoch 8 Iter 114: loss 0.24498. :  51%|██████████████████████▍                     | 114/224 [01:41<00:54,  2.02it/s]
Epoch 8 Iter 115: loss 0.21806. :  51%|██████████████████████▍                     | 114/224 [01:42<00:54,  2.02it/s]
Epoch 8 Iter 115: loss 0.21806. :  51%|██████████████████████▌                     | 115/224 [01:42<00:54,  2.01it/s]
Epoch 8 Iter 116: loss 0.22909. :  51%|██████████████████████▌                     | 115/224 [01:42<00:54,  2.01it/s]
Epoch 8 Iter 116: loss 0.22909. :  52%|██████████████████████▊                     | 116/224 [01:42<00:53,  2.02it/s]
Epoch 8 Iter 117: loss 0.23838. :  52%|██████████████████████▊                     | 116/224 [01:43<00:53,  2.02it/s]
Epoch 8 Iter 117: loss 0.23838. :  52%|██████████████████████▉                     | 117/224 [01:43<00:52,  2.02it/s]
Epoch 8 Iter 118: loss 0.23868. :  52%|██████████████████████▉                     | 117/224 [01:43<00:52,  2.02it/s]
Epoch 8 Iter 118: loss 0.23868. :  53%|███████████████████████▏                    | 118/224 [01:43<00:52,  2.03it/s]
Epoch 8 Iter 119: loss 0.22437. :  53%|███████████████████████▏                    | 118/224 [01:44<00:52,  2.03it/s]
Epoch 8 Iter 119: loss 0.22437. :  53%|███████████████████████▍                    | 119/224 [01:44<00:52,  2.02it/s]
Epoch 8 Iter 120: loss 0.23261. :  53%|███████████████████████▍                    | 119/224 [01:44<00:52,  2.02it/s]
Epoch 8 Iter 120: loss 0.23261. :  54%|███████████████████████▌                    | 120/224 [01:44<00:51,  2.00it/s]
Epoch 8 Iter 121: loss 0.23485. :  54%|███████████████████████▌                    | 120/224 [01:45<00:51,  2.00it/s]
Epoch 8 Iter 121: loss 0.23485. :  54%|███████████████████████▊                    | 121/224 [01:45<00:51,  1.99it/s]
Epoch 8 Iter 122: loss 0.22533. :  54%|███████████████████████▊                    | 121/224 [01:45<00:51,  1.99it/s]
Epoch 8 Iter 122: loss 0.22533. :  54%|███████████████████████▉                    | 122/224 [01:45<00:51,  1.99it/s]
Epoch 8 Iter 123: loss 0.25232. :  54%|███████████████████████▉                    | 122/224 [01:46<00:51,  1.99it/s]
Epoch 8 Iter 123: loss 0.25232. :  55%|████████████████████████▏                   | 123/224 [01:46<00:51,  1.98it/s]
Epoch 8 Iter 124: loss 0.24268. :  55%|████████████████████████▏                   | 123/224 [01:46<00:51,  1.98it/s]
Epoch 8 Iter 124: loss 0.24268. :  55%|████████████████████████▎                   | 124/224 [01:46<00:50,  1.97it/s]
Epoch 8 Iter 125: loss 0.22097. :  55%|████████████████████████▎                   | 124/224 [01:47<00:50,  1.97it/s]
Epoch 8 Iter 125: loss 0.22097. :  56%|████████████████████████▌                   | 125/224 [01:47<00:50,  1.95it/s]
Epoch 8 Iter 126: loss 0.23701. :  56%|████████████████████████▌                   | 125/224 [01:47<00:50,  1.95it/s]
Epoch 8 Iter 126: loss 0.23701. :  56%|████████████████████████▊                   | 126/224 [01:47<00:50,  1.96it/s]
Epoch 8 Iter 127: loss 0.21657. :  56%|████████████████████████▊                   | 126/224 [01:48<00:50,  1.96it/s]
Epoch 8 Iter 127: loss 0.21657. :  57%|████████████████████████▉                   | 127/224 [01:48<00:51,  1.89it/s]
Epoch 8 Iter 128: loss 0.24175. :  57%|████████████████████████▉                   | 127/224 [01:49<00:51,  1.89it/s]
Epoch 8 Iter 128: loss 0.24175. :  57%|█████████████████████████▏                  | 128/224 [01:49<00:50,  1.91it/s]
Epoch 8 Iter 129: loss 0.24116. :  57%|█████████████████████████▏                  | 128/224 [01:49<00:50,  1.91it/s]
Epoch 8 Iter 129: loss 0.24116. :  58%|█████████████████████████▎                  | 129/224 [01:49<00:49,  1.93it/s]
Epoch 8 Iter 130: loss 0.23027. :  58%|█████████████████████████▎                  | 129/224 [01:50<00:49,  1.93it/s]
Epoch 8 Iter 130: loss 0.23027. :  58%|█████████████████████████▌                  | 130/224 [01:50<00:48,  1.95it/s]
Epoch 8 Iter 131: loss 0.23589. :  58%|█████████████████████████▌                  | 130/224 [01:50<00:48,  1.95it/s]
Epoch 8 Iter 131: loss 0.23589. :  58%|█████████████████████████▋                  | 131/224 [01:50<00:47,  1.97it/s]
Epoch 8 Iter 132: loss 0.24500. :  58%|█████████████████████████▋                  | 131/224 [01:51<00:47,  1.97it/s]
Epoch 8 Iter 132: loss 0.24500. :  59%|█████████████████████████▉                  | 132/224 [01:51<00:46,  1.97it/s]
Epoch 8 Iter 133: loss 0.24138. :  59%|█████████████████████████▉                  | 132/224 [01:51<00:46,  1.97it/s]
Epoch 8 Iter 133: loss 0.24138. :  59%|██████████████████████████▏                 | 133/224 [01:51<00:46,  1.97it/s]
Epoch 8 Iter 134: loss 0.23104. :  59%|██████████████████████████▏                 | 133/224 [01:52<00:46,  1.97it/s]
Epoch 8 Iter 134: loss 0.23104. :  60%|██████████████████████████▎                 | 134/224 [01:52<00:45,  1.96it/s]
Epoch 8 Iter 135: loss 0.24563. :  60%|██████████████████████████▎                 | 134/224 [01:52<00:45,  1.96it/s]
Epoch 8 Iter 135: loss 0.24563. :  60%|██████████████████████████▌                 | 135/224 [01:52<00:45,  1.97it/s]
Epoch 8 Iter 136: loss 0.23956. :  60%|██████████████████████████▌                 | 135/224 [01:53<00:45,  1.97it/s]
Epoch 8 Iter 136: loss 0.23956. :  61%|██████████████████████████▋                 | 136/224 [01:53<00:44,  1.98it/s]
Epoch 8 Iter 137: loss 0.22079. :  61%|██████████████████████████▋                 | 136/224 [01:53<00:44,  1.98it/s]
Epoch 8 Iter 137: loss 0.22079. :  61%|██████████████████████████▉                 | 137/224 [01:53<00:44,  1.97it/s]
Epoch 8 Iter 138: loss 0.23681. :  61%|██████████████████████████▉                 | 137/224 [01:54<00:44,  1.97it/s]
Epoch 8 Iter 138: loss 0.23681. :  62%|███████████████████████████                 | 138/224 [01:54<00:43,  1.98it/s]
Epoch 8 Iter 139: loss 0.22486. :  62%|███████████████████████████                 | 138/224 [01:54<00:43,  1.98it/s]
Epoch 8 Iter 139: loss 0.22486. :  62%|███████████████████████████▎                | 139/224 [01:54<00:42,  1.99it/s]
Epoch 8 Iter 140: loss 0.23630. :  62%|███████████████████████████▎                | 139/224 [01:55<00:42,  1.99it/s]
Epoch 8 Iter 140: loss 0.23630. :  62%|███████████████████████████▌                | 140/224 [01:55<00:42,  1.99it/s]
Epoch 8 Iter 141: loss 0.23625. :  62%|███████████████████████████▌                | 140/224 [01:55<00:42,  1.99it/s]
Epoch 8 Iter 141: loss 0.23625. :  63%|███████████████████████████▋                | 141/224 [01:55<00:41,  1.99it/s]
Epoch 8 Iter 142: loss 0.23227. :  63%|███████████████████████████▋                | 141/224 [01:56<00:41,  1.99it/s]
Epoch 8 Iter 142: loss 0.23227. :  63%|███████████████████████████▉                | 142/224 [01:56<00:41,  1.99it/s]
Epoch 8 Iter 143: loss 0.24325. :  63%|███████████████████████████▉                | 142/224 [01:56<00:41,  1.99it/s]
Epoch 8 Iter 143: loss 0.24325. :  64%|████████████████████████████                | 143/224 [01:56<00:40,  2.01it/s]
Epoch 8 Iter 144: loss 0.24374. :  64%|████████████████████████████                | 143/224 [01:57<00:40,  2.01it/s]
Epoch 8 Iter 144: loss 0.24374. :  64%|████████████████████████████▎               | 144/224 [01:57<00:39,  2.01it/s]
Epoch 8 Iter 145: loss 0.24568. :  64%|████████████████████████████▎               | 144/224 [01:57<00:39,  2.01it/s]
Epoch 8 Iter 145: loss 0.24568. :  65%|████████████████████████████▍               | 145/224 [01:57<00:39,  2.01it/s]
Epoch 8 Iter 146: loss 0.21303. :  65%|████████████████████████████▍               | 145/224 [01:58<00:39,  2.01it/s]
Epoch 8 Iter 146: loss 0.21303. :  65%|████████████████████████████▋               | 146/224 [01:58<00:38,  2.01it/s]
Epoch 8 Iter 147: loss 0.25963. :  65%|████████████████████████████▋               | 146/224 [01:58<00:38,  2.01it/s]
Epoch 8 Iter 147: loss 0.25963. :  66%|████████████████████████████▉               | 147/224 [01:58<00:38,  2.02it/s]
Epoch 8 Iter 148: loss 0.23155. :  66%|████████████████████████████▉               | 147/224 [01:59<00:38,  2.02it/s]
Epoch 8 Iter 148: loss 0.23155. :  66%|█████████████████████████████               | 148/224 [01:59<00:37,  2.02it/s]
Epoch 8 Iter 149: loss 0.26280. :  66%|█████████████████████████████               | 148/224 [01:59<00:37,  2.02it/s]
Epoch 8 Iter 149: loss 0.26280. :  67%|█████████████████████████████▎              | 149/224 [01:59<00:37,  2.02it/s]
Epoch 8 Iter 150: loss 0.23329. :  67%|█████████████████████████████▎              | 149/224 [02:00<00:37,  2.02it/s]
Epoch 8 Iter 150: loss 0.23329. :  67%|█████████████████████████████▍              | 150/224 [02:00<00:36,  2.02it/s]
Epoch 8 Iter 151: loss 0.23919. :  67%|█████████████████████████████▍              | 150/224 [02:00<00:36,  2.02it/s]
Epoch 8 Iter 151: loss 0.23919. :  67%|█████████████████████████████▋              | 151/224 [02:00<00:36,  2.02it/s]
Epoch 8 Iter 152: loss 0.23386. :  67%|█████████████████████████████▋              | 151/224 [02:01<00:36,  2.02it/s]
Epoch 8 Iter 152: loss 0.23386. :  68%|█████████████████████████████▊              | 152/224 [02:01<00:36,  2.00it/s]
Epoch 8 Iter 153: loss 0.23069. :  68%|█████████████████████████████▊              | 152/224 [02:01<00:36,  2.00it/s]
Epoch 8 Iter 153: loss 0.23069. :  68%|██████████████████████████████              | 153/224 [02:01<00:35,  2.00it/s]
Epoch 8 Iter 154: loss 0.23158. :  68%|██████████████████████████████              | 153/224 [02:02<00:35,  2.00it/s]
Epoch 8 Iter 154: loss 0.23158. :  69%|██████████████████████████████▎             | 154/224 [02:02<00:35,  1.99it/s]
Epoch 8 Iter 155: loss 0.22797. :  69%|██████████████████████████████▎             | 154/224 [02:02<00:35,  1.99it/s]
Epoch 8 Iter 155: loss 0.22797. :  69%|██████████████████████████████▍             | 155/224 [02:02<00:34,  1.99it/s]
Epoch 8 Iter 156: loss 0.21012. :  69%|██████████████████████████████▍             | 155/224 [02:03<00:34,  1.99it/s]
Epoch 8 Iter 156: loss 0.21012. :  70%|██████████████████████████████▋             | 156/224 [02:03<00:34,  1.99it/s]
Epoch 8 Iter 157: loss 0.23625. :  70%|██████████████████████████████▋             | 156/224 [02:03<00:34,  1.99it/s]
Epoch 8 Iter 157: loss 0.23625. :  70%|██████████████████████████████▊             | 157/224 [02:03<00:33,  1.99it/s]
Epoch 8 Iter 158: loss 0.25074. :  70%|██████████████████████████████▊             | 157/224 [02:04<00:33,  1.99it/s]
Epoch 8 Iter 158: loss 0.25074. :  71%|███████████████████████████████             | 158/224 [02:04<00:33,  1.99it/s]
Epoch 8 Iter 159: loss 0.25762. :  71%|███████████████████████████████             | 158/224 [02:04<00:33,  1.99it/s]
Epoch 8 Iter 159: loss 0.25762. :  71%|███████████████████████████████▏            | 159/224 [02:04<00:33,  1.92it/s]
Epoch 8 Iter 160: loss 0.24515. :  71%|███████████████████████████████▏            | 159/224 [02:05<00:33,  1.92it/s]
Epoch 8 Iter 160: loss 0.24515. :  71%|███████████████████████████████▍            | 160/224 [02:05<00:32,  1.94it/s]
Epoch 8 Iter 161: loss 0.23797. :  71%|███████████████████████████████▍            | 160/224 [02:05<00:32,  1.94it/s]
Epoch 8 Iter 161: loss 0.23797. :  72%|███████████████████████████████▋            | 161/224 [02:05<00:32,  1.96it/s]
Epoch 8 Iter 162: loss 0.22740. :  72%|███████████████████████████████▋            | 161/224 [02:06<00:32,  1.96it/s]
Epoch 8 Iter 162: loss 0.22740. :  72%|███████████████████████████████▊            | 162/224 [02:06<00:31,  1.96it/s]
Epoch 8 Iter 163: loss 0.25138. :  72%|███████████████████████████████▊            | 162/224 [02:06<00:31,  1.96it/s]
Epoch 8 Iter 163: loss 0.25138. :  73%|████████████████████████████████            | 163/224 [02:06<00:31,  1.96it/s]
Epoch 8 Iter 164: loss 0.21978. :  73%|████████████████████████████████            | 163/224 [02:07<00:31,  1.96it/s]
Epoch 8 Iter 164: loss 0.21978. :  73%|████████████████████████████████▏           | 164/224 [02:07<00:30,  1.96it/s]
Epoch 8 Iter 165: loss 0.24243. :  73%|████████████████████████████████▏           | 164/224 [02:07<00:30,  1.96it/s]
Epoch 8 Iter 165: loss 0.24243. :  74%|████████████████████████████████▍           | 165/224 [02:07<00:29,  1.97it/s]
Epoch 8 Iter 166: loss 0.24016. :  74%|████████████████████████████████▍           | 165/224 [02:08<00:29,  1.97it/s]
Epoch 8 Iter 166: loss 0.24016. :  74%|████████████████████████████████▌           | 166/224 [02:08<00:29,  1.99it/s]
Epoch 8 Iter 167: loss 0.24042. :  74%|████████████████████████████████▌           | 166/224 [02:08<00:29,  1.99it/s]
Epoch 8 Iter 167: loss 0.24042. :  75%|████████████████████████████████▊           | 167/224 [02:08<00:29,  1.95it/s]
Epoch 8 Iter 168: loss 0.24932. :  75%|████████████████████████████████▊           | 167/224 [02:09<00:29,  1.95it/s]
Epoch 8 Iter 168: loss 0.24932. :  75%|█████████████████████████████████           | 168/224 [02:09<00:28,  1.96it/s]
Epoch 8 Iter 169: loss 0.25234. :  75%|█████████████████████████████████           | 168/224 [02:09<00:28,  1.96it/s]
Epoch 8 Iter 169: loss 0.25234. :  75%|█████████████████████████████████▏          | 169/224 [02:09<00:27,  1.97it/s]
Epoch 8 Iter 170: loss 0.23067. :  75%|█████████████████████████████████▏          | 169/224 [02:10<00:27,  1.97it/s]
Epoch 8 Iter 170: loss 0.23067. :  76%|█████████████████████████████████▍          | 170/224 [02:10<00:27,  1.98it/s]
Epoch 8 Iter 171: loss 0.22442. :  76%|█████████████████████████████████▍          | 170/224 [02:10<00:27,  1.98it/s]
Epoch 8 Iter 171: loss 0.22442. :  76%|█████████████████████████████████▌          | 171/224 [02:10<00:26,  1.98it/s]
Epoch 8 Iter 172: loss 0.22835. :  76%|█████████████████████████████████▌          | 171/224 [02:11<00:26,  1.98it/s]
Epoch 8 Iter 172: loss 0.22835. :  77%|█████████████████████████████████▊          | 172/224 [02:11<00:26,  1.98it/s]
Epoch 8 Iter 173: loss 0.23336. :  77%|█████████████████████████████████▊          | 172/224 [02:11<00:26,  1.98it/s]
Epoch 8 Iter 173: loss 0.23336. :  77%|█████████████████████████████████▉          | 173/224 [02:11<00:25,  1.98it/s]
Epoch 8 Iter 174: loss 0.26130. :  77%|█████████████████████████████████▉          | 173/224 [02:12<00:25,  1.98it/s]
Epoch 8 Iter 174: loss 0.26130. :  78%|██████████████████████████████████▏         | 174/224 [02:12<00:25,  1.99it/s]
Epoch 8 Iter 175: loss 0.24343. :  78%|██████████████████████████████████▏         | 174/224 [02:12<00:25,  1.99it/s]
Epoch 8 Iter 175: loss 0.24343. :  78%|██████████████████████████████████▍         | 175/224 [02:12<00:24,  2.00it/s]
Epoch 8 Iter 176: loss 0.21668. :  78%|██████████████████████████████████▍         | 175/224 [02:13<00:24,  2.00it/s]
Epoch 8 Iter 176: loss 0.21668. :  79%|██████████████████████████████████▌         | 176/224 [02:13<00:23,  2.00it/s]
Epoch 8 Iter 177: loss 0.23467. :  79%|██████████████████████████████████▌         | 176/224 [02:13<00:23,  2.00it/s]
Epoch 8 Iter 177: loss 0.23467. :  79%|██████████████████████████████████▊         | 177/224 [02:13<00:23,  2.01it/s]
Epoch 8 Iter 178: loss 0.22888. :  79%|██████████████████████████████████▊         | 177/224 [02:14<00:23,  2.01it/s]
Epoch 8 Iter 178: loss 0.22888. :  79%|██████████████████████████████████▉         | 178/224 [02:14<00:23,  1.93it/s]
Epoch 8 Iter 179: loss 0.23199. :  79%|██████████████████████████████████▉         | 178/224 [02:14<00:23,  1.93it/s]
Epoch 8 Iter 179: loss 0.23199. :  80%|███████████████████████████████████▏        | 179/224 [02:14<00:23,  1.94it/s]
Epoch 8 Iter 180: loss 0.22691. :  80%|███████████████████████████████████▏        | 179/224 [02:15<00:23,  1.94it/s]
Epoch 8 Iter 180: loss 0.22691. :  80%|███████████████████████████████████▎        | 180/224 [02:15<00:22,  1.98it/s]
Epoch 8 Iter 181: loss 0.23093. :  80%|███████████████████████████████████▎        | 180/224 [02:15<00:22,  1.98it/s]
Epoch 8 Iter 181: loss 0.23093. :  81%|███████████████████████████████████▌        | 181/224 [02:15<00:21,  1.99it/s]
Epoch 8 Iter 182: loss 0.21724. :  81%|███████████████████████████████████▌        | 181/224 [02:16<00:21,  1.99it/s]
Epoch 8 Iter 182: loss 0.21724. :  81%|███████████████████████████████████▊        | 182/224 [02:16<00:21,  1.99it/s]
Epoch 8 Iter 183: loss 0.26301. :  81%|███████████████████████████████████▊        | 182/224 [02:16<00:21,  1.99it/s]
Epoch 8 Iter 183: loss 0.26301. :  82%|███████████████████████████████████▉        | 183/224 [02:16<00:20,  1.99it/s]
Epoch 8 Iter 184: loss 0.24091. :  82%|███████████████████████████████████▉        | 183/224 [02:17<00:20,  1.99it/s]
Epoch 8 Iter 184: loss 0.24091. :  82%|████████████████████████████████████▏       | 184/224 [02:17<00:20,  2.00it/s]
Epoch 8 Iter 185: loss 0.25018. :  82%|████████████████████████████████████▏       | 184/224 [02:17<00:20,  2.00it/s]
Epoch 8 Iter 185: loss 0.25018. :  83%|████████████████████████████████████▎       | 185/224 [02:17<00:19,  2.00it/s]
Epoch 8 Iter 186: loss 0.24331. :  83%|████████████████████████████████████▎       | 185/224 [02:18<00:19,  2.00it/s]
Epoch 8 Iter 186: loss 0.24331. :  83%|████████████████████████████████████▌       | 186/224 [02:18<00:19,  1.99it/s]
Epoch 8 Iter 187: loss 0.23154. :  83%|████████████████████████████████████▌       | 186/224 [02:18<00:19,  1.99it/s]
Epoch 8 Iter 187: loss 0.23154. :  83%|████████████████████████████████████▋       | 187/224 [02:18<00:18,  2.00it/s]
Epoch 8 Iter 188: loss 0.23674. :  83%|████████████████████████████████████▋       | 187/224 [02:19<00:18,  2.00it/s]
Epoch 8 Iter 188: loss 0.23674. :  84%|████████████████████████████████████▉       | 188/224 [02:19<00:18,  2.00it/s]
Epoch 8 Iter 189: loss 0.24549. :  84%|████████████████████████████████████▉       | 188/224 [02:19<00:18,  2.00it/s]
Epoch 8 Iter 189: loss 0.24549. :  84%|█████████████████████████████████████▏      | 189/224 [02:19<00:18,  1.93it/s]
Epoch 8 Iter 190: loss 0.23688. :  84%|█████████████████████████████████████▏      | 189/224 [02:20<00:18,  1.93it/s]
Epoch 8 Iter 190: loss 0.23688. :  85%|█████████████████████████████████████▎      | 190/224 [02:20<00:17,  1.96it/s]
Epoch 8 Iter 191: loss 0.24334. :  85%|█████████████████████████████████████▎      | 190/224 [02:20<00:17,  1.96it/s]
Epoch 8 Iter 191: loss 0.24334. :  85%|█████████████████████████████████████▌      | 191/224 [02:20<00:16,  1.99it/s]
Epoch 8 Iter 192: loss 0.22845. :  85%|█████████████████████████████████████▌      | 191/224 [02:21<00:16,  1.99it/s]
Epoch 8 Iter 192: loss 0.22845. :  86%|█████████████████████████████████████▋      | 192/224 [02:21<00:16,  1.98it/s]
Epoch 8 Iter 193: loss 0.24003. :  86%|█████████████████████████████████████▋      | 192/224 [02:21<00:16,  1.98it/s]
Epoch 8 Iter 193: loss 0.24003. :  86%|█████████████████████████████████████▉      | 193/224 [02:21<00:15,  2.00it/s]
Epoch 8 Iter 194: loss 0.23179. :  86%|█████████████████████████████████████▉      | 193/224 [02:22<00:15,  2.00it/s]
Epoch 8 Iter 194: loss 0.23179. :  87%|██████████████████████████████████████      | 194/224 [02:22<00:14,  2.00it/s]
Epoch 8 Iter 195: loss 0.22714. :  87%|██████████████████████████████████████      | 194/224 [02:22<00:14,  2.00it/s]
Epoch 8 Iter 195: loss 0.22714. :  87%|██████████████████████████████████████▎     | 195/224 [02:22<00:14,  1.99it/s]
Epoch 8 Iter 196: loss 0.24537. :  87%|██████████████████████████████████████▎     | 195/224 [02:23<00:14,  1.99it/s]
Epoch 8 Iter 196: loss 0.24537. :  88%|██████████████████████████████████████▌     | 196/224 [02:23<00:14,  1.99it/s]
Epoch 8 Iter 197: loss 0.24466. :  88%|██████████████████████████████████████▌     | 196/224 [02:23<00:14,  1.99it/s]
Epoch 8 Iter 197: loss 0.24466. :  88%|██████████████████████████████████████▋     | 197/224 [02:23<00:13,  2.00it/s]
Epoch 8 Iter 198: loss 0.24839. :  88%|██████████████████████████████████████▋     | 197/224 [02:24<00:13,  2.00it/s]
Epoch 8 Iter 198: loss 0.24839. :  88%|██████████████████████████████████████▉     | 198/224 [02:24<00:12,  2.00it/s]
Epoch 8 Iter 199: loss 0.22467. :  88%|██████████████████████████████████████▉     | 198/224 [02:24<00:12,  2.00it/s]
Epoch 8 Iter 199: loss 0.22467. :  89%|███████████████████████████████████████     | 199/224 [02:24<00:12,  1.99it/s]
Epoch 8 Iter 200: loss 0.24373. :  89%|███████████████████████████████████████     | 199/224 [02:25<00:12,  1.99it/s]
Epoch 8 Iter 200: loss 0.24373. :  89%|███████████████████████████████████████▎    | 200/224 [02:25<00:12,  1.98it/s]
Epoch 8 Iter 201: loss 0.23460. :  89%|███████████████████████████████████████▎    | 200/224 [02:25<00:12,  1.98it/s]
Epoch 8 Iter 201: loss 0.23460. :  90%|███████████████████████████████████████▍    | 201/224 [02:25<00:11,  1.98it/s]
Epoch 8 Iter 202: loss 0.23671. :  90%|███████████████████████████████████████▍    | 201/224 [02:26<00:11,  1.98it/s]
Epoch 8 Iter 202: loss 0.23671. :  90%|███████████████████████████████████████▋    | 202/224 [02:26<00:11,  1.99it/s]
Epoch 8 Iter 203: loss 0.25136. :  90%|███████████████████████████████████████▋    | 202/224 [02:26<00:11,  1.99it/s]
Epoch 8 Iter 203: loss 0.25136. :  91%|███████████████████████████████████████▉    | 203/224 [02:26<00:10,  2.00it/s]
Epoch 8 Iter 204: loss 0.24610. :  91%|███████████████████████████████████████▉    | 203/224 [02:27<00:10,  2.00it/s]
Epoch 8 Iter 204: loss 0.24610. :  91%|████████████████████████████████████████    | 204/224 [02:27<00:10,  1.99it/s]
Epoch 8 Iter 205: loss 0.24696. :  91%|████████████████████████████████████████    | 204/224 [02:27<00:10,  1.99it/s]
Epoch 8 Iter 205: loss 0.24696. :  92%|████████████████████████████████████████▎   | 205/224 [02:27<00:09,  2.00it/s]
Epoch 8 Iter 206: loss 0.24336. :  92%|████████████████████████████████████████▎   | 205/224 [02:28<00:09,  2.00it/s]
Epoch 8 Iter 206: loss 0.24336. :  92%|████████████████████████████████████████▍   | 206/224 [02:28<00:09,  1.99it/s]
Epoch 8 Iter 207: loss 0.22643. :  92%|████████████████████████████████████████▍   | 206/224 [02:28<00:09,  1.99it/s]
Epoch 8 Iter 207: loss 0.22643. :  92%|████████████████████████████████████████▋   | 207/224 [02:28<00:08,  1.99it/s]
Epoch 8 Iter 208: loss 0.24399. :  92%|████████████████████████████████████████▋   | 207/224 [02:29<00:08,  1.99it/s]
Epoch 8 Iter 208: loss 0.24399. :  93%|████████████████████████████████████████▊   | 208/224 [02:29<00:08,  1.99it/s]
Epoch 8 Iter 209: loss 0.22354. :  93%|████████████████████████████████████████▊   | 208/224 [02:29<00:08,  1.99it/s]
Epoch 8 Iter 209: loss 0.22354. :  93%|█████████████████████████████████████████   | 209/224 [02:29<00:07,  1.99it/s]
Epoch 8 Iter 210: loss 0.21103. :  93%|█████████████████████████████████████████   | 209/224 [02:30<00:07,  1.99it/s]
Epoch 8 Iter 210: loss 0.21103. :  94%|█████████████████████████████████████████▎  | 210/224 [02:30<00:06,  2.00it/s]
Epoch 8 Iter 211: loss 0.22386. :  94%|█████████████████████████████████████████▎  | 210/224 [02:30<00:06,  2.00it/s]
Epoch 8 Iter 211: loss 0.22386. :  94%|█████████████████████████████████████████▍  | 211/224 [02:30<00:06,  2.00it/s]
Epoch 8 Iter 212: loss 0.22021. :  94%|█████████████████████████████████████████▍  | 211/224 [02:31<00:06,  2.00it/s]
Epoch 8 Iter 212: loss 0.22021. :  95%|█████████████████████████████████████████▋  | 212/224 [02:31<00:06,  2.00it/s]
Epoch 8 Iter 213: loss 0.21892. :  95%|█████████████████████████████████████████▋  | 212/224 [02:31<00:06,  2.00it/s]
Epoch 8 Iter 213: loss 0.21892. :  95%|█████████████████████████████████████████▊  | 213/224 [02:31<00:05,  1.99it/s]
Epoch 8 Iter 214: loss 0.25231. :  95%|█████████████████████████████████████████▊  | 213/224 [02:32<00:05,  1.99it/s]
Epoch 8 Iter 214: loss 0.25231. :  96%|██████████████████████████████████████████  | 214/224 [02:32<00:05,  1.99it/s]
Epoch 8 Iter 215: loss 0.22537. :  96%|██████████████████████████████████████████  | 214/224 [02:32<00:05,  1.99it/s]
Epoch 8 Iter 215: loss 0.22537. :  96%|██████████████████████████████████████████▏ | 215/224 [02:32<00:04,  1.97it/s]
Epoch 8 Iter 216: loss 0.23047. :  96%|██████████████████████████████████████████▏ | 215/224 [02:33<00:04,  1.97it/s]
Epoch 8 Iter 216: loss 0.23047. :  96%|██████████████████████████████████████████▍ | 216/224 [02:33<00:04,  1.97it/s]
Epoch 8 Iter 217: loss 0.22941. :  96%|██████████████████████████████████████████▍ | 216/224 [02:33<00:04,  1.97it/s]
Epoch 8 Iter 217: loss 0.22941. :  97%|██████████████████████████████████████████▋ | 217/224 [02:33<00:03,  1.98it/s]
Epoch 8 Iter 218: loss 0.22173. :  97%|██████████████████████████████████████████▋ | 217/224 [02:34<00:03,  1.98it/s]
Epoch 8 Iter 218: loss 0.22173. :  97%|██████████████████████████████████████████▊ | 218/224 [02:34<00:03,  1.95it/s]
Epoch 8 Iter 219: loss 0.23624. :  97%|██████████████████████████████████████████▊ | 218/224 [02:34<00:03,  1.95it/s]
Epoch 8 Iter 219: loss 0.23624. :  98%|███████████████████████████████████████████ | 219/224 [02:34<00:02,  1.96it/s]
Epoch 8 Iter 220: loss 0.24870. :  98%|███████████████████████████████████████████ | 219/224 [02:35<00:02,  1.96it/s]
Epoch 8 Iter 220: loss 0.24870. :  98%|███████████████████████████████████████████▏| 220/224 [02:35<00:02,  1.94it/s]
Epoch 8 Iter 221: loss 0.22828. :  98%|███████████████████████████████████████████▏| 220/224 [02:35<00:02,  1.94it/s]
Epoch 8 Iter 221: loss 0.22828. :  99%|███████████████████████████████████████████▍| 221/224 [02:35<00:01,  1.91it/s]
Epoch 8 Iter 222: loss 0.26613. :  99%|███████████████████████████████████████████▍| 221/224 [02:36<00:01,  1.91it/s]
Epoch 8 Iter 222: loss 0.26613. :  99%|███████████████████████████████████████████▌| 222/224 [02:36<00:01,  1.92it/s]
Epoch 8 Iter 223: loss 0.24637. :  99%|███████████████████████████████████████████▌| 222/224 [02:36<00:01,  1.92it/s]
Epoch 8 Iter 223: loss 0.24637. : 100%|███████████████████████████████████████████▊| 223/224 [02:36<00:00,  1.95it/s]
Epoch 8 Iter 224: loss 0.22006. : 100%|███████████████████████████████████████████▊| 223/224 [02:37<00:00,  1.95it/s]
Epoch 8 Iter 224: loss 0.22006. : 100%|████████████████████████████████████████████| 224/224 [02:37<00:00,  1.98it/s]
Epoch 8 Iter 224: loss 0.22006. : 100%|████████████████████████████████████████████| 224/224 [02:37<00:00,  1.42it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.22374. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.22374. :   0%|▏                                               | 1/224 [00:00<01:51,  2.01it/s]
Epoch 9 Iter 2: loss 0.23324. :   0%|▏                                               | 1/224 [00:00<01:51,  2.01it/s]
Epoch 9 Iter 2: loss 0.23324. :   1%|▍                                               | 2/224 [00:00<01:50,  2.01it/s]
Epoch 9 Iter 3: loss 0.25143. :   1%|▍                                               | 2/224 [00:01<01:50,  2.01it/s]
Epoch 9 Iter 3: loss 0.25143. :   1%|▋                                               | 3/224 [00:01<01:53,  1.94it/s]
Epoch 9 Iter 4: loss 0.24880. :   1%|▋                                               | 3/224 [00:02<01:53,  1.94it/s]
Epoch 9 Iter 4: loss 0.24880. :   2%|▊                                               | 4/224 [00:02<01:55,  1.90it/s]
Epoch 9 Iter 5: loss 0.22031. :   2%|▊                                               | 4/224 [00:02<01:55,  1.90it/s]
Epoch 9 Iter 5: loss 0.22031. :   2%|█                                               | 5/224 [00:02<01:52,  1.95it/s]
Epoch 9 Iter 6: loss 0.23725. :   2%|█                                               | 5/224 [00:03<01:52,  1.95it/s]
Epoch 9 Iter 6: loss 0.23725. :   3%|█▎                                              | 6/224 [00:03<01:51,  1.95it/s]
Epoch 9 Iter 7: loss 0.22953. :   3%|█▎                                              | 6/224 [00:03<01:51,  1.95it/s]
Epoch 9 Iter 7: loss 0.22953. :   3%|█▌                                              | 7/224 [00:03<01:50,  1.97it/s]
Epoch 9 Iter 8: loss 0.23884. :   3%|█▌                                              | 7/224 [00:04<01:50,  1.97it/s]
Epoch 9 Iter 8: loss 0.23884. :   4%|█▋                                              | 8/224 [00:04<01:49,  1.98it/s]
Epoch 9 Iter 9: loss 0.22745. :   4%|█▋                                              | 8/224 [00:04<01:49,  1.98it/s]
Epoch 9 Iter 9: loss 0.22745. :   4%|█▉                                              | 9/224 [00:04<01:48,  1.98it/s]
Epoch 9 Iter 10: loss 0.23512. :   4%|█▉                                             | 9/224 [00:05<01:48,  1.98it/s]
Epoch 9 Iter 10: loss 0.23512. :   4%|██                                            | 10/224 [00:05<01:48,  1.97it/s]
Epoch 9 Iter 11: loss 0.22755. :   4%|██                                            | 10/224 [00:05<01:48,  1.97it/s]
Epoch 9 Iter 11: loss 0.22755. :   5%|██▎                                           | 11/224 [00:05<01:46,  1.99it/s]
Epoch 9 Iter 12: loss 0.21442. :   5%|██▎                                           | 11/224 [00:06<01:46,  1.99it/s]
Epoch 9 Iter 12: loss 0.21442. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.00it/s]
Epoch 9 Iter 13: loss 0.23718. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.00it/s]
Epoch 9 Iter 13: loss 0.23718. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.01it/s]
Epoch 9 Iter 14: loss 0.23962. :   6%|██▋                                           | 13/224 [00:07<01:45,  2.01it/s]
Epoch 9 Iter 14: loss 0.23962. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.00it/s]
Epoch 9 Iter 15: loss 0.25117. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.00it/s]
Epoch 9 Iter 15: loss 0.25117. :   7%|███                                           | 15/224 [00:07<01:46,  1.96it/s]
Epoch 9 Iter 16: loss 0.24054. :   7%|███                                           | 15/224 [00:08<01:46,  1.96it/s]
Epoch 9 Iter 16: loss 0.24054. :   7%|███▎                                          | 16/224 [00:08<01:45,  1.96it/s]
Epoch 9 Iter 17: loss 0.24847. :   7%|███▎                                          | 16/224 [00:08<01:45,  1.96it/s]
Epoch 9 Iter 17: loss 0.24847. :   8%|███▍                                          | 17/224 [00:08<01:45,  1.95it/s]
Epoch 9 Iter 18: loss 0.23173. :   8%|███▍                                          | 17/224 [00:09<01:45,  1.95it/s]
Epoch 9 Iter 18: loss 0.23173. :   8%|███▋                                          | 18/224 [00:09<01:45,  1.96it/s]
Epoch 9 Iter 19: loss 0.24576. :   8%|███▋                                          | 18/224 [00:09<01:45,  1.96it/s]
Epoch 9 Iter 19: loss 0.24576. :   8%|███▉                                          | 19/224 [00:09<01:44,  1.97it/s]
Epoch 9 Iter 20: loss 0.23390. :   8%|███▉                                          | 19/224 [00:10<01:44,  1.97it/s]
Epoch 9 Iter 20: loss 0.23390. :   9%|████                                          | 20/224 [00:10<01:43,  1.97it/s]
Epoch 9 Iter 21: loss 0.20902. :   9%|████                                          | 20/224 [00:10<01:43,  1.97it/s]
Epoch 9 Iter 21: loss 0.20902. :   9%|████▎                                         | 21/224 [00:10<01:44,  1.94it/s]
Epoch 9 Iter 22: loss 0.21936. :   9%|████▎                                         | 21/224 [00:11<01:44,  1.94it/s]
Epoch 9 Iter 22: loss 0.21936. :  10%|████▌                                         | 22/224 [00:11<01:46,  1.90it/s]
Epoch 9 Iter 23: loss 0.22046. :  10%|████▌                                         | 22/224 [00:11<01:46,  1.90it/s]
Epoch 9 Iter 23: loss 0.22046. :  10%|████▋                                         | 23/224 [00:11<01:44,  1.93it/s]
Epoch 9 Iter 24: loss 0.22173. :  10%|████▋                                         | 23/224 [00:12<01:44,  1.93it/s]
Epoch 9 Iter 24: loss 0.22173. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.21825. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.21825. :  11%|█████▏                                        | 25/224 [00:12<01:41,  1.97it/s]
Epoch 9 Iter 26: loss 0.23660. :  11%|█████▏                                        | 25/224 [00:13<01:41,  1.97it/s]
Epoch 9 Iter 26: loss 0.23660. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.98it/s]
Epoch 9 Iter 27: loss 0.23219. :  12%|█████▎                                        | 26/224 [00:13<01:40,  1.98it/s]
Epoch 9 Iter 27: loss 0.23219. :  12%|█████▌                                        | 27/224 [00:13<01:39,  1.99it/s]
Epoch 9 Iter 28: loss 0.23418. :  12%|█████▌                                        | 27/224 [00:14<01:39,  1.99it/s]
Epoch 9 Iter 28: loss 0.23418. :  12%|█████▊                                        | 28/224 [00:14<01:38,  2.00it/s]
Epoch 9 Iter 29: loss 0.22709. :  12%|█████▊                                        | 28/224 [00:14<01:38,  2.00it/s]
Epoch 9 Iter 29: loss 0.22709. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 9 Iter 30: loss 0.24402. :  13%|█████▉                                        | 29/224 [00:15<01:37,  1.99it/s]
Epoch 9 Iter 30: loss 0.24402. :  13%|██████▏                                       | 30/224 [00:15<01:37,  1.99it/s]
Epoch 9 Iter 31: loss 0.23240. :  13%|██████▏                                       | 30/224 [00:15<01:37,  1.99it/s]
Epoch 9 Iter 31: loss 0.23240. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.00it/s]
Epoch 9 Iter 32: loss 0.25695. :  14%|██████▎                                       | 31/224 [00:16<01:36,  2.00it/s]
Epoch 9 Iter 32: loss 0.25695. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.00it/s]
Epoch 9 Iter 33: loss 0.25814. :  14%|██████▌                                       | 32/224 [00:16<01:35,  2.00it/s]
Epoch 9 Iter 33: loss 0.25814. :  15%|██████▊                                       | 33/224 [00:16<01:35,  2.00it/s]
Epoch 9 Iter 34: loss 0.22644. :  15%|██████▊                                       | 33/224 [00:17<01:35,  2.00it/s]
Epoch 9 Iter 34: loss 0.22644. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 9 Iter 35: loss 0.22823. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 9 Iter 35: loss 0.22823. :  16%|███████▏                                      | 35/224 [00:17<01:34,  1.99it/s]
Epoch 9 Iter 36: loss 0.20969. :  16%|███████▏                                      | 35/224 [00:18<01:34,  1.99it/s]
Epoch 9 Iter 36: loss 0.20969. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 9 Iter 37: loss 0.23236. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 9 Iter 37: loss 0.23236. :  17%|███████▌                                      | 37/224 [00:18<01:36,  1.94it/s]
Epoch 9 Iter 38: loss 0.24650. :  17%|███████▌                                      | 37/224 [00:19<01:36,  1.94it/s]
Epoch 9 Iter 38: loss 0.24650. :  17%|███████▊                                      | 38/224 [00:19<01:36,  1.93it/s]
Epoch 9 Iter 39: loss 0.24319. :  17%|███████▊                                      | 38/224 [00:19<01:36,  1.93it/s]
Epoch 9 Iter 39: loss 0.24319. :  17%|████████                                      | 39/224 [00:19<01:34,  1.96it/s]
Epoch 9 Iter 40: loss 0.22974. :  17%|████████                                      | 39/224 [00:20<01:34,  1.96it/s]
Epoch 9 Iter 40: loss 0.22974. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.98it/s]
Epoch 9 Iter 41: loss 0.23310. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.98it/s]
Epoch 9 Iter 41: loss 0.23310. :  18%|████████▍                                     | 41/224 [00:20<01:32,  1.99it/s]
Epoch 9 Iter 42: loss 0.25158. :  18%|████████▍                                     | 41/224 [00:21<01:32,  1.99it/s]
Epoch 9 Iter 42: loss 0.25158. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.97it/s]
Epoch 9 Iter 43: loss 0.25063. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.97it/s]
Epoch 9 Iter 43: loss 0.25063. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.97it/s]
Epoch 9 Iter 44: loss 0.23612. :  19%|████████▊                                     | 43/224 [00:22<01:31,  1.97it/s]
Epoch 9 Iter 44: loss 0.23612. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.96it/s]
Epoch 9 Iter 45: loss 0.25502. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.96it/s]
Epoch 9 Iter 45: loss 0.25502. :  20%|█████████▏                                    | 45/224 [00:22<01:31,  1.97it/s]
Epoch 9 Iter 46: loss 0.23679. :  20%|█████████▏                                    | 45/224 [00:23<01:31,  1.97it/s]
Epoch 9 Iter 46: loss 0.23679. :  21%|█████████▍                                    | 46/224 [00:23<01:30,  1.97it/s]
Epoch 9 Iter 47: loss 0.25986. :  21%|█████████▍                                    | 46/224 [00:23<01:30,  1.97it/s]
Epoch 9 Iter 47: loss 0.25986. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 9 Iter 48: loss 0.22152. :  21%|█████████▋                                    | 47/224 [00:24<01:31,  1.94it/s]
Epoch 9 Iter 48: loss 0.22152. :  21%|█████████▊                                    | 48/224 [00:24<01:29,  1.97it/s]
Epoch 9 Iter 49: loss 0.24407. :  21%|█████████▊                                    | 48/224 [00:24<01:29,  1.97it/s]
Epoch 9 Iter 49: loss 0.24407. :  22%|██████████                                    | 49/224 [00:24<01:28,  1.98it/s]
Epoch 9 Iter 50: loss 0.23096. :  22%|██████████                                    | 49/224 [00:25<01:28,  1.98it/s]
Epoch 9 Iter 50: loss 0.23096. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.99it/s]
Epoch 9 Iter 51: loss 0.26225. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.99it/s]
Epoch 9 Iter 51: loss 0.26225. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.99it/s]
Epoch 9 Iter 52: loss 0.24343. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.99it/s]
Epoch 9 Iter 52: loss 0.24343. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.00it/s]
Epoch 9 Iter 53: loss 0.21825. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.00it/s]
Epoch 9 Iter 53: loss 0.21825. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 9 Iter 54: loss 0.24629. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  2.01it/s]
Epoch 9 Iter 54: loss 0.24629. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.00it/s]
Epoch 9 Iter 55: loss 0.26727. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.00it/s]
Epoch 9 Iter 55: loss 0.26727. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 9 Iter 56: loss 0.24548. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  2.00it/s]
Epoch 9 Iter 56: loss 0.24548. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  1.99it/s]
Epoch 9 Iter 57: loss 0.22444. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  1.99it/s]
Epoch 9 Iter 57: loss 0.22444. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.99it/s]
Epoch 9 Iter 58: loss 0.22874. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.99it/s]
Epoch 9 Iter 58: loss 0.22874. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 9 Iter 59: loss 0.21850. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  1.99it/s]
Epoch 9 Iter 59: loss 0.21850. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 9 Iter 60: loss 0.23540. :  26%|████████████                                  | 59/224 [00:30<01:22,  1.99it/s]
Epoch 9 Iter 60: loss 0.23540. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 9 Iter 61: loss 0.22793. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.00it/s]
Epoch 9 Iter 61: loss 0.22793. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 9 Iter 62: loss 0.25185. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.00it/s]
Epoch 9 Iter 62: loss 0.25185. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.98it/s]
Epoch 9 Iter 63: loss 0.22904. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.98it/s]
Epoch 9 Iter 63: loss 0.22904. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.97it/s]
Epoch 9 Iter 64: loss 0.23412. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.97it/s]
Epoch 9 Iter 64: loss 0.23412. :  29%|█████████████▏                                | 64/224 [00:32<01:22,  1.94it/s]
Epoch 9 Iter 65: loss 0.23151. :  29%|█████████████▏                                | 64/224 [00:32<01:22,  1.94it/s]
Epoch 9 Iter 65: loss 0.23151. :  29%|█████████████▎                                | 65/224 [00:32<01:22,  1.94it/s]
Epoch 9 Iter 66: loss 0.24488. :  29%|█████████████▎                                | 65/224 [00:33<01:22,  1.94it/s]
Epoch 9 Iter 66: loss 0.24488. :  29%|█████████████▌                                | 66/224 [00:33<01:21,  1.94it/s]
Epoch 9 Iter 67: loss 0.23967. :  29%|█████████████▌                                | 66/224 [00:33<01:21,  1.94it/s]
Epoch 9 Iter 67: loss 0.23967. :  30%|█████████████▊                                | 67/224 [00:33<01:20,  1.94it/s]
Epoch 9 Iter 68: loss 0.24256. :  30%|█████████████▊                                | 67/224 [00:34<01:20,  1.94it/s]
Epoch 9 Iter 68: loss 0.24256. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.96it/s]
Epoch 9 Iter 69: loss 0.22881. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.96it/s]
Epoch 9 Iter 69: loss 0.22881. :  31%|██████████████▏                               | 69/224 [00:34<01:18,  1.96it/s]
Epoch 9 Iter 70: loss 0.23019. :  31%|██████████████▏                               | 69/224 [00:35<01:18,  1.96it/s]
Epoch 9 Iter 70: loss 0.23019. :  31%|██████████████▍                               | 70/224 [00:35<01:18,  1.97it/s]
Epoch 9 Iter 71: loss 0.24894. :  31%|██████████████▍                               | 70/224 [00:35<01:18,  1.97it/s]
Epoch 9 Iter 71: loss 0.24894. :  32%|██████████████▌                               | 71/224 [00:35<01:18,  1.96it/s]
Epoch 9 Iter 72: loss 0.23539. :  32%|██████████████▌                               | 71/224 [00:36<01:18,  1.96it/s]
Epoch 9 Iter 72: loss 0.23539. :  32%|██████████████▊                               | 72/224 [00:36<01:17,  1.97it/s]
Epoch 9 Iter 73: loss 0.22034. :  32%|██████████████▊                               | 72/224 [00:37<01:17,  1.97it/s]
Epoch 9 Iter 73: loss 0.22034. :  33%|██████████████▉                               | 73/224 [00:37<01:16,  1.97it/s]
Epoch 9 Iter 74: loss 0.23335. :  33%|██████████████▉                               | 73/224 [00:37<01:16,  1.97it/s]
Epoch 9 Iter 74: loss 0.23335. :  33%|███████████████▏                              | 74/224 [00:37<01:15,  1.98it/s]
Epoch 9 Iter 75: loss 0.25392. :  33%|███████████████▏                              | 74/224 [00:38<01:15,  1.98it/s]
Epoch 9 Iter 75: loss 0.25392. :  33%|███████████████▍                              | 75/224 [00:38<01:15,  1.96it/s]
Epoch 9 Iter 76: loss 0.25660. :  33%|███████████████▍                              | 75/224 [00:38<01:15,  1.96it/s]
Epoch 9 Iter 76: loss 0.25660. :  34%|███████████████▌                              | 76/224 [00:38<01:15,  1.95it/s]
Epoch 9 Iter 77: loss 0.23613. :  34%|███████████████▌                              | 76/224 [00:39<01:15,  1.95it/s]
Epoch 9 Iter 77: loss 0.23613. :  34%|███████████████▊                              | 77/224 [00:39<01:14,  1.97it/s]
Epoch 9 Iter 78: loss 0.23520. :  34%|███████████████▊                              | 77/224 [00:39<01:14,  1.97it/s]
Epoch 9 Iter 78: loss 0.23520. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.97it/s]
Epoch 9 Iter 79: loss 0.20833. :  35%|████████████████                              | 78/224 [00:40<01:14,  1.97it/s]
Epoch 9 Iter 79: loss 0.20833. :  35%|████████████████▏                             | 79/224 [00:40<01:14,  1.96it/s]
Epoch 9 Iter 80: loss 0.25371. :  35%|████████████████▏                             | 79/224 [00:40<01:14,  1.96it/s]
Epoch 9 Iter 80: loss 0.25371. :  36%|████████████████▍                             | 80/224 [00:40<01:13,  1.95it/s]
Epoch 9 Iter 81: loss 0.21350. :  36%|████████████████▍                             | 80/224 [00:41<01:13,  1.95it/s]
Epoch 9 Iter 81: loss 0.21350. :  36%|████████████████▋                             | 81/224 [00:41<01:13,  1.95it/s]
Epoch 9 Iter 82: loss 0.21928. :  36%|████████████████▋                             | 81/224 [00:41<01:13,  1.95it/s]
Epoch 9 Iter 82: loss 0.21928. :  37%|████████████████▊                             | 82/224 [00:41<01:12,  1.95it/s]
Epoch 9 Iter 83: loss 0.21491. :  37%|████████████████▊                             | 82/224 [00:42<01:12,  1.95it/s]
Epoch 9 Iter 83: loss 0.21491. :  37%|█████████████████                             | 83/224 [00:42<01:14,  1.90it/s]
Epoch 9 Iter 84: loss 0.22931. :  37%|█████████████████                             | 83/224 [00:42<01:14,  1.90it/s]
Epoch 9 Iter 84: loss 0.22931. :  38%|█████████████████▎                            | 84/224 [00:42<01:13,  1.90it/s]
Epoch 9 Iter 85: loss 0.22962. :  38%|█████████████████▎                            | 84/224 [00:43<01:13,  1.90it/s]
Epoch 9 Iter 85: loss 0.22962. :  38%|█████████████████▍                            | 85/224 [00:43<01:12,  1.91it/s]
Epoch 9 Iter 86: loss 0.24830. :  38%|█████████████████▍                            | 85/224 [00:43<01:12,  1.91it/s]
Epoch 9 Iter 86: loss 0.24830. :  38%|█████████████████▋                            | 86/224 [00:43<01:11,  1.92it/s]
Epoch 9 Iter 87: loss 0.23663. :  38%|█████████████████▋                            | 86/224 [00:44<01:11,  1.92it/s]
Epoch 9 Iter 87: loss 0.23663. :  39%|█████████████████▊                            | 87/224 [00:44<01:10,  1.94it/s]
Epoch 9 Iter 88: loss 0.24070. :  39%|█████████████████▊                            | 87/224 [00:44<01:10,  1.94it/s]
Epoch 9 Iter 88: loss 0.24070. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.94it/s]
Epoch 9 Iter 89: loss 0.23376. :  39%|██████████████████                            | 88/224 [00:45<01:10,  1.94it/s]
Epoch 9 Iter 89: loss 0.23376. :  40%|██████████████████▎                           | 89/224 [00:45<01:09,  1.94it/s]
Epoch 9 Iter 90: loss 0.22228. :  40%|██████████████████▎                           | 89/224 [00:45<01:09,  1.94it/s]
Epoch 9 Iter 90: loss 0.22228. :  40%|██████████████████▍                           | 90/224 [00:45<01:08,  1.95it/s]
Epoch 9 Iter 91: loss 0.23076. :  40%|██████████████████▍                           | 90/224 [00:46<01:08,  1.95it/s]
Epoch 9 Iter 91: loss 0.23076. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.96it/s]
Epoch 9 Iter 92: loss 0.23688. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.96it/s]
Epoch 9 Iter 92: loss 0.23688. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.97it/s]
Epoch 9 Iter 93: loss 0.25004. :  41%|██████████████████▉                           | 92/224 [00:47<01:06,  1.97it/s]
Epoch 9 Iter 93: loss 0.25004. :  42%|███████████████████                           | 93/224 [00:47<01:05,  1.99it/s]
Epoch 9 Iter 94: loss 0.22555. :  42%|███████████████████                           | 93/224 [00:47<01:05,  1.99it/s]
Epoch 9 Iter 94: loss 0.22555. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.99it/s]
Epoch 9 Iter 95: loss 0.22626. :  42%|███████████████████▎                          | 94/224 [00:48<01:05,  1.99it/s]
Epoch 9 Iter 95: loss 0.22626. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 9 Iter 96: loss 0.23380. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  1.99it/s]
Epoch 9 Iter 96: loss 0.23380. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 9 Iter 97: loss 0.22387. :  43%|███████████████████▋                          | 96/224 [00:49<01:04,  1.98it/s]
Epoch 9 Iter 97: loss 0.22387. :  43%|███████████████████▉                          | 97/224 [00:49<01:03,  1.99it/s]
Epoch 9 Iter 98: loss 0.22078. :  43%|███████████████████▉                          | 97/224 [00:49<01:03,  1.99it/s]
Epoch 9 Iter 98: loss 0.22078. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.99it/s]
Epoch 9 Iter 99: loss 0.21593. :  44%|████████████████████▏                         | 98/224 [00:50<01:03,  1.99it/s]
Epoch 9 Iter 99: loss 0.21593. :  44%|████████████████████▎                         | 99/224 [00:50<01:02,  1.99it/s]
Epoch 9 Iter 100: loss 0.24086. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  1.99it/s]
Epoch 9 Iter 100: loss 0.24086. :  45%|███████████████████▋                        | 100/224 [00:50<01:02,  1.99it/s]
Epoch 9 Iter 101: loss 0.26631. :  45%|███████████████████▋                        | 100/224 [00:51<01:02,  1.99it/s]
Epoch 9 Iter 101: loss 0.26631. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.98it/s]
Epoch 9 Iter 102: loss 0.23404. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.98it/s]
Epoch 9 Iter 102: loss 0.23404. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 9 Iter 103: loss 0.24013. :  46%|████████████████████                        | 102/224 [00:52<01:02,  1.95it/s]
Epoch 9 Iter 103: loss 0.24013. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.96it/s]
Epoch 9 Iter 104: loss 0.23577. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.96it/s]
Epoch 9 Iter 104: loss 0.23577. :  46%|████████████████████▍                       | 104/224 [00:52<01:01,  1.95it/s]
Epoch 9 Iter 105: loss 0.23209. :  46%|████████████████████▍                       | 104/224 [00:53<01:01,  1.95it/s]
Epoch 9 Iter 105: loss 0.23209. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.95it/s]
Epoch 9 Iter 106: loss 0.24563. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.95it/s]
Epoch 9 Iter 106: loss 0.24563. :  47%|████████████████████▊                       | 106/224 [00:53<01:00,  1.95it/s]
Epoch 9 Iter 107: loss 0.25376. :  47%|████████████████████▊                       | 106/224 [00:54<01:00,  1.95it/s]
Epoch 9 Iter 107: loss 0.25376. :  48%|█████████████████████                       | 107/224 [00:54<01:00,  1.94it/s]
Epoch 9 Iter 108: loss 0.24580. :  48%|█████████████████████                       | 107/224 [00:54<01:00,  1.94it/s]
Epoch 9 Iter 108: loss 0.24580. :  48%|█████████████████████▏                      | 108/224 [00:54<00:59,  1.96it/s]
Epoch 9 Iter 109: loss 0.24116. :  48%|█████████████████████▏                      | 108/224 [00:55<00:59,  1.96it/s]
Epoch 9 Iter 109: loss 0.24116. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.98it/s]
Epoch 9 Iter 110: loss 0.24353. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.98it/s]
Epoch 9 Iter 110: loss 0.24353. :  49%|█████████████████████▌                      | 110/224 [00:55<00:58,  1.94it/s]
Epoch 9 Iter 111: loss 0.21657. :  49%|█████████████████████▌                      | 110/224 [00:56<00:58,  1.94it/s]
Epoch 9 Iter 111: loss 0.21657. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.96it/s]
Epoch 9 Iter 112: loss 0.23896. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.96it/s]
Epoch 9 Iter 112: loss 0.23896. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.98it/s]
Epoch 9 Iter 113: loss 0.23824. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.98it/s]
Epoch 9 Iter 113: loss 0.23824. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  1.99it/s]
Epoch 9 Iter 114: loss 0.24864. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  1.99it/s]
Epoch 9 Iter 114: loss 0.24864. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.99it/s]
Epoch 9 Iter 115: loss 0.23743. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.99it/s]
Epoch 9 Iter 115: loss 0.23743. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.98it/s]
Epoch 9 Iter 116: loss 0.24026. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.98it/s]
Epoch 9 Iter 116: loss 0.24026. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.97it/s]
Epoch 9 Iter 117: loss 0.22880. :  52%|██████████████████████▊                     | 116/224 [00:59<00:54,  1.97it/s]
Epoch 9 Iter 117: loss 0.22880. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.98it/s]
Epoch 9 Iter 118: loss 0.24517. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.98it/s]
Epoch 9 Iter 118: loss 0.24517. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.97it/s]
Epoch 9 Iter 119: loss 0.24508. :  53%|███████████████████████▏                    | 118/224 [01:00<00:53,  1.97it/s]
Epoch 9 Iter 119: loss 0.24508. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.98it/s]
Epoch 9 Iter 120: loss 0.22123. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.98it/s]
Epoch 9 Iter 120: loss 0.22123. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 9 Iter 121: loss 0.23848. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.98it/s]
Epoch 9 Iter 121: loss 0.23848. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 9 Iter 122: loss 0.23947. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 9 Iter 122: loss 0.23947. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.99it/s]
Epoch 9 Iter 123: loss 0.22203. :  54%|███████████████████████▉                    | 122/224 [01:02<00:51,  1.99it/s]
Epoch 9 Iter 123: loss 0.22203. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.97it/s]
Epoch 9 Iter 124: loss 0.23587. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.97it/s]
Epoch 9 Iter 124: loss 0.23587. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.98it/s]
Epoch 9 Iter 125: loss 0.21949. :  55%|████████████████████████▎                   | 124/224 [01:03<00:50,  1.98it/s]
Epoch 9 Iter 125: loss 0.21949. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.97it/s]
Epoch 9 Iter 126: loss 0.23231. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.97it/s]
Epoch 9 Iter 126: loss 0.23231. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.97it/s]
Epoch 9 Iter 127: loss 0.22952. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.97it/s]
Epoch 9 Iter 127: loss 0.22952. :  57%|████████████████████████▉                   | 127/224 [01:04<00:49,  1.97it/s]
Epoch 9 Iter 128: loss 0.23408. :  57%|████████████████████████▉                   | 127/224 [01:05<00:49,  1.97it/s]
Epoch 9 Iter 128: loss 0.23408. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.98it/s]
Epoch 9 Iter 129: loss 0.24559. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.98it/s]
Epoch 9 Iter 129: loss 0.24559. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  1.98it/s]
Epoch 9 Iter 130: loss 0.24950. :  58%|█████████████████████████▎                  | 129/224 [01:06<00:47,  1.98it/s]
Epoch 9 Iter 130: loss 0.24950. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:47,  1.98it/s]
Epoch 9 Iter 131: loss 0.24409. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:47,  1.98it/s]
Epoch 9 Iter 131: loss 0.24409. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.00it/s]
Epoch 9 Iter 132: loss 0.23951. :  58%|█████████████████████████▋                  | 131/224 [01:07<00:46,  2.00it/s]
Epoch 9 Iter 132: loss 0.23951. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:45,  2.00it/s]
Epoch 9 Iter 133: loss 0.25038. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:45,  2.00it/s]
Epoch 9 Iter 133: loss 0.25038. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.99it/s]
Epoch 9 Iter 134: loss 0.23883. :  59%|██████████████████████████▏                 | 133/224 [01:08<00:45,  1.99it/s]
Epoch 9 Iter 134: loss 0.23883. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 9 Iter 135: loss 0.23139. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 9 Iter 135: loss 0.23139. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.98it/s]
Epoch 9 Iter 136: loss 0.24208. :  60%|██████████████████████████▌                 | 135/224 [01:09<00:44,  1.98it/s]
Epoch 9 Iter 136: loss 0.24208. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:44,  1.99it/s]
Epoch 9 Iter 137: loss 0.22436. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:44,  1.99it/s]
Epoch 9 Iter 137: loss 0.22436. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  1.99it/s]
Epoch 9 Iter 138: loss 0.23094. :  61%|██████████████████████████▉                 | 137/224 [01:10<00:43,  1.99it/s]
Epoch 9 Iter 138: loss 0.23094. :  62%|███████████████████████████                 | 138/224 [01:10<00:43,  1.96it/s]
Epoch 9 Iter 139: loss 0.25241. :  62%|███████████████████████████                 | 138/224 [01:10<00:43,  1.96it/s]
Epoch 9 Iter 139: loss 0.25241. :  62%|███████████████████████████▎                | 139/224 [01:10<00:43,  1.98it/s]
Epoch 9 Iter 140: loss 0.22519. :  62%|███████████████████████████▎                | 139/224 [01:11<00:43,  1.98it/s]
Epoch 9 Iter 140: loss 0.22519. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.98it/s]
Epoch 9 Iter 141: loss 0.24158. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.98it/s]
Epoch 9 Iter 141: loss 0.24158. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  1.99it/s]
Epoch 9 Iter 142: loss 0.22638. :  63%|███████████████████████████▋                | 141/224 [01:12<00:41,  1.99it/s]
Epoch 9 Iter 142: loss 0.22638. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.99it/s]
Epoch 9 Iter 143: loss 0.23046. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.99it/s]
Epoch 9 Iter 143: loss 0.23046. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  2.00it/s]
Epoch 9 Iter 144: loss 0.23448. :  64%|████████████████████████████                | 143/224 [01:13<00:40,  2.00it/s]
Epoch 9 Iter 144: loss 0.23448. :  64%|████████████████████████████▎               | 144/224 [01:13<00:39,  2.01it/s]
Epoch 9 Iter 145: loss 0.23899. :  64%|████████████████████████████▎               | 144/224 [01:13<00:39,  2.01it/s]
Epoch 9 Iter 145: loss 0.23899. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.01it/s]
Epoch 9 Iter 146: loss 0.23647. :  65%|████████████████████████████▍               | 145/224 [01:14<00:39,  2.01it/s]
Epoch 9 Iter 146: loss 0.23647. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.03it/s]
Epoch 9 Iter 147: loss 0.23115. :  65%|████████████████████████████▋               | 146/224 [01:14<00:38,  2.03it/s]
Epoch 9 Iter 147: loss 0.23115. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.02it/s]
Epoch 9 Iter 148: loss 0.23246. :  66%|████████████████████████████▉               | 147/224 [01:15<00:38,  2.02it/s]
Epoch 9 Iter 148: loss 0.23246. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.03it/s]
Epoch 9 Iter 149: loss 0.24311. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.03it/s]
Epoch 9 Iter 149: loss 0.24311. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:36,  2.03it/s]
Epoch 9 Iter 150: loss 0.24406. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:36,  2.03it/s]
Epoch 9 Iter 150: loss 0.24406. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.03it/s]
Epoch 9 Iter 151: loss 0.23632. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.03it/s]
Epoch 9 Iter 151: loss 0.23632. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:35,  2.03it/s]
Epoch 9 Iter 152: loss 0.21648. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:35,  2.03it/s]
Epoch 9 Iter 152: loss 0.21648. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.04it/s]
Epoch 9 Iter 153: loss 0.22961. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.04it/s]
Epoch 9 Iter 153: loss 0.22961. :  68%|██████████████████████████████              | 153/224 [01:17<00:34,  2.04it/s]
Epoch 9 Iter 154: loss 0.23429. :  68%|██████████████████████████████              | 153/224 [01:17<00:34,  2.04it/s]
Epoch 9 Iter 154: loss 0.23429. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.02it/s]
Epoch 9 Iter 155: loss 0.24741. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:34,  2.02it/s]
Epoch 9 Iter 155: loss 0.24741. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.02it/s]
Epoch 9 Iter 156: loss 0.24680. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.02it/s]
Epoch 9 Iter 156: loss 0.24680. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.04it/s]
Epoch 9 Iter 157: loss 0.22801. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.04it/s]
Epoch 9 Iter 157: loss 0.22801. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:32,  2.04it/s]
Epoch 9 Iter 158: loss 0.22630. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:32,  2.04it/s]
Epoch 9 Iter 158: loss 0.22630. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.03it/s]
Epoch 9 Iter 159: loss 0.24524. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.03it/s]
Epoch 9 Iter 159: loss 0.24524. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.03it/s]
Epoch 9 Iter 160: loss 0.24007. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.03it/s]
Epoch 9 Iter 160: loss 0.24007. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.04it/s]
Epoch 9 Iter 161: loss 0.23868. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.04it/s]
Epoch 9 Iter 161: loss 0.23868. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.02it/s]
Epoch 9 Iter 162: loss 0.23430. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.02it/s]
Epoch 9 Iter 162: loss 0.23430. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.03it/s]
Epoch 9 Iter 163: loss 0.22711. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:30,  2.03it/s]
Epoch 9 Iter 163: loss 0.22711. :  73%|████████████████████████████████            | 163/224 [01:22<00:29,  2.03it/s]
Epoch 9 Iter 164: loss 0.22187. :  73%|████████████████████████████████            | 163/224 [01:22<00:29,  2.03it/s]
Epoch 9 Iter 164: loss 0.22187. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.04it/s]
Epoch 9 Iter 165: loss 0.23059. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:29,  2.04it/s]
Epoch 9 Iter 165: loss 0.23059. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:28,  2.04it/s]
Epoch 9 Iter 166: loss 0.25415. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:28,  2.04it/s]
Epoch 9 Iter 166: loss 0.25415. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.04it/s]
Epoch 9 Iter 167: loss 0.22944. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:28,  2.04it/s]
Epoch 9 Iter 167: loss 0.22944. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  2.01it/s]
Epoch 9 Iter 168: loss 0.22369. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  2.01it/s]
Epoch 9 Iter 168: loss 0.22369. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.01it/s]
Epoch 9 Iter 169: loss 0.23638. :  75%|█████████████████████████████████           | 168/224 [01:25<00:27,  2.01it/s]
Epoch 9 Iter 169: loss 0.23638. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  1.99it/s]
Epoch 9 Iter 170: loss 0.24253. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  1.99it/s]
Epoch 9 Iter 170: loss 0.24253. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.00it/s]
Epoch 9 Iter 171: loss 0.23662. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.00it/s]
Epoch 9 Iter 171: loss 0.23662. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  2.00it/s]
Epoch 9 Iter 172: loss 0.22106. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  2.00it/s]
Epoch 9 Iter 172: loss 0.22106. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.01it/s]
Epoch 9 Iter 173: loss 0.23263. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.01it/s]
Epoch 9 Iter 173: loss 0.23263. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.00it/s]
Epoch 9 Iter 174: loss 0.21511. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.00it/s]
Epoch 9 Iter 174: loss 0.21511. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.00it/s]
Epoch 9 Iter 175: loss 0.24134. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.00it/s]
Epoch 9 Iter 175: loss 0.24134. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.02it/s]
Epoch 9 Iter 176: loss 0.23659. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.02it/s]
Epoch 9 Iter 176: loss 0.23659. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.03it/s]
Epoch 9 Iter 177: loss 0.24512. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.03it/s]
Epoch 9 Iter 177: loss 0.24512. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.04it/s]
Epoch 9 Iter 178: loss 0.25276. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.04it/s]
Epoch 9 Iter 178: loss 0.25276. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.04it/s]
Epoch 9 Iter 179: loss 0.23898. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.04it/s]
Epoch 9 Iter 179: loss 0.23898. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.03it/s]
Epoch 9 Iter 180: loss 0.22350. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.03it/s]
Epoch 9 Iter 180: loss 0.22350. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.03it/s]
Epoch 9 Iter 181: loss 0.24660. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.03it/s]
Epoch 9 Iter 181: loss 0.24660. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  1.97it/s]
Epoch 9 Iter 182: loss 0.22310. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  1.97it/s]
Epoch 9 Iter 182: loss 0.22310. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:21,  1.98it/s]
Epoch 9 Iter 183: loss 0.23596. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 9 Iter 183: loss 0.23596. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  1.99it/s]
Epoch 9 Iter 184: loss 0.24006. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  1.99it/s]
Epoch 9 Iter 184: loss 0.24006. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:20,  2.00it/s]
Epoch 9 Iter 185: loss 0.23393. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  2.00it/s]
Epoch 9 Iter 185: loss 0.23393. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.99it/s]
Epoch 9 Iter 186: loss 0.24080. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.99it/s]
Epoch 9 Iter 186: loss 0.24080. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:19,  1.99it/s]
Epoch 9 Iter 187: loss 0.23236. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.99it/s]
Epoch 9 Iter 187: loss 0.23236. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.99it/s]
Epoch 9 Iter 188: loss 0.22982. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.99it/s]
Epoch 9 Iter 188: loss 0.22982. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.97it/s]
Epoch 9 Iter 189: loss 0.22796. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.97it/s]
Epoch 9 Iter 189: loss 0.22796. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.97it/s]
Epoch 9 Iter 190: loss 0.22607. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.97it/s]
Epoch 9 Iter 190: loss 0.22607. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  1.98it/s]
Epoch 9 Iter 191: loss 0.24943. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.98it/s]
Epoch 9 Iter 191: loss 0.24943. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:17,  1.93it/s]
Epoch 9 Iter 192: loss 0.23148. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:17,  1.93it/s]
Epoch 9 Iter 192: loss 0.23148. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  1.94it/s]
Epoch 9 Iter 193: loss 0.23413. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.94it/s]
Epoch 9 Iter 193: loss 0.23413. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.96it/s]
Epoch 9 Iter 194: loss 0.23523. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.96it/s]
Epoch 9 Iter 194: loss 0.23523. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:15,  1.94it/s]
Epoch 9 Iter 195: loss 0.24240. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.94it/s]
Epoch 9 Iter 195: loss 0.24240. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  1.95it/s]
Epoch 9 Iter 196: loss 0.24502. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  1.95it/s]
Epoch 9 Iter 196: loss 0.24502. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:14,  1.95it/s]
Epoch 9 Iter 197: loss 0.24756. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.95it/s]
Epoch 9 Iter 197: loss 0.24756. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  1.97it/s]
Epoch 9 Iter 198: loss 0.23682. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  1.97it/s]
Epoch 9 Iter 198: loss 0.23682. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:13,  1.97it/s]
Epoch 9 Iter 199: loss 0.23440. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.97it/s]
Epoch 9 Iter 199: loss 0.23440. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  1.97it/s]
Epoch 9 Iter 200: loss 0.25568. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  1.97it/s]
Epoch 9 Iter 200: loss 0.25568. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:12,  1.99it/s]
Epoch 9 Iter 201: loss 0.23785. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.99it/s]
Epoch 9 Iter 201: loss 0.23785. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 9 Iter 202: loss 0.22697. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 9 Iter 202: loss 0.22697. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.00it/s]
Epoch 9 Iter 203: loss 0.23413. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.00it/s]
Epoch 9 Iter 203: loss 0.23413. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  1.95it/s]
Epoch 9 Iter 204: loss 0.22277. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.95it/s]
Epoch 9 Iter 204: loss 0.22277. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.97it/s]
Epoch 9 Iter 205: loss 0.22110. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.97it/s]
Epoch 9 Iter 205: loss 0.22110. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  1.99it/s]
Epoch 9 Iter 206: loss 0.23174. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.99it/s]
Epoch 9 Iter 206: loss 0.23174. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  1.98it/s]
Epoch 9 Iter 207: loss 0.23814. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  1.98it/s]
Epoch 9 Iter 207: loss 0.23814. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  1.99it/s]
Epoch 9 Iter 208: loss 0.22813. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  1.99it/s]
Epoch 9 Iter 208: loss 0.22813. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:08,  1.98it/s]
Epoch 9 Iter 209: loss 0.24987. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:08,  1.98it/s]
Epoch 9 Iter 209: loss 0.24987. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  1.98it/s]
Epoch 9 Iter 210: loss 0.22086. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  1.98it/s]
Epoch 9 Iter 210: loss 0.22086. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:07,  1.97it/s]
Epoch 9 Iter 211: loss 0.23560. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:07,  1.97it/s]
Epoch 9 Iter 211: loss 0.23560. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  1.97it/s]
Epoch 9 Iter 212: loss 0.23642. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  1.97it/s]
Epoch 9 Iter 212: loss 0.23642. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.98it/s]
Epoch 9 Iter 213: loss 0.22210. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.98it/s]
Epoch 9 Iter 213: loss 0.22210. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.24225. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.24225. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:05,  1.97it/s]
Epoch 9 Iter 215: loss 0.27003. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:05,  1.97it/s]
Epoch 9 Iter 215: loss 0.27003. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  1.93it/s]
Epoch 9 Iter 216: loss 0.23827. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.93it/s]
Epoch 9 Iter 216: loss 0.23827. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.95it/s]
Epoch 9 Iter 217: loss 0.23724. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.95it/s]
Epoch 9 Iter 217: loss 0.23724. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  1.96it/s]
Epoch 9 Iter 218: loss 0.24546. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.96it/s]
Epoch 9 Iter 218: loss 0.24546. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.96it/s]
Epoch 9 Iter 219: loss 0.24975. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.96it/s]
Epoch 9 Iter 219: loss 0.24975. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  1.97it/s]
Epoch 9 Iter 220: loss 0.24942. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.97it/s]
Epoch 9 Iter 220: loss 0.24942. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.98it/s]
Epoch 9 Iter 221: loss 0.22073. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.98it/s]
Epoch 9 Iter 221: loss 0.22073. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  1.96it/s]
Epoch 9 Iter 222: loss 0.22937. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.96it/s]
Epoch 9 Iter 222: loss 0.22937. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:01,  1.97it/s]
Epoch 9 Iter 223: loss 0.24747. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:01,  1.97it/s]
Epoch 9 Iter 223: loss 0.24747. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  1.97it/s]
Epoch 9 Iter 224: loss 0.23508. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.97it/s]
Epoch 9 Iter 224: loss 0.23508. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.96it/s]
Epoch 9 Iter 224: loss 0.23508. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

    Train loss: 0.23582
    Valid loss: 0.2373
       Valid loss recons: 0.22763
       Valid loss KL-D:   0.96703
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.23281. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.23281. :   0%|▏                                              | 1/224 [00:00<02:02,  1.82it/s]
Epoch 10 Iter 2: loss 0.24736. :   0%|▏                                              | 1/224 [00:01<02:02,  1.82it/s]
Epoch 10 Iter 2: loss 0.24736. :   1%|▍                                              | 2/224 [00:01<01:55,  1.93it/s]
Epoch 10 Iter 3: loss 0.23422. :   1%|▍                                              | 2/224 [00:01<01:55,  1.93it/s]
Epoch 10 Iter 3: loss 0.23422. :   1%|▋                                              | 3/224 [00:01<01:52,  1.96it/s]
Epoch 10 Iter 4: loss 0.24408. :   1%|▋                                              | 3/224 [00:02<01:52,  1.96it/s]
Epoch 10 Iter 4: loss 0.24408. :   2%|▊                                              | 4/224 [00:02<01:50,  1.99it/s]
Epoch 10 Iter 5: loss 0.23871. :   2%|▊                                              | 4/224 [00:02<01:50,  1.99it/s]
Epoch 10 Iter 5: loss 0.23871. :   2%|█                                              | 5/224 [00:02<01:48,  2.01it/s]
Epoch 10 Iter 6: loss 0.23637. :   2%|█                                              | 5/224 [00:03<01:48,  2.01it/s]
Epoch 10 Iter 6: loss 0.23637. :   3%|█▎                                             | 6/224 [00:03<01:48,  2.02it/s]
Epoch 10 Iter 7: loss 0.23325. :   3%|█▎                                             | 6/224 [00:03<01:48,  2.02it/s]
Epoch 10 Iter 7: loss 0.23325. :   3%|█▍                                             | 7/224 [00:03<01:47,  2.02it/s]
Epoch 10 Iter 8: loss 0.23313. :   3%|█▍                                             | 7/224 [00:04<01:47,  2.02it/s]
Epoch 10 Iter 8: loss 0.23313. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.98it/s]
Epoch 10 Iter 9: loss 0.22116. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.98it/s]
Epoch 10 Iter 9: loss 0.22116. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.00it/s]
Epoch 10 Iter 10: loss 0.23997. :   4%|█▊                                            | 9/224 [00:05<01:47,  2.00it/s]
Epoch 10 Iter 10: loss 0.23997. :   4%|██                                           | 10/224 [00:05<01:46,  2.00it/s]
Epoch 10 Iter 11: loss 0.24238. :   4%|██                                           | 10/224 [00:05<01:46,  2.00it/s]
Epoch 10 Iter 11: loss 0.24238. :   5%|██▏                                          | 11/224 [00:05<01:46,  2.00it/s]
Epoch 10 Iter 12: loss 0.25200. :   5%|██▏                                          | 11/224 [00:06<01:46,  2.00it/s]
Epoch 10 Iter 12: loss 0.25200. :   5%|██▍                                          | 12/224 [00:06<01:45,  2.00it/s]
Epoch 10 Iter 13: loss 0.24524. :   5%|██▍                                          | 12/224 [00:06<01:45,  2.00it/s]
Epoch 10 Iter 13: loss 0.24524. :   6%|██▌                                          | 13/224 [00:06<01:44,  2.01it/s]
Epoch 10 Iter 14: loss 0.23043. :   6%|██▌                                          | 13/224 [00:07<01:44,  2.01it/s]
Epoch 10 Iter 14: loss 0.23043. :   6%|██▊                                          | 14/224 [00:07<01:43,  2.02it/s]
Epoch 10 Iter 15: loss 0.22982. :   6%|██▊                                          | 14/224 [00:07<01:43,  2.02it/s]
Epoch 10 Iter 15: loss 0.22982. :   7%|███                                          | 15/224 [00:07<01:43,  2.02it/s]
Epoch 10 Iter 16: loss 0.24430. :   7%|███                                          | 15/224 [00:07<01:43,  2.02it/s]
Epoch 10 Iter 16: loss 0.24430. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.03it/s]
Epoch 10 Iter 17: loss 0.23799. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.03it/s]
Epoch 10 Iter 17: loss 0.23799. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 10 Iter 18: loss 0.23092. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 10 Iter 18: loss 0.23092. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.03it/s]
Epoch 10 Iter 19: loss 0.22667. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.03it/s]
Epoch 10 Iter 19: loss 0.22667. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 10 Iter 20: loss 0.25866. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 10 Iter 20: loss 0.25866. :   9%|████                                         | 20/224 [00:09<01:40,  2.03it/s]
Epoch 10 Iter 21: loss 0.24680. :   9%|████                                         | 20/224 [00:10<01:40,  2.03it/s]
Epoch 10 Iter 21: loss 0.24680. :   9%|████▏                                        | 21/224 [00:10<01:40,  2.02it/s]
Epoch 10 Iter 22: loss 0.23249. :   9%|████▏                                        | 21/224 [00:10<01:40,  2.02it/s]
Epoch 10 Iter 22: loss 0.23249. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.02it/s]
Epoch 10 Iter 23: loss 0.23824. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.02it/s]
Epoch 10 Iter 23: loss 0.23824. :  10%|████▌                                        | 23/224 [00:11<01:39,  2.02it/s]
Epoch 10 Iter 24: loss 0.23246. :  10%|████▌                                        | 23/224 [00:11<01:39,  2.02it/s]
Epoch 10 Iter 24: loss 0.23246. :  11%|████▊                                        | 24/224 [00:11<01:39,  2.02it/s]
Epoch 10 Iter 25: loss 0.23448. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.02it/s]
Epoch 10 Iter 25: loss 0.23448. :  11%|█████                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 10 Iter 26: loss 0.21129. :  11%|█████                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 10 Iter 26: loss 0.21129. :  12%|█████▏                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 10 Iter 27: loss 0.23300. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 10 Iter 27: loss 0.23300. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 10 Iter 28: loss 0.21023. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 10 Iter 28: loss 0.21023. :  12%|█████▋                                       | 28/224 [00:13<01:37,  2.02it/s]
Epoch 10 Iter 29: loss 0.22825. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.02it/s]
Epoch 10 Iter 29: loss 0.22825. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.02it/s]
Epoch 10 Iter 30: loss 0.21618. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.02it/s]
Epoch 10 Iter 30: loss 0.21618. :  13%|██████                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 10 Iter 31: loss 0.23253. :  13%|██████                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 10 Iter 31: loss 0.23253. :  14%|██████▏                                      | 31/224 [00:15<01:36,  2.00it/s]
Epoch 10 Iter 32: loss 0.23031. :  14%|██████▏                                      | 31/224 [00:15<01:36,  2.00it/s]
Epoch 10 Iter 32: loss 0.23031. :  14%|██████▍                                      | 32/224 [00:15<01:35,  2.01it/s]
Epoch 10 Iter 33: loss 0.23725. :  14%|██████▍                                      | 32/224 [00:16<01:35,  2.01it/s]
Epoch 10 Iter 33: loss 0.23725. :  15%|██████▋                                      | 33/224 [00:16<01:35,  2.00it/s]
Epoch 10 Iter 34: loss 0.24168. :  15%|██████▋                                      | 33/224 [00:16<01:35,  2.00it/s]
Epoch 10 Iter 34: loss 0.24168. :  15%|██████▊                                      | 34/224 [00:16<01:34,  2.01it/s]
Epoch 10 Iter 35: loss 0.20928. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.01it/s]
Epoch 10 Iter 35: loss 0.20928. :  16%|███████                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 10 Iter 36: loss 0.22979. :  16%|███████                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 10 Iter 36: loss 0.22979. :  16%|███████▏                                     | 36/224 [00:17<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.23274. :  16%|███████▏                                     | 36/224 [00:18<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.23274. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.00it/s]
Epoch 10 Iter 38: loss 0.25776. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.00it/s]
Epoch 10 Iter 38: loss 0.25776. :  17%|███████▋                                     | 38/224 [00:18<01:32,  2.01it/s]
Epoch 10 Iter 39: loss 0.23404. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 10 Iter 39: loss 0.23404. :  17%|███████▊                                     | 39/224 [00:19<01:32,  2.00it/s]
Epoch 10 Iter 40: loss 0.22485. :  17%|███████▊                                     | 39/224 [00:19<01:32,  2.00it/s]
Epoch 10 Iter 40: loss 0.22485. :  18%|████████                                     | 40/224 [00:19<01:32,  1.99it/s]
Epoch 10 Iter 41: loss 0.24628. :  18%|████████                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 10 Iter 41: loss 0.24628. :  18%|████████▏                                    | 41/224 [00:20<01:31,  2.00it/s]
Epoch 10 Iter 42: loss 0.24643. :  18%|████████▏                                    | 41/224 [00:20<01:31,  2.00it/s]
Epoch 10 Iter 42: loss 0.24643. :  19%|████████▍                                    | 42/224 [00:20<01:30,  2.01it/s]
Epoch 10 Iter 43: loss 0.25044. :  19%|████████▍                                    | 42/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 43: loss 0.25044. :  19%|████████▋                                    | 43/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 44: loss 0.22751. :  19%|████████▋                                    | 43/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 44: loss 0.22751. :  20%|████████▊                                    | 44/224 [00:21<01:29,  2.01it/s]
Epoch 10 Iter 45: loss 0.23688. :  20%|████████▊                                    | 44/224 [00:22<01:29,  2.01it/s]
Epoch 10 Iter 45: loss 0.23688. :  20%|█████████                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 10 Iter 46: loss 0.21522. :  20%|█████████                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 10 Iter 46: loss 0.21522. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.02it/s]
Epoch 10 Iter 47: loss 0.26605. :  21%|█████████▏                                   | 46/224 [00:23<01:27,  2.02it/s]
Epoch 10 Iter 47: loss 0.26605. :  21%|█████████▍                                   | 47/224 [00:23<01:27,  2.03it/s]
Epoch 10 Iter 48: loss 0.21663. :  21%|█████████▍                                   | 47/224 [00:23<01:27,  2.03it/s]
Epoch 10 Iter 48: loss 0.21663. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 10 Iter 49: loss 0.25287. :  21%|█████████▋                                   | 48/224 [00:24<01:26,  2.03it/s]
Epoch 10 Iter 49: loss 0.25287. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 10 Iter 50: loss 0.23074. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 10 Iter 50: loss 0.23074. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 10 Iter 51: loss 0.24206. :  22%|██████████                                   | 50/224 [00:25<01:25,  2.04it/s]
Epoch 10 Iter 51: loss 0.24206. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 10 Iter 52: loss 0.22862. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 10 Iter 52: loss 0.22862. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 10 Iter 53: loss 0.24540. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.04it/s]
Epoch 10 Iter 53: loss 0.24540. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 54: loss 0.22642. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 54: loss 0.22642. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.03it/s]
Epoch 10 Iter 55: loss 0.23585. :  24%|██████████▊                                  | 54/224 [00:27<01:23,  2.03it/s]
Epoch 10 Iter 55: loss 0.23585. :  25%|███████████                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 10 Iter 56: loss 0.24886. :  25%|███████████                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 10 Iter 56: loss 0.24886. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.03it/s]
Epoch 10 Iter 57: loss 0.24541. :  25%|███████████▎                                 | 56/224 [00:28<01:22,  2.03it/s]
Epoch 10 Iter 57: loss 0.24541. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 10 Iter 58: loss 0.23168. :  25%|███████████▍                                 | 57/224 [00:28<01:22,  2.03it/s]
Epoch 10 Iter 58: loss 0.23168. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 10 Iter 59: loss 0.24799. :  26%|███████████▋                                 | 58/224 [00:29<01:21,  2.04it/s]
Epoch 10 Iter 59: loss 0.24799. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 10 Iter 60: loss 0.22783. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 10 Iter 60: loss 0.22783. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 10 Iter 61: loss 0.23879. :  27%|████████████                                 | 60/224 [00:30<01:20,  2.04it/s]
Epoch 10 Iter 61: loss 0.23879. :  27%|████████████▎                                | 61/224 [00:30<01:20,  2.03it/s]
Epoch 10 Iter 62: loss 0.26190. :  27%|████████████▎                                | 61/224 [00:30<01:20,  2.03it/s]
Epoch 10 Iter 62: loss 0.26190. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.03it/s]
Epoch 10 Iter 63: loss 0.27307. :  28%|████████████▍                                | 62/224 [00:31<01:19,  2.03it/s]
Epoch 10 Iter 63: loss 0.27307. :  28%|████████████▋                                | 63/224 [00:31<01:20,  2.01it/s]
Epoch 10 Iter 64: loss 0.21179. :  28%|████████████▋                                | 63/224 [00:31<01:20,  2.01it/s]
Epoch 10 Iter 64: loss 0.21179. :  29%|████████████▊                                | 64/224 [00:31<01:19,  2.02it/s]
Epoch 10 Iter 65: loss 0.23933. :  29%|████████████▊                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 10 Iter 65: loss 0.23933. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 10 Iter 66: loss 0.23225. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 10 Iter 66: loss 0.23225. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.00it/s]
Epoch 10 Iter 67: loss 0.24325. :  29%|█████████████▎                               | 66/224 [00:33<01:18,  2.00it/s]
Epoch 10 Iter 67: loss 0.24325. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.01it/s]
Epoch 10 Iter 68: loss 0.23430. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.01it/s]
Epoch 10 Iter 68: loss 0.23430. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 10 Iter 69: loss 0.23652. :  30%|█████████████▋                               | 68/224 [00:34<01:16,  2.04it/s]
Epoch 10 Iter 69: loss 0.23652. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.03it/s]
Epoch 10 Iter 70: loss 0.23990. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.03it/s]
Epoch 10 Iter 70: loss 0.23990. :  31%|██████████████                               | 70/224 [00:34<01:16,  2.01it/s]
Epoch 10 Iter 71: loss 0.22401. :  31%|██████████████                               | 70/224 [00:35<01:16,  2.01it/s]
Epoch 10 Iter 71: loss 0.22401. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 10 Iter 72: loss 0.22120. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 10 Iter 72: loss 0.22120. :  32%|██████████████▍                              | 72/224 [00:35<01:15,  2.02it/s]
Epoch 10 Iter 73: loss 0.23851. :  32%|██████████████▍                              | 72/224 [00:36<01:15,  2.02it/s]
Epoch 10 Iter 73: loss 0.23851. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.03it/s]
Epoch 10 Iter 74: loss 0.22440. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.03it/s]
Epoch 10 Iter 74: loss 0.22440. :  33%|██████████████▊                              | 74/224 [00:36<01:14,  2.03it/s]
Epoch 10 Iter 75: loss 0.23855. :  33%|██████████████▊                              | 74/224 [00:37<01:14,  2.03it/s]
Epoch 10 Iter 75: loss 0.23855. :  33%|███████████████                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 10 Iter 76: loss 0.24119. :  33%|███████████████                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 10 Iter 76: loss 0.24119. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.03it/s]
Epoch 10 Iter 77: loss 0.24494. :  34%|███████████████▎                             | 76/224 [00:38<01:12,  2.03it/s]
Epoch 10 Iter 77: loss 0.24494. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 10 Iter 78: loss 0.22653. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 10 Iter 78: loss 0.22653. :  35%|███████████████▋                             | 78/224 [00:38<01:13,  1.99it/s]
Epoch 10 Iter 79: loss 0.23005. :  35%|███████████████▋                             | 78/224 [00:39<01:13,  1.99it/s]
Epoch 10 Iter 79: loss 0.23005. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.00it/s]
Epoch 10 Iter 80: loss 0.22858. :  35%|███████████████▊                             | 79/224 [00:39<01:12,  2.00it/s]
Epoch 10 Iter 80: loss 0.22858. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.00it/s]
Epoch 10 Iter 81: loss 0.21872. :  36%|████████████████                             | 80/224 [00:40<01:11,  2.00it/s]
Epoch 10 Iter 81: loss 0.21872. :  36%|████████████████▎                            | 81/224 [00:40<01:11,  2.01it/s]
Epoch 10 Iter 82: loss 0.24003. :  36%|████████████████▎                            | 81/224 [00:40<01:11,  2.01it/s]
Epoch 10 Iter 82: loss 0.24003. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.01it/s]
Epoch 10 Iter 83: loss 0.21994. :  37%|████████████████▍                            | 82/224 [00:41<01:10,  2.01it/s]
Epoch 10 Iter 83: loss 0.21994. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.02it/s]
Epoch 10 Iter 84: loss 0.23068. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.02it/s]
Epoch 10 Iter 84: loss 0.23068. :  38%|████████████████▉                            | 84/224 [00:41<01:09,  2.03it/s]
Epoch 10 Iter 85: loss 0.23512. :  38%|████████████████▉                            | 84/224 [00:42<01:09,  2.03it/s]
Epoch 10 Iter 85: loss 0.23512. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 10 Iter 86: loss 0.22786. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 10 Iter 86: loss 0.22786. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.03it/s]
Epoch 10 Iter 87: loss 0.22798. :  38%|█████████████████▎                           | 86/224 [00:43<01:07,  2.03it/s]
Epoch 10 Iter 87: loss 0.22798. :  39%|█████████████████▍                           | 87/224 [00:43<01:07,  2.02it/s]
Epoch 10 Iter 88: loss 0.22919. :  39%|█████████████████▍                           | 87/224 [00:43<01:07,  2.02it/s]
Epoch 10 Iter 88: loss 0.22919. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.02it/s]
Epoch 10 Iter 89: loss 0.23617. :  39%|█████████████████▋                           | 88/224 [00:44<01:07,  2.02it/s]
Epoch 10 Iter 89: loss 0.23617. :  40%|█████████████████▉                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 10 Iter 90: loss 0.24550. :  40%|█████████████████▉                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 10 Iter 90: loss 0.24550. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.03it/s]
Epoch 10 Iter 91: loss 0.22320. :  40%|██████████████████                           | 90/224 [00:45<01:06,  2.03it/s]
Epoch 10 Iter 91: loss 0.22320. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.03it/s]
Epoch 10 Iter 92: loss 0.24621. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.03it/s]
Epoch 10 Iter 92: loss 0.24621. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.03it/s]
Epoch 10 Iter 93: loss 0.22607. :  41%|██████████████████▍                          | 92/224 [00:46<01:05,  2.03it/s]
Epoch 10 Iter 93: loss 0.22607. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.02it/s]
Epoch 10 Iter 94: loss 0.23602. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.02it/s]
Epoch 10 Iter 94: loss 0.23602. :  42%|██████████████████▉                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 10 Iter 95: loss 0.23804. :  42%|██████████████████▉                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 10 Iter 95: loss 0.23804. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.03it/s]
Epoch 10 Iter 96: loss 0.23177. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.03it/s]
Epoch 10 Iter 96: loss 0.23177. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.02it/s]
Epoch 10 Iter 97: loss 0.23350. :  43%|███████████████████▎                         | 96/224 [00:48<01:03,  2.02it/s]
Epoch 10 Iter 97: loss 0.23350. :  43%|███████████████████▍                         | 97/224 [00:48<01:03,  2.01it/s]
Epoch 10 Iter 98: loss 0.23353. :  43%|███████████████████▍                         | 97/224 [00:48<01:03,  2.01it/s]
Epoch 10 Iter 98: loss 0.23353. :  44%|███████████████████▋                         | 98/224 [00:48<01:02,  2.01it/s]
Epoch 10 Iter 99: loss 0.26209. :  44%|███████████████████▋                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 10 Iter 99: loss 0.26209. :  44%|███████████████████▉                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 10 Iter 100: loss 0.22578. :  44%|███████████████████▍                        | 99/224 [00:49<01:02,  2.01it/s]
Epoch 10 Iter 100: loss 0.22578. :  45%|███████████████████▏                       | 100/224 [00:49<01:01,  2.01it/s]
Epoch 10 Iter 101: loss 0.23823. :  45%|███████████████████▏                       | 100/224 [00:50<01:01,  2.01it/s]
Epoch 10 Iter 101: loss 0.23823. :  45%|███████████████████▍                       | 101/224 [00:50<01:01,  2.02it/s]
Epoch 10 Iter 102: loss 0.22710. :  45%|███████████████████▍                       | 101/224 [00:50<01:01,  2.02it/s]
Epoch 10 Iter 102: loss 0.22710. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.02it/s]
Epoch 10 Iter 103: loss 0.22885. :  46%|███████████████████▌                       | 102/224 [00:51<01:00,  2.02it/s]
Epoch 10 Iter 103: loss 0.22885. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 10 Iter 104: loss 0.23788. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.02it/s]
Epoch 10 Iter 104: loss 0.23788. :  46%|███████████████████▉                       | 104/224 [00:51<00:59,  2.02it/s]
Epoch 10 Iter 105: loss 0.22887. :  46%|███████████████████▉                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 10 Iter 105: loss 0.22887. :  47%|████████████████████▏                      | 105/224 [00:52<00:58,  2.02it/s]
Epoch 10 Iter 106: loss 0.23277. :  47%|████████████████████▏                      | 105/224 [00:52<00:58,  2.02it/s]
Epoch 10 Iter 106: loss 0.23277. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.03it/s]
Epoch 10 Iter 107: loss 0.22343. :  47%|████████████████████▎                      | 106/224 [00:53<00:58,  2.03it/s]
Epoch 10 Iter 107: loss 0.22343. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.03it/s]
Epoch 10 Iter 108: loss 0.23333. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.03it/s]
Epoch 10 Iter 108: loss 0.23333. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.03it/s]
Epoch 10 Iter 109: loss 0.25517. :  48%|████████████████████▋                      | 108/224 [00:54<00:57,  2.03it/s]
Epoch 10 Iter 109: loss 0.25517. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 10 Iter 110: loss 0.22689. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 10 Iter 110: loss 0.22689. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.04it/s]
Epoch 10 Iter 111: loss 0.22638. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.04it/s]
Epoch 10 Iter 111: loss 0.22638. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.04it/s]
Epoch 10 Iter 112: loss 0.22202. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.04it/s]
Epoch 10 Iter 112: loss 0.22202. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 10 Iter 113: loss 0.22251. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.03it/s]
Epoch 10 Iter 113: loss 0.22251. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.04it/s]
Epoch 10 Iter 114: loss 0.23764. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.04it/s]
Epoch 10 Iter 114: loss 0.23764. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.04it/s]
Epoch 10 Iter 115: loss 0.22138. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.04it/s]
Epoch 10 Iter 115: loss 0.22138. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 10 Iter 116: loss 0.23514. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.05it/s]
Epoch 10 Iter 116: loss 0.23514. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 10 Iter 117: loss 0.23486. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 10 Iter 117: loss 0.23486. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.03it/s]
Epoch 10 Iter 118: loss 0.22032. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.03it/s]
Epoch 10 Iter 118: loss 0.22032. :  53%|██████████████████████▋                    | 118/224 [00:58<00:52,  2.04it/s]
Epoch 10 Iter 119: loss 0.24157. :  53%|██████████████████████▋                    | 118/224 [00:58<00:52,  2.04it/s]
Epoch 10 Iter 119: loss 0.24157. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.03it/s]
Epoch 10 Iter 120: loss 0.24179. :  53%|██████████████████████▊                    | 119/224 [00:59<00:51,  2.03it/s]
Epoch 10 Iter 120: loss 0.24179. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 10 Iter 121: loss 0.23581. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 10 Iter 121: loss 0.23581. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.02it/s]
Epoch 10 Iter 122: loss 0.23540. :  54%|███████████████████████▏                   | 121/224 [01:00<00:50,  2.02it/s]
Epoch 10 Iter 122: loss 0.23540. :  54%|███████████████████████▍                   | 122/224 [01:00<00:50,  2.03it/s]
Epoch 10 Iter 123: loss 0.22597. :  54%|███████████████████████▍                   | 122/224 [01:00<00:50,  2.03it/s]
Epoch 10 Iter 123: loss 0.22597. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.03it/s]
Epoch 10 Iter 124: loss 0.23317. :  55%|███████████████████████▌                   | 123/224 [01:01<00:49,  2.03it/s]
Epoch 10 Iter 124: loss 0.23317. :  55%|███████████████████████▊                   | 124/224 [01:01<00:49,  2.04it/s]
Epoch 10 Iter 125: loss 0.22390. :  55%|███████████████████████▊                   | 124/224 [01:01<00:49,  2.04it/s]
Epoch 10 Iter 125: loss 0.22390. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.03it/s]
Epoch 10 Iter 126: loss 0.21622. :  56%|███████████████████████▉                   | 125/224 [01:02<00:48,  2.03it/s]
Epoch 10 Iter 126: loss 0.21622. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.02it/s]
Epoch 10 Iter 127: loss 0.23565. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.02it/s]
Epoch 10 Iter 127: loss 0.23565. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.03it/s]
Epoch 10 Iter 128: loss 0.23629. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.03it/s]
Epoch 10 Iter 128: loss 0.23629. :  57%|████████████████████████▌                  | 128/224 [01:03<00:47,  2.04it/s]
Epoch 10 Iter 129: loss 0.23518. :  57%|████████████████████████▌                  | 128/224 [01:03<00:47,  2.04it/s]
Epoch 10 Iter 129: loss 0.23518. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.03it/s]
Epoch 10 Iter 130: loss 0.21197. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.03it/s]
Epoch 10 Iter 130: loss 0.21197. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.03it/s]
Epoch 10 Iter 131: loss 0.21106. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.03it/s]
Epoch 10 Iter 131: loss 0.21106. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.03it/s]
Epoch 10 Iter 132: loss 0.25079. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:45,  2.03it/s]
Epoch 10 Iter 132: loss 0.25079. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.03it/s]
Epoch 10 Iter 133: loss 0.25743. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.03it/s]
Epoch 10 Iter 133: loss 0.25743. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:45,  2.02it/s]
Epoch 10 Iter 134: loss 0.25087. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:45,  2.02it/s]
Epoch 10 Iter 134: loss 0.25087. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:44,  2.01it/s]
Epoch 10 Iter 135: loss 0.24490. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:44,  2.01it/s]
Epoch 10 Iter 135: loss 0.24490. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:44,  2.00it/s]
Epoch 10 Iter 136: loss 0.24369. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:44,  2.00it/s]
Epoch 10 Iter 136: loss 0.24369. :  61%|██████████████████████████                 | 136/224 [01:07<00:43,  2.01it/s]
Epoch 10 Iter 137: loss 0.21940. :  61%|██████████████████████████                 | 136/224 [01:07<00:43,  2.01it/s]
Epoch 10 Iter 137: loss 0.21940. :  61%|██████████████████████████▎                | 137/224 [01:07<00:43,  1.99it/s]
Epoch 10 Iter 138: loss 0.24240. :  61%|██████████████████████████▎                | 137/224 [01:08<00:43,  1.99it/s]
Epoch 10 Iter 138: loss 0.24240. :  62%|██████████████████████████▍                | 138/224 [01:08<00:45,  1.90it/s]
Epoch 10 Iter 139: loss 0.24201. :  62%|██████████████████████████▍                | 138/224 [01:08<00:45,  1.90it/s]
Epoch 10 Iter 139: loss 0.24201. :  62%|██████████████████████████▋                | 139/224 [01:08<00:44,  1.92it/s]
Epoch 10 Iter 140: loss 0.22819. :  62%|██████████████████████████▋                | 139/224 [01:09<00:44,  1.92it/s]
Epoch 10 Iter 140: loss 0.22819. :  62%|██████████████████████████▉                | 140/224 [01:09<00:43,  1.94it/s]
Epoch 10 Iter 141: loss 0.24176. :  62%|██████████████████████████▉                | 140/224 [01:09<00:43,  1.94it/s]
Epoch 10 Iter 141: loss 0.24176. :  63%|███████████████████████████                | 141/224 [01:09<00:42,  1.95it/s]
Epoch 10 Iter 142: loss 0.25307. :  63%|███████████████████████████                | 141/224 [01:10<00:42,  1.95it/s]
Epoch 10 Iter 142: loss 0.25307. :  63%|███████████████████████████▎               | 142/224 [01:10<00:42,  1.95it/s]
Epoch 10 Iter 143: loss 0.23651. :  63%|███████████████████████████▎               | 142/224 [01:10<00:42,  1.95it/s]
Epoch 10 Iter 143: loss 0.23651. :  64%|███████████████████████████▍               | 143/224 [01:10<00:41,  1.96it/s]
Epoch 10 Iter 144: loss 0.25915. :  64%|███████████████████████████▍               | 143/224 [01:11<00:41,  1.96it/s]
Epoch 10 Iter 144: loss 0.25915. :  64%|███████████████████████████▋               | 144/224 [01:11<00:40,  1.96it/s]
Epoch 10 Iter 145: loss 0.23713. :  64%|███████████████████████████▋               | 144/224 [01:11<00:40,  1.96it/s]
Epoch 10 Iter 145: loss 0.23713. :  65%|███████████████████████████▊               | 145/224 [01:11<00:40,  1.97it/s]
Epoch 10 Iter 146: loss 0.24863. :  65%|███████████████████████████▊               | 145/224 [01:12<00:40,  1.97it/s]
Epoch 10 Iter 146: loss 0.24863. :  65%|████████████████████████████               | 146/224 [01:12<00:39,  1.96it/s]
Epoch 10 Iter 147: loss 0.24797. :  65%|████████████████████████████               | 146/224 [01:13<00:39,  1.96it/s]
Epoch 10 Iter 147: loss 0.24797. :  66%|████████████████████████████▏              | 147/224 [01:13<00:39,  1.96it/s]
Epoch 10 Iter 148: loss 0.24337. :  66%|████████████████████████████▏              | 147/224 [01:13<00:39,  1.96it/s]
Epoch 10 Iter 148: loss 0.24337. :  66%|████████████████████████████▍              | 148/224 [01:13<00:39,  1.95it/s]
Epoch 10 Iter 149: loss 0.24119. :  66%|████████████████████████████▍              | 148/224 [01:14<00:39,  1.95it/s]
Epoch 10 Iter 149: loss 0.24119. :  67%|████████████████████████████▌              | 149/224 [01:14<00:38,  1.96it/s]
Epoch 10 Iter 150: loss 0.22596. :  67%|████████████████████████████▌              | 149/224 [01:14<00:38,  1.96it/s]
Epoch 10 Iter 150: loss 0.22596. :  67%|████████████████████████████▊              | 150/224 [01:14<00:37,  1.98it/s]
Epoch 10 Iter 151: loss 0.22381. :  67%|████████████████████████████▊              | 150/224 [01:15<00:37,  1.98it/s]
Epoch 10 Iter 151: loss 0.22381. :  67%|████████████████████████████▉              | 151/224 [01:15<00:36,  1.99it/s]
Epoch 10 Iter 152: loss 0.22299. :  67%|████████████████████████████▉              | 151/224 [01:15<00:36,  1.99it/s]
Epoch 10 Iter 152: loss 0.22299. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:36,  1.99it/s]
Epoch 10 Iter 153: loss 0.23844. :  68%|█████████████████████████████▏             | 152/224 [01:16<00:36,  1.99it/s]
Epoch 10 Iter 153: loss 0.23844. :  68%|█████████████████████████████▎             | 153/224 [01:16<00:35,  1.99it/s]
Epoch 10 Iter 154: loss 0.22531. :  68%|█████████████████████████████▎             | 153/224 [01:16<00:35,  1.99it/s]
Epoch 10 Iter 154: loss 0.22531. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:35,  1.98it/s]
Epoch 10 Iter 155: loss 0.25568. :  69%|█████████████████████████████▌             | 154/224 [01:17<00:35,  1.98it/s]
Epoch 10 Iter 155: loss 0.25568. :  69%|█████████████████████████████▊             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 10 Iter 156: loss 0.22953. :  69%|█████████████████████████████▊             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 10 Iter 156: loss 0.22953. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:34,  2.00it/s]
Epoch 10 Iter 157: loss 0.24909. :  70%|█████████████████████████████▉             | 156/224 [01:18<00:34,  2.00it/s]
Epoch 10 Iter 157: loss 0.24909. :  70%|██████████████████████████████▏            | 157/224 [01:18<00:33,  1.99it/s]
Epoch 10 Iter 158: loss 0.23990. :  70%|██████████████████████████████▏            | 157/224 [01:18<00:33,  1.99it/s]
Epoch 10 Iter 158: loss 0.23990. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:33,  2.00it/s]
Epoch 10 Iter 159: loss 0.24458. :  71%|██████████████████████████████▎            | 158/224 [01:19<00:33,  2.00it/s]
Epoch 10 Iter 159: loss 0.24458. :  71%|██████████████████████████████▌            | 159/224 [01:19<00:32,  1.99it/s]
Epoch 10 Iter 160: loss 0.25223. :  71%|██████████████████████████████▌            | 159/224 [01:19<00:32,  1.99it/s]
Epoch 10 Iter 160: loss 0.25223. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.00it/s]
Epoch 10 Iter 161: loss 0.23683. :  71%|██████████████████████████████▋            | 160/224 [01:20<00:31,  2.00it/s]
Epoch 10 Iter 161: loss 0.23683. :  72%|██████████████████████████████▉            | 161/224 [01:20<00:32,  1.92it/s]
Epoch 10 Iter 162: loss 0.22832. :  72%|██████████████████████████████▉            | 161/224 [01:20<00:32,  1.92it/s]
Epoch 10 Iter 162: loss 0.22832. :  72%|███████████████████████████████            | 162/224 [01:20<00:31,  1.94it/s]
Epoch 10 Iter 163: loss 0.23715. :  72%|███████████████████████████████            | 162/224 [01:21<00:31,  1.94it/s]
Epoch 10 Iter 163: loss 0.23715. :  73%|███████████████████████████████▎           | 163/224 [01:21<00:31,  1.96it/s]
Epoch 10 Iter 164: loss 0.24545. :  73%|███████████████████████████████▎           | 163/224 [01:21<00:31,  1.96it/s]
Epoch 10 Iter 164: loss 0.24545. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:30,  1.97it/s]
Epoch 10 Iter 165: loss 0.23316. :  73%|███████████████████████████████▍           | 164/224 [01:22<00:30,  1.97it/s]
Epoch 10 Iter 165: loss 0.23316. :  74%|███████████████████████████████▋           | 165/224 [01:22<00:29,  1.98it/s]
Epoch 10 Iter 166: loss 0.24305. :  74%|███████████████████████████████▋           | 165/224 [01:22<00:29,  1.98it/s]
Epoch 10 Iter 166: loss 0.24305. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:29,  2.00it/s]
Epoch 10 Iter 167: loss 0.25721. :  74%|███████████████████████████████▊           | 166/224 [01:23<00:29,  2.00it/s]
Epoch 10 Iter 167: loss 0.25721. :  75%|████████████████████████████████           | 167/224 [01:23<00:28,  1.99it/s]
Epoch 10 Iter 168: loss 0.23449. :  75%|████████████████████████████████           | 167/224 [01:23<00:28,  1.99it/s]
Epoch 10 Iter 168: loss 0.23449. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:28,  2.00it/s]
Epoch 10 Iter 169: loss 0.24367. :  75%|████████████████████████████████▎          | 168/224 [01:24<00:28,  2.00it/s]
Epoch 10 Iter 169: loss 0.24367. :  75%|████████████████████████████████▍          | 169/224 [01:24<00:27,  2.01it/s]
Epoch 10 Iter 170: loss 0.23068. :  75%|████████████████████████████████▍          | 169/224 [01:24<00:27,  2.01it/s]
Epoch 10 Iter 170: loss 0.23068. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.02it/s]
Epoch 10 Iter 171: loss 0.24623. :  76%|████████████████████████████████▋          | 170/224 [01:25<00:26,  2.02it/s]
Epoch 10 Iter 171: loss 0.24623. :  76%|████████████████████████████████▊          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 10 Iter 172: loss 0.24249. :  76%|████████████████████████████████▊          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 10 Iter 172: loss 0.24249. :  77%|█████████████████████████████████          | 172/224 [01:25<00:26,  2.00it/s]
Epoch 10 Iter 173: loss 0.23523. :  77%|█████████████████████████████████          | 172/224 [01:26<00:26,  2.00it/s]
Epoch 10 Iter 173: loss 0.23523. :  77%|█████████████████████████████████▏         | 173/224 [01:26<00:25,  2.01it/s]
Epoch 10 Iter 174: loss 0.23500. :  77%|█████████████████████████████████▏         | 173/224 [01:26<00:25,  2.01it/s]
Epoch 10 Iter 174: loss 0.23500. :  78%|█████████████████████████████████▍         | 174/224 [01:26<00:24,  2.02it/s]
Epoch 10 Iter 175: loss 0.24716. :  78%|█████████████████████████████████▍         | 174/224 [01:27<00:24,  2.02it/s]
Epoch 10 Iter 175: loss 0.24716. :  78%|█████████████████████████████████▌         | 175/224 [01:27<00:24,  2.02it/s]
Epoch 10 Iter 176: loss 0.23029. :  78%|█████████████████████████████████▌         | 175/224 [01:27<00:24,  2.02it/s]
Epoch 10 Iter 176: loss 0.23029. :  79%|█████████████████████████████████▊         | 176/224 [01:27<00:23,  2.03it/s]
Epoch 10 Iter 177: loss 0.23670. :  79%|█████████████████████████████████▊         | 176/224 [01:28<00:23,  2.03it/s]
Epoch 10 Iter 177: loss 0.23670. :  79%|█████████████████████████████████▉         | 177/224 [01:28<00:23,  2.04it/s]
Epoch 10 Iter 178: loss 0.23665. :  79%|█████████████████████████████████▉         | 177/224 [01:28<00:23,  2.04it/s]
Epoch 10 Iter 178: loss 0.23665. :  79%|██████████████████████████████████▏        | 178/224 [01:28<00:22,  2.04it/s]
Epoch 10 Iter 179: loss 0.24011. :  79%|██████████████████████████████████▏        | 178/224 [01:29<00:22,  2.04it/s]
Epoch 10 Iter 179: loss 0.24011. :  80%|██████████████████████████████████▎        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 10 Iter 180: loss 0.23174. :  80%|██████████████████████████████████▎        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 10 Iter 180: loss 0.23174. :  80%|██████████████████████████████████▌        | 180/224 [01:29<00:21,  2.03it/s]
Epoch 10 Iter 181: loss 0.23127. :  80%|██████████████████████████████████▌        | 180/224 [01:30<00:21,  2.03it/s]
Epoch 10 Iter 181: loss 0.23127. :  81%|██████████████████████████████████▋        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 10 Iter 182: loss 0.21616. :  81%|██████████████████████████████████▋        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 10 Iter 182: loss 0.21616. :  81%|██████████████████████████████████▉        | 182/224 [01:30<00:20,  2.04it/s]
Epoch 10 Iter 183: loss 0.23651. :  81%|██████████████████████████████████▉        | 182/224 [01:30<00:20,  2.04it/s]
Epoch 10 Iter 183: loss 0.23651. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:20,  2.04it/s]
Epoch 10 Iter 184: loss 0.21944. :  82%|███████████████████████████████████▏       | 183/224 [01:31<00:20,  2.04it/s]
Epoch 10 Iter 184: loss 0.21944. :  82%|███████████████████████████████████▎       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 10 Iter 185: loss 0.22983. :  82%|███████████████████████████████████▎       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 10 Iter 185: loss 0.22983. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:19,  2.02it/s]
Epoch 10 Iter 186: loss 0.22923. :  83%|███████████████████████████████████▌       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 10 Iter 186: loss 0.22923. :  83%|███████████████████████████████████▋       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 10 Iter 187: loss 0.22132. :  83%|███████████████████████████████████▋       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 10 Iter 187: loss 0.22132. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:18,  1.98it/s]
Epoch 10 Iter 188: loss 0.22613. :  83%|███████████████████████████████████▉       | 187/224 [01:33<00:18,  1.98it/s]
Epoch 10 Iter 188: loss 0.22613. :  84%|████████████████████████████████████       | 188/224 [01:33<00:18,  1.93it/s]
Epoch 10 Iter 189: loss 0.22936. :  84%|████████████████████████████████████       | 188/224 [01:34<00:18,  1.93it/s]
Epoch 10 Iter 189: loss 0.22936. :  84%|████████████████████████████████████▎      | 189/224 [01:34<00:18,  1.94it/s]
Epoch 10 Iter 190: loss 0.24757. :  84%|████████████████████████████████████▎      | 189/224 [01:34<00:18,  1.94it/s]
Epoch 10 Iter 190: loss 0.24757. :  85%|████████████████████████████████████▍      | 190/224 [01:34<00:17,  1.97it/s]
Epoch 10 Iter 191: loss 0.20399. :  85%|████████████████████████████████████▍      | 190/224 [01:35<00:17,  1.97it/s]
Epoch 10 Iter 191: loss 0.20399. :  85%|████████████████████████████████████▋      | 191/224 [01:35<00:16,  1.96it/s]
Epoch 10 Iter 192: loss 0.22669. :  85%|████████████████████████████████████▋      | 191/224 [01:35<00:16,  1.96it/s]
Epoch 10 Iter 192: loss 0.22669. :  86%|████████████████████████████████████▊      | 192/224 [01:35<00:16,  1.96it/s]
Epoch 10 Iter 193: loss 0.23517. :  86%|████████████████████████████████████▊      | 192/224 [01:36<00:16,  1.96it/s]
Epoch 10 Iter 193: loss 0.23517. :  86%|█████████████████████████████████████      | 193/224 [01:36<00:16,  1.93it/s]
Epoch 10 Iter 194: loss 0.23861. :  86%|█████████████████████████████████████      | 193/224 [01:36<00:16,  1.93it/s]
Epoch 10 Iter 194: loss 0.23861. :  87%|█████████████████████████████████████▏     | 194/224 [01:36<00:15,  1.94it/s]
Epoch 10 Iter 195: loss 0.22687. :  87%|█████████████████████████████████████▏     | 194/224 [01:37<00:15,  1.94it/s]
Epoch 10 Iter 195: loss 0.22687. :  87%|█████████████████████████████████████▍     | 195/224 [01:37<00:14,  1.96it/s]
Epoch 10 Iter 196: loss 0.23123. :  87%|█████████████████████████████████████▍     | 195/224 [01:37<00:14,  1.96it/s]
Epoch 10 Iter 196: loss 0.23123. :  88%|█████████████████████████████████████▋     | 196/224 [01:37<00:14,  1.92it/s]
Epoch 10 Iter 197: loss 0.23596. :  88%|█████████████████████████████████████▋     | 196/224 [01:38<00:14,  1.92it/s]
Epoch 10 Iter 197: loss 0.23596. :  88%|█████████████████████████████████████▊     | 197/224 [01:38<00:14,  1.91it/s]
Epoch 10 Iter 198: loss 0.23534. :  88%|█████████████████████████████████████▊     | 197/224 [01:38<00:14,  1.91it/s]
Epoch 10 Iter 198: loss 0.23534. :  88%|██████████████████████████████████████     | 198/224 [01:38<00:13,  1.89it/s]
Epoch 10 Iter 199: loss 0.24151. :  88%|██████████████████████████████████████     | 198/224 [01:39<00:13,  1.89it/s]
Epoch 10 Iter 199: loss 0.24151. :  89%|██████████████████████████████████████▏    | 199/224 [01:39<00:13,  1.88it/s]
Epoch 10 Iter 200: loss 0.23949. :  89%|██████████████████████████████████████▏    | 199/224 [01:39<00:13,  1.88it/s]
Epoch 10 Iter 200: loss 0.23949. :  89%|██████████████████████████████████████▍    | 200/224 [01:39<00:12,  1.90it/s]
Epoch 10 Iter 201: loss 0.23008. :  89%|██████████████████████████████████████▍    | 200/224 [01:40<00:12,  1.90it/s]
Epoch 10 Iter 201: loss 0.23008. :  90%|██████████████████████████████████████▌    | 201/224 [01:40<00:11,  1.92it/s]
Epoch 10 Iter 202: loss 0.22965. :  90%|██████████████████████████████████████▌    | 201/224 [01:40<00:11,  1.92it/s]
Epoch 10 Iter 202: loss 0.22965. :  90%|██████████████████████████████████████▊    | 202/224 [01:40<00:11,  1.93it/s]
Epoch 10 Iter 203: loss 0.23060. :  90%|██████████████████████████████████████▊    | 202/224 [01:41<00:11,  1.93it/s]
Epoch 10 Iter 203: loss 0.23060. :  91%|██████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.94it/s]
Epoch 10 Iter 204: loss 0.24285. :  91%|██████████████████████████████████████▉    | 203/224 [01:41<00:10,  1.94it/s]
Epoch 10 Iter 204: loss 0.24285. :  91%|███████████████████████████████████████▏   | 204/224 [01:41<00:10,  1.95it/s]
Epoch 10 Iter 205: loss 0.25578. :  91%|███████████████████████████████████████▏   | 204/224 [01:42<00:10,  1.95it/s]
Epoch 10 Iter 205: loss 0.25578. :  92%|███████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.95it/s]
Epoch 10 Iter 206: loss 0.23238. :  92%|███████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.95it/s]
Epoch 10 Iter 206: loss 0.23238. :  92%|███████████████████████████████████████▌   | 206/224 [01:42<00:09,  1.95it/s]
Epoch 10 Iter 207: loss 0.23451. :  92%|███████████████████████████████████████▌   | 206/224 [01:43<00:09,  1.95it/s]
Epoch 10 Iter 207: loss 0.23451. :  92%|███████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.91it/s]
Epoch 10 Iter 208: loss 0.24159. :  92%|███████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.91it/s]
Epoch 10 Iter 208: loss 0.24159. :  93%|███████████████████████████████████████▉   | 208/224 [01:43<00:08,  1.92it/s]
Epoch 10 Iter 209: loss 0.23922. :  93%|███████████████████████████████████████▉   | 208/224 [01:44<00:08,  1.92it/s]
Epoch 10 Iter 209: loss 0.23922. :  93%|████████████████████████████████████████   | 209/224 [01:44<00:07,  1.89it/s]
Epoch 10 Iter 210: loss 0.21337. :  93%|████████████████████████████████████████   | 209/224 [01:44<00:07,  1.89it/s]
Epoch 10 Iter 210: loss 0.21337. :  94%|████████████████████████████████████████▎  | 210/224 [01:44<00:07,  1.93it/s]
Epoch 10 Iter 211: loss 0.22935. :  94%|████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.93it/s]
Epoch 10 Iter 211: loss 0.22935. :  94%|████████████████████████████████████████▌  | 211/224 [01:45<00:06,  1.94it/s]
Epoch 10 Iter 212: loss 0.21976. :  94%|████████████████████████████████████████▌  | 211/224 [01:45<00:06,  1.94it/s]
Epoch 10 Iter 212: loss 0.21976. :  95%|████████████████████████████████████████▋  | 212/224 [01:45<00:06,  1.97it/s]
Epoch 10 Iter 213: loss 0.23578. :  95%|████████████████████████████████████████▋  | 212/224 [01:46<00:06,  1.97it/s]
Epoch 10 Iter 213: loss 0.23578. :  95%|████████████████████████████████████████▉  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 10 Iter 214: loss 0.23166. :  95%|████████████████████████████████████████▉  | 213/224 [01:46<00:05,  1.99it/s]
Epoch 10 Iter 214: loss 0.23166. :  96%|█████████████████████████████████████████  | 214/224 [01:46<00:05,  1.99it/s]
Epoch 10 Iter 215: loss 0.24277. :  96%|█████████████████████████████████████████  | 214/224 [01:47<00:05,  1.99it/s]
Epoch 10 Iter 215: loss 0.24277. :  96%|█████████████████████████████████████████▎ | 215/224 [01:47<00:04,  2.00it/s]
Epoch 10 Iter 216: loss 0.23543. :  96%|█████████████████████████████████████████▎ | 215/224 [01:47<00:04,  2.00it/s]
Epoch 10 Iter 216: loss 0.23543. :  96%|█████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.01it/s]
Epoch 10 Iter 217: loss 0.23477. :  96%|█████████████████████████████████████████▍ | 216/224 [01:48<00:03,  2.01it/s]
Epoch 10 Iter 217: loss 0.23477. :  97%|█████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.01it/s]
Epoch 10 Iter 218: loss 0.25246. :  97%|█████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.01it/s]
Epoch 10 Iter 218: loss 0.25246. :  97%|█████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.02it/s]
Epoch 10 Iter 219: loss 0.24337. :  97%|█████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.02it/s]
Epoch 10 Iter 219: loss 0.24337. :  98%|██████████████████████████████████████████ | 219/224 [01:49<00:02,  2.02it/s]
Epoch 10 Iter 220: loss 0.23849. :  98%|██████████████████████████████████████████ | 219/224 [01:49<00:02,  2.02it/s]
Epoch 10 Iter 220: loss 0.23849. :  98%|██████████████████████████████████████████▏| 220/224 [01:49<00:01,  2.02it/s]
Epoch 10 Iter 221: loss 0.24515. :  98%|██████████████████████████████████████████▏| 220/224 [01:50<00:01,  2.02it/s]
Epoch 10 Iter 221: loss 0.24515. :  99%|██████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.03it/s]
Epoch 10 Iter 222: loss 0.23530. :  99%|██████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.03it/s]
Epoch 10 Iter 222: loss 0.23530. :  99%|██████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.02it/s]
Epoch 10 Iter 223: loss 0.24814. :  99%|██████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.02it/s]
Epoch 10 Iter 223: loss 0.24814. : 100%|██████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 10 Iter 224: loss 0.24716. : 100%|██████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 10 Iter 224: loss 0.24716. : 100%|███████████████████████████████████████████| 224/224 [01:51<00:00,  1.98it/s]
Epoch 10 Iter 224: loss 0.24716. : 100%|███████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.23382. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.23382. :   0%|▏                                              | 1/224 [00:00<01:57,  1.90it/s]
Epoch 11 Iter 2: loss 0.23334. :   0%|▏                                              | 1/224 [00:01<01:57,  1.90it/s]
Epoch 11 Iter 2: loss 0.23334. :   1%|▍                                              | 2/224 [00:01<01:59,  1.86it/s]
Epoch 11 Iter 3: loss 0.22002. :   1%|▍                                              | 2/224 [00:01<01:59,  1.86it/s]
Epoch 11 Iter 3: loss 0.22002. :   1%|▋                                              | 3/224 [00:01<02:00,  1.84it/s]
Epoch 11 Iter 4: loss 0.23443. :   1%|▋                                              | 3/224 [00:02<02:00,  1.84it/s]
Epoch 11 Iter 4: loss 0.23443. :   2%|▊                                              | 4/224 [00:02<01:58,  1.85it/s]
Epoch 11 Iter 5: loss 0.20809. :   2%|▊                                              | 4/224 [00:02<01:58,  1.85it/s]
Epoch 11 Iter 5: loss 0.20809. :   2%|█                                              | 5/224 [00:02<01:59,  1.83it/s]
Epoch 11 Iter 6: loss 0.21954. :   2%|█                                              | 5/224 [00:03<01:59,  1.83it/s]
Epoch 11 Iter 6: loss 0.21954. :   3%|█▎                                             | 6/224 [00:03<01:57,  1.85it/s]
Epoch 11 Iter 7: loss 0.22697. :   3%|█▎                                             | 6/224 [00:03<01:57,  1.85it/s]
Epoch 11 Iter 7: loss 0.22697. :   3%|█▍                                             | 7/224 [00:03<01:57,  1.84it/s]
Epoch 11 Iter 8: loss 0.23888. :   3%|█▍                                             | 7/224 [00:04<01:57,  1.84it/s]
Epoch 11 Iter 8: loss 0.23888. :   4%|█▋                                             | 8/224 [00:04<02:03,  1.75it/s]
Epoch 11 Iter 9: loss 0.24579. :   4%|█▋                                             | 8/224 [00:04<02:03,  1.75it/s]
Epoch 11 Iter 9: loss 0.24579. :   4%|█▉                                             | 9/224 [00:04<02:01,  1.76it/s]
Epoch 11 Iter 10: loss 0.24569. :   4%|█▊                                            | 9/224 [00:05<02:01,  1.76it/s]
Epoch 11 Iter 10: loss 0.24569. :   4%|██                                           | 10/224 [00:05<02:07,  1.67it/s]
Epoch 11 Iter 11: loss 0.22621. :   4%|██                                           | 10/224 [00:06<02:07,  1.67it/s]
Epoch 11 Iter 11: loss 0.22621. :   5%|██▏                                          | 11/224 [00:06<02:03,  1.72it/s]
Epoch 11 Iter 12: loss 0.25683. :   5%|██▏                                          | 11/224 [00:06<02:03,  1.72it/s]
Epoch 11 Iter 12: loss 0.25683. :   5%|██▍                                          | 12/224 [00:06<02:00,  1.76it/s]
Epoch 11 Iter 13: loss 0.23616. :   5%|██▍                                          | 12/224 [00:07<02:00,  1.76it/s]
Epoch 11 Iter 13: loss 0.23616. :   6%|██▌                                          | 13/224 [00:07<02:12,  1.59it/s]
Epoch 11 Iter 14: loss 0.22938. :   6%|██▌                                          | 13/224 [00:08<02:12,  1.59it/s]
Epoch 11 Iter 14: loss 0.22938. :   6%|██▊                                          | 14/224 [00:08<02:11,  1.60it/s]
Epoch 11 Iter 15: loss 0.23030. :   6%|██▊                                          | 14/224 [00:08<02:11,  1.60it/s]
Epoch 11 Iter 15: loss 0.23030. :   7%|███                                          | 15/224 [00:08<02:11,  1.59it/s]
Epoch 11 Iter 16: loss 0.24598. :   7%|███                                          | 15/224 [00:09<02:11,  1.59it/s]
Epoch 11 Iter 16: loss 0.24598. :   7%|███▏                                         | 16/224 [00:09<02:05,  1.66it/s]
Epoch 11 Iter 17: loss 0.23129. :   7%|███▏                                         | 16/224 [00:09<02:05,  1.66it/s]
Epoch 11 Iter 17: loss 0.23129. :   8%|███▍                                         | 17/224 [00:09<02:00,  1.72it/s]
Epoch 11 Iter 18: loss 0.22866. :   8%|███▍                                         | 17/224 [00:10<02:00,  1.72it/s]
Epoch 11 Iter 18: loss 0.22866. :   8%|███▌                                         | 18/224 [00:10<01:56,  1.77it/s]
Epoch 11 Iter 19: loss 0.23927. :   8%|███▌                                         | 18/224 [00:11<01:56,  1.77it/s]
Epoch 11 Iter 19: loss 0.23927. :   8%|███▊                                         | 19/224 [00:11<02:04,  1.65it/s]
Epoch 11 Iter 20: loss 0.23309. :   8%|███▊                                         | 19/224 [00:11<02:04,  1.65it/s]
Epoch 11 Iter 20: loss 0.23309. :   9%|████                                         | 20/224 [00:11<02:13,  1.53it/s]
Epoch 11 Iter 21: loss 0.22951. :   9%|████                                         | 20/224 [00:12<02:13,  1.53it/s]
Epoch 11 Iter 21: loss 0.22951. :   9%|████▏                                        | 21/224 [00:12<02:17,  1.47it/s]
Epoch 11 Iter 22: loss 0.24100. :   9%|████▏                                        | 21/224 [00:13<02:17,  1.47it/s]
Epoch 11 Iter 22: loss 0.24100. :  10%|████▍                                        | 22/224 [00:13<02:23,  1.41it/s]
Epoch 11 Iter 23: loss 0.22423. :  10%|████▍                                        | 22/224 [00:14<02:23,  1.41it/s]
Epoch 11 Iter 23: loss 0.22423. :  10%|████▌                                        | 23/224 [00:14<02:27,  1.36it/s]
Epoch 11 Iter 24: loss 0.22763. :  10%|████▌                                        | 23/224 [00:14<02:27,  1.36it/s]
Epoch 11 Iter 24: loss 0.22763. :  11%|████▊                                        | 24/224 [00:14<02:15,  1.47it/s]
Epoch 11 Iter 25: loss 0.24030. :  11%|████▊                                        | 24/224 [00:15<02:15,  1.47it/s]
Epoch 11 Iter 25: loss 0.24030. :  11%|█████                                        | 25/224 [00:15<02:12,  1.50it/s]
Epoch 11 Iter 26: loss 0.22224. :  11%|█████                                        | 25/224 [00:15<02:12,  1.50it/s]
Epoch 11 Iter 26: loss 0.22224. :  12%|█████▏                                       | 26/224 [00:15<02:04,  1.59it/s]
Epoch 11 Iter 27: loss 0.21955. :  12%|█████▏                                       | 26/224 [00:16<02:04,  1.59it/s]
Epoch 11 Iter 27: loss 0.21955. :  12%|█████▍                                       | 27/224 [00:16<01:55,  1.70it/s]
Epoch 11 Iter 28: loss 0.22853. :  12%|█████▍                                       | 27/224 [00:16<01:55,  1.70it/s]
Epoch 11 Iter 28: loss 0.22853. :  12%|█████▋                                       | 28/224 [00:16<01:50,  1.78it/s]
Epoch 11 Iter 29: loss 0.22788. :  12%|█████▋                                       | 28/224 [00:17<01:50,  1.78it/s]
Epoch 11 Iter 29: loss 0.22788. :  13%|█████▊                                       | 29/224 [00:17<01:46,  1.83it/s]
Epoch 11 Iter 30: loss 0.23303. :  13%|█████▊                                       | 29/224 [00:17<01:46,  1.83it/s]
Epoch 11 Iter 30: loss 0.23303. :  13%|██████                                       | 30/224 [00:17<01:43,  1.88it/s]
Epoch 11 Iter 31: loss 0.23925. :  13%|██████                                       | 30/224 [00:18<01:43,  1.88it/s]
Epoch 11 Iter 31: loss 0.23925. :  14%|██████▏                                      | 31/224 [00:18<01:41,  1.91it/s]
Epoch 11 Iter 32: loss 0.24644. :  14%|██████▏                                      | 31/224 [00:18<01:41,  1.91it/s]
Epoch 11 Iter 32: loss 0.24644. :  14%|██████▍                                      | 32/224 [00:18<01:39,  1.93it/s]
Epoch 11 Iter 33: loss 0.22154. :  14%|██████▍                                      | 32/224 [00:19<01:39,  1.93it/s]
Epoch 11 Iter 33: loss 0.22154. :  15%|██████▋                                      | 33/224 [00:19<01:39,  1.92it/s]
Epoch 11 Iter 34: loss 0.22683. :  15%|██████▋                                      | 33/224 [00:19<01:39,  1.92it/s]
Epoch 11 Iter 34: loss 0.22683. :  15%|██████▊                                      | 34/224 [00:19<01:37,  1.94it/s]
Epoch 11 Iter 35: loss 0.23843. :  15%|██████▊                                      | 34/224 [00:20<01:37,  1.94it/s]
Epoch 11 Iter 35: loss 0.23843. :  16%|███████                                      | 35/224 [00:20<01:36,  1.95it/s]
Epoch 11 Iter 36: loss 0.24553. :  16%|███████                                      | 35/224 [00:20<01:36,  1.95it/s]
Epoch 11 Iter 36: loss 0.24553. :  16%|███████▏                                     | 36/224 [00:20<01:35,  1.97it/s]
Epoch 11 Iter 37: loss 0.25253. :  16%|███████▏                                     | 36/224 [00:21<01:35,  1.97it/s]
Epoch 11 Iter 37: loss 0.25253. :  17%|███████▍                                     | 37/224 [00:21<01:35,  1.97it/s]
Epoch 11 Iter 38: loss 0.23366. :  17%|███████▍                                     | 37/224 [00:21<01:35,  1.97it/s]
Epoch 11 Iter 38: loss 0.23366. :  17%|███████▋                                     | 38/224 [00:21<01:34,  1.96it/s]
Epoch 11 Iter 39: loss 0.23028. :  17%|███████▋                                     | 38/224 [00:22<01:34,  1.96it/s]
Epoch 11 Iter 39: loss 0.23028. :  17%|███████▊                                     | 39/224 [00:22<01:33,  1.97it/s]
Epoch 11 Iter 40: loss 0.25313. :  17%|███████▊                                     | 39/224 [00:23<01:33,  1.97it/s]
Epoch 11 Iter 40: loss 0.25313. :  18%|████████                                     | 40/224 [00:23<01:42,  1.80it/s]
Epoch 11 Iter 41: loss 0.23336. :  18%|████████                                     | 40/224 [00:23<01:42,  1.80it/s]
Epoch 11 Iter 41: loss 0.23336. :  18%|████████▏                                    | 41/224 [00:23<01:52,  1.62it/s]
Epoch 11 Iter 42: loss 0.22851. :  18%|████████▏                                    | 41/224 [00:24<01:52,  1.62it/s]
Epoch 11 Iter 42: loss 0.22851. :  19%|████████▍                                    | 42/224 [00:24<01:49,  1.66it/s]
Epoch 11 Iter 43: loss 0.24451. :  19%|████████▍                                    | 42/224 [00:24<01:49,  1.66it/s]
Epoch 11 Iter 43: loss 0.24451. :  19%|████████▋                                    | 43/224 [00:24<01:46,  1.70it/s]
Epoch 11 Iter 44: loss 0.25034. :  19%|████████▋                                    | 43/224 [00:25<01:46,  1.70it/s]
Epoch 11 Iter 44: loss 0.25034. :  20%|████████▊                                    | 44/224 [00:25<01:43,  1.75it/s]
Epoch 11 Iter 45: loss 0.21989. :  20%|████████▊                                    | 44/224 [00:26<01:43,  1.75it/s]
Epoch 11 Iter 45: loss 0.21989. :  20%|█████████                                    | 45/224 [00:26<01:52,  1.59it/s]
Epoch 11 Iter 46: loss 0.24271. :  20%|█████████                                    | 45/224 [00:26<01:52,  1.59it/s]
Epoch 11 Iter 46: loss 0.24271. :  21%|█████████▏                                   | 46/224 [00:26<01:51,  1.59it/s]
Epoch 11 Iter 47: loss 0.23219. :  21%|█████████▏                                   | 46/224 [00:27<01:51,  1.59it/s]
Epoch 11 Iter 47: loss 0.23219. :  21%|█████████▍                                   | 47/224 [00:27<01:44,  1.70it/s]
Epoch 11 Iter 48: loss 0.21154. :  21%|█████████▍                                   | 47/224 [00:27<01:44,  1.70it/s]
Epoch 11 Iter 48: loss 0.21154. :  21%|█████████▋                                   | 48/224 [00:27<01:39,  1.78it/s]
Epoch 11 Iter 49: loss 0.25668. :  21%|█████████▋                                   | 48/224 [00:28<01:39,  1.78it/s]
Epoch 11 Iter 49: loss 0.25668. :  22%|█████████▊                                   | 49/224 [00:28<01:35,  1.82it/s]
Epoch 11 Iter 50: loss 0.23722. :  22%|█████████▊                                   | 49/224 [00:28<01:35,  1.82it/s]
Epoch 11 Iter 50: loss 0.23722. :  22%|██████████                                   | 50/224 [00:28<01:33,  1.86it/s]
Epoch 11 Iter 51: loss 0.23372. :  22%|██████████                                   | 50/224 [00:29<01:33,  1.86it/s]
Epoch 11 Iter 51: loss 0.23372. :  23%|██████████▏                                  | 51/224 [00:29<01:31,  1.90it/s]
Epoch 11 Iter 52: loss 0.23018. :  23%|██████████▏                                  | 51/224 [00:29<01:31,  1.90it/s]
Epoch 11 Iter 52: loss 0.23018. :  23%|██████████▍                                  | 52/224 [00:29<01:29,  1.92it/s]
Epoch 11 Iter 53: loss 0.24147. :  23%|██████████▍                                  | 52/224 [00:30<01:29,  1.92it/s]
Epoch 11 Iter 53: loss 0.24147. :  24%|██████████▋                                  | 53/224 [00:30<01:28,  1.94it/s]
Epoch 11 Iter 54: loss 0.21911. :  24%|██████████▋                                  | 53/224 [00:30<01:28,  1.94it/s]
Epoch 11 Iter 54: loss 0.21911. :  24%|██████████▊                                  | 54/224 [00:30<01:29,  1.89it/s]
Epoch 11 Iter 55: loss 0.22117. :  24%|██████████▊                                  | 54/224 [00:31<01:29,  1.89it/s]
Epoch 11 Iter 55: loss 0.22117. :  25%|███████████                                  | 55/224 [00:31<01:27,  1.92it/s]
Epoch 11 Iter 56: loss 0.23100. :  25%|███████████                                  | 55/224 [00:31<01:27,  1.92it/s]
Epoch 11 Iter 56: loss 0.23100. :  25%|███████████▎                                 | 56/224 [00:31<01:26,  1.94it/s]
Epoch 11 Iter 57: loss 0.23007. :  25%|███████████▎                                 | 56/224 [00:32<01:26,  1.94it/s]
Epoch 11 Iter 57: loss 0.23007. :  25%|███████████▍                                 | 57/224 [00:32<01:25,  1.95it/s]
Epoch 11 Iter 58: loss 0.25020. :  25%|███████████▍                                 | 57/224 [00:33<01:25,  1.95it/s]
Epoch 11 Iter 58: loss 0.25020. :  26%|███████████▋                                 | 58/224 [00:33<01:24,  1.96it/s]
Epoch 11 Iter 59: loss 0.22688. :  26%|███████████▋                                 | 58/224 [00:33<01:24,  1.96it/s]
Epoch 11 Iter 59: loss 0.22688. :  26%|███████████▊                                 | 59/224 [00:33<01:23,  1.98it/s]
Epoch 11 Iter 60: loss 0.24123. :  26%|███████████▊                                 | 59/224 [00:34<01:23,  1.98it/s]
Epoch 11 Iter 60: loss 0.24123. :  27%|████████████                                 | 60/224 [00:34<01:22,  1.98it/s]
Epoch 11 Iter 61: loss 0.25940. :  27%|████████████                                 | 60/224 [00:34<01:22,  1.98it/s]
Epoch 11 Iter 61: loss 0.25940. :  27%|████████████▎                                | 61/224 [00:34<01:22,  1.98it/s]
Epoch 11 Iter 62: loss 0.23909. :  27%|████████████▎                                | 61/224 [00:35<01:22,  1.98it/s]
Epoch 11 Iter 62: loss 0.23909. :  28%|████████████▍                                | 62/224 [00:35<01:24,  1.91it/s]
Epoch 11 Iter 63: loss 0.23221. :  28%|████████████▍                                | 62/224 [00:35<01:24,  1.91it/s]
Epoch 11 Iter 63: loss 0.23221. :  28%|████████████▋                                | 63/224 [00:35<01:25,  1.89it/s]
Epoch 11 Iter 64: loss 0.23874. :  28%|████████████▋                                | 63/224 [00:36<01:25,  1.89it/s]
Epoch 11 Iter 64: loss 0.23874. :  29%|████████████▊                                | 64/224 [00:36<01:23,  1.91it/s]
Epoch 11 Iter 65: loss 0.22760. :  29%|████████████▊                                | 64/224 [00:36<01:23,  1.91it/s]
Epoch 11 Iter 65: loss 0.22760. :  29%|█████████████                                | 65/224 [00:36<01:24,  1.89it/s]
Epoch 11 Iter 66: loss 0.24707. :  29%|█████████████                                | 65/224 [00:37<01:24,  1.89it/s]
Epoch 11 Iter 66: loss 0.24707. :  29%|█████████████▎                               | 66/224 [00:37<01:22,  1.92it/s]
Epoch 11 Iter 67: loss 0.22128. :  29%|█████████████▎                               | 66/224 [00:37<01:22,  1.92it/s]
Epoch 11 Iter 67: loss 0.22128. :  30%|█████████████▍                               | 67/224 [00:37<01:20,  1.95it/s]
Epoch 11 Iter 68: loss 0.23147. :  30%|█████████████▍                               | 67/224 [00:38<01:20,  1.95it/s]
Epoch 11 Iter 68: loss 0.23147. :  30%|█████████████▋                               | 68/224 [00:38<01:19,  1.96it/s]
Epoch 11 Iter 69: loss 0.21823. :  30%|█████████████▋                               | 68/224 [00:38<01:19,  1.96it/s]
Epoch 11 Iter 69: loss 0.21823. :  31%|█████████████▊                               | 69/224 [00:38<01:21,  1.90it/s]
Epoch 11 Iter 70: loss 0.22746. :  31%|█████████████▊                               | 69/224 [00:39<01:21,  1.90it/s]
Epoch 11 Iter 70: loss 0.22746. :  31%|██████████████                               | 70/224 [00:39<01:20,  1.91it/s]
Epoch 11 Iter 71: loss 0.23516. :  31%|██████████████                               | 70/224 [00:39<01:20,  1.91it/s]
Epoch 11 Iter 71: loss 0.23516. :  32%|██████████████▎                              | 71/224 [00:39<01:19,  1.92it/s]
Epoch 11 Iter 72: loss 0.21881. :  32%|██████████████▎                              | 71/224 [00:40<01:19,  1.92it/s]
Epoch 11 Iter 72: loss 0.21881. :  32%|██████████████▍                              | 72/224 [00:40<01:19,  1.92it/s]
Epoch 11 Iter 73: loss 0.23389. :  32%|██████████████▍                              | 72/224 [00:40<01:19,  1.92it/s]
Epoch 11 Iter 73: loss 0.23389. :  33%|██████████████▋                              | 73/224 [00:40<01:17,  1.94it/s]
Epoch 11 Iter 74: loss 0.23832. :  33%|██████████████▋                              | 73/224 [00:41<01:17,  1.94it/s]
Epoch 11 Iter 74: loss 0.23832. :  33%|██████████████▊                              | 74/224 [00:41<01:17,  1.94it/s]
Epoch 11 Iter 75: loss 0.23732. :  33%|██████████████▊                              | 74/224 [00:41<01:17,  1.94it/s]
Epoch 11 Iter 75: loss 0.23732. :  33%|███████████████                              | 75/224 [00:41<01:19,  1.88it/s]
Epoch 11 Iter 76: loss 0.25020. :  33%|███████████████                              | 75/224 [00:42<01:19,  1.88it/s]
Epoch 11 Iter 76: loss 0.25020. :  34%|███████████████▎                             | 76/224 [00:42<01:23,  1.78it/s]
Epoch 11 Iter 77: loss 0.23807. :  34%|███████████████▎                             | 76/224 [00:43<01:23,  1.78it/s]
Epoch 11 Iter 77: loss 0.23807. :  34%|███████████████▍                             | 77/224 [00:43<01:22,  1.78it/s]
Epoch 11 Iter 78: loss 0.24236. :  34%|███████████████▍                             | 77/224 [00:43<01:22,  1.78it/s]
Epoch 11 Iter 78: loss 0.24236. :  35%|███████████████▋                             | 78/224 [00:43<01:24,  1.73it/s]
Epoch 11 Iter 79: loss 0.24165. :  35%|███████████████▋                             | 78/224 [00:44<01:24,  1.73it/s]
Epoch 11 Iter 79: loss 0.24165. :  35%|███████████████▊                             | 79/224 [00:44<01:21,  1.78it/s]
Epoch 11 Iter 80: loss 0.23396. :  35%|███████████████▊                             | 79/224 [00:44<01:21,  1.78it/s]
Epoch 11 Iter 80: loss 0.23396. :  36%|████████████████                             | 80/224 [00:44<01:19,  1.82it/s]
Epoch 11 Iter 81: loss 0.24292. :  36%|████████████████                             | 80/224 [00:45<01:19,  1.82it/s]
Epoch 11 Iter 81: loss 0.24292. :  36%|████████████████▎                            | 81/224 [00:45<01:16,  1.87it/s]
Epoch 11 Iter 82: loss 0.22820. :  36%|████████████████▎                            | 81/224 [00:45<01:16,  1.87it/s]
Epoch 11 Iter 82: loss 0.22820. :  37%|████████████████▍                            | 82/224 [00:45<01:14,  1.90it/s]
Epoch 11 Iter 83: loss 0.24202. :  37%|████████████████▍                            | 82/224 [00:46<01:14,  1.90it/s]
Epoch 11 Iter 83: loss 0.24202. :  37%|████████████████▋                            | 83/224 [00:46<01:13,  1.93it/s]
Epoch 11 Iter 84: loss 0.26699. :  37%|████████████████▋                            | 83/224 [00:46<01:13,  1.93it/s]
Epoch 11 Iter 84: loss 0.26699. :  38%|████████████████▉                            | 84/224 [00:46<01:12,  1.94it/s]
Epoch 11 Iter 85: loss 0.24477. :  38%|████████████████▉                            | 84/224 [00:47<01:12,  1.94it/s]
Epoch 11 Iter 85: loss 0.24477. :  38%|█████████████████                            | 85/224 [00:47<01:10,  1.96it/s]
Epoch 11 Iter 86: loss 0.23687. :  38%|█████████████████                            | 85/224 [00:47<01:10,  1.96it/s]
Epoch 11 Iter 86: loss 0.23687. :  38%|█████████████████▎                           | 86/224 [00:47<01:09,  1.97it/s]
Epoch 11 Iter 87: loss 0.21842. :  38%|█████████████████▎                           | 86/224 [00:48<01:09,  1.97it/s]
Epoch 11 Iter 87: loss 0.21842. :  39%|█████████████████▍                           | 87/224 [00:48<01:09,  1.97it/s]
Epoch 11 Iter 88: loss 0.23517. :  39%|█████████████████▍                           | 87/224 [00:48<01:09,  1.97it/s]
Epoch 11 Iter 88: loss 0.23517. :  39%|█████████████████▋                           | 88/224 [00:48<01:08,  1.97it/s]
Epoch 11 Iter 89: loss 0.24055. :  39%|█████████████████▋                           | 88/224 [00:49<01:08,  1.97it/s]
Epoch 11 Iter 89: loss 0.24055. :  40%|█████████████████▉                           | 89/224 [00:49<01:08,  1.98it/s]
Epoch 11 Iter 90: loss 0.24612. :  40%|█████████████████▉                           | 89/224 [00:49<01:08,  1.98it/s]
Epoch 11 Iter 90: loss 0.24612. :  40%|██████████████████                           | 90/224 [00:49<01:07,  1.98it/s]
Epoch 11 Iter 91: loss 0.24240. :  40%|██████████████████                           | 90/224 [00:50<01:07,  1.98it/s]
Epoch 11 Iter 91: loss 0.24240. :  41%|██████████████████▎                          | 91/224 [00:50<01:06,  1.99it/s]
Epoch 11 Iter 92: loss 0.23891. :  41%|██████████████████▎                          | 91/224 [00:50<01:06,  1.99it/s]
Epoch 11 Iter 92: loss 0.23891. :  41%|██████████████████▍                          | 92/224 [00:50<01:06,  2.00it/s]
Epoch 11 Iter 93: loss 0.22432. :  41%|██████████████████▍                          | 92/224 [00:51<01:06,  2.00it/s]
Epoch 11 Iter 93: loss 0.22432. :  42%|██████████████████▋                          | 93/224 [00:51<01:06,  1.98it/s]
Epoch 11 Iter 94: loss 0.24233. :  42%|██████████████████▋                          | 93/224 [00:51<01:06,  1.98it/s]
Epoch 11 Iter 94: loss 0.24233. :  42%|██████████████████▉                          | 94/224 [00:51<01:05,  2.00it/s]
Epoch 11 Iter 95: loss 0.25480. :  42%|██████████████████▉                          | 94/224 [00:52<01:05,  2.00it/s]
Epoch 11 Iter 95: loss 0.25480. :  42%|███████████████████                          | 95/224 [00:52<01:10,  1.82it/s]
Epoch 11 Iter 96: loss 0.23899. :  42%|███████████████████                          | 95/224 [00:53<01:10,  1.82it/s]
Epoch 11 Iter 96: loss 0.23899. :  43%|███████████████████▎                         | 96/224 [00:53<01:13,  1.75it/s]
Epoch 11 Iter 97: loss 0.22910. :  43%|███████████████████▎                         | 96/224 [00:53<01:13,  1.75it/s]
Epoch 11 Iter 97: loss 0.22910. :  43%|███████████████████▍                         | 97/224 [00:53<01:13,  1.73it/s]
Epoch 11 Iter 98: loss 0.26007. :  43%|███████████████████▍                         | 97/224 [00:54<01:13,  1.73it/s]
Epoch 11 Iter 98: loss 0.26007. :  44%|███████████████████▋                         | 98/224 [00:54<01:11,  1.75it/s]
Epoch 11 Iter 99: loss 0.21945. :  44%|███████████████████▋                         | 98/224 [00:54<01:11,  1.75it/s]
Epoch 11 Iter 99: loss 0.21945. :  44%|███████████████████▉                         | 99/224 [00:54<01:09,  1.79it/s]
Epoch 11 Iter 100: loss 0.24379. :  44%|███████████████████▍                        | 99/224 [00:55<01:09,  1.79it/s]
Epoch 11 Iter 100: loss 0.24379. :  45%|███████████████████▏                       | 100/224 [00:55<01:16,  1.63it/s]
Epoch 11 Iter 101: loss 0.21717. :  45%|███████████████████▏                       | 100/224 [00:56<01:16,  1.63it/s]
Epoch 11 Iter 101: loss 0.21717. :  45%|███████████████████▍                       | 101/224 [00:56<01:20,  1.53it/s]
Epoch 11 Iter 102: loss 0.22407. :  45%|███████████████████▍                       | 101/224 [00:56<01:20,  1.53it/s]
Epoch 11 Iter 102: loss 0.22407. :  46%|███████████████████▌                       | 102/224 [00:56<01:19,  1.53it/s]
Epoch 11 Iter 103: loss 0.23827. :  46%|███████████████████▌                       | 102/224 [00:57<01:19,  1.53it/s]
Epoch 11 Iter 103: loss 0.23827. :  46%|███████████████████▊                       | 103/224 [00:57<01:23,  1.45it/s]
Epoch 11 Iter 104: loss 0.21632. :  46%|███████████████████▊                       | 103/224 [00:58<01:23,  1.45it/s]
Epoch 11 Iter 104: loss 0.21632. :  46%|███████████████████▉                       | 104/224 [00:58<01:21,  1.48it/s]
Epoch 11 Iter 105: loss 0.25116. :  46%|███████████████████▉                       | 104/224 [00:58<01:21,  1.48it/s]
Epoch 11 Iter 105: loss 0.25116. :  47%|████████████████████▏                      | 105/224 [00:58<01:15,  1.57it/s]
Epoch 11 Iter 106: loss 0.25127. :  47%|████████████████████▏                      | 105/224 [00:59<01:15,  1.57it/s]
Epoch 11 Iter 106: loss 0.25127. :  47%|████████████████████▎                      | 106/224 [00:59<01:19,  1.48it/s]
Epoch 11 Iter 107: loss 0.23949. :  47%|████████████████████▎                      | 106/224 [01:00<01:19,  1.48it/s]
Epoch 11 Iter 107: loss 0.23949. :  48%|████████████████████▌                      | 107/224 [01:00<01:15,  1.54it/s]
Epoch 11 Iter 108: loss 0.24611. :  48%|████████████████████▌                      | 107/224 [01:00<01:15,  1.54it/s]
Epoch 11 Iter 108: loss 0.24611. :  48%|████████████████████▋                      | 108/224 [01:00<01:11,  1.62it/s]
Epoch 11 Iter 109: loss 0.25006. :  48%|████████████████████▋                      | 108/224 [01:01<01:11,  1.62it/s]
Epoch 11 Iter 109: loss 0.25006. :  49%|████████████████████▉                      | 109/224 [01:01<01:08,  1.67it/s]
Epoch 11 Iter 110: loss 0.24050. :  49%|████████████████████▉                      | 109/224 [01:01<01:08,  1.67it/s]
Epoch 11 Iter 110: loss 0.24050. :  49%|█████████████████████                      | 110/224 [01:01<01:05,  1.73it/s]
Epoch 11 Iter 111: loss 0.23861. :  49%|█████████████████████                      | 110/224 [01:02<01:05,  1.73it/s]
Epoch 11 Iter 111: loss 0.23861. :  50%|█████████████████████▎                     | 111/224 [01:02<01:07,  1.67it/s]
Epoch 11 Iter 112: loss 0.22538. :  50%|█████████████████████▎                     | 111/224 [01:03<01:07,  1.67it/s]
Epoch 11 Iter 112: loss 0.22538. :  50%|█████████████████████▌                     | 112/224 [01:03<01:07,  1.66it/s]
Epoch 11 Iter 113: loss 0.24835. :  50%|█████████████████████▌                     | 112/224 [01:03<01:07,  1.66it/s]
Epoch 11 Iter 113: loss 0.24835. :  50%|█████████████████████▋                     | 113/224 [01:03<01:12,  1.54it/s]
Epoch 11 Iter 114: loss 0.23367. :  50%|█████████████████████▋                     | 113/224 [01:04<01:12,  1.54it/s]
Epoch 11 Iter 114: loss 0.23367. :  51%|█████████████████████▉                     | 114/224 [01:04<01:15,  1.47it/s]
Epoch 11 Iter 115: loss 0.22702. :  51%|█████████████████████▉                     | 114/224 [01:05<01:15,  1.47it/s]
Epoch 11 Iter 115: loss 0.22702. :  51%|██████████████████████                     | 115/224 [01:05<01:12,  1.50it/s]
Epoch 11 Iter 116: loss 0.25416. :  51%|██████████████████████                     | 115/224 [01:05<01:12,  1.50it/s]
Epoch 11 Iter 116: loss 0.25416. :  52%|██████████████████████▎                    | 116/224 [01:05<01:07,  1.61it/s]
Epoch 11 Iter 117: loss 0.25917. :  52%|██████████████████████▎                    | 116/224 [01:06<01:07,  1.61it/s]
Epoch 11 Iter 117: loss 0.25917. :  52%|██████████████████████▍                    | 117/224 [01:06<01:04,  1.66it/s]
Epoch 11 Iter 118: loss 0.23916. :  52%|██████████████████████▍                    | 117/224 [01:06<01:04,  1.66it/s]
Epoch 11 Iter 118: loss 0.23916. :  53%|██████████████████████▋                    | 118/224 [01:06<01:03,  1.66it/s]
Epoch 11 Iter 119: loss 0.22975. :  53%|██████████████████████▋                    | 118/224 [01:07<01:03,  1.66it/s]
Epoch 11 Iter 119: loss 0.22975. :  53%|██████████████████████▊                    | 119/224 [01:07<01:03,  1.65it/s]
Epoch 11 Iter 120: loss 0.25015. :  53%|██████████████████████▊                    | 119/224 [01:08<01:03,  1.65it/s]
Epoch 11 Iter 120: loss 0.25015. :  54%|███████████████████████                    | 120/224 [01:08<01:09,  1.50it/s]
Epoch 11 Iter 121: loss 0.23749. :  54%|███████████████████████                    | 120/224 [01:09<01:09,  1.50it/s]
Epoch 11 Iter 121: loss 0.23749. :  54%|███████████████████████▏                   | 121/224 [01:09<01:12,  1.42it/s]
Epoch 11 Iter 122: loss 0.24546. :  54%|███████████████████████▏                   | 121/224 [01:09<01:12,  1.42it/s]
Epoch 11 Iter 122: loss 0.24546. :  54%|███████████████████████▍                   | 122/224 [01:09<01:14,  1.37it/s]
Epoch 11 Iter 123: loss 0.21121. :  54%|███████████████████████▍                   | 122/224 [01:10<01:14,  1.37it/s]
Epoch 11 Iter 123: loss 0.21121. :  55%|███████████████████████▌                   | 123/224 [01:10<01:12,  1.38it/s]
Epoch 11 Iter 124: loss 0.22669. :  55%|███████████████████████▌                   | 123/224 [01:11<01:12,  1.38it/s]
Epoch 11 Iter 124: loss 0.22669. :  55%|███████████████████████▊                   | 124/224 [01:11<01:06,  1.50it/s]
Epoch 11 Iter 125: loss 0.21900. :  55%|███████████████████████▊                   | 124/224 [01:11<01:06,  1.50it/s]
Epoch 11 Iter 125: loss 0.21900. :  56%|███████████████████████▉                   | 125/224 [01:11<01:02,  1.59it/s]
Epoch 11 Iter 126: loss 0.22767. :  56%|███████████████████████▉                   | 125/224 [01:12<01:02,  1.59it/s]
Epoch 11 Iter 126: loss 0.22767. :  56%|████████████████████████▏                  | 126/224 [01:12<01:05,  1.49it/s]
Epoch 11 Iter 127: loss 0.24476. :  56%|████████████████████████▏                  | 126/224 [01:13<01:05,  1.49it/s]
Epoch 11 Iter 127: loss 0.24476. :  57%|████████████████████████▍                  | 127/224 [01:13<01:08,  1.43it/s]
Epoch 11 Iter 128: loss 0.24770. :  57%|████████████████████████▍                  | 127/224 [01:13<01:08,  1.43it/s]
Epoch 11 Iter 128: loss 0.24770. :  57%|████████████████████████▌                  | 128/224 [01:13<01:02,  1.53it/s]
Epoch 11 Iter 129: loss 0.22883. :  57%|████████████████████████▌                  | 128/224 [01:14<01:02,  1.53it/s]
Epoch 11 Iter 129: loss 0.22883. :  58%|████████████████████████▊                  | 129/224 [01:14<00:59,  1.60it/s]
Epoch 11 Iter 130: loss 0.24605. :  58%|████████████████████████▊                  | 129/224 [01:14<00:59,  1.60it/s]
Epoch 11 Iter 130: loss 0.24605. :  58%|████████████████████████▉                  | 130/224 [01:14<00:56,  1.65it/s]
Epoch 11 Iter 131: loss 0.21578. :  58%|████████████████████████▉                  | 130/224 [01:15<00:56,  1.65it/s]
Epoch 11 Iter 131: loss 0.21578. :  58%|█████████████████████████▏                 | 131/224 [01:15<00:55,  1.68it/s]
Epoch 11 Iter 132: loss 0.24168. :  58%|█████████████████████████▏                 | 131/224 [01:16<00:55,  1.68it/s]
Epoch 11 Iter 132: loss 0.24168. :  59%|█████████████████████████▎                 | 132/224 [01:16<00:59,  1.54it/s]
Epoch 11 Iter 133: loss 0.24684. :  59%|█████████████████████████▎                 | 132/224 [01:17<00:59,  1.54it/s]
Epoch 11 Iter 133: loss 0.24684. :  59%|█████████████████████████▌                 | 133/224 [01:17<01:02,  1.45it/s]
Epoch 11 Iter 134: loss 0.24126. :  59%|█████████████████████████▌                 | 133/224 [01:17<01:02,  1.45it/s]
Epoch 11 Iter 134: loss 0.24126. :  60%|█████████████████████████▋                 | 134/224 [01:17<01:04,  1.39it/s]
Epoch 11 Iter 135: loss 0.23614. :  60%|█████████████████████████▋                 | 134/224 [01:18<01:04,  1.39it/s]
Epoch 11 Iter 135: loss 0.23614. :  60%|█████████████████████████▉                 | 135/224 [01:18<01:05,  1.35it/s]
Epoch 11 Iter 136: loss 0.25104. :  60%|█████████████████████████▉                 | 135/224 [01:19<01:05,  1.35it/s]
Epoch 11 Iter 136: loss 0.25104. :  61%|██████████████████████████                 | 136/224 [01:19<01:05,  1.35it/s]
Epoch 11 Iter 137: loss 0.22908. :  61%|██████████████████████████                 | 136/224 [01:20<01:05,  1.35it/s]
Epoch 11 Iter 137: loss 0.22908. :  61%|██████████████████████████▎                | 137/224 [01:20<01:02,  1.38it/s]
Epoch 11 Iter 138: loss 0.23357. :  61%|██████████████████████████▎                | 137/224 [01:20<01:02,  1.38it/s]
Epoch 11 Iter 138: loss 0.23357. :  62%|██████████████████████████▍                | 138/224 [01:20<01:00,  1.43it/s]
Epoch 11 Iter 139: loss 0.23748. :  62%|██████████████████████████▍                | 138/224 [01:21<01:00,  1.43it/s]
Epoch 11 Iter 139: loss 0.23748. :  62%|██████████████████████████▋                | 139/224 [01:21<01:00,  1.40it/s]
Epoch 11 Iter 140: loss 0.25577. :  62%|██████████████████████████▋                | 139/224 [01:22<01:00,  1.40it/s]
Epoch 11 Iter 140: loss 0.25577. :  62%|██████████████████████████▉                | 140/224 [01:22<01:01,  1.37it/s]
Epoch 11 Iter 141: loss 0.23137. :  62%|██████████████████████████▉                | 140/224 [01:22<01:01,  1.37it/s]
Epoch 11 Iter 141: loss 0.23137. :  63%|███████████████████████████                | 141/224 [01:22<01:01,  1.34it/s]
Epoch 11 Iter 142: loss 0.22564. :  63%|███████████████████████████                | 141/224 [01:23<01:01,  1.34it/s]
Epoch 11 Iter 142: loss 0.22564. :  63%|███████████████████████████▎               | 142/224 [01:23<00:56,  1.44it/s]
Epoch 11 Iter 143: loss 0.22406. :  63%|███████████████████████████▎               | 142/224 [01:24<00:56,  1.44it/s]
Epoch 11 Iter 143: loss 0.22406. :  64%|███████████████████████████▍               | 143/224 [01:24<00:55,  1.45it/s]
Epoch 11 Iter 144: loss 0.22214. :  64%|███████████████████████████▍               | 143/224 [01:24<00:55,  1.45it/s]
Epoch 11 Iter 144: loss 0.22214. :  64%|███████████████████████████▋               | 144/224 [01:24<00:55,  1.45it/s]
Epoch 11 Iter 145: loss 0.23624. :  64%|███████████████████████████▋               | 144/224 [01:25<00:55,  1.45it/s]
Epoch 11 Iter 145: loss 0.23624. :  65%|███████████████████████████▊               | 145/224 [01:25<00:51,  1.54it/s]
Epoch 11 Iter 146: loss 0.22785. :  65%|███████████████████████████▊               | 145/224 [01:26<00:51,  1.54it/s]
Epoch 11 Iter 146: loss 0.22785. :  65%|████████████████████████████               | 146/224 [01:26<00:53,  1.45it/s]
Epoch 11 Iter 147: loss 0.26853. :  65%|████████████████████████████               | 146/224 [01:26<00:53,  1.45it/s]
Epoch 11 Iter 147: loss 0.26853. :  66%|████████████████████████████▏              | 147/224 [01:26<00:54,  1.41it/s]
Epoch 11 Iter 148: loss 0.24248. :  66%|████████████████████████████▏              | 147/224 [01:27<00:54,  1.41it/s]
Epoch 11 Iter 148: loss 0.24248. :  66%|████████████████████████████▍              | 148/224 [01:27<00:55,  1.37it/s]
Epoch 11 Iter 149: loss 0.23249. :  66%|████████████████████████████▍              | 148/224 [01:28<00:55,  1.37it/s]
Epoch 11 Iter 149: loss 0.23249. :  67%|████████████████████████████▌              | 149/224 [01:28<00:54,  1.38it/s]
Epoch 11 Iter 150: loss 0.24396. :  67%|████████████████████████████▌              | 149/224 [01:29<00:54,  1.38it/s]
Epoch 11 Iter 150: loss 0.24396. :  67%|████████████████████████████▊              | 150/224 [01:29<00:49,  1.48it/s]
Epoch 11 Iter 151: loss 0.24531. :  67%|████████████████████████████▊              | 150/224 [01:29<00:49,  1.48it/s]
Epoch 11 Iter 151: loss 0.24531. :  67%|████████████████████████████▉              | 151/224 [01:29<00:46,  1.57it/s]
Epoch 11 Iter 152: loss 0.21958. :  67%|████████████████████████████▉              | 151/224 [01:30<00:46,  1.57it/s]
Epoch 11 Iter 152: loss 0.21958. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:48,  1.49it/s]
Epoch 11 Iter 153: loss 0.24199. :  68%|█████████████████████████████▏             | 152/224 [01:31<00:48,  1.49it/s]
Epoch 11 Iter 153: loss 0.24199. :  68%|█████████████████████████████▎             | 153/224 [01:31<00:47,  1.49it/s]
Epoch 11 Iter 154: loss 0.25032. :  68%|█████████████████████████████▎             | 153/224 [01:31<00:47,  1.49it/s]
Epoch 11 Iter 154: loss 0.25032. :  69%|█████████████████████████████▌             | 154/224 [01:31<00:46,  1.50it/s]
Epoch 11 Iter 155: loss 0.23691. :  69%|█████████████████████████████▌             | 154/224 [01:32<00:46,  1.50it/s]
Epoch 11 Iter 155: loss 0.23691. :  69%|█████████████████████████████▊             | 155/224 [01:32<00:45,  1.53it/s]
Epoch 11 Iter 156: loss 0.22374. :  69%|█████████████████████████████▊             | 155/224 [01:32<00:45,  1.53it/s]
Epoch 11 Iter 156: loss 0.22374. :  70%|█████████████████████████████▉             | 156/224 [01:32<00:42,  1.61it/s]
Epoch 11 Iter 157: loss 0.22995. :  70%|█████████████████████████████▉             | 156/224 [01:33<00:42,  1.61it/s]
Epoch 11 Iter 157: loss 0.22995. :  70%|██████████████████████████████▏            | 157/224 [01:33<00:42,  1.56it/s]
Epoch 11 Iter 158: loss 0.23583. :  70%|██████████████████████████████▏            | 157/224 [01:34<00:42,  1.56it/s]
Epoch 11 Iter 158: loss 0.23583. :  71%|██████████████████████████████▎            | 158/224 [01:34<00:42,  1.55it/s]
Epoch 11 Iter 159: loss 0.21126. :  71%|██████████████████████████████▎            | 158/224 [01:34<00:42,  1.55it/s]
Epoch 11 Iter 159: loss 0.21126. :  71%|██████████████████████████████▌            | 159/224 [01:34<00:40,  1.62it/s]
Epoch 11 Iter 160: loss 0.24140. :  71%|██████████████████████████████▌            | 159/224 [01:35<00:40,  1.62it/s]
Epoch 11 Iter 160: loss 0.24140. :  71%|██████████████████████████████▋            | 160/224 [01:35<00:42,  1.50it/s]
Epoch 11 Iter 161: loss 0.23055. :  71%|██████████████████████████████▋            | 160/224 [01:36<00:42,  1.50it/s]
Epoch 11 Iter 161: loss 0.23055. :  72%|██████████████████████████████▉            | 161/224 [01:36<00:44,  1.42it/s]
Epoch 11 Iter 162: loss 0.24289. :  72%|██████████████████████████████▉            | 161/224 [01:36<00:44,  1.42it/s]
Epoch 11 Iter 162: loss 0.24289. :  72%|███████████████████████████████            | 162/224 [01:36<00:41,  1.51it/s]
Epoch 11 Iter 163: loss 0.22543. :  72%|███████████████████████████████            | 162/224 [01:37<00:41,  1.51it/s]
Epoch 11 Iter 163: loss 0.22543. :  73%|███████████████████████████████▎           | 163/224 [01:37<00:38,  1.60it/s]
Epoch 11 Iter 164: loss 0.25041. :  73%|███████████████████████████████▎           | 163/224 [01:37<00:38,  1.60it/s]
Epoch 11 Iter 164: loss 0.25041. :  73%|███████████████████████████████▍           | 164/224 [01:37<00:35,  1.67it/s]
Epoch 11 Iter 165: loss 0.24536. :  73%|███████████████████████████████▍           | 164/224 [01:38<00:35,  1.67it/s]
Epoch 11 Iter 165: loss 0.24536. :  74%|███████████████████████████████▋           | 165/224 [01:38<00:34,  1.72it/s]
Epoch 11 Iter 166: loss 0.21764. :  74%|███████████████████████████████▋           | 165/224 [01:39<00:34,  1.72it/s]
Epoch 11 Iter 166: loss 0.21764. :  74%|███████████████████████████████▊           | 166/224 [01:39<00:33,  1.75it/s]
Epoch 11 Iter 167: loss 0.24854. :  74%|███████████████████████████████▊           | 166/224 [01:39<00:33,  1.75it/s]
Epoch 11 Iter 167: loss 0.24854. :  75%|████████████████████████████████           | 167/224 [01:39<00:33,  1.71it/s]
Epoch 11 Iter 168: loss 0.21870. :  75%|████████████████████████████████           | 167/224 [01:40<00:33,  1.71it/s]
Epoch 11 Iter 168: loss 0.21870. :  75%|████████████████████████████████▎          | 168/224 [01:40<00:32,  1.75it/s]
Epoch 11 Iter 169: loss 0.23491. :  75%|████████████████████████████████▎          | 168/224 [01:40<00:32,  1.75it/s]
Epoch 11 Iter 169: loss 0.23491. :  75%|████████████████████████████████▍          | 169/224 [01:40<00:31,  1.77it/s]
Epoch 11 Iter 170: loss 0.23232. :  75%|████████████████████████████████▍          | 169/224 [01:41<00:31,  1.77it/s]
Epoch 11 Iter 170: loss 0.23232. :  76%|████████████████████████████████▋          | 170/224 [01:41<00:33,  1.61it/s]
Epoch 11 Iter 171: loss 0.24447. :  76%|████████████████████████████████▋          | 170/224 [01:42<00:33,  1.61it/s]
Epoch 11 Iter 171: loss 0.24447. :  76%|████████████████████████████████▊          | 171/224 [01:42<00:35,  1.49it/s]
Epoch 11 Iter 172: loss 0.24258. :  76%|████████████████████████████████▊          | 171/224 [01:42<00:35,  1.49it/s]
Epoch 11 Iter 172: loss 0.24258. :  77%|█████████████████████████████████          | 172/224 [01:42<00:33,  1.57it/s]
Epoch 11 Iter 173: loss 0.23178. :  77%|█████████████████████████████████          | 172/224 [01:43<00:33,  1.57it/s]
Epoch 11 Iter 173: loss 0.23178. :  77%|█████████████████████████████████▏         | 173/224 [01:43<00:31,  1.61it/s]
Epoch 11 Iter 174: loss 0.24164. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:31,  1.61it/s]
Epoch 11 Iter 174: loss 0.24164. :  78%|█████████████████████████████████▍         | 174/224 [01:44<00:32,  1.53it/s]
Epoch 11 Iter 175: loss 0.22433. :  78%|█████████████████████████████████▍         | 174/224 [01:44<00:32,  1.53it/s]
Epoch 11 Iter 175: loss 0.22433. :  78%|█████████████████████████████████▌         | 175/224 [01:44<00:33,  1.46it/s]
Epoch 11 Iter 176: loss 0.20904. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:33,  1.46it/s]
Epoch 11 Iter 176: loss 0.20904. :  79%|█████████████████████████████████▊         | 176/224 [01:45<00:34,  1.40it/s]
Epoch 11 Iter 177: loss 0.22833. :  79%|█████████████████████████████████▊         | 176/224 [01:46<00:34,  1.40it/s]
Epoch 11 Iter 177: loss 0.22833. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:31,  1.50it/s]
Epoch 11 Iter 178: loss 0.24162. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:31,  1.50it/s]
Epoch 11 Iter 178: loss 0.24162. :  79%|██████████████████████████████████▏        | 178/224 [01:46<00:30,  1.49it/s]
Epoch 11 Iter 179: loss 0.24954. :  79%|██████████████████████████████████▏        | 178/224 [01:47<00:30,  1.49it/s]
Epoch 11 Iter 179: loss 0.24954. :  80%|██████████████████████████████████▎        | 179/224 [01:47<00:31,  1.44it/s]
Epoch 11 Iter 180: loss 0.22106. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:31,  1.44it/s]
Epoch 11 Iter 180: loss 0.22106. :  80%|██████████████████████████████████▌        | 180/224 [01:48<00:29,  1.50it/s]
Epoch 11 Iter 181: loss 0.23201. :  80%|██████████████████████████████████▌        | 180/224 [01:48<00:29,  1.50it/s]
Epoch 11 Iter 181: loss 0.23201. :  81%|██████████████████████████████████▋        | 181/224 [01:48<00:26,  1.59it/s]
Epoch 11 Iter 182: loss 0.23547. :  81%|██████████████████████████████████▋        | 181/224 [01:49<00:26,  1.59it/s]
Epoch 11 Iter 182: loss 0.23547. :  81%|██████████████████████████████████▉        | 182/224 [01:49<00:25,  1.66it/s]
Epoch 11 Iter 183: loss 0.23401. :  81%|██████████████████████████████████▉        | 182/224 [01:50<00:25,  1.66it/s]
Epoch 11 Iter 183: loss 0.23401. :  82%|███████████████████████████████████▏       | 183/224 [01:50<00:25,  1.59it/s]
Epoch 11 Iter 184: loss 0.24142. :  82%|███████████████████████████████████▏       | 183/224 [01:50<00:25,  1.59it/s]
Epoch 11 Iter 184: loss 0.24142. :  82%|███████████████████████████████████▎       | 184/224 [01:50<00:25,  1.58it/s]
Epoch 11 Iter 185: loss 0.23329. :  82%|███████████████████████████████████▎       | 184/224 [01:51<00:25,  1.58it/s]
Epoch 11 Iter 185: loss 0.23329. :  83%|███████████████████████████████████▌       | 185/224 [01:51<00:23,  1.64it/s]
Epoch 11 Iter 186: loss 0.23559. :  83%|███████████████████████████████████▌       | 185/224 [01:51<00:23,  1.64it/s]
Epoch 11 Iter 186: loss 0.23559. :  83%|███████████████████████████████████▋       | 186/224 [01:51<00:22,  1.69it/s]
Epoch 11 Iter 187: loss 0.24717. :  83%|███████████████████████████████████▋       | 186/224 [01:52<00:22,  1.69it/s]
Epoch 11 Iter 187: loss 0.24717. :  83%|███████████████████████████████████▉       | 187/224 [01:52<00:21,  1.72it/s]
Epoch 11 Iter 188: loss 0.24124. :  83%|███████████████████████████████████▉       | 187/224 [01:52<00:21,  1.72it/s]
Epoch 11 Iter 188: loss 0.24124. :  84%|████████████████████████████████████       | 188/224 [01:52<00:20,  1.76it/s]
Epoch 11 Iter 189: loss 0.23686. :  84%|████████████████████████████████████       | 188/224 [01:53<00:20,  1.76it/s]
Epoch 11 Iter 189: loss 0.23686. :  84%|████████████████████████████████████▎      | 189/224 [01:53<00:21,  1.65it/s]
Epoch 11 Iter 190: loss 0.24734. :  84%|████████████████████████████████████▎      | 189/224 [01:54<00:21,  1.65it/s]
Epoch 11 Iter 190: loss 0.24734. :  85%|████████████████████████████████████▍      | 190/224 [01:54<00:20,  1.64it/s]
Epoch 11 Iter 191: loss 0.22162. :  85%|████████████████████████████████████▍      | 190/224 [01:54<00:20,  1.64it/s]
Epoch 11 Iter 191: loss 0.22162. :  85%|████████████████████████████████████▋      | 191/224 [01:54<00:19,  1.65it/s]
Epoch 11 Iter 192: loss 0.25392. :  85%|████████████████████████████████████▋      | 191/224 [01:55<00:19,  1.65it/s]
Epoch 11 Iter 192: loss 0.25392. :  86%|████████████████████████████████████▊      | 192/224 [01:55<00:19,  1.65it/s]
Epoch 11 Iter 193: loss 0.22692. :  86%|████████████████████████████████████▊      | 192/224 [01:56<00:19,  1.65it/s]
Epoch 11 Iter 193: loss 0.22692. :  86%|█████████████████████████████████████      | 193/224 [01:56<00:20,  1.52it/s]
Epoch 11 Iter 194: loss 0.21427. :  86%|█████████████████████████████████████      | 193/224 [01:56<00:20,  1.52it/s]
Epoch 11 Iter 194: loss 0.21427. :  87%|█████████████████████████████████████▏     | 194/224 [01:56<00:18,  1.60it/s]
Epoch 11 Iter 195: loss 0.22562. :  87%|█████████████████████████████████████▏     | 194/224 [01:57<00:18,  1.60it/s]
Epoch 11 Iter 195: loss 0.22562. :  87%|█████████████████████████████████████▍     | 195/224 [01:57<00:17,  1.67it/s]
Epoch 11 Iter 196: loss 0.21998. :  87%|█████████████████████████████████████▍     | 195/224 [01:57<00:17,  1.67it/s]
Epoch 11 Iter 196: loss 0.21998. :  88%|█████████████████████████████████████▋     | 196/224 [01:57<00:16,  1.70it/s]
Epoch 11 Iter 197: loss 0.23590. :  88%|█████████████████████████████████████▋     | 196/224 [01:58<00:16,  1.70it/s]
Epoch 11 Iter 197: loss 0.23590. :  88%|█████████████████████████████████████▊     | 197/224 [01:58<00:15,  1.73it/s]
Epoch 11 Iter 198: loss 0.24670. :  88%|█████████████████████████████████████▊     | 197/224 [01:58<00:15,  1.73it/s]
Epoch 11 Iter 198: loss 0.24670. :  88%|██████████████████████████████████████     | 198/224 [01:58<00:14,  1.75it/s]
Epoch 11 Iter 199: loss 0.24630. :  88%|██████████████████████████████████████     | 198/224 [01:59<00:14,  1.75it/s]
Epoch 11 Iter 199: loss 0.24630. :  89%|██████████████████████████████████████▏    | 199/224 [01:59<00:14,  1.73it/s]
Epoch 11 Iter 200: loss 0.23252. :  89%|██████████████████████████████████████▏    | 199/224 [02:00<00:14,  1.73it/s]
Epoch 11 Iter 200: loss 0.23252. :  89%|██████████████████████████████████████▍    | 200/224 [02:00<00:15,  1.60it/s]
Epoch 11 Iter 201: loss 0.24746. :  89%|██████████████████████████████████████▍    | 200/224 [02:00<00:15,  1.60it/s]
Epoch 11 Iter 201: loss 0.24746. :  90%|██████████████████████████████████████▌    | 201/224 [02:00<00:14,  1.55it/s]
Epoch 11 Iter 202: loss 0.23909. :  90%|██████████████████████████████████████▌    | 201/224 [02:01<00:14,  1.55it/s]
Epoch 11 Iter 202: loss 0.23909. :  90%|██████████████████████████████████████▊    | 202/224 [02:01<00:14,  1.47it/s]
Epoch 11 Iter 203: loss 0.23797. :  90%|██████████████████████████████████████▊    | 202/224 [02:02<00:14,  1.47it/s]
Epoch 11 Iter 203: loss 0.23797. :  91%|██████████████████████████████████████▉    | 203/224 [02:02<00:14,  1.41it/s]
Epoch 11 Iter 204: loss 0.22493. :  91%|██████████████████████████████████████▉    | 203/224 [02:03<00:14,  1.41it/s]
Epoch 11 Iter 204: loss 0.22493. :  91%|███████████████████████████████████████▏   | 204/224 [02:03<00:14,  1.38it/s]
Epoch 11 Iter 205: loss 0.24482. :  91%|███████████████████████████████████████▏   | 204/224 [02:03<00:14,  1.38it/s]
Epoch 11 Iter 205: loss 0.24482. :  92%|███████████████████████████████████████▎   | 205/224 [02:03<00:13,  1.38it/s]
Epoch 11 Iter 206: loss 0.23146. :  92%|███████████████████████████████████████▎   | 205/224 [02:04<00:13,  1.38it/s]
Epoch 11 Iter 206: loss 0.23146. :  92%|███████████████████████████████████████▌   | 206/224 [02:04<00:12,  1.47it/s]
Epoch 11 Iter 207: loss 0.23058. :  92%|███████████████████████████████████████▌   | 206/224 [02:05<00:12,  1.47it/s]
Epoch 11 Iter 207: loss 0.23058. :  92%|███████████████████████████████████████▋   | 207/224 [02:05<00:11,  1.51it/s]
Epoch 11 Iter 208: loss 0.22313. :  92%|███████████████████████████████████████▋   | 207/224 [02:05<00:11,  1.51it/s]
Epoch 11 Iter 208: loss 0.22313. :  93%|███████████████████████████████████████▉   | 208/224 [02:05<00:10,  1.59it/s]
Epoch 11 Iter 209: loss 0.23319. :  93%|███████████████████████████████████████▉   | 208/224 [02:06<00:10,  1.59it/s]
Epoch 11 Iter 209: loss 0.23319. :  93%|████████████████████████████████████████   | 209/224 [02:06<00:09,  1.59it/s]
Epoch 11 Iter 210: loss 0.22976. :  93%|████████████████████████████████████████   | 209/224 [02:06<00:09,  1.59it/s]
Epoch 11 Iter 210: loss 0.22976. :  94%|████████████████████████████████████████▎  | 210/224 [02:06<00:08,  1.63it/s]
Epoch 11 Iter 211: loss 0.23018. :  94%|████████████████████████████████████████▎  | 210/224 [02:07<00:08,  1.63it/s]
Epoch 11 Iter 211: loss 0.23018. :  94%|████████████████████████████████████████▌  | 211/224 [02:07<00:07,  1.68it/s]
Epoch 11 Iter 212: loss 0.22478. :  94%|████████████████████████████████████████▌  | 211/224 [02:08<00:07,  1.68it/s]
Epoch 11 Iter 212: loss 0.22478. :  95%|████████████████████████████████████████▋  | 212/224 [02:08<00:07,  1.55it/s]
Epoch 11 Iter 213: loss 0.23270. :  95%|████████████████████████████████████████▋  | 212/224 [02:08<00:07,  1.55it/s]
Epoch 11 Iter 213: loss 0.23270. :  95%|████████████████████████████████████████▉  | 213/224 [02:08<00:07,  1.54it/s]
Epoch 11 Iter 214: loss 0.25393. :  95%|████████████████████████████████████████▉  | 213/224 [02:09<00:07,  1.54it/s]
Epoch 11 Iter 214: loss 0.25393. :  96%|█████████████████████████████████████████  | 214/224 [02:09<00:06,  1.63it/s]
Epoch 11 Iter 215: loss 0.22442. :  96%|█████████████████████████████████████████  | 214/224 [02:10<00:06,  1.63it/s]
Epoch 11 Iter 215: loss 0.22442. :  96%|█████████████████████████████████████████▎ | 215/224 [02:10<00:05,  1.64it/s]
Epoch 11 Iter 216: loss 0.22378. :  96%|█████████████████████████████████████████▎ | 215/224 [02:10<00:05,  1.64it/s]
Epoch 11 Iter 216: loss 0.22378. :  96%|█████████████████████████████████████████▍ | 216/224 [02:10<00:05,  1.57it/s]
Epoch 11 Iter 217: loss 0.23810. :  96%|█████████████████████████████████████████▍ | 216/224 [02:11<00:05,  1.57it/s]
Epoch 11 Iter 217: loss 0.23810. :  97%|█████████████████████████████████████████▋ | 217/224 [02:11<00:04,  1.54it/s]
Epoch 11 Iter 218: loss 0.23864. :  97%|█████████████████████████████████████████▋ | 217/224 [02:11<00:04,  1.54it/s]
Epoch 11 Iter 218: loss 0.23864. :  97%|█████████████████████████████████████████▊ | 218/224 [02:11<00:03,  1.62it/s]
Epoch 11 Iter 219: loss 0.22225. :  97%|█████████████████████████████████████████▊ | 218/224 [02:12<00:03,  1.62it/s]
Epoch 11 Iter 219: loss 0.22225. :  98%|██████████████████████████████████████████ | 219/224 [02:12<00:03,  1.59it/s]
Epoch 11 Iter 220: loss 0.24466. :  98%|██████████████████████████████████████████ | 219/224 [02:13<00:03,  1.59it/s]
Epoch 11 Iter 220: loss 0.24466. :  98%|██████████████████████████████████████████▏| 220/224 [02:13<00:02,  1.62it/s]
Epoch 11 Iter 221: loss 0.24345. :  98%|██████████████████████████████████████████▏| 220/224 [02:13<00:02,  1.62it/s]
Epoch 11 Iter 221: loss 0.24345. :  99%|██████████████████████████████████████████▍| 221/224 [02:13<00:01,  1.66it/s]
Epoch 11 Iter 222: loss 0.22039. :  99%|██████████████████████████████████████████▍| 221/224 [02:14<00:01,  1.66it/s]
Epoch 11 Iter 222: loss 0.22039. :  99%|██████████████████████████████████████████▌| 222/224 [02:14<00:01,  1.55it/s]
Epoch 11 Iter 223: loss 0.21946. :  99%|██████████████████████████████████████████▌| 222/224 [02:15<00:01,  1.55it/s]
Epoch 11 Iter 223: loss 0.21946. : 100%|██████████████████████████████████████████▊| 223/224 [02:15<00:00,  1.60it/s]
Epoch 11 Iter 224: loss 0.23823. : 100%|██████████████████████████████████████████▊| 223/224 [02:15<00:00,  1.60it/s]
Epoch 11 Iter 224: loss 0.23823. : 100%|███████████████████████████████████████████| 224/224 [02:15<00:00,  1.66it/s]
Epoch 11 Iter 224: loss 0.23823. : 100%|███████████████████████████████████████████| 224/224 [02:15<00:00,  1.65it/s]

    Train loss: 0.23534
    Valid loss: 0.2376
       Valid loss recons: 0.22727
       Valid loss KL-D:   1.03259
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.22104. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.22104. :   0%|▏                                              | 1/224 [00:00<02:02,  1.82it/s]
Epoch 12 Iter 2: loss 0.22917. :   0%|▏                                              | 1/224 [00:01<02:02,  1.82it/s]
Epoch 12 Iter 2: loss 0.22917. :   1%|▍                                              | 2/224 [00:01<02:32,  1.45it/s]
Epoch 12 Iter 3: loss 0.24649. :   1%|▍                                              | 2/224 [00:02<02:32,  1.45it/s]
Epoch 12 Iter 3: loss 0.24649. :   1%|▋                                              | 3/224 [00:02<02:41,  1.37it/s]
Epoch 12 Iter 4: loss 0.25305. :   1%|▋                                              | 3/224 [00:02<02:41,  1.37it/s]
Epoch 12 Iter 4: loss 0.25305. :   2%|▊                                              | 4/224 [00:02<02:36,  1.40it/s]
Epoch 12 Iter 5: loss 0.22632. :   2%|▊                                              | 4/224 [00:03<02:36,  1.40it/s]
Epoch 12 Iter 5: loss 0.22632. :   2%|█                                              | 5/224 [00:03<02:22,  1.54it/s]
Epoch 12 Iter 6: loss 0.22735. :   2%|█                                              | 5/224 [00:03<02:22,  1.54it/s]
Epoch 12 Iter 6: loss 0.22735. :   3%|█▎                                             | 6/224 [00:03<02:14,  1.63it/s]
Epoch 12 Iter 7: loss 0.21072. :   3%|█▎                                             | 6/224 [00:04<02:14,  1.63it/s]
Epoch 12 Iter 7: loss 0.21072. :   3%|█▍                                             | 7/224 [00:04<02:25,  1.49it/s]
Epoch 12 Iter 8: loss 0.22611. :   3%|█▍                                             | 7/224 [00:05<02:25,  1.49it/s]
Epoch 12 Iter 8: loss 0.22611. :   4%|█▋                                             | 8/224 [00:05<02:33,  1.41it/s]
Epoch 12 Iter 9: loss 0.22793. :   4%|█▋                                             | 8/224 [00:06<02:33,  1.41it/s]
Epoch 12 Iter 9: loss 0.22793. :   4%|█▉                                             | 9/224 [00:06<02:37,  1.37it/s]
Epoch 12 Iter 10: loss 0.24809. :   4%|█▊                                            | 9/224 [00:07<02:37,  1.37it/s]
Epoch 12 Iter 10: loss 0.24809. :   4%|██                                           | 10/224 [00:07<02:40,  1.34it/s]
Epoch 12 Iter 11: loss 0.22240. :   4%|██                                           | 10/224 [00:07<02:40,  1.34it/s]
Epoch 12 Iter 11: loss 0.22240. :   5%|██▏                                          | 11/224 [00:07<02:41,  1.32it/s]
Epoch 12 Iter 12: loss 0.25061. :   5%|██▏                                          | 11/224 [00:08<02:41,  1.32it/s]
Epoch 12 Iter 12: loss 0.25061. :   5%|██▍                                          | 12/224 [00:08<02:42,  1.30it/s]
Epoch 12 Iter 13: loss 0.24380. :   5%|██▍                                          | 12/224 [00:09<02:42,  1.30it/s]
Epoch 12 Iter 13: loss 0.24380. :   6%|██▌                                          | 13/224 [00:09<02:42,  1.30it/s]
Epoch 12 Iter 14: loss 0.24803. :   6%|██▌                                          | 13/224 [00:10<02:42,  1.30it/s]
Epoch 12 Iter 14: loss 0.24803. :   6%|██▊                                          | 14/224 [00:10<02:42,  1.29it/s]
Epoch 12 Iter 15: loss 0.24423. :   6%|██▊                                          | 14/224 [00:10<02:42,  1.29it/s]
Epoch 12 Iter 15: loss 0.24423. :   7%|███                                          | 15/224 [00:10<02:36,  1.34it/s]
Epoch 12 Iter 16: loss 0.22153. :   7%|███                                          | 15/224 [00:11<02:36,  1.34it/s]
Epoch 12 Iter 16: loss 0.22153. :   7%|███▏                                         | 16/224 [00:11<02:26,  1.42it/s]
Epoch 12 Iter 17: loss 0.25114. :   7%|███▏                                         | 16/224 [00:12<02:26,  1.42it/s]
Epoch 12 Iter 17: loss 0.25114. :   8%|███▍                                         | 17/224 [00:12<02:29,  1.38it/s]
Epoch 12 Iter 18: loss 0.23425. :   8%|███▍                                         | 17/224 [00:12<02:29,  1.38it/s]
Epoch 12 Iter 18: loss 0.23425. :   8%|███▌                                         | 18/224 [00:12<02:21,  1.46it/s]
Epoch 12 Iter 19: loss 0.25929. :   8%|███▌                                         | 18/224 [00:13<02:21,  1.46it/s]
Epoch 12 Iter 19: loss 0.25929. :   8%|███▊                                         | 19/224 [00:13<02:15,  1.51it/s]
Epoch 12 Iter 20: loss 0.21945. :   8%|███▊                                         | 19/224 [00:13<02:15,  1.51it/s]
Epoch 12 Iter 20: loss 0.21945. :   9%|████                                         | 20/224 [00:13<02:07,  1.60it/s]
Epoch 12 Iter 21: loss 0.24070. :   9%|████                                         | 20/224 [00:14<02:07,  1.60it/s]
Epoch 12 Iter 21: loss 0.24070. :   9%|████▏                                        | 21/224 [00:14<02:01,  1.67it/s]
Epoch 12 Iter 22: loss 0.25392. :   9%|████▏                                        | 21/224 [00:15<02:01,  1.67it/s]
Epoch 12 Iter 22: loss 0.25392. :  10%|████▍                                        | 22/224 [00:15<02:05,  1.61it/s]
Epoch 12 Iter 23: loss 0.22239. :  10%|████▍                                        | 22/224 [00:15<02:05,  1.61it/s]
Epoch 12 Iter 23: loss 0.22239. :  10%|████▌                                        | 23/224 [00:15<02:00,  1.67it/s]
Epoch 12 Iter 24: loss 0.23034. :  10%|████▌                                        | 23/224 [00:16<02:00,  1.67it/s]
Epoch 12 Iter 24: loss 0.23034. :  11%|████▊                                        | 24/224 [00:16<01:55,  1.72it/s]
Epoch 12 Iter 25: loss 0.22488. :  11%|████▊                                        | 24/224 [00:16<01:55,  1.72it/s]
Epoch 12 Iter 25: loss 0.22488. :  11%|█████                                        | 25/224 [00:16<02:01,  1.64it/s]
Epoch 12 Iter 26: loss 0.23240. :  11%|█████                                        | 25/224 [00:17<02:01,  1.64it/s]
Epoch 12 Iter 26: loss 0.23240. :  12%|█████▏                                       | 26/224 [00:17<02:03,  1.60it/s]
Epoch 12 Iter 27: loss 0.23239. :  12%|█████▏                                       | 26/224 [00:18<02:03,  1.60it/s]
Epoch 12 Iter 27: loss 0.23239. :  12%|█████▍                                       | 27/224 [00:18<01:58,  1.66it/s]
Epoch 12 Iter 28: loss 0.20804. :  12%|█████▍                                       | 27/224 [00:18<01:58,  1.66it/s]
Epoch 12 Iter 28: loss 0.20804. :  12%|█████▋                                       | 28/224 [00:18<02:03,  1.59it/s]
Epoch 12 Iter 29: loss 0.21727. :  12%|█████▋                                       | 28/224 [00:19<02:03,  1.59it/s]
Epoch 12 Iter 29: loss 0.21727. :  13%|█████▊                                       | 29/224 [00:19<02:10,  1.49it/s]
Epoch 12 Iter 30: loss 0.24534. :  13%|█████▊                                       | 29/224 [00:20<02:10,  1.49it/s]
Epoch 12 Iter 30: loss 0.24534. :  13%|██████                                       | 30/224 [00:20<02:15,  1.43it/s]
Epoch 12 Iter 31: loss 0.25356. :  13%|██████                                       | 30/224 [00:21<02:15,  1.43it/s]
Epoch 12 Iter 31: loss 0.25356. :  14%|██████▏                                      | 31/224 [00:21<02:13,  1.45it/s]
Epoch 12 Iter 32: loss 0.22995. :  14%|██████▏                                      | 31/224 [00:21<02:13,  1.45it/s]
Epoch 12 Iter 32: loss 0.22995. :  14%|██████▍                                      | 32/224 [00:21<02:10,  1.47it/s]
Epoch 12 Iter 33: loss 0.23024. :  14%|██████▍                                      | 32/224 [00:22<02:10,  1.47it/s]
Epoch 12 Iter 33: loss 0.23024. :  15%|██████▋                                      | 33/224 [00:22<02:06,  1.51it/s]
Epoch 12 Iter 34: loss 0.23774. :  15%|██████▋                                      | 33/224 [00:23<02:06,  1.51it/s]
Epoch 12 Iter 34: loss 0.23774. :  15%|██████▊                                      | 34/224 [00:23<02:10,  1.46it/s]
Epoch 12 Iter 35: loss 0.26482. :  15%|██████▊                                      | 34/224 [00:23<02:10,  1.46it/s]
Epoch 12 Iter 35: loss 0.26482. :  16%|███████                                      | 35/224 [00:23<02:01,  1.56it/s]
Epoch 12 Iter 36: loss 0.25988. :  16%|███████                                      | 35/224 [00:24<02:01,  1.56it/s]
Epoch 12 Iter 36: loss 0.25988. :  16%|███████▏                                     | 36/224 [00:24<01:58,  1.59it/s]
Epoch 12 Iter 37: loss 0.23695. :  16%|███████▏                                     | 36/224 [00:24<01:58,  1.59it/s]
Epoch 12 Iter 37: loss 0.23695. :  17%|███████▍                                     | 37/224 [00:24<01:58,  1.57it/s]
Epoch 12 Iter 38: loss 0.22714. :  17%|███████▍                                     | 37/224 [00:25<01:58,  1.57it/s]
Epoch 12 Iter 38: loss 0.22714. :  17%|███████▋                                     | 38/224 [00:25<02:05,  1.48it/s]
Epoch 12 Iter 39: loss 0.22490. :  17%|███████▋                                     | 38/224 [00:26<02:05,  1.48it/s]
Epoch 12 Iter 39: loss 0.22490. :  17%|███████▊                                     | 39/224 [00:26<02:07,  1.46it/s]
Epoch 12 Iter 40: loss 0.25231. :  17%|███████▊                                     | 39/224 [00:27<02:07,  1.46it/s]
Epoch 12 Iter 40: loss 0.25231. :  18%|████████                                     | 40/224 [00:27<02:10,  1.41it/s]
Epoch 12 Iter 41: loss 0.26203. :  18%|████████                                     | 40/224 [00:27<02:10,  1.41it/s]
Epoch 12 Iter 41: loss 0.26203. :  18%|████████▏                                    | 41/224 [00:27<02:12,  1.38it/s]
Epoch 12 Iter 42: loss 0.23751. :  18%|████████▏                                    | 41/224 [00:28<02:12,  1.38it/s]
Epoch 12 Iter 42: loss 0.23751. :  19%|████████▍                                    | 42/224 [00:28<02:14,  1.36it/s]
Epoch 12 Iter 43: loss 0.24238. :  19%|████████▍                                    | 42/224 [00:29<02:14,  1.36it/s]
Epoch 12 Iter 43: loss 0.24238. :  19%|████████▋                                    | 43/224 [00:29<02:14,  1.34it/s]
Epoch 12 Iter 44: loss 0.23282. :  19%|████████▋                                    | 43/224 [00:29<02:14,  1.34it/s]
Epoch 12 Iter 44: loss 0.23282. :  20%|████████▊                                    | 44/224 [00:29<02:04,  1.44it/s]
Epoch 12 Iter 45: loss 0.22192. :  20%|████████▊                                    | 44/224 [00:30<02:04,  1.44it/s]
Epoch 12 Iter 45: loss 0.22192. :  20%|█████████                                    | 45/224 [00:30<02:08,  1.39it/s]
Epoch 12 Iter 46: loss 0.23660. :  20%|█████████                                    | 45/224 [00:31<02:08,  1.39it/s]
Epoch 12 Iter 46: loss 0.23660. :  21%|█████████▏                                   | 46/224 [00:31<02:10,  1.37it/s]
Epoch 12 Iter 47: loss 0.25497. :  21%|█████████▏                                   | 46/224 [00:32<02:10,  1.37it/s]
Epoch 12 Iter 47: loss 0.25497. :  21%|█████████▍                                   | 47/224 [00:32<02:11,  1.35it/s]
Epoch 12 Iter 48: loss 0.24470. :  21%|█████████▍                                   | 47/224 [00:33<02:11,  1.35it/s]
Epoch 12 Iter 48: loss 0.24470. :  21%|█████████▋                                   | 48/224 [00:33<02:11,  1.34it/s]
Epoch 12 Iter 49: loss 0.25707. :  21%|█████████▋                                   | 48/224 [00:33<02:11,  1.34it/s]
Epoch 12 Iter 49: loss 0.25707. :  22%|█████████▊                                   | 49/224 [00:33<02:11,  1.33it/s]
Epoch 12 Iter 50: loss 0.22092. :  22%|█████████▊                                   | 49/224 [00:34<02:11,  1.33it/s]
Epoch 12 Iter 50: loss 0.22092. :  22%|██████████                                   | 50/224 [00:34<02:10,  1.34it/s]
Epoch 12 Iter 51: loss 0.22384. :  22%|██████████                                   | 50/224 [00:35<02:10,  1.34it/s]
Epoch 12 Iter 51: loss 0.22384. :  23%|██████████▏                                  | 51/224 [00:35<01:59,  1.44it/s]
Epoch 12 Iter 52: loss 0.24434. :  23%|██████████▏                                  | 51/224 [00:35<01:59,  1.44it/s]
Epoch 12 Iter 52: loss 0.24434. :  23%|██████████▍                                  | 52/224 [00:35<02:03,  1.39it/s]
Epoch 12 Iter 53: loss 0.22061. :  23%|██████████▍                                  | 52/224 [00:36<02:03,  1.39it/s]
Epoch 12 Iter 53: loss 0.22061. :  24%|██████████▋                                  | 53/224 [00:36<02:02,  1.40it/s]
Epoch 12 Iter 54: loss 0.24984. :  24%|██████████▋                                  | 53/224 [00:37<02:02,  1.40it/s]
Epoch 12 Iter 54: loss 0.24984. :  24%|██████████▊                                  | 54/224 [00:37<02:00,  1.41it/s]
Epoch 12 Iter 55: loss 0.23783. :  24%|██████████▊                                  | 54/224 [00:37<02:00,  1.41it/s]
Epoch 12 Iter 55: loss 0.23783. :  25%|███████████                                  | 55/224 [00:37<01:57,  1.44it/s]
Epoch 12 Iter 56: loss 0.23364. :  25%|███████████                                  | 55/224 [00:38<01:57,  1.44it/s]
Epoch 12 Iter 56: loss 0.23364. :  25%|███████████▎                                 | 56/224 [00:38<01:48,  1.55it/s]
Epoch 12 Iter 57: loss 0.21649. :  25%|███████████▎                                 | 56/224 [00:38<01:48,  1.55it/s]
Epoch 12 Iter 57: loss 0.21649. :  25%|███████████▍                                 | 57/224 [00:38<01:41,  1.65it/s]
Epoch 12 Iter 58: loss 0.23231. :  25%|███████████▍                                 | 57/224 [00:39<01:41,  1.65it/s]
Epoch 12 Iter 58: loss 0.23231. :  26%|███████████▋                                 | 58/224 [00:39<01:35,  1.73it/s]
Epoch 12 Iter 59: loss 0.23926. :  26%|███████████▋                                 | 58/224 [00:40<01:35,  1.73it/s]
Epoch 12 Iter 59: loss 0.23926. :  26%|███████████▊                                 | 59/224 [00:40<01:34,  1.75it/s]
Epoch 12 Iter 60: loss 0.23444. :  26%|███████████▊                                 | 59/224 [00:40<01:34,  1.75it/s]
Epoch 12 Iter 60: loss 0.23444. :  27%|████████████                                 | 60/224 [00:40<01:30,  1.81it/s]
Epoch 12 Iter 61: loss 0.23810. :  27%|████████████                                 | 60/224 [00:41<01:30,  1.81it/s]
Epoch 12 Iter 61: loss 0.23810. :  27%|████████████▎                                | 61/224 [00:41<01:27,  1.86it/s]
Epoch 12 Iter 62: loss 0.23679. :  27%|████████████▎                                | 61/224 [00:41<01:27,  1.86it/s]
Epoch 12 Iter 62: loss 0.23679. :  28%|████████████▍                                | 62/224 [00:41<01:24,  1.91it/s]
Epoch 12 Iter 63: loss 0.22358. :  28%|████████████▍                                | 62/224 [00:42<01:24,  1.91it/s]
Epoch 12 Iter 63: loss 0.22358. :  28%|████████████▋                                | 63/224 [00:42<01:23,  1.94it/s]
Epoch 12 Iter 64: loss 0.22790. :  28%|████████████▋                                | 63/224 [00:42<01:23,  1.94it/s]
Epoch 12 Iter 64: loss 0.22790. :  29%|████████████▊                                | 64/224 [00:42<01:21,  1.97it/s]
Epoch 12 Iter 65: loss 0.24209. :  29%|████████████▊                                | 64/224 [00:43<01:21,  1.97it/s]
Epoch 12 Iter 65: loss 0.24209. :  29%|█████████████                                | 65/224 [00:43<01:19,  1.99it/s]
Epoch 12 Iter 66: loss 0.23597. :  29%|█████████████                                | 65/224 [00:43<01:19,  1.99it/s]
Epoch 12 Iter 66: loss 0.23597. :  29%|█████████████▎                               | 66/224 [00:43<01:20,  1.97it/s]
Epoch 12 Iter 67: loss 0.23648. :  29%|█████████████▎                               | 66/224 [00:44<01:20,  1.97it/s]
Epoch 12 Iter 67: loss 0.23648. :  30%|█████████████▍                               | 67/224 [00:44<01:20,  1.96it/s]
Epoch 12 Iter 68: loss 0.24528. :  30%|█████████████▍                               | 67/224 [00:44<01:20,  1.96it/s]
Epoch 12 Iter 68: loss 0.24528. :  30%|█████████████▋                               | 68/224 [00:44<01:19,  1.97it/s]
Epoch 12 Iter 69: loss 0.22538. :  30%|█████████████▋                               | 68/224 [00:45<01:19,  1.97it/s]
Epoch 12 Iter 69: loss 0.22538. :  31%|█████████████▊                               | 69/224 [00:45<01:18,  1.97it/s]
Epoch 12 Iter 70: loss 0.22782. :  31%|█████████████▊                               | 69/224 [00:45<01:18,  1.97it/s]
Epoch 12 Iter 70: loss 0.22782. :  31%|██████████████                               | 70/224 [00:45<01:17,  1.98it/s]
Epoch 12 Iter 71: loss 0.25529. :  31%|██████████████                               | 70/224 [00:46<01:17,  1.98it/s]
Epoch 12 Iter 71: loss 0.25529. :  32%|██████████████▎                              | 71/224 [00:46<01:17,  1.98it/s]
Epoch 12 Iter 72: loss 0.22768. :  32%|██████████████▎                              | 71/224 [00:46<01:17,  1.98it/s]
Epoch 12 Iter 72: loss 0.22768. :  32%|██████████████▍                              | 72/224 [00:46<01:16,  1.99it/s]
Epoch 12 Iter 73: loss 0.23188. :  32%|██████████████▍                              | 72/224 [00:47<01:16,  1.99it/s]
Epoch 12 Iter 73: loss 0.23188. :  33%|██████████████▋                              | 73/224 [00:47<01:15,  2.00it/s]
Epoch 12 Iter 74: loss 0.24323. :  33%|██████████████▋                              | 73/224 [00:47<01:15,  2.00it/s]
Epoch 12 Iter 74: loss 0.24323. :  33%|██████████████▊                              | 74/224 [00:47<01:16,  1.96it/s]
Epoch 12 Iter 75: loss 0.22658. :  33%|██████████████▊                              | 74/224 [00:48<01:16,  1.96it/s]
Epoch 12 Iter 75: loss 0.22658. :  33%|███████████████                              | 75/224 [00:48<01:22,  1.80it/s]
Epoch 12 Iter 76: loss 0.21838. :  33%|███████████████                              | 75/224 [00:48<01:22,  1.80it/s]
Epoch 12 Iter 76: loss 0.21838. :  34%|███████████████▎                             | 76/224 [00:48<01:21,  1.82it/s]
Epoch 12 Iter 77: loss 0.26075. :  34%|███████████████▎                             | 76/224 [00:49<01:21,  1.82it/s]
Epoch 12 Iter 77: loss 0.26075. :  34%|███████████████▍                             | 77/224 [00:49<01:18,  1.87it/s]
Epoch 12 Iter 78: loss 0.24535. :  34%|███████████████▍                             | 77/224 [00:49<01:18,  1.87it/s]
Epoch 12 Iter 78: loss 0.24535. :  35%|███████████████▋                             | 78/224 [00:49<01:16,  1.91it/s]
Epoch 12 Iter 79: loss 0.25898. :  35%|███████████████▋                             | 78/224 [00:50<01:16,  1.91it/s]
Epoch 12 Iter 79: loss 0.25898. :  35%|███████████████▊                             | 79/224 [00:50<01:14,  1.94it/s]
Epoch 12 Iter 80: loss 0.24048. :  35%|███████████████▊                             | 79/224 [00:50<01:14,  1.94it/s]
Epoch 12 Iter 80: loss 0.24048. :  36%|████████████████                             | 80/224 [00:50<01:13,  1.97it/s]
Epoch 12 Iter 81: loss 0.22286. :  36%|████████████████                             | 80/224 [00:51<01:13,  1.97it/s]
Epoch 12 Iter 81: loss 0.22286. :  36%|████████████████▎                            | 81/224 [00:51<01:12,  1.97it/s]
Epoch 12 Iter 82: loss 0.24111. :  36%|████████████████▎                            | 81/224 [00:51<01:12,  1.97it/s]
Epoch 12 Iter 82: loss 0.24111. :  37%|████████████████▍                            | 82/224 [00:51<01:14,  1.92it/s]
Epoch 12 Iter 83: loss 0.22778. :  37%|████████████████▍                            | 82/224 [00:52<01:14,  1.92it/s]
Epoch 12 Iter 83: loss 0.22778. :  37%|████████████████▋                            | 83/224 [00:52<01:12,  1.93it/s]
Epoch 12 Iter 84: loss 0.23028. :  37%|████████████████▋                            | 83/224 [00:52<01:12,  1.93it/s]
Epoch 12 Iter 84: loss 0.23028. :  38%|████████████████▉                            | 84/224 [00:52<01:11,  1.96it/s]
Epoch 12 Iter 85: loss 0.22289. :  38%|████████████████▉                            | 84/224 [00:53<01:11,  1.96it/s]
Epoch 12 Iter 85: loss 0.22289. :  38%|█████████████████                            | 85/224 [00:53<01:11,  1.94it/s]
Epoch 12 Iter 86: loss 0.23054. :  38%|█████████████████                            | 85/224 [00:53<01:11,  1.94it/s]
Epoch 12 Iter 86: loss 0.23054. :  38%|█████████████████▎                           | 86/224 [00:53<01:12,  1.91it/s]
Epoch 12 Iter 87: loss 0.22087. :  38%|█████████████████▎                           | 86/224 [00:54<01:12,  1.91it/s]
Epoch 12 Iter 87: loss 0.22087. :  39%|█████████████████▍                           | 87/224 [00:54<01:10,  1.93it/s]
Epoch 12 Iter 88: loss 0.24281. :  39%|█████████████████▍                           | 87/224 [00:54<01:10,  1.93it/s]
Epoch 12 Iter 88: loss 0.24281. :  39%|█████████████████▋                           | 88/224 [00:54<01:10,  1.94it/s]
Epoch 12 Iter 89: loss 0.22210. :  39%|█████████████████▋                           | 88/224 [00:55<01:10,  1.94it/s]
Epoch 12 Iter 89: loss 0.22210. :  40%|█████████████████▉                           | 89/224 [00:55<01:09,  1.95it/s]
Epoch 12 Iter 90: loss 0.23727. :  40%|█████████████████▉                           | 89/224 [00:55<01:09,  1.95it/s]
Epoch 12 Iter 90: loss 0.23727. :  40%|██████████████████                           | 90/224 [00:55<01:08,  1.97it/s]
Epoch 12 Iter 91: loss 0.24917. :  40%|██████████████████                           | 90/224 [00:56<01:08,  1.97it/s]
Epoch 12 Iter 91: loss 0.24917. :  41%|██████████████████▎                          | 91/224 [00:56<01:07,  1.97it/s]
Epoch 12 Iter 92: loss 0.24663. :  41%|██████████████████▎                          | 91/224 [00:56<01:07,  1.97it/s]
Epoch 12 Iter 92: loss 0.24663. :  41%|██████████████████▍                          | 92/224 [00:56<01:06,  1.97it/s]
Epoch 12 Iter 93: loss 0.23405. :  41%|██████████████████▍                          | 92/224 [00:57<01:06,  1.97it/s]
Epoch 12 Iter 93: loss 0.23405. :  42%|██████████████████▋                          | 93/224 [00:57<01:06,  1.97it/s]
Epoch 12 Iter 94: loss 0.25915. :  42%|██████████████████▋                          | 93/224 [00:57<01:06,  1.97it/s]
Epoch 12 Iter 94: loss 0.25915. :  42%|██████████████████▉                          | 94/224 [00:57<01:05,  1.98it/s]
Epoch 12 Iter 95: loss 0.25051. :  42%|██████████████████▉                          | 94/224 [00:58<01:05,  1.98it/s]
Epoch 12 Iter 95: loss 0.25051. :  42%|███████████████████                          | 95/224 [00:58<01:05,  1.97it/s]
Epoch 12 Iter 96: loss 0.24704. :  42%|███████████████████                          | 95/224 [00:58<01:05,  1.97it/s]
Epoch 12 Iter 96: loss 0.24704. :  43%|███████████████████▎                         | 96/224 [00:58<01:04,  1.97it/s]
Epoch 12 Iter 97: loss 0.21974. :  43%|███████████████████▎                         | 96/224 [00:59<01:04,  1.97it/s]
Epoch 12 Iter 97: loss 0.21974. :  43%|███████████████████▍                         | 97/224 [00:59<01:04,  1.96it/s]
Epoch 12 Iter 98: loss 0.23718. :  43%|███████████████████▍                         | 97/224 [00:59<01:04,  1.96it/s]
Epoch 12 Iter 98: loss 0.23718. :  44%|███████████████████▋                         | 98/224 [00:59<01:04,  1.97it/s]
Epoch 12 Iter 99: loss 0.23791. :  44%|███████████████████▋                         | 98/224 [01:00<01:04,  1.97it/s]
Epoch 12 Iter 99: loss 0.23791. :  44%|███████████████████▉                         | 99/224 [01:00<01:04,  1.95it/s]
Epoch 12 Iter 100: loss 0.23533. :  44%|███████████████████▍                        | 99/224 [01:01<01:04,  1.95it/s]
Epoch 12 Iter 100: loss 0.23533. :  45%|███████████████████▏                       | 100/224 [01:01<01:03,  1.96it/s]
Epoch 12 Iter 101: loss 0.22820. :  45%|███████████████████▏                       | 100/224 [01:01<01:03,  1.96it/s]
Epoch 12 Iter 101: loss 0.22820. :  45%|███████████████████▍                       | 101/224 [01:01<01:02,  1.97it/s]
Epoch 12 Iter 102: loss 0.24174. :  45%|███████████████████▍                       | 101/224 [01:02<01:02,  1.97it/s]
Epoch 12 Iter 102: loss 0.24174. :  46%|███████████████████▌                       | 102/224 [01:02<01:02,  1.95it/s]
Epoch 12 Iter 103: loss 0.22103. :  46%|███████████████████▌                       | 102/224 [01:02<01:02,  1.95it/s]
Epoch 12 Iter 103: loss 0.22103. :  46%|███████████████████▊                       | 103/224 [01:02<01:01,  1.96it/s]
Epoch 12 Iter 104: loss 0.24375. :  46%|███████████████████▊                       | 103/224 [01:03<01:01,  1.96it/s]
Epoch 12 Iter 104: loss 0.24375. :  46%|███████████████████▉                       | 104/224 [01:03<01:00,  1.97it/s]
Epoch 12 Iter 105: loss 0.22443. :  46%|███████████████████▉                       | 104/224 [01:03<01:00,  1.97it/s]
Epoch 12 Iter 105: loss 0.22443. :  47%|████████████████████▏                      | 105/224 [01:03<01:03,  1.87it/s]
Epoch 12 Iter 106: loss 0.21591. :  47%|████████████████████▏                      | 105/224 [01:04<01:03,  1.87it/s]
Epoch 12 Iter 106: loss 0.21591. :  47%|████████████████████▎                      | 106/224 [01:04<01:03,  1.87it/s]
Epoch 12 Iter 107: loss 0.22695. :  47%|████████████████████▎                      | 106/224 [01:04<01:03,  1.87it/s]
Epoch 12 Iter 107: loss 0.22695. :  48%|████████████████████▌                      | 107/224 [01:04<01:03,  1.84it/s]
Epoch 12 Iter 108: loss 0.23785. :  48%|████████████████████▌                      | 107/224 [01:05<01:03,  1.84it/s]
Epoch 12 Iter 108: loss 0.23785. :  48%|████████████████████▋                      | 108/224 [01:05<01:03,  1.83it/s]
Epoch 12 Iter 109: loss 0.21854. :  48%|████████████████████▋                      | 108/224 [01:05<01:03,  1.83it/s]
Epoch 12 Iter 109: loss 0.21854. :  49%|████████████████████▉                      | 109/224 [01:05<01:02,  1.83it/s]
Epoch 12 Iter 110: loss 0.22822. :  49%|████████████████████▉                      | 109/224 [01:06<01:02,  1.83it/s]
Epoch 12 Iter 110: loss 0.22822. :  49%|█████████████████████                      | 110/224 [01:06<01:02,  1.81it/s]
Epoch 12 Iter 111: loss 0.25755. :  49%|█████████████████████                      | 110/224 [01:06<01:02,  1.81it/s]
Epoch 12 Iter 111: loss 0.25755. :  50%|█████████████████████▎                     | 111/224 [01:06<01:02,  1.82it/s]
Epoch 12 Iter 112: loss 0.21898. :  50%|█████████████████████▎                     | 111/224 [01:07<01:02,  1.82it/s]
Epoch 12 Iter 112: loss 0.21898. :  50%|█████████████████████▌                     | 112/224 [01:07<01:01,  1.81it/s]
Epoch 12 Iter 113: loss 0.22262. :  50%|█████████████████████▌                     | 112/224 [01:08<01:01,  1.81it/s]
Epoch 12 Iter 113: loss 0.22262. :  50%|█████████████████████▋                     | 113/224 [01:08<01:01,  1.81it/s]
Epoch 12 Iter 114: loss 0.23588. :  50%|█████████████████████▋                     | 113/224 [01:08<01:01,  1.81it/s]
Epoch 12 Iter 114: loss 0.23588. :  51%|█████████████████████▉                     | 114/224 [01:08<00:59,  1.84it/s]
Epoch 12 Iter 115: loss 0.23284. :  51%|█████████████████████▉                     | 114/224 [01:09<00:59,  1.84it/s]
Epoch 12 Iter 115: loss 0.23284. :  51%|██████████████████████                     | 115/224 [01:09<00:59,  1.82it/s]
Epoch 12 Iter 116: loss 0.22900. :  51%|██████████████████████                     | 115/224 [01:09<00:59,  1.82it/s]
Epoch 12 Iter 116: loss 0.22900. :  52%|██████████████████████▎                    | 116/224 [01:09<01:02,  1.73it/s]
Epoch 12 Iter 117: loss 0.23105. :  52%|██████████████████████▎                    | 116/224 [01:10<01:02,  1.73it/s]
Epoch 12 Iter 117: loss 0.23105. :  52%|██████████████████████▍                    | 117/224 [01:10<01:00,  1.78it/s]
Epoch 12 Iter 118: loss 0.21064. :  52%|██████████████████████▍                    | 117/224 [01:10<01:00,  1.78it/s]
Epoch 12 Iter 118: loss 0.21064. :  53%|██████████████████████▋                    | 118/224 [01:10<00:58,  1.81it/s]
Epoch 12 Iter 119: loss 0.22022. :  53%|██████████████████████▋                    | 118/224 [01:11<00:58,  1.81it/s]
Epoch 12 Iter 119: loss 0.22022. :  53%|██████████████████████▊                    | 119/224 [01:11<00:59,  1.77it/s]
Epoch 12 Iter 120: loss 0.24309. :  53%|██████████████████████▊                    | 119/224 [01:12<00:59,  1.77it/s]
Epoch 12 Iter 120: loss 0.24309. :  54%|███████████████████████                    | 120/224 [01:12<01:05,  1.59it/s]
Epoch 12 Iter 121: loss 0.22290. :  54%|███████████████████████                    | 120/224 [01:13<01:05,  1.59it/s]
Epoch 12 Iter 121: loss 0.22290. :  54%|███████████████████████▏                   | 121/224 [01:13<01:09,  1.48it/s]
Epoch 12 Iter 122: loss 0.26090. :  54%|███████████████████████▏                   | 121/224 [01:13<01:09,  1.48it/s]
Epoch 12 Iter 122: loss 0.26090. :  54%|███████████████████████▍                   | 122/224 [01:13<01:06,  1.54it/s]
Epoch 12 Iter 123: loss 0.25293. :  54%|███████████████████████▍                   | 122/224 [01:14<01:06,  1.54it/s]
Epoch 12 Iter 123: loss 0.25293. :  55%|███████████████████████▌                   | 123/224 [01:14<01:09,  1.45it/s]
Epoch 12 Iter 124: loss 0.22813. :  55%|███████████████████████▌                   | 123/224 [01:14<01:09,  1.45it/s]
Epoch 12 Iter 124: loss 0.22813. :  55%|███████████████████████▊                   | 124/224 [01:14<01:04,  1.55it/s]
Epoch 12 Iter 125: loss 0.24223. :  55%|███████████████████████▊                   | 124/224 [01:15<01:04,  1.55it/s]
Epoch 12 Iter 125: loss 0.24223. :  56%|███████████████████████▉                   | 125/224 [01:15<01:03,  1.55it/s]
Epoch 12 Iter 126: loss 0.22562. :  56%|███████████████████████▉                   | 125/224 [01:16<01:03,  1.55it/s]
Epoch 12 Iter 126: loss 0.22562. :  56%|████████████████████████▏                  | 126/224 [01:16<00:59,  1.64it/s]
Epoch 12 Iter 127: loss 0.25189. :  56%|████████████████████████▏                  | 126/224 [01:16<00:59,  1.64it/s]
Epoch 12 Iter 127: loss 0.25189. :  57%|████████████████████████▍                  | 127/224 [01:16<00:59,  1.64it/s]
Epoch 12 Iter 128: loss 0.23811. :  57%|████████████████████████▍                  | 127/224 [01:17<00:59,  1.64it/s]
Epoch 12 Iter 128: loss 0.23811. :  57%|████████████████████████▌                  | 128/224 [01:17<00:59,  1.61it/s]
Epoch 12 Iter 129: loss 0.23036. :  57%|████████████████████████▌                  | 128/224 [01:17<00:59,  1.61it/s]
Epoch 12 Iter 129: loss 0.23036. :  58%|████████████████████████▊                  | 129/224 [01:17<00:56,  1.68it/s]
Epoch 12 Iter 130: loss 0.23251. :  58%|████████████████████████▊                  | 129/224 [01:18<00:56,  1.68it/s]
Epoch 12 Iter 130: loss 0.23251. :  58%|████████████████████████▉                  | 130/224 [01:18<01:00,  1.56it/s]
Epoch 12 Iter 131: loss 0.22088. :  58%|████████████████████████▉                  | 130/224 [01:19<01:00,  1.56it/s]
Epoch 12 Iter 131: loss 0.22088. :  58%|█████████████████████████▏                 | 131/224 [01:19<01:03,  1.47it/s]
Epoch 12 Iter 132: loss 0.22237. :  58%|█████████████████████████▏                 | 131/224 [01:20<01:03,  1.47it/s]
Epoch 12 Iter 132: loss 0.22237. :  59%|█████████████████████████▎                 | 132/224 [01:20<01:05,  1.41it/s]
Epoch 12 Iter 133: loss 0.27368. :  59%|█████████████████████████▎                 | 132/224 [01:20<01:05,  1.41it/s]
Epoch 12 Iter 133: loss 0.27368. :  59%|█████████████████████████▌                 | 133/224 [01:20<01:05,  1.38it/s]
Epoch 12 Iter 134: loss 0.26054. :  59%|█████████████████████████▌                 | 133/224 [01:21<01:05,  1.38it/s]
Epoch 12 Iter 134: loss 0.26054. :  60%|█████████████████████████▋                 | 134/224 [01:21<01:06,  1.36it/s]
Epoch 12 Iter 135: loss 0.26322. :  60%|█████████████████████████▋                 | 134/224 [01:22<01:06,  1.36it/s]
Epoch 12 Iter 135: loss 0.26322. :  60%|█████████████████████████▉                 | 135/224 [01:22<01:05,  1.36it/s]
Epoch 12 Iter 136: loss 0.22744. :  60%|█████████████████████████▉                 | 135/224 [01:22<01:05,  1.36it/s]
Epoch 12 Iter 136: loss 0.22744. :  61%|██████████████████████████                 | 136/224 [01:22<00:59,  1.48it/s]
Epoch 12 Iter 137: loss 0.23525. :  61%|██████████████████████████                 | 136/224 [01:23<00:59,  1.48it/s]
Epoch 12 Iter 137: loss 0.23525. :  61%|██████████████████████████▎                | 137/224 [01:23<00:55,  1.58it/s]
Epoch 12 Iter 138: loss 0.23961. :  61%|██████████████████████████▎                | 137/224 [01:24<00:55,  1.58it/s]
Epoch 12 Iter 138: loss 0.23961. :  62%|██████████████████████████▍                | 138/224 [01:24<00:52,  1.63it/s]
Epoch 12 Iter 139: loss 0.24215. :  62%|██████████████████████████▍                | 138/224 [01:24<00:52,  1.63it/s]
Epoch 12 Iter 139: loss 0.24215. :  62%|██████████████████████████▋                | 139/224 [01:24<00:56,  1.51it/s]
Epoch 12 Iter 140: loss 0.23553. :  62%|██████████████████████████▋                | 139/224 [01:25<00:56,  1.51it/s]
Epoch 12 Iter 140: loss 0.23553. :  62%|██████████████████████████▉                | 140/224 [01:25<00:58,  1.44it/s]
Epoch 12 Iter 141: loss 0.22594. :  62%|██████████████████████████▉                | 140/224 [01:26<00:58,  1.44it/s]
Epoch 12 Iter 141: loss 0.22594. :  63%|███████████████████████████                | 141/224 [01:26<00:57,  1.44it/s]
Epoch 12 Iter 142: loss 0.23960. :  63%|███████████████████████████                | 141/224 [01:26<00:57,  1.44it/s]
Epoch 12 Iter 142: loss 0.23960. :  63%|███████████████████████████▎               | 142/224 [01:26<00:52,  1.55it/s]
Epoch 12 Iter 143: loss 0.22810. :  63%|███████████████████████████▎               | 142/224 [01:27<00:52,  1.55it/s]
Epoch 12 Iter 143: loss 0.22810. :  64%|███████████████████████████▍               | 143/224 [01:27<00:51,  1.58it/s]
Epoch 12 Iter 144: loss 0.22794. :  64%|███████████████████████████▍               | 143/224 [01:27<00:51,  1.58it/s]
Epoch 12 Iter 144: loss 0.22794. :  64%|███████████████████████████▋               | 144/224 [01:27<00:48,  1.65it/s]
Epoch 12 Iter 145: loss 0.24270. :  64%|███████████████████████████▋               | 144/224 [01:28<00:48,  1.65it/s]
Epoch 12 Iter 145: loss 0.24270. :  65%|███████████████████████████▊               | 145/224 [01:28<00:51,  1.54it/s]
Epoch 12 Iter 146: loss 0.22157. :  65%|███████████████████████████▊               | 145/224 [01:29<00:51,  1.54it/s]
Epoch 12 Iter 146: loss 0.22157. :  65%|████████████████████████████               | 146/224 [01:29<00:48,  1.62it/s]
Epoch 12 Iter 147: loss 0.24042. :  65%|████████████████████████████               | 146/224 [01:29<00:48,  1.62it/s]
Epoch 12 Iter 147: loss 0.24042. :  66%|████████████████████████████▏              | 147/224 [01:29<00:49,  1.57it/s]
Epoch 12 Iter 148: loss 0.23182. :  66%|████████████████████████████▏              | 147/224 [01:30<00:49,  1.57it/s]
Epoch 12 Iter 148: loss 0.23182. :  66%|████████████████████████████▍              | 148/224 [01:30<00:47,  1.60it/s]
Epoch 12 Iter 149: loss 0.23878. :  66%|████████████████████████████▍              | 148/224 [01:31<00:47,  1.60it/s]
Epoch 12 Iter 149: loss 0.23878. :  67%|████████████████████████████▌              | 149/224 [01:31<00:46,  1.61it/s]
Epoch 12 Iter 150: loss 0.22710. :  67%|████████████████████████████▌              | 149/224 [01:31<00:46,  1.61it/s]
Epoch 12 Iter 150: loss 0.22710. :  67%|████████████████████████████▊              | 150/224 [01:31<00:46,  1.59it/s]
Epoch 12 Iter 151: loss 0.21733. :  67%|████████████████████████████▊              | 150/224 [01:32<00:46,  1.59it/s]
Epoch 12 Iter 151: loss 0.21733. :  67%|████████████████████████████▉              | 151/224 [01:32<00:45,  1.60it/s]
Epoch 12 Iter 152: loss 0.23492. :  67%|████████████████████████████▉              | 151/224 [01:33<00:45,  1.60it/s]
Epoch 12 Iter 152: loss 0.23492. :  68%|█████████████████████████████▏             | 152/224 [01:33<00:43,  1.64it/s]
Epoch 12 Iter 153: loss 0.23009. :  68%|█████████████████████████████▏             | 152/224 [01:33<00:43,  1.64it/s]
Epoch 12 Iter 153: loss 0.23009. :  68%|█████████████████████████████▎             | 153/224 [01:33<00:43,  1.62it/s]
Epoch 12 Iter 154: loss 0.24291. :  68%|█████████████████████████████▎             | 153/224 [01:34<00:43,  1.62it/s]
Epoch 12 Iter 154: loss 0.24291. :  69%|█████████████████████████████▌             | 154/224 [01:34<00:42,  1.64it/s]
Epoch 12 Iter 155: loss 0.24619. :  69%|█████████████████████████████▌             | 154/224 [01:34<00:42,  1.64it/s]
Epoch 12 Iter 155: loss 0.24619. :  69%|█████████████████████████████▊             | 155/224 [01:34<00:40,  1.69it/s]
Epoch 12 Iter 156: loss 0.23912. :  69%|█████████████████████████████▊             | 155/224 [01:35<00:40,  1.69it/s]
Epoch 12 Iter 156: loss 0.23912. :  70%|█████████████████████████████▉             | 156/224 [01:35<00:44,  1.55it/s]
Epoch 12 Iter 157: loss 0.24045. :  70%|█████████████████████████████▉             | 156/224 [01:36<00:44,  1.55it/s]
Epoch 12 Iter 157: loss 0.24045. :  70%|██████████████████████████████▏            | 157/224 [01:36<00:45,  1.47it/s]
Epoch 12 Iter 158: loss 0.23315. :  70%|██████████████████████████████▏            | 157/224 [01:37<00:45,  1.47it/s]
Epoch 12 Iter 158: loss 0.23315. :  71%|██████████████████████████████▎            | 158/224 [01:37<00:46,  1.41it/s]
Epoch 12 Iter 159: loss 0.22778. :  71%|██████████████████████████████▎            | 158/224 [01:37<00:46,  1.41it/s]
Epoch 12 Iter 159: loss 0.22778. :  71%|██████████████████████████████▌            | 159/224 [01:37<00:47,  1.38it/s]
Epoch 12 Iter 160: loss 0.24215. :  71%|██████████████████████████████▌            | 159/224 [01:38<00:47,  1.38it/s]
Epoch 12 Iter 160: loss 0.24215. :  71%|██████████████████████████████▋            | 160/224 [01:38<00:46,  1.36it/s]
Epoch 12 Iter 161: loss 0.23382. :  71%|██████████████████████████████▋            | 160/224 [01:39<00:46,  1.36it/s]
Epoch 12 Iter 161: loss 0.23382. :  72%|██████████████████████████████▉            | 161/224 [01:39<00:46,  1.36it/s]
Epoch 12 Iter 162: loss 0.23577. :  72%|██████████████████████████████▉            | 161/224 [01:40<00:46,  1.36it/s]
Epoch 12 Iter 162: loss 0.23577. :  72%|███████████████████████████████            | 162/224 [01:40<00:45,  1.38it/s]
Epoch 12 Iter 163: loss 0.24690. :  72%|███████████████████████████████            | 162/224 [01:40<00:45,  1.38it/s]
Epoch 12 Iter 163: loss 0.24690. :  73%|███████████████████████████████▎           | 163/224 [01:40<00:42,  1.42it/s]
Epoch 12 Iter 164: loss 0.24128. :  73%|███████████████████████████████▎           | 163/224 [01:41<00:42,  1.42it/s]
Epoch 12 Iter 164: loss 0.24128. :  73%|███████████████████████████████▍           | 164/224 [01:41<00:39,  1.53it/s]
Epoch 12 Iter 165: loss 0.24787. :  73%|███████████████████████████████▍           | 164/224 [01:41<00:39,  1.53it/s]
Epoch 12 Iter 165: loss 0.24787. :  74%|███████████████████████████████▋           | 165/224 [01:41<00:36,  1.60it/s]
Epoch 12 Iter 166: loss 0.24387. :  74%|███████████████████████████████▋           | 165/224 [01:42<00:36,  1.60it/s]
Epoch 12 Iter 166: loss 0.24387. :  74%|███████████████████████████████▊           | 166/224 [01:42<00:34,  1.68it/s]
Epoch 12 Iter 167: loss 0.23810. :  74%|███████████████████████████████▊           | 166/224 [01:42<00:34,  1.68it/s]
Epoch 12 Iter 167: loss 0.23810. :  75%|████████████████████████████████           | 167/224 [01:42<00:33,  1.68it/s]
Epoch 12 Iter 168: loss 0.21479. :  75%|████████████████████████████████           | 167/224 [01:43<00:33,  1.68it/s]
Epoch 12 Iter 168: loss 0.21479. :  75%|████████████████████████████████▎          | 168/224 [01:43<00:32,  1.73it/s]
Epoch 12 Iter 169: loss 0.22035. :  75%|████████████████████████████████▎          | 168/224 [01:44<00:32,  1.73it/s]
Epoch 12 Iter 169: loss 0.22035. :  75%|████████████████████████████████▍          | 169/224 [01:44<00:31,  1.72it/s]
Epoch 12 Iter 170: loss 0.22145. :  75%|████████████████████████████████▍          | 169/224 [01:44<00:31,  1.72it/s]
Epoch 12 Iter 170: loss 0.22145. :  76%|████████████████████████████████▋          | 170/224 [01:44<00:34,  1.58it/s]
Epoch 12 Iter 171: loss 0.22418. :  76%|████████████████████████████████▋          | 170/224 [01:45<00:34,  1.58it/s]
Epoch 12 Iter 171: loss 0.22418. :  76%|████████████████████████████████▊          | 171/224 [01:45<00:35,  1.48it/s]
Epoch 12 Iter 172: loss 0.21343. :  76%|████████████████████████████████▊          | 171/224 [01:46<00:35,  1.48it/s]
Epoch 12 Iter 172: loss 0.21343. :  77%|█████████████████████████████████          | 172/224 [01:46<00:36,  1.42it/s]
Epoch 12 Iter 173: loss 0.22978. :  77%|█████████████████████████████████          | 172/224 [01:47<00:36,  1.42it/s]
Epoch 12 Iter 173: loss 0.22978. :  77%|█████████████████████████████████▏         | 173/224 [01:47<00:36,  1.38it/s]
Epoch 12 Iter 174: loss 0.23457. :  77%|█████████████████████████████████▏         | 173/224 [01:47<00:36,  1.38it/s]
Epoch 12 Iter 174: loss 0.23457. :  78%|█████████████████████████████████▍         | 174/224 [01:47<00:33,  1.47it/s]
Epoch 12 Iter 175: loss 0.21474. :  78%|█████████████████████████████████▍         | 174/224 [01:48<00:33,  1.47it/s]
Epoch 12 Iter 175: loss 0.21474. :  78%|█████████████████████████████████▌         | 175/224 [01:48<00:34,  1.40it/s]
Epoch 12 Iter 176: loss 0.24040. :  78%|█████████████████████████████████▌         | 175/224 [01:49<00:34,  1.40it/s]
Epoch 12 Iter 176: loss 0.24040. :  79%|█████████████████████████████████▊         | 176/224 [01:49<00:32,  1.49it/s]
Epoch 12 Iter 177: loss 0.21530. :  79%|█████████████████████████████████▊         | 176/224 [01:49<00:32,  1.49it/s]
Epoch 12 Iter 177: loss 0.21530. :  79%|█████████████████████████████████▉         | 177/224 [01:49<00:29,  1.59it/s]
Epoch 12 Iter 178: loss 0.24343. :  79%|█████████████████████████████████▉         | 177/224 [01:50<00:29,  1.59it/s]
Epoch 12 Iter 178: loss 0.24343. :  79%|██████████████████████████████████▏        | 178/224 [01:50<00:27,  1.65it/s]
Epoch 12 Iter 179: loss 0.25509. :  79%|██████████████████████████████████▏        | 178/224 [01:50<00:27,  1.65it/s]
Epoch 12 Iter 179: loss 0.25509. :  80%|██████████████████████████████████▎        | 179/224 [01:50<00:28,  1.59it/s]
Epoch 12 Iter 180: loss 0.23204. :  80%|██████████████████████████████████▎        | 179/224 [01:51<00:28,  1.59it/s]
Epoch 12 Iter 180: loss 0.23204. :  80%|██████████████████████████████████▌        | 180/224 [01:51<00:29,  1.49it/s]
Epoch 12 Iter 181: loss 0.23525. :  80%|██████████████████████████████████▌        | 180/224 [01:52<00:29,  1.49it/s]
Epoch 12 Iter 181: loss 0.23525. :  81%|██████████████████████████████████▋        | 181/224 [01:52<00:30,  1.43it/s]
Epoch 12 Iter 182: loss 0.24993. :  81%|██████████████████████████████████▋        | 181/224 [01:53<00:30,  1.43it/s]
Epoch 12 Iter 182: loss 0.24993. :  81%|██████████████████████████████████▉        | 182/224 [01:53<00:29,  1.43it/s]
Epoch 12 Iter 183: loss 0.21054. :  81%|██████████████████████████████████▉        | 182/224 [01:53<00:29,  1.43it/s]
Epoch 12 Iter 183: loss 0.21054. :  82%|███████████████████████████████████▏       | 183/224 [01:53<00:26,  1.53it/s]
Epoch 12 Iter 184: loss 0.21548. :  82%|███████████████████████████████████▏       | 183/224 [01:54<00:26,  1.53it/s]
Epoch 12 Iter 184: loss 0.21548. :  82%|███████████████████████████████████▎       | 184/224 [01:54<00:24,  1.62it/s]
Epoch 12 Iter 185: loss 0.25064. :  82%|███████████████████████████████████▎       | 184/224 [01:54<00:24,  1.62it/s]
Epoch 12 Iter 185: loss 0.25064. :  83%|███████████████████████████████████▌       | 185/224 [01:54<00:24,  1.59it/s]
Epoch 12 Iter 186: loss 0.25474. :  83%|███████████████████████████████████▌       | 185/224 [01:55<00:24,  1.59it/s]
Epoch 12 Iter 186: loss 0.25474. :  83%|███████████████████████████████████▋       | 186/224 [01:55<00:23,  1.62it/s]
Epoch 12 Iter 187: loss 0.24443. :  83%|███████████████████████████████████▋       | 186/224 [01:55<00:23,  1.62it/s]
Epoch 12 Iter 187: loss 0.24443. :  83%|███████████████████████████████████▉       | 187/224 [01:55<00:22,  1.62it/s]
Epoch 12 Iter 188: loss 0.22337. :  83%|███████████████████████████████████▉       | 187/224 [01:56<00:22,  1.62it/s]
Epoch 12 Iter 188: loss 0.22337. :  84%|████████████████████████████████████       | 188/224 [01:56<00:22,  1.62it/s]
Epoch 12 Iter 189: loss 0.23666. :  84%|████████████████████████████████████       | 188/224 [01:57<00:22,  1.62it/s]
Epoch 12 Iter 189: loss 0.23666. :  84%|████████████████████████████████████▎      | 189/224 [01:57<00:20,  1.68it/s]
Epoch 12 Iter 190: loss 0.24987. :  84%|████████████████████████████████████▎      | 189/224 [01:57<00:20,  1.68it/s]
Epoch 12 Iter 190: loss 0.24987. :  85%|████████████████████████████████████▍      | 190/224 [01:57<00:21,  1.58it/s]
Epoch 12 Iter 191: loss 0.24988. :  85%|████████████████████████████████████▍      | 190/224 [01:58<00:21,  1.58it/s]
Epoch 12 Iter 191: loss 0.24988. :  85%|████████████████████████████████████▋      | 191/224 [01:58<00:22,  1.48it/s]
Epoch 12 Iter 192: loss 0.23803. :  85%|████████████████████████████████████▋      | 191/224 [01:59<00:22,  1.48it/s]
Epoch 12 Iter 192: loss 0.23803. :  86%|████████████████████████████████████▊      | 192/224 [01:59<00:22,  1.41it/s]
Epoch 12 Iter 193: loss 0.24633. :  86%|████████████████████████████████████▊      | 192/224 [02:00<00:22,  1.41it/s]
Epoch 12 Iter 193: loss 0.24633. :  86%|█████████████████████████████████████      | 193/224 [02:00<00:22,  1.38it/s]
Epoch 12 Iter 194: loss 0.22573. :  86%|█████████████████████████████████████      | 193/224 [02:00<00:22,  1.38it/s]
Epoch 12 Iter 194: loss 0.22573. :  87%|█████████████████████████████████████▏     | 194/224 [02:00<00:22,  1.36it/s]
Epoch 12 Iter 195: loss 0.22454. :  87%|█████████████████████████████████████▏     | 194/224 [02:01<00:22,  1.36it/s]
Epoch 12 Iter 195: loss 0.22454. :  87%|█████████████████████████████████████▍     | 195/224 [02:01<00:21,  1.34it/s]
Epoch 12 Iter 196: loss 0.23938. :  87%|█████████████████████████████████████▍     | 195/224 [02:02<00:21,  1.34it/s]
Epoch 12 Iter 196: loss 0.23938. :  88%|█████████████████████████████████████▋     | 196/224 [02:02<00:21,  1.33it/s]
Epoch 12 Iter 197: loss 0.20004. :  88%|█████████████████████████████████████▋     | 196/224 [02:03<00:21,  1.33it/s]
Epoch 12 Iter 197: loss 0.20004. :  88%|█████████████████████████████████████▊     | 197/224 [02:03<00:20,  1.32it/s]
Epoch 12 Iter 198: loss 0.21867. :  88%|█████████████████████████████████████▊     | 197/224 [02:04<00:20,  1.32it/s]
Epoch 12 Iter 198: loss 0.21867. :  88%|██████████████████████████████████████     | 198/224 [02:04<00:19,  1.32it/s]
Epoch 12 Iter 199: loss 0.20670. :  88%|██████████████████████████████████████     | 198/224 [02:04<00:19,  1.32it/s]
Epoch 12 Iter 199: loss 0.20670. :  89%|██████████████████████████████████████▏    | 199/224 [02:04<00:19,  1.31it/s]
Epoch 12 Iter 200: loss 0.25721. :  89%|██████████████████████████████████████▏    | 199/224 [02:05<00:19,  1.31it/s]
Epoch 12 Iter 200: loss 0.25721. :  89%|██████████████████████████████████████▍    | 200/224 [02:05<00:18,  1.31it/s]
Epoch 12 Iter 201: loss 0.21433. :  89%|██████████████████████████████████████▍    | 200/224 [02:06<00:18,  1.31it/s]
Epoch 12 Iter 201: loss 0.21433. :  90%|██████████████████████████████████████▌    | 201/224 [02:06<00:17,  1.31it/s]
Epoch 12 Iter 202: loss 0.24405. :  90%|██████████████████████████████████████▌    | 201/224 [02:07<00:17,  1.31it/s]
Epoch 12 Iter 202: loss 0.24405. :  90%|██████████████████████████████████████▊    | 202/224 [02:07<00:16,  1.31it/s]
Epoch 12 Iter 203: loss 0.22374. :  90%|██████████████████████████████████████▊    | 202/224 [02:07<00:16,  1.31it/s]
Epoch 12 Iter 203: loss 0.22374. :  91%|██████████████████████████████████████▉    | 203/224 [02:07<00:15,  1.36it/s]
Epoch 12 Iter 204: loss 0.23512. :  91%|██████████████████████████████████████▉    | 203/224 [02:08<00:15,  1.36it/s]
Epoch 12 Iter 204: loss 0.23512. :  91%|███████████████████████████████████████▏   | 204/224 [02:08<00:13,  1.47it/s]
Epoch 12 Iter 205: loss 0.22264. :  91%|███████████████████████████████████████▏   | 204/224 [02:08<00:13,  1.47it/s]
Epoch 12 Iter 205: loss 0.22264. :  92%|███████████████████████████████████████▎   | 205/224 [02:08<00:12,  1.58it/s]
Epoch 12 Iter 206: loss 0.26291. :  92%|███████████████████████████████████████▎   | 205/224 [02:09<00:12,  1.58it/s]
Epoch 12 Iter 206: loss 0.26291. :  92%|███████████████████████████████████████▌   | 206/224 [02:09<00:10,  1.66it/s]
Epoch 12 Iter 207: loss 0.25073. :  92%|███████████████████████████████████████▌   | 206/224 [02:10<00:10,  1.66it/s]
Epoch 12 Iter 207: loss 0.25073. :  92%|███████████████████████████████████████▋   | 207/224 [02:10<00:10,  1.63it/s]
Epoch 12 Iter 208: loss 0.22696. :  92%|███████████████████████████████████████▋   | 207/224 [02:10<00:10,  1.63it/s]
Epoch 12 Iter 208: loss 0.22696. :  93%|███████████████████████████████████████▉   | 208/224 [02:10<00:10,  1.51it/s]
Epoch 12 Iter 209: loss 0.22627. :  93%|███████████████████████████████████████▉   | 208/224 [02:11<00:10,  1.51it/s]
Epoch 12 Iter 209: loss 0.22627. :  93%|████████████████████████████████████████   | 209/224 [02:11<00:10,  1.43it/s]
Epoch 12 Iter 210: loss 0.22965. :  93%|████████████████████████████████████████   | 209/224 [02:12<00:10,  1.43it/s]
Epoch 12 Iter 210: loss 0.22965. :  94%|████████████████████████████████████████▎  | 210/224 [02:12<00:10,  1.39it/s]
Epoch 12 Iter 211: loss 0.22115. :  94%|████████████████████████████████████████▎  | 210/224 [02:13<00:10,  1.39it/s]
Epoch 12 Iter 211: loss 0.22115. :  94%|████████████████████████████████████████▌  | 211/224 [02:13<00:09,  1.36it/s]
Epoch 12 Iter 212: loss 0.23089. :  94%|████████████████████████████████████████▌  | 211/224 [02:13<00:09,  1.36it/s]
Epoch 12 Iter 212: loss 0.23089. :  95%|████████████████████████████████████████▋  | 212/224 [02:13<00:08,  1.47it/s]
Epoch 12 Iter 213: loss 0.23142. :  95%|████████████████████████████████████████▋  | 212/224 [02:14<00:08,  1.47it/s]
Epoch 12 Iter 213: loss 0.23142. :  95%|████████████████████████████████████████▉  | 213/224 [02:14<00:07,  1.54it/s]
Epoch 12 Iter 214: loss 0.21890. :  95%|████████████████████████████████████████▉  | 213/224 [02:14<00:07,  1.54it/s]
Epoch 12 Iter 214: loss 0.21890. :  96%|█████████████████████████████████████████  | 214/224 [02:14<00:06,  1.59it/s]
Epoch 12 Iter 215: loss 0.22746. :  96%|█████████████████████████████████████████  | 214/224 [02:15<00:06,  1.59it/s]
Epoch 12 Iter 215: loss 0.22746. :  96%|█████████████████████████████████████████▎ | 215/224 [02:15<00:06,  1.50it/s]
Epoch 12 Iter 216: loss 0.25180. :  96%|█████████████████████████████████████████▎ | 215/224 [02:16<00:06,  1.50it/s]
Epoch 12 Iter 216: loss 0.25180. :  96%|█████████████████████████████████████████▍ | 216/224 [02:16<00:05,  1.43it/s]
Epoch 12 Iter 217: loss 0.24918. :  96%|█████████████████████████████████████████▍ | 216/224 [02:17<00:05,  1.43it/s]
Epoch 12 Iter 217: loss 0.24918. :  97%|█████████████████████████████████████████▋ | 217/224 [02:17<00:04,  1.42it/s]
Epoch 12 Iter 218: loss 0.22566. :  97%|█████████████████████████████████████████▋ | 217/224 [02:17<00:04,  1.42it/s]
Epoch 12 Iter 218: loss 0.22566. :  97%|█████████████████████████████████████████▊ | 218/224 [02:17<00:04,  1.49it/s]
Epoch 12 Iter 219: loss 0.25473. :  97%|█████████████████████████████████████████▊ | 218/224 [02:18<00:04,  1.49it/s]
Epoch 12 Iter 219: loss 0.25473. :  98%|██████████████████████████████████████████ | 219/224 [02:18<00:03,  1.59it/s]
Epoch 12 Iter 220: loss 0.26040. :  98%|██████████████████████████████████████████ | 219/224 [02:18<00:03,  1.59it/s]
Epoch 12 Iter 220: loss 0.26040. :  98%|██████████████████████████████████████████▏| 220/224 [02:18<00:02,  1.63it/s]
Epoch 12 Iter 221: loss 0.20715. :  98%|██████████████████████████████████████████▏| 220/224 [02:19<00:02,  1.63it/s]
Epoch 12 Iter 221: loss 0.20715. :  99%|██████████████████████████████████████████▍| 221/224 [02:19<00:01,  1.51it/s]
Epoch 12 Iter 222: loss 0.24549. :  99%|██████████████████████████████████████████▍| 221/224 [02:20<00:01,  1.51it/s]
Epoch 12 Iter 222: loss 0.24549. :  99%|██████████████████████████████████████████▌| 222/224 [02:20<00:01,  1.44it/s]
Epoch 12 Iter 223: loss 0.24948. :  99%|██████████████████████████████████████████▌| 222/224 [02:20<00:01,  1.44it/s]
Epoch 12 Iter 223: loss 0.24948. : 100%|██████████████████████████████████████████▊| 223/224 [02:20<00:00,  1.54it/s]
Epoch 12 Iter 224: loss 0.22606. : 100%|██████████████████████████████████████████▊| 223/224 [02:21<00:00,  1.54it/s]
Epoch 12 Iter 224: loss 0.22606. : 100%|███████████████████████████████████████████| 224/224 [02:21<00:00,  1.62it/s]
Epoch 12 Iter 224: loss 0.22606. : 100%|███████████████████████████████████████████| 224/224 [02:21<00:00,  1.58it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.24030. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.24030. :   0%|▏                                              | 1/224 [00:00<02:29,  1.49it/s]
Epoch 13 Iter 2: loss 0.23245. :   0%|▏                                              | 1/224 [00:01<02:29,  1.49it/s]
Epoch 13 Iter 2: loss 0.23245. :   1%|▍                                              | 2/224 [00:01<02:22,  1.56it/s]
Epoch 13 Iter 3: loss 0.21100. :   1%|▍                                              | 2/224 [00:02<02:22,  1.56it/s]
Epoch 13 Iter 3: loss 0.21100. :   1%|▋                                              | 3/224 [00:02<02:28,  1.49it/s]
Epoch 13 Iter 4: loss 0.25091. :   1%|▋                                              | 3/224 [00:02<02:28,  1.49it/s]
Epoch 13 Iter 4: loss 0.25091. :   2%|▊                                              | 4/224 [00:02<02:36,  1.40it/s]
Epoch 13 Iter 5: loss 0.23305. :   2%|▊                                              | 4/224 [00:03<02:36,  1.40it/s]
Epoch 13 Iter 5: loss 0.23305. :   2%|█                                              | 5/224 [00:03<02:24,  1.51it/s]
Epoch 13 Iter 6: loss 0.22834. :   2%|█                                              | 5/224 [00:04<02:24,  1.51it/s]
Epoch 13 Iter 6: loss 0.22834. :   3%|█▎                                             | 6/224 [00:04<02:32,  1.43it/s]
Epoch 13 Iter 7: loss 0.25916. :   3%|█▎                                             | 6/224 [00:04<02:32,  1.43it/s]
Epoch 13 Iter 7: loss 0.25916. :   3%|█▍                                             | 7/224 [00:04<02:28,  1.46it/s]
Epoch 13 Iter 8: loss 0.20847. :   3%|█▍                                             | 7/224 [00:05<02:28,  1.46it/s]
Epoch 13 Iter 8: loss 0.20847. :   4%|█▋                                             | 8/224 [00:05<02:19,  1.55it/s]
Epoch 13 Iter 9: loss 0.25560. :   4%|█▋                                             | 8/224 [00:05<02:19,  1.55it/s]
Epoch 13 Iter 9: loss 0.25560. :   4%|█▉                                             | 9/224 [00:05<02:11,  1.64it/s]
Epoch 13 Iter 10: loss 0.22463. :   4%|█▊                                            | 9/224 [00:06<02:11,  1.64it/s]
Epoch 13 Iter 10: loss 0.22463. :   4%|██                                           | 10/224 [00:06<02:13,  1.60it/s]
Epoch 13 Iter 11: loss 0.23399. :   4%|██                                           | 10/224 [00:07<02:13,  1.60it/s]
Epoch 13 Iter 11: loss 0.23399. :   5%|██▏                                          | 11/224 [00:07<02:08,  1.66it/s]
Epoch 13 Iter 12: loss 0.23907. :   5%|██▏                                          | 11/224 [00:07<02:08,  1.66it/s]
Epoch 13 Iter 12: loss 0.23907. :   5%|██▍                                          | 12/224 [00:07<02:03,  1.72it/s]
Epoch 13 Iter 13: loss 0.22267. :   5%|██▍                                          | 12/224 [00:08<02:03,  1.72it/s]
Epoch 13 Iter 13: loss 0.22267. :   6%|██▌                                          | 13/224 [00:08<02:05,  1.68it/s]
Epoch 13 Iter 14: loss 0.21754. :   6%|██▌                                          | 13/224 [00:08<02:05,  1.68it/s]
Epoch 13 Iter 14: loss 0.21754. :   6%|██▊                                          | 14/224 [00:08<02:12,  1.58it/s]
Epoch 13 Iter 15: loss 0.24322. :   6%|██▊                                          | 14/224 [00:09<02:12,  1.58it/s]
Epoch 13 Iter 15: loss 0.24322. :   7%|███                                          | 15/224 [00:09<02:07,  1.64it/s]
Epoch 13 Iter 16: loss 0.25038. :   7%|███                                          | 15/224 [00:10<02:07,  1.64it/s]
Epoch 13 Iter 16: loss 0.25038. :   7%|███▏                                         | 16/224 [00:10<02:16,  1.52it/s]
Epoch 13 Iter 17: loss 0.23805. :   7%|███▏                                         | 16/224 [00:10<02:16,  1.52it/s]
Epoch 13 Iter 17: loss 0.23805. :   8%|███▍                                         | 17/224 [00:10<02:09,  1.60it/s]
Epoch 13 Iter 18: loss 0.23546. :   8%|███▍                                         | 17/224 [00:11<02:09,  1.60it/s]
Epoch 13 Iter 18: loss 0.23546. :   8%|███▌                                         | 18/224 [00:11<02:04,  1.65it/s]
Epoch 13 Iter 19: loss 0.22793. :   8%|███▌                                         | 18/224 [00:11<02:04,  1.65it/s]
Epoch 13 Iter 19: loss 0.22793. :   8%|███▊                                         | 19/224 [00:11<02:01,  1.68it/s]
Epoch 13 Iter 20: loss 0.24511. :   8%|███▊                                         | 19/224 [00:12<02:01,  1.68it/s]
Epoch 13 Iter 20: loss 0.24511. :   9%|████                                         | 20/224 [00:12<01:57,  1.74it/s]
Epoch 13 Iter 21: loss 0.23198. :   9%|████                                         | 20/224 [00:13<01:57,  1.74it/s]
Epoch 13 Iter 21: loss 0.23198. :   9%|████▏                                        | 21/224 [00:13<01:54,  1.78it/s]
Epoch 13 Iter 22: loss 0.24221. :   9%|████▏                                        | 21/224 [00:13<01:54,  1.78it/s]
Epoch 13 Iter 22: loss 0.24221. :  10%|████▍                                        | 22/224 [00:13<01:56,  1.73it/s]
Epoch 13 Iter 23: loss 0.22091. :  10%|████▍                                        | 22/224 [00:14<01:56,  1.73it/s]
Epoch 13 Iter 23: loss 0.22091. :  10%|████▌                                        | 23/224 [00:14<01:55,  1.73it/s]
Epoch 13 Iter 24: loss 0.21945. :  10%|████▌                                        | 23/224 [00:14<01:55,  1.73it/s]
Epoch 13 Iter 24: loss 0.21945. :  11%|████▊                                        | 24/224 [00:14<01:54,  1.74it/s]
Epoch 13 Iter 25: loss 0.21463. :  11%|████▊                                        | 24/224 [00:15<01:54,  1.74it/s]
Epoch 13 Iter 25: loss 0.21463. :  11%|█████                                        | 25/224 [00:15<01:51,  1.78it/s]
Epoch 13 Iter 26: loss 0.21292. :  11%|█████                                        | 25/224 [00:15<01:51,  1.78it/s]
Epoch 13 Iter 26: loss 0.21292. :  12%|█████▏                                       | 26/224 [00:15<01:56,  1.70it/s]
Epoch 13 Iter 27: loss 0.23275. :  12%|█████▏                                       | 26/224 [00:16<01:56,  1.70it/s]
Epoch 13 Iter 27: loss 0.23275. :  12%|█████▍                                       | 27/224 [00:16<01:52,  1.75it/s]
Epoch 13 Iter 28: loss 0.22713. :  12%|█████▍                                       | 27/224 [00:17<01:52,  1.75it/s]
Epoch 13 Iter 28: loss 0.22713. :  12%|█████▋                                       | 28/224 [00:17<01:49,  1.79it/s]
Epoch 13 Iter 29: loss 0.24440. :  12%|█████▋                                       | 28/224 [00:17<01:49,  1.79it/s]
Epoch 13 Iter 29: loss 0.24440. :  13%|█████▊                                       | 29/224 [00:17<01:57,  1.66it/s]
Epoch 13 Iter 30: loss 0.21501. :  13%|█████▊                                       | 29/224 [00:18<01:57,  1.66it/s]
Epoch 13 Iter 30: loss 0.21501. :  13%|██████                                       | 30/224 [00:18<02:07,  1.53it/s]
Epoch 13 Iter 31: loss 0.22802. :  13%|██████                                       | 30/224 [00:19<02:07,  1.53it/s]
Epoch 13 Iter 31: loss 0.22802. :  14%|██████▏                                      | 31/224 [00:19<02:08,  1.50it/s]
Epoch 13 Iter 32: loss 0.22149. :  14%|██████▏                                      | 31/224 [00:19<02:08,  1.50it/s]
Epoch 13 Iter 32: loss 0.22149. :  14%|██████▍                                      | 32/224 [00:19<02:13,  1.44it/s]
Epoch 13 Iter 33: loss 0.23833. :  14%|██████▍                                      | 32/224 [00:20<02:13,  1.44it/s]
Epoch 13 Iter 33: loss 0.23833. :  15%|██████▋                                      | 33/224 [00:20<02:09,  1.47it/s]
Epoch 13 Iter 34: loss 0.23685. :  15%|██████▋                                      | 33/224 [00:21<02:09,  1.47it/s]
Epoch 13 Iter 34: loss 0.23685. :  15%|██████▊                                      | 34/224 [00:21<02:01,  1.56it/s]
Epoch 13 Iter 35: loss 0.23235. :  15%|██████▊                                      | 34/224 [00:21<02:01,  1.56it/s]
Epoch 13 Iter 35: loss 0.23235. :  16%|███████                                      | 35/224 [00:21<01:56,  1.62it/s]
Epoch 13 Iter 36: loss 0.25580. :  16%|███████                                      | 35/224 [00:22<01:56,  1.62it/s]
Epoch 13 Iter 36: loss 0.25580. :  16%|███████▏                                     | 36/224 [00:22<01:51,  1.68it/s]
Epoch 13 Iter 37: loss 0.23692. :  16%|███████▏                                     | 36/224 [00:22<01:51,  1.68it/s]
Epoch 13 Iter 37: loss 0.23692. :  17%|███████▍                                     | 37/224 [00:22<01:57,  1.59it/s]
Epoch 13 Iter 38: loss 0.23173. :  17%|███████▍                                     | 37/224 [00:23<01:57,  1.59it/s]
Epoch 13 Iter 38: loss 0.23173. :  17%|███████▋                                     | 38/224 [00:23<02:06,  1.47it/s]
Epoch 13 Iter 39: loss 0.24238. :  17%|███████▋                                     | 38/224 [00:24<02:06,  1.47it/s]
Epoch 13 Iter 39: loss 0.24238. :  17%|███████▊                                     | 39/224 [00:24<02:03,  1.50it/s]
Epoch 13 Iter 40: loss 0.23923. :  17%|███████▊                                     | 39/224 [00:25<02:03,  1.50it/s]
Epoch 13 Iter 40: loss 0.23923. :  18%|████████                                     | 40/224 [00:25<02:09,  1.42it/s]
Epoch 13 Iter 41: loss 0.22881. :  18%|████████                                     | 40/224 [00:25<02:09,  1.42it/s]
Epoch 13 Iter 41: loss 0.22881. :  18%|████████▏                                    | 41/224 [00:25<02:06,  1.44it/s]
Epoch 13 Iter 42: loss 0.23117. :  18%|████████▏                                    | 41/224 [00:26<02:06,  1.44it/s]
Epoch 13 Iter 42: loss 0.23117. :  19%|████████▍                                    | 42/224 [00:26<02:11,  1.39it/s]
Epoch 13 Iter 43: loss 0.24375. :  19%|████████▍                                    | 42/224 [00:27<02:11,  1.39it/s]
Epoch 13 Iter 43: loss 0.24375. :  19%|████████▋                                    | 43/224 [00:27<02:07,  1.42it/s]
Epoch 13 Iter 44: loss 0.23243. :  19%|████████▋                                    | 43/224 [00:27<02:07,  1.42it/s]
Epoch 13 Iter 44: loss 0.23243. :  20%|████████▊                                    | 44/224 [00:27<01:58,  1.52it/s]
Epoch 13 Iter 45: loss 0.21172. :  20%|████████▊                                    | 44/224 [00:28<01:58,  1.52it/s]
Epoch 13 Iter 45: loss 0.21172. :  20%|█████████                                    | 45/224 [00:28<02:02,  1.46it/s]
Epoch 13 Iter 46: loss 0.24950. :  20%|█████████                                    | 45/224 [00:29<02:02,  1.46it/s]
Epoch 13 Iter 46: loss 0.24950. :  21%|█████████▏                                   | 46/224 [00:29<02:07,  1.40it/s]
Epoch 13 Iter 47: loss 0.23847. :  21%|█████████▏                                   | 46/224 [00:30<02:07,  1.40it/s]
Epoch 13 Iter 47: loss 0.23847. :  21%|█████████▍                                   | 47/224 [00:30<02:09,  1.36it/s]
Epoch 13 Iter 48: loss 0.22965. :  21%|█████████▍                                   | 47/224 [00:30<02:09,  1.36it/s]
Epoch 13 Iter 48: loss 0.22965. :  21%|█████████▋                                   | 48/224 [00:30<01:59,  1.48it/s]
Epoch 13 Iter 49: loss 0.22930. :  21%|█████████▋                                   | 48/224 [00:31<01:59,  1.48it/s]
Epoch 13 Iter 49: loss 0.22930. :  22%|█████████▊                                   | 49/224 [00:31<01:57,  1.49it/s]
Epoch 13 Iter 50: loss 0.23351. :  22%|█████████▊                                   | 49/224 [00:32<01:57,  1.49it/s]
Epoch 13 Iter 50: loss 0.23351. :  22%|██████████                                   | 50/224 [00:32<01:56,  1.49it/s]
Epoch 13 Iter 51: loss 0.20656. :  22%|██████████                                   | 50/224 [00:32<01:56,  1.49it/s]
Epoch 13 Iter 51: loss 0.20656. :  23%|██████████▏                                  | 51/224 [00:32<01:58,  1.46it/s]
Epoch 13 Iter 52: loss 0.22126. :  23%|██████████▏                                  | 51/224 [00:33<01:58,  1.46it/s]
Epoch 13 Iter 52: loss 0.22126. :  23%|██████████▍                                  | 52/224 [00:33<01:58,  1.46it/s]
Epoch 13 Iter 53: loss 0.25836. :  23%|██████████▍                                  | 52/224 [00:34<01:58,  1.46it/s]
Epoch 13 Iter 53: loss 0.25836. :  24%|██████████▋                                  | 53/224 [00:34<01:50,  1.54it/s]
Epoch 13 Iter 54: loss 0.25075. :  24%|██████████▋                                  | 53/224 [00:34<01:50,  1.54it/s]
Epoch 13 Iter 54: loss 0.25075. :  24%|██████████▊                                  | 54/224 [00:34<01:47,  1.58it/s]
Epoch 13 Iter 55: loss 0.22083. :  24%|██████████▊                                  | 54/224 [00:35<01:47,  1.58it/s]
Epoch 13 Iter 55: loss 0.22083. :  25%|███████████                                  | 55/224 [00:35<01:41,  1.66it/s]
Epoch 13 Iter 56: loss 0.22477. :  25%|███████████                                  | 55/224 [00:35<01:41,  1.66it/s]
Epoch 13 Iter 56: loss 0.22477. :  25%|███████████▎                                 | 56/224 [00:35<01:39,  1.69it/s]
Epoch 13 Iter 57: loss 0.22542. :  25%|███████████▎                                 | 56/224 [00:36<01:39,  1.69it/s]
Epoch 13 Iter 57: loss 0.22542. :  25%|███████████▍                                 | 57/224 [00:36<01:39,  1.68it/s]
Epoch 13 Iter 58: loss 0.21788. :  25%|███████████▍                                 | 57/224 [00:36<01:39,  1.68it/s]
Epoch 13 Iter 58: loss 0.21788. :  26%|███████████▋                                 | 58/224 [00:36<01:39,  1.67it/s]
Epoch 13 Iter 59: loss 0.23030. :  26%|███████████▋                                 | 58/224 [00:37<01:39,  1.67it/s]
Epoch 13 Iter 59: loss 0.23030. :  26%|███████████▊                                 | 59/224 [00:37<01:40,  1.64it/s]
Epoch 13 Iter 60: loss 0.23873. :  26%|███████████▊                                 | 59/224 [00:38<01:40,  1.64it/s]
Epoch 13 Iter 60: loss 0.23873. :  27%|████████████                                 | 60/224 [00:38<01:36,  1.70it/s]
Epoch 13 Iter 61: loss 0.23770. :  27%|████████████                                 | 60/224 [00:38<01:36,  1.70it/s]
Epoch 13 Iter 61: loss 0.23770. :  27%|████████████▎                                | 61/224 [00:38<01:33,  1.74it/s]
Epoch 13 Iter 62: loss 0.23963. :  27%|████████████▎                                | 61/224 [00:39<01:33,  1.74it/s]
Epoch 13 Iter 62: loss 0.23963. :  28%|████████████▍                                | 62/224 [00:39<01:38,  1.65it/s]
Epoch 13 Iter 63: loss 0.23179. :  28%|████████████▍                                | 62/224 [00:39<01:38,  1.65it/s]
Epoch 13 Iter 63: loss 0.23179. :  28%|████████████▋                                | 63/224 [00:39<01:32,  1.73it/s]
Epoch 13 Iter 64: loss 0.23417. :  28%|████████████▋                                | 63/224 [00:40<01:32,  1.73it/s]
Epoch 13 Iter 64: loss 0.23417. :  29%|████████████▊                                | 64/224 [00:40<01:28,  1.81it/s]
Epoch 13 Iter 65: loss 0.23525. :  29%|████████████▊                                | 64/224 [00:40<01:28,  1.81it/s]
Epoch 13 Iter 65: loss 0.23525. :  29%|█████████████                                | 65/224 [00:40<01:25,  1.87it/s]
Epoch 13 Iter 66: loss 0.21908. :  29%|█████████████                                | 65/224 [00:41<01:25,  1.87it/s]
Epoch 13 Iter 66: loss 0.21908. :  29%|█████████████▎                               | 66/224 [00:41<01:22,  1.90it/s]
Epoch 13 Iter 67: loss 0.23337. :  29%|█████████████▎                               | 66/224 [00:41<01:22,  1.90it/s]
Epoch 13 Iter 67: loss 0.23337. :  30%|█████████████▍                               | 67/224 [00:41<01:21,  1.93it/s]
Epoch 13 Iter 68: loss 0.20558. :  30%|█████████████▍                               | 67/224 [00:42<01:21,  1.93it/s]
Epoch 13 Iter 68: loss 0.20558. :  30%|█████████████▋                               | 68/224 [00:42<01:20,  1.95it/s]
Epoch 13 Iter 69: loss 0.24175. :  30%|█████████████▋                               | 68/224 [00:42<01:20,  1.95it/s]
Epoch 13 Iter 69: loss 0.24175. :  31%|█████████████▊                               | 69/224 [00:42<01:19,  1.94it/s]
Epoch 13 Iter 70: loss 0.21125. :  31%|█████████████▊                               | 69/224 [00:43<01:19,  1.94it/s]
Epoch 13 Iter 70: loss 0.21125. :  31%|██████████████                               | 70/224 [00:43<01:18,  1.97it/s]
Epoch 13 Iter 71: loss 0.24477. :  31%|██████████████                               | 70/224 [00:43<01:18,  1.97it/s]
Epoch 13 Iter 71: loss 0.24477. :  32%|██████████████▎                              | 71/224 [00:43<01:17,  1.97it/s]
Epoch 13 Iter 72: loss 0.22848. :  32%|██████████████▎                              | 71/224 [00:44<01:17,  1.97it/s]
Epoch 13 Iter 72: loss 0.22848. :  32%|██████████████▍                              | 72/224 [00:44<01:16,  1.98it/s]
Epoch 13 Iter 73: loss 0.23735. :  32%|██████████████▍                              | 72/224 [00:44<01:16,  1.98it/s]
Epoch 13 Iter 73: loss 0.23735. :  33%|██████████████▋                              | 73/224 [00:44<01:16,  1.98it/s]
Epoch 13 Iter 74: loss 0.25543. :  33%|██████████████▋                              | 73/224 [00:45<01:16,  1.98it/s]
Epoch 13 Iter 74: loss 0.25543. :  33%|██████████████▊                              | 74/224 [00:45<01:15,  2.00it/s]
Epoch 13 Iter 75: loss 0.24131. :  33%|██████████████▊                              | 74/224 [00:45<01:15,  2.00it/s]
Epoch 13 Iter 75: loss 0.24131. :  33%|███████████████                              | 75/224 [00:45<01:14,  1.99it/s]
Epoch 13 Iter 76: loss 0.23369. :  33%|███████████████                              | 75/224 [00:46<01:14,  1.99it/s]
Epoch 13 Iter 76: loss 0.23369. :  34%|███████████████▎                             | 76/224 [00:46<01:13,  2.00it/s]
Epoch 13 Iter 77: loss 0.23881. :  34%|███████████████▎                             | 76/224 [00:46<01:13,  2.00it/s]
Epoch 13 Iter 77: loss 0.23881. :  34%|███████████████▍                             | 77/224 [00:46<01:13,  2.00it/s]
Epoch 13 Iter 78: loss 0.23593. :  34%|███████████████▍                             | 77/224 [00:47<01:13,  2.00it/s]
Epoch 13 Iter 78: loss 0.23593. :  35%|███████████████▋                             | 78/224 [00:47<01:12,  2.01it/s]
Epoch 13 Iter 79: loss 0.23094. :  35%|███████████████▋                             | 78/224 [00:47<01:12,  2.01it/s]
Epoch 13 Iter 79: loss 0.23094. :  35%|███████████████▊                             | 79/224 [00:47<01:13,  1.97it/s]
Epoch 13 Iter 80: loss 0.24121. :  35%|███████████████▊                             | 79/224 [00:48<01:13,  1.97it/s]
Epoch 13 Iter 80: loss 0.24121. :  36%|████████████████                             | 80/224 [00:48<01:12,  1.98it/s]
Epoch 13 Iter 81: loss 0.24819. :  36%|████████████████                             | 80/224 [00:48<01:12,  1.98it/s]
Epoch 13 Iter 81: loss 0.24819. :  36%|████████████████▎                            | 81/224 [00:48<01:14,  1.93it/s]
Epoch 13 Iter 82: loss 0.23192. :  36%|████████████████▎                            | 81/224 [00:49<01:14,  1.93it/s]
Epoch 13 Iter 82: loss 0.23192. :  37%|████████████████▍                            | 82/224 [00:49<01:14,  1.91it/s]
Epoch 13 Iter 83: loss 0.24033. :  37%|████████████████▍                            | 82/224 [00:49<01:14,  1.91it/s]
Epoch 13 Iter 83: loss 0.24033. :  37%|████████████████▋                            | 83/224 [00:49<01:12,  1.93it/s]
Epoch 13 Iter 84: loss 0.25341. :  37%|████████████████▋                            | 83/224 [00:50<01:12,  1.93it/s]
Epoch 13 Iter 84: loss 0.25341. :  38%|████████████████▉                            | 84/224 [00:50<01:12,  1.93it/s]
Epoch 13 Iter 85: loss 0.24111. :  38%|████████████████▉                            | 84/224 [00:50<01:12,  1.93it/s]
Epoch 13 Iter 85: loss 0.24111. :  38%|█████████████████                            | 85/224 [00:50<01:11,  1.95it/s]
Epoch 13 Iter 86: loss 0.22981. :  38%|█████████████████                            | 85/224 [00:51<01:11,  1.95it/s]
Epoch 13 Iter 86: loss 0.22981. :  38%|█████████████████▎                           | 86/224 [00:51<01:10,  1.96it/s]
Epoch 13 Iter 87: loss 0.22841. :  38%|█████████████████▎                           | 86/224 [00:51<01:10,  1.96it/s]
Epoch 13 Iter 87: loss 0.22841. :  39%|█████████████████▍                           | 87/224 [00:51<01:09,  1.96it/s]
Epoch 13 Iter 88: loss 0.23491. :  39%|█████████████████▍                           | 87/224 [00:52<01:09,  1.96it/s]
Epoch 13 Iter 88: loss 0.23491. :  39%|█████████████████▋                           | 88/224 [00:52<01:09,  1.97it/s]
Epoch 13 Iter 89: loss 0.24798. :  39%|█████████████████▋                           | 88/224 [00:52<01:09,  1.97it/s]
Epoch 13 Iter 89: loss 0.24798. :  40%|█████████████████▉                           | 89/224 [00:52<01:08,  1.97it/s]
Epoch 13 Iter 90: loss 0.24123. :  40%|█████████████████▉                           | 89/224 [00:53<01:08,  1.97it/s]
Epoch 13 Iter 90: loss 0.24123. :  40%|██████████████████                           | 90/224 [00:53<01:08,  1.97it/s]
Epoch 13 Iter 91: loss 0.22771. :  40%|██████████████████                           | 90/224 [00:53<01:08,  1.97it/s]
Epoch 13 Iter 91: loss 0.22771. :  41%|██████████████████▎                          | 91/224 [00:53<01:07,  1.97it/s]
Epoch 13 Iter 92: loss 0.23413. :  41%|██████████████████▎                          | 91/224 [00:54<01:07,  1.97it/s]
Epoch 13 Iter 92: loss 0.23413. :  41%|██████████████████▍                          | 92/224 [00:54<01:08,  1.92it/s]
Epoch 13 Iter 93: loss 0.24484. :  41%|██████████████████▍                          | 92/224 [00:55<01:08,  1.92it/s]
Epoch 13 Iter 93: loss 0.24484. :  42%|██████████████████▋                          | 93/224 [00:55<01:07,  1.95it/s]
Epoch 13 Iter 94: loss 0.23999. :  42%|██████████████████▋                          | 93/224 [00:55<01:07,  1.95it/s]
Epoch 13 Iter 94: loss 0.23999. :  42%|██████████████████▉                          | 94/224 [00:55<01:05,  1.98it/s]
Epoch 13 Iter 95: loss 0.26015. :  42%|██████████████████▉                          | 94/224 [00:56<01:05,  1.98it/s]
Epoch 13 Iter 95: loss 0.26015. :  42%|███████████████████                          | 95/224 [00:56<01:04,  2.00it/s]
Epoch 13 Iter 96: loss 0.23663. :  42%|███████████████████                          | 95/224 [00:56<01:04,  2.00it/s]
Epoch 13 Iter 96: loss 0.23663. :  43%|███████████████████▎                         | 96/224 [00:56<01:03,  2.00it/s]
Epoch 13 Iter 97: loss 0.24065. :  43%|███████████████████▎                         | 96/224 [00:57<01:03,  2.00it/s]
Epoch 13 Iter 97: loss 0.24065. :  43%|███████████████████▍                         | 97/224 [00:57<01:03,  1.99it/s]
Epoch 13 Iter 98: loss 0.25462. :  43%|███████████████████▍                         | 97/224 [00:57<01:03,  1.99it/s]
Epoch 13 Iter 98: loss 0.25462. :  44%|███████████████████▋                         | 98/224 [00:57<01:03,  2.00it/s]
Epoch 13 Iter 99: loss 0.22387. :  44%|███████████████████▋                         | 98/224 [00:58<01:03,  2.00it/s]
Epoch 13 Iter 99: loss 0.22387. :  44%|███████████████████▉                         | 99/224 [00:58<01:02,  1.99it/s]
Epoch 13 Iter 100: loss 0.23887. :  44%|███████████████████▍                        | 99/224 [00:58<01:02,  1.99it/s]
Epoch 13 Iter 100: loss 0.23887. :  45%|███████████████████▏                       | 100/224 [00:58<01:02,  1.98it/s]
Epoch 13 Iter 101: loss 0.22088. :  45%|███████████████████▏                       | 100/224 [00:59<01:02,  1.98it/s]
Epoch 13 Iter 101: loss 0.22088. :  45%|███████████████████▍                       | 101/224 [00:59<01:02,  1.98it/s]
Epoch 13 Iter 102: loss 0.24151. :  45%|███████████████████▍                       | 101/224 [00:59<01:02,  1.98it/s]
Epoch 13 Iter 102: loss 0.24151. :  46%|███████████████████▌                       | 102/224 [00:59<01:01,  1.97it/s]
Epoch 13 Iter 103: loss 0.23183. :  46%|███████████████████▌                       | 102/224 [01:00<01:01,  1.97it/s]
Epoch 13 Iter 103: loss 0.23183. :  46%|███████████████████▊                       | 103/224 [01:00<01:01,  1.97it/s]
Epoch 13 Iter 104: loss 0.25258. :  46%|███████████████████▊                       | 103/224 [01:00<01:01,  1.97it/s]
Epoch 13 Iter 104: loss 0.25258. :  46%|███████████████████▉                       | 104/224 [01:00<01:01,  1.96it/s]
Epoch 13 Iter 105: loss 0.22329. :  46%|███████████████████▉                       | 104/224 [01:01<01:01,  1.96it/s]
Epoch 13 Iter 105: loss 0.22329. :  47%|████████████████████▏                      | 105/224 [01:01<01:00,  1.97it/s]
Epoch 13 Iter 106: loss 0.22731. :  47%|████████████████████▏                      | 105/224 [01:01<01:00,  1.97it/s]
Epoch 13 Iter 106: loss 0.22731. :  47%|████████████████████▎                      | 106/224 [01:01<01:00,  1.96it/s]
Epoch 13 Iter 107: loss 0.24163. :  47%|████████████████████▎                      | 106/224 [01:02<01:00,  1.96it/s]
Epoch 13 Iter 107: loss 0.24163. :  48%|████████████████████▌                      | 107/224 [01:02<00:59,  1.96it/s]
Epoch 13 Iter 108: loss 0.21941. :  48%|████████████████████▌                      | 107/224 [01:02<00:59,  1.96it/s]
Epoch 13 Iter 108: loss 0.21941. :  48%|████████████████████▋                      | 108/224 [01:02<00:59,  1.96it/s]
Epoch 13 Iter 109: loss 0.23390. :  48%|████████████████████▋                      | 108/224 [01:03<00:59,  1.96it/s]
Epoch 13 Iter 109: loss 0.23390. :  49%|████████████████████▉                      | 109/224 [01:03<00:58,  1.97it/s]
Epoch 13 Iter 110: loss 0.23628. :  49%|████████████████████▉                      | 109/224 [01:03<00:58,  1.97it/s]
Epoch 13 Iter 110: loss 0.23628. :  49%|█████████████████████                      | 110/224 [01:03<00:57,  1.98it/s]
Epoch 13 Iter 111: loss 0.23300. :  49%|█████████████████████                      | 110/224 [01:04<00:57,  1.98it/s]
Epoch 13 Iter 111: loss 0.23300. :  50%|█████████████████████▎                     | 111/224 [01:04<00:57,  1.98it/s]
Epoch 13 Iter 112: loss 0.22260. :  50%|█████████████████████▎                     | 111/224 [01:04<00:57,  1.98it/s]
Epoch 13 Iter 112: loss 0.22260. :  50%|█████████████████████▌                     | 112/224 [01:04<00:56,  1.98it/s]
Epoch 13 Iter 113: loss 0.21781. :  50%|█████████████████████▌                     | 112/224 [01:05<00:56,  1.98it/s]
Epoch 13 Iter 113: loss 0.21781. :  50%|█████████████████████▋                     | 113/224 [01:05<00:56,  1.97it/s]
Epoch 13 Iter 114: loss 0.24373. :  50%|█████████████████████▋                     | 113/224 [01:05<00:56,  1.97it/s]
Epoch 13 Iter 114: loss 0.24373. :  51%|█████████████████████▉                     | 114/224 [01:05<00:55,  1.98it/s]
Epoch 13 Iter 115: loss 0.24362. :  51%|█████████████████████▉                     | 114/224 [01:06<00:55,  1.98it/s]
Epoch 13 Iter 115: loss 0.24362. :  51%|██████████████████████                     | 115/224 [01:06<00:54,  1.99it/s]
Epoch 13 Iter 116: loss 0.23284. :  51%|██████████████████████                     | 115/224 [01:06<00:54,  1.99it/s]
Epoch 13 Iter 116: loss 0.23284. :  52%|██████████████████████▎                    | 116/224 [01:06<00:54,  2.00it/s]
Epoch 13 Iter 117: loss 0.23049. :  52%|██████████████████████▎                    | 116/224 [01:07<00:54,  2.00it/s]
Epoch 13 Iter 117: loss 0.23049. :  52%|██████████████████████▍                    | 117/224 [01:07<00:53,  1.99it/s]
Epoch 13 Iter 118: loss 0.23200. :  52%|██████████████████████▍                    | 117/224 [01:07<00:53,  1.99it/s]
Epoch 13 Iter 118: loss 0.23200. :  53%|██████████████████████▋                    | 118/224 [01:07<00:53,  1.99it/s]
Epoch 13 Iter 119: loss 0.24857. :  53%|██████████████████████▋                    | 118/224 [01:08<00:53,  1.99it/s]
Epoch 13 Iter 119: loss 0.24857. :  53%|██████████████████████▊                    | 119/224 [01:08<00:52,  1.99it/s]
Epoch 13 Iter 120: loss 0.25019. :  53%|██████████████████████▊                    | 119/224 [01:08<00:52,  1.99it/s]
Epoch 13 Iter 120: loss 0.25019. :  54%|███████████████████████                    | 120/224 [01:08<00:52,  1.99it/s]
Epoch 13 Iter 121: loss 0.22927. :  54%|███████████████████████                    | 120/224 [01:09<00:52,  1.99it/s]
Epoch 13 Iter 121: loss 0.22927. :  54%|███████████████████████▏                   | 121/224 [01:09<00:51,  2.00it/s]
Epoch 13 Iter 122: loss 0.23065. :  54%|███████████████████████▏                   | 121/224 [01:09<00:51,  2.00it/s]
Epoch 13 Iter 122: loss 0.23065. :  54%|███████████████████████▍                   | 122/224 [01:09<00:52,  1.93it/s]
Epoch 13 Iter 123: loss 0.23054. :  54%|███████████████████████▍                   | 122/224 [01:10<00:52,  1.93it/s]
Epoch 13 Iter 123: loss 0.23054. :  55%|███████████████████████▌                   | 123/224 [01:10<00:51,  1.95it/s]
Epoch 13 Iter 124: loss 0.22603. :  55%|███████████████████████▌                   | 123/224 [01:10<00:51,  1.95it/s]
Epoch 13 Iter 124: loss 0.22603. :  55%|███████████████████████▊                   | 124/224 [01:10<00:50,  1.97it/s]
Epoch 13 Iter 125: loss 0.23043. :  55%|███████████████████████▊                   | 124/224 [01:11<00:50,  1.97it/s]
Epoch 13 Iter 125: loss 0.23043. :  56%|███████████████████████▉                   | 125/224 [01:11<00:50,  1.96it/s]
Epoch 13 Iter 126: loss 0.25163. :  56%|███████████████████████▉                   | 125/224 [01:11<00:50,  1.96it/s]
Epoch 13 Iter 126: loss 0.25163. :  56%|████████████████████████▏                  | 126/224 [01:11<00:50,  1.93it/s]
Epoch 13 Iter 127: loss 0.21972. :  56%|████████████████████████▏                  | 126/224 [01:12<00:50,  1.93it/s]
Epoch 13 Iter 127: loss 0.21972. :  57%|████████████████████████▍                  | 127/224 [01:12<00:49,  1.94it/s]
Epoch 13 Iter 128: loss 0.24443. :  57%|████████████████████████▍                  | 127/224 [01:12<00:49,  1.94it/s]
Epoch 13 Iter 128: loss 0.24443. :  57%|████████████████████████▌                  | 128/224 [01:12<00:48,  1.97it/s]
Epoch 13 Iter 129: loss 0.23600. :  57%|████████████████████████▌                  | 128/224 [01:13<00:48,  1.97it/s]
Epoch 13 Iter 129: loss 0.23600. :  58%|████████████████████████▊                  | 129/224 [01:13<00:48,  1.97it/s]
Epoch 13 Iter 130: loss 0.23078. :  58%|████████████████████████▊                  | 129/224 [01:13<00:48,  1.97it/s]
Epoch 13 Iter 130: loss 0.23078. :  58%|████████████████████████▉                  | 130/224 [01:13<00:48,  1.95it/s]
Epoch 13 Iter 131: loss 0.22704. :  58%|████████████████████████▉                  | 130/224 [01:14<00:48,  1.95it/s]
Epoch 13 Iter 131: loss 0.22704. :  58%|█████████████████████████▏                 | 131/224 [01:14<00:47,  1.96it/s]
Epoch 13 Iter 132: loss 0.24886. :  58%|█████████████████████████▏                 | 131/224 [01:14<00:47,  1.96it/s]
Epoch 13 Iter 132: loss 0.24886. :  59%|█████████████████████████▎                 | 132/224 [01:14<00:46,  1.98it/s]
Epoch 13 Iter 133: loss 0.22517. :  59%|█████████████████████████▎                 | 132/224 [01:15<00:46,  1.98it/s]
Epoch 13 Iter 133: loss 0.22517. :  59%|█████████████████████████▌                 | 133/224 [01:15<00:45,  2.00it/s]
Epoch 13 Iter 134: loss 0.22049. :  59%|█████████████████████████▌                 | 133/224 [01:15<00:45,  2.00it/s]
Epoch 13 Iter 134: loss 0.22049. :  60%|█████████████████████████▋                 | 134/224 [01:15<00:46,  1.94it/s]
Epoch 13 Iter 135: loss 0.23590. :  60%|█████████████████████████▋                 | 134/224 [01:16<00:46,  1.94it/s]
Epoch 13 Iter 135: loss 0.23590. :  60%|█████████████████████████▉                 | 135/224 [01:16<00:45,  1.95it/s]
Epoch 13 Iter 136: loss 0.22657. :  60%|█████████████████████████▉                 | 135/224 [01:16<00:45,  1.95it/s]
Epoch 13 Iter 136: loss 0.22657. :  61%|██████████████████████████                 | 136/224 [01:16<00:45,  1.95it/s]
Epoch 13 Iter 137: loss 0.23392. :  61%|██████████████████████████                 | 136/224 [01:17<00:45,  1.95it/s]
Epoch 13 Iter 137: loss 0.23392. :  61%|██████████████████████████▎                | 137/224 [01:17<00:44,  1.96it/s]
Epoch 13 Iter 138: loss 0.25635. :  61%|██████████████████████████▎                | 137/224 [01:17<00:44,  1.96it/s]
Epoch 13 Iter 138: loss 0.25635. :  62%|██████████████████████████▍                | 138/224 [01:17<00:43,  1.97it/s]
Epoch 13 Iter 139: loss 0.21734. :  62%|██████████████████████████▍                | 138/224 [01:18<00:43,  1.97it/s]
Epoch 13 Iter 139: loss 0.21734. :  62%|██████████████████████████▋                | 139/224 [01:18<00:43,  1.97it/s]
Epoch 13 Iter 140: loss 0.21603. :  62%|██████████████████████████▋                | 139/224 [01:18<00:43,  1.97it/s]
Epoch 13 Iter 140: loss 0.21603. :  62%|██████████████████████████▉                | 140/224 [01:18<00:42,  1.98it/s]
Epoch 13 Iter 141: loss 0.22273. :  62%|██████████████████████████▉                | 140/224 [01:19<00:42,  1.98it/s]
Epoch 13 Iter 141: loss 0.22273. :  63%|███████████████████████████                | 141/224 [01:19<00:41,  1.98it/s]
Epoch 13 Iter 142: loss 0.23648. :  63%|███████████████████████████                | 141/224 [01:19<00:41,  1.98it/s]
Epoch 13 Iter 142: loss 0.23648. :  63%|███████████████████████████▎               | 142/224 [01:19<00:41,  1.99it/s]
Epoch 13 Iter 143: loss 0.22211. :  63%|███████████████████████████▎               | 142/224 [01:20<00:41,  1.99it/s]
Epoch 13 Iter 143: loss 0.22211. :  64%|███████████████████████████▍               | 143/224 [01:20<00:41,  1.94it/s]
Epoch 13 Iter 144: loss 0.25402. :  64%|███████████████████████████▍               | 143/224 [01:20<00:41,  1.94it/s]
Epoch 13 Iter 144: loss 0.25402. :  64%|███████████████████████████▋               | 144/224 [01:20<00:40,  1.96it/s]
Epoch 13 Iter 145: loss 0.24605. :  64%|███████████████████████████▋               | 144/224 [01:21<00:40,  1.96it/s]
Epoch 13 Iter 145: loss 0.24605. :  65%|███████████████████████████▊               | 145/224 [01:21<00:39,  1.98it/s]
Epoch 13 Iter 146: loss 0.24045. :  65%|███████████████████████████▊               | 145/224 [01:21<00:39,  1.98it/s]
Epoch 13 Iter 146: loss 0.24045. :  65%|████████████████████████████               | 146/224 [01:21<00:39,  1.99it/s]
Epoch 13 Iter 147: loss 0.23133. :  65%|████████████████████████████               | 146/224 [01:22<00:39,  1.99it/s]
Epoch 13 Iter 147: loss 0.23133. :  66%|████████████████████████████▏              | 147/224 [01:22<00:38,  1.99it/s]
Epoch 13 Iter 148: loss 0.22099. :  66%|████████████████████████████▏              | 147/224 [01:22<00:38,  1.99it/s]
Epoch 13 Iter 148: loss 0.22099. :  66%|████████████████████████████▍              | 148/224 [01:22<00:38,  2.00it/s]
Epoch 13 Iter 149: loss 0.23294. :  66%|████████████████████████████▍              | 148/224 [01:23<00:38,  2.00it/s]
Epoch 13 Iter 149: loss 0.23294. :  67%|████████████████████████████▌              | 149/224 [01:23<00:37,  1.99it/s]
Epoch 13 Iter 150: loss 0.24381. :  67%|████████████████████████████▌              | 149/224 [01:23<00:37,  1.99it/s]
Epoch 13 Iter 150: loss 0.24381. :  67%|████████████████████████████▊              | 150/224 [01:23<00:37,  1.97it/s]
Epoch 13 Iter 151: loss 0.23997. :  67%|████████████████████████████▊              | 150/224 [01:24<00:37,  1.97it/s]
Epoch 13 Iter 151: loss 0.23997. :  67%|████████████████████████████▉              | 151/224 [01:24<00:37,  1.93it/s]
Epoch 13 Iter 152: loss 0.22162. :  67%|████████████████████████████▉              | 151/224 [01:24<00:37,  1.93it/s]
Epoch 13 Iter 152: loss 0.22162. :  68%|█████████████████████████████▏             | 152/224 [01:24<00:37,  1.94it/s]
Epoch 13 Iter 153: loss 0.24291. :  68%|█████████████████████████████▏             | 152/224 [01:25<00:37,  1.94it/s]
Epoch 13 Iter 153: loss 0.24291. :  68%|█████████████████████████████▎             | 153/224 [01:25<00:36,  1.96it/s]
Epoch 13 Iter 154: loss 0.24653. :  68%|█████████████████████████████▎             | 153/224 [01:25<00:36,  1.96it/s]
Epoch 13 Iter 154: loss 0.24653. :  69%|█████████████████████████████▌             | 154/224 [01:25<00:35,  1.97it/s]
Epoch 13 Iter 155: loss 0.24089. :  69%|█████████████████████████████▌             | 154/224 [01:26<00:35,  1.97it/s]
Epoch 13 Iter 155: loss 0.24089. :  69%|█████████████████████████████▊             | 155/224 [01:26<00:34,  1.98it/s]
Epoch 13 Iter 156: loss 0.22521. :  69%|█████████████████████████████▊             | 155/224 [01:26<00:34,  1.98it/s]
Epoch 13 Iter 156: loss 0.22521. :  70%|█████████████████████████████▉             | 156/224 [01:26<00:34,  1.99it/s]
Epoch 13 Iter 157: loss 0.22297. :  70%|█████████████████████████████▉             | 156/224 [01:27<00:34,  1.99it/s]
Epoch 13 Iter 157: loss 0.22297. :  70%|██████████████████████████████▏            | 157/224 [01:27<00:34,  1.94it/s]
Epoch 13 Iter 158: loss 0.23572. :  70%|██████████████████████████████▏            | 157/224 [01:28<00:34,  1.94it/s]
Epoch 13 Iter 158: loss 0.23572. :  71%|██████████████████████████████▎            | 158/224 [01:28<00:34,  1.90it/s]
Epoch 13 Iter 159: loss 0.22024. :  71%|██████████████████████████████▎            | 158/224 [01:28<00:34,  1.90it/s]
Epoch 13 Iter 159: loss 0.22024. :  71%|██████████████████████████████▌            | 159/224 [01:28<00:33,  1.92it/s]
Epoch 13 Iter 160: loss 0.23983. :  71%|██████████████████████████████▌            | 159/224 [01:29<00:33,  1.92it/s]
Epoch 13 Iter 160: loss 0.23983. :  71%|██████████████████████████████▋            | 160/224 [01:29<00:33,  1.94it/s]
Epoch 13 Iter 161: loss 0.23831. :  71%|██████████████████████████████▋            | 160/224 [01:29<00:33,  1.94it/s]
Epoch 13 Iter 161: loss 0.23831. :  72%|██████████████████████████████▉            | 161/224 [01:29<00:32,  1.95it/s]
Epoch 13 Iter 162: loss 0.24032. :  72%|██████████████████████████████▉            | 161/224 [01:30<00:32,  1.95it/s]
Epoch 13 Iter 162: loss 0.24032. :  72%|███████████████████████████████            | 162/224 [01:30<00:31,  1.96it/s]
Epoch 13 Iter 163: loss 0.22420. :  72%|███████████████████████████████            | 162/224 [01:30<00:31,  1.96it/s]
Epoch 13 Iter 163: loss 0.22420. :  73%|███████████████████████████████▎           | 163/224 [01:30<00:30,  1.97it/s]
Epoch 13 Iter 164: loss 0.25137. :  73%|███████████████████████████████▎           | 163/224 [01:31<00:30,  1.97it/s]
Epoch 13 Iter 164: loss 0.25137. :  73%|███████████████████████████████▍           | 164/224 [01:31<00:30,  1.98it/s]
Epoch 13 Iter 165: loss 0.24897. :  73%|███████████████████████████████▍           | 164/224 [01:31<00:30,  1.98it/s]
Epoch 13 Iter 165: loss 0.24897. :  74%|███████████████████████████████▋           | 165/224 [01:31<00:29,  1.97it/s]
Epoch 13 Iter 166: loss 0.22966. :  74%|███████████████████████████████▋           | 165/224 [01:32<00:29,  1.97it/s]
Epoch 13 Iter 166: loss 0.22966. :  74%|███████████████████████████████▊           | 166/224 [01:32<00:30,  1.93it/s]
Epoch 13 Iter 167: loss 0.23904. :  74%|███████████████████████████████▊           | 166/224 [01:32<00:30,  1.93it/s]
Epoch 13 Iter 167: loss 0.23904. :  75%|████████████████████████████████           | 167/224 [01:32<00:29,  1.93it/s]
Epoch 13 Iter 168: loss 0.24371. :  75%|████████████████████████████████           | 167/224 [01:33<00:29,  1.93it/s]
Epoch 13 Iter 168: loss 0.24371. :  75%|████████████████████████████████▎          | 168/224 [01:33<00:28,  1.94it/s]
Epoch 13 Iter 169: loss 0.24175. :  75%|████████████████████████████████▎          | 168/224 [01:33<00:28,  1.94it/s]
Epoch 13 Iter 169: loss 0.24175. :  75%|████████████████████████████████▍          | 169/224 [01:33<00:28,  1.96it/s]
Epoch 13 Iter 170: loss 0.23555. :  75%|████████████████████████████████▍          | 169/224 [01:34<00:28,  1.96it/s]
Epoch 13 Iter 170: loss 0.23555. :  76%|████████████████████████████████▋          | 170/224 [01:34<00:27,  1.98it/s]
Epoch 13 Iter 171: loss 0.24607. :  76%|████████████████████████████████▋          | 170/224 [01:34<00:27,  1.98it/s]
Epoch 13 Iter 171: loss 0.24607. :  76%|████████████████████████████████▊          | 171/224 [01:34<00:26,  2.00it/s]
Epoch 13 Iter 172: loss 0.22178. :  76%|████████████████████████████████▊          | 171/224 [01:35<00:26,  2.00it/s]
Epoch 13 Iter 172: loss 0.22178. :  77%|█████████████████████████████████          | 172/224 [01:35<00:26,  1.99it/s]
Epoch 13 Iter 173: loss 0.23650. :  77%|█████████████████████████████████          | 172/224 [01:35<00:26,  1.99it/s]
Epoch 13 Iter 173: loss 0.23650. :  77%|█████████████████████████████████▏         | 173/224 [01:35<00:26,  1.92it/s]
Epoch 13 Iter 174: loss 0.23131. :  77%|█████████████████████████████████▏         | 173/224 [01:36<00:26,  1.92it/s]
Epoch 13 Iter 174: loss 0.23131. :  78%|█████████████████████████████████▍         | 174/224 [01:36<00:25,  1.95it/s]
Epoch 13 Iter 175: loss 0.25796. :  78%|█████████████████████████████████▍         | 174/224 [01:36<00:25,  1.95it/s]
Epoch 13 Iter 175: loss 0.25796. :  78%|█████████████████████████████████▌         | 175/224 [01:36<00:24,  1.97it/s]
Epoch 13 Iter 176: loss 0.22805. :  78%|█████████████████████████████████▌         | 175/224 [01:37<00:24,  1.97it/s]
Epoch 13 Iter 176: loss 0.22805. :  79%|█████████████████████████████████▊         | 176/224 [01:37<00:24,  1.97it/s]
Epoch 13 Iter 177: loss 0.24028. :  79%|█████████████████████████████████▊         | 176/224 [01:37<00:24,  1.97it/s]
Epoch 13 Iter 177: loss 0.24028. :  79%|█████████████████████████████████▉         | 177/224 [01:37<00:23,  1.98it/s]
Epoch 13 Iter 178: loss 0.23874. :  79%|█████████████████████████████████▉         | 177/224 [01:38<00:23,  1.98it/s]
Epoch 13 Iter 178: loss 0.23874. :  79%|██████████████████████████████████▏        | 178/224 [01:38<00:23,  1.98it/s]
Epoch 13 Iter 179: loss 0.23514. :  79%|██████████████████████████████████▏        | 178/224 [01:38<00:23,  1.98it/s]
Epoch 13 Iter 179: loss 0.23514. :  80%|██████████████████████████████████▎        | 179/224 [01:38<00:22,  2.00it/s]
Epoch 13 Iter 180: loss 0.25040. :  80%|██████████████████████████████████▎        | 179/224 [01:39<00:22,  2.00it/s]
Epoch 13 Iter 180: loss 0.25040. :  80%|██████████████████████████████████▌        | 180/224 [01:39<00:21,  2.00it/s]
Epoch 13 Iter 181: loss 0.22665. :  80%|██████████████████████████████████▌        | 180/224 [01:39<00:21,  2.00it/s]
Epoch 13 Iter 181: loss 0.22665. :  81%|██████████████████████████████████▋        | 181/224 [01:39<00:21,  2.01it/s]
Epoch 13 Iter 182: loss 0.23898. :  81%|██████████████████████████████████▋        | 181/224 [01:40<00:21,  2.01it/s]
Epoch 13 Iter 182: loss 0.23898. :  81%|██████████████████████████████████▉        | 182/224 [01:40<00:20,  2.01it/s]
Epoch 13 Iter 183: loss 0.24671. :  81%|██████████████████████████████████▉        | 182/224 [01:40<00:20,  2.01it/s]
Epoch 13 Iter 183: loss 0.24671. :  82%|███████████████████████████████████▏       | 183/224 [01:40<00:20,  1.98it/s]
Epoch 13 Iter 184: loss 0.24130. :  82%|███████████████████████████████████▏       | 183/224 [01:41<00:20,  1.98it/s]
Epoch 13 Iter 184: loss 0.24130. :  82%|███████████████████████████████████▎       | 184/224 [01:41<00:20,  1.96it/s]
Epoch 13 Iter 185: loss 0.25075. :  82%|███████████████████████████████████▎       | 184/224 [01:41<00:20,  1.96it/s]
Epoch 13 Iter 185: loss 0.25075. :  83%|███████████████████████████████████▌       | 185/224 [01:41<00:19,  1.97it/s]
Epoch 13 Iter 186: loss 0.26387. :  83%|███████████████████████████████████▌       | 185/224 [01:42<00:19,  1.97it/s]
Epoch 13 Iter 186: loss 0.26387. :  83%|███████████████████████████████████▋       | 186/224 [01:42<00:19,  1.98it/s]
Epoch 13 Iter 187: loss 0.23102. :  83%|███████████████████████████████████▋       | 186/224 [01:42<00:19,  1.98it/s]
Epoch 13 Iter 187: loss 0.23102. :  83%|███████████████████████████████████▉       | 187/224 [01:42<00:18,  2.00it/s]
Epoch 13 Iter 188: loss 0.23047. :  83%|███████████████████████████████████▉       | 187/224 [01:43<00:18,  2.00it/s]
Epoch 13 Iter 188: loss 0.23047. :  84%|████████████████████████████████████       | 188/224 [01:43<00:18,  1.98it/s]
Epoch 13 Iter 189: loss 0.25504. :  84%|████████████████████████████████████       | 188/224 [01:43<00:18,  1.98it/s]
Epoch 13 Iter 189: loss 0.25504. :  84%|████████████████████████████████████▎      | 189/224 [01:43<00:17,  2.00it/s]
Epoch 13 Iter 190: loss 0.23291. :  84%|████████████████████████████████████▎      | 189/224 [01:44<00:17,  2.00it/s]
Epoch 13 Iter 190: loss 0.23291. :  85%|████████████████████████████████████▍      | 190/224 [01:44<00:17,  1.95it/s]
Epoch 13 Iter 191: loss 0.23846. :  85%|████████████████████████████████████▍      | 190/224 [01:44<00:17,  1.95it/s]
Epoch 13 Iter 191: loss 0.23846. :  85%|████████████████████████████████████▋      | 191/224 [01:44<00:17,  1.85it/s]
Epoch 13 Iter 192: loss 0.23015. :  85%|████████████████████████████████████▋      | 191/224 [01:45<00:17,  1.85it/s]
Epoch 13 Iter 192: loss 0.23015. :  86%|████████████████████████████████████▊      | 192/224 [01:45<00:16,  1.89it/s]
Epoch 13 Iter 193: loss 0.23606. :  86%|████████████████████████████████████▊      | 192/224 [01:45<00:16,  1.89it/s]
Epoch 13 Iter 193: loss 0.23606. :  86%|█████████████████████████████████████      | 193/224 [01:45<00:16,  1.92it/s]
Epoch 13 Iter 194: loss 0.24728. :  86%|█████████████████████████████████████      | 193/224 [01:46<00:16,  1.92it/s]
Epoch 13 Iter 194: loss 0.24728. :  87%|█████████████████████████████████████▏     | 194/224 [01:46<00:15,  1.95it/s]
Epoch 13 Iter 195: loss 0.23073. :  87%|█████████████████████████████████████▏     | 194/224 [01:46<00:15,  1.95it/s]
Epoch 13 Iter 195: loss 0.23073. :  87%|█████████████████████████████████████▍     | 195/224 [01:46<00:14,  1.95it/s]
Epoch 13 Iter 196: loss 0.23901. :  87%|█████████████████████████████████████▍     | 195/224 [01:47<00:14,  1.95it/s]
Epoch 13 Iter 196: loss 0.23901. :  88%|█████████████████████████████████████▋     | 196/224 [01:47<00:14,  1.96it/s]
Epoch 13 Iter 197: loss 0.23241. :  88%|█████████████████████████████████████▋     | 196/224 [01:47<00:14,  1.96it/s]
Epoch 13 Iter 197: loss 0.23241. :  88%|█████████████████████████████████████▊     | 197/224 [01:47<00:13,  1.97it/s]
Epoch 13 Iter 198: loss 0.24751. :  88%|█████████████████████████████████████▊     | 197/224 [01:48<00:13,  1.97it/s]
Epoch 13 Iter 198: loss 0.24751. :  88%|██████████████████████████████████████     | 198/224 [01:48<00:13,  1.98it/s]
Epoch 13 Iter 199: loss 0.23932. :  88%|██████████████████████████████████████     | 198/224 [01:48<00:13,  1.98it/s]
Epoch 13 Iter 199: loss 0.23932. :  89%|██████████████████████████████████████▏    | 199/224 [01:48<00:12,  1.99it/s]
Epoch 13 Iter 200: loss 0.23742. :  89%|██████████████████████████████████████▏    | 199/224 [01:49<00:12,  1.99it/s]
Epoch 13 Iter 200: loss 0.23742. :  89%|██████████████████████████████████████▍    | 200/224 [01:49<00:12,  1.99it/s]
Epoch 13 Iter 201: loss 0.22169. :  89%|██████████████████████████████████████▍    | 200/224 [01:49<00:12,  1.99it/s]
Epoch 13 Iter 201: loss 0.22169. :  90%|██████████████████████████████████████▌    | 201/224 [01:49<00:11,  1.98it/s]
Epoch 13 Iter 202: loss 0.23496. :  90%|██████████████████████████████████████▌    | 201/224 [01:50<00:11,  1.98it/s]
Epoch 13 Iter 202: loss 0.23496. :  90%|██████████████████████████████████████▊    | 202/224 [01:50<00:11,  2.00it/s]
Epoch 13 Iter 203: loss 0.21497. :  90%|██████████████████████████████████████▊    | 202/224 [01:50<00:11,  2.00it/s]
Epoch 13 Iter 203: loss 0.21497. :  91%|██████████████████████████████████████▉    | 203/224 [01:50<00:10,  2.00it/s]
Epoch 13 Iter 204: loss 0.25833. :  91%|██████████████████████████████████████▉    | 203/224 [01:51<00:10,  2.00it/s]
Epoch 13 Iter 204: loss 0.25833. :  91%|███████████████████████████████████████▏   | 204/224 [01:51<00:10,  1.98it/s]
Epoch 13 Iter 205: loss 0.25904. :  91%|███████████████████████████████████████▏   | 204/224 [01:51<00:10,  1.98it/s]
Epoch 13 Iter 205: loss 0.25904. :  92%|███████████████████████████████████████▎   | 205/224 [01:51<00:09,  1.99it/s]
Epoch 13 Iter 206: loss 0.25542. :  92%|███████████████████████████████████████▎   | 205/224 [01:52<00:09,  1.99it/s]
Epoch 13 Iter 206: loss 0.25542. :  92%|███████████████████████████████████████▌   | 206/224 [01:52<00:08,  2.01it/s]
Epoch 13 Iter 207: loss 0.24051. :  92%|███████████████████████████████████████▌   | 206/224 [01:52<00:08,  2.01it/s]
Epoch 13 Iter 207: loss 0.24051. :  92%|███████████████████████████████████████▋   | 207/224 [01:52<00:08,  2.02it/s]
Epoch 13 Iter 208: loss 0.23485. :  92%|███████████████████████████████████████▋   | 207/224 [01:53<00:08,  2.02it/s]
Epoch 13 Iter 208: loss 0.23485. :  93%|███████████████████████████████████████▉   | 208/224 [01:53<00:07,  2.03it/s]
Epoch 13 Iter 209: loss 0.23900. :  93%|███████████████████████████████████████▉   | 208/224 [01:53<00:07,  2.03it/s]
Epoch 13 Iter 209: loss 0.23900. :  93%|████████████████████████████████████████   | 209/224 [01:53<00:07,  2.03it/s]
Epoch 13 Iter 210: loss 0.24045. :  93%|████████████████████████████████████████   | 209/224 [01:54<00:07,  2.03it/s]
Epoch 13 Iter 210: loss 0.24045. :  94%|████████████████████████████████████████▎  | 210/224 [01:54<00:06,  2.04it/s]
Epoch 13 Iter 211: loss 0.22198. :  94%|████████████████████████████████████████▎  | 210/224 [01:54<00:06,  2.04it/s]
Epoch 13 Iter 211: loss 0.22198. :  94%|████████████████████████████████████████▌  | 211/224 [01:54<00:06,  2.01it/s]
Epoch 13 Iter 212: loss 0.25993. :  94%|████████████████████████████████████████▌  | 211/224 [01:55<00:06,  2.01it/s]
Epoch 13 Iter 212: loss 0.25993. :  95%|████████████████████████████████████████▋  | 212/224 [01:55<00:05,  2.02it/s]
Epoch 13 Iter 213: loss 0.23932. :  95%|████████████████████████████████████████▋  | 212/224 [01:55<00:05,  2.02it/s]
Epoch 13 Iter 213: loss 0.23932. :  95%|████████████████████████████████████████▉  | 213/224 [01:55<00:05,  2.02it/s]
Epoch 13 Iter 214: loss 0.24091. :  95%|████████████████████████████████████████▉  | 213/224 [01:56<00:05,  2.02it/s]
Epoch 13 Iter 214: loss 0.24091. :  96%|█████████████████████████████████████████  | 214/224 [01:56<00:04,  2.02it/s]
Epoch 13 Iter 215: loss 0.22583. :  96%|█████████████████████████████████████████  | 214/224 [01:56<00:04,  2.02it/s]
Epoch 13 Iter 215: loss 0.22583. :  96%|█████████████████████████████████████████▎ | 215/224 [01:56<00:04,  2.01it/s]
Epoch 13 Iter 216: loss 0.21360. :  96%|█████████████████████████████████████████▎ | 215/224 [01:57<00:04,  2.01it/s]
Epoch 13 Iter 216: loss 0.21360. :  96%|█████████████████████████████████████████▍ | 216/224 [01:57<00:03,  2.02it/s]
Epoch 13 Iter 217: loss 0.23693. :  96%|█████████████████████████████████████████▍ | 216/224 [01:57<00:03,  2.02it/s]
Epoch 13 Iter 217: loss 0.23693. :  97%|█████████████████████████████████████████▋ | 217/224 [01:57<00:03,  2.03it/s]
Epoch 13 Iter 218: loss 0.23740. :  97%|█████████████████████████████████████████▋ | 217/224 [01:58<00:03,  2.03it/s]
Epoch 13 Iter 218: loss 0.23740. :  97%|█████████████████████████████████████████▊ | 218/224 [01:58<00:02,  2.02it/s]
Epoch 13 Iter 219: loss 0.25038. :  97%|█████████████████████████████████████████▊ | 218/224 [01:58<00:02,  2.02it/s]
Epoch 13 Iter 219: loss 0.25038. :  98%|██████████████████████████████████████████ | 219/224 [01:58<00:02,  2.03it/s]
Epoch 13 Iter 220: loss 0.22199. :  98%|██████████████████████████████████████████ | 219/224 [01:59<00:02,  2.03it/s]
Epoch 13 Iter 220: loss 0.22199. :  98%|██████████████████████████████████████████▏| 220/224 [01:59<00:01,  2.03it/s]
Epoch 13 Iter 221: loss 0.22539. :  98%|██████████████████████████████████████████▏| 220/224 [01:59<00:01,  2.03it/s]
Epoch 13 Iter 221: loss 0.22539. :  99%|██████████████████████████████████████████▍| 221/224 [01:59<00:01,  2.03it/s]
Epoch 13 Iter 222: loss 0.23849. :  99%|██████████████████████████████████████████▍| 221/224 [02:00<00:01,  2.03it/s]
Epoch 13 Iter 222: loss 0.23849. :  99%|██████████████████████████████████████████▌| 222/224 [02:00<00:00,  2.03it/s]
Epoch 13 Iter 223: loss 0.21703. :  99%|██████████████████████████████████████████▌| 222/224 [02:00<00:00,  2.03it/s]
Epoch 13 Iter 223: loss 0.21703. : 100%|██████████████████████████████████████████▊| 223/224 [02:00<00:00,  2.02it/s]
Epoch 13 Iter 224: loss 0.23475. : 100%|██████████████████████████████████████████▊| 223/224 [02:01<00:00,  2.02it/s]
Epoch 13 Iter 224: loss 0.23475. : 100%|███████████████████████████████████████████| 224/224 [02:01<00:00,  2.02it/s]
Epoch 13 Iter 224: loss 0.23475. : 100%|███████████████████████████████████████████| 224/224 [02:01<00:00,  1.85it/s]

    Train loss: 0.23512
    Valid loss: 0.23663
       Valid loss recons: 0.22621
       Valid loss KL-D:   1.0415
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.22984. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.22984. :   0%|▏                                              | 1/224 [00:00<02:21,  1.57it/s]
Epoch 14 Iter 2: loss 0.24050. :   0%|▏                                              | 1/224 [00:01<02:21,  1.57it/s]
Epoch 14 Iter 2: loss 0.24050. :   1%|▍                                              | 2/224 [00:01<02:37,  1.41it/s]
Epoch 14 Iter 3: loss 0.22836. :   1%|▍                                              | 2/224 [00:01<02:37,  1.41it/s]
Epoch 14 Iter 3: loss 0.22836. :   1%|▋                                              | 3/224 [00:01<02:20,  1.58it/s]
Epoch 14 Iter 4: loss 0.22906. :   1%|▋                                              | 3/224 [00:02<02:20,  1.58it/s]
Epoch 14 Iter 4: loss 0.22906. :   2%|▊                                              | 4/224 [00:02<02:11,  1.67it/s]
Epoch 14 Iter 5: loss 0.26438. :   2%|▊                                              | 4/224 [00:03<02:11,  1.67it/s]
Epoch 14 Iter 5: loss 0.26438. :   2%|█                                              | 5/224 [00:03<02:07,  1.71it/s]
Epoch 14 Iter 6: loss 0.23308. :   2%|█                                              | 5/224 [00:03<02:07,  1.71it/s]
Epoch 14 Iter 6: loss 0.23308. :   3%|█▎                                             | 6/224 [00:03<02:05,  1.74it/s]
Epoch 14 Iter 7: loss 0.25757. :   3%|█▎                                             | 6/224 [00:04<02:05,  1.74it/s]
Epoch 14 Iter 7: loss 0.25757. :   3%|█▍                                             | 7/224 [00:04<02:03,  1.75it/s]
Epoch 14 Iter 8: loss 0.23326. :   3%|█▍                                             | 7/224 [00:04<02:03,  1.75it/s]
Epoch 14 Iter 8: loss 0.23326. :   4%|█▋                                             | 8/224 [00:04<02:18,  1.56it/s]
Epoch 14 Iter 9: loss 0.22419. :   4%|█▋                                             | 8/224 [00:05<02:18,  1.56it/s]
Epoch 14 Iter 9: loss 0.22419. :   4%|█▉                                             | 9/224 [00:05<02:19,  1.54it/s]
Epoch 14 Iter 10: loss 0.24179. :   4%|█▊                                            | 9/224 [00:06<02:19,  1.54it/s]
Epoch 14 Iter 10: loss 0.24179. :   4%|██                                           | 10/224 [00:06<02:11,  1.63it/s]
Epoch 14 Iter 11: loss 0.21657. :   4%|██                                           | 10/224 [00:06<02:11,  1.63it/s]
Epoch 14 Iter 11: loss 0.21657. :   5%|██▏                                          | 11/224 [00:06<02:07,  1.68it/s]
Epoch 14 Iter 12: loss 0.22966. :   5%|██▏                                          | 11/224 [00:07<02:07,  1.68it/s]
Epoch 14 Iter 12: loss 0.22966. :   5%|██▍                                          | 12/224 [00:07<02:03,  1.72it/s]
Epoch 14 Iter 13: loss 0.23255. :   5%|██▍                                          | 12/224 [00:08<02:03,  1.72it/s]
Epoch 14 Iter 13: loss 0.23255. :   6%|██▌                                          | 13/224 [00:08<02:16,  1.55it/s]
Epoch 14 Iter 14: loss 0.23036. :   6%|██▌                                          | 13/224 [00:08<02:16,  1.55it/s]
Epoch 14 Iter 14: loss 0.23036. :   6%|██▊                                          | 14/224 [00:08<02:15,  1.54it/s]
Epoch 14 Iter 15: loss 0.23857. :   6%|██▊                                          | 14/224 [00:09<02:15,  1.54it/s]
Epoch 14 Iter 15: loss 0.23857. :   7%|███                                          | 15/224 [00:09<02:09,  1.61it/s]
Epoch 14 Iter 16: loss 0.25757. :   7%|███                                          | 15/224 [00:09<02:09,  1.61it/s]
Epoch 14 Iter 16: loss 0.25757. :   7%|███▏                                         | 16/224 [00:09<02:12,  1.57it/s]
Epoch 14 Iter 17: loss 0.23455. :   7%|███▏                                         | 16/224 [00:10<02:12,  1.57it/s]
Epoch 14 Iter 17: loss 0.23455. :   8%|███▍                                         | 17/224 [00:10<02:19,  1.48it/s]
Epoch 14 Iter 18: loss 0.24198. :   8%|███▍                                         | 17/224 [00:11<02:19,  1.48it/s]
Epoch 14 Iter 18: loss 0.24198. :   8%|███▌                                         | 18/224 [00:11<02:24,  1.42it/s]
Epoch 14 Iter 19: loss 0.23608. :   8%|███▌                                         | 18/224 [00:12<02:24,  1.42it/s]
Epoch 14 Iter 19: loss 0.23608. :   8%|███▊                                         | 19/224 [00:12<02:27,  1.39it/s]
Epoch 14 Iter 20: loss 0.24477. :   8%|███▊                                         | 19/224 [00:12<02:27,  1.39it/s]
Epoch 14 Iter 20: loss 0.24477. :   9%|████                                         | 20/224 [00:12<02:29,  1.36it/s]
Epoch 14 Iter 21: loss 0.22532. :   9%|████                                         | 20/224 [00:13<02:29,  1.36it/s]
Epoch 14 Iter 21: loss 0.22532. :   9%|████▏                                        | 21/224 [00:13<02:21,  1.44it/s]
Epoch 14 Iter 22: loss 0.23427. :   9%|████▏                                        | 21/224 [00:14<02:21,  1.44it/s]
Epoch 14 Iter 22: loss 0.23427. :  10%|████▍                                        | 22/224 [00:14<02:16,  1.48it/s]
Epoch 14 Iter 23: loss 0.24177. :  10%|████▍                                        | 22/224 [00:14<02:16,  1.48it/s]
Epoch 14 Iter 23: loss 0.24177. :  10%|████▌                                        | 23/224 [00:14<02:21,  1.42it/s]
Epoch 14 Iter 24: loss 0.22522. :  10%|████▌                                        | 23/224 [00:15<02:21,  1.42it/s]
Epoch 14 Iter 24: loss 0.22522. :  11%|████▊                                        | 24/224 [00:15<02:13,  1.50it/s]
Epoch 14 Iter 25: loss 0.24389. :  11%|████▊                                        | 24/224 [00:16<02:13,  1.50it/s]
Epoch 14 Iter 25: loss 0.24389. :  11%|█████                                        | 25/224 [00:16<02:04,  1.60it/s]
Epoch 14 Iter 26: loss 0.21263. :  11%|█████                                        | 25/224 [00:16<02:04,  1.60it/s]
Epoch 14 Iter 26: loss 0.21263. :  12%|█████▏                                       | 26/224 [00:16<02:00,  1.65it/s]
Epoch 14 Iter 27: loss 0.22308. :  12%|█████▏                                       | 26/224 [00:17<02:00,  1.65it/s]
Epoch 14 Iter 27: loss 0.22308. :  12%|█████▍                                       | 27/224 [00:17<02:02,  1.61it/s]
Epoch 14 Iter 28: loss 0.25600. :  12%|█████▍                                       | 27/224 [00:17<02:02,  1.61it/s]
Epoch 14 Iter 28: loss 0.25600. :  12%|█████▋                                       | 28/224 [00:17<02:03,  1.59it/s]
Epoch 14 Iter 29: loss 0.24180. :  12%|█████▋                                       | 28/224 [00:18<02:03,  1.59it/s]
Epoch 14 Iter 29: loss 0.24180. :  13%|█████▊                                       | 29/224 [00:18<01:58,  1.65it/s]
Epoch 14 Iter 30: loss 0.24243. :  13%|█████▊                                       | 29/224 [00:19<01:58,  1.65it/s]
Epoch 14 Iter 30: loss 0.24243. :  13%|██████                                       | 30/224 [00:19<01:53,  1.71it/s]
Epoch 14 Iter 31: loss 0.22621. :  13%|██████                                       | 30/224 [00:19<01:53,  1.71it/s]
Epoch 14 Iter 31: loss 0.22621. :  14%|██████▏                                      | 31/224 [00:19<02:02,  1.57it/s]
Epoch 14 Iter 32: loss 0.23839. :  14%|██████▏                                      | 31/224 [00:20<02:02,  1.57it/s]
Epoch 14 Iter 32: loss 0.23839. :  14%|██████▍                                      | 32/224 [00:20<01:59,  1.60it/s]
Epoch 14 Iter 33: loss 0.23101. :  14%|██████▍                                      | 32/224 [00:20<01:59,  1.60it/s]
Epoch 14 Iter 33: loss 0.23101. :  15%|██████▋                                      | 33/224 [00:20<01:55,  1.65it/s]
Epoch 14 Iter 34: loss 0.24778. :  15%|██████▋                                      | 33/224 [00:21<01:55,  1.65it/s]
Epoch 14 Iter 34: loss 0.24778. :  15%|██████▊                                      | 34/224 [00:21<01:56,  1.63it/s]
Epoch 14 Iter 35: loss 0.23388. :  15%|██████▊                                      | 34/224 [00:22<01:56,  1.63it/s]
Epoch 14 Iter 35: loss 0.23388. :  16%|███████                                      | 35/224 [00:22<01:51,  1.70it/s]
Epoch 14 Iter 36: loss 0.20703. :  16%|███████                                      | 35/224 [00:22<01:51,  1.70it/s]
Epoch 14 Iter 36: loss 0.20703. :  16%|███████▏                                     | 36/224 [00:22<01:47,  1.74it/s]
Epoch 14 Iter 37: loss 0.23831. :  16%|███████▏                                     | 36/224 [00:23<01:47,  1.74it/s]
Epoch 14 Iter 37: loss 0.23831. :  17%|███████▍                                     | 37/224 [00:23<01:50,  1.70it/s]
Epoch 14 Iter 38: loss 0.24222. :  17%|███████▍                                     | 37/224 [00:23<01:50,  1.70it/s]
Epoch 14 Iter 38: loss 0.24222. :  17%|███████▋                                     | 38/224 [00:23<01:50,  1.68it/s]
Epoch 14 Iter 39: loss 0.22213. :  17%|███████▋                                     | 38/224 [00:24<01:50,  1.68it/s]
Epoch 14 Iter 39: loss 0.22213. :  17%|███████▊                                     | 39/224 [00:24<01:52,  1.64it/s]
Epoch 14 Iter 40: loss 0.21523. :  17%|███████▊                                     | 39/224 [00:25<01:52,  1.64it/s]
Epoch 14 Iter 40: loss 0.21523. :  18%|████████                                     | 40/224 [00:25<01:57,  1.57it/s]
Epoch 14 Iter 41: loss 0.19985. :  18%|████████                                     | 40/224 [00:26<01:57,  1.57it/s]
Epoch 14 Iter 41: loss 0.19985. :  18%|████████▏                                    | 41/224 [00:26<02:05,  1.46it/s]
Epoch 14 Iter 42: loss 0.23407. :  18%|████████▏                                    | 41/224 [00:26<02:05,  1.46it/s]
Epoch 14 Iter 42: loss 0.23407. :  19%|████████▍                                    | 42/224 [00:26<02:01,  1.50it/s]
Epoch 14 Iter 43: loss 0.23589. :  19%|████████▍                                    | 42/224 [00:27<02:01,  1.50it/s]
Epoch 14 Iter 43: loss 0.23589. :  19%|████████▋                                    | 43/224 [00:27<01:53,  1.60it/s]
Epoch 14 Iter 44: loss 0.22895. :  19%|████████▋                                    | 43/224 [00:27<01:53,  1.60it/s]
Epoch 14 Iter 44: loss 0.22895. :  20%|████████▊                                    | 44/224 [00:27<01:50,  1.63it/s]
Epoch 14 Iter 45: loss 0.23292. :  20%|████████▊                                    | 44/224 [00:28<01:50,  1.63it/s]
Epoch 14 Iter 45: loss 0.23292. :  20%|█████████                                    | 45/224 [00:28<01:51,  1.61it/s]
Epoch 14 Iter 46: loss 0.21933. :  20%|█████████                                    | 45/224 [00:29<01:51,  1.61it/s]
Epoch 14 Iter 46: loss 0.21933. :  21%|█████████▏                                   | 46/224 [00:29<01:51,  1.59it/s]
Epoch 14 Iter 47: loss 0.23549. :  21%|█████████▏                                   | 46/224 [00:29<01:51,  1.59it/s]
Epoch 14 Iter 47: loss 0.23549. :  21%|█████████▍                                   | 47/224 [00:29<01:46,  1.66it/s]
Epoch 14 Iter 48: loss 0.22328. :  21%|█████████▍                                   | 47/224 [00:30<01:46,  1.66it/s]
Epoch 14 Iter 48: loss 0.22328. :  21%|█████████▋                                   | 48/224 [00:30<01:43,  1.71it/s]
Epoch 14 Iter 49: loss 0.23121. :  21%|█████████▋                                   | 48/224 [00:30<01:43,  1.71it/s]
Epoch 14 Iter 49: loss 0.23121. :  22%|█████████▊                                   | 49/224 [00:30<01:39,  1.75it/s]
Epoch 14 Iter 50: loss 0.24359. :  22%|█████████▊                                   | 49/224 [00:31<01:39,  1.75it/s]
Epoch 14 Iter 50: loss 0.24359. :  22%|██████████                                   | 50/224 [00:31<01:37,  1.79it/s]
Epoch 14 Iter 51: loss 0.22262. :  22%|██████████                                   | 50/224 [00:31<01:37,  1.79it/s]
Epoch 14 Iter 51: loss 0.22262. :  23%|██████████▏                                  | 51/224 [00:31<01:37,  1.78it/s]
Epoch 14 Iter 52: loss 0.21818. :  23%|██████████▏                                  | 51/224 [00:32<01:37,  1.78it/s]
Epoch 14 Iter 52: loss 0.21818. :  23%|██████████▍                                  | 52/224 [00:32<01:35,  1.80it/s]
Epoch 14 Iter 53: loss 0.23634. :  23%|██████████▍                                  | 52/224 [00:32<01:35,  1.80it/s]
Epoch 14 Iter 53: loss 0.23634. :  24%|██████████▋                                  | 53/224 [00:32<01:34,  1.81it/s]
Epoch 14 Iter 54: loss 0.23967. :  24%|██████████▋                                  | 53/224 [00:33<01:34,  1.81it/s]
Epoch 14 Iter 54: loss 0.23967. :  24%|██████████▊                                  | 54/224 [00:33<01:35,  1.78it/s]
Epoch 14 Iter 55: loss 0.24198. :  24%|██████████▊                                  | 54/224 [00:34<01:35,  1.78it/s]
Epoch 14 Iter 55: loss 0.24198. :  25%|███████████                                  | 55/224 [00:34<01:35,  1.78it/s]
Epoch 14 Iter 56: loss 0.24280. :  25%|███████████                                  | 55/224 [00:34<01:35,  1.78it/s]
Epoch 14 Iter 56: loss 0.24280. :  25%|███████████▎                                 | 56/224 [00:34<01:32,  1.81it/s]
Epoch 14 Iter 57: loss 0.24048. :  25%|███████████▎                                 | 56/224 [00:35<01:32,  1.81it/s]
Epoch 14 Iter 57: loss 0.24048. :  25%|███████████▍                                 | 57/224 [00:35<01:42,  1.63it/s]
Epoch 14 Iter 58: loss 0.25167. :  25%|███████████▍                                 | 57/224 [00:36<01:42,  1.63it/s]
Epoch 14 Iter 58: loss 0.25167. :  26%|███████████▋                                 | 58/224 [00:36<01:47,  1.54it/s]
Epoch 14 Iter 59: loss 0.22864. :  26%|███████████▋                                 | 58/224 [00:36<01:47,  1.54it/s]
Epoch 14 Iter 59: loss 0.22864. :  26%|███████████▊                                 | 59/224 [00:36<01:49,  1.51it/s]
Epoch 14 Iter 60: loss 0.22159. :  26%|███████████▊                                 | 59/224 [00:37<01:49,  1.51it/s]
Epoch 14 Iter 60: loss 0.22159. :  27%|████████████                                 | 60/224 [00:37<01:42,  1.60it/s]
Epoch 14 Iter 61: loss 0.24062. :  27%|████████████                                 | 60/224 [00:37<01:42,  1.60it/s]
Epoch 14 Iter 61: loss 0.24062. :  27%|████████████▎                                | 61/224 [00:37<01:37,  1.67it/s]
Epoch 14 Iter 62: loss 0.22976. :  27%|████████████▎                                | 61/224 [00:38<01:37,  1.67it/s]
Epoch 14 Iter 62: loss 0.22976. :  28%|████████████▍                                | 62/224 [00:38<01:34,  1.72it/s]
Epoch 14 Iter 63: loss 0.23760. :  28%|████████████▍                                | 62/224 [00:38<01:34,  1.72it/s]
Epoch 14 Iter 63: loss 0.23760. :  28%|████████████▋                                | 63/224 [00:38<01:32,  1.74it/s]
Epoch 14 Iter 64: loss 0.24286. :  28%|████████████▋                                | 63/224 [00:39<01:32,  1.74it/s]
Epoch 14 Iter 64: loss 0.24286. :  29%|████████████▊                                | 64/224 [00:39<01:31,  1.76it/s]
Epoch 14 Iter 65: loss 0.23023. :  29%|████████████▊                                | 64/224 [00:40<01:31,  1.76it/s]
Epoch 14 Iter 65: loss 0.23023. :  29%|█████████████                                | 65/224 [00:40<01:38,  1.61it/s]
Epoch 14 Iter 66: loss 0.22293. :  29%|█████████████                                | 65/224 [00:40<01:38,  1.61it/s]
Epoch 14 Iter 66: loss 0.22293. :  29%|█████████████▎                               | 66/224 [00:40<01:33,  1.69it/s]
Epoch 14 Iter 67: loss 0.23088. :  29%|█████████████▎                               | 66/224 [00:41<01:33,  1.69it/s]
Epoch 14 Iter 67: loss 0.23088. :  30%|█████████████▍                               | 67/224 [00:41<01:33,  1.67it/s]
Epoch 14 Iter 68: loss 0.22421. :  30%|█████████████▍                               | 67/224 [00:42<01:33,  1.67it/s]
Epoch 14 Iter 68: loss 0.22421. :  30%|█████████████▋                               | 68/224 [00:42<01:38,  1.58it/s]
Epoch 14 Iter 69: loss 0.21911. :  30%|█████████████▋                               | 68/224 [00:42<01:38,  1.58it/s]
Epoch 14 Iter 69: loss 0.21911. :  31%|█████████████▊                               | 69/224 [00:42<01:40,  1.54it/s]
Epoch 14 Iter 70: loss 0.22289. :  31%|█████████████▊                               | 69/224 [00:43<01:40,  1.54it/s]
Epoch 14 Iter 70: loss 0.22289. :  31%|██████████████                               | 70/224 [00:43<01:45,  1.46it/s]
Epoch 14 Iter 71: loss 0.23008. :  31%|██████████████                               | 70/224 [00:44<01:45,  1.46it/s]
Epoch 14 Iter 71: loss 0.23008. :  32%|██████████████▎                              | 71/224 [00:44<01:49,  1.39it/s]
Epoch 14 Iter 72: loss 0.25425. :  32%|██████████████▎                              | 71/224 [00:45<01:49,  1.39it/s]
Epoch 14 Iter 72: loss 0.25425. :  32%|██████████████▍                              | 72/224 [00:45<01:50,  1.38it/s]
Epoch 14 Iter 73: loss 0.23594. :  32%|██████████████▍                              | 72/224 [00:45<01:50,  1.38it/s]
Epoch 14 Iter 73: loss 0.23594. :  33%|██████████████▋                              | 73/224 [00:45<01:51,  1.36it/s]
Epoch 14 Iter 74: loss 0.21301. :  33%|██████████████▋                              | 73/224 [00:46<01:51,  1.36it/s]
Epoch 14 Iter 74: loss 0.21301. :  33%|██████████████▊                              | 74/224 [00:46<01:52,  1.34it/s]
Epoch 14 Iter 75: loss 0.22463. :  33%|██████████████▊                              | 74/224 [00:47<01:52,  1.34it/s]
Epoch 14 Iter 75: loss 0.22463. :  33%|███████████████                              | 75/224 [00:47<01:52,  1.33it/s]
Epoch 14 Iter 76: loss 0.25092. :  33%|███████████████                              | 75/224 [00:48<01:52,  1.33it/s]
Epoch 14 Iter 76: loss 0.25092. :  34%|███████████████▎                             | 76/224 [00:48<01:52,  1.32it/s]
Epoch 14 Iter 77: loss 0.21655. :  34%|███████████████▎                             | 76/224 [00:48<01:52,  1.32it/s]
Epoch 14 Iter 77: loss 0.21655. :  34%|███████████████▍                             | 77/224 [00:48<01:48,  1.36it/s]
Epoch 14 Iter 78: loss 0.22533. :  34%|███████████████▍                             | 77/224 [00:49<01:48,  1.36it/s]
Epoch 14 Iter 78: loss 0.22533. :  35%|███████████████▋                             | 78/224 [00:49<01:40,  1.45it/s]
Epoch 14 Iter 79: loss 0.23485. :  35%|███████████████▋                             | 78/224 [00:49<01:40,  1.45it/s]
Epoch 14 Iter 79: loss 0.23485. :  35%|███████████████▊                             | 79/224 [00:49<01:33,  1.56it/s]
Epoch 14 Iter 80: loss 0.21809. :  35%|███████████████▊                             | 79/224 [00:50<01:33,  1.56it/s]
Epoch 14 Iter 80: loss 0.21809. :  36%|████████████████                             | 80/224 [00:50<01:29,  1.61it/s]
Epoch 14 Iter 81: loss 0.23817. :  36%|████████████████                             | 80/224 [00:51<01:29,  1.61it/s]
Epoch 14 Iter 81: loss 0.23817. :  36%|████████████████▎                            | 81/224 [00:51<01:35,  1.50it/s]
Epoch 14 Iter 82: loss 0.24806. :  36%|████████████████▎                            | 81/224 [00:52<01:35,  1.50it/s]
Epoch 14 Iter 82: loss 0.24806. :  37%|████████████████▍                            | 82/224 [00:52<01:39,  1.43it/s]
Epoch 14 Iter 83: loss 0.24969. :  37%|████████████████▍                            | 82/224 [00:52<01:39,  1.43it/s]
Epoch 14 Iter 83: loss 0.24969. :  37%|████████████████▋                            | 83/224 [00:52<01:41,  1.38it/s]
Epoch 14 Iter 84: loss 0.23283. :  37%|████████████████▋                            | 83/224 [00:53<01:41,  1.38it/s]
Epoch 14 Iter 84: loss 0.23283. :  38%|████████████████▉                            | 84/224 [00:53<01:37,  1.44it/s]
Epoch 14 Iter 85: loss 0.24372. :  38%|████████████████▉                            | 84/224 [00:54<01:37,  1.44it/s]
Epoch 14 Iter 85: loss 0.24372. :  38%|█████████████████                            | 85/224 [00:54<01:31,  1.51it/s]
Epoch 14 Iter 86: loss 0.25495. :  38%|█████████████████                            | 85/224 [00:54<01:31,  1.51it/s]
Epoch 14 Iter 86: loss 0.25495. :  38%|█████████████████▎                           | 86/224 [00:54<01:27,  1.57it/s]
Epoch 14 Iter 87: loss 0.23417. :  38%|█████████████████▎                           | 86/224 [00:55<01:27,  1.57it/s]
Epoch 14 Iter 87: loss 0.23417. :  39%|█████████████████▍                           | 87/224 [00:55<01:23,  1.65it/s]
Epoch 14 Iter 88: loss 0.22419. :  39%|█████████████████▍                           | 87/224 [00:55<01:23,  1.65it/s]
Epoch 14 Iter 88: loss 0.22419. :  39%|█████████████████▋                           | 88/224 [00:55<01:19,  1.70it/s]
Epoch 14 Iter 89: loss 0.22557. :  39%|█████████████████▋                           | 88/224 [00:56<01:19,  1.70it/s]
Epoch 14 Iter 89: loss 0.22557. :  40%|█████████████████▉                           | 89/224 [00:56<01:17,  1.74it/s]
Epoch 14 Iter 90: loss 0.23796. :  40%|█████████████████▉                           | 89/224 [00:56<01:17,  1.74it/s]
Epoch 14 Iter 90: loss 0.23796. :  40%|██████████████████                           | 90/224 [00:56<01:17,  1.72it/s]
Epoch 14 Iter 91: loss 0.25431. :  40%|██████████████████                           | 90/224 [00:57<01:17,  1.72it/s]
Epoch 14 Iter 91: loss 0.25431. :  41%|██████████████████▎                          | 91/224 [00:57<01:24,  1.57it/s]
Epoch 14 Iter 92: loss 0.23458. :  41%|██████████████████▎                          | 91/224 [00:58<01:24,  1.57it/s]
Epoch 14 Iter 92: loss 0.23458. :  41%|██████████████████▍                          | 92/224 [00:58<01:28,  1.49it/s]
Epoch 14 Iter 93: loss 0.23117. :  41%|██████████████████▍                          | 92/224 [00:59<01:28,  1.49it/s]
Epoch 14 Iter 93: loss 0.23117. :  42%|██████████████████▋                          | 93/224 [00:59<01:31,  1.43it/s]
Epoch 14 Iter 94: loss 0.24615. :  42%|██████████████████▋                          | 93/224 [00:59<01:31,  1.43it/s]
Epoch 14 Iter 94: loss 0.24615. :  42%|██████████████████▉                          | 94/224 [00:59<01:33,  1.39it/s]
Epoch 14 Iter 95: loss 0.24064. :  42%|██████████████████▉                          | 94/224 [01:00<01:33,  1.39it/s]
Epoch 14 Iter 95: loss 0.24064. :  42%|███████████████████                          | 95/224 [01:00<01:30,  1.42it/s]
Epoch 14 Iter 96: loss 0.23829. :  42%|███████████████████                          | 95/224 [01:01<01:30,  1.42it/s]
Epoch 14 Iter 96: loss 0.23829. :  43%|███████████████████▎                         | 96/224 [01:01<01:23,  1.52it/s]
Epoch 14 Iter 97: loss 0.24043. :  43%|███████████████████▎                         | 96/224 [01:01<01:23,  1.52it/s]
Epoch 14 Iter 97: loss 0.24043. :  43%|███████████████████▍                         | 97/224 [01:01<01:19,  1.60it/s]
Epoch 14 Iter 98: loss 0.25298. :  43%|███████████████████▍                         | 97/224 [01:02<01:19,  1.60it/s]
Epoch 14 Iter 98: loss 0.25298. :  44%|███████████████████▋                         | 98/224 [01:02<01:15,  1.68it/s]
Epoch 14 Iter 99: loss 0.22370. :  44%|███████████████████▋                         | 98/224 [01:02<01:15,  1.68it/s]
Epoch 14 Iter 99: loss 0.22370. :  44%|███████████████████▉                         | 99/224 [01:02<01:12,  1.73it/s]
Epoch 14 Iter 100: loss 0.26108. :  44%|███████████████████▍                        | 99/224 [01:03<01:12,  1.73it/s]
Epoch 14 Iter 100: loss 0.26108. :  45%|███████████████████▏                       | 100/224 [01:03<01:11,  1.73it/s]
Epoch 14 Iter 101: loss 0.25897. :  45%|███████████████████▏                       | 100/224 [01:04<01:11,  1.73it/s]
Epoch 14 Iter 101: loss 0.25897. :  45%|███████████████████▍                       | 101/224 [01:04<01:18,  1.56it/s]
Epoch 14 Iter 102: loss 0.24932. :  45%|███████████████████▍                       | 101/224 [01:04<01:18,  1.56it/s]
Epoch 14 Iter 102: loss 0.24932. :  46%|███████████████████▌                       | 102/224 [01:04<01:23,  1.46it/s]
Epoch 14 Iter 103: loss 0.23154. :  46%|███████████████████▌                       | 102/224 [01:05<01:23,  1.46it/s]
Epoch 14 Iter 103: loss 0.23154. :  46%|███████████████████▊                       | 103/224 [01:05<01:26,  1.40it/s]
Epoch 14 Iter 104: loss 0.23909. :  46%|███████████████████▊                       | 103/224 [01:06<01:26,  1.40it/s]
Epoch 14 Iter 104: loss 0.23909. :  46%|███████████████████▉                       | 104/224 [01:06<01:21,  1.47it/s]
Epoch 14 Iter 105: loss 0.22678. :  46%|███████████████████▉                       | 104/224 [01:06<01:21,  1.47it/s]
Epoch 14 Iter 105: loss 0.22678. :  47%|████████████████████▏                      | 105/224 [01:06<01:16,  1.55it/s]
Epoch 14 Iter 106: loss 0.23224. :  47%|████████████████████▏                      | 105/224 [01:07<01:16,  1.55it/s]
Epoch 14 Iter 106: loss 0.23224. :  47%|████████████████████▎                      | 106/224 [01:07<01:16,  1.55it/s]
Epoch 14 Iter 107: loss 0.21228. :  47%|████████████████████▎                      | 106/224 [01:08<01:16,  1.55it/s]
Epoch 14 Iter 107: loss 0.21228. :  48%|████████████████████▌                      | 107/224 [01:08<01:11,  1.63it/s]
Epoch 14 Iter 108: loss 0.23853. :  48%|████████████████████▌                      | 107/224 [01:08<01:11,  1.63it/s]
Epoch 14 Iter 108: loss 0.23853. :  48%|████████████████████▋                      | 108/224 [01:08<01:08,  1.70it/s]
Epoch 14 Iter 109: loss 0.23898. :  48%|████████████████████▋                      | 108/224 [01:09<01:08,  1.70it/s]
Epoch 14 Iter 109: loss 0.23898. :  49%|████████████████████▉                      | 109/224 [01:09<01:10,  1.63it/s]
Epoch 14 Iter 110: loss 0.24248. :  49%|████████████████████▉                      | 109/224 [01:09<01:10,  1.63it/s]
Epoch 14 Iter 110: loss 0.24248. :  49%|█████████████████████                      | 110/224 [01:09<01:07,  1.69it/s]
Epoch 14 Iter 111: loss 0.26875. :  49%|█████████████████████                      | 110/224 [01:10<01:07,  1.69it/s]
Epoch 14 Iter 111: loss 0.26875. :  50%|█████████████████████▎                     | 111/224 [01:10<01:04,  1.75it/s]
Epoch 14 Iter 112: loss 0.26846. :  50%|█████████████████████▎                     | 111/224 [01:10<01:04,  1.75it/s]
Epoch 14 Iter 112: loss 0.26846. :  50%|█████████████████████▌                     | 112/224 [01:10<01:03,  1.76it/s]
Epoch 14 Iter 113: loss 0.23723. :  50%|█████████████████████▌                     | 112/224 [01:11<01:03,  1.76it/s]
Epoch 14 Iter 113: loss 0.23723. :  50%|█████████████████████▋                     | 113/224 [01:11<01:09,  1.60it/s]
Epoch 14 Iter 114: loss 0.21186. :  50%|█████████████████████▋                     | 113/224 [01:12<01:09,  1.60it/s]
Epoch 14 Iter 114: loss 0.21186. :  51%|█████████████████████▉                     | 114/224 [01:12<01:05,  1.67it/s]
Epoch 14 Iter 115: loss 0.24438. :  51%|█████████████████████▉                     | 114/224 [01:12<01:05,  1.67it/s]
Epoch 14 Iter 115: loss 0.24438. :  51%|██████████████████████                     | 115/224 [01:12<01:03,  1.72it/s]
Epoch 14 Iter 116: loss 0.22482. :  51%|██████████████████████                     | 115/224 [01:13<01:03,  1.72it/s]
Epoch 14 Iter 116: loss 0.22482. :  52%|██████████████████████▎                    | 116/224 [01:13<01:01,  1.76it/s]
Epoch 14 Iter 117: loss 0.24058. :  52%|██████████████████████▎                    | 116/224 [01:13<01:01,  1.76it/s]
Epoch 14 Iter 117: loss 0.24058. :  52%|██████████████████████▍                    | 117/224 [01:13<01:01,  1.73it/s]
Epoch 14 Iter 118: loss 0.25835. :  52%|██████████████████████▍                    | 117/224 [01:14<01:01,  1.73it/s]
Epoch 14 Iter 118: loss 0.25835. :  53%|██████████████████████▋                    | 118/224 [01:14<01:03,  1.66it/s]
Epoch 14 Iter 119: loss 0.22562. :  53%|██████████████████████▋                    | 118/224 [01:15<01:03,  1.66it/s]
Epoch 14 Iter 119: loss 0.22562. :  53%|██████████████████████▊                    | 119/224 [01:15<01:08,  1.52it/s]
Epoch 14 Iter 120: loss 0.25579. :  53%|██████████████████████▊                    | 119/224 [01:16<01:08,  1.52it/s]
Epoch 14 Iter 120: loss 0.25579. :  54%|███████████████████████                    | 120/224 [01:16<01:12,  1.44it/s]
Epoch 14 Iter 121: loss 0.22487. :  54%|███████████████████████                    | 120/224 [01:16<01:12,  1.44it/s]
Epoch 14 Iter 121: loss 0.22487. :  54%|███████████████████████▏                   | 121/224 [01:16<01:08,  1.51it/s]
Epoch 14 Iter 122: loss 0.24173. :  54%|███████████████████████▏                   | 121/224 [01:17<01:08,  1.51it/s]
Epoch 14 Iter 122: loss 0.24173. :  54%|███████████████████████▍                   | 122/224 [01:17<01:08,  1.49it/s]
Epoch 14 Iter 123: loss 0.22995. :  54%|███████████████████████▍                   | 122/224 [01:17<01:08,  1.49it/s]
Epoch 14 Iter 123: loss 0.22995. :  55%|███████████████████████▌                   | 123/224 [01:17<01:03,  1.59it/s]
Epoch 14 Iter 124: loss 0.23599. :  55%|███████████████████████▌                   | 123/224 [01:18<01:03,  1.59it/s]
Epoch 14 Iter 124: loss 0.23599. :  55%|███████████████████████▊                   | 124/224 [01:18<01:01,  1.63it/s]
Epoch 14 Iter 125: loss 0.22655. :  55%|███████████████████████▊                   | 124/224 [01:18<01:01,  1.63it/s]
Epoch 14 Iter 125: loss 0.22655. :  56%|███████████████████████▉                   | 125/224 [01:18<00:58,  1.68it/s]
Epoch 14 Iter 126: loss 0.21841. :  56%|███████████████████████▉                   | 125/224 [01:19<00:58,  1.68it/s]
Epoch 14 Iter 126: loss 0.21841. :  56%|████████████████████████▏                  | 126/224 [01:19<00:56,  1.73it/s]
Epoch 14 Iter 127: loss 0.22458. :  56%|████████████████████████▏                  | 126/224 [01:20<00:56,  1.73it/s]
Epoch 14 Iter 127: loss 0.22458. :  57%|████████████████████████▍                  | 127/224 [01:20<01:00,  1.60it/s]
Epoch 14 Iter 128: loss 0.24288. :  57%|████████████████████████▍                  | 127/224 [01:20<01:00,  1.60it/s]
Epoch 14 Iter 128: loss 0.24288. :  57%|████████████████████████▌                  | 128/224 [01:20<00:57,  1.67it/s]
Epoch 14 Iter 129: loss 0.23956. :  57%|████████████████████████▌                  | 128/224 [01:21<00:57,  1.67it/s]
Epoch 14 Iter 129: loss 0.23956. :  58%|████████████████████████▊                  | 129/224 [01:21<00:54,  1.73it/s]
Epoch 14 Iter 130: loss 0.22020. :  58%|████████████████████████▊                  | 129/224 [01:21<00:54,  1.73it/s]
Epoch 14 Iter 130: loss 0.22020. :  58%|████████████████████████▉                  | 130/224 [01:21<00:55,  1.70it/s]
Epoch 14 Iter 131: loss 0.21010. :  58%|████████████████████████▉                  | 130/224 [01:22<00:55,  1.70it/s]
Epoch 14 Iter 131: loss 0.21010. :  58%|█████████████████████████▏                 | 131/224 [01:22<00:56,  1.65it/s]
Epoch 14 Iter 132: loss 0.26388. :  58%|█████████████████████████▏                 | 131/224 [01:23<00:56,  1.65it/s]
Epoch 14 Iter 132: loss 0.26388. :  59%|█████████████████████████▎                 | 132/224 [01:23<00:58,  1.56it/s]
Epoch 14 Iter 133: loss 0.23225. :  59%|█████████████████████████▎                 | 132/224 [01:24<00:58,  1.56it/s]
Epoch 14 Iter 133: loss 0.23225. :  59%|█████████████████████████▌                 | 133/224 [01:24<01:01,  1.47it/s]
Epoch 14 Iter 134: loss 0.23116. :  59%|█████████████████████████▌                 | 133/224 [01:24<01:01,  1.47it/s]
Epoch 14 Iter 134: loss 0.23116. :  60%|█████████████████████████▋                 | 134/224 [01:24<01:02,  1.44it/s]
Epoch 14 Iter 135: loss 0.22458. :  60%|█████████████████████████▋                 | 134/224 [01:25<01:02,  1.44it/s]
Epoch 14 Iter 135: loss 0.22458. :  60%|█████████████████████████▉                 | 135/224 [01:25<00:57,  1.54it/s]
Epoch 14 Iter 136: loss 0.25735. :  60%|█████████████████████████▉                 | 135/224 [01:25<00:57,  1.54it/s]
Epoch 14 Iter 136: loss 0.25735. :  61%|██████████████████████████                 | 136/224 [01:25<00:54,  1.62it/s]
Epoch 14 Iter 137: loss 0.23995. :  61%|██████████████████████████                 | 136/224 [01:26<00:54,  1.62it/s]
Epoch 14 Iter 137: loss 0.23995. :  61%|██████████████████████████▎                | 137/224 [01:26<00:52,  1.66it/s]
Epoch 14 Iter 138: loss 0.23705. :  61%|██████████████████████████▎                | 137/224 [01:27<00:52,  1.66it/s]
Epoch 14 Iter 138: loss 0.23705. :  62%|██████████████████████████▍                | 138/224 [01:27<00:51,  1.68it/s]
Epoch 14 Iter 139: loss 0.23145. :  62%|██████████████████████████▍                | 138/224 [01:27<00:51,  1.68it/s]
Epoch 14 Iter 139: loss 0.23145. :  62%|██████████████████████████▋                | 139/224 [01:27<00:49,  1.72it/s]
Epoch 14 Iter 140: loss 0.24149. :  62%|██████████████████████████▋                | 139/224 [01:28<00:49,  1.72it/s]
Epoch 14 Iter 140: loss 0.24149. :  62%|██████████████████████████▉                | 140/224 [01:28<00:53,  1.57it/s]
Epoch 14 Iter 141: loss 0.24279. :  62%|██████████████████████████▉                | 140/224 [01:29<00:53,  1.57it/s]
Epoch 14 Iter 141: loss 0.24279. :  63%|███████████████████████████                | 141/224 [01:29<00:55,  1.48it/s]
Epoch 14 Iter 142: loss 0.25118. :  63%|███████████████████████████                | 141/224 [01:29<00:55,  1.48it/s]
Epoch 14 Iter 142: loss 0.25118. :  63%|███████████████████████████▎               | 142/224 [01:29<00:57,  1.43it/s]
Epoch 14 Iter 143: loss 0.21247. :  63%|███████████████████████████▎               | 142/224 [01:30<00:57,  1.43it/s]
Epoch 14 Iter 143: loss 0.21247. :  64%|███████████████████████████▍               | 143/224 [01:30<00:58,  1.39it/s]
Epoch 14 Iter 144: loss 0.22341. :  64%|███████████████████████████▍               | 143/224 [01:31<00:58,  1.39it/s]
Epoch 14 Iter 144: loss 0.22341. :  64%|███████████████████████████▋               | 144/224 [01:31<00:58,  1.36it/s]
Epoch 14 Iter 145: loss 0.24294. :  64%|███████████████████████████▋               | 144/224 [01:31<00:58,  1.36it/s]
Epoch 14 Iter 145: loss 0.24294. :  65%|███████████████████████████▊               | 145/224 [01:31<00:54,  1.45it/s]
Epoch 14 Iter 146: loss 0.24378. :  65%|███████████████████████████▊               | 145/224 [01:32<00:54,  1.45it/s]
Epoch 14 Iter 146: loss 0.24378. :  65%|████████████████████████████               | 146/224 [01:32<00:51,  1.51it/s]
Epoch 14 Iter 147: loss 0.24737. :  65%|████████████████████████████               | 146/224 [01:33<00:51,  1.51it/s]
Epoch 14 Iter 147: loss 0.24737. :  66%|████████████████████████████▏              | 147/224 [01:33<00:48,  1.59it/s]
Epoch 14 Iter 148: loss 0.22838. :  66%|████████████████████████████▏              | 147/224 [01:33<00:48,  1.59it/s]
Epoch 14 Iter 148: loss 0.22838. :  66%|████████████████████████████▍              | 148/224 [01:33<00:47,  1.59it/s]
Epoch 14 Iter 149: loss 0.24762. :  66%|████████████████████████████▍              | 148/224 [01:34<00:47,  1.59it/s]
Epoch 14 Iter 149: loss 0.24762. :  67%|████████████████████████████▌              | 149/224 [01:34<00:44,  1.67it/s]
Epoch 14 Iter 150: loss 0.22822. :  67%|████████████████████████████▌              | 149/224 [01:34<00:44,  1.67it/s]
Epoch 14 Iter 150: loss 0.22822. :  67%|████████████████████████████▊              | 150/224 [01:34<00:43,  1.69it/s]
Epoch 14 Iter 151: loss 0.24790. :  67%|████████████████████████████▊              | 150/224 [01:35<00:43,  1.69it/s]
Epoch 14 Iter 151: loss 0.24790. :  67%|████████████████████████████▉              | 151/224 [01:35<00:45,  1.62it/s]
Epoch 14 Iter 152: loss 0.23502. :  67%|████████████████████████████▉              | 151/224 [01:36<00:45,  1.62it/s]
Epoch 14 Iter 152: loss 0.23502. :  68%|█████████████████████████████▏             | 152/224 [01:36<00:45,  1.58it/s]
Epoch 14 Iter 153: loss 0.22127. :  68%|█████████████████████████████▏             | 152/224 [01:37<00:45,  1.58it/s]
Epoch 14 Iter 153: loss 0.22127. :  68%|█████████████████████████████▎             | 153/224 [01:37<00:48,  1.48it/s]
Epoch 14 Iter 154: loss 0.25028. :  68%|█████████████████████████████▎             | 153/224 [01:37<00:48,  1.48it/s]
Epoch 14 Iter 154: loss 0.25028. :  69%|█████████████████████████████▌             | 154/224 [01:37<00:46,  1.50it/s]
Epoch 14 Iter 155: loss 0.26953. :  69%|█████████████████████████████▌             | 154/224 [01:38<00:46,  1.50it/s]
Epoch 14 Iter 155: loss 0.26953. :  69%|█████████████████████████████▊             | 155/224 [01:38<00:45,  1.51it/s]
Epoch 14 Iter 156: loss 0.24693. :  69%|█████████████████████████████▊             | 155/224 [01:38<00:45,  1.51it/s]
Epoch 14 Iter 156: loss 0.24693. :  70%|█████████████████████████████▉             | 156/224 [01:38<00:43,  1.56it/s]
Epoch 14 Iter 157: loss 0.25033. :  70%|█████████████████████████████▉             | 156/224 [01:39<00:43,  1.56it/s]
Epoch 14 Iter 157: loss 0.25033. :  70%|██████████████████████████████▏            | 157/224 [01:39<00:41,  1.61it/s]
Epoch 14 Iter 158: loss 0.23124. :  70%|██████████████████████████████▏            | 157/224 [01:40<00:41,  1.61it/s]
Epoch 14 Iter 158: loss 0.23124. :  71%|██████████████████████████████▎            | 158/224 [01:40<00:39,  1.68it/s]
Epoch 14 Iter 159: loss 0.21356. :  71%|██████████████████████████████▎            | 158/224 [01:40<00:39,  1.68it/s]
Epoch 14 Iter 159: loss 0.21356. :  71%|██████████████████████████████▌            | 159/224 [01:40<00:38,  1.71it/s]
Epoch 14 Iter 160: loss 0.21851. :  71%|██████████████████████████████▌            | 159/224 [01:41<00:38,  1.71it/s]
Epoch 14 Iter 160: loss 0.21851. :  71%|██████████████████████████████▋            | 160/224 [01:41<00:36,  1.76it/s]
Epoch 14 Iter 161: loss 0.23487. :  71%|██████████████████████████████▋            | 160/224 [01:41<00:36,  1.76it/s]
Epoch 14 Iter 161: loss 0.23487. :  72%|██████████████████████████████▉            | 161/224 [01:41<00:36,  1.71it/s]
Epoch 14 Iter 162: loss 0.23111. :  72%|██████████████████████████████▉            | 161/224 [01:42<00:36,  1.71it/s]
Epoch 14 Iter 162: loss 0.23111. :  72%|███████████████████████████████            | 162/224 [01:42<00:37,  1.65it/s]
Epoch 14 Iter 163: loss 0.23620. :  72%|███████████████████████████████            | 162/224 [01:42<00:37,  1.65it/s]
Epoch 14 Iter 163: loss 0.23620. :  73%|███████████████████████████████▎           | 163/224 [01:42<00:35,  1.71it/s]
Epoch 14 Iter 164: loss 0.24366. :  73%|███████████████████████████████▎           | 163/224 [01:43<00:35,  1.71it/s]
Epoch 14 Iter 164: loss 0.24366. :  73%|███████████████████████████████▍           | 164/224 [01:43<00:34,  1.74it/s]
Epoch 14 Iter 165: loss 0.21729. :  73%|███████████████████████████████▍           | 164/224 [01:43<00:34,  1.74it/s]
Epoch 14 Iter 165: loss 0.21729. :  74%|███████████████████████████████▋           | 165/224 [01:43<00:33,  1.77it/s]
Epoch 14 Iter 166: loss 0.23057. :  74%|███████████████████████████████▋           | 165/224 [01:44<00:33,  1.77it/s]
Epoch 14 Iter 166: loss 0.23057. :  74%|███████████████████████████████▊           | 166/224 [01:44<00:32,  1.79it/s]
Epoch 14 Iter 167: loss 0.23854. :  74%|███████████████████████████████▊           | 166/224 [01:45<00:32,  1.79it/s]
Epoch 14 Iter 167: loss 0.23854. :  75%|████████████████████████████████           | 167/224 [01:45<00:31,  1.81it/s]
Epoch 14 Iter 168: loss 0.22119. :  75%|████████████████████████████████           | 167/224 [01:45<00:31,  1.81it/s]
Epoch 14 Iter 168: loss 0.22119. :  75%|████████████████████████████████▎          | 168/224 [01:45<00:34,  1.61it/s]
Epoch 14 Iter 169: loss 0.23498. :  75%|████████████████████████████████▎          | 168/224 [01:46<00:34,  1.61it/s]
Epoch 14 Iter 169: loss 0.23498. :  75%|████████████████████████████████▍          | 169/224 [01:46<00:37,  1.47it/s]
Epoch 14 Iter 170: loss 0.25527. :  75%|████████████████████████████████▍          | 169/224 [01:47<00:37,  1.47it/s]
Epoch 14 Iter 170: loss 0.25527. :  76%|████████████████████████████████▋          | 170/224 [01:47<00:38,  1.41it/s]
Epoch 14 Iter 171: loss 0.22519. :  76%|████████████████████████████████▋          | 170/224 [01:48<00:38,  1.41it/s]
Epoch 14 Iter 171: loss 0.22519. :  76%|████████████████████████████████▊          | 171/224 [01:48<00:36,  1.46it/s]
Epoch 14 Iter 172: loss 0.22025. :  76%|████████████████████████████████▊          | 171/224 [01:48<00:36,  1.46it/s]
Epoch 14 Iter 172: loss 0.22025. :  77%|█████████████████████████████████          | 172/224 [01:48<00:34,  1.53it/s]
Epoch 14 Iter 173: loss 0.22753. :  77%|█████████████████████████████████          | 172/224 [01:49<00:34,  1.53it/s]
Epoch 14 Iter 173: loss 0.22753. :  77%|█████████████████████████████████▏         | 173/224 [01:49<00:35,  1.44it/s]
Epoch 14 Iter 174: loss 0.23327. :  77%|█████████████████████████████████▏         | 173/224 [01:50<00:35,  1.44it/s]
Epoch 14 Iter 174: loss 0.23327. :  78%|█████████████████████████████████▍         | 174/224 [01:50<00:33,  1.51it/s]
Epoch 14 Iter 175: loss 0.21879. :  78%|█████████████████████████████████▍         | 174/224 [01:50<00:33,  1.51it/s]
Epoch 14 Iter 175: loss 0.21879. :  78%|█████████████████████████████████▌         | 175/224 [01:50<00:31,  1.57it/s]
Epoch 14 Iter 176: loss 0.23780. :  78%|█████████████████████████████████▌         | 175/224 [01:51<00:31,  1.57it/s]
Epoch 14 Iter 176: loss 0.23780. :  79%|█████████████████████████████████▊         | 176/224 [01:51<00:29,  1.65it/s]
Epoch 14 Iter 177: loss 0.23613. :  79%|█████████████████████████████████▊         | 176/224 [01:51<00:29,  1.65it/s]
Epoch 14 Iter 177: loss 0.23613. :  79%|█████████████████████████████████▉         | 177/224 [01:51<00:29,  1.57it/s]
Epoch 14 Iter 178: loss 0.22094. :  79%|█████████████████████████████████▉         | 177/224 [01:52<00:29,  1.57it/s]
Epoch 14 Iter 178: loss 0.22094. :  79%|██████████████████████████████████▏        | 178/224 [01:52<00:31,  1.47it/s]
Epoch 14 Iter 179: loss 0.25243. :  79%|██████████████████████████████████▏        | 178/224 [01:53<00:31,  1.47it/s]
Epoch 14 Iter 179: loss 0.25243. :  80%|██████████████████████████████████▎        | 179/224 [01:53<00:32,  1.39it/s]
Epoch 14 Iter 180: loss 0.24773. :  80%|██████████████████████████████████▎        | 179/224 [01:54<00:32,  1.39it/s]
Epoch 14 Iter 180: loss 0.24773. :  80%|██████████████████████████████████▌        | 180/224 [01:54<00:29,  1.49it/s]
Epoch 14 Iter 181: loss 0.24998. :  80%|██████████████████████████████████▌        | 180/224 [01:54<00:29,  1.49it/s]
Epoch 14 Iter 181: loss 0.24998. :  81%|██████████████████████████████████▋        | 181/224 [01:54<00:27,  1.58it/s]
Epoch 14 Iter 182: loss 0.22343. :  81%|██████████████████████████████████▋        | 181/224 [01:55<00:27,  1.58it/s]
Epoch 14 Iter 182: loss 0.22343. :  81%|██████████████████████████████████▉        | 182/224 [01:55<00:25,  1.63it/s]
Epoch 14 Iter 183: loss 0.25173. :  81%|██████████████████████████████████▉        | 182/224 [01:55<00:25,  1.63it/s]
Epoch 14 Iter 183: loss 0.25173. :  82%|███████████████████████████████████▏       | 183/224 [01:55<00:24,  1.69it/s]
Epoch 14 Iter 184: loss 0.23548. :  82%|███████████████████████████████████▏       | 183/224 [01:56<00:24,  1.69it/s]
Epoch 14 Iter 184: loss 0.23548. :  82%|███████████████████████████████████▎       | 184/224 [01:56<00:23,  1.69it/s]
Epoch 14 Iter 185: loss 0.24380. :  82%|███████████████████████████████████▎       | 184/224 [01:57<00:23,  1.69it/s]
Epoch 14 Iter 185: loss 0.24380. :  83%|███████████████████████████████████▌       | 185/224 [01:57<00:25,  1.55it/s]
Epoch 14 Iter 186: loss 0.21489. :  83%|███████████████████████████████████▌       | 185/224 [01:57<00:25,  1.55it/s]
Epoch 14 Iter 186: loss 0.21489. :  83%|███████████████████████████████████▋       | 186/224 [01:57<00:25,  1.47it/s]
Epoch 14 Iter 187: loss 0.21222. :  83%|███████████████████████████████████▋       | 186/224 [01:58<00:25,  1.47it/s]
Epoch 14 Iter 187: loss 0.21222. :  83%|███████████████████████████████████▉       | 187/224 [01:58<00:26,  1.42it/s]
Epoch 14 Iter 188: loss 0.23601. :  83%|███████████████████████████████████▉       | 187/224 [01:59<00:26,  1.42it/s]
Epoch 14 Iter 188: loss 0.23601. :  84%|████████████████████████████████████       | 188/224 [01:59<00:24,  1.45it/s]
Epoch 14 Iter 189: loss 0.24037. :  84%|████████████████████████████████████       | 188/224 [01:59<00:24,  1.45it/s]
Epoch 14 Iter 189: loss 0.24037. :  84%|████████████████████████████████████▎      | 189/224 [01:59<00:24,  1.44it/s]
Epoch 14 Iter 190: loss 0.23279. :  84%|████████████████████████████████████▎      | 189/224 [02:00<00:24,  1.44it/s]
Epoch 14 Iter 190: loss 0.23279. :  85%|████████████████████████████████████▍      | 190/224 [02:00<00:23,  1.42it/s]
Epoch 14 Iter 191: loss 0.22159. :  85%|████████████████████████████████████▍      | 190/224 [02:01<00:23,  1.42it/s]
Epoch 14 Iter 191: loss 0.22159. :  85%|████████████████████████████████████▋      | 191/224 [02:01<00:23,  1.39it/s]
Epoch 14 Iter 192: loss 0.22948. :  85%|████████████████████████████████████▋      | 191/224 [02:02<00:23,  1.39it/s]
Epoch 14 Iter 192: loss 0.22948. :  86%|████████████████████████████████████▊      | 192/224 [02:02<00:22,  1.43it/s]
Epoch 14 Iter 193: loss 0.21074. :  86%|████████████████████████████████████▊      | 192/224 [02:02<00:22,  1.43it/s]
Epoch 14 Iter 193: loss 0.21074. :  86%|█████████████████████████████████████      | 193/224 [02:02<00:22,  1.41it/s]
Epoch 14 Iter 194: loss 0.24402. :  86%|█████████████████████████████████████      | 193/224 [02:03<00:22,  1.41it/s]
Epoch 14 Iter 194: loss 0.24402. :  87%|█████████████████████████████████████▏     | 194/224 [02:03<00:20,  1.45it/s]
Epoch 14 Iter 195: loss 0.24320. :  87%|█████████████████████████████████████▏     | 194/224 [02:04<00:20,  1.45it/s]
Epoch 14 Iter 195: loss 0.24320. :  87%|█████████████████████████████████████▍     | 195/224 [02:04<00:19,  1.46it/s]
Epoch 14 Iter 196: loss 0.24065. :  87%|█████████████████████████████████████▍     | 195/224 [02:04<00:19,  1.46it/s]
Epoch 14 Iter 196: loss 0.24065. :  88%|█████████████████████████████████████▋     | 196/224 [02:04<00:18,  1.51it/s]
Epoch 14 Iter 197: loss 0.22057. :  88%|█████████████████████████████████████▋     | 196/224 [02:05<00:18,  1.51it/s]
Epoch 14 Iter 197: loss 0.22057. :  88%|█████████████████████████████████████▊     | 197/224 [02:05<00:17,  1.52it/s]
Epoch 14 Iter 198: loss 0.22708. :  88%|█████████████████████████████████████▊     | 197/224 [02:06<00:17,  1.52it/s]
Epoch 14 Iter 198: loss 0.22708. :  88%|██████████████████████████████████████     | 198/224 [02:06<00:17,  1.53it/s]
Epoch 14 Iter 199: loss 0.22610. :  88%|██████████████████████████████████████     | 198/224 [02:06<00:17,  1.53it/s]
Epoch 14 Iter 199: loss 0.22610. :  89%|██████████████████████████████████████▏    | 199/224 [02:06<00:15,  1.58it/s]
Epoch 14 Iter 200: loss 0.24330. :  89%|██████████████████████████████████████▏    | 199/224 [02:07<00:15,  1.58it/s]
Epoch 14 Iter 200: loss 0.24330. :  89%|██████████████████████████████████████▍    | 200/224 [02:07<00:16,  1.47it/s]
Epoch 14 Iter 201: loss 0.22990. :  89%|██████████████████████████████████████▍    | 200/224 [02:08<00:16,  1.47it/s]
Epoch 14 Iter 201: loss 0.22990. :  90%|██████████████████████████████████████▌    | 201/224 [02:08<00:16,  1.41it/s]
Epoch 14 Iter 202: loss 0.24430. :  90%|██████████████████████████████████████▌    | 201/224 [02:08<00:16,  1.41it/s]
Epoch 14 Iter 202: loss 0.24430. :  90%|██████████████████████████████████████▊    | 202/224 [02:08<00:16,  1.37it/s]
Epoch 14 Iter 203: loss 0.25133. :  90%|██████████████████████████████████████▊    | 202/224 [02:09<00:16,  1.37it/s]
Epoch 14 Iter 203: loss 0.25133. :  91%|██████████████████████████████████████▉    | 203/224 [02:09<00:15,  1.39it/s]
Epoch 14 Iter 204: loss 0.23370. :  91%|██████████████████████████████████████▉    | 203/224 [02:10<00:15,  1.39it/s]
Epoch 14 Iter 204: loss 0.23370. :  91%|███████████████████████████████████████▏   | 204/224 [02:10<00:14,  1.36it/s]
Epoch 14 Iter 205: loss 0.22737. :  91%|███████████████████████████████████████▏   | 204/224 [02:11<00:14,  1.36it/s]
Epoch 14 Iter 205: loss 0.22737. :  92%|███████████████████████████████████████▎   | 205/224 [02:11<00:13,  1.40it/s]
Epoch 14 Iter 206: loss 0.24380. :  92%|███████████████████████████████████████▎   | 205/224 [02:11<00:13,  1.40it/s]
Epoch 14 Iter 206: loss 0.24380. :  92%|███████████████████████████████████████▌   | 206/224 [02:11<00:11,  1.52it/s]
Epoch 14 Iter 207: loss 0.22615. :  92%|███████████████████████████████████████▌   | 206/224 [02:12<00:11,  1.52it/s]
Epoch 14 Iter 207: loss 0.22615. :  92%|███████████████████████████████████████▋   | 207/224 [02:12<00:10,  1.59it/s]
Epoch 14 Iter 208: loss 0.24487. :  92%|███████████████████████████████████████▋   | 207/224 [02:12<00:10,  1.59it/s]
Epoch 14 Iter 208: loss 0.24487. :  93%|███████████████████████████████████████▉   | 208/224 [02:12<00:09,  1.61it/s]
Epoch 14 Iter 209: loss 0.24090. :  93%|███████████████████████████████████████▉   | 208/224 [02:13<00:09,  1.61it/s]
Epoch 14 Iter 209: loss 0.24090. :  93%|████████████████████████████████████████   | 209/224 [02:13<00:08,  1.68it/s]
Epoch 14 Iter 210: loss 0.23243. :  93%|████████████████████████████████████████   | 209/224 [02:13<00:08,  1.68it/s]
Epoch 14 Iter 210: loss 0.23243. :  94%|████████████████████████████████████████▎  | 210/224 [02:13<00:08,  1.70it/s]
Epoch 14 Iter 211: loss 0.21746. :  94%|████████████████████████████████████████▎  | 210/224 [02:14<00:08,  1.70it/s]
Epoch 14 Iter 211: loss 0.21746. :  94%|████████████████████████████████████████▌  | 211/224 [02:14<00:07,  1.72it/s]
Epoch 14 Iter 212: loss 0.24917. :  94%|████████████████████████████████████████▌  | 211/224 [02:14<00:07,  1.72it/s]
Epoch 14 Iter 212: loss 0.24917. :  95%|████████████████████████████████████████▋  | 212/224 [02:14<00:06,  1.75it/s]
Epoch 14 Iter 213: loss 0.22854. :  95%|████████████████████████████████████████▋  | 212/224 [02:15<00:06,  1.75it/s]
Epoch 14 Iter 213: loss 0.22854. :  95%|████████████████████████████████████████▉  | 213/224 [02:15<00:06,  1.82it/s]
Epoch 14 Iter 214: loss 0.22274. :  95%|████████████████████████████████████████▉  | 213/224 [02:16<00:06,  1.82it/s]
Epoch 14 Iter 214: loss 0.22274. :  96%|█████████████████████████████████████████  | 214/224 [02:16<00:05,  1.82it/s]
Epoch 14 Iter 215: loss 0.25465. :  96%|█████████████████████████████████████████  | 214/224 [02:16<00:05,  1.82it/s]
Epoch 14 Iter 215: loss 0.25465. :  96%|█████████████████████████████████████████▎ | 215/224 [02:16<00:04,  1.85it/s]
Epoch 14 Iter 216: loss 0.23353. :  96%|█████████████████████████████████████████▎ | 215/224 [02:17<00:04,  1.85it/s]
Epoch 14 Iter 216: loss 0.23353. :  96%|█████████████████████████████████████████▍ | 216/224 [02:17<00:04,  1.88it/s]
Epoch 14 Iter 217: loss 0.22119. :  96%|█████████████████████████████████████████▍ | 216/224 [02:17<00:04,  1.88it/s]
Epoch 14 Iter 217: loss 0.22119. :  97%|█████████████████████████████████████████▋ | 217/224 [02:17<00:03,  1.92it/s]
Epoch 14 Iter 218: loss 0.26059. :  97%|█████████████████████████████████████████▋ | 217/224 [02:18<00:03,  1.92it/s]
Epoch 14 Iter 218: loss 0.26059. :  97%|█████████████████████████████████████████▊ | 218/224 [02:18<00:03,  1.94it/s]
Epoch 14 Iter 219: loss 0.23556. :  97%|█████████████████████████████████████████▊ | 218/224 [02:18<00:03,  1.94it/s]
Epoch 14 Iter 219: loss 0.23556. :  98%|██████████████████████████████████████████ | 219/224 [02:18<00:02,  1.96it/s]
Epoch 14 Iter 220: loss 0.24892. :  98%|██████████████████████████████████████████ | 219/224 [02:19<00:02,  1.96it/s]
Epoch 14 Iter 220: loss 0.24892. :  98%|██████████████████████████████████████████▏| 220/224 [02:19<00:02,  1.98it/s]
Epoch 14 Iter 221: loss 0.22435. :  98%|██████████████████████████████████████████▏| 220/224 [02:19<00:02,  1.98it/s]
Epoch 14 Iter 221: loss 0.22435. :  99%|██████████████████████████████████████████▍| 221/224 [02:19<00:01,  1.99it/s]
Epoch 14 Iter 222: loss 0.23347. :  99%|██████████████████████████████████████████▍| 221/224 [02:20<00:01,  1.99it/s]
Epoch 14 Iter 222: loss 0.23347. :  99%|██████████████████████████████████████████▌| 222/224 [02:20<00:01,  1.99it/s]
Epoch 14 Iter 223: loss 0.22120. :  99%|██████████████████████████████████████████▌| 222/224 [02:20<00:01,  1.99it/s]
Epoch 14 Iter 223: loss 0.22120. : 100%|██████████████████████████████████████████▊| 223/224 [02:20<00:00,  2.00it/s]
Epoch 14 Iter 224: loss 0.20760. : 100%|██████████████████████████████████████████▊| 223/224 [02:21<00:00,  2.00it/s]
Epoch 14 Iter 224: loss 0.20760. : 100%|███████████████████████████████████████████| 224/224 [02:21<00:00,  1.97it/s]
Epoch 14 Iter 224: loss 0.20760. : 100%|███████████████████████████████████████████| 224/224 [02:21<00:00,  1.59it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.23377. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.23377. :   0%|▏                                              | 1/224 [00:00<01:53,  1.97it/s]
Epoch 15 Iter 2: loss 0.22465. :   0%|▏                                              | 1/224 [00:01<01:53,  1.97it/s]
Epoch 15 Iter 2: loss 0.22465. :   1%|▍                                              | 2/224 [00:01<01:53,  1.96it/s]
Epoch 15 Iter 3: loss 0.23401. :   1%|▍                                              | 2/224 [00:01<01:53,  1.96it/s]
Epoch 15 Iter 3: loss 0.23401. :   1%|▋                                              | 3/224 [00:01<01:53,  1.95it/s]
Epoch 15 Iter 4: loss 0.22254. :   1%|▋                                              | 3/224 [00:02<01:53,  1.95it/s]
Epoch 15 Iter 4: loss 0.22254. :   2%|▊                                              | 4/224 [00:02<01:51,  1.97it/s]
Epoch 15 Iter 5: loss 0.23492. :   2%|▊                                              | 4/224 [00:02<01:51,  1.97it/s]
Epoch 15 Iter 5: loss 0.23492. :   2%|█                                              | 5/224 [00:02<01:50,  1.98it/s]
Epoch 15 Iter 6: loss 0.24341. :   2%|█                                              | 5/224 [00:03<01:50,  1.98it/s]
Epoch 15 Iter 6: loss 0.24341. :   3%|█▎                                             | 6/224 [00:03<01:50,  1.98it/s]
Epoch 15 Iter 7: loss 0.23118. :   3%|█▎                                             | 6/224 [00:03<01:50,  1.98it/s]
Epoch 15 Iter 7: loss 0.23118. :   3%|█▍                                             | 7/224 [00:03<01:53,  1.92it/s]
Epoch 15 Iter 8: loss 0.24931. :   3%|█▍                                             | 7/224 [00:04<01:53,  1.92it/s]
Epoch 15 Iter 8: loss 0.24931. :   4%|█▋                                             | 8/224 [00:04<01:55,  1.86it/s]
Epoch 15 Iter 9: loss 0.24736. :   4%|█▋                                             | 8/224 [00:04<01:55,  1.86it/s]
Epoch 15 Iter 9: loss 0.24736. :   4%|█▉                                             | 9/224 [00:04<01:56,  1.84it/s]
Epoch 15 Iter 10: loss 0.23997. :   4%|█▊                                            | 9/224 [00:05<01:56,  1.84it/s]
Epoch 15 Iter 10: loss 0.23997. :   4%|██                                           | 10/224 [00:05<01:54,  1.87it/s]
Epoch 15 Iter 11: loss 0.23351. :   4%|██                                           | 10/224 [00:05<01:54,  1.87it/s]
Epoch 15 Iter 11: loss 0.23351. :   5%|██▏                                          | 11/224 [00:05<01:52,  1.90it/s]
Epoch 15 Iter 12: loss 0.23257. :   5%|██▏                                          | 11/224 [00:06<01:52,  1.90it/s]
Epoch 15 Iter 12: loss 0.23257. :   5%|██▍                                          | 12/224 [00:06<01:50,  1.92it/s]
Epoch 15 Iter 13: loss 0.23092. :   5%|██▍                                          | 12/224 [00:06<01:50,  1.92it/s]
Epoch 15 Iter 13: loss 0.23092. :   6%|██▌                                          | 13/224 [00:06<01:49,  1.93it/s]
Epoch 15 Iter 14: loss 0.22130. :   6%|██▌                                          | 13/224 [00:07<01:49,  1.93it/s]
Epoch 15 Iter 14: loss 0.22130. :   6%|██▊                                          | 14/224 [00:07<01:52,  1.87it/s]
Epoch 15 Iter 15: loss 0.23150. :   6%|██▊                                          | 14/224 [00:07<01:52,  1.87it/s]
Epoch 15 Iter 15: loss 0.23150. :   7%|███                                          | 15/224 [00:07<01:51,  1.88it/s]
Epoch 15 Iter 16: loss 0.22742. :   7%|███                                          | 15/224 [00:08<01:51,  1.88it/s]
Epoch 15 Iter 16: loss 0.22742. :   7%|███▏                                         | 16/224 [00:08<01:51,  1.87it/s]
Epoch 15 Iter 17: loss 0.24416. :   7%|███▏                                         | 16/224 [00:08<01:51,  1.87it/s]
Epoch 15 Iter 17: loss 0.24416. :   8%|███▍                                         | 17/224 [00:08<01:51,  1.86it/s]
Epoch 15 Iter 18: loss 0.26165. :   8%|███▍                                         | 17/224 [00:09<01:51,  1.86it/s]
Epoch 15 Iter 18: loss 0.26165. :   8%|███▌                                         | 18/224 [00:09<01:48,  1.90it/s]
Epoch 15 Iter 19: loss 0.24072. :   8%|███▌                                         | 18/224 [00:09<01:48,  1.90it/s]
Epoch 15 Iter 19: loss 0.24072. :   8%|███▊                                         | 19/224 [00:09<01:47,  1.90it/s]
Epoch 15 Iter 20: loss 0.22027. :   8%|███▊                                         | 19/224 [00:10<01:47,  1.90it/s]
Epoch 15 Iter 20: loss 0.22027. :   9%|████                                         | 20/224 [00:10<01:46,  1.91it/s]
Epoch 15 Iter 21: loss 0.22334. :   9%|████                                         | 20/224 [00:11<01:46,  1.91it/s]
Epoch 15 Iter 21: loss 0.22334. :   9%|████▏                                        | 21/224 [00:11<01:45,  1.92it/s]
Epoch 15 Iter 22: loss 0.25542. :   9%|████▏                                        | 21/224 [00:11<01:45,  1.92it/s]
Epoch 15 Iter 22: loss 0.25542. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.93it/s]
Epoch 15 Iter 23: loss 0.25697. :  10%|████▍                                        | 22/224 [00:12<01:44,  1.93it/s]
Epoch 15 Iter 23: loss 0.25697. :  10%|████▌                                        | 23/224 [00:12<01:43,  1.95it/s]
Epoch 15 Iter 24: loss 0.22148. :  10%|████▌                                        | 23/224 [00:12<01:43,  1.95it/s]
Epoch 15 Iter 24: loss 0.22148. :  11%|████▊                                        | 24/224 [00:12<01:43,  1.94it/s]
Epoch 15 Iter 25: loss 0.23119. :  11%|████▊                                        | 24/224 [00:13<01:43,  1.94it/s]
Epoch 15 Iter 25: loss 0.23119. :  11%|█████                                        | 25/224 [00:13<01:41,  1.95it/s]
Epoch 15 Iter 26: loss 0.24297. :  11%|█████                                        | 25/224 [00:13<01:41,  1.95it/s]
Epoch 15 Iter 26: loss 0.24297. :  12%|█████▏                                       | 26/224 [00:13<01:40,  1.97it/s]
Epoch 15 Iter 27: loss 0.21772. :  12%|█████▏                                       | 26/224 [00:14<01:40,  1.97it/s]
Epoch 15 Iter 27: loss 0.21772. :  12%|█████▍                                       | 27/224 [00:14<01:39,  1.98it/s]
Epoch 15 Iter 28: loss 0.24201. :  12%|█████▍                                       | 27/224 [00:14<01:39,  1.98it/s]
Epoch 15 Iter 28: loss 0.24201. :  12%|█████▋                                       | 28/224 [00:14<01:39,  1.98it/s]
Epoch 15 Iter 29: loss 0.22140. :  12%|█████▋                                       | 28/224 [00:15<01:39,  1.98it/s]
Epoch 15 Iter 29: loss 0.22140. :  13%|█████▊                                       | 29/224 [00:15<01:40,  1.94it/s]
Epoch 15 Iter 30: loss 0.23124. :  13%|█████▊                                       | 29/224 [00:15<01:40,  1.94it/s]
Epoch 15 Iter 30: loss 0.23124. :  13%|██████                                       | 30/224 [00:15<01:39,  1.96it/s]
Epoch 15 Iter 31: loss 0.22170. :  13%|██████                                       | 30/224 [00:16<01:39,  1.96it/s]
Epoch 15 Iter 31: loss 0.22170. :  14%|██████▏                                      | 31/224 [00:16<01:37,  1.97it/s]
Epoch 15 Iter 32: loss 0.23018. :  14%|██████▏                                      | 31/224 [00:16<01:37,  1.97it/s]
Epoch 15 Iter 32: loss 0.23018. :  14%|██████▍                                      | 32/224 [00:16<01:36,  1.99it/s]
Epoch 15 Iter 33: loss 0.22002. :  14%|██████▍                                      | 32/224 [00:17<01:36,  1.99it/s]
Epoch 15 Iter 33: loss 0.22002. :  15%|██████▋                                      | 33/224 [00:17<01:35,  2.00it/s]
Epoch 15 Iter 34: loss 0.23036. :  15%|██████▋                                      | 33/224 [00:17<01:35,  2.00it/s]
Epoch 15 Iter 34: loss 0.23036. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.01it/s]
Epoch 15 Iter 35: loss 0.22971. :  15%|██████▊                                      | 34/224 [00:18<01:34,  2.01it/s]
Epoch 15 Iter 35: loss 0.22971. :  16%|███████                                      | 35/224 [00:18<01:35,  1.98it/s]
Epoch 15 Iter 36: loss 0.22424. :  16%|███████                                      | 35/224 [00:18<01:35,  1.98it/s]
Epoch 15 Iter 36: loss 0.22424. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.00it/s]
Epoch 15 Iter 37: loss 0.24419. :  16%|███████▏                                     | 36/224 [00:19<01:33,  2.00it/s]
Epoch 15 Iter 37: loss 0.24419. :  17%|███████▍                                     | 37/224 [00:19<01:32,  2.01it/s]
Epoch 15 Iter 38: loss 0.24478. :  17%|███████▍                                     | 37/224 [00:19<01:32,  2.01it/s]
Epoch 15 Iter 38: loss 0.24478. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 15 Iter 39: loss 0.22514. :  17%|███████▋                                     | 38/224 [00:20<01:32,  2.01it/s]
Epoch 15 Iter 39: loss 0.22514. :  17%|███████▊                                     | 39/224 [00:20<01:33,  1.97it/s]
Epoch 15 Iter 40: loss 0.24785. :  17%|███████▊                                     | 39/224 [00:20<01:33,  1.97it/s]
Epoch 15 Iter 40: loss 0.24785. :  18%|████████                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 15 Iter 41: loss 0.23032. :  18%|████████                                     | 40/224 [00:21<01:33,  1.97it/s]
Epoch 15 Iter 41: loss 0.23032. :  18%|████████▏                                    | 41/224 [00:21<01:31,  1.99it/s]
Epoch 15 Iter 42: loss 0.22670. :  18%|████████▏                                    | 41/224 [00:21<01:31,  1.99it/s]
Epoch 15 Iter 42: loss 0.22670. :  19%|████████▍                                    | 42/224 [00:21<01:31,  1.99it/s]
Epoch 15 Iter 43: loss 0.22290. :  19%|████████▍                                    | 42/224 [00:22<01:31,  1.99it/s]
Epoch 15 Iter 43: loss 0.22290. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.98it/s]
Epoch 15 Iter 44: loss 0.24185. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.98it/s]
Epoch 15 Iter 44: loss 0.24185. :  20%|████████▊                                    | 44/224 [00:22<01:31,  1.98it/s]
Epoch 15 Iter 45: loss 0.23361. :  20%|████████▊                                    | 44/224 [00:23<01:31,  1.98it/s]
Epoch 15 Iter 45: loss 0.23361. :  20%|█████████                                    | 45/224 [00:23<01:31,  1.96it/s]
Epoch 15 Iter 46: loss 0.25589. :  20%|█████████                                    | 45/224 [00:23<01:31,  1.96it/s]
Epoch 15 Iter 46: loss 0.25589. :  21%|█████████▏                                   | 46/224 [00:23<01:30,  1.97it/s]
Epoch 15 Iter 47: loss 0.23777. :  21%|█████████▏                                   | 46/224 [00:24<01:30,  1.97it/s]
Epoch 15 Iter 47: loss 0.23777. :  21%|█████████▍                                   | 47/224 [00:24<01:29,  1.98it/s]
Epoch 15 Iter 48: loss 0.22229. :  21%|█████████▍                                   | 47/224 [00:24<01:29,  1.98it/s]
Epoch 15 Iter 48: loss 0.22229. :  21%|█████████▋                                   | 48/224 [00:24<01:29,  1.96it/s]
Epoch 15 Iter 49: loss 0.21831. :  21%|█████████▋                                   | 48/224 [00:25<01:29,  1.96it/s]
Epoch 15 Iter 49: loss 0.21831. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.96it/s]
Epoch 15 Iter 50: loss 0.24233. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.96it/s]
Epoch 15 Iter 50: loss 0.24233. :  22%|██████████                                   | 50/224 [00:25<01:29,  1.94it/s]
Epoch 15 Iter 51: loss 0.23937. :  22%|██████████                                   | 50/224 [00:26<01:29,  1.94it/s]
Epoch 15 Iter 51: loss 0.23937. :  23%|██████████▏                                  | 51/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 52: loss 0.23138. :  23%|██████████▏                                  | 51/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 52: loss 0.23138. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.23749. :  23%|██████████▍                                  | 52/224 [00:27<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.23749. :  24%|██████████▋                                  | 53/224 [00:27<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.22301. :  24%|██████████▋                                  | 53/224 [00:27<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.22301. :  24%|██████████▊                                  | 54/224 [00:27<01:27,  1.94it/s]
Epoch 15 Iter 55: loss 0.25025. :  24%|██████████▊                                  | 54/224 [00:28<01:27,  1.94it/s]
Epoch 15 Iter 55: loss 0.25025. :  25%|███████████                                  | 55/224 [00:28<01:25,  1.97it/s]
Epoch 15 Iter 56: loss 0.21920. :  25%|███████████                                  | 55/224 [00:28<01:25,  1.97it/s]
Epoch 15 Iter 56: loss 0.21920. :  25%|███████████▎                                 | 56/224 [00:28<01:25,  1.97it/s]
Epoch 15 Iter 57: loss 0.21559. :  25%|███████████▎                                 | 56/224 [00:29<01:25,  1.97it/s]
Epoch 15 Iter 57: loss 0.21559. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  1.99it/s]
Epoch 15 Iter 58: loss 0.24470. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  1.99it/s]
Epoch 15 Iter 58: loss 0.24470. :  26%|███████████▋                                 | 58/224 [00:29<01:22,  2.01it/s]
Epoch 15 Iter 59: loss 0.24134. :  26%|███████████▋                                 | 58/224 [00:30<01:22,  2.01it/s]
Epoch 15 Iter 59: loss 0.24134. :  26%|███████████▊                                 | 59/224 [00:30<01:21,  2.02it/s]
Epoch 15 Iter 60: loss 0.21889. :  26%|███████████▊                                 | 59/224 [00:30<01:21,  2.02it/s]
Epoch 15 Iter 60: loss 0.21889. :  27%|████████████                                 | 60/224 [00:30<01:20,  2.03it/s]
Epoch 15 Iter 61: loss 0.24554. :  27%|████████████                                 | 60/224 [00:31<01:20,  2.03it/s]
Epoch 15 Iter 61: loss 0.24554. :  27%|████████████▎                                | 61/224 [00:31<01:20,  2.03it/s]
Epoch 15 Iter 62: loss 0.22456. :  27%|████████████▎                                | 61/224 [00:31<01:20,  2.03it/s]
Epoch 15 Iter 62: loss 0.22456. :  28%|████████████▍                                | 62/224 [00:31<01:19,  2.03it/s]
Epoch 15 Iter 63: loss 0.23503. :  28%|████████████▍                                | 62/224 [00:32<01:19,  2.03it/s]
Epoch 15 Iter 63: loss 0.23503. :  28%|████████████▋                                | 63/224 [00:32<01:19,  2.03it/s]
Epoch 15 Iter 64: loss 0.25151. :  28%|████████████▋                                | 63/224 [00:32<01:19,  2.03it/s]
Epoch 15 Iter 64: loss 0.25151. :  29%|████████████▊                                | 64/224 [00:32<01:22,  1.95it/s]
Epoch 15 Iter 65: loss 0.23841. :  29%|████████████▊                                | 64/224 [00:33<01:22,  1.95it/s]
Epoch 15 Iter 65: loss 0.23841. :  29%|█████████████                                | 65/224 [00:33<01:22,  1.93it/s]
Epoch 15 Iter 66: loss 0.23956. :  29%|█████████████                                | 65/224 [00:33<01:22,  1.93it/s]
Epoch 15 Iter 66: loss 0.23956. :  29%|█████████████▎                               | 66/224 [00:33<01:22,  1.92it/s]
Epoch 15 Iter 67: loss 0.21546. :  29%|█████████████▎                               | 66/224 [00:34<01:22,  1.92it/s]
Epoch 15 Iter 67: loss 0.21546. :  30%|█████████████▍                               | 67/224 [00:34<01:21,  1.93it/s]
Epoch 15 Iter 68: loss 0.21511. :  30%|█████████████▍                               | 67/224 [00:34<01:21,  1.93it/s]
Epoch 15 Iter 68: loss 0.21511. :  30%|█████████████▋                               | 68/224 [00:34<01:19,  1.96it/s]
Epoch 15 Iter 69: loss 0.25661. :  30%|█████████████▋                               | 68/224 [00:35<01:19,  1.96it/s]
Epoch 15 Iter 69: loss 0.25661. :  31%|█████████████▊                               | 69/224 [00:35<01:18,  1.98it/s]
Epoch 15 Iter 70: loss 0.26054. :  31%|█████████████▊                               | 69/224 [00:35<01:18,  1.98it/s]
Epoch 15 Iter 70: loss 0.26054. :  31%|██████████████                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 15 Iter 71: loss 0.22685. :  31%|██████████████                               | 70/224 [00:36<01:17,  1.98it/s]
Epoch 15 Iter 71: loss 0.22685. :  32%|██████████████▎                              | 71/224 [00:36<01:16,  1.99it/s]
Epoch 15 Iter 72: loss 0.24570. :  32%|██████████████▎                              | 71/224 [00:36<01:16,  1.99it/s]
Epoch 15 Iter 72: loss 0.24570. :  32%|██████████████▍                              | 72/224 [00:36<01:16,  2.00it/s]
Epoch 15 Iter 73: loss 0.23477. :  32%|██████████████▍                              | 72/224 [00:37<01:16,  2.00it/s]
Epoch 15 Iter 73: loss 0.23477. :  33%|██████████████▋                              | 73/224 [00:37<01:15,  1.99it/s]
Epoch 15 Iter 74: loss 0.24847. :  33%|██████████████▋                              | 73/224 [00:37<01:15,  1.99it/s]
Epoch 15 Iter 74: loss 0.24847. :  33%|██████████████▊                              | 74/224 [00:37<01:15,  1.99it/s]
Epoch 15 Iter 75: loss 0.24476. :  33%|██████████████▊                              | 74/224 [00:38<01:15,  1.99it/s]
Epoch 15 Iter 75: loss 0.24476. :  33%|███████████████                              | 75/224 [00:38<01:14,  1.99it/s]
Epoch 15 Iter 76: loss 0.24073. :  33%|███████████████                              | 75/224 [00:39<01:14,  1.99it/s]
Epoch 15 Iter 76: loss 0.24073. :  34%|███████████████▎                             | 76/224 [00:39<01:29,  1.66it/s]
Epoch 15 Iter 77: loss 0.23116. :  34%|███████████████▎                             | 76/224 [00:40<01:29,  1.66it/s]
Epoch 15 Iter 77: loss 0.23116. :  34%|███████████████▍                             | 77/224 [00:40<01:50,  1.34it/s]
Epoch 15 Iter 78: loss 0.19481. :  34%|███████████████▍                             | 77/224 [00:40<01:50,  1.34it/s]
Epoch 15 Iter 78: loss 0.19481. :  35%|███████████████▋                             | 78/224 [00:40<01:37,  1.49it/s]
Epoch 15 Iter 79: loss 0.22982. :  35%|███████████████▋                             | 78/224 [00:41<01:37,  1.49it/s]
Epoch 15 Iter 79: loss 0.22982. :  35%|███████████████▊                             | 79/224 [00:41<01:29,  1.61it/s]
Epoch 15 Iter 80: loss 0.24195. :  35%|███████████████▊                             | 79/224 [00:41<01:29,  1.61it/s]
Epoch 15 Iter 80: loss 0.24195. :  36%|████████████████                             | 80/224 [00:41<01:24,  1.71it/s]
Epoch 15 Iter 81: loss 0.22517. :  36%|████████████████                             | 80/224 [00:42<01:24,  1.71it/s]
Epoch 15 Iter 81: loss 0.22517. :  36%|████████████████▎                            | 81/224 [00:42<01:20,  1.77it/s]
Epoch 15 Iter 82: loss 0.24830. :  36%|████████████████▎                            | 81/224 [00:42<01:20,  1.77it/s]
Epoch 15 Iter 82: loss 0.24830. :  37%|████████████████▍                            | 82/224 [00:42<01:17,  1.82it/s]
Epoch 15 Iter 83: loss 0.24292. :  37%|████████████████▍                            | 82/224 [00:43<01:17,  1.82it/s]
Epoch 15 Iter 83: loss 0.24292. :  37%|████████████████▋                            | 83/224 [00:43<01:15,  1.86it/s]
Epoch 15 Iter 84: loss 0.24018. :  37%|████████████████▋                            | 83/224 [00:43<01:15,  1.86it/s]
Epoch 15 Iter 84: loss 0.24018. :  38%|████████████████▉                            | 84/224 [00:43<01:13,  1.89it/s]
Epoch 15 Iter 85: loss 0.24869. :  38%|████████████████▉                            | 84/224 [00:44<01:13,  1.89it/s]
Epoch 15 Iter 85: loss 0.24869. :  38%|█████████████████                            | 85/224 [00:44<01:12,  1.91it/s]
Epoch 15 Iter 86: loss 0.23325. :  38%|█████████████████                            | 85/224 [00:44<01:12,  1.91it/s]
Epoch 15 Iter 86: loss 0.23325. :  38%|█████████████████▎                           | 86/224 [00:44<01:11,  1.93it/s]
Epoch 15 Iter 87: loss 0.25082. :  38%|█████████████████▎                           | 86/224 [00:45<01:11,  1.93it/s]
Epoch 15 Iter 87: loss 0.25082. :  39%|█████████████████▍                           | 87/224 [00:45<01:10,  1.95it/s]
Epoch 15 Iter 88: loss 0.21995. :  39%|█████████████████▍                           | 87/224 [00:45<01:10,  1.95it/s]
Epoch 15 Iter 88: loss 0.21995. :  39%|█████████████████▋                           | 88/224 [00:45<01:09,  1.96it/s]
Epoch 15 Iter 89: loss 0.21995. :  39%|█████████████████▋                           | 88/224 [00:46<01:09,  1.96it/s]
Epoch 15 Iter 89: loss 0.21995. :  40%|█████████████████▉                           | 89/224 [00:46<01:08,  1.98it/s]
Epoch 15 Iter 90: loss 0.23374. :  40%|█████████████████▉                           | 89/224 [00:46<01:08,  1.98it/s]
Epoch 15 Iter 90: loss 0.23374. :  40%|██████████████████                           | 90/224 [00:46<01:07,  1.98it/s]
Epoch 15 Iter 91: loss 0.23079. :  40%|██████████████████                           | 90/224 [00:47<01:07,  1.98it/s]
Epoch 15 Iter 91: loss 0.23079. :  41%|██████████████████▎                          | 91/224 [00:47<01:06,  2.00it/s]
Epoch 15 Iter 92: loss 0.23701. :  41%|██████████████████▎                          | 91/224 [00:47<01:06,  2.00it/s]
Epoch 15 Iter 92: loss 0.23701. :  41%|██████████████████▍                          | 92/224 [00:47<01:05,  2.01it/s]
Epoch 15 Iter 93: loss 0.25246. :  41%|██████████████████▍                          | 92/224 [00:48<01:05,  2.01it/s]
Epoch 15 Iter 93: loss 0.25246. :  42%|██████████████████▋                          | 93/224 [00:48<01:04,  2.02it/s]
Epoch 15 Iter 94: loss 0.23219. :  42%|██████████████████▋                          | 93/224 [00:48<01:04,  2.02it/s]
Epoch 15 Iter 94: loss 0.23219. :  42%|██████████████████▉                          | 94/224 [00:48<01:06,  1.96it/s]
Epoch 15 Iter 95: loss 0.23836. :  42%|██████████████████▉                          | 94/224 [00:49<01:06,  1.96it/s]
Epoch 15 Iter 95: loss 0.23836. :  42%|███████████████████                          | 95/224 [00:49<01:05,  1.97it/s]
Epoch 15 Iter 96: loss 0.22264. :  42%|███████████████████                          | 95/224 [00:49<01:05,  1.97it/s]
Epoch 15 Iter 96: loss 0.22264. :  43%|███████████████████▎                         | 96/224 [00:49<01:04,  1.98it/s]
Epoch 15 Iter 97: loss 0.21524. :  43%|███████████████████▎                         | 96/224 [00:50<01:04,  1.98it/s]
Epoch 15 Iter 97: loss 0.21524. :  43%|███████████████████▍                         | 97/224 [00:50<01:03,  1.99it/s]
Epoch 15 Iter 98: loss 0.24596. :  43%|███████████████████▍                         | 97/224 [00:50<01:03,  1.99it/s]
Epoch 15 Iter 98: loss 0.24596. :  44%|███████████████████▋                         | 98/224 [00:50<01:03,  2.00it/s]
Epoch 15 Iter 99: loss 0.21985. :  44%|███████████████████▋                         | 98/224 [00:51<01:03,  2.00it/s]
Epoch 15 Iter 99: loss 0.21985. :  44%|███████████████████▉                         | 99/224 [00:51<01:02,  2.00it/s]
Epoch 15 Iter 100: loss 0.21935. :  44%|███████████████████▍                        | 99/224 [00:51<01:02,  2.00it/s]
Epoch 15 Iter 100: loss 0.21935. :  45%|███████████████████▏                       | 100/224 [00:51<01:01,  2.00it/s]
Epoch 15 Iter 101: loss 0.23136. :  45%|███████████████████▏                       | 100/224 [00:52<01:01,  2.00it/s]
Epoch 15 Iter 101: loss 0.23136. :  45%|███████████████████▍                       | 101/224 [00:52<01:01,  2.01it/s]
Epoch 15 Iter 102: loss 0.23977. :  45%|███████████████████▍                       | 101/224 [00:52<01:01,  2.01it/s]
Epoch 15 Iter 102: loss 0.23977. :  46%|███████████████████▌                       | 102/224 [00:52<01:00,  2.01it/s]
Epoch 15 Iter 103: loss 0.24315. :  46%|███████████████████▌                       | 102/224 [00:53<01:00,  2.01it/s]
Epoch 15 Iter 103: loss 0.24315. :  46%|███████████████████▊                       | 103/224 [00:53<01:00,  2.02it/s]
Epoch 15 Iter 104: loss 0.23258. :  46%|███████████████████▊                       | 103/224 [00:53<01:00,  2.02it/s]
Epoch 15 Iter 104: loss 0.23258. :  46%|███████████████████▉                       | 104/224 [00:53<00:59,  2.02it/s]
Epoch 15 Iter 105: loss 0.23879. :  46%|███████████████████▉                       | 104/224 [00:54<00:59,  2.02it/s]
Epoch 15 Iter 105: loss 0.23879. :  47%|████████████████████▏                      | 105/224 [00:54<00:59,  2.01it/s]
Epoch 15 Iter 106: loss 0.22416. :  47%|████████████████████▏                      | 105/224 [00:54<00:59,  2.01it/s]
Epoch 15 Iter 106: loss 0.22416. :  47%|████████████████████▎                      | 106/224 [00:54<00:58,  2.01it/s]
Epoch 15 Iter 107: loss 0.22427. :  47%|████████████████████▎                      | 106/224 [00:55<00:58,  2.01it/s]
Epoch 15 Iter 107: loss 0.22427. :  48%|████████████████████▌                      | 107/224 [00:55<00:57,  2.02it/s]
Epoch 15 Iter 108: loss 0.23086. :  48%|████████████████████▌                      | 107/224 [00:55<00:57,  2.02it/s]
Epoch 15 Iter 108: loss 0.23086. :  48%|████████████████████▋                      | 108/224 [00:55<00:58,  1.97it/s]
Epoch 15 Iter 109: loss 0.25520. :  48%|████████████████████▋                      | 108/224 [00:56<00:58,  1.97it/s]
Epoch 15 Iter 109: loss 0.25520. :  49%|████████████████████▉                      | 109/224 [00:56<00:57,  1.99it/s]
Epoch 15 Iter 110: loss 0.22901. :  49%|████████████████████▉                      | 109/224 [00:56<00:57,  1.99it/s]
Epoch 15 Iter 110: loss 0.22901. :  49%|█████████████████████                      | 110/224 [00:56<00:57,  1.99it/s]
Epoch 15 Iter 111: loss 0.22569. :  49%|█████████████████████                      | 110/224 [00:57<00:57,  1.99it/s]
Epoch 15 Iter 111: loss 0.22569. :  50%|█████████████████████▎                     | 111/224 [00:57<00:56,  2.00it/s]
Epoch 15 Iter 112: loss 0.24469. :  50%|█████████████████████▎                     | 111/224 [00:57<00:56,  2.00it/s]
Epoch 15 Iter 112: loss 0.24469. :  50%|█████████████████████▌                     | 112/224 [00:57<00:55,  2.01it/s]
Epoch 15 Iter 113: loss 0.25172. :  50%|█████████████████████▌                     | 112/224 [00:58<00:55,  2.01it/s]
Epoch 15 Iter 113: loss 0.25172. :  50%|█████████████████████▋                     | 113/224 [00:58<00:55,  2.01it/s]
Epoch 15 Iter 114: loss 0.23653. :  50%|█████████████████████▋                     | 113/224 [00:58<00:55,  2.01it/s]
Epoch 15 Iter 114: loss 0.23653. :  51%|█████████████████████▉                     | 114/224 [00:58<00:54,  2.02it/s]
Epoch 15 Iter 115: loss 0.27122. :  51%|█████████████████████▉                     | 114/224 [00:59<00:54,  2.02it/s]
Epoch 15 Iter 115: loss 0.27122. :  51%|██████████████████████                     | 115/224 [00:59<00:54,  2.00it/s]
Epoch 15 Iter 116: loss 0.22380. :  51%|██████████████████████                     | 115/224 [00:59<00:54,  2.00it/s]
Epoch 15 Iter 116: loss 0.22380. :  52%|██████████████████████▎                    | 116/224 [00:59<00:53,  2.01it/s]
Epoch 15 Iter 117: loss 0.23393. :  52%|██████████████████████▎                    | 116/224 [01:00<00:53,  2.01it/s]
Epoch 15 Iter 117: loss 0.23393. :  52%|██████████████████████▍                    | 117/224 [01:00<00:53,  2.02it/s]
Epoch 15 Iter 118: loss 0.24814. :  52%|██████████████████████▍                    | 117/224 [01:00<00:53,  2.02it/s]
Epoch 15 Iter 118: loss 0.24814. :  53%|██████████████████████▋                    | 118/224 [01:00<00:52,  2.01it/s]
Epoch 15 Iter 119: loss 0.23468. :  53%|██████████████████████▋                    | 118/224 [01:01<00:52,  2.01it/s]
Epoch 15 Iter 119: loss 0.23468. :  53%|██████████████████████▊                    | 119/224 [01:01<00:51,  2.03it/s]
Epoch 15 Iter 120: loss 0.23090. :  53%|██████████████████████▊                    | 119/224 [01:01<00:51,  2.03it/s]
Epoch 15 Iter 120: loss 0.23090. :  54%|███████████████████████                    | 120/224 [01:01<00:51,  2.02it/s]
Epoch 15 Iter 121: loss 0.22392. :  54%|███████████████████████                    | 120/224 [01:02<00:51,  2.02it/s]
Epoch 15 Iter 121: loss 0.22392. :  54%|███████████████████████▏                   | 121/224 [01:02<00:50,  2.03it/s]
Epoch 15 Iter 122: loss 0.23082. :  54%|███████████████████████▏                   | 121/224 [01:02<00:50,  2.03it/s]
Epoch 15 Iter 122: loss 0.23082. :  54%|███████████████████████▍                   | 122/224 [01:02<00:50,  2.03it/s]
Epoch 15 Iter 123: loss 0.23266. :  54%|███████████████████████▍                   | 122/224 [01:03<00:50,  2.03it/s]
Epoch 15 Iter 123: loss 0.23266. :  55%|███████████████████████▌                   | 123/224 [01:03<00:50,  2.01it/s]
Epoch 15 Iter 124: loss 0.23250. :  55%|███████████████████████▌                   | 123/224 [01:03<00:50,  2.01it/s]
Epoch 15 Iter 124: loss 0.23250. :  55%|███████████████████████▊                   | 124/224 [01:03<00:49,  2.02it/s]
Epoch 15 Iter 125: loss 0.23724. :  55%|███████████████████████▊                   | 124/224 [01:04<00:49,  2.02it/s]
Epoch 15 Iter 125: loss 0.23724. :  56%|███████████████████████▉                   | 125/224 [01:04<00:48,  2.02it/s]
Epoch 15 Iter 126: loss 0.22258. :  56%|███████████████████████▉                   | 125/224 [01:04<00:48,  2.02it/s]
Epoch 15 Iter 126: loss 0.22258. :  56%|████████████████████████▏                  | 126/224 [01:04<00:48,  2.02it/s]
Epoch 15 Iter 127: loss 0.22324. :  56%|████████████████████████▏                  | 126/224 [01:05<00:48,  2.02it/s]
Epoch 15 Iter 127: loss 0.22324. :  57%|████████████████████████▍                  | 127/224 [01:05<00:48,  2.02it/s]
Epoch 15 Iter 128: loss 0.23808. :  57%|████████████████████████▍                  | 127/224 [01:05<00:48,  2.02it/s]
Epoch 15 Iter 128: loss 0.23808. :  57%|████████████████████████▌                  | 128/224 [01:05<00:48,  2.00it/s]
Epoch 15 Iter 129: loss 0.23794. :  57%|████████████████████████▌                  | 128/224 [01:06<00:48,  2.00it/s]
Epoch 15 Iter 129: loss 0.23794. :  58%|████████████████████████▊                  | 129/224 [01:06<00:47,  2.00it/s]
Epoch 15 Iter 130: loss 0.22742. :  58%|████████████████████████▊                  | 129/224 [01:06<00:47,  2.00it/s]
Epoch 15 Iter 130: loss 0.22742. :  58%|████████████████████████▉                  | 130/224 [01:06<00:46,  2.01it/s]
Epoch 15 Iter 131: loss 0.22636. :  58%|████████████████████████▉                  | 130/224 [01:07<00:46,  2.01it/s]
Epoch 15 Iter 131: loss 0.22636. :  58%|█████████████████████████▏                 | 131/224 [01:07<00:46,  2.01it/s]
Epoch 15 Iter 132: loss 0.22937. :  58%|█████████████████████████▏                 | 131/224 [01:07<00:46,  2.01it/s]
Epoch 15 Iter 132: loss 0.22937. :  59%|█████████████████████████▎                 | 132/224 [01:07<00:46,  2.00it/s]
Epoch 15 Iter 133: loss 0.24893. :  59%|█████████████████████████▎                 | 132/224 [01:08<00:46,  2.00it/s]
Epoch 15 Iter 133: loss 0.24893. :  59%|█████████████████████████▌                 | 133/224 [01:08<00:45,  2.00it/s]
Epoch 15 Iter 134: loss 0.24769. :  59%|█████████████████████████▌                 | 133/224 [01:08<00:45,  2.00it/s]
Epoch 15 Iter 134: loss 0.24769. :  60%|█████████████████████████▋                 | 134/224 [01:08<00:45,  2.00it/s]
Epoch 15 Iter 135: loss 0.24702. :  60%|█████████████████████████▋                 | 134/224 [01:09<00:45,  2.00it/s]
Epoch 15 Iter 135: loss 0.24702. :  60%|█████████████████████████▉                 | 135/224 [01:09<00:44,  2.00it/s]
Epoch 15 Iter 136: loss 0.26032. :  60%|█████████████████████████▉                 | 135/224 [01:09<00:44,  2.00it/s]
Epoch 15 Iter 136: loss 0.26032. :  61%|██████████████████████████                 | 136/224 [01:09<00:43,  2.00it/s]
Epoch 15 Iter 137: loss 0.23718. :  61%|██████████████████████████                 | 136/224 [01:10<00:43,  2.00it/s]
Epoch 15 Iter 137: loss 0.23718. :  61%|██████████████████████████▎                | 137/224 [01:10<00:43,  1.99it/s]
Epoch 15 Iter 138: loss 0.25057. :  61%|██████████████████████████▎                | 137/224 [01:10<00:43,  1.99it/s]
Epoch 15 Iter 138: loss 0.25057. :  62%|██████████████████████████▍                | 138/224 [01:10<00:42,  2.01it/s]
Epoch 15 Iter 139: loss 0.21776. :  62%|██████████████████████████▍                | 138/224 [01:11<00:42,  2.01it/s]
Epoch 15 Iter 139: loss 0.21776. :  62%|██████████████████████████▋                | 139/224 [01:11<00:42,  2.00it/s]
Epoch 15 Iter 140: loss 0.25790. :  62%|██████████████████████████▋                | 139/224 [01:11<00:42,  2.00it/s]
Epoch 15 Iter 140: loss 0.25790. :  62%|██████████████████████████▉                | 140/224 [01:11<00:41,  2.00it/s]
Epoch 15 Iter 141: loss 0.23423. :  62%|██████████████████████████▉                | 140/224 [01:12<00:41,  2.00it/s]
Epoch 15 Iter 141: loss 0.23423. :  63%|███████████████████████████                | 141/224 [01:12<00:41,  2.02it/s]
Epoch 15 Iter 142: loss 0.22356. :  63%|███████████████████████████                | 141/224 [01:12<00:41,  2.02it/s]
Epoch 15 Iter 142: loss 0.22356. :  63%|███████████████████████████▎               | 142/224 [01:12<00:40,  2.03it/s]
Epoch 15 Iter 143: loss 0.24785. :  63%|███████████████████████████▎               | 142/224 [01:13<00:40,  2.03it/s]
Epoch 15 Iter 143: loss 0.24785. :  64%|███████████████████████████▍               | 143/224 [01:13<00:40,  2.00it/s]
Epoch 15 Iter 144: loss 0.24282. :  64%|███████████████████████████▍               | 143/224 [01:13<00:40,  2.00it/s]
Epoch 15 Iter 144: loss 0.24282. :  64%|███████████████████████████▋               | 144/224 [01:13<00:39,  2.01it/s]
Epoch 15 Iter 145: loss 0.22361. :  64%|███████████████████████████▋               | 144/224 [01:14<00:39,  2.01it/s]
Epoch 15 Iter 145: loss 0.22361. :  65%|███████████████████████████▊               | 145/224 [01:14<00:39,  2.02it/s]
Epoch 15 Iter 146: loss 0.22605. :  65%|███████████████████████████▊               | 145/224 [01:14<00:39,  2.02it/s]
Epoch 15 Iter 146: loss 0.22605. :  65%|████████████████████████████               | 146/224 [01:14<00:38,  2.02it/s]
Epoch 15 Iter 147: loss 0.23836. :  65%|████████████████████████████               | 146/224 [01:15<00:38,  2.02it/s]
Epoch 15 Iter 147: loss 0.23836. :  66%|████████████████████████████▏              | 147/224 [01:15<00:37,  2.03it/s]
Epoch 15 Iter 148: loss 0.24722. :  66%|████████████████████████████▏              | 147/224 [01:15<00:37,  2.03it/s]
Epoch 15 Iter 148: loss 0.24722. :  66%|████████████████████████████▍              | 148/224 [01:15<00:37,  2.02it/s]
Epoch 15 Iter 149: loss 0.23420. :  66%|████████████████████████████▍              | 148/224 [01:16<00:37,  2.02it/s]
Epoch 15 Iter 149: loss 0.23420. :  67%|████████████████████████████▌              | 149/224 [01:16<00:38,  1.95it/s]
Epoch 15 Iter 150: loss 0.20675. :  67%|████████████████████████████▌              | 149/224 [01:16<00:38,  1.95it/s]
Epoch 15 Iter 150: loss 0.20675. :  67%|████████████████████████████▊              | 150/224 [01:16<00:37,  1.96it/s]
Epoch 15 Iter 151: loss 0.24252. :  67%|████████████████████████████▊              | 150/224 [01:17<00:37,  1.96it/s]
Epoch 15 Iter 151: loss 0.24252. :  67%|████████████████████████████▉              | 151/224 [01:17<00:36,  1.98it/s]
Epoch 15 Iter 152: loss 0.24700. :  67%|████████████████████████████▉              | 151/224 [01:17<00:36,  1.98it/s]
Epoch 15 Iter 152: loss 0.24700. :  68%|█████████████████████████████▏             | 152/224 [01:17<00:36,  1.97it/s]
Epoch 15 Iter 153: loss 0.23165. :  68%|█████████████████████████████▏             | 152/224 [01:18<00:36,  1.97it/s]
Epoch 15 Iter 153: loss 0.23165. :  68%|█████████████████████████████▎             | 153/224 [01:18<00:35,  1.98it/s]
Epoch 15 Iter 154: loss 0.23579. :  68%|█████████████████████████████▎             | 153/224 [01:18<00:35,  1.98it/s]
Epoch 15 Iter 154: loss 0.23579. :  69%|█████████████████████████████▌             | 154/224 [01:18<00:35,  1.98it/s]
Epoch 15 Iter 155: loss 0.21375. :  69%|█████████████████████████████▌             | 154/224 [01:19<00:35,  1.98it/s]
Epoch 15 Iter 155: loss 0.21375. :  69%|█████████████████████████████▊             | 155/224 [01:19<00:34,  1.97it/s]
Epoch 15 Iter 156: loss 0.22981. :  69%|█████████████████████████████▊             | 155/224 [01:19<00:34,  1.97it/s]
Epoch 15 Iter 156: loss 0.22981. :  70%|█████████████████████████████▉             | 156/224 [01:19<00:34,  1.98it/s]
Epoch 15 Iter 157: loss 0.23325. :  70%|█████████████████████████████▉             | 156/224 [01:20<00:34,  1.98it/s]
Epoch 15 Iter 157: loss 0.23325. :  70%|██████████████████████████████▏            | 157/224 [01:20<00:47,  1.41it/s]
Epoch 15 Iter 158: loss 0.21444. :  70%|██████████████████████████████▏            | 157/224 [01:21<00:47,  1.41it/s]
Epoch 15 Iter 158: loss 0.21444. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:43,  1.51it/s]
Epoch 15 Iter 159: loss 0.24473. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:43,  1.51it/s]
Epoch 15 Iter 159: loss 0.24473. :  71%|██████████████████████████████▌            | 159/224 [01:21<00:39,  1.63it/s]
Epoch 15 Iter 160: loss 0.22637. :  71%|██████████████████████████████▌            | 159/224 [01:22<00:39,  1.63it/s]
Epoch 15 Iter 160: loss 0.22637. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:37,  1.73it/s]
Epoch 15 Iter 161: loss 0.22221. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:37,  1.73it/s]
Epoch 15 Iter 161: loss 0.22221. :  72%|██████████████████████████████▉            | 161/224 [01:22<00:35,  1.80it/s]
Epoch 15 Iter 162: loss 0.22147. :  72%|██████████████████████████████▉            | 161/224 [01:23<00:35,  1.80it/s]
Epoch 15 Iter 162: loss 0.22147. :  72%|███████████████████████████████            | 162/224 [01:23<00:33,  1.84it/s]
Epoch 15 Iter 163: loss 0.24868. :  72%|███████████████████████████████            | 162/224 [01:23<00:33,  1.84it/s]
Epoch 15 Iter 163: loss 0.24868. :  73%|███████████████████████████████▎           | 163/224 [01:24<00:32,  1.87it/s]
Epoch 15 Iter 164: loss 0.23743. :  73%|███████████████████████████████▎           | 163/224 [01:24<00:32,  1.87it/s]
Epoch 15 Iter 164: loss 0.23743. :  73%|███████████████████████████████▍           | 164/224 [01:24<00:31,  1.90it/s]
Epoch 15 Iter 165: loss 0.24289. :  73%|███████████████████████████████▍           | 164/224 [01:25<00:31,  1.90it/s]
Epoch 15 Iter 165: loss 0.24289. :  74%|███████████████████████████████▋           | 165/224 [01:25<00:30,  1.93it/s]
Epoch 15 Iter 166: loss 0.23233. :  74%|███████████████████████████████▋           | 165/224 [01:25<00:30,  1.93it/s]
Epoch 15 Iter 166: loss 0.23233. :  74%|███████████████████████████████▊           | 166/224 [01:25<00:30,  1.93it/s]
Epoch 15 Iter 167: loss 0.24176. :  74%|███████████████████████████████▊           | 166/224 [01:26<00:30,  1.93it/s]
Epoch 15 Iter 167: loss 0.24176. :  75%|████████████████████████████████           | 167/224 [01:26<00:29,  1.92it/s]
Epoch 15 Iter 168: loss 0.25169. :  75%|████████████████████████████████           | 167/224 [01:26<00:29,  1.92it/s]
Epoch 15 Iter 168: loss 0.25169. :  75%|████████████████████████████████▎          | 168/224 [01:26<00:29,  1.93it/s]
Epoch 15 Iter 169: loss 0.23600. :  75%|████████████████████████████████▎          | 168/224 [01:27<00:29,  1.93it/s]
Epoch 15 Iter 169: loss 0.23600. :  75%|████████████████████████████████▍          | 169/224 [01:27<00:28,  1.94it/s]
Epoch 15 Iter 170: loss 0.24483. :  75%|████████████████████████████████▍          | 169/224 [01:27<00:28,  1.94it/s]
Epoch 15 Iter 170: loss 0.24483. :  76%|████████████████████████████████▋          | 170/224 [01:27<00:27,  1.96it/s]
Epoch 15 Iter 171: loss 0.25572. :  76%|████████████████████████████████▋          | 170/224 [01:28<00:27,  1.96it/s]
Epoch 15 Iter 171: loss 0.25572. :  76%|████████████████████████████████▊          | 171/224 [01:28<00:26,  1.97it/s]
Epoch 15 Iter 172: loss 0.22498. :  76%|████████████████████████████████▊          | 171/224 [01:28<00:26,  1.97it/s]
Epoch 15 Iter 172: loss 0.22498. :  77%|█████████████████████████████████          | 172/224 [01:28<00:26,  1.98it/s]
Epoch 15 Iter 173: loss 0.23409. :  77%|█████████████████████████████████          | 172/224 [01:29<00:26,  1.98it/s]
Epoch 15 Iter 173: loss 0.23409. :  77%|█████████████████████████████████▏         | 173/224 [01:29<00:25,  1.98it/s]
Epoch 15 Iter 174: loss 0.26951. :  77%|█████████████████████████████████▏         | 173/224 [01:29<00:25,  1.98it/s]
Epoch 15 Iter 174: loss 0.26951. :  78%|█████████████████████████████████▍         | 174/224 [01:29<00:26,  1.92it/s]
Epoch 15 Iter 175: loss 0.23479. :  78%|█████████████████████████████████▍         | 174/224 [01:30<00:26,  1.92it/s]
Epoch 15 Iter 175: loss 0.23479. :  78%|█████████████████████████████████▌         | 175/224 [01:30<00:25,  1.93it/s]
Epoch 15 Iter 176: loss 0.22136. :  78%|█████████████████████████████████▌         | 175/224 [01:30<00:25,  1.93it/s]
Epoch 15 Iter 176: loss 0.22136. :  79%|█████████████████████████████████▊         | 176/224 [01:30<00:24,  1.95it/s]
Epoch 15 Iter 177: loss 0.23003. :  79%|█████████████████████████████████▊         | 176/224 [01:31<00:24,  1.95it/s]
Epoch 15 Iter 177: loss 0.23003. :  79%|█████████████████████████████████▉         | 177/224 [01:31<00:23,  1.96it/s]
Epoch 15 Iter 178: loss 0.20875. :  79%|█████████████████████████████████▉         | 177/224 [01:31<00:23,  1.96it/s]
Epoch 15 Iter 178: loss 0.20875. :  79%|██████████████████████████████████▏        | 178/224 [01:31<00:23,  1.98it/s]
Epoch 15 Iter 179: loss 0.25076. :  79%|██████████████████████████████████▏        | 178/224 [01:32<00:23,  1.98it/s]
Epoch 15 Iter 179: loss 0.25076. :  80%|██████████████████████████████████▎        | 179/224 [01:32<00:22,  1.99it/s]
Epoch 15 Iter 180: loss 0.24554. :  80%|██████████████████████████████████▎        | 179/224 [01:32<00:22,  1.99it/s]
Epoch 15 Iter 180: loss 0.24554. :  80%|██████████████████████████████████▌        | 180/224 [01:32<00:21,  2.00it/s]
Epoch 15 Iter 181: loss 0.22415. :  80%|██████████████████████████████████▌        | 180/224 [01:33<00:21,  2.00it/s]
Epoch 15 Iter 181: loss 0.22415. :  81%|██████████████████████████████████▋        | 181/224 [01:33<00:21,  2.00it/s]
Epoch 15 Iter 182: loss 0.23428. :  81%|██████████████████████████████████▋        | 181/224 [01:33<00:21,  2.00it/s]
Epoch 15 Iter 182: loss 0.23428. :  81%|██████████████████████████████████▉        | 182/224 [01:33<00:21,  1.95it/s]
Epoch 15 Iter 183: loss 0.22868. :  81%|██████████████████████████████████▉        | 182/224 [01:34<00:21,  1.95it/s]
Epoch 15 Iter 183: loss 0.22868. :  82%|███████████████████████████████████▏       | 183/224 [01:34<00:20,  1.97it/s]
Epoch 15 Iter 184: loss 0.22343. :  82%|███████████████████████████████████▏       | 183/224 [01:34<00:20,  1.97it/s]
Epoch 15 Iter 184: loss 0.22343. :  82%|███████████████████████████████████▎       | 184/224 [01:34<00:20,  1.98it/s]
Epoch 15 Iter 185: loss 0.21985. :  82%|███████████████████████████████████▎       | 184/224 [01:35<00:20,  1.98it/s]
Epoch 15 Iter 185: loss 0.21985. :  83%|███████████████████████████████████▌       | 185/224 [01:35<00:19,  2.00it/s]
Epoch 15 Iter 186: loss 0.25731. :  83%|███████████████████████████████████▌       | 185/224 [01:35<00:19,  2.00it/s]
Epoch 15 Iter 186: loss 0.25731. :  83%|███████████████████████████████████▋       | 186/224 [01:35<00:18,  2.01it/s]
Epoch 15 Iter 187: loss 0.22346. :  83%|███████████████████████████████████▋       | 186/224 [01:36<00:18,  2.01it/s]
Epoch 15 Iter 187: loss 0.22346. :  83%|███████████████████████████████████▉       | 187/224 [01:36<00:18,  2.00it/s]
Epoch 15 Iter 188: loss 0.24654. :  83%|███████████████████████████████████▉       | 187/224 [01:36<00:18,  2.00it/s]
Epoch 15 Iter 188: loss 0.24654. :  84%|████████████████████████████████████       | 188/224 [01:36<00:18,  2.00it/s]
Epoch 15 Iter 189: loss 0.23664. :  84%|████████████████████████████████████       | 188/224 [01:37<00:18,  2.00it/s]
Epoch 15 Iter 189: loss 0.23664. :  84%|████████████████████████████████████▎      | 189/224 [01:37<00:17,  2.00it/s]
Epoch 15 Iter 190: loss 0.22837. :  84%|████████████████████████████████████▎      | 189/224 [01:37<00:17,  2.00it/s]
Epoch 15 Iter 190: loss 0.22837. :  85%|████████████████████████████████████▍      | 190/224 [01:37<00:16,  2.02it/s]
Epoch 15 Iter 191: loss 0.22046. :  85%|████████████████████████████████████▍      | 190/224 [01:38<00:16,  2.02it/s]
Epoch 15 Iter 191: loss 0.22046. :  85%|████████████████████████████████████▋      | 191/224 [01:38<00:16,  2.02it/s]
Epoch 15 Iter 192: loss 0.24425. :  85%|████████████████████████████████████▋      | 191/224 [01:38<00:16,  2.02it/s]
Epoch 15 Iter 192: loss 0.24425. :  86%|████████████████████████████████████▊      | 192/224 [01:38<00:15,  2.01it/s]
Epoch 15 Iter 193: loss 0.22182. :  86%|████████████████████████████████████▊      | 192/224 [01:39<00:15,  2.01it/s]
Epoch 15 Iter 193: loss 0.22182. :  86%|█████████████████████████████████████      | 193/224 [01:39<00:15,  2.01it/s]
Epoch 15 Iter 194: loss 0.25703. :  86%|█████████████████████████████████████      | 193/224 [01:39<00:15,  2.01it/s]
Epoch 15 Iter 194: loss 0.25703. :  87%|█████████████████████████████████████▏     | 194/224 [01:39<00:14,  2.03it/s]
Epoch 15 Iter 195: loss 0.23014. :  87%|█████████████████████████████████████▏     | 194/224 [01:40<00:14,  2.03it/s]
Epoch 15 Iter 195: loss 0.23014. :  87%|█████████████████████████████████████▍     | 195/224 [01:40<00:14,  2.02it/s]
Epoch 15 Iter 196: loss 0.23622. :  87%|█████████████████████████████████████▍     | 195/224 [01:40<00:14,  2.02it/s]
Epoch 15 Iter 196: loss 0.23622. :  88%|█████████████████████████████████████▋     | 196/224 [01:40<00:14,  1.98it/s]
Epoch 15 Iter 197: loss 0.23540. :  88%|█████████████████████████████████████▋     | 196/224 [01:41<00:14,  1.98it/s]
Epoch 15 Iter 197: loss 0.23540. :  88%|█████████████████████████████████████▊     | 197/224 [01:41<00:13,  1.93it/s]
Epoch 15 Iter 198: loss 0.23725. :  88%|█████████████████████████████████████▊     | 197/224 [01:41<00:13,  1.93it/s]
Epoch 15 Iter 198: loss 0.23725. :  88%|██████████████████████████████████████     | 198/224 [01:41<00:13,  1.95it/s]
Epoch 15 Iter 199: loss 0.22818. :  88%|██████████████████████████████████████     | 198/224 [01:42<00:13,  1.95it/s]
Epoch 15 Iter 199: loss 0.22818. :  89%|██████████████████████████████████████▏    | 199/224 [01:42<00:12,  1.96it/s]
Epoch 15 Iter 200: loss 0.23845. :  89%|██████████████████████████████████████▏    | 199/224 [01:42<00:12,  1.96it/s]
Epoch 15 Iter 200: loss 0.23845. :  89%|██████████████████████████████████████▍    | 200/224 [01:42<00:12,  1.97it/s]
Epoch 15 Iter 201: loss 0.22475. :  89%|██████████████████████████████████████▍    | 200/224 [01:43<00:12,  1.97it/s]
Epoch 15 Iter 201: loss 0.22475. :  90%|██████████████████████████████████████▌    | 201/224 [01:43<00:11,  2.00it/s]
Epoch 15 Iter 202: loss 0.20533. :  90%|██████████████████████████████████████▌    | 201/224 [01:43<00:11,  2.00it/s]
Epoch 15 Iter 202: loss 0.20533. :  90%|██████████████████████████████████████▊    | 202/224 [01:43<00:11,  1.99it/s]
Epoch 15 Iter 203: loss 0.22398. :  90%|██████████████████████████████████████▊    | 202/224 [01:44<00:11,  1.99it/s]
Epoch 15 Iter 203: loss 0.22398. :  91%|██████████████████████████████████████▉    | 203/224 [01:44<00:10,  1.99it/s]
Epoch 15 Iter 204: loss 0.24585. :  91%|██████████████████████████████████████▉    | 203/224 [01:44<00:10,  1.99it/s]
Epoch 15 Iter 204: loss 0.24585. :  91%|███████████████████████████████████████▏   | 204/224 [01:44<00:10,  1.84it/s]
Epoch 15 Iter 205: loss 0.24232. :  91%|███████████████████████████████████████▏   | 204/224 [01:45<00:10,  1.84it/s]
Epoch 15 Iter 205: loss 0.24232. :  92%|███████████████████████████████████████▎   | 205/224 [01:45<00:10,  1.80it/s]
Epoch 15 Iter 206: loss 0.23034. :  92%|███████████████████████████████████████▎   | 205/224 [01:45<00:10,  1.80it/s]
Epoch 15 Iter 206: loss 0.23034. :  92%|███████████████████████████████████████▌   | 206/224 [01:45<00:09,  1.83it/s]
Epoch 15 Iter 207: loss 0.26485. :  92%|███████████████████████████████████████▌   | 206/224 [01:46<00:09,  1.83it/s]
Epoch 15 Iter 207: loss 0.26485. :  92%|███████████████████████████████████████▋   | 207/224 [01:46<00:09,  1.87it/s]
Epoch 15 Iter 208: loss 0.25166. :  92%|███████████████████████████████████████▋   | 207/224 [01:46<00:09,  1.87it/s]
Epoch 15 Iter 208: loss 0.25166. :  93%|███████████████████████████████████████▉   | 208/224 [01:46<00:08,  1.90it/s]
Epoch 15 Iter 209: loss 0.21978. :  93%|███████████████████████████████████████▉   | 208/224 [01:47<00:08,  1.90it/s]
Epoch 15 Iter 209: loss 0.21978. :  93%|████████████████████████████████████████   | 209/224 [01:47<00:07,  1.94it/s]
Epoch 15 Iter 210: loss 0.25178. :  93%|████████████████████████████████████████   | 209/224 [01:47<00:07,  1.94it/s]
Epoch 15 Iter 210: loss 0.25178. :  94%|████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.96it/s]
Epoch 15 Iter 211: loss 0.21440. :  94%|████████████████████████████████████████▎  | 210/224 [01:48<00:07,  1.96it/s]
Epoch 15 Iter 211: loss 0.21440. :  94%|████████████████████████████████████████▌  | 211/224 [01:48<00:06,  1.92it/s]
Epoch 15 Iter 212: loss 0.21778. :  94%|████████████████████████████████████████▌  | 211/224 [01:48<00:06,  1.92it/s]
Epoch 15 Iter 212: loss 0.21778. :  95%|████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.93it/s]
Epoch 15 Iter 213: loss 0.22397. :  95%|████████████████████████████████████████▋  | 212/224 [01:49<00:06,  1.93it/s]
Epoch 15 Iter 213: loss 0.22397. :  95%|████████████████████████████████████████▉  | 213/224 [01:49<00:05,  1.96it/s]
Epoch 15 Iter 214: loss 0.22110. :  95%|████████████████████████████████████████▉  | 213/224 [01:49<00:05,  1.96it/s]
Epoch 15 Iter 214: loss 0.22110. :  96%|█████████████████████████████████████████  | 214/224 [01:49<00:05,  1.98it/s]
Epoch 15 Iter 215: loss 0.23273. :  96%|█████████████████████████████████████████  | 214/224 [01:50<00:05,  1.98it/s]
Epoch 15 Iter 215: loss 0.23273. :  96%|█████████████████████████████████████████▎ | 215/224 [01:50<00:04,  1.99it/s]
Epoch 15 Iter 216: loss 0.24097. :  96%|█████████████████████████████████████████▎ | 215/224 [01:50<00:04,  1.99it/s]
Epoch 15 Iter 216: loss 0.24097. :  96%|█████████████████████████████████████████▍ | 216/224 [01:50<00:03,  2.01it/s]
Epoch 15 Iter 217: loss 0.22569. :  96%|█████████████████████████████████████████▍ | 216/224 [01:51<00:03,  2.01it/s]
Epoch 15 Iter 217: loss 0.22569. :  97%|█████████████████████████████████████████▋ | 217/224 [01:51<00:03,  1.97it/s]
Epoch 15 Iter 218: loss 0.23295. :  97%|█████████████████████████████████████████▋ | 217/224 [01:51<00:03,  1.97it/s]
Epoch 15 Iter 218: loss 0.23295. :  97%|█████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.97it/s]
Epoch 15 Iter 219: loss 0.21284. :  97%|█████████████████████████████████████████▊ | 218/224 [01:52<00:03,  1.97it/s]
Epoch 15 Iter 219: loss 0.21284. :  98%|██████████████████████████████████████████ | 219/224 [01:52<00:02,  1.98it/s]
Epoch 15 Iter 220: loss 0.23597. :  98%|██████████████████████████████████████████ | 219/224 [01:53<00:02,  1.98it/s]
Epoch 15 Iter 220: loss 0.23597. :  98%|██████████████████████████████████████████▏| 220/224 [01:53<00:02,  1.97it/s]
Epoch 15 Iter 221: loss 0.22566. :  98%|██████████████████████████████████████████▏| 220/224 [01:53<00:02,  1.97it/s]
Epoch 15 Iter 221: loss 0.22566. :  99%|██████████████████████████████████████████▍| 221/224 [01:53<00:01,  1.97it/s]
Epoch 15 Iter 222: loss 0.24229. :  99%|██████████████████████████████████████████▍| 221/224 [01:54<00:01,  1.97it/s]
Epoch 15 Iter 222: loss 0.24229. :  99%|██████████████████████████████████████████▌| 222/224 [01:54<00:01,  1.98it/s]
Epoch 15 Iter 223: loss 0.22975. :  99%|██████████████████████████████████████████▌| 222/224 [01:54<00:01,  1.98it/s]
Epoch 15 Iter 223: loss 0.22975. : 100%|██████████████████████████████████████████▊| 223/224 [01:54<00:00,  1.98it/s]
Epoch 15 Iter 224: loss 0.24426. : 100%|██████████████████████████████████████████▊| 223/224 [01:55<00:00,  1.98it/s]
Epoch 15 Iter 224: loss 0.24426. : 100%|███████████████████████████████████████████| 224/224 [01:55<00:00,  2.00it/s]
Epoch 15 Iter 224: loss 0.24426. : 100%|███████████████████████████████████████████| 224/224 [01:55<00:00,  1.95it/s]

    Train loss: 0.23451
    Valid loss: 0.23561
       Valid loss recons: 0.22463
       Valid loss KL-D:   1.09781
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.22583. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.22583. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 16 Iter 2: loss 0.26005. :   0%|▏                                              | 1/224 [00:00<01:49,  2.03it/s]
Epoch 16 Iter 2: loss 0.26005. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 16 Iter 3: loss 0.24582. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 16 Iter 3: loss 0.24582. :   1%|▋                                              | 3/224 [00:01<02:05,  1.76it/s]
Epoch 16 Iter 4: loss 0.24131. :   1%|▋                                              | 3/224 [00:02<02:05,  1.76it/s]
Epoch 16 Iter 4: loss 0.24131. :   2%|▊                                              | 4/224 [00:02<02:14,  1.63it/s]
Epoch 16 Iter 5: loss 0.24275. :   2%|▊                                              | 4/224 [00:02<02:14,  1.63it/s]
Epoch 16 Iter 5: loss 0.24275. :   2%|█                                              | 5/224 [00:02<02:17,  1.59it/s]
Epoch 16 Iter 6: loss 0.23313. :   2%|█                                              | 5/224 [00:03<02:17,  1.59it/s]
Epoch 16 Iter 6: loss 0.23313. :   3%|█▎                                             | 6/224 [00:03<02:22,  1.53it/s]
Epoch 16 Iter 7: loss 0.23439. :   3%|█▎                                             | 6/224 [00:04<02:22,  1.53it/s]
Epoch 16 Iter 7: loss 0.23439. :   3%|█▍                                             | 7/224 [00:04<02:30,  1.44it/s]
Epoch 16 Iter 8: loss 0.23657. :   3%|█▍                                             | 7/224 [00:05<02:30,  1.44it/s]
Epoch 16 Iter 8: loss 0.23657. :   4%|█▋                                             | 8/224 [00:05<02:37,  1.37it/s]
Epoch 16 Iter 9: loss 0.21487. :   4%|█▋                                             | 8/224 [00:06<02:37,  1.37it/s]
Epoch 16 Iter 9: loss 0.21487. :   4%|█▉                                             | 9/224 [00:06<02:40,  1.34it/s]
Epoch 16 Iter 10: loss 0.24435. :   4%|█▊                                            | 9/224 [00:06<02:40,  1.34it/s]
Epoch 16 Iter 10: loss 0.24435. :   4%|██                                           | 10/224 [00:06<02:28,  1.45it/s]
Epoch 16 Iter 11: loss 0.22427. :   4%|██                                           | 10/224 [00:07<02:28,  1.45it/s]
Epoch 16 Iter 11: loss 0.22427. :   5%|██▏                                          | 11/224 [00:07<02:31,  1.41it/s]
Epoch 16 Iter 12: loss 0.23275. :   5%|██▏                                          | 11/224 [00:08<02:31,  1.41it/s]
Epoch 16 Iter 12: loss 0.23275. :   5%|██▍                                          | 12/224 [00:08<02:33,  1.38it/s]
Epoch 16 Iter 13: loss 0.23670. :   5%|██▍                                          | 12/224 [00:08<02:33,  1.38it/s]
Epoch 16 Iter 13: loss 0.23670. :   6%|██▌                                          | 13/224 [00:08<02:22,  1.49it/s]
Epoch 16 Iter 14: loss 0.25263. :   6%|██▌                                          | 13/224 [00:09<02:22,  1.49it/s]
Epoch 16 Iter 14: loss 0.25263. :   6%|██▊                                          | 14/224 [00:09<02:12,  1.58it/s]
Epoch 16 Iter 15: loss 0.25549. :   6%|██▊                                          | 14/224 [00:09<02:12,  1.58it/s]
Epoch 16 Iter 15: loss 0.25549. :   7%|███                                          | 15/224 [00:09<02:05,  1.66it/s]
Epoch 16 Iter 16: loss 0.24262. :   7%|███                                          | 15/224 [00:10<02:05,  1.66it/s]
Epoch 16 Iter 16: loss 0.24262. :   7%|███▏                                         | 16/224 [00:10<02:01,  1.72it/s]
Epoch 16 Iter 17: loss 0.24141. :   7%|███▏                                         | 16/224 [00:10<02:01,  1.72it/s]
Epoch 16 Iter 17: loss 0.24141. :   8%|███▍                                         | 17/224 [00:10<02:01,  1.70it/s]
Epoch 16 Iter 18: loss 0.24326. :   8%|███▍                                         | 17/224 [00:11<02:01,  1.70it/s]
Epoch 16 Iter 18: loss 0.24326. :   8%|███▌                                         | 18/224 [00:11<01:58,  1.74it/s]
Epoch 16 Iter 19: loss 0.25140. :   8%|███▌                                         | 18/224 [00:12<01:58,  1.74it/s]
Epoch 16 Iter 19: loss 0.25140. :   8%|███▊                                         | 19/224 [00:12<02:10,  1.57it/s]
Epoch 16 Iter 20: loss 0.26256. :   8%|███▊                                         | 19/224 [00:12<02:10,  1.57it/s]
Epoch 16 Iter 20: loss 0.26256. :   9%|████                                         | 20/224 [00:12<02:02,  1.66it/s]
Epoch 16 Iter 21: loss 0.24062. :   9%|████                                         | 20/224 [00:13<02:02,  1.66it/s]
Epoch 16 Iter 21: loss 0.24062. :   9%|████▏                                        | 21/224 [00:13<01:58,  1.72it/s]
Epoch 16 Iter 22: loss 0.24330. :   9%|████▏                                        | 21/224 [00:13<01:58,  1.72it/s]
Epoch 16 Iter 22: loss 0.24330. :  10%|████▍                                        | 22/224 [00:13<01:57,  1.72it/s]
Epoch 16 Iter 23: loss 0.25666. :  10%|████▍                                        | 22/224 [00:14<01:57,  1.72it/s]
Epoch 16 Iter 23: loss 0.25666. :  10%|████▌                                        | 23/224 [00:14<01:54,  1.76it/s]
Epoch 16 Iter 24: loss 0.22416. :  10%|████▌                                        | 23/224 [00:15<01:54,  1.76it/s]
Epoch 16 Iter 24: loss 0.22416. :  11%|████▊                                        | 24/224 [00:15<01:57,  1.70it/s]
Epoch 16 Iter 25: loss 0.23052. :  11%|████▊                                        | 24/224 [00:15<01:57,  1.70it/s]
Epoch 16 Iter 25: loss 0.23052. :  11%|█████                                        | 25/224 [00:15<01:56,  1.71it/s]
Epoch 16 Iter 26: loss 0.22530. :  11%|█████                                        | 25/224 [00:16<01:56,  1.71it/s]
Epoch 16 Iter 26: loss 0.22530. :  12%|█████▏                                       | 26/224 [00:16<01:52,  1.76it/s]
Epoch 16 Iter 27: loss 0.24639. :  12%|█████▏                                       | 26/224 [00:16<01:52,  1.76it/s]
Epoch 16 Iter 27: loss 0.24639. :  12%|█████▍                                       | 27/224 [00:16<01:50,  1.78it/s]
Epoch 16 Iter 28: loss 0.22253. :  12%|█████▍                                       | 27/224 [00:17<01:50,  1.78it/s]
Epoch 16 Iter 28: loss 0.22253. :  12%|█████▋                                       | 28/224 [00:17<01:48,  1.81it/s]
Epoch 16 Iter 29: loss 0.23617. :  12%|█████▋                                       | 28/224 [00:17<01:48,  1.81it/s]
Epoch 16 Iter 29: loss 0.23617. :  13%|█████▊                                       | 29/224 [00:17<01:46,  1.83it/s]
Epoch 16 Iter 30: loss 0.22496. :  13%|█████▊                                       | 29/224 [00:18<01:46,  1.83it/s]
Epoch 16 Iter 30: loss 0.22496. :  13%|██████                                       | 30/224 [00:18<01:46,  1.81it/s]
Epoch 16 Iter 31: loss 0.22736. :  13%|██████                                       | 30/224 [00:18<01:46,  1.81it/s]
Epoch 16 Iter 31: loss 0.22736. :  14%|██████▏                                      | 31/224 [00:18<01:45,  1.83it/s]
Epoch 16 Iter 32: loss 0.22255. :  14%|██████▏                                      | 31/224 [00:19<01:45,  1.83it/s]
Epoch 16 Iter 32: loss 0.22255. :  14%|██████▍                                      | 32/224 [00:19<01:44,  1.84it/s]
Epoch 16 Iter 33: loss 0.23163. :  14%|██████▍                                      | 32/224 [00:19<01:44,  1.84it/s]
Epoch 16 Iter 33: loss 0.23163. :  15%|██████▋                                      | 33/224 [00:19<01:43,  1.85it/s]
Epoch 16 Iter 34: loss 0.22982. :  15%|██████▋                                      | 33/224 [00:20<01:43,  1.85it/s]
Epoch 16 Iter 34: loss 0.22982. :  15%|██████▊                                      | 34/224 [00:20<01:44,  1.81it/s]
Epoch 16 Iter 35: loss 0.23741. :  15%|██████▊                                      | 34/224 [00:21<01:44,  1.81it/s]
Epoch 16 Iter 35: loss 0.23741. :  16%|███████                                      | 35/224 [00:21<01:44,  1.81it/s]
Epoch 16 Iter 36: loss 0.21898. :  16%|███████                                      | 35/224 [00:21<01:44,  1.81it/s]
Epoch 16 Iter 36: loss 0.21898. :  16%|███████▏                                     | 36/224 [00:21<01:48,  1.74it/s]
Epoch 16 Iter 37: loss 0.23801. :  16%|███████▏                                     | 36/224 [00:22<01:48,  1.74it/s]
Epoch 16 Iter 37: loss 0.23801. :  17%|███████▍                                     | 37/224 [00:22<01:57,  1.59it/s]
Epoch 16 Iter 38: loss 0.23218. :  17%|███████▍                                     | 37/224 [00:23<01:57,  1.59it/s]
Epoch 16 Iter 38: loss 0.23218. :  17%|███████▋                                     | 38/224 [00:23<02:02,  1.52it/s]
Epoch 16 Iter 39: loss 0.24331. :  17%|███████▋                                     | 38/224 [00:23<02:02,  1.52it/s]
Epoch 16 Iter 39: loss 0.24331. :  17%|███████▊                                     | 39/224 [00:23<01:59,  1.55it/s]
Epoch 16 Iter 40: loss 0.23211. :  17%|███████▊                                     | 39/224 [00:24<01:59,  1.55it/s]
Epoch 16 Iter 40: loss 0.23211. :  18%|████████                                     | 40/224 [00:24<02:05,  1.46it/s]
Epoch 16 Iter 41: loss 0.22799. :  18%|████████                                     | 40/224 [00:25<02:05,  1.46it/s]
Epoch 16 Iter 41: loss 0.22799. :  18%|████████▏                                    | 41/224 [00:25<02:08,  1.42it/s]
Epoch 16 Iter 42: loss 0.25129. :  18%|████████▏                                    | 41/224 [00:25<02:08,  1.42it/s]
Epoch 16 Iter 42: loss 0.25129. :  19%|████████▍                                    | 42/224 [00:25<02:03,  1.48it/s]
Epoch 16 Iter 43: loss 0.23599. :  19%|████████▍                                    | 42/224 [00:26<02:03,  1.48it/s]
Epoch 16 Iter 43: loss 0.23599. :  19%|████████▋                                    | 43/224 [00:26<01:55,  1.56it/s]
Epoch 16 Iter 44: loss 0.22168. :  19%|████████▋                                    | 43/224 [00:27<01:55,  1.56it/s]
Epoch 16 Iter 44: loss 0.22168. :  20%|████████▊                                    | 44/224 [00:27<01:52,  1.61it/s]
Epoch 16 Iter 45: loss 0.22531. :  20%|████████▊                                    | 44/224 [00:27<01:52,  1.61it/s]
Epoch 16 Iter 45: loss 0.22531. :  20%|█████████                                    | 45/224 [00:27<01:56,  1.53it/s]
Epoch 16 Iter 46: loss 0.22858. :  20%|█████████                                    | 45/224 [00:28<01:56,  1.53it/s]
Epoch 16 Iter 46: loss 0.22858. :  21%|█████████▏                                   | 46/224 [00:28<01:55,  1.54it/s]
Epoch 16 Iter 47: loss 0.23237. :  21%|█████████▏                                   | 46/224 [00:28<01:55,  1.54it/s]
Epoch 16 Iter 47: loss 0.23237. :  21%|█████████▍                                   | 47/224 [00:28<01:51,  1.59it/s]
Epoch 16 Iter 48: loss 0.22419. :  21%|█████████▍                                   | 47/224 [00:29<01:51,  1.59it/s]
Epoch 16 Iter 48: loss 0.22419. :  21%|█████████▋                                   | 48/224 [00:29<01:52,  1.57it/s]
Epoch 16 Iter 49: loss 0.23726. :  21%|█████████▋                                   | 48/224 [00:30<01:52,  1.57it/s]
Epoch 16 Iter 49: loss 0.23726. :  22%|█████████▊                                   | 49/224 [00:30<01:46,  1.65it/s]
Epoch 16 Iter 50: loss 0.23175. :  22%|█████████▊                                   | 49/224 [00:30<01:46,  1.65it/s]
Epoch 16 Iter 50: loss 0.23175. :  22%|██████████                                   | 50/224 [00:30<01:42,  1.70it/s]
Epoch 16 Iter 51: loss 0.23007. :  22%|██████████                                   | 50/224 [00:31<01:42,  1.70it/s]
Epoch 16 Iter 51: loss 0.23007. :  23%|██████████▏                                  | 51/224 [00:31<01:39,  1.73it/s]
Epoch 16 Iter 52: loss 0.23144. :  23%|██████████▏                                  | 51/224 [00:31<01:39,  1.73it/s]
Epoch 16 Iter 52: loss 0.23144. :  23%|██████████▍                                  | 52/224 [00:31<01:36,  1.78it/s]
Epoch 16 Iter 53: loss 0.20602. :  23%|██████████▍                                  | 52/224 [00:32<01:36,  1.78it/s]
Epoch 16 Iter 53: loss 0.20602. :  24%|██████████▋                                  | 53/224 [00:32<01:35,  1.79it/s]
Epoch 16 Iter 54: loss 0.22946. :  24%|██████████▋                                  | 53/224 [00:32<01:35,  1.79it/s]
Epoch 16 Iter 54: loss 0.22946. :  24%|██████████▊                                  | 54/224 [00:32<01:37,  1.74it/s]
Epoch 16 Iter 55: loss 0.23974. :  24%|██████████▊                                  | 54/224 [00:33<01:37,  1.74it/s]
Epoch 16 Iter 55: loss 0.23974. :  25%|███████████                                  | 55/224 [00:33<01:38,  1.72it/s]
Epoch 16 Iter 56: loss 0.24330. :  25%|███████████                                  | 55/224 [00:34<01:38,  1.72it/s]
Epoch 16 Iter 56: loss 0.24330. :  25%|███████████▎                                 | 56/224 [00:34<01:47,  1.56it/s]
Epoch 16 Iter 57: loss 0.21962. :  25%|███████████▎                                 | 56/224 [00:35<01:47,  1.56it/s]
Epoch 16 Iter 57: loss 0.21962. :  25%|███████████▍                                 | 57/224 [00:35<01:54,  1.45it/s]
Epoch 16 Iter 58: loss 0.24562. :  25%|███████████▍                                 | 57/224 [00:35<01:54,  1.45it/s]
Epoch 16 Iter 58: loss 0.24562. :  26%|███████████▋                                 | 58/224 [00:35<01:59,  1.39it/s]
Epoch 16 Iter 59: loss 0.22997. :  26%|███████████▋                                 | 58/224 [00:36<01:59,  1.39it/s]
Epoch 16 Iter 59: loss 0.22997. :  26%|███████████▊                                 | 59/224 [00:36<02:01,  1.36it/s]
Epoch 16 Iter 60: loss 0.25412. :  26%|███████████▊                                 | 59/224 [00:37<02:01,  1.36it/s]
Epoch 16 Iter 60: loss 0.25412. :  27%|████████████                                 | 60/224 [00:37<02:03,  1.33it/s]
Epoch 16 Iter 61: loss 0.22947. :  27%|████████████                                 | 60/224 [00:38<02:03,  1.33it/s]
Epoch 16 Iter 61: loss 0.22947. :  27%|████████████▎                                | 61/224 [00:38<01:53,  1.44it/s]
Epoch 16 Iter 62: loss 0.23718. :  27%|████████████▎                                | 61/224 [00:38<01:53,  1.44it/s]
Epoch 16 Iter 62: loss 0.23718. :  28%|████████████▍                                | 62/224 [00:38<01:56,  1.39it/s]
Epoch 16 Iter 63: loss 0.22598. :  28%|████████████▍                                | 62/224 [00:39<01:56,  1.39it/s]
Epoch 16 Iter 63: loss 0.22598. :  28%|████████████▋                                | 63/224 [00:39<01:51,  1.45it/s]
Epoch 16 Iter 64: loss 0.25408. :  28%|████████████▋                                | 63/224 [00:40<01:51,  1.45it/s]
Epoch 16 Iter 64: loss 0.25408. :  29%|████████████▊                                | 64/224 [00:40<01:46,  1.50it/s]
Epoch 16 Iter 65: loss 0.22689. :  29%|████████████▊                                | 64/224 [00:40<01:46,  1.50it/s]
Epoch 16 Iter 65: loss 0.22689. :  29%|█████████████                                | 65/224 [00:40<01:41,  1.56it/s]
Epoch 16 Iter 66: loss 0.24954. :  29%|█████████████                                | 65/224 [00:41<01:41,  1.56it/s]
Epoch 16 Iter 66: loss 0.24954. :  29%|█████████████▎                               | 66/224 [00:41<01:37,  1.62it/s]
Epoch 16 Iter 67: loss 0.25354. :  29%|█████████████▎                               | 66/224 [00:41<01:37,  1.62it/s]
Epoch 16 Iter 67: loss 0.25354. :  30%|█████████████▍                               | 67/224 [00:41<01:33,  1.68it/s]
Epoch 16 Iter 68: loss 0.23426. :  30%|█████████████▍                               | 67/224 [00:42<01:33,  1.68it/s]
Epoch 16 Iter 68: loss 0.23426. :  30%|█████████████▋                               | 68/224 [00:42<01:29,  1.75it/s]
Epoch 16 Iter 69: loss 0.22816. :  30%|█████████████▋                               | 68/224 [00:42<01:29,  1.75it/s]
Epoch 16 Iter 69: loss 0.22816. :  31%|█████████████▊                               | 69/224 [00:42<01:28,  1.76it/s]
Epoch 16 Iter 70: loss 0.22413. :  31%|█████████████▊                               | 69/224 [00:43<01:28,  1.76it/s]
Epoch 16 Iter 70: loss 0.22413. :  31%|██████████████                               | 70/224 [00:43<01:28,  1.74it/s]
Epoch 16 Iter 71: loss 0.23982. :  31%|██████████████                               | 70/224 [00:44<01:28,  1.74it/s]
Epoch 16 Iter 71: loss 0.23982. :  32%|██████████████▎                              | 71/224 [00:44<01:30,  1.69it/s]
Epoch 16 Iter 72: loss 0.23842. :  32%|██████████████▎                              | 71/224 [00:44<01:30,  1.69it/s]
Epoch 16 Iter 72: loss 0.23842. :  32%|██████████████▍                              | 72/224 [00:44<01:32,  1.65it/s]
Epoch 16 Iter 73: loss 0.24635. :  32%|██████████████▍                              | 72/224 [00:45<01:32,  1.65it/s]
Epoch 16 Iter 73: loss 0.24635. :  33%|██████████████▋                              | 73/224 [00:45<01:28,  1.71it/s]
Epoch 16 Iter 74: loss 0.24773. :  33%|██████████████▋                              | 73/224 [00:45<01:28,  1.71it/s]
Epoch 16 Iter 74: loss 0.24773. :  33%|██████████████▊                              | 74/224 [00:45<01:25,  1.76it/s]
Epoch 16 Iter 75: loss 0.25226. :  33%|██████████████▊                              | 74/224 [00:46<01:25,  1.76it/s]
Epoch 16 Iter 75: loss 0.25226. :  33%|███████████████                              | 75/224 [00:46<01:26,  1.71it/s]
Epoch 16 Iter 76: loss 0.25106. :  33%|███████████████                              | 75/224 [00:46<01:26,  1.71it/s]
Epoch 16 Iter 76: loss 0.25106. :  34%|███████████████▎                             | 76/224 [00:46<01:24,  1.75it/s]
Epoch 16 Iter 77: loss 0.24490. :  34%|███████████████▎                             | 76/224 [00:47<01:24,  1.75it/s]
Epoch 16 Iter 77: loss 0.24490. :  34%|███████████████▍                             | 77/224 [00:47<01:24,  1.74it/s]
Epoch 16 Iter 78: loss 0.22285. :  34%|███████████████▍                             | 77/224 [00:48<01:24,  1.74it/s]
Epoch 16 Iter 78: loss 0.22285. :  35%|███████████████▋                             | 78/224 [00:48<01:23,  1.75it/s]
Epoch 16 Iter 79: loss 0.22233. :  35%|███████████████▋                             | 78/224 [00:48<01:23,  1.75it/s]
Epoch 16 Iter 79: loss 0.22233. :  35%|███████████████▊                             | 79/224 [00:48<01:22,  1.76it/s]
Epoch 16 Iter 80: loss 0.24283. :  35%|███████████████▊                             | 79/224 [00:49<01:22,  1.76it/s]
Epoch 16 Iter 80: loss 0.24283. :  36%|████████████████                             | 80/224 [00:49<01:21,  1.78it/s]
Epoch 16 Iter 81: loss 0.24295. :  36%|████████████████                             | 80/224 [00:49<01:21,  1.78it/s]
Epoch 16 Iter 81: loss 0.24295. :  36%|████████████████▎                            | 81/224 [00:49<01:22,  1.74it/s]
Epoch 16 Iter 82: loss 0.23445. :  36%|████████████████▎                            | 81/224 [00:50<01:22,  1.74it/s]
Epoch 16 Iter 82: loss 0.23445. :  37%|████████████████▍                            | 82/224 [00:50<01:20,  1.77it/s]
Epoch 16 Iter 83: loss 0.24980. :  37%|████████████████▍                            | 82/224 [00:50<01:20,  1.77it/s]
Epoch 16 Iter 83: loss 0.24980. :  37%|████████████████▋                            | 83/224 [00:50<01:23,  1.70it/s]
Epoch 16 Iter 84: loss 0.23757. :  37%|████████████████▋                            | 83/224 [00:51<01:23,  1.70it/s]
Epoch 16 Iter 84: loss 0.23757. :  38%|████████████████▉                            | 84/224 [00:51<01:25,  1.63it/s]
Epoch 16 Iter 85: loss 0.24072. :  38%|████████████████▉                            | 84/224 [00:52<01:25,  1.63it/s]
Epoch 16 Iter 85: loss 0.24072. :  38%|█████████████████                            | 85/224 [00:52<01:29,  1.56it/s]
Epoch 16 Iter 86: loss 0.22704. :  38%|█████████████████                            | 85/224 [00:53<01:29,  1.56it/s]
Epoch 16 Iter 86: loss 0.22704. :  38%|█████████████████▎                           | 86/224 [00:53<01:33,  1.48it/s]
Epoch 16 Iter 87: loss 0.22702. :  38%|█████████████████▎                           | 86/224 [00:53<01:33,  1.48it/s]
Epoch 16 Iter 87: loss 0.22702. :  39%|█████████████████▍                           | 87/224 [00:53<01:36,  1.42it/s]
Epoch 16 Iter 88: loss 0.22762. :  39%|█████████████████▍                           | 87/224 [00:54<01:36,  1.42it/s]
Epoch 16 Iter 88: loss 0.22762. :  39%|█████████████████▋                           | 88/224 [00:54<01:36,  1.40it/s]
Epoch 16 Iter 89: loss 0.20478. :  39%|█████████████████▋                           | 88/224 [00:55<01:36,  1.40it/s]
Epoch 16 Iter 89: loss 0.20478. :  40%|█████████████████▉                           | 89/224 [00:55<01:38,  1.37it/s]
Epoch 16 Iter 90: loss 0.24418. :  40%|█████████████████▉                           | 89/224 [00:55<01:38,  1.37it/s]
Epoch 16 Iter 90: loss 0.24418. :  40%|██████████████████                           | 90/224 [00:55<01:32,  1.45it/s]
Epoch 16 Iter 91: loss 0.24548. :  40%|██████████████████                           | 90/224 [00:56<01:32,  1.45it/s]
Epoch 16 Iter 91: loss 0.24548. :  41%|██████████████████▎                          | 91/224 [00:56<01:25,  1.55it/s]
Epoch 16 Iter 92: loss 0.21750. :  41%|██████████████████▎                          | 91/224 [00:57<01:25,  1.55it/s]
Epoch 16 Iter 92: loss 0.21750. :  41%|██████████████████▍                          | 92/224 [00:57<01:20,  1.64it/s]
Epoch 16 Iter 93: loss 0.23055. :  41%|██████████████████▍                          | 92/224 [00:57<01:20,  1.64it/s]
Epoch 16 Iter 93: loss 0.23055. :  42%|██████████████████▋                          | 93/224 [00:57<01:16,  1.71it/s]
Epoch 16 Iter 94: loss 0.22712. :  42%|██████████████████▋                          | 93/224 [00:58<01:16,  1.71it/s]
Epoch 16 Iter 94: loss 0.22712. :  42%|██████████████████▉                          | 94/224 [00:58<01:16,  1.70it/s]
Epoch 16 Iter 95: loss 0.23959. :  42%|██████████████████▉                          | 94/224 [00:58<01:16,  1.70it/s]
Epoch 16 Iter 95: loss 0.23959. :  42%|███████████████████                          | 95/224 [00:58<01:22,  1.57it/s]
Epoch 16 Iter 96: loss 0.23570. :  42%|███████████████████                          | 95/224 [00:59<01:22,  1.57it/s]
Epoch 16 Iter 96: loss 0.23570. :  43%|███████████████████▎                         | 96/224 [00:59<01:17,  1.65it/s]
Epoch 16 Iter 97: loss 0.22772. :  43%|███████████████████▎                         | 96/224 [00:59<01:17,  1.65it/s]
Epoch 16 Iter 97: loss 0.22772. :  43%|███████████████████▍                         | 97/224 [00:59<01:14,  1.70it/s]
Epoch 16 Iter 98: loss 0.22465. :  43%|███████████████████▍                         | 97/224 [01:00<01:14,  1.70it/s]
Epoch 16 Iter 98: loss 0.22465. :  44%|███████████████████▋                         | 98/224 [01:00<01:14,  1.70it/s]
Epoch 16 Iter 99: loss 0.22664. :  44%|███████████████████▋                         | 98/224 [01:01<01:14,  1.70it/s]
Epoch 16 Iter 99: loss 0.22664. :  44%|███████████████████▉                         | 99/224 [01:01<01:18,  1.59it/s]
Epoch 16 Iter 100: loss 0.22691. :  44%|███████████████████▍                        | 99/224 [01:01<01:18,  1.59it/s]
Epoch 16 Iter 100: loss 0.22691. :  45%|███████████████████▏                       | 100/224 [01:01<01:19,  1.55it/s]
Epoch 16 Iter 101: loss 0.23213. :  45%|███████████████████▏                       | 100/224 [01:02<01:19,  1.55it/s]
Epoch 16 Iter 101: loss 0.23213. :  45%|███████████████████▍                       | 101/224 [01:02<01:16,  1.62it/s]
Epoch 16 Iter 102: loss 0.24041. :  45%|███████████████████▍                       | 101/224 [01:03<01:16,  1.62it/s]
Epoch 16 Iter 102: loss 0.24041. :  46%|███████████████████▌                       | 102/224 [01:03<01:12,  1.67it/s]
Epoch 16 Iter 103: loss 0.23636. :  46%|███████████████████▌                       | 102/224 [01:03<01:12,  1.67it/s]
Epoch 16 Iter 103: loss 0.23636. :  46%|███████████████████▊                       | 103/224 [01:03<01:10,  1.73it/s]
Epoch 16 Iter 104: loss 0.21890. :  46%|███████████████████▊                       | 103/224 [01:04<01:10,  1.73it/s]
Epoch 16 Iter 104: loss 0.21890. :  46%|███████████████████▉                       | 104/224 [01:04<01:12,  1.65it/s]
Epoch 16 Iter 105: loss 0.23864. :  46%|███████████████████▉                       | 104/224 [01:04<01:12,  1.65it/s]
Epoch 16 Iter 105: loss 0.23864. :  47%|████████████████████▏                      | 105/224 [01:04<01:10,  1.70it/s]
Epoch 16 Iter 106: loss 0.24672. :  47%|████████████████████▏                      | 105/224 [01:05<01:10,  1.70it/s]
Epoch 16 Iter 106: loss 0.24672. :  47%|████████████████████▎                      | 106/224 [01:05<01:07,  1.75it/s]
Epoch 16 Iter 107: loss 0.23599. :  47%|████████████████████▎                      | 106/224 [01:05<01:07,  1.75it/s]
Epoch 16 Iter 107: loss 0.23599. :  48%|████████████████████▌                      | 107/224 [01:05<01:05,  1.78it/s]
Epoch 16 Iter 108: loss 0.24939. :  48%|████████████████████▌                      | 107/224 [01:06<01:05,  1.78it/s]
Epoch 16 Iter 108: loss 0.24939. :  48%|████████████████████▋                      | 108/224 [01:06<01:05,  1.77it/s]
Epoch 16 Iter 109: loss 0.24607. :  48%|████████████████████▋                      | 108/224 [01:07<01:05,  1.77it/s]
Epoch 16 Iter 109: loss 0.24607. :  49%|████████████████████▉                      | 109/224 [01:07<01:04,  1.79it/s]
Epoch 16 Iter 110: loss 0.21793. :  49%|████████████████████▉                      | 109/224 [01:07<01:04,  1.79it/s]
Epoch 16 Iter 110: loss 0.21793. :  49%|█████████████████████                      | 110/224 [01:07<01:03,  1.80it/s]
Epoch 16 Iter 111: loss 0.23492. :  49%|█████████████████████                      | 110/224 [01:08<01:03,  1.80it/s]
Epoch 16 Iter 111: loss 0.23492. :  50%|█████████████████████▎                     | 111/224 [01:08<01:04,  1.74it/s]
Epoch 16 Iter 112: loss 0.21979. :  50%|█████████████████████▎                     | 111/224 [01:08<01:04,  1.74it/s]
Epoch 16 Iter 112: loss 0.21979. :  50%|█████████████████████▌                     | 112/224 [01:08<01:02,  1.78it/s]
Epoch 16 Iter 113: loss 0.23914. :  50%|█████████████████████▌                     | 112/224 [01:09<01:02,  1.78it/s]
Epoch 16 Iter 113: loss 0.23914. :  50%|█████████████████████▋                     | 113/224 [01:09<01:02,  1.77it/s]
Epoch 16 Iter 114: loss 0.23476. :  50%|█████████████████████▋                     | 113/224 [01:09<01:02,  1.77it/s]
Epoch 16 Iter 114: loss 0.23476. :  51%|█████████████████████▉                     | 114/224 [01:09<01:04,  1.70it/s]
Epoch 16 Iter 115: loss 0.22959. :  51%|█████████████████████▉                     | 114/224 [01:10<01:04,  1.70it/s]
Epoch 16 Iter 115: loss 0.22959. :  51%|██████████████████████                     | 115/224 [01:10<01:11,  1.53it/s]
Epoch 16 Iter 116: loss 0.23475. :  51%|██████████████████████                     | 115/224 [01:11<01:11,  1.53it/s]
Epoch 16 Iter 116: loss 0.23475. :  52%|██████████████████████▎                    | 116/224 [01:11<01:14,  1.44it/s]
Epoch 16 Iter 117: loss 0.24336. :  52%|██████████████████████▎                    | 116/224 [01:12<01:14,  1.44it/s]
Epoch 16 Iter 117: loss 0.24336. :  52%|██████████████████████▍                    | 117/224 [01:12<01:12,  1.48it/s]
Epoch 16 Iter 118: loss 0.26244. :  52%|██████████████████████▍                    | 117/224 [01:12<01:12,  1.48it/s]
Epoch 16 Iter 118: loss 0.26244. :  53%|██████████████████████▋                    | 118/224 [01:12<01:09,  1.54it/s]
Epoch 16 Iter 119: loss 0.22385. :  53%|██████████████████████▋                    | 118/224 [01:13<01:09,  1.54it/s]
Epoch 16 Iter 119: loss 0.22385. :  53%|██████████████████████▊                    | 119/224 [01:13<01:04,  1.62it/s]
Epoch 16 Iter 120: loss 0.23584. :  53%|██████████████████████▊                    | 119/224 [01:14<01:04,  1.62it/s]
Epoch 16 Iter 120: loss 0.23584. :  54%|███████████████████████                    | 120/224 [01:14<01:08,  1.51it/s]
Epoch 16 Iter 121: loss 0.24912. :  54%|███████████████████████                    | 120/224 [01:14<01:08,  1.51it/s]
Epoch 16 Iter 121: loss 0.24912. :  54%|███████████████████████▏                   | 121/224 [01:14<01:08,  1.50it/s]
Epoch 16 Iter 122: loss 0.23976. :  54%|███████████████████████▏                   | 121/224 [01:15<01:08,  1.50it/s]
Epoch 16 Iter 122: loss 0.23976. :  54%|███████████████████████▍                   | 122/224 [01:15<01:02,  1.62it/s]
Epoch 16 Iter 123: loss 0.24137. :  54%|███████████████████████▍                   | 122/224 [01:15<01:02,  1.62it/s]
Epoch 16 Iter 123: loss 0.24137. :  55%|███████████████████████▌                   | 123/224 [01:15<01:01,  1.65it/s]
Epoch 16 Iter 124: loss 0.22475. :  55%|███████████████████████▌                   | 123/224 [01:16<01:01,  1.65it/s]
Epoch 16 Iter 124: loss 0.22475. :  55%|███████████████████████▊                   | 124/224 [01:16<00:58,  1.72it/s]
Epoch 16 Iter 125: loss 0.24569. :  55%|███████████████████████▊                   | 124/224 [01:16<00:58,  1.72it/s]
Epoch 16 Iter 125: loss 0.24569. :  56%|███████████████████████▉                   | 125/224 [01:16<00:56,  1.76it/s]
Epoch 16 Iter 126: loss 0.21109. :  56%|███████████████████████▉                   | 125/224 [01:17<00:56,  1.76it/s]
Epoch 16 Iter 126: loss 0.21109. :  56%|████████████████████████▏                  | 126/224 [01:17<00:58,  1.68it/s]
Epoch 16 Iter 127: loss 0.22525. :  56%|████████████████████████▏                  | 126/224 [01:18<00:58,  1.68it/s]
Epoch 16 Iter 127: loss 0.22525. :  57%|████████████████████████▍                  | 127/224 [01:18<00:55,  1.74it/s]
Epoch 16 Iter 128: loss 0.21506. :  57%|████████████████████████▍                  | 127/224 [01:18<00:55,  1.74it/s]
Epoch 16 Iter 128: loss 0.21506. :  57%|████████████████████████▌                  | 128/224 [01:18<00:54,  1.78it/s]
Epoch 16 Iter 129: loss 0.23430. :  57%|████████████████████████▌                  | 128/224 [01:19<00:54,  1.78it/s]
Epoch 16 Iter 129: loss 0.23430. :  58%|████████████████████████▊                  | 129/224 [01:19<00:59,  1.59it/s]
Epoch 16 Iter 130: loss 0.23122. :  58%|████████████████████████▊                  | 129/224 [01:20<00:59,  1.59it/s]
Epoch 16 Iter 130: loss 0.23122. :  58%|████████████████████████▉                  | 130/224 [01:20<01:03,  1.48it/s]
Epoch 16 Iter 131: loss 0.23479. :  58%|████████████████████████▉                  | 130/224 [01:20<01:03,  1.48it/s]
Epoch 16 Iter 131: loss 0.23479. :  58%|█████████████████████████▏                 | 131/224 [01:20<01:06,  1.41it/s]
Epoch 16 Iter 132: loss 0.25068. :  58%|█████████████████████████▏                 | 131/224 [01:21<01:06,  1.41it/s]
Epoch 16 Iter 132: loss 0.25068. :  59%|█████████████████████████▎                 | 132/224 [01:21<01:06,  1.38it/s]
Epoch 16 Iter 133: loss 0.23422. :  59%|█████████████████████████▎                 | 132/224 [01:22<01:06,  1.38it/s]
Epoch 16 Iter 133: loss 0.23422. :  59%|█████████████████████████▌                 | 133/224 [01:22<01:06,  1.37it/s]
Epoch 16 Iter 134: loss 0.25285. :  59%|█████████████████████████▌                 | 133/224 [01:23<01:06,  1.37it/s]
Epoch 16 Iter 134: loss 0.25285. :  60%|█████████████████████████▋                 | 134/224 [01:23<01:05,  1.36it/s]
Epoch 16 Iter 135: loss 0.24976. :  60%|█████████████████████████▋                 | 134/224 [01:23<01:05,  1.36it/s]
Epoch 16 Iter 135: loss 0.24976. :  60%|█████████████████████████▉                 | 135/224 [01:23<01:05,  1.35it/s]
Epoch 16 Iter 136: loss 0.23982. :  60%|█████████████████████████▉                 | 135/224 [01:24<01:05,  1.35it/s]
Epoch 16 Iter 136: loss 0.23982. :  61%|██████████████████████████                 | 136/224 [01:24<01:00,  1.45it/s]
Epoch 16 Iter 137: loss 0.23101. :  61%|██████████████████████████                 | 136/224 [01:25<01:00,  1.45it/s]
Epoch 16 Iter 137: loss 0.23101. :  61%|██████████████████████████▎                | 137/224 [01:25<00:57,  1.51it/s]
Epoch 16 Iter 138: loss 0.23405. :  61%|██████████████████████████▎                | 137/224 [01:25<00:57,  1.51it/s]
Epoch 16 Iter 138: loss 0.23405. :  62%|██████████████████████████▍                | 138/224 [01:25<00:54,  1.58it/s]
Epoch 16 Iter 139: loss 0.22367. :  62%|██████████████████████████▍                | 138/224 [01:26<00:54,  1.58it/s]
Epoch 16 Iter 139: loss 0.22367. :  62%|██████████████████████████▋                | 139/224 [01:26<00:52,  1.63it/s]
Epoch 16 Iter 140: loss 0.22148. :  62%|██████████████████████████▋                | 139/224 [01:26<00:52,  1.63it/s]
Epoch 16 Iter 140: loss 0.22148. :  62%|██████████████████████████▉                | 140/224 [01:26<00:49,  1.68it/s]
Epoch 16 Iter 141: loss 0.22720. :  62%|██████████████████████████▉                | 140/224 [01:27<00:49,  1.68it/s]
Epoch 16 Iter 141: loss 0.22720. :  63%|███████████████████████████                | 141/224 [01:27<00:47,  1.74it/s]
Epoch 16 Iter 142: loss 0.23162. :  63%|███████████████████████████                | 141/224 [01:27<00:47,  1.74it/s]
Epoch 16 Iter 142: loss 0.23162. :  63%|███████████████████████████▎               | 142/224 [01:27<00:46,  1.76it/s]
Epoch 16 Iter 143: loss 0.24041. :  63%|███████████████████████████▎               | 142/224 [01:28<00:46,  1.76it/s]
Epoch 16 Iter 143: loss 0.24041. :  64%|███████████████████████████▍               | 143/224 [01:28<00:47,  1.69it/s]
Epoch 16 Iter 144: loss 0.22420. :  64%|███████████████████████████▍               | 143/224 [01:29<00:47,  1.69it/s]
Epoch 16 Iter 144: loss 0.22420. :  64%|███████████████████████████▋               | 144/224 [01:29<00:46,  1.72it/s]
Epoch 16 Iter 145: loss 0.23975. :  64%|███████████████████████████▋               | 144/224 [01:29<00:46,  1.72it/s]
Epoch 16 Iter 145: loss 0.23975. :  65%|███████████████████████████▊               | 145/224 [01:29<00:49,  1.58it/s]
Epoch 16 Iter 146: loss 0.24589. :  65%|███████████████████████████▊               | 145/224 [01:30<00:49,  1.58it/s]
Epoch 16 Iter 146: loss 0.24589. :  65%|████████████████████████████               | 146/224 [01:30<00:51,  1.50it/s]
Epoch 16 Iter 147: loss 0.24679. :  65%|████████████████████████████               | 146/224 [01:31<00:51,  1.50it/s]
Epoch 16 Iter 147: loss 0.24679. :  66%|████████████████████████████▏              | 147/224 [01:31<00:52,  1.46it/s]
Epoch 16 Iter 148: loss 0.22511. :  66%|████████████████████████████▏              | 147/224 [01:31<00:52,  1.46it/s]
Epoch 16 Iter 148: loss 0.22511. :  66%|████████████████████████████▍              | 148/224 [01:31<00:48,  1.56it/s]
Epoch 16 Iter 149: loss 0.21087. :  66%|████████████████████████████▍              | 148/224 [01:32<00:48,  1.56it/s]
Epoch 16 Iter 149: loss 0.21087. :  67%|████████████████████████████▌              | 149/224 [01:32<00:46,  1.60it/s]
Epoch 16 Iter 150: loss 0.23775. :  67%|████████████████████████████▌              | 149/224 [01:33<00:46,  1.60it/s]
Epoch 16 Iter 150: loss 0.23775. :  67%|████████████████████████████▊              | 150/224 [01:33<00:45,  1.63it/s]
Epoch 16 Iter 151: loss 0.22329. :  67%|████████████████████████████▊              | 150/224 [01:33<00:45,  1.63it/s]
Epoch 16 Iter 151: loss 0.22329. :  67%|████████████████████████████▉              | 151/224 [01:33<00:48,  1.49it/s]
Epoch 16 Iter 152: loss 0.23775. :  67%|████████████████████████████▉              | 151/224 [01:34<00:48,  1.49it/s]
Epoch 16 Iter 152: loss 0.23775. :  68%|█████████████████████████████▏             | 152/224 [01:34<00:50,  1.43it/s]
Epoch 16 Iter 153: loss 0.24367. :  68%|█████████████████████████████▏             | 152/224 [01:35<00:50,  1.43it/s]
Epoch 16 Iter 153: loss 0.24367. :  68%|█████████████████████████████▎             | 153/224 [01:35<00:51,  1.39it/s]
Epoch 16 Iter 154: loss 0.23917. :  68%|█████████████████████████████▎             | 153/224 [01:35<00:51,  1.39it/s]
Epoch 16 Iter 154: loss 0.23917. :  69%|█████████████████████████████▌             | 154/224 [01:35<00:48,  1.44it/s]
Epoch 16 Iter 155: loss 0.22791. :  69%|█████████████████████████████▌             | 154/224 [01:36<00:48,  1.44it/s]
Epoch 16 Iter 155: loss 0.22791. :  69%|█████████████████████████████▊             | 155/224 [01:36<00:46,  1.48it/s]
Epoch 16 Iter 156: loss 0.21988. :  69%|█████████████████████████████▊             | 155/224 [01:37<00:46,  1.48it/s]
Epoch 16 Iter 156: loss 0.21988. :  70%|█████████████████████████████▉             | 156/224 [01:37<00:47,  1.42it/s]
Epoch 16 Iter 157: loss 0.24088. :  70%|█████████████████████████████▉             | 156/224 [01:37<00:47,  1.42it/s]
Epoch 16 Iter 157: loss 0.24088. :  70%|██████████████████████████████▏            | 157/224 [01:37<00:43,  1.53it/s]
Epoch 16 Iter 158: loss 0.23270. :  70%|██████████████████████████████▏            | 157/224 [01:38<00:43,  1.53it/s]
Epoch 16 Iter 158: loss 0.23270. :  71%|██████████████████████████████▎            | 158/224 [01:38<00:42,  1.54it/s]
Epoch 16 Iter 159: loss 0.22561. :  71%|██████████████████████████████▎            | 158/224 [01:39<00:42,  1.54it/s]
Epoch 16 Iter 159: loss 0.22561. :  71%|██████████████████████████████▌            | 159/224 [01:39<00:40,  1.62it/s]
Epoch 16 Iter 160: loss 0.22004. :  71%|██████████████████████████████▌            | 159/224 [01:39<00:40,  1.62it/s]
Epoch 16 Iter 160: loss 0.22004. :  71%|██████████████████████████████▋            | 160/224 [01:39<00:37,  1.70it/s]
Epoch 16 Iter 161: loss 0.21750. :  71%|██████████████████████████████▋            | 160/224 [01:40<00:37,  1.70it/s]
Epoch 16 Iter 161: loss 0.21750. :  72%|██████████████████████████████▉            | 161/224 [01:40<00:37,  1.70it/s]
Epoch 16 Iter 162: loss 0.24232. :  72%|██████████████████████████████▉            | 161/224 [01:40<00:37,  1.70it/s]
Epoch 16 Iter 162: loss 0.24232. :  72%|███████████████████████████████            | 162/224 [01:40<00:39,  1.56it/s]
Epoch 16 Iter 163: loss 0.22221. :  72%|███████████████████████████████            | 162/224 [01:41<00:39,  1.56it/s]
Epoch 16 Iter 163: loss 0.22221. :  73%|███████████████████████████████▎           | 163/224 [01:41<00:37,  1.62it/s]
Epoch 16 Iter 164: loss 0.21424. :  73%|███████████████████████████████▎           | 163/224 [01:42<00:37,  1.62it/s]
Epoch 16 Iter 164: loss 0.21424. :  73%|███████████████████████████████▍           | 164/224 [01:42<00:37,  1.59it/s]
Epoch 16 Iter 165: loss 0.23493. :  73%|███████████████████████████████▍           | 164/224 [01:42<00:37,  1.59it/s]
Epoch 16 Iter 165: loss 0.23493. :  74%|███████████████████████████████▋           | 165/224 [01:42<00:37,  1.56it/s]
Epoch 16 Iter 166: loss 0.20872. :  74%|███████████████████████████████▋           | 165/224 [01:43<00:37,  1.56it/s]
Epoch 16 Iter 166: loss 0.20872. :  74%|███████████████████████████████▊           | 166/224 [01:43<00:39,  1.47it/s]
Epoch 16 Iter 167: loss 0.21855. :  74%|███████████████████████████████▊           | 166/224 [01:44<00:39,  1.47it/s]
Epoch 16 Iter 167: loss 0.21855. :  75%|████████████████████████████████           | 167/224 [01:44<00:40,  1.42it/s]
Epoch 16 Iter 168: loss 0.25664. :  75%|████████████████████████████████           | 167/224 [01:45<00:40,  1.42it/s]
Epoch 16 Iter 168: loss 0.25664. :  75%|████████████████████████████████▎          | 168/224 [01:45<00:38,  1.45it/s]
Epoch 16 Iter 169: loss 0.22445. :  75%|████████████████████████████████▎          | 168/224 [01:45<00:38,  1.45it/s]
Epoch 16 Iter 169: loss 0.22445. :  75%|████████████████████████████████▍          | 169/224 [01:45<00:35,  1.54it/s]
Epoch 16 Iter 170: loss 0.23350. :  75%|████████████████████████████████▍          | 169/224 [01:46<00:35,  1.54it/s]
Epoch 16 Iter 170: loss 0.23350. :  76%|████████████████████████████████▋          | 170/224 [01:46<00:34,  1.58it/s]
Epoch 16 Iter 171: loss 0.23849. :  76%|████████████████████████████████▋          | 170/224 [01:46<00:34,  1.58it/s]
Epoch 16 Iter 171: loss 0.23849. :  76%|████████████████████████████████▊          | 171/224 [01:46<00:35,  1.49it/s]
Epoch 16 Iter 172: loss 0.24753. :  76%|████████████████████████████████▊          | 171/224 [01:47<00:35,  1.49it/s]
Epoch 16 Iter 172: loss 0.24753. :  77%|█████████████████████████████████          | 172/224 [01:47<00:36,  1.43it/s]
Epoch 16 Iter 173: loss 0.22391. :  77%|█████████████████████████████████          | 172/224 [01:48<00:36,  1.43it/s]
Epoch 16 Iter 173: loss 0.22391. :  77%|█████████████████████████████████▏         | 173/224 [01:48<00:34,  1.50it/s]
Epoch 16 Iter 174: loss 0.22992. :  77%|█████████████████████████████████▏         | 173/224 [01:49<00:34,  1.50it/s]
Epoch 16 Iter 174: loss 0.22992. :  78%|█████████████████████████████████▍         | 174/224 [01:49<00:34,  1.45it/s]
Epoch 16 Iter 175: loss 0.21803. :  78%|█████████████████████████████████▍         | 174/224 [01:49<00:34,  1.45it/s]
Epoch 16 Iter 175: loss 0.21803. :  78%|█████████████████████████████████▌         | 175/224 [01:49<00:34,  1.40it/s]
Epoch 16 Iter 176: loss 0.24154. :  78%|█████████████████████████████████▌         | 175/224 [01:50<00:34,  1.40it/s]
Epoch 16 Iter 176: loss 0.24154. :  79%|█████████████████████████████████▊         | 176/224 [01:50<00:35,  1.37it/s]
Epoch 16 Iter 177: loss 0.23429. :  79%|█████████████████████████████████▊         | 176/224 [01:51<00:35,  1.37it/s]
Epoch 16 Iter 177: loss 0.23429. :  79%|█████████████████████████████████▉         | 177/224 [01:51<00:34,  1.35it/s]
Epoch 16 Iter 178: loss 0.23045. :  79%|█████████████████████████████████▉         | 177/224 [01:51<00:34,  1.35it/s]
Epoch 16 Iter 178: loss 0.23045. :  79%|██████████████████████████████████▏        | 178/224 [01:51<00:31,  1.44it/s]
Epoch 16 Iter 179: loss 0.23213. :  79%|██████████████████████████████████▏        | 178/224 [01:52<00:31,  1.44it/s]
Epoch 16 Iter 179: loss 0.23213. :  80%|██████████████████████████████████▎        | 179/224 [01:52<00:30,  1.48it/s]
Epoch 16 Iter 180: loss 0.24507. :  80%|██████████████████████████████████▎        | 179/224 [01:53<00:30,  1.48it/s]
Epoch 16 Iter 180: loss 0.24507. :  80%|██████████████████████████████████▌        | 180/224 [01:53<00:27,  1.57it/s]
Epoch 16 Iter 181: loss 0.23716. :  80%|██████████████████████████████████▌        | 180/224 [01:53<00:27,  1.57it/s]
Epoch 16 Iter 181: loss 0.23716. :  81%|██████████████████████████████████▋        | 181/224 [01:53<00:26,  1.63it/s]
Epoch 16 Iter 182: loss 0.23482. :  81%|██████████████████████████████████▋        | 181/224 [01:54<00:26,  1.63it/s]
Epoch 16 Iter 182: loss 0.23482. :  81%|██████████████████████████████████▉        | 182/224 [01:54<00:24,  1.69it/s]
Epoch 16 Iter 183: loss 0.24376. :  81%|██████████████████████████████████▉        | 182/224 [01:54<00:24,  1.69it/s]
Epoch 16 Iter 183: loss 0.24376. :  82%|███████████████████████████████████▏       | 183/224 [01:54<00:23,  1.74it/s]
Epoch 16 Iter 184: loss 0.21190. :  82%|███████████████████████████████████▏       | 183/224 [01:55<00:23,  1.74it/s]
Epoch 16 Iter 184: loss 0.21190. :  82%|███████████████████████████████████▎       | 184/224 [01:55<00:22,  1.75it/s]
Epoch 16 Iter 185: loss 0.25691. :  82%|███████████████████████████████████▎       | 184/224 [01:55<00:22,  1.75it/s]
Epoch 16 Iter 185: loss 0.25691. :  83%|███████████████████████████████████▌       | 185/224 [01:55<00:21,  1.79it/s]
Epoch 16 Iter 186: loss 0.22452. :  83%|███████████████████████████████████▌       | 185/224 [01:56<00:21,  1.79it/s]
Epoch 16 Iter 186: loss 0.22452. :  83%|███████████████████████████████████▋       | 186/224 [01:56<00:20,  1.82it/s]
Epoch 16 Iter 187: loss 0.21718. :  83%|███████████████████████████████████▋       | 186/224 [01:57<00:20,  1.82it/s]
Epoch 16 Iter 187: loss 0.21718. :  83%|███████████████████████████████████▉       | 187/224 [01:57<00:21,  1.71it/s]
Epoch 16 Iter 188: loss 0.24289. :  83%|███████████████████████████████████▉       | 187/224 [01:57<00:21,  1.71it/s]
Epoch 16 Iter 188: loss 0.24289. :  84%|████████████████████████████████████       | 188/224 [01:57<00:21,  1.65it/s]
Epoch 16 Iter 189: loss 0.23019. :  84%|████████████████████████████████████       | 188/224 [01:58<00:21,  1.65it/s]
Epoch 16 Iter 189: loss 0.23019. :  84%|████████████████████████████████████▎      | 189/224 [01:58<00:20,  1.72it/s]
Epoch 16 Iter 190: loss 0.24231. :  84%|████████████████████████████████████▎      | 189/224 [01:58<00:20,  1.72it/s]
Epoch 16 Iter 190: loss 0.24231. :  85%|████████████████████████████████████▍      | 190/224 [01:58<00:19,  1.77it/s]
Epoch 16 Iter 191: loss 0.21489. :  85%|████████████████████████████████████▍      | 190/224 [01:59<00:19,  1.77it/s]
Epoch 16 Iter 191: loss 0.21489. :  85%|████████████████████████████████████▋      | 191/224 [01:59<00:18,  1.79it/s]
Epoch 16 Iter 192: loss 0.24706. :  85%|████████████████████████████████████▋      | 191/224 [01:59<00:18,  1.79it/s]
Epoch 16 Iter 192: loss 0.24706. :  86%|████████████████████████████████████▊      | 192/224 [01:59<00:17,  1.82it/s]
Epoch 16 Iter 193: loss 0.24557. :  86%|████████████████████████████████████▊      | 192/224 [02:00<00:17,  1.82it/s]
Epoch 16 Iter 193: loss 0.24557. :  86%|█████████████████████████████████████      | 193/224 [02:00<00:17,  1.80it/s]
Epoch 16 Iter 194: loss 0.24807. :  86%|█████████████████████████████████████      | 193/224 [02:00<00:17,  1.80it/s]
Epoch 16 Iter 194: loss 0.24807. :  87%|█████████████████████████████████████▏     | 194/224 [02:00<00:16,  1.79it/s]
Epoch 16 Iter 195: loss 0.24482. :  87%|█████████████████████████████████████▏     | 194/224 [02:01<00:16,  1.79it/s]
Epoch 16 Iter 195: loss 0.24482. :  87%|█████████████████████████████████████▍     | 195/224 [02:01<00:15,  1.82it/s]
Epoch 16 Iter 196: loss 0.22972. :  87%|█████████████████████████████████████▍     | 195/224 [02:02<00:15,  1.82it/s]
Epoch 16 Iter 196: loss 0.22972. :  88%|█████████████████████████████████████▋     | 196/224 [02:02<00:15,  1.83it/s]
Epoch 16 Iter 197: loss 0.23149. :  88%|█████████████████████████████████████▋     | 196/224 [02:02<00:15,  1.83it/s]
Epoch 16 Iter 197: loss 0.23149. :  88%|█████████████████████████████████████▊     | 197/224 [02:02<00:15,  1.74it/s]
Epoch 16 Iter 198: loss 0.24499. :  88%|█████████████████████████████████████▊     | 197/224 [02:03<00:15,  1.74it/s]
Epoch 16 Iter 198: loss 0.24499. :  88%|██████████████████████████████████████     | 198/224 [02:03<00:15,  1.65it/s]
Epoch 16 Iter 199: loss 0.22529. :  88%|██████████████████████████████████████     | 198/224 [02:03<00:15,  1.65it/s]
Epoch 16 Iter 199: loss 0.22529. :  89%|██████████████████████████████████████▏    | 199/224 [02:03<00:14,  1.70it/s]
Epoch 16 Iter 200: loss 0.21987. :  89%|██████████████████████████████████████▏    | 199/224 [02:04<00:14,  1.70it/s]
Epoch 16 Iter 200: loss 0.21987. :  89%|██████████████████████████████████████▍    | 200/224 [02:04<00:13,  1.76it/s]
Epoch 16 Iter 201: loss 0.22622. :  89%|██████████████████████████████████████▍    | 200/224 [02:04<00:13,  1.76it/s]
Epoch 16 Iter 201: loss 0.22622. :  90%|██████████████████████████████████████▌    | 201/224 [02:04<00:12,  1.80it/s]
Epoch 16 Iter 202: loss 0.23116. :  90%|██████████████████████████████████████▌    | 201/224 [02:05<00:12,  1.80it/s]
Epoch 16 Iter 202: loss 0.23116. :  90%|██████████████████████████████████████▊    | 202/224 [02:05<00:11,  1.85it/s]
Epoch 16 Iter 203: loss 0.27019. :  90%|██████████████████████████████████████▊    | 202/224 [02:05<00:11,  1.85it/s]
Epoch 16 Iter 203: loss 0.27019. :  91%|██████████████████████████████████████▉    | 203/224 [02:05<00:11,  1.89it/s]
Epoch 16 Iter 204: loss 0.23350. :  91%|██████████████████████████████████████▉    | 203/224 [02:06<00:11,  1.89it/s]
Epoch 16 Iter 204: loss 0.23350. :  91%|███████████████████████████████████████▏   | 204/224 [02:06<00:10,  1.91it/s]
Epoch 16 Iter 205: loss 0.23397. :  91%|███████████████████████████████████████▏   | 204/224 [02:06<00:10,  1.91it/s]
Epoch 16 Iter 205: loss 0.23397. :  92%|███████████████████████████████████████▎   | 205/224 [02:06<00:09,  1.92it/s]
Epoch 16 Iter 206: loss 0.23992. :  92%|███████████████████████████████████████▎   | 205/224 [02:07<00:09,  1.92it/s]
Epoch 16 Iter 206: loss 0.23992. :  92%|███████████████████████████████████████▌   | 206/224 [02:07<00:09,  1.94it/s]
Epoch 16 Iter 207: loss 0.22795. :  92%|███████████████████████████████████████▌   | 206/224 [02:08<00:09,  1.94it/s]
Epoch 16 Iter 207: loss 0.22795. :  92%|███████████████████████████████████████▋   | 207/224 [02:08<00:09,  1.86it/s]
Epoch 16 Iter 208: loss 0.23142. :  92%|███████████████████████████████████████▋   | 207/224 [02:08<00:09,  1.86it/s]
Epoch 16 Iter 208: loss 0.23142. :  93%|███████████████████████████████████████▉   | 208/224 [02:08<00:08,  1.88it/s]
Epoch 16 Iter 209: loss 0.22388. :  93%|███████████████████████████████████████▉   | 208/224 [02:09<00:08,  1.88it/s]
Epoch 16 Iter 209: loss 0.22388. :  93%|████████████████████████████████████████   | 209/224 [02:09<00:07,  1.91it/s]
Epoch 16 Iter 210: loss 0.24887. :  93%|████████████████████████████████████████   | 209/224 [02:09<00:07,  1.91it/s]
Epoch 16 Iter 210: loss 0.24887. :  94%|████████████████████████████████████████▎  | 210/224 [02:09<00:07,  1.93it/s]
Epoch 16 Iter 211: loss 0.23699. :  94%|████████████████████████████████████████▎  | 210/224 [02:10<00:07,  1.93it/s]
Epoch 16 Iter 211: loss 0.23699. :  94%|████████████████████████████████████████▌  | 211/224 [02:10<00:06,  1.92it/s]
Epoch 16 Iter 212: loss 0.26132. :  94%|████████████████████████████████████████▌  | 211/224 [02:10<00:06,  1.92it/s]
Epoch 16 Iter 212: loss 0.26132. :  95%|████████████████████████████████████████▋  | 212/224 [02:10<00:06,  1.86it/s]
Epoch 16 Iter 213: loss 0.24323. :  95%|████████████████████████████████████████▋  | 212/224 [02:11<00:06,  1.86it/s]
Epoch 16 Iter 213: loss 0.24323. :  95%|████████████████████████████████████████▉  | 213/224 [02:11<00:05,  1.89it/s]
Epoch 16 Iter 214: loss 0.21213. :  95%|████████████████████████████████████████▉  | 213/224 [02:11<00:05,  1.89it/s]
Epoch 16 Iter 214: loss 0.21213. :  96%|█████████████████████████████████████████  | 214/224 [02:11<00:05,  1.91it/s]
Epoch 16 Iter 215: loss 0.24010. :  96%|█████████████████████████████████████████  | 214/224 [02:12<00:05,  1.91it/s]
Epoch 16 Iter 215: loss 0.24010. :  96%|█████████████████████████████████████████▎ | 215/224 [02:12<00:04,  1.93it/s]
Epoch 16 Iter 216: loss 0.22707. :  96%|█████████████████████████████████████████▎ | 215/224 [02:12<00:04,  1.93it/s]
Epoch 16 Iter 216: loss 0.22707. :  96%|█████████████████████████████████████████▍ | 216/224 [02:12<00:04,  1.94it/s]
Epoch 16 Iter 217: loss 0.20969. :  96%|█████████████████████████████████████████▍ | 216/224 [02:13<00:04,  1.94it/s]
Epoch 16 Iter 217: loss 0.20969. :  97%|█████████████████████████████████████████▋ | 217/224 [02:13<00:03,  1.96it/s]
Epoch 16 Iter 218: loss 0.23241. :  97%|█████████████████████████████████████████▋ | 217/224 [02:13<00:03,  1.96it/s]
Epoch 16 Iter 218: loss 0.23241. :  97%|█████████████████████████████████████████▊ | 218/224 [02:13<00:03,  1.97it/s]
Epoch 16 Iter 219: loss 0.23989. :  97%|█████████████████████████████████████████▊ | 218/224 [02:14<00:03,  1.97it/s]
Epoch 16 Iter 219: loss 0.23989. :  98%|██████████████████████████████████████████ | 219/224 [02:14<00:02,  1.97it/s]
Epoch 16 Iter 220: loss 0.20740. :  98%|██████████████████████████████████████████ | 219/224 [02:14<00:02,  1.97it/s]
Epoch 16 Iter 220: loss 0.20740. :  98%|██████████████████████████████████████████▏| 220/224 [02:14<00:02,  1.98it/s]
Epoch 16 Iter 221: loss 0.23844. :  98%|██████████████████████████████████████████▏| 220/224 [02:15<00:02,  1.98it/s]
Epoch 16 Iter 221: loss 0.23844. :  99%|██████████████████████████████████████████▍| 221/224 [02:15<00:01,  1.92it/s]
Epoch 16 Iter 222: loss 0.24613. :  99%|██████████████████████████████████████████▍| 221/224 [02:15<00:01,  1.92it/s]
Epoch 16 Iter 222: loss 0.24613. :  99%|██████████████████████████████████████████▌| 222/224 [02:15<00:01,  1.92it/s]
Epoch 16 Iter 223: loss 0.23292. :  99%|██████████████████████████████████████████▌| 222/224 [02:16<00:01,  1.92it/s]
Epoch 16 Iter 223: loss 0.23292. : 100%|██████████████████████████████████████████▊| 223/224 [02:16<00:00,  1.94it/s]
Epoch 16 Iter 224: loss 0.24471. : 100%|██████████████████████████████████████████▊| 223/224 [02:16<00:00,  1.94it/s]
Epoch 16 Iter 224: loss 0.24471. : 100%|███████████████████████████████████████████| 224/224 [02:16<00:00,  1.95it/s]
Epoch 16 Iter 224: loss 0.24471. : 100%|███████████████████████████████████████████| 224/224 [02:16<00:00,  1.64it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.24001. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.24001. :   0%|▏                                              | 1/224 [00:00<02:09,  1.73it/s]
Epoch 17 Iter 2: loss 0.23108. :   0%|▏                                              | 1/224 [00:01<02:09,  1.73it/s]
Epoch 17 Iter 2: loss 0.23108. :   1%|▍                                              | 2/224 [00:01<02:33,  1.45it/s]
Epoch 17 Iter 3: loss 0.23099. :   1%|▍                                              | 2/224 [00:01<02:33,  1.45it/s]
Epoch 17 Iter 3: loss 0.23099. :   1%|▋                                              | 3/224 [00:01<02:15,  1.63it/s]
Epoch 17 Iter 4: loss 0.21783. :   1%|▋                                              | 3/224 [00:02<02:15,  1.63it/s]
Epoch 17 Iter 4: loss 0.21783. :   2%|▊                                              | 4/224 [00:02<02:04,  1.77it/s]
Epoch 17 Iter 5: loss 0.21900. :   2%|▊                                              | 4/224 [00:02<02:04,  1.77it/s]
Epoch 17 Iter 5: loss 0.21900. :   2%|█                                              | 5/224 [00:02<01:57,  1.86it/s]
Epoch 17 Iter 6: loss 0.24491. :   2%|█                                              | 5/224 [00:03<01:57,  1.86it/s]
Epoch 17 Iter 6: loss 0.24491. :   3%|█▎                                             | 6/224 [00:03<01:53,  1.92it/s]
Epoch 17 Iter 7: loss 0.24751. :   3%|█▎                                             | 6/224 [00:03<01:53,  1.92it/s]
Epoch 17 Iter 7: loss 0.24751. :   3%|█▍                                             | 7/224 [00:03<01:52,  1.93it/s]
Epoch 17 Iter 8: loss 0.23281. :   3%|█▍                                             | 7/224 [00:04<01:52,  1.93it/s]
Epoch 17 Iter 8: loss 0.23281. :   4%|█▋                                             | 8/224 [00:04<01:49,  1.98it/s]
Epoch 17 Iter 9: loss 0.22374. :   4%|█▋                                             | 8/224 [00:05<01:49,  1.98it/s]
Epoch 17 Iter 9: loss 0.22374. :   4%|█▉                                             | 9/224 [00:05<02:19,  1.54it/s]
Epoch 17 Iter 10: loss 0.23112. :   4%|█▊                                            | 9/224 [00:05<02:19,  1.54it/s]
Epoch 17 Iter 10: loss 0.23112. :   4%|██                                           | 10/224 [00:05<02:09,  1.65it/s]
Epoch 17 Iter 11: loss 0.24153. :   4%|██                                           | 10/224 [00:06<02:09,  1.65it/s]
Epoch 17 Iter 11: loss 0.24153. :   5%|██▏                                          | 11/224 [00:06<02:01,  1.75it/s]
Epoch 17 Iter 12: loss 0.24220. :   5%|██▏                                          | 11/224 [00:06<02:01,  1.75it/s]
Epoch 17 Iter 12: loss 0.24220. :   5%|██▍                                          | 12/224 [00:06<01:55,  1.84it/s]
Epoch 17 Iter 13: loss 0.24474. :   5%|██▍                                          | 12/224 [00:07<01:55,  1.84it/s]
Epoch 17 Iter 13: loss 0.24474. :   6%|██▌                                          | 13/224 [00:07<01:50,  1.91it/s]
Epoch 17 Iter 14: loss 0.21628. :   6%|██▌                                          | 13/224 [00:07<01:50,  1.91it/s]
Epoch 17 Iter 14: loss 0.21628. :   6%|██▊                                          | 14/224 [00:07<01:47,  1.96it/s]
Epoch 17 Iter 15: loss 0.23496. :   6%|██▊                                          | 14/224 [00:08<01:47,  1.96it/s]
Epoch 17 Iter 15: loss 0.23496. :   7%|███                                          | 15/224 [00:08<01:45,  1.98it/s]
Epoch 17 Iter 16: loss 0.24252. :   7%|███                                          | 15/224 [00:08<01:45,  1.98it/s]
Epoch 17 Iter 16: loss 0.24252. :   7%|███▏                                         | 16/224 [00:08<01:43,  2.00it/s]
Epoch 17 Iter 17: loss 0.25047. :   7%|███▏                                         | 16/224 [00:09<01:43,  2.00it/s]
Epoch 17 Iter 17: loss 0.25047. :   8%|███▍                                         | 17/224 [00:09<01:41,  2.03it/s]
Epoch 17 Iter 18: loss 0.22178. :   8%|███▍                                         | 17/224 [00:09<01:41,  2.03it/s]
Epoch 17 Iter 18: loss 0.22178. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.04it/s]
Epoch 17 Iter 19: loss 0.25041. :   8%|███▌                                         | 18/224 [00:10<01:41,  2.04it/s]
Epoch 17 Iter 19: loss 0.25041. :   8%|███▊                                         | 19/224 [00:10<01:40,  2.04it/s]
Epoch 17 Iter 20: loss 0.24921. :   8%|███▊                                         | 19/224 [00:10<01:40,  2.04it/s]
Epoch 17 Iter 20: loss 0.24921. :   9%|████                                         | 20/224 [00:10<01:40,  2.03it/s]
Epoch 17 Iter 21: loss 0.23427. :   9%|████                                         | 20/224 [00:11<01:40,  2.03it/s]
Epoch 17 Iter 21: loss 0.23427. :   9%|████▏                                        | 21/224 [00:11<01:39,  2.03it/s]
Epoch 17 Iter 22: loss 0.24024. :   9%|████▏                                        | 21/224 [00:11<01:39,  2.03it/s]
Epoch 17 Iter 22: loss 0.24024. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.03it/s]
Epoch 17 Iter 23: loss 0.25211. :  10%|████▍                                        | 22/224 [00:12<01:39,  2.03it/s]
Epoch 17 Iter 23: loss 0.25211. :  10%|████▌                                        | 23/224 [00:12<01:39,  2.01it/s]
Epoch 17 Iter 24: loss 0.23964. :  10%|████▌                                        | 23/224 [00:12<01:39,  2.01it/s]
Epoch 17 Iter 24: loss 0.23964. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.01it/s]
Epoch 17 Iter 25: loss 0.23809. :  11%|████▊                                        | 24/224 [00:13<01:39,  2.01it/s]
Epoch 17 Iter 25: loss 0.23809. :  11%|█████                                        | 25/224 [00:13<01:38,  2.02it/s]
Epoch 17 Iter 26: loss 0.23939. :  11%|█████                                        | 25/224 [00:13<01:38,  2.02it/s]
Epoch 17 Iter 26: loss 0.23939. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.03it/s]
Epoch 17 Iter 27: loss 0.23007. :  12%|█████▏                                       | 26/224 [00:14<01:37,  2.03it/s]
Epoch 17 Iter 27: loss 0.23007. :  12%|█████▍                                       | 27/224 [00:14<01:37,  2.03it/s]
Epoch 17 Iter 28: loss 0.22726. :  12%|█████▍                                       | 27/224 [00:14<01:37,  2.03it/s]
Epoch 17 Iter 28: loss 0.22726. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.02it/s]
Epoch 17 Iter 29: loss 0.23656. :  12%|█████▋                                       | 28/224 [00:15<01:37,  2.02it/s]
Epoch 17 Iter 29: loss 0.23656. :  13%|█████▊                                       | 29/224 [00:15<01:38,  1.98it/s]
Epoch 17 Iter 30: loss 0.25633. :  13%|█████▊                                       | 29/224 [00:15<01:38,  1.98it/s]
Epoch 17 Iter 30: loss 0.25633. :  13%|██████                                       | 30/224 [00:15<01:37,  2.00it/s]
Epoch 17 Iter 31: loss 0.26185. :  13%|██████                                       | 30/224 [00:16<01:37,  2.00it/s]
Epoch 17 Iter 31: loss 0.26185. :  14%|██████▏                                      | 31/224 [00:16<01:35,  2.02it/s]
Epoch 17 Iter 32: loss 0.23934. :  14%|██████▏                                      | 31/224 [00:16<01:35,  2.02it/s]
Epoch 17 Iter 32: loss 0.23934. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.02it/s]
Epoch 17 Iter 33: loss 0.23822. :  14%|██████▍                                      | 32/224 [00:17<01:34,  2.02it/s]
Epoch 17 Iter 33: loss 0.23822. :  15%|██████▋                                      | 33/224 [00:17<01:33,  2.03it/s]
Epoch 17 Iter 34: loss 0.21706. :  15%|██████▋                                      | 33/224 [00:17<01:33,  2.03it/s]
Epoch 17 Iter 34: loss 0.21706. :  15%|██████▊                                      | 34/224 [00:17<01:33,  2.03it/s]
Epoch 17 Iter 35: loss 0.21663. :  15%|██████▊                                      | 34/224 [00:18<01:33,  2.03it/s]
Epoch 17 Iter 35: loss 0.21663. :  16%|███████                                      | 35/224 [00:18<01:33,  2.03it/s]
Epoch 17 Iter 36: loss 0.23060. :  16%|███████                                      | 35/224 [00:18<01:33,  2.03it/s]
Epoch 17 Iter 36: loss 0.23060. :  16%|███████▏                                     | 36/224 [00:18<01:32,  2.03it/s]
Epoch 17 Iter 37: loss 0.22121. :  16%|███████▏                                     | 36/224 [00:19<01:32,  2.03it/s]
Epoch 17 Iter 37: loss 0.22121. :  17%|███████▍                                     | 37/224 [00:19<01:31,  2.05it/s]
Epoch 17 Iter 38: loss 0.24057. :  17%|███████▍                                     | 37/224 [00:19<01:31,  2.05it/s]
Epoch 17 Iter 38: loss 0.24057. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.05it/s]
Epoch 17 Iter 39: loss 0.25145. :  17%|███████▋                                     | 38/224 [00:20<01:30,  2.05it/s]
Epoch 17 Iter 39: loss 0.25145. :  17%|███████▊                                     | 39/224 [00:20<01:29,  2.06it/s]
Epoch 17 Iter 40: loss 0.20842. :  17%|███████▊                                     | 39/224 [00:20<01:29,  2.06it/s]
Epoch 17 Iter 40: loss 0.20842. :  18%|████████                                     | 40/224 [00:20<01:29,  2.05it/s]
Epoch 17 Iter 41: loss 0.23087. :  18%|████████                                     | 40/224 [00:21<01:29,  2.05it/s]
Epoch 17 Iter 41: loss 0.23087. :  18%|████████▏                                    | 41/224 [00:21<01:29,  2.04it/s]
Epoch 17 Iter 42: loss 0.22800. :  18%|████████▏                                    | 41/224 [00:21<01:29,  2.04it/s]
Epoch 17 Iter 42: loss 0.22800. :  19%|████████▍                                    | 42/224 [00:21<01:28,  2.05it/s]
Epoch 17 Iter 43: loss 0.24209. :  19%|████████▍                                    | 42/224 [00:21<01:28,  2.05it/s]
Epoch 17 Iter 43: loss 0.24209. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 17 Iter 44: loss 0.24711. :  19%|████████▋                                    | 43/224 [00:22<01:27,  2.06it/s]
Epoch 17 Iter 44: loss 0.24711. :  20%|████████▊                                    | 44/224 [00:22<01:28,  2.04it/s]
Epoch 17 Iter 45: loss 0.24884. :  20%|████████▊                                    | 44/224 [00:22<01:28,  2.04it/s]
Epoch 17 Iter 45: loss 0.24884. :  20%|█████████                                    | 45/224 [00:22<01:28,  2.03it/s]
Epoch 17 Iter 46: loss 0.25112. :  20%|█████████                                    | 45/224 [00:23<01:28,  2.03it/s]
Epoch 17 Iter 46: loss 0.25112. :  21%|█████████▏                                   | 46/224 [00:23<01:26,  2.05it/s]
Epoch 17 Iter 47: loss 0.23270. :  21%|█████████▏                                   | 46/224 [00:23<01:26,  2.05it/s]
Epoch 17 Iter 47: loss 0.23270. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 17 Iter 48: loss 0.24567. :  21%|█████████▍                                   | 47/224 [00:24<01:26,  2.04it/s]
Epoch 17 Iter 48: loss 0.24567. :  21%|█████████▋                                   | 48/224 [00:24<01:25,  2.05it/s]
Epoch 17 Iter 49: loss 0.22787. :  21%|█████████▋                                   | 48/224 [00:24<01:25,  2.05it/s]
Epoch 17 Iter 49: loss 0.22787. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 17 Iter 50: loss 0.22982. :  22%|█████████▊                                   | 49/224 [00:25<01:25,  2.06it/s]
Epoch 17 Iter 50: loss 0.22982. :  22%|██████████                                   | 50/224 [00:25<01:24,  2.06it/s]
Epoch 17 Iter 51: loss 0.23695. :  22%|██████████                                   | 50/224 [00:25<01:24,  2.06it/s]
Epoch 17 Iter 51: loss 0.23695. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 17 Iter 52: loss 0.23849. :  23%|██████████▏                                  | 51/224 [00:26<01:24,  2.06it/s]
Epoch 17 Iter 52: loss 0.23849. :  23%|██████████▍                                  | 52/224 [00:26<01:23,  2.06it/s]
Epoch 17 Iter 53: loss 0.24630. :  23%|██████████▍                                  | 52/224 [00:26<01:23,  2.06it/s]
Epoch 17 Iter 53: loss 0.24630. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 17 Iter 54: loss 0.23293. :  24%|██████████▋                                  | 53/224 [00:27<01:23,  2.06it/s]
Epoch 17 Iter 54: loss 0.23293. :  24%|██████████▊                                  | 54/224 [00:27<01:22,  2.06it/s]
Epoch 17 Iter 55: loss 0.22464. :  24%|██████████▊                                  | 54/224 [00:27<01:22,  2.06it/s]
Epoch 17 Iter 55: loss 0.22464. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 17 Iter 56: loss 0.23589. :  25%|███████████                                  | 55/224 [00:28<01:21,  2.07it/s]
Epoch 17 Iter 56: loss 0.23589. :  25%|███████████▎                                 | 56/224 [00:28<01:21,  2.07it/s]
Epoch 17 Iter 57: loss 0.25113. :  25%|███████████▎                                 | 56/224 [00:28<01:21,  2.07it/s]
Epoch 17 Iter 57: loss 0.25113. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 17 Iter 58: loss 0.23261. :  25%|███████████▍                                 | 57/224 [00:29<01:21,  2.06it/s]
Epoch 17 Iter 58: loss 0.23261. :  26%|███████████▋                                 | 58/224 [00:29<01:20,  2.07it/s]
Epoch 17 Iter 59: loss 0.24517. :  26%|███████████▋                                 | 58/224 [00:29<01:20,  2.07it/s]
Epoch 17 Iter 59: loss 0.24517. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 17 Iter 60: loss 0.23433. :  26%|███████████▊                                 | 59/224 [00:30<01:19,  2.08it/s]
Epoch 17 Iter 60: loss 0.23433. :  27%|████████████                                 | 60/224 [00:30<01:18,  2.08it/s]
Epoch 17 Iter 61: loss 0.22390. :  27%|████████████                                 | 60/224 [00:30<01:18,  2.08it/s]
Epoch 17 Iter 61: loss 0.22390. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 17 Iter 62: loss 0.22160. :  27%|████████████▎                                | 61/224 [00:31<01:18,  2.07it/s]
Epoch 17 Iter 62: loss 0.22160. :  28%|████████████▍                                | 62/224 [00:31<01:18,  2.06it/s]
Epoch 17 Iter 63: loss 0.23212. :  28%|████████████▍                                | 62/224 [00:31<01:18,  2.06it/s]
Epoch 17 Iter 63: loss 0.23212. :  28%|████████████▋                                | 63/224 [00:31<01:19,  2.02it/s]
Epoch 17 Iter 64: loss 0.22438. :  28%|████████████▋                                | 63/224 [00:32<01:19,  2.02it/s]
Epoch 17 Iter 64: loss 0.22438. :  29%|████████████▊                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 17 Iter 65: loss 0.21981. :  29%|████████████▊                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 17 Iter 65: loss 0.21981. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 17 Iter 66: loss 0.22091. :  29%|█████████████                                | 65/224 [00:33<01:18,  2.03it/s]
Epoch 17 Iter 66: loss 0.22091. :  29%|█████████████▎                               | 66/224 [00:33<01:18,  2.01it/s]
Epoch 17 Iter 67: loss 0.22305. :  29%|█████████████▎                               | 66/224 [00:33<01:18,  2.01it/s]
Epoch 17 Iter 67: loss 0.22305. :  30%|█████████████▍                               | 67/224 [00:33<01:18,  2.01it/s]
Epoch 17 Iter 68: loss 0.22406. :  30%|█████████████▍                               | 67/224 [00:34<01:18,  2.01it/s]
Epoch 17 Iter 68: loss 0.22406. :  30%|█████████████▋                               | 68/224 [00:34<01:17,  2.02it/s]
Epoch 17 Iter 69: loss 0.20878. :  30%|█████████████▋                               | 68/224 [00:34<01:17,  2.02it/s]
Epoch 17 Iter 69: loss 0.20878. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 17 Iter 70: loss 0.22765. :  31%|█████████████▊                               | 69/224 [00:35<01:16,  2.02it/s]
Epoch 17 Iter 70: loss 0.22765. :  31%|██████████████                               | 70/224 [00:35<01:15,  2.03it/s]
Epoch 17 Iter 71: loss 0.26042. :  31%|██████████████                               | 70/224 [00:35<01:15,  2.03it/s]
Epoch 17 Iter 71: loss 0.26042. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 17 Iter 72: loss 0.23787. :  32%|██████████████▎                              | 71/224 [00:36<01:15,  2.02it/s]
Epoch 17 Iter 72: loss 0.23787. :  32%|██████████████▍                              | 72/224 [00:36<01:14,  2.03it/s]
Epoch 17 Iter 73: loss 0.22777. :  32%|██████████████▍                              | 72/224 [00:36<01:14,  2.03it/s]
Epoch 17 Iter 73: loss 0.22777. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.04it/s]
Epoch 17 Iter 74: loss 0.24360. :  33%|██████████████▋                              | 73/224 [00:37<01:14,  2.04it/s]
Epoch 17 Iter 74: loss 0.24360. :  33%|██████████████▊                              | 74/224 [00:37<01:13,  2.03it/s]
Epoch 17 Iter 75: loss 0.22457. :  33%|██████████████▊                              | 74/224 [00:37<01:13,  2.03it/s]
Epoch 17 Iter 75: loss 0.22457. :  33%|███████████████                              | 75/224 [00:37<01:13,  2.04it/s]
Epoch 17 Iter 76: loss 0.25314. :  33%|███████████████                              | 75/224 [00:38<01:13,  2.04it/s]
Epoch 17 Iter 76: loss 0.25314. :  34%|███████████████▎                             | 76/224 [00:38<01:12,  2.05it/s]
Epoch 17 Iter 77: loss 0.24060. :  34%|███████████████▎                             | 76/224 [00:38<01:12,  2.05it/s]
Epoch 17 Iter 77: loss 0.24060. :  34%|███████████████▍                             | 77/224 [00:38<01:11,  2.06it/s]
Epoch 17 Iter 78: loss 0.24140. :  34%|███████████████▍                             | 77/224 [00:39<01:11,  2.06it/s]
Epoch 17 Iter 78: loss 0.24140. :  35%|███████████████▋                             | 78/224 [00:39<01:11,  2.06it/s]
Epoch 17 Iter 79: loss 0.23494. :  35%|███████████████▋                             | 78/224 [00:39<01:11,  2.06it/s]
Epoch 17 Iter 79: loss 0.23494. :  35%|███████████████▊                             | 79/224 [00:39<01:10,  2.05it/s]
Epoch 17 Iter 80: loss 0.25747. :  35%|███████████████▊                             | 79/224 [00:40<01:10,  2.05it/s]
Epoch 17 Iter 80: loss 0.25747. :  36%|████████████████                             | 80/224 [00:40<01:10,  2.06it/s]
Epoch 17 Iter 81: loss 0.24965. :  36%|████████████████                             | 80/224 [00:40<01:10,  2.06it/s]
Epoch 17 Iter 81: loss 0.24965. :  36%|████████████████▎                            | 81/224 [00:40<01:10,  2.04it/s]
Epoch 17 Iter 82: loss 0.21873. :  36%|████████████████▎                            | 81/224 [00:41<01:10,  2.04it/s]
Epoch 17 Iter 82: loss 0.21873. :  37%|████████████████▍                            | 82/224 [00:41<01:09,  2.04it/s]
Epoch 17 Iter 83: loss 0.23826. :  37%|████████████████▍                            | 82/224 [00:41<01:09,  2.04it/s]
Epoch 17 Iter 83: loss 0.23826. :  37%|████████████████▋                            | 83/224 [00:41<01:09,  2.04it/s]
Epoch 17 Iter 84: loss 0.24663. :  37%|████████████████▋                            | 83/224 [00:42<01:09,  2.04it/s]
Epoch 17 Iter 84: loss 0.24663. :  38%|████████████████▉                            | 84/224 [00:42<01:08,  2.04it/s]
Epoch 17 Iter 85: loss 0.21637. :  38%|████████████████▉                            | 84/224 [00:42<01:08,  2.04it/s]
Epoch 17 Iter 85: loss 0.21637. :  38%|█████████████████                            | 85/224 [00:42<01:07,  2.05it/s]
Epoch 17 Iter 86: loss 0.22517. :  38%|█████████████████                            | 85/224 [00:43<01:07,  2.05it/s]
Epoch 17 Iter 86: loss 0.22517. :  38%|█████████████████▎                           | 86/224 [00:43<01:07,  2.05it/s]
Epoch 17 Iter 87: loss 0.21252. :  38%|█████████████████▎                           | 86/224 [00:43<01:07,  2.05it/s]
Epoch 17 Iter 87: loss 0.21252. :  39%|█████████████████▍                           | 87/224 [00:43<01:06,  2.05it/s]
Epoch 17 Iter 88: loss 0.23667. :  39%|█████████████████▍                           | 87/224 [00:43<01:06,  2.05it/s]
Epoch 17 Iter 88: loss 0.23667. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 17 Iter 89: loss 0.22356. :  39%|█████████████████▋                           | 88/224 [00:44<01:06,  2.06it/s]
Epoch 17 Iter 89: loss 0.22356. :  40%|█████████████████▉                           | 89/224 [00:44<01:05,  2.06it/s]
Epoch 17 Iter 90: loss 0.23862. :  40%|█████████████████▉                           | 89/224 [00:44<01:05,  2.06it/s]
Epoch 17 Iter 90: loss 0.23862. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 17 Iter 91: loss 0.23634. :  40%|██████████████████                           | 90/224 [00:45<01:05,  2.06it/s]
Epoch 17 Iter 91: loss 0.23634. :  41%|██████████████████▎                          | 91/224 [00:45<01:04,  2.05it/s]
Epoch 17 Iter 92: loss 0.24316. :  41%|██████████████████▎                          | 91/224 [00:45<01:04,  2.05it/s]
Epoch 17 Iter 92: loss 0.24316. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 17 Iter 93: loss 0.24174. :  41%|██████████████████▍                          | 92/224 [00:46<01:04,  2.06it/s]
Epoch 17 Iter 93: loss 0.24174. :  42%|██████████████████▋                          | 93/224 [00:46<01:03,  2.07it/s]
Epoch 17 Iter 94: loss 0.24402. :  42%|██████████████████▋                          | 93/224 [00:46<01:03,  2.07it/s]
Epoch 17 Iter 94: loss 0.24402. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.09it/s]
Epoch 17 Iter 95: loss 0.20921. :  42%|██████████████████▉                          | 94/224 [00:47<01:02,  2.09it/s]
Epoch 17 Iter 95: loss 0.20921. :  42%|███████████████████                          | 95/224 [00:47<01:01,  2.09it/s]
Epoch 17 Iter 96: loss 0.22341. :  42%|███████████████████                          | 95/224 [00:47<01:01,  2.09it/s]
Epoch 17 Iter 96: loss 0.22341. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.09it/s]
Epoch 17 Iter 97: loss 0.23091. :  43%|███████████████████▎                         | 96/224 [00:48<01:01,  2.09it/s]
Epoch 17 Iter 97: loss 0.23091. :  43%|███████████████████▍                         | 97/224 [00:48<01:01,  2.07it/s]
Epoch 17 Iter 98: loss 0.25265. :  43%|███████████████████▍                         | 97/224 [00:48<01:01,  2.07it/s]
Epoch 17 Iter 98: loss 0.25265. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 17 Iter 99: loss 0.22823. :  44%|███████████████████▋                         | 98/224 [00:49<01:00,  2.07it/s]
Epoch 17 Iter 99: loss 0.22823. :  44%|███████████████████▉                         | 99/224 [00:49<01:00,  2.07it/s]
Epoch 17 Iter 100: loss 0.21833. :  44%|███████████████████▍                        | 99/224 [00:49<01:00,  2.07it/s]
Epoch 17 Iter 100: loss 0.21833. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 17 Iter 101: loss 0.21986. :  45%|███████████████████▏                       | 100/224 [00:50<01:00,  2.05it/s]
Epoch 17 Iter 101: loss 0.21986. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.05it/s]
Epoch 17 Iter 102: loss 0.25315. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.05it/s]
Epoch 17 Iter 102: loss 0.25315. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 17 Iter 103: loss 0.25444. :  46%|███████████████████▌                       | 102/224 [00:51<00:59,  2.05it/s]
Epoch 17 Iter 103: loss 0.25444. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.05it/s]
Epoch 17 Iter 104: loss 0.22017. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.05it/s]
Epoch 17 Iter 104: loss 0.22017. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.05it/s]
Epoch 17 Iter 105: loss 0.21538. :  46%|███████████████████▉                       | 104/224 [00:52<00:58,  2.05it/s]
Epoch 17 Iter 105: loss 0.21538. :  47%|████████████████████▏                      | 105/224 [00:52<00:57,  2.05it/s]
Epoch 17 Iter 106: loss 0.23775. :  47%|████████████████████▏                      | 105/224 [00:52<00:57,  2.05it/s]
Epoch 17 Iter 106: loss 0.23775. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.05it/s]
Epoch 17 Iter 107: loss 0.23364. :  47%|████████████████████▎                      | 106/224 [00:53<00:57,  2.05it/s]
Epoch 17 Iter 107: loss 0.23364. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.05it/s]
Epoch 17 Iter 108: loss 0.24372. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.05it/s]
Epoch 17 Iter 108: loss 0.24372. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.04it/s]
Epoch 17 Iter 109: loss 0.23106. :  48%|████████████████████▋                      | 108/224 [00:54<00:56,  2.04it/s]
Epoch 17 Iter 109: loss 0.23106. :  49%|████████████████████▉                      | 109/224 [00:54<00:55,  2.07it/s]
Epoch 17 Iter 110: loss 0.22439. :  49%|████████████████████▉                      | 109/224 [00:54<00:55,  2.07it/s]
Epoch 17 Iter 110: loss 0.22439. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.07it/s]
Epoch 17 Iter 111: loss 0.23547. :  49%|█████████████████████                      | 110/224 [00:55<00:55,  2.07it/s]
Epoch 17 Iter 111: loss 0.23547. :  50%|█████████████████████▎                     | 111/224 [00:55<00:54,  2.08it/s]
Epoch 17 Iter 112: loss 0.24661. :  50%|█████████████████████▎                     | 111/224 [00:55<00:54,  2.08it/s]
Epoch 17 Iter 112: loss 0.24661. :  50%|█████████████████████▌                     | 112/224 [00:55<00:53,  2.09it/s]
Epoch 17 Iter 113: loss 0.22341. :  50%|█████████████████████▌                     | 112/224 [00:56<00:53,  2.09it/s]
Epoch 17 Iter 113: loss 0.22341. :  50%|█████████████████████▋                     | 113/224 [00:56<00:53,  2.07it/s]
Epoch 17 Iter 114: loss 0.24564. :  50%|█████████████████████▋                     | 113/224 [00:56<00:53,  2.07it/s]
Epoch 17 Iter 114: loss 0.24564. :  51%|█████████████████████▉                     | 114/224 [00:56<00:52,  2.08it/s]
Epoch 17 Iter 115: loss 0.24571. :  51%|█████████████████████▉                     | 114/224 [00:57<00:52,  2.08it/s]
Epoch 17 Iter 115: loss 0.24571. :  51%|██████████████████████                     | 115/224 [00:57<00:52,  2.07it/s]
Epoch 17 Iter 116: loss 0.23809. :  51%|██████████████████████                     | 115/224 [00:57<00:52,  2.07it/s]
Epoch 17 Iter 116: loss 0.23809. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.06it/s]
Epoch 17 Iter 117: loss 0.23886. :  52%|██████████████████████▎                    | 116/224 [00:58<00:52,  2.06it/s]
Epoch 17 Iter 117: loss 0.23886. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.05it/s]
Epoch 17 Iter 118: loss 0.24289. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.05it/s]
Epoch 17 Iter 118: loss 0.24289. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.06it/s]
Epoch 17 Iter 119: loss 0.23029. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.06it/s]
Epoch 17 Iter 119: loss 0.23029. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 17 Iter 120: loss 0.21552. :  53%|██████████████████████▊                    | 119/224 [00:59<00:50,  2.06it/s]
Epoch 17 Iter 120: loss 0.21552. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.06it/s]
Epoch 17 Iter 121: loss 0.24871. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.06it/s]
Epoch 17 Iter 121: loss 0.24871. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 17 Iter 122: loss 0.21701. :  54%|███████████████████████▏                   | 121/224 [01:00<00:50,  2.06it/s]
Epoch 17 Iter 122: loss 0.21701. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.06it/s]
Epoch 17 Iter 123: loss 0.21530. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.06it/s]
Epoch 17 Iter 123: loss 0.21530. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 17 Iter 124: loss 0.21974. :  55%|███████████████████████▌                   | 123/224 [01:01<00:48,  2.06it/s]
Epoch 17 Iter 124: loss 0.21974. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.06it/s]
Epoch 17 Iter 125: loss 0.24281. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.06it/s]
Epoch 17 Iter 125: loss 0.24281. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.06it/s]
Epoch 17 Iter 126: loss 0.23660. :  56%|███████████████████████▉                   | 125/224 [01:02<00:47,  2.06it/s]
Epoch 17 Iter 126: loss 0.23660. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.07it/s]
Epoch 17 Iter 127: loss 0.24362. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.07it/s]
Epoch 17 Iter 127: loss 0.24362. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 17 Iter 128: loss 0.23605. :  57%|████████████████████████▍                  | 127/224 [01:03<00:46,  2.07it/s]
Epoch 17 Iter 128: loss 0.23605. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.07it/s]
Epoch 17 Iter 129: loss 0.22660. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.07it/s]
Epoch 17 Iter 129: loss 0.22660. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 17 Iter 130: loss 0.22734. :  58%|████████████████████████▊                  | 129/224 [01:04<00:45,  2.07it/s]
Epoch 17 Iter 130: loss 0.22734. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.06it/s]
Epoch 17 Iter 131: loss 0.26179. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.06it/s]
Epoch 17 Iter 131: loss 0.26179. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 17 Iter 132: loss 0.21568. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:44,  2.07it/s]
Epoch 17 Iter 132: loss 0.21568. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 17 Iter 133: loss 0.24425. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 17 Iter 133: loss 0.24425. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.07it/s]
Epoch 17 Iter 134: loss 0.22180. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:44,  2.07it/s]
Epoch 17 Iter 134: loss 0.22180. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.07it/s]
Epoch 17 Iter 135: loss 0.22845. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.07it/s]
Epoch 17 Iter 135: loss 0.22845. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 17 Iter 136: loss 0.23408. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:43,  2.06it/s]
Epoch 17 Iter 136: loss 0.23408. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.07it/s]
Epoch 17 Iter 137: loss 0.24597. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.07it/s]
Epoch 17 Iter 137: loss 0.24597. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 17 Iter 138: loss 0.25315. :  61%|██████████████████████████▎                | 137/224 [01:08<00:42,  2.06it/s]
Epoch 17 Iter 138: loss 0.25315. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 17 Iter 139: loss 0.22660. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 17 Iter 139: loss 0.22660. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 17 Iter 140: loss 0.22097. :  62%|██████████████████████████▋                | 139/224 [01:09<00:41,  2.06it/s]
Epoch 17 Iter 140: loss 0.22097. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 17 Iter 141: loss 0.22593. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 17 Iter 141: loss 0.22593. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 17 Iter 142: loss 0.23096. :  63%|███████████████████████████                | 141/224 [01:10<00:40,  2.06it/s]
Epoch 17 Iter 142: loss 0.23096. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.06it/s]
Epoch 17 Iter 143: loss 0.24218. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.06it/s]
Epoch 17 Iter 143: loss 0.24218. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 17 Iter 144: loss 0.21564. :  64%|███████████████████████████▍               | 143/224 [01:11<00:39,  2.06it/s]
Epoch 17 Iter 144: loss 0.21564. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 17 Iter 145: loss 0.24016. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 17 Iter 145: loss 0.24016. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.04it/s]
Epoch 17 Iter 146: loss 0.23886. :  65%|███████████████████████████▊               | 145/224 [01:12<00:38,  2.04it/s]
Epoch 17 Iter 146: loss 0.23886. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.06it/s]
Epoch 17 Iter 147: loss 0.21505. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.06it/s]
Epoch 17 Iter 147: loss 0.21505. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.05it/s]
Epoch 17 Iter 148: loss 0.23293. :  66%|████████████████████████████▏              | 147/224 [01:13<00:37,  2.05it/s]
Epoch 17 Iter 148: loss 0.23293. :  66%|████████████████████████████▍              | 148/224 [01:13<00:37,  2.05it/s]
Epoch 17 Iter 149: loss 0.25262. :  66%|████████████████████████████▍              | 148/224 [01:13<00:37,  2.05it/s]
Epoch 17 Iter 149: loss 0.25262. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 17 Iter 150: loss 0.24071. :  67%|████████████████████████████▌              | 149/224 [01:14<00:36,  2.05it/s]
Epoch 17 Iter 150: loss 0.24071. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.05it/s]
Epoch 17 Iter 151: loss 0.21933. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.05it/s]
Epoch 17 Iter 151: loss 0.21933. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 17 Iter 152: loss 0.24833. :  67%|████████████████████████████▉              | 151/224 [01:15<00:35,  2.06it/s]
Epoch 17 Iter 152: loss 0.24833. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:34,  2.06it/s]
Epoch 17 Iter 153: loss 0.21504. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:34,  2.06it/s]
Epoch 17 Iter 153: loss 0.21504. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.05it/s]
Epoch 17 Iter 154: loss 0.24253. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.05it/s]
Epoch 17 Iter 154: loss 0.24253. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 17 Iter 155: loss 0.24624. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:34,  2.05it/s]
Epoch 17 Iter 155: loss 0.24624. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.04it/s]
Epoch 17 Iter 156: loss 0.23727. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.04it/s]
Epoch 17 Iter 156: loss 0.23727. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.05it/s]
Epoch 17 Iter 157: loss 0.22778. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:33,  2.05it/s]
Epoch 17 Iter 157: loss 0.22778. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.05it/s]
Epoch 17 Iter 158: loss 0.22276. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.05it/s]
Epoch 17 Iter 158: loss 0.22276. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 17 Iter 159: loss 0.25996. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:32,  2.06it/s]
Epoch 17 Iter 159: loss 0.25996. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.06it/s]
Epoch 17 Iter 160: loss 0.23993. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.06it/s]
Epoch 17 Iter 160: loss 0.23993. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 17 Iter 161: loss 0.22749. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.05it/s]
Epoch 17 Iter 161: loss 0.22749. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 17 Iter 162: loss 0.22381. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 17 Iter 162: loss 0.22381. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 17 Iter 163: loss 0.25114. :  72%|███████████████████████████████            | 162/224 [01:20<00:30,  2.06it/s]
Epoch 17 Iter 163: loss 0.25114. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 17 Iter 164: loss 0.24593. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 17 Iter 164: loss 0.24593. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:30,  2.00it/s]
Epoch 17 Iter 165: loss 0.24547. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:30,  2.00it/s]
Epoch 17 Iter 165: loss 0.24547. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:29,  2.02it/s]
Epoch 17 Iter 166: loss 0.23802. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:29,  2.02it/s]
Epoch 17 Iter 166: loss 0.23802. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.03it/s]
Epoch 17 Iter 167: loss 0.25713. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.03it/s]
Epoch 17 Iter 167: loss 0.25713. :  75%|████████████████████████████████           | 167/224 [01:22<00:28,  2.01it/s]
Epoch 17 Iter 168: loss 0.22757. :  75%|████████████████████████████████           | 167/224 [01:22<00:28,  2.01it/s]
Epoch 17 Iter 168: loss 0.22757. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.03it/s]
Epoch 17 Iter 169: loss 0.27964. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.03it/s]
Epoch 17 Iter 169: loss 0.27964. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.04it/s]
Epoch 17 Iter 170: loss 0.22005. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.04it/s]
Epoch 17 Iter 170: loss 0.22005. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 17 Iter 171: loss 0.22669. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.05it/s]
Epoch 17 Iter 171: loss 0.22669. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 17 Iter 172: loss 0.24466. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 17 Iter 172: loss 0.24466. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 17 Iter 173: loss 0.24149. :  77%|█████████████████████████████████          | 172/224 [01:25<00:25,  2.06it/s]
Epoch 17 Iter 173: loss 0.24149. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 17 Iter 174: loss 0.25673. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 17 Iter 174: loss 0.25673. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 17 Iter 175: loss 0.24757. :  78%|█████████████████████████████████▍         | 174/224 [01:26<00:24,  2.05it/s]
Epoch 17 Iter 175: loss 0.24757. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.05it/s]
Epoch 17 Iter 176: loss 0.23907. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.05it/s]
Epoch 17 Iter 176: loss 0.23907. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 17 Iter 177: loss 0.24028. :  79%|█████████████████████████████████▊         | 176/224 [01:27<00:23,  2.05it/s]
Epoch 17 Iter 177: loss 0.24028. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:23,  2.04it/s]
Epoch 17 Iter 178: loss 0.24942. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:23,  2.04it/s]
Epoch 17 Iter 178: loss 0.24942. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.04it/s]
Epoch 17 Iter 179: loss 0.22983. :  79%|██████████████████████████████████▏        | 178/224 [01:28<00:22,  2.04it/s]
Epoch 17 Iter 179: loss 0.22983. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.05it/s]
Epoch 17 Iter 180: loss 0.23656. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.05it/s]
Epoch 17 Iter 180: loss 0.23656. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 17 Iter 181: loss 0.21317. :  80%|██████████████████████████████████▌        | 180/224 [01:29<00:21,  2.07it/s]
Epoch 17 Iter 181: loss 0.21317. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 17 Iter 182: loss 0.23406. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 17 Iter 182: loss 0.23406. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.07it/s]
Epoch 17 Iter 183: loss 0.21696. :  81%|██████████████████████████████████▉        | 182/224 [01:30<00:20,  2.07it/s]
Epoch 17 Iter 183: loss 0.21696. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.07it/s]
Epoch 17 Iter 184: loss 0.22343. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.07it/s]
Epoch 17 Iter 184: loss 0.22343. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 17 Iter 185: loss 0.25053. :  82%|███████████████████████████████████▎       | 184/224 [01:31<00:19,  2.06it/s]
Epoch 17 Iter 185: loss 0.25053. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 17 Iter 186: loss 0.24315. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 17 Iter 186: loss 0.24315. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 17 Iter 187: loss 0.23532. :  83%|███████████████████████████████████▋       | 186/224 [01:32<00:18,  2.06it/s]
Epoch 17 Iter 187: loss 0.23532. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.06it/s]
Epoch 17 Iter 188: loss 0.22481. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.06it/s]
Epoch 17 Iter 188: loss 0.22481. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.05it/s]
Epoch 17 Iter 189: loss 0.24437. :  84%|████████████████████████████████████       | 188/224 [01:33<00:17,  2.05it/s]
Epoch 17 Iter 189: loss 0.24437. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:17,  2.06it/s]
Epoch 17 Iter 190: loss 0.22680. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:17,  2.06it/s]
Epoch 17 Iter 190: loss 0.22680. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.05it/s]
Epoch 17 Iter 191: loss 0.23844. :  85%|████████████████████████████████████▍      | 190/224 [01:34<00:16,  2.05it/s]
Epoch 17 Iter 191: loss 0.23844. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:16,  2.05it/s]
Epoch 17 Iter 192: loss 0.21851. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:16,  2.05it/s]
Epoch 17 Iter 192: loss 0.21851. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.04it/s]
Epoch 17 Iter 193: loss 0.22832. :  86%|████████████████████████████████████▊      | 192/224 [01:35<00:15,  2.04it/s]
Epoch 17 Iter 193: loss 0.22832. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:15,  2.06it/s]
Epoch 17 Iter 194: loss 0.21190. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:15,  2.06it/s]
Epoch 17 Iter 194: loss 0.21190. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 195: loss 0.24009. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 195: loss 0.24009. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 196: loss 0.23779. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:14,  2.06it/s]
Epoch 17 Iter 196: loss 0.23779. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.07it/s]
Epoch 17 Iter 197: loss 0.23561. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.07it/s]
Epoch 17 Iter 197: loss 0.23561. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 17 Iter 198: loss 0.21043. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  2.07it/s]
Epoch 17 Iter 198: loss 0.21043. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 17 Iter 199: loss 0.21524. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 17 Iter 199: loss 0.21524. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 17 Iter 200: loss 0.25596. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  2.06it/s]
Epoch 17 Iter 200: loss 0.25596. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.01it/s]
Epoch 17 Iter 201: loss 0.22241. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.01it/s]
Epoch 17 Iter 201: loss 0.22241. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.03it/s]
Epoch 17 Iter 202: loss 0.23654. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.03it/s]
Epoch 17 Iter 202: loss 0.23654. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.04it/s]
Epoch 17 Iter 203: loss 0.23085. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.04it/s]
Epoch 17 Iter 203: loss 0.23085. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.03it/s]
Epoch 17 Iter 204: loss 0.24210. :  91%|██████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.03it/s]
Epoch 17 Iter 204: loss 0.24210. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.03it/s]
Epoch 17 Iter 205: loss 0.23310. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.03it/s]
Epoch 17 Iter 205: loss 0.23310. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.03it/s]
Epoch 17 Iter 206: loss 0.22764. :  92%|███████████████████████████████████████▎   | 205/224 [01:41<00:09,  2.03it/s]
Epoch 17 Iter 206: loss 0.22764. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.03it/s]
Epoch 17 Iter 207: loss 0.23787. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.03it/s]
Epoch 17 Iter 207: loss 0.23787. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.03it/s]
Epoch 17 Iter 208: loss 0.24245. :  92%|███████████████████████████████████████▋   | 207/224 [01:42<00:08,  2.03it/s]
Epoch 17 Iter 208: loss 0.24245. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.03it/s]
Epoch 17 Iter 209: loss 0.25764. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.03it/s]
Epoch 17 Iter 209: loss 0.25764. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.04it/s]
Epoch 17 Iter 210: loss 0.23365. :  93%|████████████████████████████████████████   | 209/224 [01:43<00:07,  2.04it/s]
Epoch 17 Iter 210: loss 0.23365. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.04it/s]
Epoch 17 Iter 211: loss 0.24226. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.04it/s]
Epoch 17 Iter 211: loss 0.24226. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.05it/s]
Epoch 17 Iter 212: loss 0.22354. :  94%|████████████████████████████████████████▌  | 211/224 [01:44<00:06,  2.05it/s]
Epoch 17 Iter 212: loss 0.22354. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.05it/s]
Epoch 17 Iter 213: loss 0.23049. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.05it/s]
Epoch 17 Iter 213: loss 0.23049. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.05it/s]
Epoch 17 Iter 214: loss 0.22123. :  95%|████████████████████████████████████████▉  | 213/224 [01:45<00:05,  2.05it/s]
Epoch 17 Iter 214: loss 0.22123. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.05it/s]
Epoch 17 Iter 215: loss 0.24165. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.05it/s]
Epoch 17 Iter 215: loss 0.24165. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.04it/s]
Epoch 17 Iter 216: loss 0.23940. :  96%|█████████████████████████████████████████▎ | 215/224 [01:46<00:04,  2.04it/s]
Epoch 17 Iter 216: loss 0.23940. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.05it/s]
Epoch 17 Iter 217: loss 0.22336. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.05it/s]
Epoch 17 Iter 217: loss 0.22336. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.05it/s]
Epoch 17 Iter 218: loss 0.20980. :  97%|█████████████████████████████████████████▋ | 217/224 [01:47<00:03,  2.05it/s]
Epoch 17 Iter 218: loss 0.20980. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.05it/s]
Epoch 17 Iter 219: loss 0.24283. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.05it/s]
Epoch 17 Iter 219: loss 0.24283. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.05it/s]
Epoch 17 Iter 220: loss 0.23721. :  98%|██████████████████████████████████████████ | 219/224 [01:48<00:02,  2.05it/s]
Epoch 17 Iter 220: loss 0.23721. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.04it/s]
Epoch 17 Iter 221: loss 0.22497. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.04it/s]
Epoch 17 Iter 221: loss 0.22497. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.05it/s]
Epoch 17 Iter 222: loss 0.23930. :  99%|██████████████████████████████████████████▍| 221/224 [01:49<00:01,  2.05it/s]
Epoch 17 Iter 222: loss 0.23930. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.07it/s]
Epoch 17 Iter 223: loss 0.22194. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.07it/s]
Epoch 17 Iter 223: loss 0.22194. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.06it/s]
Epoch 17 Iter 224: loss 0.22479. : 100%|██████████████████████████████████████████▊| 223/224 [01:50<00:00,  2.06it/s]
Epoch 17 Iter 224: loss 0.22479. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  2.05it/s]
Epoch 17 Iter 224: loss 0.22479. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  2.03it/s]

    Train loss: 0.23462
    Valid loss: 0.2355
       Valid loss recons: 0.22593
       Valid loss KL-D:   0.9569
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.22168. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.22168. :   0%|▏                                              | 1/224 [00:00<01:44,  2.12it/s]
Epoch 18 Iter 2: loss 0.23969. :   0%|▏                                              | 1/224 [00:00<01:44,  2.12it/s]
Epoch 18 Iter 2: loss 0.23969. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 18 Iter 3: loss 0.25400. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 18 Iter 3: loss 0.25400. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 18 Iter 4: loss 0.22595. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 18 Iter 4: loss 0.22595. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 18 Iter 5: loss 0.25081. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 18 Iter 5: loss 0.25081. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 18 Iter 6: loss 0.24718. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 18 Iter 6: loss 0.24718. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 18 Iter 7: loss 0.22256. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 18 Iter 7: loss 0.22256. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 18 Iter 8: loss 0.23580. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 18 Iter 8: loss 0.23580. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 18 Iter 9: loss 0.23566. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 18 Iter 9: loss 0.23566. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 18 Iter 10: loss 0.21681. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 18 Iter 10: loss 0.21681. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 18 Iter 11: loss 0.24046. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 18 Iter 11: loss 0.24046. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 18 Iter 12: loss 0.25748. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 18 Iter 12: loss 0.25748. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 18 Iter 13: loss 0.23813. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 18 Iter 13: loss 0.23813. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 18 Iter 14: loss 0.22472. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 18 Iter 14: loss 0.22472. :   6%|██▊                                          | 14/224 [00:06<01:43,  2.02it/s]
Epoch 18 Iter 15: loss 0.24870. :   6%|██▊                                          | 14/224 [00:07<01:43,  2.02it/s]
Epoch 18 Iter 15: loss 0.24870. :   7%|███                                          | 15/224 [00:07<01:42,  2.03it/s]
Epoch 18 Iter 16: loss 0.26325. :   7%|███                                          | 15/224 [00:07<01:42,  2.03it/s]
Epoch 18 Iter 16: loss 0.26325. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.03it/s]
Epoch 18 Iter 17: loss 0.23523. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.03it/s]
Epoch 18 Iter 17: loss 0.23523. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 18 Iter 18: loss 0.23799. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.03it/s]
Epoch 18 Iter 18: loss 0.23799. :   8%|███▌                                         | 18/224 [00:08<01:42,  2.02it/s]
Epoch 18 Iter 19: loss 0.22975. :   8%|███▌                                         | 18/224 [00:09<01:42,  2.02it/s]
Epoch 18 Iter 19: loss 0.22975. :   8%|███▊                                         | 19/224 [00:09<01:45,  1.95it/s]
Epoch 18 Iter 20: loss 0.24395. :   8%|███▊                                         | 19/224 [00:09<01:45,  1.95it/s]
Epoch 18 Iter 20: loss 0.24395. :   9%|████                                         | 20/224 [00:09<01:44,  1.96it/s]
Epoch 18 Iter 21: loss 0.21962. :   9%|████                                         | 20/224 [00:10<01:44,  1.96it/s]
Epoch 18 Iter 21: loss 0.21962. :   9%|████▏                                        | 21/224 [00:10<01:41,  1.99it/s]
Epoch 18 Iter 22: loss 0.22056. :   9%|████▏                                        | 21/224 [00:10<01:41,  1.99it/s]
Epoch 18 Iter 22: loss 0.22056. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.03it/s]
Epoch 18 Iter 23: loss 0.23338. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.03it/s]
Epoch 18 Iter 23: loss 0.23338. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 18 Iter 24: loss 0.24308. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 18 Iter 24: loss 0.24308. :  11%|████▊                                        | 24/224 [00:11<01:39,  2.02it/s]
Epoch 18 Iter 25: loss 0.22562. :  11%|████▊                                        | 24/224 [00:12<01:39,  2.02it/s]
Epoch 18 Iter 25: loss 0.22562. :  11%|█████                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 18 Iter 26: loss 0.22643. :  11%|█████                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 18 Iter 26: loss 0.22643. :  12%|█████▏                                       | 26/224 [00:12<01:38,  2.02it/s]
Epoch 18 Iter 27: loss 0.23283. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.02it/s]
Epoch 18 Iter 27: loss 0.23283. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.02it/s]
Epoch 18 Iter 28: loss 0.25641. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.02it/s]
Epoch 18 Iter 28: loss 0.25641. :  12%|█████▋                                       | 28/224 [00:13<01:37,  2.02it/s]
Epoch 18 Iter 29: loss 0.22135. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.02it/s]
Epoch 18 Iter 29: loss 0.22135. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.01it/s]
Epoch 18 Iter 30: loss 0.21324. :  13%|█████▊                                       | 29/224 [00:14<01:36,  2.01it/s]
Epoch 18 Iter 30: loss 0.21324. :  13%|██████                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 18 Iter 31: loss 0.22232. :  13%|██████                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 18 Iter 31: loss 0.22232. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.01it/s]
Epoch 18 Iter 32: loss 0.26134. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.01it/s]
Epoch 18 Iter 32: loss 0.26134. :  14%|██████▍                                      | 32/224 [00:15<01:34,  2.02it/s]
Epoch 18 Iter 33: loss 0.22673. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.02it/s]
Epoch 18 Iter 33: loss 0.22673. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.03it/s]
Epoch 18 Iter 34: loss 0.20928. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.03it/s]
Epoch 18 Iter 34: loss 0.20928. :  15%|██████▊                                      | 34/224 [00:16<01:33,  2.03it/s]
Epoch 18 Iter 35: loss 0.20586. :  15%|██████▊                                      | 34/224 [00:17<01:33,  2.03it/s]
Epoch 18 Iter 35: loss 0.20586. :  16%|███████                                      | 35/224 [00:17<01:35,  1.98it/s]
Epoch 18 Iter 36: loss 0.22242. :  16%|███████                                      | 35/224 [00:17<01:35,  1.98it/s]
Epoch 18 Iter 36: loss 0.22242. :  16%|███████▏                                     | 36/224 [00:17<01:34,  2.00it/s]
Epoch 18 Iter 37: loss 0.22696. :  16%|███████▏                                     | 36/224 [00:18<01:34,  2.00it/s]
Epoch 18 Iter 37: loss 0.22696. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.01it/s]
Epoch 18 Iter 38: loss 0.24172. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.01it/s]
Epoch 18 Iter 38: loss 0.24172. :  17%|███████▋                                     | 38/224 [00:18<01:31,  2.03it/s]
Epoch 18 Iter 39: loss 0.21333. :  17%|███████▋                                     | 38/224 [00:19<01:31,  2.03it/s]
Epoch 18 Iter 39: loss 0.21333. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.03it/s]
Epoch 18 Iter 40: loss 0.22145. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.03it/s]
Epoch 18 Iter 40: loss 0.22145. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 18 Iter 41: loss 0.24220. :  18%|████████                                     | 40/224 [00:20<01:30,  2.04it/s]
Epoch 18 Iter 41: loss 0.24220. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 18 Iter 42: loss 0.22180. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 18 Iter 42: loss 0.22180. :  19%|████████▍                                    | 42/224 [00:20<01:29,  2.04it/s]
Epoch 18 Iter 43: loss 0.22442. :  19%|████████▍                                    | 42/224 [00:21<01:29,  2.04it/s]
Epoch 18 Iter 43: loss 0.22442. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 18 Iter 44: loss 0.23998. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 18 Iter 44: loss 0.23998. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.05it/s]
Epoch 18 Iter 45: loss 0.22186. :  20%|████████▊                                    | 44/224 [00:22<01:28,  2.05it/s]
Epoch 18 Iter 45: loss 0.22186. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 18 Iter 46: loss 0.21145. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 18 Iter 46: loss 0.21145. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.02it/s]
Epoch 18 Iter 47: loss 0.23198. :  21%|█████████▏                                   | 46/224 [00:23<01:27,  2.02it/s]
Epoch 18 Iter 47: loss 0.23198. :  21%|█████████▍                                   | 47/224 [00:23<01:28,  1.99it/s]
Epoch 18 Iter 48: loss 0.25529. :  21%|█████████▍                                   | 47/224 [00:23<01:28,  1.99it/s]
Epoch 18 Iter 48: loss 0.25529. :  21%|█████████▋                                   | 48/224 [00:23<01:32,  1.90it/s]
Epoch 18 Iter 49: loss 0.24349. :  21%|█████████▋                                   | 48/224 [00:24<01:32,  1.90it/s]
Epoch 18 Iter 49: loss 0.24349. :  22%|█████████▊                                   | 49/224 [00:24<01:34,  1.85it/s]
Epoch 18 Iter 50: loss 0.24316. :  22%|█████████▊                                   | 49/224 [00:24<01:34,  1.85it/s]
Epoch 18 Iter 50: loss 0.24316. :  22%|██████████                                   | 50/224 [00:24<01:34,  1.84it/s]
Epoch 18 Iter 51: loss 0.22282. :  22%|██████████                                   | 50/224 [00:25<01:34,  1.84it/s]
Epoch 18 Iter 51: loss 0.22282. :  23%|██████████▏                                  | 51/224 [00:25<01:35,  1.82it/s]
Epoch 18 Iter 52: loss 0.22328. :  23%|██████████▏                                  | 51/224 [00:25<01:35,  1.82it/s]
Epoch 18 Iter 52: loss 0.22328. :  23%|██████████▍                                  | 52/224 [00:25<01:30,  1.90it/s]
Epoch 18 Iter 53: loss 0.24827. :  23%|██████████▍                                  | 52/224 [00:26<01:30,  1.90it/s]
Epoch 18 Iter 53: loss 0.24827. :  24%|██████████▋                                  | 53/224 [00:26<01:27,  1.96it/s]
Epoch 18 Iter 54: loss 0.23499. :  24%|██████████▋                                  | 53/224 [00:26<01:27,  1.96it/s]
Epoch 18 Iter 54: loss 0.23499. :  24%|██████████▊                                  | 54/224 [00:26<01:25,  1.98it/s]
Epoch 18 Iter 55: loss 0.25752. :  24%|██████████▊                                  | 54/224 [00:27<01:25,  1.98it/s]
Epoch 18 Iter 55: loss 0.25752. :  25%|███████████                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 18 Iter 56: loss 0.23604. :  25%|███████████                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 18 Iter 56: loss 0.23604. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.05it/s]
Epoch 18 Iter 57: loss 0.24317. :  25%|███████████▎                                 | 56/224 [00:28<01:22,  2.05it/s]
Epoch 18 Iter 57: loss 0.24317. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 18 Iter 58: loss 0.23986. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 18 Iter 58: loss 0.23986. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 18 Iter 59: loss 0.23690. :  26%|███████████▋                                 | 58/224 [00:29<01:20,  2.06it/s]
Epoch 18 Iter 59: loss 0.23690. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 18 Iter 60: loss 0.21966. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 18 Iter 60: loss 0.21966. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 18 Iter 61: loss 0.22469. :  27%|████████████                                 | 60/224 [00:30<01:19,  2.06it/s]
Epoch 18 Iter 61: loss 0.22469. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 18 Iter 62: loss 0.23426. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 18 Iter 62: loss 0.23426. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 18 Iter 63: loss 0.23594. :  28%|████████████▍                                | 62/224 [00:31<01:18,  2.07it/s]
Epoch 18 Iter 63: loss 0.23594. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 18 Iter 64: loss 0.24425. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 18 Iter 64: loss 0.24425. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 18 Iter 65: loss 0.22191. :  29%|████████████▊                                | 64/224 [00:32<01:17,  2.06it/s]
Epoch 18 Iter 65: loss 0.22191. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 18 Iter 66: loss 0.22275. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 18 Iter 66: loss 0.22275. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 18 Iter 67: loss 0.24194. :  29%|█████████████▎                               | 66/224 [00:33<01:16,  2.07it/s]
Epoch 18 Iter 67: loss 0.24194. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.03it/s]
Epoch 18 Iter 68: loss 0.24659. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.03it/s]
Epoch 18 Iter 68: loss 0.24659. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 18 Iter 69: loss 0.25046. :  30%|█████████████▋                               | 68/224 [00:34<01:16,  2.03it/s]
Epoch 18 Iter 69: loss 0.25046. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.04it/s]
Epoch 18 Iter 70: loss 0.22690. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.04it/s]
Epoch 18 Iter 70: loss 0.22690. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 18 Iter 71: loss 0.21697. :  31%|██████████████                               | 70/224 [00:35<01:15,  2.03it/s]
Epoch 18 Iter 71: loss 0.21697. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 18 Iter 72: loss 0.24606. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.02it/s]
Epoch 18 Iter 72: loss 0.24606. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 18 Iter 73: loss 0.24474. :  32%|██████████████▍                              | 72/224 [00:36<01:14,  2.04it/s]
Epoch 18 Iter 73: loss 0.24474. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.03it/s]
Epoch 18 Iter 74: loss 0.24598. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.03it/s]
Epoch 18 Iter 74: loss 0.24598. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 18 Iter 75: loss 0.23532. :  33%|██████████████▊                              | 74/224 [00:37<01:13,  2.03it/s]
Epoch 18 Iter 75: loss 0.23532. :  33%|███████████████                              | 75/224 [00:37<01:14,  2.01it/s]
Epoch 18 Iter 76: loss 0.23691. :  33%|███████████████                              | 75/224 [00:37<01:14,  2.01it/s]
Epoch 18 Iter 76: loss 0.23691. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.01it/s]
Epoch 18 Iter 77: loss 0.23367. :  34%|███████████████▎                             | 76/224 [00:38<01:13,  2.01it/s]
Epoch 18 Iter 77: loss 0.23367. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 18 Iter 78: loss 0.21944. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 18 Iter 78: loss 0.21944. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 18 Iter 79: loss 0.22376. :  35%|███████████████▋                             | 78/224 [00:39<01:10,  2.07it/s]
Epoch 18 Iter 79: loss 0.22376. :  35%|███████████████▊                             | 79/224 [00:39<01:09,  2.08it/s]
Epoch 18 Iter 80: loss 0.24292. :  35%|███████████████▊                             | 79/224 [00:39<01:09,  2.08it/s]
Epoch 18 Iter 80: loss 0.24292. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 18 Iter 81: loss 0.22914. :  36%|████████████████                             | 80/224 [00:40<01:09,  2.08it/s]
Epoch 18 Iter 81: loss 0.22914. :  36%|████████████████▎                            | 81/224 [00:40<01:08,  2.08it/s]
Epoch 18 Iter 82: loss 0.24714. :  36%|████████████████▎                            | 81/224 [00:40<01:08,  2.08it/s]
Epoch 18 Iter 82: loss 0.24714. :  37%|████████████████▍                            | 82/224 [00:40<01:07,  2.11it/s]
Epoch 18 Iter 83: loss 0.22713. :  37%|████████████████▍                            | 82/224 [00:40<01:07,  2.11it/s]
Epoch 18 Iter 83: loss 0.22713. :  37%|████████████████▋                            | 83/224 [00:40<01:06,  2.12it/s]
Epoch 18 Iter 84: loss 0.22246. :  37%|████████████████▋                            | 83/224 [00:41<01:06,  2.12it/s]
Epoch 18 Iter 84: loss 0.22246. :  38%|████████████████▉                            | 84/224 [00:41<01:06,  2.12it/s]
Epoch 18 Iter 85: loss 0.22819. :  38%|████████████████▉                            | 84/224 [00:41<01:06,  2.12it/s]
Epoch 18 Iter 85: loss 0.22819. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.09it/s]
Epoch 18 Iter 86: loss 0.23744. :  38%|█████████████████                            | 85/224 [00:42<01:06,  2.09it/s]
Epoch 18 Iter 86: loss 0.23744. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 18 Iter 87: loss 0.23385. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 18 Iter 87: loss 0.23385. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 18 Iter 88: loss 0.23242. :  39%|█████████████████▍                           | 87/224 [00:43<01:06,  2.05it/s]
Epoch 18 Iter 88: loss 0.23242. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 18 Iter 89: loss 0.22795. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 18 Iter 89: loss 0.22795. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 18 Iter 90: loss 0.22071. :  40%|█████████████████▉                           | 89/224 [00:44<01:06,  2.04it/s]
Epoch 18 Iter 90: loss 0.22071. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 18 Iter 91: loss 0.21772. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 18 Iter 91: loss 0.21772. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 18 Iter 92: loss 0.21306. :  41%|██████████████████▎                          | 91/224 [00:45<01:04,  2.05it/s]
Epoch 18 Iter 92: loss 0.21306. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 18 Iter 93: loss 0.23004. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 18 Iter 93: loss 0.23004. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 18 Iter 94: loss 0.23234. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.04it/s]
Epoch 18 Iter 94: loss 0.23234. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 18 Iter 95: loss 0.22448. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 18 Iter 95: loss 0.22448. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.03it/s]
Epoch 18 Iter 96: loss 0.24332. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.03it/s]
Epoch 18 Iter 96: loss 0.24332. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 18 Iter 97: loss 0.23292. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 18 Iter 97: loss 0.23292. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 18 Iter 98: loss 0.23371. :  43%|███████████████████▍                         | 97/224 [00:48<01:02,  2.04it/s]
Epoch 18 Iter 98: loss 0.23371. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.04it/s]
Epoch 18 Iter 99: loss 0.24530. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.04it/s]
Epoch 18 Iter 99: loss 0.24530. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.05it/s]
Epoch 18 Iter 100: loss 0.24418. :  44%|███████████████████▍                        | 99/224 [00:49<01:01,  2.05it/s]
Epoch 18 Iter 100: loss 0.24418. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.07it/s]
Epoch 18 Iter 101: loss 0.22856. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.07it/s]
Epoch 18 Iter 101: loss 0.22856. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 18 Iter 102: loss 0.23521. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.05it/s]
Epoch 18 Iter 102: loss 0.23521. :  46%|███████████████████▌                       | 102/224 [00:50<01:02,  1.96it/s]
Epoch 18 Iter 103: loss 0.23425. :  46%|███████████████████▌                       | 102/224 [00:50<01:02,  1.96it/s]
Epoch 18 Iter 103: loss 0.23425. :  46%|███████████████████▊                       | 103/224 [00:50<01:03,  1.90it/s]
Epoch 18 Iter 104: loss 0.24880. :  46%|███████████████████▊                       | 103/224 [00:51<01:03,  1.90it/s]
Epoch 18 Iter 104: loss 0.24880. :  46%|███████████████████▉                       | 104/224 [00:51<01:01,  1.94it/s]
Epoch 18 Iter 105: loss 0.25221. :  46%|███████████████████▉                       | 104/224 [00:51<01:01,  1.94it/s]
Epoch 18 Iter 105: loss 0.25221. :  47%|████████████████████▏                      | 105/224 [00:51<01:02,  1.90it/s]
Epoch 18 Iter 106: loss 0.23028. :  47%|████████████████████▏                      | 105/224 [00:52<01:02,  1.90it/s]
Epoch 18 Iter 106: loss 0.23028. :  47%|████████████████████▎                      | 106/224 [00:52<01:00,  1.96it/s]
Epoch 18 Iter 107: loss 0.24330. :  47%|████████████████████▎                      | 106/224 [00:52<01:00,  1.96it/s]
Epoch 18 Iter 107: loss 0.24330. :  48%|████████████████████▌                      | 107/224 [00:52<00:59,  1.97it/s]
Epoch 18 Iter 108: loss 0.23544. :  48%|████████████████████▌                      | 107/224 [00:53<00:59,  1.97it/s]
Epoch 18 Iter 108: loss 0.23544. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.00it/s]
Epoch 18 Iter 109: loss 0.24009. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.00it/s]
Epoch 18 Iter 109: loss 0.24009. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.02it/s]
Epoch 18 Iter 110: loss 0.23605. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 18 Iter 110: loss 0.23605. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.02it/s]
Epoch 18 Iter 111: loss 0.22981. :  49%|█████████████████████                      | 110/224 [00:54<00:56,  2.02it/s]
Epoch 18 Iter 111: loss 0.22981. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.03it/s]
Epoch 18 Iter 112: loss 0.24077. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 18 Iter 112: loss 0.24077. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.04it/s]
Epoch 18 Iter 113: loss 0.23548. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.04it/s]
Epoch 18 Iter 113: loss 0.23548. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.03it/s]
Epoch 18 Iter 114: loss 0.25189. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 18 Iter 114: loss 0.25189. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.04it/s]
Epoch 18 Iter 115: loss 0.24873. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.04it/s]
Epoch 18 Iter 115: loss 0.24873. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 18 Iter 116: loss 0.20893. :  51%|██████████████████████                     | 115/224 [00:57<00:52,  2.06it/s]
Epoch 18 Iter 116: loss 0.20893. :  52%|██████████████████████▎                    | 116/224 [00:57<00:53,  2.03it/s]
Epoch 18 Iter 117: loss 0.23988. :  52%|██████████████████████▎                    | 116/224 [00:57<00:53,  2.03it/s]
Epoch 18 Iter 117: loss 0.23988. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 18 Iter 118: loss 0.22626. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.04it/s]
Epoch 18 Iter 118: loss 0.22626. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.04it/s]
Epoch 18 Iter 119: loss 0.22946. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.04it/s]
Epoch 18 Iter 119: loss 0.22946. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.04it/s]
Epoch 18 Iter 120: loss 0.23115. :  53%|██████████████████████▊                    | 119/224 [00:59<00:51,  2.04it/s]
Epoch 18 Iter 120: loss 0.23115. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 18 Iter 121: loss 0.23079. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.03it/s]
Epoch 18 Iter 121: loss 0.23079. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.04it/s]
Epoch 18 Iter 122: loss 0.21646. :  54%|███████████████████████▏                   | 121/224 [01:00<00:50,  2.04it/s]
Epoch 18 Iter 122: loss 0.21646. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.04it/s]
Epoch 18 Iter 123: loss 0.24996. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.04it/s]
Epoch 18 Iter 123: loss 0.24996. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.04it/s]
Epoch 18 Iter 124: loss 0.23090. :  55%|███████████████████████▌                   | 123/224 [01:01<00:49,  2.04it/s]
Epoch 18 Iter 124: loss 0.23090. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.06it/s]
Epoch 18 Iter 125: loss 0.24217. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.06it/s]
Epoch 18 Iter 125: loss 0.24217. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 18 Iter 126: loss 0.24608. :  56%|███████████████████████▉                   | 125/224 [01:02<00:48,  2.06it/s]
Epoch 18 Iter 126: loss 0.24608. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.03it/s]
Epoch 18 Iter 127: loss 0.22757. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.03it/s]
Epoch 18 Iter 127: loss 0.22757. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 18 Iter 128: loss 0.22267. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.05it/s]
Epoch 18 Iter 128: loss 0.22267. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.05it/s]
Epoch 18 Iter 129: loss 0.22730. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.05it/s]
Epoch 18 Iter 129: loss 0.22730. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 18 Iter 130: loss 0.21706. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.05it/s]
Epoch 18 Iter 130: loss 0.21706. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.05it/s]
Epoch 18 Iter 131: loss 0.21565. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.05it/s]
Epoch 18 Iter 131: loss 0.21565. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 18 Iter 132: loss 0.23171. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:45,  2.05it/s]
Epoch 18 Iter 132: loss 0.23171. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.03it/s]
Epoch 18 Iter 133: loss 0.22950. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.03it/s]
Epoch 18 Iter 133: loss 0.22950. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.04it/s]
Epoch 18 Iter 134: loss 0.25077. :  59%|█████████████████████████▌                 | 133/224 [01:06<00:44,  2.04it/s]
Epoch 18 Iter 134: loss 0.25077. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.05it/s]
Epoch 18 Iter 135: loss 0.22423. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.05it/s]
Epoch 18 Iter 135: loss 0.22423. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.04it/s]
Epoch 18 Iter 136: loss 0.23666. :  60%|█████████████████████████▉                 | 135/224 [01:07<00:43,  2.04it/s]
Epoch 18 Iter 136: loss 0.23666. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.06it/s]
Epoch 18 Iter 137: loss 0.22192. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.06it/s]
Epoch 18 Iter 137: loss 0.22192. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.07it/s]
Epoch 18 Iter 138: loss 0.22861. :  61%|██████████████████████████▎                | 137/224 [01:08<00:42,  2.07it/s]
Epoch 18 Iter 138: loss 0.22861. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.05it/s]
Epoch 18 Iter 139: loss 0.21234. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.05it/s]
Epoch 18 Iter 139: loss 0.21234. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 18 Iter 140: loss 0.24542. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 18 Iter 140: loss 0.24542. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 18 Iter 141: loss 0.22641. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 18 Iter 141: loss 0.22641. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 18 Iter 142: loss 0.23979. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 18 Iter 142: loss 0.23979. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 18 Iter 143: loss 0.22078. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.07it/s]
Epoch 18 Iter 143: loss 0.22078. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.05it/s]
Epoch 18 Iter 144: loss 0.24588. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.05it/s]
Epoch 18 Iter 144: loss 0.24588. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.24793. :  64%|███████████████████████████▋               | 144/224 [01:11<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.24793. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 18 Iter 146: loss 0.24330. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 18 Iter 146: loss 0.24330. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 18 Iter 147: loss 0.24393. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.07it/s]
Epoch 18 Iter 147: loss 0.24393. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.07it/s]
Epoch 18 Iter 148: loss 0.24956. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.07it/s]
Epoch 18 Iter 148: loss 0.24956. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 18 Iter 149: loss 0.23234. :  66%|████████████████████████████▍              | 148/224 [01:13<00:36,  2.07it/s]
Epoch 18 Iter 149: loss 0.23234. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.07it/s]
Epoch 18 Iter 150: loss 0.22675. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.07it/s]
Epoch 18 Iter 150: loss 0.22675. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 18 Iter 151: loss 0.26379. :  67%|████████████████████████████▊              | 150/224 [01:14<00:35,  2.08it/s]
Epoch 18 Iter 151: loss 0.26379. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.07it/s]
Epoch 18 Iter 152: loss 0.24169. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.07it/s]
Epoch 18 Iter 152: loss 0.24169. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 18 Iter 153: loss 0.20822. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:34,  2.08it/s]
Epoch 18 Iter 153: loss 0.20822. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.07it/s]
Epoch 18 Iter 154: loss 0.22502. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.07it/s]
Epoch 18 Iter 154: loss 0.22502. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 18 Iter 155: loss 0.22625. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:33,  2.07it/s]
Epoch 18 Iter 155: loss 0.22625. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.07it/s]
Epoch 18 Iter 156: loss 0.23519. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.07it/s]
Epoch 18 Iter 156: loss 0.23519. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 18 Iter 157: loss 0.22242. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:32,  2.07it/s]
Epoch 18 Iter 157: loss 0.22242. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.08it/s]
Epoch 18 Iter 158: loss 0.23425. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.08it/s]
Epoch 18 Iter 158: loss 0.23425. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 18 Iter 159: loss 0.22228. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:31,  2.08it/s]
Epoch 18 Iter 159: loss 0.22228. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 18 Iter 160: loss 0.23560. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 18 Iter 160: loss 0.23560. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 18 Iter 161: loss 0.22938. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.06it/s]
Epoch 18 Iter 161: loss 0.22938. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 18 Iter 162: loss 0.24835. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.06it/s]
Epoch 18 Iter 162: loss 0.24835. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 18 Iter 163: loss 0.20882. :  72%|███████████████████████████████            | 162/224 [01:20<00:30,  2.06it/s]
Epoch 18 Iter 163: loss 0.20882. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.07it/s]
Epoch 18 Iter 164: loss 0.21669. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.07it/s]
Epoch 18 Iter 164: loss 0.21669. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 18 Iter 165: loss 0.24379. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:29,  2.05it/s]
Epoch 18 Iter 165: loss 0.24379. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.05it/s]
Epoch 18 Iter 166: loss 0.25079. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.05it/s]
Epoch 18 Iter 166: loss 0.25079. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.04it/s]
Epoch 18 Iter 167: loss 0.24320. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.04it/s]
Epoch 18 Iter 167: loss 0.24320. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.05it/s]
Epoch 18 Iter 168: loss 0.24448. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.05it/s]
Epoch 18 Iter 168: loss 0.24448. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 18 Iter 169: loss 0.25009. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.07it/s]
Epoch 18 Iter 169: loss 0.25009. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.23464. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.23464. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.24917. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.24917. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 18 Iter 172: loss 0.24818. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 18 Iter 172: loss 0.24818. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 18 Iter 173: loss 0.24500. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 18 Iter 173: loss 0.24500. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 18 Iter 174: loss 0.24776. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.07it/s]
Epoch 18 Iter 174: loss 0.24776. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 18 Iter 175: loss 0.23062. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 18 Iter 175: loss 0.23062. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 18 Iter 176: loss 0.21744. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.07it/s]
Epoch 18 Iter 176: loss 0.21744. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 18 Iter 177: loss 0.23630. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 18 Iter 177: loss 0.23630. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 18 Iter 178: loss 0.23453. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.05it/s]
Epoch 18 Iter 178: loss 0.23453. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 18 Iter 179: loss 0.23603. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 18 Iter 179: loss 0.23603. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 18 Iter 180: loss 0.21895. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.07it/s]
Epoch 18 Iter 180: loss 0.21895. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 18 Iter 181: loss 0.24158. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 18 Iter 181: loss 0.24158. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 18 Iter 182: loss 0.23164. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 18 Iter 182: loss 0.23164. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.09it/s]
Epoch 18 Iter 183: loss 0.22335. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.09it/s]
Epoch 18 Iter 183: loss 0.22335. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 18 Iter 184: loss 0.24478. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.07it/s]
Epoch 18 Iter 184: loss 0.24478. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 18 Iter 185: loss 0.23744. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 18 Iter 185: loss 0.23744. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 18 Iter 186: loss 0.24855. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 18 Iter 186: loss 0.24855. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 18 Iter 187: loss 0.23217. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 18 Iter 187: loss 0.23217. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 18 Iter 188: loss 0.25503. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.06it/s]
Epoch 18 Iter 188: loss 0.25503. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.06it/s]
Epoch 18 Iter 189: loss 0.23096. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.06it/s]
Epoch 18 Iter 189: loss 0.23096. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 18 Iter 190: loss 0.24450. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:16,  2.06it/s]
Epoch 18 Iter 190: loss 0.24450. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.06it/s]
Epoch 18 Iter 191: loss 0.23287. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.06it/s]
Epoch 18 Iter 191: loss 0.23287. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 18 Iter 192: loss 0.23327. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:15,  2.07it/s]
Epoch 18 Iter 192: loss 0.23327. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 18 Iter 193: loss 0.23739. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 18 Iter 193: loss 0.23739. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.08it/s]
Epoch 18 Iter 194: loss 0.23540. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:14,  2.08it/s]
Epoch 18 Iter 194: loss 0.23540. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.07it/s]
Epoch 18 Iter 195: loss 0.22205. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.07it/s]
Epoch 18 Iter 195: loss 0.22205. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.08it/s]
Epoch 18 Iter 196: loss 0.22688. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:13,  2.08it/s]
Epoch 18 Iter 196: loss 0.22688. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.07it/s]
Epoch 18 Iter 197: loss 0.23639. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.07it/s]
Epoch 18 Iter 197: loss 0.23639. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 18 Iter 198: loss 0.22947. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  2.06it/s]
Epoch 18 Iter 198: loss 0.22947. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 18 Iter 199: loss 0.23013. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 18 Iter 199: loss 0.23013. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.05it/s]
Epoch 18 Iter 200: loss 0.23066. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  2.05it/s]
Epoch 18 Iter 200: loss 0.23066. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.05it/s]
Epoch 18 Iter 201: loss 0.23715. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.05it/s]
Epoch 18 Iter 201: loss 0.23715. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 18 Iter 202: loss 0.25644. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.06it/s]
Epoch 18 Iter 202: loss 0.25644. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.06it/s]
Epoch 18 Iter 203: loss 0.21701. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.06it/s]
Epoch 18 Iter 203: loss 0.21701. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.05it/s]
Epoch 18 Iter 204: loss 0.24807. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.05it/s]
Epoch 18 Iter 204: loss 0.24807. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 18 Iter 205: loss 0.22935. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.06it/s]
Epoch 18 Iter 205: loss 0.22935. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.06it/s]
Epoch 18 Iter 206: loss 0.23278. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.06it/s]
Epoch 18 Iter 206: loss 0.23278. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 18 Iter 207: loss 0.24144. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.05it/s]
Epoch 18 Iter 207: loss 0.24144. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.05it/s]
Epoch 18 Iter 208: loss 0.25861. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.05it/s]
Epoch 18 Iter 208: loss 0.25861. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 18 Iter 209: loss 0.24053. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.06it/s]
Epoch 18 Iter 209: loss 0.24053. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 18 Iter 210: loss 0.23879. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 18 Iter 210: loss 0.23879. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 18 Iter 211: loss 0.22129. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.07it/s]
Epoch 18 Iter 211: loss 0.22129. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.07it/s]
Epoch 18 Iter 212: loss 0.23575. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.07it/s]
Epoch 18 Iter 212: loss 0.23575. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 18 Iter 213: loss 0.24470. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.05it/s]
Epoch 18 Iter 213: loss 0.24470. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.05it/s]
Epoch 18 Iter 214: loss 0.24521. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.05it/s]
Epoch 18 Iter 214: loss 0.24521. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 18 Iter 215: loss 0.22035. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.06it/s]
Epoch 18 Iter 215: loss 0.22035. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.06it/s]
Epoch 18 Iter 216: loss 0.22667. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.06it/s]
Epoch 18 Iter 216: loss 0.22667. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 18 Iter 217: loss 0.25523. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.05it/s]
Epoch 18 Iter 217: loss 0.25523. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.05it/s]
Epoch 18 Iter 218: loss 0.22109. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.05it/s]
Epoch 18 Iter 218: loss 0.22109. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 18 Iter 219: loss 0.21820. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.06it/s]
Epoch 18 Iter 219: loss 0.21820. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.06it/s]
Epoch 18 Iter 220: loss 0.26318. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.06it/s]
Epoch 18 Iter 220: loss 0.26318. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 18 Iter 221: loss 0.23261. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:01,  2.05it/s]
Epoch 18 Iter 221: loss 0.23261. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.06it/s]
Epoch 18 Iter 222: loss 0.23922. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.06it/s]
Epoch 18 Iter 222: loss 0.23922. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 18 Iter 223: loss 0.24107. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:00,  2.07it/s]
Epoch 18 Iter 223: loss 0.24107. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.07it/s]
Epoch 18 Iter 224: loss 0.23171. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.07it/s]
Epoch 18 Iter 224: loss 0.23171. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]
Epoch 18 Iter 224: loss 0.23171. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.04it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.23541. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.23541. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 19 Iter 2: loss 0.22069. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 19 Iter 2: loss 0.22069. :   1%|▍                                             | 2/224 [00:00<01:46,  2.08it/s]
Epoch 19 Iter 3: loss 0.25927. :   1%|▍                                             | 2/224 [00:01<01:46,  2.08it/s]
Epoch 19 Iter 3: loss 0.25927. :   1%|▌                                             | 3/224 [00:01<01:46,  2.08it/s]
Epoch 19 Iter 4: loss 0.22887. :   1%|▌                                             | 3/224 [00:01<01:46,  2.08it/s]
Epoch 19 Iter 4: loss 0.22887. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 19 Iter 5: loss 0.22169. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 19 Iter 5: loss 0.22169. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 19 Iter 6: loss 0.23707. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 19 Iter 6: loss 0.23707. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 19 Iter 7: loss 0.24317. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 19 Iter 7: loss 0.24317. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 19 Iter 8: loss 0.22526. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 19 Iter 8: loss 0.22526. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 19 Iter 9: loss 0.21030. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 19 Iter 9: loss 0.21030. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 19 Iter 10: loss 0.22240. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 19 Iter 10: loss 0.22240. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 19 Iter 11: loss 0.22768. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 19 Iter 11: loss 0.22768. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 19 Iter 12: loss 0.21364. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 19 Iter 12: loss 0.21364. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.06it/s]
Epoch 19 Iter 13: loss 0.20534. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.06it/s]
Epoch 19 Iter 13: loss 0.20534. :   6%|██▌                                         | 13/224 [00:06<01:43,  2.03it/s]
Epoch 19 Iter 14: loss 0.21755. :   6%|██▌                                         | 13/224 [00:06<01:43,  2.03it/s]
Epoch 19 Iter 14: loss 0.21755. :   6%|██▊                                         | 14/224 [00:06<01:42,  2.04it/s]
Epoch 19 Iter 15: loss 0.22970. :   6%|██▊                                         | 14/224 [00:07<01:42,  2.04it/s]
Epoch 19 Iter 15: loss 0.22970. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 19 Iter 16: loss 0.21385. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 19 Iter 16: loss 0.21385. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.05it/s]
Epoch 19 Iter 17: loss 0.21461. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.05it/s]
Epoch 19 Iter 17: loss 0.21461. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 18: loss 0.22116. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 18: loss 0.22116. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 19 Iter 19: loss 0.24827. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 19 Iter 19: loss 0.24827. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.25084. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.25084. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.06it/s]
Epoch 19 Iter 21: loss 0.22859. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.06it/s]
Epoch 19 Iter 21: loss 0.22859. :   9%|████▏                                       | 21/224 [00:10<01:39,  2.05it/s]
Epoch 19 Iter 22: loss 0.23073. :   9%|████▏                                       | 21/224 [00:10<01:39,  2.05it/s]
Epoch 19 Iter 22: loss 0.23073. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 19 Iter 23: loss 0.21817. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 19 Iter 23: loss 0.21817. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 19 Iter 24: loss 0.24198. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 19 Iter 24: loss 0.24198. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 19 Iter 25: loss 0.24864. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 19 Iter 25: loss 0.24864. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 19 Iter 26: loss 0.20874. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 19 Iter 26: loss 0.20874. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 19 Iter 27: loss 0.23958. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 19 Iter 27: loss 0.23958. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 19 Iter 28: loss 0.24945. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 19 Iter 28: loss 0.24945. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 19 Iter 29: loss 0.24056. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 19 Iter 29: loss 0.24056. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 19 Iter 30: loss 0.23239. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 19 Iter 30: loss 0.23239. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 19 Iter 31: loss 0.24297. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 19 Iter 31: loss 0.24297. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 19 Iter 32: loss 0.23128. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 19 Iter 32: loss 0.23128. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.10it/s]
Epoch 19 Iter 33: loss 0.24636. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.10it/s]
Epoch 19 Iter 33: loss 0.24636. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.09it/s]
Epoch 19 Iter 34: loss 0.24573. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.09it/s]
Epoch 19 Iter 34: loss 0.24573. :  15%|██████▋                                     | 34/224 [00:16<01:30,  2.09it/s]
Epoch 19 Iter 35: loss 0.22868. :  15%|██████▋                                     | 34/224 [00:16<01:30,  2.09it/s]
Epoch 19 Iter 35: loss 0.22868. :  16%|██████▉                                     | 35/224 [00:16<01:30,  2.08it/s]
Epoch 19 Iter 36: loss 0.23256. :  16%|██████▉                                     | 35/224 [00:17<01:30,  2.08it/s]
Epoch 19 Iter 36: loss 0.23256. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 19 Iter 37: loss 0.22462. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 19 Iter 37: loss 0.22462. :  17%|███████▎                                    | 37/224 [00:17<01:29,  2.09it/s]
Epoch 19 Iter 38: loss 0.24692. :  17%|███████▎                                    | 37/224 [00:18<01:29,  2.09it/s]
Epoch 19 Iter 38: loss 0.24692. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 19 Iter 39: loss 0.24454. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 19 Iter 39: loss 0.24454. :  17%|███████▋                                    | 39/224 [00:18<01:28,  2.09it/s]
Epoch 19 Iter 40: loss 0.25825. :  17%|███████▋                                    | 39/224 [00:19<01:28,  2.09it/s]
Epoch 19 Iter 40: loss 0.25825. :  18%|███████▊                                    | 40/224 [00:19<01:27,  2.10it/s]
Epoch 19 Iter 41: loss 0.23064. :  18%|███████▊                                    | 40/224 [00:19<01:27,  2.10it/s]
Epoch 19 Iter 41: loss 0.23064. :  18%|████████                                    | 41/224 [00:19<01:27,  2.09it/s]
Epoch 19 Iter 42: loss 0.24396. :  18%|████████                                    | 41/224 [00:20<01:27,  2.09it/s]
Epoch 19 Iter 42: loss 0.24396. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 19 Iter 43: loss 0.22137. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 19 Iter 43: loss 0.22137. :  19%|████████▍                                   | 43/224 [00:20<01:26,  2.09it/s]
Epoch 19 Iter 44: loss 0.25637. :  19%|████████▍                                   | 43/224 [00:21<01:26,  2.09it/s]
Epoch 19 Iter 44: loss 0.25637. :  20%|████████▋                                   | 44/224 [00:21<01:25,  2.10it/s]
Epoch 19 Iter 45: loss 0.22154. :  20%|████████▋                                   | 44/224 [00:21<01:25,  2.10it/s]
Epoch 19 Iter 45: loss 0.22154. :  20%|████████▊                                   | 45/224 [00:21<01:24,  2.11it/s]
Epoch 19 Iter 46: loss 0.23385. :  20%|████████▊                                   | 45/224 [00:22<01:24,  2.11it/s]
Epoch 19 Iter 46: loss 0.23385. :  21%|█████████                                   | 46/224 [00:22<01:24,  2.09it/s]
Epoch 19 Iter 47: loss 0.22551. :  21%|█████████                                   | 46/224 [00:22<01:24,  2.09it/s]
Epoch 19 Iter 47: loss 0.22551. :  21%|█████████▏                                  | 47/224 [00:22<01:24,  2.09it/s]
Epoch 19 Iter 48: loss 0.23897. :  21%|█████████▏                                  | 47/224 [00:23<01:24,  2.09it/s]
Epoch 19 Iter 48: loss 0.23897. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 19 Iter 49: loss 0.24709. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 19 Iter 49: loss 0.24709. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 19 Iter 50: loss 0.21779. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 19 Iter 50: loss 0.21779. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 19 Iter 51: loss 0.24737. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 19 Iter 51: loss 0.24737. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 19 Iter 52: loss 0.22231. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 19 Iter 52: loss 0.22231. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 19 Iter 53: loss 0.24107. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 19 Iter 53: loss 0.24107. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 19 Iter 54: loss 0.22998. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 19 Iter 54: loss 0.22998. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 19 Iter 55: loss 0.23305. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 19 Iter 55: loss 0.23305. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 19 Iter 56: loss 0.21988. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 19 Iter 56: loss 0.21988. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 19 Iter 57: loss 0.22255. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 19 Iter 57: loss 0.22255. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 19 Iter 58: loss 0.24449. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 19 Iter 58: loss 0.24449. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 59: loss 0.23532. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 59: loss 0.23532. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 60: loss 0.25986. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 60: loss 0.25986. :  27%|███████████▊                                | 60/224 [00:28<01:18,  2.08it/s]
Epoch 19 Iter 61: loss 0.23176. :  27%|███████████▊                                | 60/224 [00:29<01:18,  2.08it/s]
Epoch 19 Iter 61: loss 0.23176. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 19 Iter 62: loss 0.23537. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 19 Iter 62: loss 0.23537. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.07it/s]
Epoch 19 Iter 63: loss 0.22712. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 19 Iter 63: loss 0.22712. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 19 Iter 64: loss 0.23052. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 19 Iter 64: loss 0.23052. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.06it/s]
Epoch 19 Iter 65: loss 0.23928. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 19 Iter 65: loss 0.23928. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 19 Iter 66: loss 0.24744. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 19 Iter 66: loss 0.24744. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 19 Iter 67: loss 0.24241. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 19 Iter 67: loss 0.24241. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.08it/s]
Epoch 19 Iter 68: loss 0.23013. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.08it/s]
Epoch 19 Iter 68: loss 0.23013. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 19 Iter 69: loss 0.25522. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 19 Iter 69: loss 0.25522. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 19 Iter 70: loss 0.21282. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 19 Iter 70: loss 0.21282. :  31%|█████████████▊                              | 70/224 [00:33<01:12,  2.11it/s]
Epoch 19 Iter 71: loss 0.24957. :  31%|█████████████▊                              | 70/224 [00:34<01:12,  2.11it/s]
Epoch 19 Iter 71: loss 0.24957. :  32%|█████████████▉                              | 71/224 [00:34<01:12,  2.12it/s]
Epoch 19 Iter 72: loss 0.26881. :  32%|█████████████▉                              | 71/224 [00:34<01:12,  2.12it/s]
Epoch 19 Iter 72: loss 0.26881. :  32%|██████████████▏                             | 72/224 [00:34<01:11,  2.12it/s]
Epoch 19 Iter 73: loss 0.21971. :  32%|██████████████▏                             | 72/224 [00:35<01:11,  2.12it/s]
Epoch 19 Iter 73: loss 0.21971. :  33%|██████████████▎                             | 73/224 [00:35<01:11,  2.10it/s]
Epoch 19 Iter 74: loss 0.22514. :  33%|██████████████▎                             | 73/224 [00:35<01:11,  2.10it/s]
Epoch 19 Iter 74: loss 0.22514. :  33%|██████████████▌                             | 74/224 [00:35<01:11,  2.11it/s]
Epoch 19 Iter 75: loss 0.20677. :  33%|██████████████▌                             | 74/224 [00:36<01:11,  2.11it/s]
Epoch 19 Iter 75: loss 0.20677. :  33%|██████████████▋                             | 75/224 [00:36<01:10,  2.11it/s]
Epoch 19 Iter 76: loss 0.24614. :  33%|██████████████▋                             | 75/224 [00:36<01:10,  2.11it/s]
Epoch 19 Iter 76: loss 0.24614. :  34%|██████████████▉                             | 76/224 [00:36<01:10,  2.10it/s]
Epoch 19 Iter 77: loss 0.22792. :  34%|██████████████▉                             | 76/224 [00:37<01:10,  2.10it/s]
Epoch 19 Iter 77: loss 0.22792. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.09it/s]
Epoch 19 Iter 78: loss 0.24374. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.09it/s]
Epoch 19 Iter 78: loss 0.24374. :  35%|███████████████▎                            | 78/224 [00:37<01:09,  2.10it/s]
Epoch 19 Iter 79: loss 0.24303. :  35%|███████████████▎                            | 78/224 [00:38<01:09,  2.10it/s]
Epoch 19 Iter 79: loss 0.24303. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 19 Iter 80: loss 0.22072. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 19 Iter 80: loss 0.22072. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.08it/s]
Epoch 19 Iter 81: loss 0.23748. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.08it/s]
Epoch 19 Iter 81: loss 0.23748. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 19 Iter 82: loss 0.22965. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 19 Iter 82: loss 0.22965. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 19 Iter 83: loss 0.24259. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 19 Iter 83: loss 0.24259. :  37%|████████████████▎                           | 83/224 [00:39<01:07,  2.08it/s]
Epoch 19 Iter 84: loss 0.23564. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.08it/s]
Epoch 19 Iter 84: loss 0.23564. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 19 Iter 85: loss 0.23459. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 19 Iter 85: loss 0.23459. :  38%|████████████████▋                           | 85/224 [00:40<01:07,  2.07it/s]
Epoch 19 Iter 86: loss 0.20495. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 19 Iter 86: loss 0.20495. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 19 Iter 87: loss 0.24433. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 19 Iter 87: loss 0.24433. :  39%|█████████████████                           | 87/224 [00:41<01:06,  2.06it/s]
Epoch 19 Iter 88: loss 0.23564. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 19 Iter 88: loss 0.23564. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 19 Iter 89: loss 0.23208. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 19 Iter 89: loss 0.23208. :  40%|█████████████████▍                          | 89/224 [00:42<01:05,  2.07it/s]
Epoch 19 Iter 90: loss 0.22303. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 19 Iter 90: loss 0.22303. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 19 Iter 91: loss 0.25161. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 19 Iter 91: loss 0.25161. :  41%|█████████████████▉                          | 91/224 [00:43<01:04,  2.06it/s]
Epoch 19 Iter 92: loss 0.24191. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 19 Iter 92: loss 0.24191. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 19 Iter 93: loss 0.24363. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 19 Iter 93: loss 0.24363. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 19 Iter 94: loss 0.22841. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 19 Iter 94: loss 0.22841. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 19 Iter 95: loss 0.23511. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 19 Iter 95: loss 0.23511. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.07it/s]
Epoch 19 Iter 96: loss 0.23016. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 19 Iter 96: loss 0.23016. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 19 Iter 97: loss 0.22482. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 19 Iter 97: loss 0.22482. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 19 Iter 98: loss 0.23578. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 19 Iter 98: loss 0.23578. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 19 Iter 99: loss 0.24368. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 19 Iter 99: loss 0.24368. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 19 Iter 100: loss 0.23180. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 19 Iter 100: loss 0.23180. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 19 Iter 101: loss 0.24044. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 19 Iter 101: loss 0.24044. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 19 Iter 102: loss 0.22087. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 19 Iter 102: loss 0.22087. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 19 Iter 103: loss 0.23747. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 19 Iter 103: loss 0.23747. :  46%|███████████████████▎                      | 103/224 [00:49<00:59,  2.04it/s]
Epoch 19 Iter 104: loss 0.22169. :  46%|███████████████████▎                      | 103/224 [00:50<00:59,  2.04it/s]
Epoch 19 Iter 104: loss 0.22169. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 19 Iter 105: loss 0.24014. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 19 Iter 105: loss 0.24014. :  47%|███████████████████▋                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 19 Iter 106: loss 0.25188. :  47%|███████████████████▋                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 19 Iter 106: loss 0.25188. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 19 Iter 107: loss 0.23229. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 19 Iter 107: loss 0.23229. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.05it/s]
Epoch 19 Iter 108: loss 0.25851. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.05it/s]
Epoch 19 Iter 108: loss 0.25851. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 19 Iter 109: loss 0.22080. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 19 Iter 109: loss 0.22080. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 19 Iter 110: loss 0.22302. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 19 Iter 110: loss 0.22302. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.04it/s]
Epoch 19 Iter 111: loss 0.22700. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.04it/s]
Epoch 19 Iter 111: loss 0.22700. :  50%|████████████████████▊                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 19 Iter 112: loss 0.24054. :  50%|████████████████████▊                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 19 Iter 112: loss 0.24054. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 19 Iter 113: loss 0.23588. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 19 Iter 113: loss 0.23588. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.04it/s]
Epoch 19 Iter 114: loss 0.24732. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.04it/s]
Epoch 19 Iter 114: loss 0.24732. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.04it/s]
Epoch 19 Iter 115: loss 0.23568. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.04it/s]
Epoch 19 Iter 115: loss 0.23568. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.05it/s]
Epoch 19 Iter 116: loss 0.24422. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.05it/s]
Epoch 19 Iter 116: loss 0.24422. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 19 Iter 117: loss 0.25920. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 19 Iter 117: loss 0.25920. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.04it/s]
Epoch 19 Iter 118: loss 0.21108. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 19 Iter 118: loss 0.21108. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 19 Iter 119: loss 0.21279. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 19 Iter 119: loss 0.21279. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.05it/s]
Epoch 19 Iter 120: loss 0.22537. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.05it/s]
Epoch 19 Iter 120: loss 0.22537. :  54%|██████████████████████▌                   | 120/224 [00:57<00:50,  2.06it/s]
Epoch 19 Iter 121: loss 0.23076. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 19 Iter 121: loss 0.23076. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 19 Iter 122: loss 0.25637. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 19 Iter 122: loss 0.25637. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 19 Iter 123: loss 0.23482. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 19 Iter 123: loss 0.23482. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 19 Iter 124: loss 0.25755. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 19 Iter 124: loss 0.25755. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.07it/s]
Epoch 19 Iter 125: loss 0.23451. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 19 Iter 125: loss 0.23451. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 19 Iter 126: loss 0.25057. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 19 Iter 126: loss 0.25057. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 19 Iter 127: loss 0.22453. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 19 Iter 127: loss 0.22453. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 19 Iter 128: loss 0.22787. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 19 Iter 128: loss 0.22787. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 19 Iter 129: loss 0.23820. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 19 Iter 129: loss 0.23820. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 19 Iter 130: loss 0.22296. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 19 Iter 130: loss 0.22296. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 19 Iter 131: loss 0.24402. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 19 Iter 131: loss 0.24402. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 19 Iter 132: loss 0.21086. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 19 Iter 132: loss 0.21086. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 19 Iter 133: loss 0.24291. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 19 Iter 133: loss 0.24291. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 19 Iter 134: loss 0.22901. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 19 Iter 134: loss 0.22901. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 19 Iter 135: loss 0.21520. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 19 Iter 135: loss 0.21520. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 19 Iter 136: loss 0.25910. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 19 Iter 136: loss 0.25910. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.08it/s]
Epoch 19 Iter 137: loss 0.23325. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.08it/s]
Epoch 19 Iter 137: loss 0.23325. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 19 Iter 138: loss 0.23889. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 19 Iter 138: loss 0.23889. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 19 Iter 139: loss 0.23671. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 19 Iter 139: loss 0.23671. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 19 Iter 140: loss 0.23811. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 19 Iter 140: loss 0.23811. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 19 Iter 141: loss 0.22456. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 19 Iter 141: loss 0.22456. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 19 Iter 142: loss 0.25115. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 19 Iter 142: loss 0.25115. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 19 Iter 143: loss 0.23012. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 19 Iter 143: loss 0.23012. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 19 Iter 144: loss 0.23273. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 19 Iter 144: loss 0.23273. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 19 Iter 145: loss 0.21745. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 19 Iter 145: loss 0.21745. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 19 Iter 146: loss 0.26728. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 19 Iter 146: loss 0.26728. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 19 Iter 147: loss 0.23484. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 19 Iter 147: loss 0.23484. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 19 Iter 148: loss 0.23167. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 19 Iter 148: loss 0.23167. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 19 Iter 149: loss 0.22492. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 19 Iter 149: loss 0.22492. :  67%|███████████████████████████▉              | 149/224 [01:11<00:36,  2.08it/s]
Epoch 19 Iter 150: loss 0.22865. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 19 Iter 150: loss 0.22865. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 19 Iter 151: loss 0.22482. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 19 Iter 151: loss 0.22482. :  67%|████████████████████████████▎             | 151/224 [01:12<00:35,  2.07it/s]
Epoch 19 Iter 152: loss 0.22122. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 19 Iter 152: loss 0.22122. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 19 Iter 153: loss 0.23441. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 19 Iter 153: loss 0.23441. :  68%|████████████████████████████▋             | 153/224 [01:13<00:34,  2.07it/s]
Epoch 19 Iter 154: loss 0.21173. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 19 Iter 154: loss 0.21173. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 19 Iter 155: loss 0.22896. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 19 Iter 155: loss 0.22896. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.08it/s]
Epoch 19 Iter 156: loss 0.23842. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 19 Iter 156: loss 0.23842. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 19 Iter 157: loss 0.22578. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 19 Iter 157: loss 0.22578. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.08it/s]
Epoch 19 Iter 158: loss 0.24318. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 19 Iter 158: loss 0.24318. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 19 Iter 159: loss 0.24259. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 19 Iter 159: loss 0.24259. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 19 Iter 160: loss 0.22815. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 19 Iter 160: loss 0.22815. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 19 Iter 161: loss 0.21388. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 19 Iter 161: loss 0.21388. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.07it/s]
Epoch 19 Iter 162: loss 0.23332. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 162: loss 0.23332. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 163: loss 0.22176. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 163: loss 0.22176. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.23742. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.23742. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.23135. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.23135. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 19 Iter 166: loss 0.22769. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 19 Iter 166: loss 0.22769. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 19 Iter 167: loss 0.24328. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 19 Iter 167: loss 0.24328. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.24530. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.24530. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 19 Iter 169: loss 0.23011. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 19 Iter 169: loss 0.23011. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 19 Iter 170: loss 0.25817. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 19 Iter 170: loss 0.25817. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 19 Iter 171: loss 0.21343. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 19 Iter 171: loss 0.21343. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 19 Iter 172: loss 0.22893. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 19 Iter 172: loss 0.22893. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 19 Iter 173: loss 0.24672. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 19 Iter 173: loss 0.24672. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 19 Iter 174: loss 0.24902. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 19 Iter 174: loss 0.24902. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 19 Iter 175: loss 0.22877. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 19 Iter 175: loss 0.22877. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 19 Iter 176: loss 0.23269. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 19 Iter 176: loss 0.23269. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 19 Iter 177: loss 0.22231. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 19 Iter 177: loss 0.22231. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:23,  2.04it/s]
Epoch 19 Iter 178: loss 0.24631. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:23,  2.04it/s]
Epoch 19 Iter 178: loss 0.24631. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 19 Iter 179: loss 0.23588. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 19 Iter 179: loss 0.23588. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 19 Iter 180: loss 0.23886. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 19 Iter 180: loss 0.23886. :  80%|█████████████████████████████████▊        | 180/224 [01:26<00:21,  2.07it/s]
Epoch 19 Iter 181: loss 0.22717. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 19 Iter 181: loss 0.22717. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 19 Iter 182: loss 0.22744. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 19 Iter 182: loss 0.22744. :  81%|██████████████████████████████████▏       | 182/224 [01:27<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.21766. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.21766. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.23980. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.23980. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.21551. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.21551. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 19 Iter 186: loss 0.23159. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 19 Iter 186: loss 0.23159. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.05it/s]
Epoch 19 Iter 187: loss 0.21127. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 19 Iter 187: loss 0.21127. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 19 Iter 188: loss 0.24619. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 19 Iter 188: loss 0.24619. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 19 Iter 189: loss 0.22147. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 19 Iter 189: loss 0.22147. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 19 Iter 190: loss 0.21668. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 19 Iter 190: loss 0.21668. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 19 Iter 191: loss 0.21213. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 19 Iter 191: loss 0.21213. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 19 Iter 192: loss 0.23292. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 19 Iter 192: loss 0.23292. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.04it/s]
Epoch 19 Iter 193: loss 0.24222. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 19 Iter 193: loss 0.24222. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 19 Iter 194: loss 0.24204. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 19 Iter 194: loss 0.24204. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.05it/s]
Epoch 19 Iter 195: loss 0.23461. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 19 Iter 195: loss 0.23461. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 19 Iter 196: loss 0.22849. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 19 Iter 196: loss 0.22849. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.05it/s]
Epoch 19 Iter 197: loss 0.24711. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 19 Iter 197: loss 0.24711. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 19 Iter 198: loss 0.24948. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 19 Iter 198: loss 0.24948. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.05it/s]
Epoch 19 Iter 199: loss 0.25511. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 19 Iter 199: loss 0.25511. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 19 Iter 200: loss 0.24347. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 19 Iter 200: loss 0.24347. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 19 Iter 201: loss 0.22039. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 19 Iter 201: loss 0.22039. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 19 Iter 202: loss 0.23390. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 19 Iter 202: loss 0.23390. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 19 Iter 203: loss 0.23617. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 19 Iter 203: loss 0.23617. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 19 Iter 204: loss 0.24632. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 19 Iter 204: loss 0.24632. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.25172. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.25172. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 206: loss 0.22680. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 206: loss 0.22680. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 19 Iter 207: loss 0.23330. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 19 Iter 207: loss 0.23330. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 19 Iter 208: loss 0.24620. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 19 Iter 208: loss 0.24620. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 19 Iter 209: loss 0.24293. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 19 Iter 209: loss 0.24293. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 19 Iter 210: loss 0.23039. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 19 Iter 210: loss 0.23039. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 19 Iter 211: loss 0.23855. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 19 Iter 211: loss 0.23855. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 19 Iter 212: loss 0.23084. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 19 Iter 212: loss 0.23084. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.03it/s]
Epoch 19 Iter 213: loss 0.22737. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.03it/s]
Epoch 19 Iter 213: loss 0.22737. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 19 Iter 214: loss 0.23679. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 19 Iter 214: loss 0.23679. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.04it/s]
Epoch 19 Iter 215: loss 0.23614. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.04it/s]
Epoch 19 Iter 215: loss 0.23614. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.03it/s]
Epoch 19 Iter 216: loss 0.24074. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.03it/s]
Epoch 19 Iter 216: loss 0.24074. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 19 Iter 217: loss 0.23165. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 19 Iter 217: loss 0.23165. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 19 Iter 218: loss 0.24378. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 19 Iter 218: loss 0.24378. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 19 Iter 219: loss 0.22412. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 19 Iter 219: loss 0.22412. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 19 Iter 220: loss 0.23121. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 19 Iter 220: loss 0.23121. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.04it/s]
Epoch 19 Iter 221: loss 0.23833. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.04it/s]
Epoch 19 Iter 221: loss 0.23833. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.03it/s]
Epoch 19 Iter 222: loss 0.23298. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.03it/s]
Epoch 19 Iter 222: loss 0.23298. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 19 Iter 223: loss 0.21985. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 19 Iter 223: loss 0.21985. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.04it/s]
Epoch 19 Iter 224: loss 0.24934. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 19 Iter 224: loss 0.24934. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 19 Iter 224: loss 0.24934. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23394
    Valid loss: 0.23573
       Valid loss recons: 0.22339
       Valid loss KL-D:   1.23474
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.23948. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.23948. :   0%|▏                                             | 1/224 [00:00<01:49,  2.03it/s]
Epoch 20 Iter 2: loss 0.24169. :   0%|▏                                             | 1/224 [00:00<01:49,  2.03it/s]
Epoch 20 Iter 2: loss 0.24169. :   1%|▍                                             | 2/224 [00:00<01:50,  2.00it/s]
Epoch 20 Iter 3: loss 0.22699. :   1%|▍                                             | 2/224 [00:01<01:50,  2.00it/s]
Epoch 20 Iter 3: loss 0.22699. :   1%|▌                                             | 3/224 [00:01<01:50,  2.01it/s]
Epoch 20 Iter 4: loss 0.23661. :   1%|▌                                             | 3/224 [00:01<01:50,  2.01it/s]
Epoch 20 Iter 4: loss 0.23661. :   2%|▊                                             | 4/224 [00:01<01:48,  2.03it/s]
Epoch 20 Iter 5: loss 0.22791. :   2%|▊                                             | 4/224 [00:02<01:48,  2.03it/s]
Epoch 20 Iter 5: loss 0.22791. :   2%|█                                             | 5/224 [00:02<01:48,  2.01it/s]
Epoch 20 Iter 6: loss 0.24160. :   2%|█                                             | 5/224 [00:02<01:48,  2.01it/s]
Epoch 20 Iter 6: loss 0.24160. :   3%|█▏                                            | 6/224 [00:02<01:47,  2.03it/s]
Epoch 20 Iter 7: loss 0.24060. :   3%|█▏                                            | 6/224 [00:03<01:47,  2.03it/s]
Epoch 20 Iter 7: loss 0.24060. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.04it/s]
Epoch 20 Iter 8: loss 0.23597. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.04it/s]
Epoch 20 Iter 8: loss 0.23597. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 20 Iter 9: loss 0.23776. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 20 Iter 9: loss 0.23776. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 20 Iter 10: loss 0.23618. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 20 Iter 10: loss 0.23618. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 20 Iter 11: loss 0.24379. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 20 Iter 11: loss 0.24379. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 20 Iter 12: loss 0.23919. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 20 Iter 12: loss 0.23919. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 20 Iter 13: loss 0.23895. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 20 Iter 13: loss 0.23895. :   6%|██▌                                         | 13/224 [00:06<01:44,  2.03it/s]
Epoch 20 Iter 14: loss 0.23542. :   6%|██▌                                         | 13/224 [00:06<01:44,  2.03it/s]
Epoch 20 Iter 14: loss 0.23542. :   6%|██▊                                         | 14/224 [00:06<01:43,  2.03it/s]
Epoch 20 Iter 15: loss 0.24162. :   6%|██▊                                         | 14/224 [00:07<01:43,  2.03it/s]
Epoch 20 Iter 15: loss 0.24162. :   7%|██▉                                         | 15/224 [00:07<01:42,  2.04it/s]
Epoch 20 Iter 16: loss 0.23085. :   7%|██▉                                         | 15/224 [00:07<01:42,  2.04it/s]
Epoch 20 Iter 16: loss 0.23085. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.05it/s]
Epoch 20 Iter 17: loss 0.23233. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.05it/s]
Epoch 20 Iter 17: loss 0.23233. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 20 Iter 18: loss 0.25476. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 20 Iter 18: loss 0.25476. :   8%|███▌                                        | 18/224 [00:08<01:38,  2.09it/s]
Epoch 20 Iter 19: loss 0.24176. :   8%|███▌                                        | 18/224 [00:09<01:38,  2.09it/s]
Epoch 20 Iter 19: loss 0.24176. :   8%|███▋                                        | 19/224 [00:09<01:37,  2.10it/s]
Epoch 20 Iter 20: loss 0.23757. :   8%|███▋                                        | 19/224 [00:09<01:37,  2.10it/s]
Epoch 20 Iter 20: loss 0.23757. :   9%|███▉                                        | 20/224 [00:09<01:37,  2.09it/s]
Epoch 20 Iter 21: loss 0.20261. :   9%|███▉                                        | 20/224 [00:10<01:37,  2.09it/s]
Epoch 20 Iter 21: loss 0.20261. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 22: loss 0.23156. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 22: loss 0.23156. :  10%|████▎                                       | 22/224 [00:10<01:36,  2.09it/s]
Epoch 20 Iter 23: loss 0.23803. :  10%|████▎                                       | 22/224 [00:11<01:36,  2.09it/s]
Epoch 20 Iter 23: loss 0.23803. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 20 Iter 24: loss 0.22356. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 20 Iter 24: loss 0.22356. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 20 Iter 25: loss 0.23935. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 20 Iter 25: loss 0.23935. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 20 Iter 26: loss 0.22319. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 20 Iter 26: loss 0.22319. :  12%|█████                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 20 Iter 27: loss 0.23270. :  12%|█████                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 20 Iter 27: loss 0.23270. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.05it/s]
Epoch 20 Iter 28: loss 0.22288. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.05it/s]
Epoch 20 Iter 28: loss 0.22288. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 20 Iter 29: loss 0.23368. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 20 Iter 29: loss 0.23368. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 20 Iter 30: loss 0.24942. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 20 Iter 30: loss 0.24942. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 20 Iter 31: loss 0.24458. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 20 Iter 31: loss 0.24458. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 20 Iter 32: loss 0.22833. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 20 Iter 32: loss 0.22833. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 20 Iter 33: loss 0.23325. :  14%|██████▎                                     | 32/224 [00:16<01:33,  2.06it/s]
Epoch 20 Iter 33: loss 0.23325. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 20 Iter 34: loss 0.24973. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 20 Iter 34: loss 0.24973. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 20 Iter 35: loss 0.22835. :  15%|██████▋                                     | 34/224 [00:17<01:31,  2.07it/s]
Epoch 20 Iter 35: loss 0.22835. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 20 Iter 36: loss 0.23139. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 20 Iter 36: loss 0.23139. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 37: loss 0.22801. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 37: loss 0.22801. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.23924. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.23924. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 39: loss 0.27191. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 39: loss 0.27191. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.08it/s]
Epoch 20 Iter 40: loss 0.22862. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.08it/s]
Epoch 20 Iter 40: loss 0.22862. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 20 Iter 41: loss 0.23437. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 20 Iter 41: loss 0.23437. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 20 Iter 42: loss 0.23193. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 20 Iter 42: loss 0.23193. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 20 Iter 43: loss 0.21865. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 20 Iter 43: loss 0.21865. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 20 Iter 44: loss 0.20932. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 20 Iter 44: loss 0.20932. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 20 Iter 45: loss 0.20565. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 20 Iter 45: loss 0.20565. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.06it/s]
Epoch 20 Iter 46: loss 0.22478. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.06it/s]
Epoch 20 Iter 46: loss 0.22478. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 20 Iter 47: loss 0.21620. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 20 Iter 47: loss 0.21620. :  21%|█████████▏                                  | 47/224 [00:22<01:26,  2.06it/s]
Epoch 20 Iter 48: loss 0.24350. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.06it/s]
Epoch 20 Iter 48: loss 0.24350. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 20 Iter 49: loss 0.24205. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 20 Iter 49: loss 0.24205. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 20 Iter 50: loss 0.21578. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 20 Iter 50: loss 0.21578. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 20 Iter 51: loss 0.21847. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 20 Iter 51: loss 0.21847. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 20 Iter 52: loss 0.22872. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 20 Iter 52: loss 0.22872. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 20 Iter 53: loss 0.24265. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 20 Iter 53: loss 0.24265. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 20 Iter 54: loss 0.21667. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 20 Iter 54: loss 0.21667. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 20 Iter 55: loss 0.24334. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 20 Iter 55: loss 0.24334. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 20 Iter 56: loss 0.23697. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 20 Iter 56: loss 0.23697. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 20 Iter 57: loss 0.27510. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 20 Iter 57: loss 0.27510. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.08it/s]
Epoch 20 Iter 58: loss 0.23570. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.08it/s]
Epoch 20 Iter 58: loss 0.23570. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 20 Iter 59: loss 0.22560. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 20 Iter 59: loss 0.22560. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 20 Iter 60: loss 0.23196. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 20 Iter 60: loss 0.23196. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 20 Iter 61: loss 0.23050. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 20 Iter 61: loss 0.23050. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 20 Iter 62: loss 0.22545. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 20 Iter 62: loss 0.22545. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 20 Iter 63: loss 0.22575. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 20 Iter 63: loss 0.22575. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 20 Iter 64: loss 0.24836. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.06it/s]
Epoch 20 Iter 64: loss 0.24836. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 20 Iter 65: loss 0.24876. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 20 Iter 65: loss 0.24876. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 20 Iter 66: loss 0.23015. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.07it/s]
Epoch 20 Iter 66: loss 0.23015. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 20 Iter 67: loss 0.22387. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 20 Iter 67: loss 0.22387. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 20 Iter 68: loss 0.24362. :  30%|█████████████▏                              | 67/224 [00:33<01:16,  2.06it/s]
Epoch 20 Iter 68: loss 0.24362. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 20 Iter 69: loss 0.24056. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 20 Iter 69: loss 0.24056. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 20 Iter 70: loss 0.22684. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 20 Iter 70: loss 0.22684. :  31%|█████████████▊                              | 70/224 [00:33<01:15,  2.05it/s]
Epoch 20 Iter 71: loss 0.19793. :  31%|█████████████▊                              | 70/224 [00:34<01:15,  2.05it/s]
Epoch 20 Iter 71: loss 0.19793. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.22690. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.22690. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.23703. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.23703. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.05it/s]
Epoch 20 Iter 74: loss 0.23366. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.05it/s]
Epoch 20 Iter 74: loss 0.23366. :  33%|██████████████▌                             | 74/224 [00:35<01:13,  2.04it/s]
Epoch 20 Iter 75: loss 0.23535. :  33%|██████████████▌                             | 74/224 [00:36<01:13,  2.04it/s]
Epoch 20 Iter 75: loss 0.23535. :  33%|██████████████▋                             | 75/224 [00:36<01:13,  2.04it/s]
Epoch 20 Iter 76: loss 0.23883. :  33%|██████████████▋                             | 75/224 [00:36<01:13,  2.04it/s]
Epoch 20 Iter 76: loss 0.23883. :  34%|██████████████▉                             | 76/224 [00:36<01:12,  2.03it/s]
Epoch 20 Iter 77: loss 0.22653. :  34%|██████████████▉                             | 76/224 [00:37<01:12,  2.03it/s]
Epoch 20 Iter 77: loss 0.22653. :  34%|███████████████▏                            | 77/224 [00:37<01:12,  2.02it/s]
Epoch 20 Iter 78: loss 0.22396. :  34%|███████████████▏                            | 77/224 [00:37<01:12,  2.02it/s]
Epoch 20 Iter 78: loss 0.22396. :  35%|███████████████▎                            | 78/224 [00:37<01:11,  2.04it/s]
Epoch 20 Iter 79: loss 0.23511. :  35%|███████████████▎                            | 78/224 [00:38<01:11,  2.04it/s]
Epoch 20 Iter 79: loss 0.23511. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.03it/s]
Epoch 20 Iter 80: loss 0.23557. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.03it/s]
Epoch 20 Iter 80: loss 0.23557. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.05it/s]
Epoch 20 Iter 81: loss 0.23053. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.05it/s]
Epoch 20 Iter 81: loss 0.23053. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 20 Iter 82: loss 0.24639. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 20 Iter 82: loss 0.24639. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 20 Iter 83: loss 0.23783. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 20 Iter 83: loss 0.23783. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 20 Iter 84: loss 0.22897. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 20 Iter 84: loss 0.22897. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 20 Iter 85: loss 0.23212. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 20 Iter 85: loss 0.23212. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 20 Iter 86: loss 0.24386. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 20 Iter 86: loss 0.24386. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 20 Iter 87: loss 0.23712. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 20 Iter 87: loss 0.23712. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 20 Iter 88: loss 0.24243. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 20 Iter 88: loss 0.24243. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 20 Iter 89: loss 0.22728. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 20 Iter 89: loss 0.22728. :  40%|█████████████████▍                          | 89/224 [00:43<01:06,  2.04it/s]
Epoch 20 Iter 90: loss 0.21805. :  40%|█████████████████▍                          | 89/224 [00:43<01:06,  2.04it/s]
Epoch 20 Iter 90: loss 0.21805. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.05it/s]
Epoch 20 Iter 91: loss 0.23258. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.05it/s]
Epoch 20 Iter 91: loss 0.23258. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 20 Iter 92: loss 0.25374. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 20 Iter 92: loss 0.25374. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 20 Iter 93: loss 0.25855. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 20 Iter 93: loss 0.25855. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.05it/s]
Epoch 20 Iter 94: loss 0.25323. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.05it/s]
Epoch 20 Iter 94: loss 0.25323. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.05it/s]
Epoch 20 Iter 95: loss 0.23168. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.05it/s]
Epoch 20 Iter 95: loss 0.23168. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.05it/s]
Epoch 20 Iter 96: loss 0.23484. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.05it/s]
Epoch 20 Iter 96: loss 0.23484. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.06it/s]
Epoch 20 Iter 97: loss 0.23624. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.06it/s]
Epoch 20 Iter 97: loss 0.23624. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 20 Iter 98: loss 0.26177. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 20 Iter 98: loss 0.26177. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 20 Iter 99: loss 0.21479. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 20 Iter 99: loss 0.21479. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 20 Iter 100: loss 0.24089. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 20 Iter 100: loss 0.24089. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 20 Iter 101: loss 0.22281. :  45%|██████████████████▊                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 20 Iter 101: loss 0.22281. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 102: loss 0.22291. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 102: loss 0.22291. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 20 Iter 103: loss 0.22322. :  46%|███████████████████▏                      | 102/224 [00:50<00:59,  2.06it/s]
Epoch 20 Iter 103: loss 0.22322. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.05it/s]
Epoch 20 Iter 104: loss 0.25463. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.05it/s]
Epoch 20 Iter 104: loss 0.25463. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 20 Iter 105: loss 0.25624. :  46%|███████████████████▌                      | 104/224 [00:51<00:58,  2.06it/s]
Epoch 20 Iter 105: loss 0.25624. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 20 Iter 106: loss 0.25485. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 20 Iter 106: loss 0.25485. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 20 Iter 107: loss 0.23571. :  47%|███████████████████▉                      | 106/224 [00:52<00:57,  2.07it/s]
Epoch 20 Iter 107: loss 0.23571. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 20 Iter 108: loss 0.24893. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 20 Iter 108: loss 0.24893. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 20 Iter 109: loss 0.22178. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 20 Iter 109: loss 0.22178. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 20 Iter 110: loss 0.23866. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 20 Iter 110: loss 0.23866. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 20 Iter 111: loss 0.23159. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 20 Iter 111: loss 0.23159. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 20 Iter 112: loss 0.23826. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 20 Iter 112: loss 0.23826. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 20 Iter 113: loss 0.24399. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 20 Iter 113: loss 0.24399. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 20 Iter 114: loss 0.25341. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 20 Iter 114: loss 0.25341. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 20 Iter 115: loss 0.23955. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 20 Iter 115: loss 0.23955. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 20 Iter 116: loss 0.25830. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 20 Iter 116: loss 0.25830. :  52%|█████████████████████▊                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 20 Iter 117: loss 0.23894. :  52%|█████████████████████▊                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 20 Iter 117: loss 0.23894. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.09it/s]
Epoch 20 Iter 118: loss 0.23362. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.09it/s]
Epoch 20 Iter 118: loss 0.23362. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.08it/s]
Epoch 20 Iter 119: loss 0.24167. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.08it/s]
Epoch 20 Iter 119: loss 0.24167. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.08it/s]
Epoch 20 Iter 120: loss 0.20833. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.08it/s]
Epoch 20 Iter 120: loss 0.20833. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 20 Iter 121: loss 0.20713. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 20 Iter 121: loss 0.20713. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 20 Iter 122: loss 0.23638. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 20 Iter 122: loss 0.23638. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 20 Iter 123: loss 0.23755. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 20 Iter 123: loss 0.23755. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 20 Iter 124: loss 0.25905. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 20 Iter 124: loss 0.25905. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.10it/s]
Epoch 20 Iter 125: loss 0.21741. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.10it/s]
Epoch 20 Iter 125: loss 0.21741. :  56%|███████████████████████▍                  | 125/224 [01:00<00:46,  2.11it/s]
Epoch 20 Iter 126: loss 0.23241. :  56%|███████████████████████▍                  | 125/224 [01:01<00:46,  2.11it/s]
Epoch 20 Iter 126: loss 0.23241. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.10it/s]
Epoch 20 Iter 127: loss 0.23483. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.10it/s]
Epoch 20 Iter 127: loss 0.23483. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 20 Iter 128: loss 0.23728. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 20 Iter 128: loss 0.23728. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 20 Iter 129: loss 0.21996. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 20 Iter 129: loss 0.21996. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 20 Iter 130: loss 0.23877. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.07it/s]
Epoch 20 Iter 130: loss 0.23877. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 20 Iter 131: loss 0.23699. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 20 Iter 131: loss 0.23699. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 20 Iter 132: loss 0.22361. :  58%|████████████████████████▌                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 20 Iter 132: loss 0.22361. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 20 Iter 133: loss 0.25270. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 20 Iter 133: loss 0.25270. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 20 Iter 134: loss 0.22593. :  59%|████████████████████████▉                 | 133/224 [01:05<00:43,  2.07it/s]
Epoch 20 Iter 134: loss 0.22593. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 20 Iter 135: loss 0.21127. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 20 Iter 135: loss 0.21127. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 20 Iter 136: loss 0.22448. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 20 Iter 136: loss 0.22448. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 20 Iter 137: loss 0.23872. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 20 Iter 137: loss 0.23872. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 20 Iter 138: loss 0.23782. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 20 Iter 138: loss 0.23782. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 20 Iter 139: loss 0.23010. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 139: loss 0.23010. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 140: loss 0.23265. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 140: loss 0.23265. :  62%|██████████████████████████▎               | 140/224 [01:07<00:41,  2.04it/s]
Epoch 20 Iter 141: loss 0.22927. :  62%|██████████████████████████▎               | 140/224 [01:08<00:41,  2.04it/s]
Epoch 20 Iter 141: loss 0.22927. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 20 Iter 142: loss 0.23633. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 20 Iter 142: loss 0.23633. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 20 Iter 143: loss 0.22318. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 20 Iter 143: loss 0.22318. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 20 Iter 144: loss 0.22007. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 20 Iter 144: loss 0.22007. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 20 Iter 145: loss 0.23260. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 20 Iter 145: loss 0.23260. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 20 Iter 146: loss 0.24502. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 20 Iter 146: loss 0.24502. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 20 Iter 147: loss 0.22739. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 20 Iter 147: loss 0.22739. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 20 Iter 148: loss 0.23638. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 20 Iter 148: loss 0.23638. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 20 Iter 149: loss 0.24589. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 20 Iter 149: loss 0.24589. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 20 Iter 150: loss 0.23494. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 20 Iter 150: loss 0.23494. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 20 Iter 151: loss 0.22131. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 20 Iter 151: loss 0.22131. :  67%|████████████████████████████▎             | 151/224 [01:13<00:34,  2.10it/s]
Epoch 20 Iter 152: loss 0.22757. :  67%|████████████████████████████▎             | 151/224 [01:13<00:34,  2.10it/s]
Epoch 20 Iter 152: loss 0.22757. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.09it/s]
Epoch 20 Iter 153: loss 0.25604. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.09it/s]
Epoch 20 Iter 153: loss 0.25604. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 20 Iter 154: loss 0.23706. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 20 Iter 154: loss 0.23706. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.10it/s]
Epoch 20 Iter 155: loss 0.22277. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.10it/s]
Epoch 20 Iter 155: loss 0.22277. :  69%|█████████████████████████████             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 20 Iter 156: loss 0.24323. :  69%|█████████████████████████████             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 20 Iter 156: loss 0.24323. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.11it/s]
Epoch 20 Iter 157: loss 0.24658. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.11it/s]
Epoch 20 Iter 157: loss 0.24658. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.10it/s]
Epoch 20 Iter 158: loss 0.21837. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.10it/s]
Epoch 20 Iter 158: loss 0.21837. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 20 Iter 159: loss 0.24682. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.10it/s]
Epoch 20 Iter 159: loss 0.24682. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:30,  2.11it/s]
Epoch 20 Iter 160: loss 0.24288. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:30,  2.11it/s]
Epoch 20 Iter 160: loss 0.24288. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.10it/s]
Epoch 20 Iter 161: loss 0.22424. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.10it/s]
Epoch 20 Iter 161: loss 0.22424. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 20 Iter 162: loss 0.24272. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 20 Iter 162: loss 0.24272. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 20 Iter 163: loss 0.23648. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 20 Iter 163: loss 0.23648. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 20 Iter 164: loss 0.22376. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 20 Iter 164: loss 0.22376. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 20 Iter 165: loss 0.22756. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 20 Iter 165: loss 0.22756. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 20 Iter 166: loss 0.21620. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 20 Iter 166: loss 0.21620. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 20 Iter 167: loss 0.22562. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 20 Iter 167: loss 0.22562. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:28,  2.03it/s]
Epoch 20 Iter 168: loss 0.22281. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:28,  2.03it/s]
Epoch 20 Iter 168: loss 0.22281. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.03it/s]
Epoch 20 Iter 169: loss 0.24536. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.03it/s]
Epoch 20 Iter 169: loss 0.24536. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 20 Iter 170: loss 0.24830. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 20 Iter 170: loss 0.24830. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 20 Iter 171: loss 0.24572. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 20 Iter 171: loss 0.24572. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 20 Iter 172: loss 0.22099. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 172: loss 0.22099. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 173: loss 0.23828. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 20 Iter 173: loss 0.23828. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.23147. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.23147. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 175: loss 0.22170. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 175: loss 0.22170. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 20 Iter 176: loss 0.25181. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 176: loss 0.25181. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 177: loss 0.22466. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 20 Iter 177: loss 0.22466. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.08it/s]
Epoch 20 Iter 178: loss 0.22615. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.08it/s]
Epoch 20 Iter 178: loss 0.22615. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 20 Iter 179: loss 0.25265. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 20 Iter 179: loss 0.25265. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 20 Iter 180: loss 0.22859. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 20 Iter 180: loss 0.22859. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 20 Iter 181: loss 0.24566. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 20 Iter 181: loss 0.24566. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 20 Iter 182: loss 0.22137. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 20 Iter 182: loss 0.22137. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 20 Iter 183: loss 0.25839. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 20 Iter 183: loss 0.25839. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 20 Iter 184: loss 0.23526. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 20 Iter 184: loss 0.23526. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 20 Iter 185: loss 0.23632. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 20 Iter 185: loss 0.23632. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 20 Iter 186: loss 0.22133. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 20 Iter 186: loss 0.22133. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 20 Iter 187: loss 0.23372. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 20 Iter 187: loss 0.23372. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 20 Iter 188: loss 0.24337. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 20 Iter 188: loss 0.24337. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 20 Iter 189: loss 0.25262. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 20 Iter 189: loss 0.25262. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 20 Iter 190: loss 0.22971. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 20 Iter 190: loss 0.22971. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 20 Iter 191: loss 0.22269. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 20 Iter 191: loss 0.22269. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 20 Iter 192: loss 0.21479. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 192: loss 0.21479. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 193: loss 0.25133. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 193: loss 0.25133. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 20 Iter 194: loss 0.22510. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.06it/s]
Epoch 20 Iter 194: loss 0.22510. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 20 Iter 195: loss 0.25307. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 20 Iter 195: loss 0.25307. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 20 Iter 196: loss 0.23881. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 20 Iter 196: loss 0.23881. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 20 Iter 197: loss 0.23390. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 20 Iter 197: loss 0.23390. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 20 Iter 198: loss 0.22301. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 20 Iter 198: loss 0.22301. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.05it/s]
Epoch 20 Iter 199: loss 0.24120. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 20 Iter 199: loss 0.24120. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 20 Iter 200: loss 0.22471. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 20 Iter 200: loss 0.22471. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 20 Iter 201: loss 0.24383. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 201: loss 0.24383. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 202: loss 0.22571. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 20 Iter 202: loss 0.22571. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 20 Iter 203: loss 0.22086. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 20 Iter 203: loss 0.22086. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 20 Iter 204: loss 0.22806. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 20 Iter 204: loss 0.22806. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 20 Iter 205: loss 0.24184. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 20 Iter 205: loss 0.24184. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 20 Iter 206: loss 0.23743. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 20 Iter 206: loss 0.23743. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 20 Iter 207: loss 0.24732. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 20 Iter 207: loss 0.24732. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 20 Iter 208: loss 0.24455. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 20 Iter 208: loss 0.24455. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 20 Iter 209: loss 0.22583. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 20 Iter 209: loss 0.22583. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.04it/s]
Epoch 20 Iter 210: loss 0.22246. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.04it/s]
Epoch 20 Iter 210: loss 0.22246. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.03it/s]
Epoch 20 Iter 211: loss 0.22333. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.03it/s]
Epoch 20 Iter 211: loss 0.22333. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 20 Iter 212: loss 0.21799. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 20 Iter 212: loss 0.21799. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.03it/s]
Epoch 20 Iter 213: loss 0.23286. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.03it/s]
Epoch 20 Iter 213: loss 0.23286. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.01it/s]
Epoch 20 Iter 214: loss 0.23789. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.01it/s]
Epoch 20 Iter 214: loss 0.23789. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.02it/s]
Epoch 20 Iter 215: loss 0.22653. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.02it/s]
Epoch 20 Iter 215: loss 0.22653. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 20 Iter 216: loss 0.25152. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 20 Iter 216: loss 0.25152. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 20 Iter 217: loss 0.22346. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.04it/s]
Epoch 20 Iter 217: loss 0.22346. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 20 Iter 218: loss 0.23314. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 20 Iter 218: loss 0.23314. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 20 Iter 219: loss 0.22028. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 20 Iter 219: loss 0.22028. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 20 Iter 220: loss 0.22987. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 20 Iter 220: loss 0.22987. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.05it/s]
Epoch 20 Iter 221: loss 0.23709. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 221: loss 0.23709. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 222: loss 0.22666. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 20 Iter 222: loss 0.22666. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 20 Iter 223: loss 0.24571. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.05it/s]
Epoch 20 Iter 223: loss 0.24571. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 20 Iter 224: loss 0.23641. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 20 Iter 224: loss 0.23641. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 20 Iter 224: loss 0.23641. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.21680. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.21680. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 21 Iter 2: loss 0.23086. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 21 Iter 2: loss 0.23086. :   1%|▍                                             | 2/224 [00:00<01:49,  2.03it/s]
Epoch 21 Iter 3: loss 0.23873. :   1%|▍                                             | 2/224 [00:01<01:49,  2.03it/s]
Epoch 21 Iter 3: loss 0.23873. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 21 Iter 4: loss 0.24739. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 21 Iter 4: loss 0.24739. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.24400. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.24400. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 21 Iter 6: loss 0.21678. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 21 Iter 6: loss 0.21678. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 21 Iter 7: loss 0.22349. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 21 Iter 7: loss 0.22349. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 21 Iter 8: loss 0.23222. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 21 Iter 8: loss 0.23222. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 21 Iter 9: loss 0.24692. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 21 Iter 9: loss 0.24692. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 21 Iter 10: loss 0.21821. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 21 Iter 10: loss 0.21821. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 21 Iter 11: loss 0.24884. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 21 Iter 11: loss 0.24884. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 21 Iter 12: loss 0.26820. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 21 Iter 12: loss 0.26820. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 21 Iter 13: loss 0.23703. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 21 Iter 13: loss 0.23703. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.21789. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.21789. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 21 Iter 15: loss 0.23454. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 21 Iter 15: loss 0.23454. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 21 Iter 16: loss 0.21922. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 21 Iter 16: loss 0.21922. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 21 Iter 17: loss 0.22618. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 21 Iter 17: loss 0.22618. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 21 Iter 18: loss 0.23863. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 21 Iter 18: loss 0.23863. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.06it/s]
Epoch 21 Iter 19: loss 0.22124. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 19: loss 0.22124. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 20: loss 0.24767. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 20: loss 0.24767. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 21 Iter 21: loss 0.24141. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 21 Iter 21: loss 0.24141. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 21 Iter 22: loss 0.24993. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 21 Iter 22: loss 0.24993. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 21 Iter 23: loss 0.23425. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 21 Iter 23: loss 0.23425. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 21 Iter 24: loss 0.22694. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 21 Iter 24: loss 0.22694. :  11%|████▋                                       | 24/224 [00:11<01:38,  2.02it/s]
Epoch 21 Iter 25: loss 0.22352. :  11%|████▋                                       | 24/224 [00:12<01:38,  2.02it/s]
Epoch 21 Iter 25: loss 0.22352. :  11%|████▉                                       | 25/224 [00:12<01:38,  2.03it/s]
Epoch 21 Iter 26: loss 0.23476. :  11%|████▉                                       | 25/224 [00:12<01:38,  2.03it/s]
Epoch 21 Iter 26: loss 0.23476. :  12%|█████                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 21 Iter 27: loss 0.23367. :  12%|█████                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 21 Iter 27: loss 0.23367. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 28: loss 0.23907. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.04it/s]
Epoch 21 Iter 28: loss 0.23907. :  12%|█████▌                                      | 28/224 [00:13<01:36,  2.03it/s]
Epoch 21 Iter 29: loss 0.21507. :  12%|█████▌                                      | 28/224 [00:14<01:36,  2.03it/s]
Epoch 21 Iter 29: loss 0.21507. :  13%|█████▋                                      | 29/224 [00:14<01:36,  2.03it/s]
Epoch 21 Iter 30: loss 0.22479. :  13%|█████▋                                      | 29/224 [00:14<01:36,  2.03it/s]
Epoch 21 Iter 30: loss 0.22479. :  13%|█████▉                                      | 30/224 [00:14<01:35,  2.03it/s]
Epoch 21 Iter 31: loss 0.24117. :  13%|█████▉                                      | 30/224 [00:15<01:35,  2.03it/s]
Epoch 21 Iter 31: loss 0.24117. :  14%|██████                                      | 31/224 [00:15<01:34,  2.03it/s]
Epoch 21 Iter 32: loss 0.20870. :  14%|██████                                      | 31/224 [00:15<01:34,  2.03it/s]
Epoch 21 Iter 32: loss 0.20870. :  14%|██████▎                                     | 32/224 [00:15<01:34,  2.04it/s]
Epoch 21 Iter 33: loss 0.22636. :  14%|██████▎                                     | 32/224 [00:16<01:34,  2.04it/s]
Epoch 21 Iter 33: loss 0.22636. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.04it/s]
Epoch 21 Iter 34: loss 0.20907. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.04it/s]
Epoch 21 Iter 34: loss 0.20907. :  15%|██████▋                                     | 34/224 [00:16<01:33,  2.04it/s]
Epoch 21 Iter 35: loss 0.23757. :  15%|██████▋                                     | 34/224 [00:17<01:33,  2.04it/s]
Epoch 21 Iter 35: loss 0.23757. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.04it/s]
Epoch 21 Iter 36: loss 0.22565. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.04it/s]
Epoch 21 Iter 36: loss 0.22565. :  16%|███████                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 21 Iter 37: loss 0.21684. :  16%|███████                                     | 36/224 [00:18<01:32,  2.04it/s]
Epoch 21 Iter 37: loss 0.21684. :  17%|███████▎                                    | 37/224 [00:18<01:32,  2.03it/s]
Epoch 21 Iter 38: loss 0.23655. :  17%|███████▎                                    | 37/224 [00:18<01:32,  2.03it/s]
Epoch 21 Iter 38: loss 0.23655. :  17%|███████▍                                    | 38/224 [00:18<01:31,  2.03it/s]
Epoch 21 Iter 39: loss 0.22536. :  17%|███████▍                                    | 38/224 [00:19<01:31,  2.03it/s]
Epoch 21 Iter 39: loss 0.22536. :  17%|███████▋                                    | 39/224 [00:19<01:31,  2.03it/s]
Epoch 21 Iter 40: loss 0.22717. :  17%|███████▋                                    | 39/224 [00:19<01:31,  2.03it/s]
Epoch 21 Iter 40: loss 0.22717. :  18%|███████▊                                    | 40/224 [00:19<01:30,  2.03it/s]
Epoch 21 Iter 41: loss 0.23772. :  18%|███████▊                                    | 40/224 [00:20<01:30,  2.03it/s]
Epoch 21 Iter 41: loss 0.23772. :  18%|████████                                    | 41/224 [00:20<01:29,  2.03it/s]
Epoch 21 Iter 42: loss 0.21900. :  18%|████████                                    | 41/224 [00:20<01:29,  2.03it/s]
Epoch 21 Iter 42: loss 0.21900. :  19%|████████▎                                   | 42/224 [00:20<01:29,  2.04it/s]
Epoch 21 Iter 43: loss 0.24928. :  19%|████████▎                                   | 42/224 [00:21<01:29,  2.04it/s]
Epoch 21 Iter 43: loss 0.24928. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.04it/s]
Epoch 21 Iter 44: loss 0.23145. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.04it/s]
Epoch 21 Iter 44: loss 0.23145. :  20%|████████▋                                   | 44/224 [00:21<01:28,  2.03it/s]
Epoch 21 Iter 45: loss 0.23655. :  20%|████████▋                                   | 44/224 [00:22<01:28,  2.03it/s]
Epoch 21 Iter 45: loss 0.23655. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.04it/s]
Epoch 21 Iter 46: loss 0.24555. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.04it/s]
Epoch 21 Iter 46: loss 0.24555. :  21%|█████████                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 21 Iter 47: loss 0.22346. :  21%|█████████                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 21 Iter 47: loss 0.22346. :  21%|█████████▏                                  | 47/224 [00:22<01:27,  2.03it/s]
Epoch 21 Iter 48: loss 0.23515. :  21%|█████████▏                                  | 47/224 [00:23<01:27,  2.03it/s]
Epoch 21 Iter 48: loss 0.23515. :  21%|█████████▍                                  | 48/224 [00:23<01:26,  2.03it/s]
Epoch 21 Iter 49: loss 0.23922. :  21%|█████████▍                                  | 48/224 [00:23<01:26,  2.03it/s]
Epoch 21 Iter 49: loss 0.23922. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.04it/s]
Epoch 21 Iter 50: loss 0.24925. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.04it/s]
Epoch 21 Iter 50: loss 0.24925. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 21 Iter 51: loss 0.22830. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 21 Iter 51: loss 0.22830. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 21 Iter 52: loss 0.21933. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 21 Iter 52: loss 0.21933. :  23%|██████████▏                                 | 52/224 [00:25<01:24,  2.04it/s]
Epoch 21 Iter 53: loss 0.25310. :  23%|██████████▏                                 | 52/224 [00:25<01:24,  2.04it/s]
Epoch 21 Iter 53: loss 0.25310. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 21 Iter 54: loss 0.23203. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 21 Iter 54: loss 0.23203. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 21 Iter 55: loss 0.25291. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 21 Iter 55: loss 0.25291. :  25%|██████████▊                                 | 55/224 [00:26<01:23,  2.01it/s]
Epoch 21 Iter 56: loss 0.21381. :  25%|██████████▊                                 | 55/224 [00:27<01:23,  2.01it/s]
Epoch 21 Iter 56: loss 0.21381. :  25%|███████████                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 21 Iter 57: loss 0.25348. :  25%|███████████                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 21 Iter 57: loss 0.25348. :  25%|███████████▏                                | 57/224 [00:27<01:22,  2.03it/s]
Epoch 21 Iter 58: loss 0.22359. :  25%|███████████▏                                | 57/224 [00:28<01:22,  2.03it/s]
Epoch 21 Iter 58: loss 0.22359. :  26%|███████████▍                                | 58/224 [00:28<01:21,  2.03it/s]
Epoch 21 Iter 59: loss 0.23627. :  26%|███████████▍                                | 58/224 [00:28<01:21,  2.03it/s]
Epoch 21 Iter 59: loss 0.23627. :  26%|███████████▌                                | 59/224 [00:28<01:21,  2.01it/s]
Epoch 21 Iter 60: loss 0.25979. :  26%|███████████▌                                | 59/224 [00:29<01:21,  2.01it/s]
Epoch 21 Iter 60: loss 0.25979. :  27%|███████████▊                                | 60/224 [00:29<01:21,  2.00it/s]
Epoch 21 Iter 61: loss 0.24617. :  27%|███████████▊                                | 60/224 [00:29<01:21,  2.00it/s]
Epoch 21 Iter 61: loss 0.24617. :  27%|███████████▉                                | 61/224 [00:29<01:22,  1.97it/s]
Epoch 21 Iter 62: loss 0.23496. :  27%|███████████▉                                | 61/224 [00:30<01:22,  1.97it/s]
Epoch 21 Iter 62: loss 0.23496. :  28%|████████████▏                               | 62/224 [00:30<01:21,  1.99it/s]
Epoch 21 Iter 63: loss 0.23272. :  28%|████████████▏                               | 62/224 [00:30<01:21,  1.99it/s]
Epoch 21 Iter 63: loss 0.23272. :  28%|████████████▍                               | 63/224 [00:30<01:20,  2.00it/s]
Epoch 21 Iter 64: loss 0.22926. :  28%|████████████▍                               | 63/224 [00:31<01:20,  2.00it/s]
Epoch 21 Iter 64: loss 0.22926. :  29%|████████████▌                               | 64/224 [00:31<01:19,  2.02it/s]
Epoch 21 Iter 65: loss 0.23526. :  29%|████████████▌                               | 64/224 [00:31<01:19,  2.02it/s]
Epoch 21 Iter 65: loss 0.23526. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.04it/s]
Epoch 21 Iter 66: loss 0.22226. :  29%|████████████▊                               | 65/224 [00:32<01:17,  2.04it/s]
Epoch 21 Iter 66: loss 0.22226. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 21 Iter 67: loss 0.26466. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 21 Iter 67: loss 0.26466. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 21 Iter 68: loss 0.25269. :  30%|█████████████▏                              | 67/224 [00:33<01:16,  2.05it/s]
Epoch 21 Iter 68: loss 0.25269. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 21 Iter 69: loss 0.23259. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 21 Iter 69: loss 0.23259. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.07it/s]
Epoch 21 Iter 70: loss 0.25804. :  31%|█████████████▌                              | 69/224 [00:34<01:15,  2.07it/s]
Epoch 21 Iter 70: loss 0.25804. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 21 Iter 71: loss 0.21535. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 21 Iter 71: loss 0.21535. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 21 Iter 72: loss 0.24233. :  32%|█████████████▉                              | 71/224 [00:35<01:14,  2.07it/s]
Epoch 21 Iter 72: loss 0.24233. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 21 Iter 73: loss 0.21515. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 21 Iter 73: loss 0.21515. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 21 Iter 74: loss 0.23079. :  33%|██████████████▎                             | 73/224 [00:36<01:12,  2.08it/s]
Epoch 21 Iter 74: loss 0.23079. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 21 Iter 75: loss 0.22092. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 21 Iter 75: loss 0.22092. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 21 Iter 76: loss 0.26199. :  33%|██████████████▋                             | 75/224 [00:37<01:12,  2.06it/s]
Epoch 21 Iter 76: loss 0.26199. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 21 Iter 77: loss 0.23076. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 21 Iter 77: loss 0.23076. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 21 Iter 78: loss 0.23610. :  34%|███████████████▏                            | 77/224 [00:38<01:11,  2.06it/s]
Epoch 21 Iter 78: loss 0.23610. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 21 Iter 79: loss 0.21674. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 21 Iter 79: loss 0.21674. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 21 Iter 80: loss 0.22653. :  35%|███████████████▌                            | 79/224 [00:39<01:09,  2.07it/s]
Epoch 21 Iter 80: loss 0.22653. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 21 Iter 81: loss 0.27226. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 21 Iter 81: loss 0.27226. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 21 Iter 82: loss 0.23508. :  36%|███████████████▉                            | 81/224 [00:40<01:09,  2.06it/s]
Epoch 21 Iter 82: loss 0.23508. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 83: loss 0.24344. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 83: loss 0.24344. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 21 Iter 84: loss 0.22693. :  37%|████████████████▎                           | 83/224 [00:41<01:08,  2.06it/s]
Epoch 21 Iter 84: loss 0.22693. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 21 Iter 85: loss 0.21543. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 21 Iter 85: loss 0.21543. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 21 Iter 86: loss 0.21825. :  38%|████████████████▋                           | 85/224 [00:42<01:07,  2.06it/s]
Epoch 21 Iter 86: loss 0.21825. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 21 Iter 87: loss 0.25686. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 21 Iter 87: loss 0.25686. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 21 Iter 88: loss 0.23219. :  39%|█████████████████                           | 87/224 [00:43<01:06,  2.06it/s]
Epoch 21 Iter 88: loss 0.23219. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.04it/s]
Epoch 21 Iter 89: loss 0.24724. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.04it/s]
Epoch 21 Iter 89: loss 0.24724. :  40%|█████████████████▍                          | 89/224 [00:43<01:06,  2.04it/s]
Epoch 21 Iter 90: loss 0.23109. :  40%|█████████████████▍                          | 89/224 [00:44<01:06,  2.04it/s]
Epoch 21 Iter 90: loss 0.23109. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 91: loss 0.23333. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 91: loss 0.23333. :  41%|█████████████████▉                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 92: loss 0.23398. :  41%|█████████████████▉                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 21 Iter 92: loss 0.23398. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.03it/s]
Epoch 21 Iter 93: loss 0.23707. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.03it/s]
Epoch 21 Iter 93: loss 0.23707. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.03it/s]
Epoch 21 Iter 94: loss 0.23109. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.03it/s]
Epoch 21 Iter 94: loss 0.23109. :  42%|██████████████████▍                         | 94/224 [00:45<01:04,  2.02it/s]
Epoch 21 Iter 95: loss 0.23057. :  42%|██████████████████▍                         | 94/224 [00:46<01:04,  2.02it/s]
Epoch 21 Iter 95: loss 0.23057. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.03it/s]
Epoch 21 Iter 96: loss 0.22828. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.03it/s]
Epoch 21 Iter 96: loss 0.22828. :  43%|██████████████████▊                         | 96/224 [00:46<01:03,  2.02it/s]
Epoch 21 Iter 97: loss 0.24072. :  43%|██████████████████▊                         | 96/224 [00:47<01:03,  2.02it/s]
Epoch 21 Iter 97: loss 0.24072. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 21 Iter 98: loss 0.24949. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 21 Iter 98: loss 0.24949. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.03it/s]
Epoch 21 Iter 99: loss 0.23335. :  44%|███████████████████▎                        | 98/224 [00:48<01:01,  2.03it/s]
Epoch 21 Iter 99: loss 0.23335. :  44%|███████████████████▍                        | 99/224 [00:48<01:01,  2.04it/s]
Epoch 21 Iter 100: loss 0.23689. :  44%|███████████████████                        | 99/224 [00:48<01:01,  2.04it/s]
Epoch 21 Iter 100: loss 0.23689. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 21 Iter 101: loss 0.24152. :  45%|██████████████████▊                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 21 Iter 101: loss 0.24152. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 21 Iter 102: loss 0.23199. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 21 Iter 102: loss 0.23199. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 21 Iter 103: loss 0.23274. :  46%|███████████████████▏                      | 102/224 [00:50<00:59,  2.05it/s]
Epoch 21 Iter 103: loss 0.23274. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 21 Iter 104: loss 0.21163. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 21 Iter 104: loss 0.21163. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 21 Iter 105: loss 0.25284. :  46%|███████████████████▌                      | 104/224 [00:51<00:57,  2.07it/s]
Epoch 21 Iter 105: loss 0.25284. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 21 Iter 106: loss 0.21733. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 21 Iter 106: loss 0.21733. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 21 Iter 107: loss 0.23430. :  47%|███████████████████▉                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 21 Iter 107: loss 0.23430. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 108: loss 0.21797. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 108: loss 0.21797. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 21 Iter 109: loss 0.22291. :  48%|████████████████████▎                     | 108/224 [00:53<00:56,  2.06it/s]
Epoch 21 Iter 109: loss 0.22291. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 21 Iter 110: loss 0.23300. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 21 Iter 110: loss 0.23300. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 21 Iter 111: loss 0.23631. :  49%|████████████████████▋                     | 110/224 [00:54<00:55,  2.07it/s]
Epoch 21 Iter 111: loss 0.23631. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 21 Iter 112: loss 0.23401. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 21 Iter 112: loss 0.23401. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 21 Iter 113: loss 0.25693. :  50%|█████████████████████                     | 112/224 [00:55<00:53,  2.08it/s]
Epoch 21 Iter 113: loss 0.25693. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 21 Iter 114: loss 0.23302. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 21 Iter 114: loss 0.23302. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 21 Iter 115: loss 0.22683. :  51%|█████████████████████▍                    | 114/224 [00:56<00:53,  2.07it/s]
Epoch 21 Iter 115: loss 0.22683. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 21 Iter 116: loss 0.20420. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 21 Iter 116: loss 0.20420. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 21 Iter 117: loss 0.26567. :  52%|█████████████████████▊                    | 116/224 [00:57<00:52,  2.05it/s]
Epoch 21 Iter 117: loss 0.26567. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 21 Iter 118: loss 0.22222. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 21 Iter 118: loss 0.22222. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 21 Iter 119: loss 0.25134. :  53%|██████████████████████▏                   | 118/224 [00:58<00:51,  2.06it/s]
Epoch 21 Iter 119: loss 0.25134. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 21 Iter 120: loss 0.24648. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 21 Iter 120: loss 0.24648. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 21 Iter 121: loss 0.23261. :  54%|██████████████████████▌                   | 120/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 121: loss 0.23261. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 122: loss 0.25071. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 122: loss 0.25071. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 21 Iter 123: loss 0.21467. :  54%|██████████████████████▊                   | 122/224 [01:00<00:49,  2.06it/s]
Epoch 21 Iter 123: loss 0.21467. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.23814. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.23814. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 21 Iter 125: loss 0.21161. :  55%|███████████████████████▎                  | 124/224 [01:01<00:48,  2.06it/s]
Epoch 21 Iter 125: loss 0.21161. :  56%|███████████████████████▍                  | 125/224 [01:01<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.25653. :  56%|███████████████████████▍                  | 125/224 [01:01<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.25653. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 21 Iter 127: loss 0.23258. :  56%|███████████████████████▋                  | 126/224 [01:02<00:47,  2.07it/s]
Epoch 21 Iter 127: loss 0.23258. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 21 Iter 128: loss 0.23497. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 21 Iter 128: loss 0.23497. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 21 Iter 129: loss 0.22858. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 21 Iter 129: loss 0.22858. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 21 Iter 130: loss 0.23854. :  58%|████████████████████████▏                 | 129/224 [01:03<00:46,  2.06it/s]
Epoch 21 Iter 130: loss 0.23854. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 21 Iter 131: loss 0.23065. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 21 Iter 131: loss 0.23065. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 21 Iter 132: loss 0.24072. :  58%|████████████████████████▌                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 21 Iter 132: loss 0.24072. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 21 Iter 133: loss 0.23546. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 21 Iter 133: loss 0.23546. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 21 Iter 134: loss 0.21709. :  59%|████████████████████████▉                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 21 Iter 134: loss 0.21709. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 21 Iter 135: loss 0.23130. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 21 Iter 135: loss 0.23130. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 21 Iter 136: loss 0.23647. :  60%|█████████████████████████▎                | 135/224 [01:06<00:43,  2.05it/s]
Epoch 21 Iter 136: loss 0.23647. :  61%|█████████████████████████▍                | 136/224 [01:06<00:43,  2.03it/s]
Epoch 21 Iter 137: loss 0.21968. :  61%|█████████████████████████▍                | 136/224 [01:06<00:43,  2.03it/s]
Epoch 21 Iter 137: loss 0.21968. :  61%|█████████████████████████▋                | 137/224 [01:06<00:43,  2.00it/s]
Epoch 21 Iter 138: loss 0.20783. :  61%|█████████████████████████▋                | 137/224 [01:07<00:43,  2.00it/s]
Epoch 21 Iter 138: loss 0.20783. :  62%|█████████████████████████▉                | 138/224 [01:07<00:42,  2.01it/s]
Epoch 21 Iter 139: loss 0.23127. :  62%|█████████████████████████▉                | 138/224 [01:07<00:42,  2.01it/s]
Epoch 21 Iter 139: loss 0.23127. :  62%|██████████████████████████                | 139/224 [01:07<00:42,  2.02it/s]
Epoch 21 Iter 140: loss 0.26110. :  62%|██████████████████████████                | 139/224 [01:08<00:42,  2.02it/s]
Epoch 21 Iter 140: loss 0.26110. :  62%|██████████████████████████▎               | 140/224 [01:08<00:41,  2.03it/s]
Epoch 21 Iter 141: loss 0.22942. :  62%|██████████████████████████▎               | 140/224 [01:08<00:41,  2.03it/s]
Epoch 21 Iter 141: loss 0.22942. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.04it/s]
Epoch 21 Iter 142: loss 0.23644. :  63%|██████████████████████████▍               | 141/224 [01:09<00:40,  2.04it/s]
Epoch 21 Iter 142: loss 0.23644. :  63%|██████████████████████████▋               | 142/224 [01:09<00:40,  2.04it/s]
Epoch 21 Iter 143: loss 0.21820. :  63%|██████████████████████████▋               | 142/224 [01:09<00:40,  2.04it/s]
Epoch 21 Iter 143: loss 0.21820. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 21 Iter 144: loss 0.24530. :  64%|██████████████████████████▊               | 143/224 [01:10<00:39,  2.05it/s]
Epoch 21 Iter 144: loss 0.24530. :  64%|███████████████████████████               | 144/224 [01:10<00:39,  2.04it/s]
Epoch 21 Iter 145: loss 0.22778. :  64%|███████████████████████████               | 144/224 [01:10<00:39,  2.04it/s]
Epoch 21 Iter 145: loss 0.22778. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.03it/s]
Epoch 21 Iter 146: loss 0.23290. :  65%|███████████████████████████▏              | 145/224 [01:11<00:38,  2.03it/s]
Epoch 21 Iter 146: loss 0.23290. :  65%|███████████████████████████▍              | 146/224 [01:11<00:38,  2.03it/s]
Epoch 21 Iter 147: loss 0.22514. :  65%|███████████████████████████▍              | 146/224 [01:11<00:38,  2.03it/s]
Epoch 21 Iter 147: loss 0.22514. :  66%|███████████████████████████▌              | 147/224 [01:11<00:38,  2.03it/s]
Epoch 21 Iter 148: loss 0.21877. :  66%|███████████████████████████▌              | 147/224 [01:12<00:38,  2.03it/s]
Epoch 21 Iter 148: loss 0.21877. :  66%|███████████████████████████▊              | 148/224 [01:12<00:37,  2.02it/s]
Epoch 21 Iter 149: loss 0.21335. :  66%|███████████████████████████▊              | 148/224 [01:12<00:37,  2.02it/s]
Epoch 21 Iter 149: loss 0.21335. :  67%|███████████████████████████▉              | 149/224 [01:12<00:37,  2.03it/s]
Epoch 21 Iter 150: loss 0.22537. :  67%|███████████████████████████▉              | 149/224 [01:13<00:37,  2.03it/s]
Epoch 21 Iter 150: loss 0.22537. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.02it/s]
Epoch 21 Iter 151: loss 0.24137. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.02it/s]
Epoch 21 Iter 151: loss 0.24137. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.03it/s]
Epoch 21 Iter 152: loss 0.22981. :  67%|████████████████████████████▎             | 151/224 [01:14<00:35,  2.03it/s]
Epoch 21 Iter 152: loss 0.22981. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.03it/s]
Epoch 21 Iter 153: loss 0.23690. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.03it/s]
Epoch 21 Iter 153: loss 0.23690. :  68%|████████████████████████████▋             | 153/224 [01:14<00:35,  2.03it/s]
Epoch 21 Iter 154: loss 0.22703. :  68%|████████████████████████████▋             | 153/224 [01:15<00:35,  2.03it/s]
Epoch 21 Iter 154: loss 0.22703. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.02it/s]
Epoch 21 Iter 155: loss 0.21230. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.02it/s]
Epoch 21 Iter 155: loss 0.21230. :  69%|█████████████████████████████             | 155/224 [01:15<00:34,  2.02it/s]
Epoch 21 Iter 156: loss 0.19907. :  69%|█████████████████████████████             | 155/224 [01:16<00:34,  2.02it/s]
Epoch 21 Iter 156: loss 0.19907. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.01it/s]
Epoch 21 Iter 157: loss 0.22241. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.01it/s]
Epoch 21 Iter 157: loss 0.22241. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:33,  2.01it/s]
Epoch 21 Iter 158: loss 0.24114. :  70%|█████████████████████████████▍            | 157/224 [01:17<00:33,  2.01it/s]
Epoch 21 Iter 158: loss 0.24114. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.01it/s]
Epoch 21 Iter 159: loss 0.23492. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.01it/s]
Epoch 21 Iter 159: loss 0.23492. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:32,  2.00it/s]
Epoch 21 Iter 160: loss 0.24706. :  71%|█████████████████████████████▊            | 159/224 [01:18<00:32,  2.00it/s]
Epoch 21 Iter 160: loss 0.24706. :  71%|██████████████████████████████            | 160/224 [01:18<00:32,  1.99it/s]
Epoch 21 Iter 161: loss 0.24446. :  71%|██████████████████████████████            | 160/224 [01:18<00:32,  1.99it/s]
Epoch 21 Iter 161: loss 0.24446. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:31,  1.99it/s]
Epoch 21 Iter 162: loss 0.22316. :  72%|██████████████████████████████▏           | 161/224 [01:19<00:31,  1.99it/s]
Epoch 21 Iter 162: loss 0.22316. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:31,  1.99it/s]
Epoch 21 Iter 163: loss 0.23237. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:31,  1.99it/s]
Epoch 21 Iter 163: loss 0.23237. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:30,  1.99it/s]
Epoch 21 Iter 164: loss 0.23778. :  73%|██████████████████████████████▌           | 163/224 [01:20<00:30,  1.99it/s]
Epoch 21 Iter 164: loss 0.23778. :  73%|██████████████████████████████▋           | 164/224 [01:20<00:29,  2.00it/s]
Epoch 21 Iter 165: loss 0.23436. :  73%|██████████████████████████████▋           | 164/224 [01:20<00:29,  2.00it/s]
Epoch 21 Iter 165: loss 0.23436. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:29,  2.01it/s]
Epoch 21 Iter 166: loss 0.23906. :  74%|██████████████████████████████▉           | 165/224 [01:21<00:29,  2.01it/s]
Epoch 21 Iter 166: loss 0.23906. :  74%|███████████████████████████████▏          | 166/224 [01:21<00:29,  2.00it/s]
Epoch 21 Iter 167: loss 0.22650. :  74%|███████████████████████████████▏          | 166/224 [01:21<00:29,  2.00it/s]
Epoch 21 Iter 167: loss 0.22650. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:28,  1.99it/s]
Epoch 21 Iter 168: loss 0.22997. :  75%|███████████████████████████████▎          | 167/224 [01:22<00:28,  1.99it/s]
Epoch 21 Iter 168: loss 0.22997. :  75%|███████████████████████████████▌          | 168/224 [01:22<00:27,  2.00it/s]
Epoch 21 Iter 169: loss 0.24945. :  75%|███████████████████████████████▌          | 168/224 [01:22<00:27,  2.00it/s]
Epoch 21 Iter 169: loss 0.24945. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:27,  2.01it/s]
Epoch 21 Iter 170: loss 0.26152. :  75%|███████████████████████████████▋          | 169/224 [01:23<00:27,  2.01it/s]
Epoch 21 Iter 170: loss 0.26152. :  76%|███████████████████████████████▉          | 170/224 [01:23<00:26,  2.01it/s]
Epoch 21 Iter 171: loss 0.23556. :  76%|███████████████████████████████▉          | 170/224 [01:23<00:26,  2.01it/s]
Epoch 21 Iter 171: loss 0.23556. :  76%|████████████████████████████████          | 171/224 [01:23<00:26,  2.00it/s]
Epoch 21 Iter 172: loss 0.23383. :  76%|████████████████████████████████          | 171/224 [01:24<00:26,  2.00it/s]
Epoch 21 Iter 172: loss 0.23383. :  77%|████████████████████████████████▎         | 172/224 [01:24<00:25,  2.02it/s]
Epoch 21 Iter 173: loss 0.26406. :  77%|████████████████████████████████▎         | 172/224 [01:24<00:25,  2.02it/s]
Epoch 21 Iter 173: loss 0.26406. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 21 Iter 174: loss 0.23180. :  77%|████████████████████████████████▍         | 173/224 [01:25<00:24,  2.05it/s]
Epoch 21 Iter 174: loss 0.23180. :  78%|████████████████████████████████▋         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 21 Iter 175: loss 0.21915. :  78%|████████████████████████████████▋         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 21 Iter 175: loss 0.21915. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:24,  2.03it/s]
Epoch 21 Iter 176: loss 0.23518. :  78%|████████████████████████████████▊         | 175/224 [01:26<00:24,  2.03it/s]
Epoch 21 Iter 176: loss 0.23518. :  79%|█████████████████████████████████         | 176/224 [01:26<00:23,  2.02it/s]
Epoch 21 Iter 177: loss 0.22639. :  79%|█████████████████████████████████         | 176/224 [01:26<00:23,  2.02it/s]
Epoch 21 Iter 177: loss 0.22639. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:23,  2.03it/s]
Epoch 21 Iter 178: loss 0.23242. :  79%|█████████████████████████████████▏        | 177/224 [01:27<00:23,  2.03it/s]
Epoch 21 Iter 178: loss 0.23242. :  79%|█████████████████████████████████▍        | 178/224 [01:27<00:22,  2.03it/s]
Epoch 21 Iter 179: loss 0.22963. :  79%|█████████████████████████████████▍        | 178/224 [01:27<00:22,  2.03it/s]
Epoch 21 Iter 179: loss 0.22963. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:22,  2.04it/s]
Epoch 21 Iter 180: loss 0.23665. :  80%|█████████████████████████████████▌        | 179/224 [01:28<00:22,  2.04it/s]
Epoch 21 Iter 180: loss 0.23665. :  80%|█████████████████████████████████▊        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.23338. :  80%|█████████████████████████████████▊        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.23338. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 21 Iter 182: loss 0.24381. :  81%|█████████████████████████████████▉        | 181/224 [01:29<00:20,  2.08it/s]
Epoch 21 Iter 182: loss 0.24381. :  81%|██████████████████████████████████▏       | 182/224 [01:29<00:20,  2.09it/s]
Epoch 21 Iter 183: loss 0.23006. :  81%|██████████████████████████████████▏       | 182/224 [01:29<00:20,  2.09it/s]
Epoch 21 Iter 183: loss 0.23006. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 21 Iter 184: loss 0.20703. :  82%|██████████████████████████████████▎       | 183/224 [01:30<00:19,  2.08it/s]
Epoch 21 Iter 184: loss 0.20703. :  82%|██████████████████████████████████▌       | 184/224 [01:30<00:19,  2.07it/s]
Epoch 21 Iter 185: loss 0.24193. :  82%|██████████████████████████████████▌       | 184/224 [01:30<00:19,  2.07it/s]
Epoch 21 Iter 185: loss 0.24193. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.23517. :  83%|██████████████████████████████████▋       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.23517. :  83%|██████████████████████████████████▉       | 186/224 [01:31<00:18,  2.07it/s]
Epoch 21 Iter 187: loss 0.24658. :  83%|██████████████████████████████████▉       | 186/224 [01:31<00:18,  2.07it/s]
Epoch 21 Iter 187: loss 0.24658. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.08it/s]
Epoch 21 Iter 188: loss 0.21809. :  83%|███████████████████████████████████       | 187/224 [01:32<00:17,  2.08it/s]
Epoch 21 Iter 188: loss 0.21809. :  84%|███████████████████████████████████▎      | 188/224 [01:32<00:17,  2.05it/s]
Epoch 21 Iter 189: loss 0.23935. :  84%|███████████████████████████████████▎      | 188/224 [01:32<00:17,  2.05it/s]
Epoch 21 Iter 189: loss 0.23935. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 21 Iter 190: loss 0.24124. :  84%|███████████████████████████████████▍      | 189/224 [01:33<00:17,  2.05it/s]
Epoch 21 Iter 190: loss 0.24124. :  85%|███████████████████████████████████▋      | 190/224 [01:33<00:16,  2.05it/s]
Epoch 21 Iter 191: loss 0.23838. :  85%|███████████████████████████████████▋      | 190/224 [01:33<00:16,  2.05it/s]
Epoch 21 Iter 191: loss 0.23838. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 21 Iter 192: loss 0.24927. :  85%|███████████████████████████████████▊      | 191/224 [01:34<00:16,  2.04it/s]
Epoch 21 Iter 192: loss 0.24927. :  86%|████████████████████████████████████      | 192/224 [01:34<00:15,  2.02it/s]
Epoch 21 Iter 193: loss 0.24312. :  86%|████████████████████████████████████      | 192/224 [01:34<00:15,  2.02it/s]
Epoch 21 Iter 193: loss 0.24312. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.01it/s]
Epoch 21 Iter 194: loss 0.24028. :  86%|████████████████████████████████████▏     | 193/224 [01:35<00:15,  2.01it/s]
Epoch 21 Iter 194: loss 0.24028. :  87%|████████████████████████████████████▍     | 194/224 [01:35<00:14,  2.02it/s]
Epoch 21 Iter 195: loss 0.25497. :  87%|████████████████████████████████████▍     | 194/224 [01:35<00:14,  2.02it/s]
Epoch 21 Iter 195: loss 0.25497. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.04it/s]
Epoch 21 Iter 196: loss 0.23181. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.04it/s]
Epoch 21 Iter 196: loss 0.23181. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 21 Iter 197: loss 0.24327. :  88%|████████████████████████████████████▊     | 196/224 [01:36<00:13,  2.05it/s]
Epoch 21 Iter 197: loss 0.24327. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 21 Iter 198: loss 0.22974. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 21 Iter 198: loss 0.22974. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 21 Iter 199: loss 0.24330. :  88%|█████████████████████████████████████▏    | 198/224 [01:37<00:12,  2.05it/s]
Epoch 21 Iter 199: loss 0.24330. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 21 Iter 200: loss 0.24118. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 21 Iter 200: loss 0.24118. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 21 Iter 201: loss 0.23957. :  89%|█████████████████████████████████████▌    | 200/224 [01:38<00:11,  2.06it/s]
Epoch 21 Iter 201: loss 0.23957. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 21 Iter 202: loss 0.22430. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 21 Iter 202: loss 0.22430. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 21 Iter 203: loss 0.23922. :  90%|█████████████████████████████████████▉    | 202/224 [01:39<00:10,  2.06it/s]
Epoch 21 Iter 203: loss 0.23922. :  91%|██████████████████████████████████████    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 21 Iter 204: loss 0.23401. :  91%|██████████████████████████████████████    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 21 Iter 204: loss 0.23401. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 21 Iter 205: loss 0.22811. :  91%|██████████████████████████████████████▎   | 204/224 [01:40<00:09,  2.06it/s]
Epoch 21 Iter 205: loss 0.22811. :  92%|██████████████████████████████████████▍   | 205/224 [01:40<00:09,  2.05it/s]
Epoch 21 Iter 206: loss 0.24220. :  92%|██████████████████████████████████████▍   | 205/224 [01:40<00:09,  2.05it/s]
Epoch 21 Iter 206: loss 0.24220. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 21 Iter 207: loss 0.24172. :  92%|██████████████████████████████████████▋   | 206/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 207: loss 0.24172. :  92%|██████████████████████████████████████▊   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 208: loss 0.24802. :  92%|██████████████████████████████████████▊   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 208: loss 0.24802. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 21 Iter 209: loss 0.22373. :  93%|███████████████████████████████████████   | 208/224 [01:42<00:07,  2.06it/s]
Epoch 21 Iter 209: loss 0.22373. :  93%|███████████████████████████████████████▏  | 209/224 [01:42<00:07,  2.06it/s]
Epoch 21 Iter 210: loss 0.24934. :  93%|███████████████████████████████████████▏  | 209/224 [01:42<00:07,  2.06it/s]
Epoch 21 Iter 210: loss 0.24934. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 21 Iter 211: loss 0.22075. :  94%|███████████████████████████████████████▍  | 210/224 [01:43<00:06,  2.06it/s]
Epoch 21 Iter 211: loss 0.22075. :  94%|███████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.07it/s]
Epoch 21 Iter 212: loss 0.24063. :  94%|███████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.07it/s]
Epoch 21 Iter 212: loss 0.24063. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 21 Iter 213: loss 0.24603. :  95%|███████████████████████████████████████▊  | 212/224 [01:44<00:05,  2.07it/s]
Epoch 21 Iter 213: loss 0.24603. :  95%|███████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 21 Iter 214: loss 0.23709. :  95%|███████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.06it/s]
Epoch 21 Iter 214: loss 0.23709. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.08it/s]
Epoch 21 Iter 215: loss 0.23701. :  96%|████████████████████████████████████████▏ | 214/224 [01:45<00:04,  2.08it/s]
Epoch 21 Iter 215: loss 0.23701. :  96%|████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 21 Iter 216: loss 0.24847. :  96%|████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 21 Iter 216: loss 0.24847. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 21 Iter 217: loss 0.22879. :  96%|████████████████████████████████████████▌ | 216/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 217: loss 0.22879. :  97%|████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 218: loss 0.24447. :  97%|████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 218: loss 0.24447. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 21 Iter 219: loss 0.22999. :  97%|████████████████████████████████████████▉ | 218/224 [01:47<00:02,  2.07it/s]
Epoch 21 Iter 219: loss 0.22999. :  98%|█████████████████████████████████████████ | 219/224 [01:47<00:02,  2.07it/s]
Epoch 21 Iter 220: loss 0.23865. :  98%|█████████████████████████████████████████ | 219/224 [01:47<00:02,  2.07it/s]
Epoch 21 Iter 220: loss 0.23865. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.07it/s]
Epoch 21 Iter 221: loss 0.24031. :  98%|█████████████████████████████████████████▎| 220/224 [01:48<00:01,  2.07it/s]
Epoch 21 Iter 221: loss 0.24031. :  99%|█████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.07it/s]
Epoch 21 Iter 222: loss 0.22596. :  99%|█████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.07it/s]
Epoch 21 Iter 222: loss 0.22596. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.05it/s]
Epoch 21 Iter 223: loss 0.22352. :  99%|█████████████████████████████████████████▋| 222/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 223: loss 0.22352. : 100%|█████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.22423. : 100%|█████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.22423. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.22423. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.04it/s]

    Train loss: 0.23415
    Valid loss: 0.23581
       Valid loss recons: 0.22362
       Valid loss KL-D:   1.21851
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.23393. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.23393. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 22 Iter 2: loss 0.23213. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 22 Iter 2: loss 0.23213. :   1%|▍                                             | 2/224 [00:00<01:47,  2.06it/s]
Epoch 22 Iter 3: loss 0.22488. :   1%|▍                                             | 2/224 [00:01<01:47,  2.06it/s]
Epoch 22 Iter 3: loss 0.22488. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 22 Iter 4: loss 0.24680. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 22 Iter 4: loss 0.24680. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 22 Iter 5: loss 0.24535. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 22 Iter 5: loss 0.24535. :   2%|█                                             | 5/224 [00:02<01:47,  2.04it/s]
Epoch 22 Iter 6: loss 0.22933. :   2%|█                                             | 5/224 [00:02<01:47,  2.04it/s]
Epoch 22 Iter 6: loss 0.22933. :   3%|█▏                                            | 6/224 [00:02<01:48,  2.02it/s]
Epoch 22 Iter 7: loss 0.22434. :   3%|█▏                                            | 6/224 [00:03<01:48,  2.02it/s]
Epoch 22 Iter 7: loss 0.22434. :   3%|█▍                                            | 7/224 [00:03<01:50,  1.96it/s]
Epoch 22 Iter 8: loss 0.23032. :   3%|█▍                                            | 7/224 [00:04<01:50,  1.96it/s]
Epoch 22 Iter 8: loss 0.23032. :   4%|█▋                                            | 8/224 [00:04<01:52,  1.92it/s]
Epoch 22 Iter 9: loss 0.23273. :   4%|█▋                                            | 8/224 [00:04<01:52,  1.92it/s]
Epoch 22 Iter 9: loss 0.23273. :   4%|█▊                                            | 9/224 [00:04<01:51,  1.92it/s]
Epoch 22 Iter 10: loss 0.26141. :   4%|█▊                                           | 9/224 [00:05<01:51,  1.92it/s]
Epoch 22 Iter 10: loss 0.26141. :   4%|█▉                                          | 10/224 [00:05<01:51,  1.92it/s]
Epoch 22 Iter 11: loss 0.23555. :   4%|█▉                                          | 10/224 [00:05<01:51,  1.92it/s]
Epoch 22 Iter 11: loss 0.23555. :   5%|██▏                                         | 11/224 [00:05<01:50,  1.93it/s]
Epoch 22 Iter 12: loss 0.22828. :   5%|██▏                                         | 11/224 [00:06<01:50,  1.93it/s]
Epoch 22 Iter 12: loss 0.22828. :   5%|██▎                                         | 12/224 [00:06<01:48,  1.96it/s]
Epoch 22 Iter 13: loss 0.23095. :   5%|██▎                                         | 12/224 [00:06<01:48,  1.96it/s]
Epoch 22 Iter 13: loss 0.23095. :   6%|██▌                                         | 13/224 [00:06<01:47,  1.96it/s]
Epoch 22 Iter 14: loss 0.23193. :   6%|██▌                                         | 13/224 [00:07<01:47,  1.96it/s]
Epoch 22 Iter 14: loss 0.23193. :   6%|██▊                                         | 14/224 [00:07<01:47,  1.96it/s]
Epoch 22 Iter 15: loss 0.23272. :   6%|██▊                                         | 14/224 [00:07<01:47,  1.96it/s]
Epoch 22 Iter 15: loss 0.23272. :   7%|██▉                                         | 15/224 [00:07<01:46,  1.96it/s]
Epoch 22 Iter 16: loss 0.23361. :   7%|██▉                                         | 15/224 [00:08<01:46,  1.96it/s]
Epoch 22 Iter 16: loss 0.23361. :   7%|███▏                                        | 16/224 [00:08<01:46,  1.95it/s]
Epoch 22 Iter 17: loss 0.24951. :   7%|███▏                                        | 16/224 [00:08<01:46,  1.95it/s]
Epoch 22 Iter 17: loss 0.24951. :   8%|███▎                                        | 17/224 [00:08<01:46,  1.95it/s]
Epoch 22 Iter 18: loss 0.23983. :   8%|███▎                                        | 17/224 [00:09<01:46,  1.95it/s]
Epoch 22 Iter 18: loss 0.23983. :   8%|███▌                                        | 18/224 [00:09<01:44,  1.96it/s]
Epoch 22 Iter 19: loss 0.22219. :   8%|███▌                                        | 18/224 [00:09<01:44,  1.96it/s]
Epoch 22 Iter 19: loss 0.22219. :   8%|███▋                                        | 19/224 [00:09<01:44,  1.96it/s]
Epoch 22 Iter 20: loss 0.21539. :   8%|███▋                                        | 19/224 [00:10<01:44,  1.96it/s]
Epoch 22 Iter 20: loss 0.21539. :   9%|███▉                                        | 20/224 [00:10<01:44,  1.96it/s]
Epoch 22 Iter 21: loss 0.23279. :   9%|███▉                                        | 20/224 [00:10<01:44,  1.96it/s]
Epoch 22 Iter 21: loss 0.23279. :   9%|████▏                                       | 21/224 [00:10<01:43,  1.96it/s]
Epoch 22 Iter 22: loss 0.22878. :   9%|████▏                                       | 21/224 [00:11<01:43,  1.96it/s]
Epoch 22 Iter 22: loss 0.22878. :  10%|████▎                                       | 22/224 [00:11<01:43,  1.96it/s]
Epoch 22 Iter 23: loss 0.24656. :  10%|████▎                                       | 22/224 [00:11<01:43,  1.96it/s]
Epoch 22 Iter 23: loss 0.24656. :  10%|████▌                                       | 23/224 [00:11<01:42,  1.96it/s]
Epoch 22 Iter 24: loss 0.21440. :  10%|████▌                                       | 23/224 [00:12<01:42,  1.96it/s]
Epoch 22 Iter 24: loss 0.21440. :  11%|████▋                                       | 24/224 [00:12<01:42,  1.96it/s]
Epoch 22 Iter 25: loss 0.24656. :  11%|████▋                                       | 24/224 [00:12<01:42,  1.96it/s]
Epoch 22 Iter 25: loss 0.24656. :  11%|████▉                                       | 25/224 [00:12<01:41,  1.96it/s]
Epoch 22 Iter 26: loss 0.24894. :  11%|████▉                                       | 25/224 [00:13<01:41,  1.96it/s]
Epoch 22 Iter 26: loss 0.24894. :  12%|█████                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 22 Iter 27: loss 0.23483. :  12%|█████                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 22 Iter 27: loss 0.23483. :  12%|█████▎                                      | 27/224 [00:13<01:37,  2.02it/s]
Epoch 22 Iter 28: loss 0.21532. :  12%|█████▎                                      | 27/224 [00:14<01:37,  2.02it/s]
Epoch 22 Iter 28: loss 0.21532. :  12%|█████▌                                      | 28/224 [00:14<01:36,  2.02it/s]
Epoch 22 Iter 29: loss 0.20703. :  12%|█████▌                                      | 28/224 [00:14<01:36,  2.02it/s]
Epoch 22 Iter 29: loss 0.20703. :  13%|█████▋                                      | 29/224 [00:14<01:36,  2.02it/s]
Epoch 22 Iter 30: loss 0.24232. :  13%|█████▋                                      | 29/224 [00:15<01:36,  2.02it/s]
Epoch 22 Iter 30: loss 0.24232. :  13%|█████▉                                      | 30/224 [00:15<01:35,  2.03it/s]
Epoch 22 Iter 31: loss 0.23583. :  13%|█████▉                                      | 30/224 [00:15<01:35,  2.03it/s]
Epoch 22 Iter 31: loss 0.23583. :  14%|██████                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 22 Iter 32: loss 0.23565. :  14%|██████                                      | 31/224 [00:16<01:34,  2.04it/s]
Epoch 22 Iter 32: loss 0.23565. :  14%|██████▎                                     | 32/224 [00:16<01:34,  2.04it/s]
Epoch 22 Iter 33: loss 0.24364. :  14%|██████▎                                     | 32/224 [00:16<01:34,  2.04it/s]
Epoch 22 Iter 33: loss 0.24364. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.05it/s]
Epoch 22 Iter 34: loss 0.22063. :  15%|██████▍                                     | 33/224 [00:17<01:33,  2.05it/s]
Epoch 22 Iter 34: loss 0.22063. :  15%|██████▋                                     | 34/224 [00:17<01:32,  2.05it/s]
Epoch 22 Iter 35: loss 0.24554. :  15%|██████▋                                     | 34/224 [00:17<01:32,  2.05it/s]
Epoch 22 Iter 35: loss 0.24554. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.05it/s]
Epoch 22 Iter 36: loss 0.25906. :  16%|██████▉                                     | 35/224 [00:18<01:32,  2.05it/s]
Epoch 22 Iter 36: loss 0.25906. :  16%|███████                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 22 Iter 37: loss 0.23532. :  16%|███████                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 22 Iter 37: loss 0.23532. :  17%|███████▎                                    | 37/224 [00:18<01:32,  2.02it/s]
Epoch 22 Iter 38: loss 0.22737. :  17%|███████▎                                    | 37/224 [00:19<01:32,  2.02it/s]
Epoch 22 Iter 38: loss 0.22737. :  17%|███████▍                                    | 38/224 [00:19<01:32,  2.01it/s]
Epoch 22 Iter 39: loss 0.21642. :  17%|███████▍                                    | 38/224 [00:19<01:32,  2.01it/s]
Epoch 22 Iter 39: loss 0.21642. :  17%|███████▋                                    | 39/224 [00:19<01:32,  2.01it/s]
Epoch 22 Iter 40: loss 0.22286. :  17%|███████▋                                    | 39/224 [00:20<01:32,  2.01it/s]
Epoch 22 Iter 40: loss 0.22286. :  18%|███████▊                                    | 40/224 [00:20<01:31,  2.02it/s]
Epoch 22 Iter 41: loss 0.22220. :  18%|███████▊                                    | 40/224 [00:20<01:31,  2.02it/s]
Epoch 22 Iter 41: loss 0.22220. :  18%|████████                                    | 41/224 [00:20<01:30,  2.01it/s]
Epoch 22 Iter 42: loss 0.23212. :  18%|████████                                    | 41/224 [00:21<01:30,  2.01it/s]
Epoch 22 Iter 42: loss 0.23212. :  19%|████████▎                                   | 42/224 [00:21<01:29,  2.03it/s]
Epoch 22 Iter 43: loss 0.23153. :  19%|████████▎                                   | 42/224 [00:21<01:29,  2.03it/s]
Epoch 22 Iter 43: loss 0.23153. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.04it/s]
Epoch 22 Iter 44: loss 0.23249. :  19%|████████▍                                   | 43/224 [00:22<01:28,  2.04it/s]
Epoch 22 Iter 44: loss 0.23249. :  20%|████████▋                                   | 44/224 [00:22<01:28,  2.04it/s]
Epoch 22 Iter 45: loss 0.24385. :  20%|████████▋                                   | 44/224 [00:22<01:28,  2.04it/s]
Epoch 22 Iter 45: loss 0.24385. :  20%|████████▊                                   | 45/224 [00:22<01:28,  2.03it/s]
Epoch 22 Iter 46: loss 0.22897. :  20%|████████▊                                   | 45/224 [00:23<01:28,  2.03it/s]
Epoch 22 Iter 46: loss 0.22897. :  21%|█████████                                   | 46/224 [00:23<01:27,  2.03it/s]
Epoch 22 Iter 47: loss 0.22952. :  21%|█████████                                   | 46/224 [00:23<01:27,  2.03it/s]
Epoch 22 Iter 47: loss 0.22952. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.04it/s]
Epoch 22 Iter 48: loss 0.25827. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.04it/s]
Epoch 22 Iter 48: loss 0.25827. :  21%|█████████▍                                  | 48/224 [00:24<01:26,  2.04it/s]
Epoch 22 Iter 49: loss 0.25751. :  21%|█████████▍                                  | 48/224 [00:24<01:26,  2.04it/s]
Epoch 22 Iter 49: loss 0.25751. :  22%|█████████▋                                  | 49/224 [00:24<01:26,  2.03it/s]
Epoch 22 Iter 50: loss 0.22601. :  22%|█████████▋                                  | 49/224 [00:25<01:26,  2.03it/s]
Epoch 22 Iter 50: loss 0.22601. :  22%|█████████▊                                  | 50/224 [00:25<01:26,  2.00it/s]
Epoch 22 Iter 51: loss 0.22794. :  22%|█████████▊                                  | 50/224 [00:25<01:26,  2.00it/s]
Epoch 22 Iter 51: loss 0.22794. :  23%|██████████                                  | 51/224 [00:25<01:25,  2.03it/s]
Epoch 22 Iter 52: loss 0.22079. :  23%|██████████                                  | 51/224 [00:25<01:25,  2.03it/s]
Epoch 22 Iter 52: loss 0.22079. :  23%|██████████▏                                 | 52/224 [00:25<01:24,  2.03it/s]
Epoch 22 Iter 53: loss 0.23192. :  23%|██████████▏                                 | 52/224 [00:26<01:24,  2.03it/s]
Epoch 22 Iter 53: loss 0.23192. :  24%|██████████▍                                 | 53/224 [00:26<01:24,  2.03it/s]
Epoch 22 Iter 54: loss 0.25819. :  24%|██████████▍                                 | 53/224 [00:26<01:24,  2.03it/s]
Epoch 22 Iter 54: loss 0.25819. :  24%|██████████▌                                 | 54/224 [00:26<01:23,  2.02it/s]
Epoch 22 Iter 55: loss 0.22932. :  24%|██████████▌                                 | 54/224 [00:27<01:23,  2.02it/s]
Epoch 22 Iter 55: loss 0.22932. :  25%|██████████▊                                 | 55/224 [00:27<01:23,  2.03it/s]
Epoch 22 Iter 56: loss 0.24536. :  25%|██████████▊                                 | 55/224 [00:27<01:23,  2.03it/s]
Epoch 22 Iter 56: loss 0.24536. :  25%|███████████                                 | 56/224 [00:27<01:23,  2.02it/s]
Epoch 22 Iter 57: loss 0.22522. :  25%|███████████                                 | 56/224 [00:28<01:23,  2.02it/s]
Epoch 22 Iter 57: loss 0.22522. :  25%|███████████▏                                | 57/224 [00:28<01:22,  2.03it/s]
Epoch 22 Iter 58: loss 0.23598. :  25%|███████████▏                                | 57/224 [00:28<01:22,  2.03it/s]
Epoch 22 Iter 58: loss 0.23598. :  26%|███████████▍                                | 58/224 [00:28<01:21,  2.03it/s]
Epoch 22 Iter 59: loss 0.22378. :  26%|███████████▍                                | 58/224 [00:29<01:21,  2.03it/s]
Epoch 22 Iter 59: loss 0.22378. :  26%|███████████▌                                | 59/224 [00:29<01:21,  2.03it/s]
Epoch 22 Iter 60: loss 0.23409. :  26%|███████████▌                                | 59/224 [00:29<01:21,  2.03it/s]
Epoch 22 Iter 60: loss 0.23409. :  27%|███████████▊                                | 60/224 [00:29<01:20,  2.03it/s]
Epoch 22 Iter 61: loss 0.23437. :  27%|███████████▊                                | 60/224 [00:30<01:20,  2.03it/s]
Epoch 22 Iter 61: loss 0.23437. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 22 Iter 62: loss 0.23873. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 22 Iter 62: loss 0.23873. :  28%|████████████▏                               | 62/224 [00:30<01:19,  2.05it/s]
Epoch 22 Iter 63: loss 0.23222. :  28%|████████████▏                               | 62/224 [00:31<01:19,  2.05it/s]
Epoch 22 Iter 63: loss 0.23222. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.05it/s]
Epoch 22 Iter 64: loss 0.23629. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.05it/s]
Epoch 22 Iter 64: loss 0.23629. :  29%|████████████▌                               | 64/224 [00:31<01:18,  2.05it/s]
Epoch 22 Iter 65: loss 0.22720. :  29%|████████████▌                               | 64/224 [00:32<01:18,  2.05it/s]
Epoch 22 Iter 65: loss 0.22720. :  29%|████████████▊                               | 65/224 [00:32<01:17,  2.05it/s]
Epoch 22 Iter 66: loss 0.25176. :  29%|████████████▊                               | 65/224 [00:32<01:17,  2.05it/s]
Epoch 22 Iter 66: loss 0.25176. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 22 Iter 67: loss 0.22853. :  29%|████████████▉                               | 66/224 [00:33<01:16,  2.06it/s]
Epoch 22 Iter 67: loss 0.22853. :  30%|█████████████▏                              | 67/224 [00:33<01:16,  2.05it/s]
Epoch 22 Iter 68: loss 0.21860. :  30%|█████████████▏                              | 67/224 [00:33<01:16,  2.05it/s]
Epoch 22 Iter 68: loss 0.21860. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 22 Iter 69: loss 0.25082. :  30%|█████████████▎                              | 68/224 [00:34<01:15,  2.07it/s]
Epoch 22 Iter 69: loss 0.25082. :  31%|█████████████▌                              | 69/224 [00:34<01:14,  2.07it/s]
Epoch 22 Iter 70: loss 0.20708. :  31%|█████████████▌                              | 69/224 [00:34<01:14,  2.07it/s]
Epoch 22 Iter 70: loss 0.20708. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 22 Iter 71: loss 0.24046. :  31%|█████████████▊                              | 70/224 [00:35<01:14,  2.06it/s]
Epoch 22 Iter 71: loss 0.24046. :  32%|█████████████▉                              | 71/224 [00:35<01:14,  2.05it/s]
Epoch 22 Iter 72: loss 0.24668. :  32%|█████████████▉                              | 71/224 [00:35<01:14,  2.05it/s]
Epoch 22 Iter 72: loss 0.24668. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 22 Iter 73: loss 0.22512. :  32%|██████████████▏                             | 72/224 [00:36<01:13,  2.06it/s]
Epoch 22 Iter 73: loss 0.22512. :  33%|██████████████▎                             | 73/224 [00:36<01:13,  2.06it/s]
Epoch 22 Iter 74: loss 0.25394. :  33%|██████████████▎                             | 73/224 [00:36<01:13,  2.06it/s]
Epoch 22 Iter 74: loss 0.25394. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 22 Iter 75: loss 0.22642. :  33%|██████████████▌                             | 74/224 [00:37<01:12,  2.07it/s]
Epoch 22 Iter 75: loss 0.22642. :  33%|██████████████▋                             | 75/224 [00:37<01:12,  2.06it/s]
Epoch 22 Iter 76: loss 0.24251. :  33%|██████████████▋                             | 75/224 [00:37<01:12,  2.06it/s]
Epoch 22 Iter 76: loss 0.24251. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 22 Iter 77: loss 0.24074. :  34%|██████████████▉                             | 76/224 [00:38<01:11,  2.07it/s]
Epoch 22 Iter 77: loss 0.24074. :  34%|███████████████▏                            | 77/224 [00:38<01:11,  2.06it/s]
Epoch 22 Iter 78: loss 0.24203. :  34%|███████████████▏                            | 77/224 [00:38<01:11,  2.06it/s]
Epoch 22 Iter 78: loss 0.24203. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 22 Iter 79: loss 0.23249. :  35%|███████████████▎                            | 78/224 [00:39<01:10,  2.06it/s]
Epoch 22 Iter 79: loss 0.23249. :  35%|███████████████▌                            | 79/224 [00:39<01:10,  2.06it/s]
Epoch 22 Iter 80: loss 0.23149. :  35%|███████████████▌                            | 79/224 [00:39<01:10,  2.06it/s]
Epoch 22 Iter 80: loss 0.23149. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.06it/s]
Epoch 22 Iter 81: loss 0.23476. :  36%|███████████████▋                            | 80/224 [00:40<01:10,  2.06it/s]
Epoch 22 Iter 81: loss 0.23476. :  36%|███████████████▉                            | 81/224 [00:40<01:09,  2.05it/s]
Epoch 22 Iter 82: loss 0.24968. :  36%|███████████████▉                            | 81/224 [00:40<01:09,  2.05it/s]
Epoch 22 Iter 82: loss 0.24968. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 22 Iter 83: loss 0.25442. :  37%|████████████████                            | 82/224 [00:41<01:08,  2.06it/s]
Epoch 22 Iter 83: loss 0.25442. :  37%|████████████████▎                           | 83/224 [00:41<01:08,  2.06it/s]
Epoch 22 Iter 84: loss 0.23725. :  37%|████████████████▎                           | 83/224 [00:41<01:08,  2.06it/s]
Epoch 22 Iter 84: loss 0.23725. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 22 Iter 85: loss 0.23589. :  38%|████████████████▌                           | 84/224 [00:42<01:07,  2.06it/s]
Epoch 22 Iter 85: loss 0.23589. :  38%|████████████████▋                           | 85/224 [00:42<01:07,  2.06it/s]
Epoch 22 Iter 86: loss 0.21953. :  38%|████████████████▋                           | 85/224 [00:42<01:07,  2.06it/s]
Epoch 22 Iter 86: loss 0.21953. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 22 Iter 87: loss 0.21866. :  38%|████████████████▉                           | 86/224 [00:43<01:07,  2.06it/s]
Epoch 22 Iter 87: loss 0.21866. :  39%|█████████████████                           | 87/224 [00:43<01:06,  2.05it/s]
Epoch 22 Iter 88: loss 0.24105. :  39%|█████████████████                           | 87/224 [00:43<01:06,  2.05it/s]
Epoch 22 Iter 88: loss 0.24105. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.06it/s]
Epoch 22 Iter 89: loss 0.23123. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.06it/s]
Epoch 22 Iter 89: loss 0.23123. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 22 Iter 90: loss 0.22706. :  40%|█████████████████▍                          | 89/224 [00:44<01:05,  2.06it/s]
Epoch 22 Iter 90: loss 0.22706. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 91: loss 0.21122. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 91: loss 0.21122. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 92: loss 0.22454. :  41%|█████████████████▉                          | 91/224 [00:45<01:04,  2.07it/s]
Epoch 22 Iter 92: loss 0.22454. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 22 Iter 93: loss 0.23835. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 22 Iter 93: loss 0.23835. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 22 Iter 94: loss 0.22607. :  42%|██████████████████▎                         | 93/224 [00:46<01:03,  2.07it/s]
Epoch 22 Iter 94: loss 0.22607. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.07it/s]
Epoch 22 Iter 95: loss 0.24330. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.07it/s]
Epoch 22 Iter 95: loss 0.24330. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 22 Iter 96: loss 0.24790. :  42%|██████████████████▋                         | 95/224 [00:47<01:02,  2.07it/s]
Epoch 22 Iter 96: loss 0.24790. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 22 Iter 97: loss 0.23195. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 22 Iter 97: loss 0.23195. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 22 Iter 98: loss 0.25106. :  43%|███████████████████                         | 97/224 [00:48<01:01,  2.07it/s]
Epoch 22 Iter 98: loss 0.25106. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 22 Iter 99: loss 0.25257. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 22 Iter 99: loss 0.25257. :  44%|███████████████████▍                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 22 Iter 100: loss 0.24570. :  44%|███████████████████                        | 99/224 [00:49<00:59,  2.09it/s]
Epoch 22 Iter 100: loss 0.24570. :  45%|██████████████████▊                       | 100/224 [00:49<00:59,  2.09it/s]
Epoch 22 Iter 101: loss 0.24212. :  45%|██████████████████▊                       | 100/224 [00:49<00:59,  2.09it/s]
Epoch 22 Iter 101: loss 0.24212. :  45%|██████████████████▉                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 22 Iter 102: loss 0.21370. :  45%|██████████████████▉                       | 101/224 [00:50<00:58,  2.09it/s]
Epoch 22 Iter 102: loss 0.21370. :  46%|███████████████████▏                      | 102/224 [00:50<00:58,  2.08it/s]
Epoch 22 Iter 103: loss 0.23245. :  46%|███████████████████▏                      | 102/224 [00:50<00:58,  2.08it/s]
Epoch 22 Iter 103: loss 0.23245. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 22 Iter 104: loss 0.24308. :  46%|███████████████████▎                      | 103/224 [00:51<00:58,  2.07it/s]
Epoch 22 Iter 104: loss 0.24308. :  46%|███████████████████▌                      | 104/224 [00:51<00:57,  2.07it/s]
Epoch 22 Iter 105: loss 0.23660. :  46%|███████████████████▌                      | 104/224 [00:51<00:57,  2.07it/s]
Epoch 22 Iter 105: loss 0.23660. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 22 Iter 106: loss 0.21959. :  47%|███████████████████▋                      | 105/224 [00:52<00:57,  2.07it/s]
Epoch 22 Iter 106: loss 0.21959. :  47%|███████████████████▉                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 22 Iter 107: loss 0.22441. :  47%|███████████████████▉                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 22 Iter 107: loss 0.22441. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 22 Iter 108: loss 0.22107. :  48%|████████████████████                      | 107/224 [00:53<00:56,  2.07it/s]
Epoch 22 Iter 108: loss 0.22107. :  48%|████████████████████▎                     | 108/224 [00:53<00:56,  2.06it/s]
Epoch 22 Iter 109: loss 0.24788. :  48%|████████████████████▎                     | 108/224 [00:53<00:56,  2.06it/s]
Epoch 22 Iter 109: loss 0.24788. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 22 Iter 110: loss 0.22731. :  49%|████████████████████▍                     | 109/224 [00:54<00:55,  2.07it/s]
Epoch 22 Iter 110: loss 0.22731. :  49%|████████████████████▋                     | 110/224 [00:54<00:55,  2.06it/s]
Epoch 22 Iter 111: loss 0.21209. :  49%|████████████████████▋                     | 110/224 [00:54<00:55,  2.06it/s]
Epoch 22 Iter 111: loss 0.21209. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 22 Iter 112: loss 0.23603. :  50%|████████████████████▊                     | 111/224 [00:55<00:54,  2.06it/s]
Epoch 22 Iter 112: loss 0.23603. :  50%|█████████████████████                     | 112/224 [00:55<00:53,  2.08it/s]
Epoch 22 Iter 113: loss 0.22092. :  50%|█████████████████████                     | 112/224 [00:55<00:53,  2.08it/s]
Epoch 22 Iter 113: loss 0.22092. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 22 Iter 114: loss 0.24136. :  50%|█████████████████████▏                    | 113/224 [00:56<00:53,  2.07it/s]
Epoch 22 Iter 114: loss 0.24136. :  51%|█████████████████████▍                    | 114/224 [00:56<00:53,  2.07it/s]
Epoch 22 Iter 115: loss 0.25740. :  51%|█████████████████████▍                    | 114/224 [00:56<00:53,  2.07it/s]
Epoch 22 Iter 115: loss 0.25740. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 22 Iter 116: loss 0.23759. :  51%|█████████████████████▌                    | 115/224 [00:57<00:52,  2.06it/s]
Epoch 22 Iter 116: loss 0.23759. :  52%|█████████████████████▊                    | 116/224 [00:57<00:52,  2.07it/s]
Epoch 22 Iter 117: loss 0.24434. :  52%|█████████████████████▊                    | 116/224 [00:57<00:52,  2.07it/s]
Epoch 22 Iter 117: loss 0.24434. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 22 Iter 118: loss 0.24204. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 22 Iter 118: loss 0.24204. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 22 Iter 119: loss 0.22559. :  53%|██████████████████████▏                   | 118/224 [00:58<00:51,  2.07it/s]
Epoch 22 Iter 119: loss 0.22559. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 120: loss 0.22762. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 120: loss 0.22762. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 121: loss 0.23663. :  54%|██████████████████████▌                   | 120/224 [00:59<00:50,  2.08it/s]
Epoch 22 Iter 121: loss 0.23663. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 22 Iter 122: loss 0.24274. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 22 Iter 122: loss 0.24274. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.22233. :  54%|██████████████████████▊                   | 122/224 [01:00<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.22233. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 22 Iter 124: loss 0.23780. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 22 Iter 124: loss 0.23780. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.23682. :  55%|███████████████████████▎                  | 124/224 [01:01<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.23682. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.09it/s]
Epoch 22 Iter 126: loss 0.22157. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.09it/s]
Epoch 22 Iter 126: loss 0.22157. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.10it/s]
Epoch 22 Iter 127: loss 0.26745. :  56%|███████████████████████▋                  | 126/224 [01:02<00:46,  2.10it/s]
Epoch 22 Iter 127: loss 0.26745. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.10it/s]
Epoch 22 Iter 128: loss 0.24498. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.10it/s]
Epoch 22 Iter 128: loss 0.24498. :  57%|████████████████████████                  | 128/224 [01:02<00:45,  2.10it/s]
Epoch 22 Iter 129: loss 0.22126. :  57%|████████████████████████                  | 128/224 [01:03<00:45,  2.10it/s]
Epoch 22 Iter 129: loss 0.22126. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.09it/s]
Epoch 22 Iter 130: loss 0.22956. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.09it/s]
Epoch 22 Iter 130: loss 0.22956. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.09it/s]
Epoch 22 Iter 131: loss 0.22908. :  58%|████████████████████████▍                 | 130/224 [01:04<00:45,  2.09it/s]
Epoch 22 Iter 131: loss 0.22908. :  58%|████████████████████████▌                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 22 Iter 132: loss 0.21814. :  58%|████████████████████████▌                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 22 Iter 132: loss 0.21814. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 22 Iter 133: loss 0.26163. :  59%|████████████████████████▊                 | 132/224 [01:05<00:44,  2.07it/s]
Epoch 22 Iter 133: loss 0.26163. :  59%|████████████████████████▉                 | 133/224 [01:05<00:43,  2.07it/s]
Epoch 22 Iter 134: loss 0.23553. :  59%|████████████████████████▉                 | 133/224 [01:05<00:43,  2.07it/s]
Epoch 22 Iter 134: loss 0.23553. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 22 Iter 135: loss 0.25537. :  60%|█████████████████████████▏                | 134/224 [01:06<00:43,  2.07it/s]
Epoch 22 Iter 135: loss 0.25537. :  60%|█████████████████████████▎                | 135/224 [01:06<00:42,  2.08it/s]
Epoch 22 Iter 136: loss 0.21536. :  60%|█████████████████████████▎                | 135/224 [01:06<00:42,  2.08it/s]
Epoch 22 Iter 136: loss 0.21536. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 22 Iter 137: loss 0.23693. :  61%|█████████████████████████▍                | 136/224 [01:07<00:42,  2.07it/s]
Epoch 22 Iter 137: loss 0.23693. :  61%|█████████████████████████▋                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 22 Iter 138: loss 0.22006. :  61%|█████████████████████████▋                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 22 Iter 138: loss 0.22006. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 22 Iter 139: loss 0.23091. :  62%|█████████████████████████▉                | 138/224 [01:08<00:41,  2.06it/s]
Epoch 22 Iter 139: loss 0.23091. :  62%|██████████████████████████                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 22 Iter 140: loss 0.23478. :  62%|██████████████████████████                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 22 Iter 140: loss 0.23478. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 22 Iter 141: loss 0.23798. :  62%|██████████████████████████▎               | 140/224 [01:09<00:40,  2.07it/s]
Epoch 22 Iter 141: loss 0.23798. :  63%|██████████████████████████▍               | 141/224 [01:09<00:40,  2.07it/s]
Epoch 22 Iter 142: loss 0.22393. :  63%|██████████████████████████▍               | 141/224 [01:09<00:40,  2.07it/s]
Epoch 22 Iter 142: loss 0.22393. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 22 Iter 143: loss 0.22557. :  63%|██████████████████████████▋               | 142/224 [01:10<00:39,  2.07it/s]
Epoch 22 Iter 143: loss 0.22557. :  64%|██████████████████████████▊               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 22 Iter 144: loss 0.23508. :  64%|██████████████████████████▊               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 22 Iter 144: loss 0.23508. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 22 Iter 145: loss 0.24378. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 22 Iter 145: loss 0.24378. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 22 Iter 146: loss 0.23526. :  65%|███████████████████████████▏              | 145/224 [01:11<00:38,  2.07it/s]
Epoch 22 Iter 146: loss 0.23526. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 22 Iter 147: loss 0.21960. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 22 Iter 147: loss 0.21960. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 22 Iter 148: loss 0.22642. :  66%|███████████████████████████▌              | 147/224 [01:12<00:37,  2.06it/s]
Epoch 22 Iter 148: loss 0.22642. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 22 Iter 149: loss 0.26937. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 22 Iter 149: loss 0.26937. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 22 Iter 150: loss 0.25802. :  67%|███████████████████████████▉              | 149/224 [01:13<00:36,  2.06it/s]
Epoch 22 Iter 150: loss 0.25802. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 22 Iter 151: loss 0.22877. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 22 Iter 151: loss 0.22877. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 22 Iter 152: loss 0.22929. :  67%|████████████████████████████▎             | 151/224 [01:14<00:35,  2.06it/s]
Epoch 22 Iter 152: loss 0.22929. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 22 Iter 153: loss 0.23204. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 22 Iter 153: loss 0.23204. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 22 Iter 154: loss 0.23076. :  68%|████████████████████████████▋             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 22 Iter 154: loss 0.23076. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.23603. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.23603. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 22 Iter 156: loss 0.22844. :  69%|█████████████████████████████             | 155/224 [01:16<00:33,  2.05it/s]
Epoch 22 Iter 156: loss 0.22844. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.05it/s]
Epoch 22 Iter 157: loss 0.21250. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.05it/s]
Epoch 22 Iter 157: loss 0.21250. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 22 Iter 158: loss 0.23308. :  70%|█████████████████████████████▍            | 157/224 [01:17<00:32,  2.06it/s]
Epoch 22 Iter 158: loss 0.23308. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.23689. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.23689. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.21478. :  71%|█████████████████████████████▊            | 159/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.21478. :  71%|██████████████████████████████            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.23295. :  71%|██████████████████████████████            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.23295. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.22304. :  72%|██████████████████████████████▏           | 161/224 [01:19<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.22304. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:30,  2.07it/s]
Epoch 22 Iter 163: loss 0.22462. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:30,  2.07it/s]
Epoch 22 Iter 163: loss 0.22462. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 22 Iter 164: loss 0.21018. :  73%|██████████████████████████████▌           | 163/224 [01:20<00:29,  2.05it/s]
Epoch 22 Iter 164: loss 0.21018. :  73%|██████████████████████████████▋           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 22 Iter 165: loss 0.25231. :  73%|██████████████████████████████▋           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 22 Iter 165: loss 0.25231. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 22 Iter 166: loss 0.23395. :  74%|██████████████████████████████▉           | 165/224 [01:21<00:28,  2.06it/s]
Epoch 22 Iter 166: loss 0.23395. :  74%|███████████████████████████████▏          | 166/224 [01:21<00:28,  2.06it/s]
Epoch 22 Iter 167: loss 0.23055. :  74%|███████████████████████████████▏          | 166/224 [01:21<00:28,  2.06it/s]
Epoch 22 Iter 167: loss 0.23055. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.05it/s]
Epoch 22 Iter 168: loss 0.23868. :  75%|███████████████████████████████▎          | 167/224 [01:22<00:27,  2.05it/s]
Epoch 22 Iter 168: loss 0.23868. :  75%|███████████████████████████████▌          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 22 Iter 169: loss 0.24722. :  75%|███████████████████████████████▌          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 22 Iter 169: loss 0.24722. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 22 Iter 170: loss 0.25252. :  75%|███████████████████████████████▋          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 22 Iter 170: loss 0.25252. :  76%|███████████████████████████████▉          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 22 Iter 171: loss 0.24014. :  76%|███████████████████████████████▉          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 22 Iter 171: loss 0.24014. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 22 Iter 172: loss 0.20854. :  76%|████████████████████████████████          | 171/224 [01:24<00:25,  2.05it/s]
Epoch 22 Iter 172: loss 0.20854. :  77%|████████████████████████████████▎         | 172/224 [01:24<00:25,  2.07it/s]
Epoch 22 Iter 173: loss 0.23389. :  77%|████████████████████████████████▎         | 172/224 [01:24<00:25,  2.07it/s]
Epoch 22 Iter 173: loss 0.23389. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.11it/s]
Epoch 22 Iter 174: loss 0.22471. :  77%|████████████████████████████████▍         | 173/224 [01:25<00:24,  2.11it/s]
Epoch 22 Iter 174: loss 0.22471. :  78%|████████████████████████████████▋         | 174/224 [01:25<00:23,  2.12it/s]
Epoch 22 Iter 175: loss 0.23669. :  78%|████████████████████████████████▋         | 174/224 [01:25<00:23,  2.12it/s]
Epoch 22 Iter 175: loss 0.23669. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:22,  2.13it/s]
Epoch 22 Iter 176: loss 0.24325. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:22,  2.13it/s]
Epoch 22 Iter 176: loss 0.24325. :  79%|█████████████████████████████████         | 176/224 [01:25<00:22,  2.11it/s]
Epoch 22 Iter 177: loss 0.23135. :  79%|█████████████████████████████████         | 176/224 [01:26<00:22,  2.11it/s]
Epoch 22 Iter 177: loss 0.23135. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.12it/s]
Epoch 22 Iter 178: loss 0.24524. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.12it/s]
Epoch 22 Iter 178: loss 0.24524. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:21,  2.11it/s]
Epoch 22 Iter 179: loss 0.24524. :  79%|█████████████████████████████████▍        | 178/224 [01:27<00:21,  2.11it/s]
Epoch 22 Iter 179: loss 0.24524. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.10it/s]
Epoch 22 Iter 180: loss 0.24376. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.10it/s]
Epoch 22 Iter 180: loss 0.24376. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 22 Iter 181: loss 0.22028. :  80%|█████████████████████████████████▊        | 180/224 [01:28<00:21,  2.08it/s]
Epoch 22 Iter 181: loss 0.22028. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 22 Iter 182: loss 0.23997. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 22 Iter 182: loss 0.23997. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 22 Iter 183: loss 0.23748. :  81%|██████████████████████████████████▏       | 182/224 [01:29<00:20,  2.07it/s]
Epoch 22 Iter 183: loss 0.23748. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 22 Iter 184: loss 0.22450. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 22 Iter 184: loss 0.22450. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 22 Iter 185: loss 0.21957. :  82%|██████████████████████████████████▌       | 184/224 [01:30<00:19,  2.07it/s]
Epoch 22 Iter 185: loss 0.21957. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 186: loss 0.22326. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 186: loss 0.22326. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 187: loss 0.24379. :  83%|██████████████████████████████████▉       | 186/224 [01:31<00:18,  2.06it/s]
Epoch 22 Iter 187: loss 0.24379. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 22 Iter 188: loss 0.21100. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 22 Iter 188: loss 0.21100. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 22 Iter 189: loss 0.24818. :  84%|███████████████████████████████████▎      | 188/224 [01:32<00:17,  2.07it/s]
Epoch 22 Iter 189: loss 0.24818. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 22 Iter 190: loss 0.23710. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 22 Iter 190: loss 0.23710. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 22 Iter 191: loss 0.24375. :  85%|███████████████████████████████████▋      | 190/224 [01:33<00:16,  2.08it/s]
Epoch 22 Iter 191: loss 0.24375. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.08it/s]
Epoch 22 Iter 192: loss 0.23782. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.08it/s]
Epoch 22 Iter 192: loss 0.23782. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 22 Iter 193: loss 0.22905. :  86%|████████████████████████████████████      | 192/224 [01:34<00:15,  2.08it/s]
Epoch 22 Iter 193: loss 0.22905. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:14,  2.07it/s]
Epoch 22 Iter 194: loss 0.22172. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:14,  2.07it/s]
Epoch 22 Iter 194: loss 0.22172. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 22 Iter 195: loss 0.20877. :  87%|████████████████████████████████████▍     | 194/224 [01:35<00:14,  2.08it/s]
Epoch 22 Iter 195: loss 0.20877. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:13,  2.09it/s]
Epoch 22 Iter 196: loss 0.23744. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:13,  2.09it/s]
Epoch 22 Iter 196: loss 0.23744. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 22 Iter 197: loss 0.23910. :  88%|████████████████████████████████████▊     | 196/224 [01:36<00:13,  2.08it/s]
Epoch 22 Iter 197: loss 0.23910. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 22 Iter 198: loss 0.22914. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 22 Iter 198: loss 0.22914. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 22 Iter 199: loss 0.25680. :  88%|█████████████████████████████████████▏    | 198/224 [01:37<00:12,  2.07it/s]
Epoch 22 Iter 199: loss 0.25680. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.07it/s]
Epoch 22 Iter 200: loss 0.22139. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.07it/s]
Epoch 22 Iter 200: loss 0.22139. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 22 Iter 201: loss 0.25261. :  89%|█████████████████████████████████████▌    | 200/224 [01:38<00:11,  2.07it/s]
Epoch 22 Iter 201: loss 0.25261. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.07it/s]
Epoch 22 Iter 202: loss 0.22610. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.07it/s]
Epoch 22 Iter 202: loss 0.22610. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 22 Iter 203: loss 0.24654. :  90%|█████████████████████████████████████▉    | 202/224 [01:39<00:10,  2.06it/s]
Epoch 22 Iter 203: loss 0.24654. :  91%|██████████████████████████████████████    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 22 Iter 204: loss 0.20534. :  91%|██████████████████████████████████████    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 22 Iter 204: loss 0.20534. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 205: loss 0.22554. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 205: loss 0.22554. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 206: loss 0.24175. :  92%|██████████████████████████████████████▍   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 22 Iter 206: loss 0.24175. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 207: loss 0.22207. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 207: loss 0.22207. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 208: loss 0.26176. :  92%|██████████████████████████████████████▊   | 207/224 [01:41<00:08,  2.07it/s]
Epoch 22 Iter 208: loss 0.26176. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 22 Iter 209: loss 0.22514. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 22 Iter 209: loss 0.22514. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 22 Iter 210: loss 0.21895. :  93%|███████████████████████████████████████▏  | 209/224 [01:42<00:07,  2.07it/s]
Epoch 22 Iter 210: loss 0.21895. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 22 Iter 211: loss 0.23015. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 22 Iter 211: loss 0.23015. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 22 Iter 212: loss 0.21943. :  94%|███████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.05it/s]
Epoch 22 Iter 212: loss 0.21943. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 22 Iter 213: loss 0.23810. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 22 Iter 213: loss 0.23810. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 22 Iter 214: loss 0.23359. :  95%|███████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.05it/s]
Epoch 22 Iter 214: loss 0.23359. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 22 Iter 215: loss 0.24295. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 22 Iter 215: loss 0.24295. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 22 Iter 216: loss 0.22810. :  96%|████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 22 Iter 216: loss 0.22810. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 22 Iter 217: loss 0.23531. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 22 Iter 217: loss 0.23531. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 22 Iter 218: loss 0.23835. :  97%|████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 22 Iter 218: loss 0.23835. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 22 Iter 219: loss 0.22469. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 22 Iter 219: loss 0.22469. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 22 Iter 220: loss 0.22042. :  98%|█████████████████████████████████████████ | 219/224 [01:47<00:02,  2.06it/s]
Epoch 22 Iter 220: loss 0.22042. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.07it/s]
Epoch 22 Iter 221: loss 0.23504. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.07it/s]
Epoch 22 Iter 221: loss 0.23504. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 22 Iter 222: loss 0.25183. :  99%|█████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.07it/s]
Epoch 22 Iter 222: loss 0.25183. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 22 Iter 223: loss 0.23831. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 22 Iter 223: loss 0.23831. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 22 Iter 224: loss 0.24077. : 100%|█████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.05it/s]
Epoch 22 Iter 224: loss 0.24077. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]
Epoch 22 Iter 224: loss 0.24077. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.22062. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.22062. :   0%|▏                                             | 1/224 [00:00<01:45,  2.11it/s]
Epoch 23 Iter 2: loss 0.22692. :   0%|▏                                             | 1/224 [00:00<01:45,  2.11it/s]
Epoch 23 Iter 2: loss 0.22692. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 23 Iter 3: loss 0.25106. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 23 Iter 3: loss 0.25106. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.24490. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.24490. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 5: loss 0.24262. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 23 Iter 5: loss 0.24262. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.22953. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.22953. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 7: loss 0.22194. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 23 Iter 7: loss 0.22194. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 23 Iter 8: loss 0.24996. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 23 Iter 8: loss 0.24996. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.22566. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.22566. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.23194. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.23194. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 23 Iter 11: loss 0.23488. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 23 Iter 11: loss 0.23488. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 23 Iter 12: loss 0.23841. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 23 Iter 12: loss 0.23841. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 23 Iter 13: loss 0.22365. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 23 Iter 13: loss 0.22365. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 14: loss 0.21726. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 14: loss 0.21726. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 23 Iter 15: loss 0.25201. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 23 Iter 15: loss 0.25201. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 23 Iter 16: loss 0.27370. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 23 Iter 16: loss 0.27370. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 23 Iter 17: loss 0.24017. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 23 Iter 17: loss 0.24017. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.22600. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.22600. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 19: loss 0.22570. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.06it/s]
Epoch 23 Iter 19: loss 0.22570. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.22370. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.22370. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 21: loss 0.24096. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 23 Iter 21: loss 0.24096. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.07it/s]
Epoch 23 Iter 22: loss 0.21480. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.07it/s]
Epoch 23 Iter 22: loss 0.21480. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.08it/s]
Epoch 23 Iter 23: loss 0.24109. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.08it/s]
Epoch 23 Iter 23: loss 0.24109. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 24: loss 0.24573. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 24: loss 0.24573. :  11%|████▋                                       | 24/224 [00:11<01:35,  2.09it/s]
Epoch 23 Iter 25: loss 0.21566. :  11%|████▋                                       | 24/224 [00:12<01:35,  2.09it/s]
Epoch 23 Iter 25: loss 0.21566. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 26: loss 0.23365. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 26: loss 0.23365. :  12%|█████                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 27: loss 0.22731. :  12%|█████                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 23 Iter 27: loss 0.22731. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.24123. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.24123. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.08it/s]
Epoch 23 Iter 29: loss 0.23138. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.08it/s]
Epoch 23 Iter 29: loss 0.23138. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.07it/s]
Epoch 23 Iter 30: loss 0.23852. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.07it/s]
Epoch 23 Iter 30: loss 0.23852. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.22299. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.22299. :  14%|██████                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.25095. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.25095. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.22436. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.22436. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.06it/s]
Epoch 23 Iter 34: loss 0.20881. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 23 Iter 34: loss 0.20881. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 23 Iter 35: loss 0.22963. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 23 Iter 35: loss 0.22963. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 23 Iter 36: loss 0.24710. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 23 Iter 36: loss 0.24710. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.22628. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.22628. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 38: loss 0.24516. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 23 Iter 38: loss 0.24516. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 23 Iter 39: loss 0.23249. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 23 Iter 39: loss 0.23249. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.07it/s]
Epoch 23 Iter 40: loss 0.22636. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.07it/s]
Epoch 23 Iter 40: loss 0.22636. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.07it/s]
Epoch 23 Iter 41: loss 0.23701. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.07it/s]
Epoch 23 Iter 41: loss 0.23701. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 23 Iter 42: loss 0.25138. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 23 Iter 42: loss 0.25138. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.23103. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.23103. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 23 Iter 44: loss 0.22270. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 44: loss 0.22270. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.23674. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.23674. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.24386. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.24386. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 23 Iter 47: loss 0.24099. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 23 Iter 47: loss 0.24099. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.24164. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.24164. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.23285. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.23285. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 23 Iter 50: loss 0.23654. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 50: loss 0.23654. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 51: loss 0.23763. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 51: loss 0.23763. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 23 Iter 52: loss 0.22397. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 23 Iter 52: loss 0.22397. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.25352. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.25352. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.06it/s]
Epoch 23 Iter 54: loss 0.24908. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.06it/s]
Epoch 23 Iter 54: loss 0.24908. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 23 Iter 55: loss 0.22739. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 23 Iter 55: loss 0.22739. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.06it/s]
Epoch 23 Iter 56: loss 0.24351. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.06it/s]
Epoch 23 Iter 56: loss 0.24351. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 23 Iter 57: loss 0.22903. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 23 Iter 57: loss 0.22903. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.08it/s]
Epoch 23 Iter 58: loss 0.25317. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.08it/s]
Epoch 23 Iter 58: loss 0.25317. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 23 Iter 59: loss 0.23547. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 23 Iter 59: loss 0.23547. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.06it/s]
Epoch 23 Iter 60: loss 0.22165. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.06it/s]
Epoch 23 Iter 60: loss 0.22165. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 23 Iter 61: loss 0.22792. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 23 Iter 61: loss 0.22792. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 23 Iter 62: loss 0.23377. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 23 Iter 62: loss 0.23377. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.08it/s]
Epoch 23 Iter 63: loss 0.24311. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.08it/s]
Epoch 23 Iter 63: loss 0.24311. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 23 Iter 64: loss 0.25006. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 23 Iter 64: loss 0.25006. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 23 Iter 65: loss 0.24338. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 23 Iter 65: loss 0.24338. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 23 Iter 66: loss 0.24445. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 23 Iter 66: loss 0.24445. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 23 Iter 67: loss 0.22954. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 23 Iter 67: loss 0.22954. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 23 Iter 68: loss 0.24591. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 23 Iter 68: loss 0.24591. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 23 Iter 69: loss 0.24014. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 23 Iter 69: loss 0.24014. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 23 Iter 70: loss 0.23170. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 23 Iter 70: loss 0.23170. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 23 Iter 71: loss 0.23014. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 23 Iter 71: loss 0.23014. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 23 Iter 72: loss 0.22422. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 23 Iter 72: loss 0.22422. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 23 Iter 73: loss 0.24941. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 23 Iter 73: loss 0.24941. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 23 Iter 74: loss 0.22469. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 23 Iter 74: loss 0.22469. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 23 Iter 75: loss 0.23816. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 23 Iter 75: loss 0.23816. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 23 Iter 76: loss 0.22701. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 23 Iter 76: loss 0.22701. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 23 Iter 77: loss 0.22772. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 23 Iter 77: loss 0.22772. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 23 Iter 78: loss 0.23961. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 23 Iter 78: loss 0.23961. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 23 Iter 79: loss 0.24022. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 23 Iter 79: loss 0.24022. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 23 Iter 80: loss 0.24578. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 23 Iter 80: loss 0.24578. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 23 Iter 81: loss 0.23737. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 23 Iter 81: loss 0.23737. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 23 Iter 82: loss 0.23976. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 23 Iter 82: loss 0.23976. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 23 Iter 83: loss 0.23366. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 23 Iter 83: loss 0.23366. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 23 Iter 84: loss 0.22990. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 23 Iter 84: loss 0.22990. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.08it/s]
Epoch 23 Iter 85: loss 0.22711. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.08it/s]
Epoch 23 Iter 85: loss 0.22711. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.10it/s]
Epoch 23 Iter 86: loss 0.23003. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.10it/s]
Epoch 23 Iter 86: loss 0.23003. :  38%|████████████████▉                           | 86/224 [00:41<01:05,  2.10it/s]
Epoch 23 Iter 87: loss 0.21621. :  38%|████████████████▉                           | 86/224 [00:42<01:05,  2.10it/s]
Epoch 23 Iter 87: loss 0.21621. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 23 Iter 88: loss 0.23015. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 23 Iter 88: loss 0.23015. :  39%|█████████████████▎                          | 88/224 [00:42<01:04,  2.10it/s]
Epoch 23 Iter 89: loss 0.23290. :  39%|█████████████████▎                          | 88/224 [00:43<01:04,  2.10it/s]
Epoch 23 Iter 89: loss 0.23290. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.09it/s]
Epoch 23 Iter 90: loss 0.21317. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.09it/s]
Epoch 23 Iter 90: loss 0.21317. :  40%|█████████████████▋                          | 90/224 [00:43<01:03,  2.10it/s]
Epoch 23 Iter 91: loss 0.25667. :  40%|█████████████████▋                          | 90/224 [00:43<01:03,  2.10it/s]
Epoch 23 Iter 91: loss 0.25667. :  41%|█████████████████▉                          | 91/224 [00:43<01:03,  2.09it/s]
Epoch 23 Iter 92: loss 0.23519. :  41%|█████████████████▉                          | 91/224 [00:44<01:03,  2.09it/s]
Epoch 23 Iter 92: loss 0.23519. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 23 Iter 93: loss 0.23252. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 23 Iter 93: loss 0.23252. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 23 Iter 94: loss 0.23503. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 23 Iter 94: loss 0.23503. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 23 Iter 95: loss 0.24280. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 23 Iter 95: loss 0.24280. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.07it/s]
Epoch 23 Iter 96: loss 0.22545. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 23 Iter 96: loss 0.22545. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 23 Iter 97: loss 0.23007. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 23 Iter 97: loss 0.23007. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.07it/s]
Epoch 23 Iter 98: loss 0.22712. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 23 Iter 98: loss 0.22712. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 23 Iter 99: loss 0.22696. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 23 Iter 99: loss 0.22696. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 23 Iter 100: loss 0.22944. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 23 Iter 100: loss 0.22944. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 23 Iter 101: loss 0.24215. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 23 Iter 101: loss 0.24215. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 23 Iter 102: loss 0.21804. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 23 Iter 102: loss 0.21804. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 23 Iter 103: loss 0.22680. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 23 Iter 103: loss 0.22680. :  46%|███████████████████▎                      | 103/224 [00:49<00:59,  2.05it/s]
Epoch 23 Iter 104: loss 0.25127. :  46%|███████████████████▎                      | 103/224 [00:50<00:59,  2.05it/s]
Epoch 23 Iter 104: loss 0.25127. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 23 Iter 105: loss 0.22200. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 23 Iter 105: loss 0.22200. :  47%|███████████████████▋                      | 105/224 [00:50<00:58,  2.04it/s]
Epoch 23 Iter 106: loss 0.24447. :  47%|███████████████████▋                      | 105/224 [00:51<00:58,  2.04it/s]
Epoch 23 Iter 106: loss 0.24447. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 23 Iter 107: loss 0.22950. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 23 Iter 107: loss 0.22950. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.05it/s]
Epoch 23 Iter 108: loss 0.23077. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.05it/s]
Epoch 23 Iter 108: loss 0.23077. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 23 Iter 109: loss 0.23445. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 23 Iter 109: loss 0.23445. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 23 Iter 110: loss 0.23697. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 23 Iter 110: loss 0.23697. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 23 Iter 111: loss 0.22835. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 23 Iter 111: loss 0.22835. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 23 Iter 112: loss 0.21247. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 23 Iter 112: loss 0.21247. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 23 Iter 113: loss 0.23342. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 23 Iter 113: loss 0.23342. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 23 Iter 114: loss 0.22025. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 23 Iter 114: loss 0.22025. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 23 Iter 115: loss 0.22401. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 23 Iter 115: loss 0.22401. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.24122. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.24122. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 117: loss 0.24663. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 117: loss 0.24663. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 118: loss 0.23305. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 23 Iter 118: loss 0.23305. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 23 Iter 119: loss 0.24579. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 23 Iter 119: loss 0.24579. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 23 Iter 120: loss 0.22765. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 23 Iter 120: loss 0.22765. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 23 Iter 121: loss 0.25128. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 23 Iter 121: loss 0.25128. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 23 Iter 122: loss 0.23018. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 23 Iter 122: loss 0.23018. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 23 Iter 123: loss 0.22745. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 23 Iter 123: loss 0.22745. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 23 Iter 124: loss 0.21354. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 23 Iter 124: loss 0.21354. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 23 Iter 125: loss 0.24187. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 23 Iter 125: loss 0.24187. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 23 Iter 126: loss 0.23949. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 23 Iter 126: loss 0.23949. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.22027. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.22027. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 23 Iter 128: loss 0.22586. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 23 Iter 128: loss 0.22586. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.22351. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.22351. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.22090. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.22090. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.05it/s]
Epoch 23 Iter 131: loss 0.23811. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 23 Iter 131: loss 0.23811. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 23 Iter 132: loss 0.23032. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 23 Iter 132: loss 0.23032. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 23 Iter 133: loss 0.21204. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 23 Iter 133: loss 0.21204. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 23 Iter 134: loss 0.23644. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 23 Iter 134: loss 0.23644. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 23 Iter 135: loss 0.20611. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 23 Iter 135: loss 0.20611. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 23 Iter 136: loss 0.22908. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 23 Iter 136: loss 0.22908. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 23 Iter 137: loss 0.22980. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 23 Iter 137: loss 0.22980. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 23 Iter 138: loss 0.22357. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 23 Iter 138: loss 0.22357. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 23 Iter 139: loss 0.22640. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 23 Iter 139: loss 0.22640. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 23 Iter 140: loss 0.23048. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 23 Iter 140: loss 0.23048. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 23 Iter 141: loss 0.22648. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 23 Iter 141: loss 0.22648. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 23 Iter 142: loss 0.23429. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 23 Iter 142: loss 0.23429. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 23 Iter 143: loss 0.26196. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 23 Iter 143: loss 0.26196. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 23 Iter 144: loss 0.22396. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 23 Iter 144: loss 0.22396. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 23 Iter 145: loss 0.23452. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 23 Iter 145: loss 0.23452. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 23 Iter 146: loss 0.23697. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 23 Iter 146: loss 0.23697. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 23 Iter 147: loss 0.22058. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 23 Iter 147: loss 0.22058. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 23 Iter 148: loss 0.22020. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 23 Iter 148: loss 0.22020. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 23 Iter 149: loss 0.23947. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 23 Iter 149: loss 0.23947. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.03it/s]
Epoch 23 Iter 150: loss 0.25397. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.03it/s]
Epoch 23 Iter 150: loss 0.25397. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.04it/s]
Epoch 23 Iter 151: loss 0.23994. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 23 Iter 151: loss 0.23994. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.04it/s]
Epoch 23 Iter 152: loss 0.26043. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.04it/s]
Epoch 23 Iter 152: loss 0.26043. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 23 Iter 153: loss 0.23268. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 23 Iter 153: loss 0.23268. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 23 Iter 154: loss 0.24039. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 23 Iter 154: loss 0.24039. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 23 Iter 155: loss 0.23707. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 23 Iter 155: loss 0.23707. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 23 Iter 156: loss 0.23328. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 23 Iter 156: loss 0.23328. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 23 Iter 157: loss 0.24061. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.06it/s]
Epoch 23 Iter 157: loss 0.24061. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 23 Iter 158: loss 0.24221. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 23 Iter 158: loss 0.24221. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 23 Iter 159: loss 0.22836. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 23 Iter 159: loss 0.22836. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 23 Iter 160: loss 0.24171. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 23 Iter 160: loss 0.24171. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 23 Iter 161: loss 0.23328. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 23 Iter 161: loss 0.23328. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 23 Iter 162: loss 0.22969. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 23 Iter 162: loss 0.22969. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 23 Iter 163: loss 0.22304. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 23 Iter 163: loss 0.22304. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.22615. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.22615. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 23 Iter 165: loss 0.23668. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 23 Iter 165: loss 0.23668. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 23 Iter 166: loss 0.25322. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 23 Iter 166: loss 0.25322. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 23 Iter 167: loss 0.23045. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 23 Iter 167: loss 0.23045. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.08it/s]
Epoch 23 Iter 168: loss 0.24392. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.08it/s]
Epoch 23 Iter 168: loss 0.24392. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 23 Iter 169: loss 0.21799. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 23 Iter 169: loss 0.21799. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.24487. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.24487. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 23 Iter 171: loss 0.25255. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 23 Iter 171: loss 0.25255. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 23 Iter 172: loss 0.23037. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 23 Iter 172: loss 0.23037. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:24,  2.08it/s]
Epoch 23 Iter 173: loss 0.23831. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:24,  2.08it/s]
Epoch 23 Iter 173: loss 0.23831. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 23 Iter 174: loss 0.24436. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 23 Iter 174: loss 0.24436. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.23530. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.23530. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 23 Iter 176: loss 0.23103. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 23 Iter 176: loss 0.23103. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.00it/s]
Epoch 23 Iter 177: loss 0.23707. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.00it/s]
Epoch 23 Iter 177: loss 0.23707. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.04it/s]
Epoch 23 Iter 178: loss 0.23503. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.04it/s]
Epoch 23 Iter 178: loss 0.23503. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 23 Iter 179: loss 0.22598. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 23 Iter 179: loss 0.22598. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 23 Iter 180: loss 0.22878. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 23 Iter 180: loss 0.22878. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 23 Iter 181: loss 0.25034. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 23 Iter 181: loss 0.25034. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.24141. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.24141. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.23807. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.23807. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 23 Iter 184: loss 0.23545. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 23 Iter 184: loss 0.23545. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:18,  2.11it/s]
Epoch 23 Iter 185: loss 0.23618. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:18,  2.11it/s]
Epoch 23 Iter 185: loss 0.23618. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.12it/s]
Epoch 23 Iter 186: loss 0.21516. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.12it/s]
Epoch 23 Iter 186: loss 0.21516. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:17,  2.12it/s]
Epoch 23 Iter 187: loss 0.20985. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:17,  2.12it/s]
Epoch 23 Iter 187: loss 0.20985. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.10it/s]
Epoch 23 Iter 188: loss 0.22926. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.10it/s]
Epoch 23 Iter 188: loss 0.22926. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.09it/s]
Epoch 23 Iter 189: loss 0.21873. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.09it/s]
Epoch 23 Iter 189: loss 0.21873. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 23 Iter 190: loss 0.24798. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 23 Iter 190: loss 0.24798. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 23 Iter 191: loss 0.22605. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 23 Iter 191: loss 0.22605. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 23 Iter 192: loss 0.22264. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 23 Iter 192: loss 0.22264. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 23 Iter 193: loss 0.22348. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 23 Iter 193: loss 0.22348. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 23 Iter 194: loss 0.24432. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 23 Iter 194: loss 0.24432. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 23 Iter 195: loss 0.24743. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 23 Iter 195: loss 0.24743. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 23 Iter 196: loss 0.24139. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 23 Iter 196: loss 0.24139. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 23 Iter 197: loss 0.23700. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 23 Iter 197: loss 0.23700. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 23 Iter 198: loss 0.24120. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 23 Iter 198: loss 0.24120. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 23 Iter 199: loss 0.23078. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 23 Iter 199: loss 0.23078. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.22856. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.22856. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 23 Iter 201: loss 0.22331. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 23 Iter 201: loss 0.22331. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 23 Iter 202: loss 0.22411. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 23 Iter 202: loss 0.22411. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.04it/s]
Epoch 23 Iter 203: loss 0.23177. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 23 Iter 203: loss 0.23177. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 23 Iter 204: loss 0.24299. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 23 Iter 204: loss 0.24299. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 23 Iter 205: loss 0.24269. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 23 Iter 205: loss 0.24269. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 23 Iter 206: loss 0.23939. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 23 Iter 206: loss 0.23939. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.09it/s]
Epoch 23 Iter 207: loss 0.24935. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.09it/s]
Epoch 23 Iter 207: loss 0.24935. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.10it/s]
Epoch 23 Iter 208: loss 0.23333. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.10it/s]
Epoch 23 Iter 208: loss 0.23333. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.09it/s]
Epoch 23 Iter 209: loss 0.24344. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.09it/s]
Epoch 23 Iter 209: loss 0.24344. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 23 Iter 210: loss 0.23252. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 23 Iter 210: loss 0.23252. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 23 Iter 211: loss 0.24356. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 23 Iter 211: loss 0.24356. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 23 Iter 212: loss 0.23877. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 23 Iter 212: loss 0.23877. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 23 Iter 213: loss 0.22287. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 23 Iter 213: loss 0.22287. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 23 Iter 214: loss 0.23588. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 23 Iter 214: loss 0.23588. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 23 Iter 215: loss 0.21338. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 215: loss 0.21338. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.23350. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.23350. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 23 Iter 217: loss 0.21723. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 23 Iter 217: loss 0.21723. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 23 Iter 218: loss 0.22975. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 23 Iter 218: loss 0.22975. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 23 Iter 219: loss 0.23340. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 23 Iter 219: loss 0.23340. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 23 Iter 220: loss 0.22963. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 23 Iter 220: loss 0.22963. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 23 Iter 221: loss 0.24326. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 23 Iter 221: loss 0.24326. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 23 Iter 222: loss 0.23504. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 23 Iter 222: loss 0.23504. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 23 Iter 223: loss 0.21467. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 23 Iter 223: loss 0.21467. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.05it/s]
Epoch 23 Iter 224: loss 0.23270. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 23 Iter 224: loss 0.23270. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 23 Iter 224: loss 0.23270. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23378
    Valid loss: 0.23493
       Valid loss recons: 0.22429
       Valid loss KL-D:   1.06349
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.21805. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.21805. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.22987. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.22987. :   1%|▍                                             | 2/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 3: loss 0.23932. :   1%|▍                                             | 2/224 [00:01<01:48,  2.05it/s]
Epoch 24 Iter 3: loss 0.23932. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 24 Iter 4: loss 0.24812. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 24 Iter 4: loss 0.24812. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 24 Iter 5: loss 0.22186. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 24 Iter 5: loss 0.22186. :   2%|█                                             | 5/224 [00:02<01:46,  2.07it/s]
Epoch 24 Iter 6: loss 0.26585. :   2%|█                                             | 5/224 [00:02<01:46,  2.07it/s]
Epoch 24 Iter 6: loss 0.26585. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 24 Iter 7: loss 0.20827. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 24 Iter 7: loss 0.20827. :   3%|█▍                                            | 7/224 [00:03<01:47,  2.03it/s]
Epoch 24 Iter 8: loss 0.25745. :   3%|█▍                                            | 7/224 [00:03<01:47,  2.03it/s]
Epoch 24 Iter 8: loss 0.25745. :   4%|█▋                                            | 8/224 [00:03<01:46,  2.03it/s]
Epoch 24 Iter 9: loss 0.21225. :   4%|█▋                                            | 8/224 [00:04<01:46,  2.03it/s]
Epoch 24 Iter 9: loss 0.21225. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.24179. :   4%|█▊                                           | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.24179. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 24 Iter 11: loss 0.24552. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 24 Iter 11: loss 0.24552. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 24 Iter 12: loss 0.23668. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 24 Iter 12: loss 0.23668. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 24 Iter 13: loss 0.21920. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 24 Iter 13: loss 0.21920. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 24 Iter 14: loss 0.24116. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 24 Iter 14: loss 0.24116. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 24 Iter 15: loss 0.24423. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 24 Iter 15: loss 0.24423. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 24 Iter 16: loss 0.22164. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 24 Iter 16: loss 0.22164. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 24 Iter 17: loss 0.22816. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 24 Iter 17: loss 0.22816. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 24 Iter 18: loss 0.22728. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 24 Iter 18: loss 0.22728. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.08it/s]
Epoch 24 Iter 19: loss 0.21412. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.08it/s]
Epoch 24 Iter 19: loss 0.21412. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 24 Iter 20: loss 0.24062. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 24 Iter 20: loss 0.24062. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 24 Iter 21: loss 0.22359. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 24 Iter 21: loss 0.22359. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 24 Iter 22: loss 0.22844. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 24 Iter 22: loss 0.22844. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.08it/s]
Epoch 24 Iter 23: loss 0.22506. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.08it/s]
Epoch 24 Iter 23: loss 0.22506. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 24 Iter 24: loss 0.23820. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 24 Iter 24: loss 0.23820. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 24 Iter 25: loss 0.23571. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 24 Iter 25: loss 0.23571. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 24 Iter 26: loss 0.24213. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 24 Iter 26: loss 0.24213. :  12%|█████                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 24 Iter 27: loss 0.23525. :  12%|█████                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 24 Iter 27: loss 0.23525. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.07it/s]
Epoch 24 Iter 28: loss 0.23259. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.07it/s]
Epoch 24 Iter 28: loss 0.23259. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 24 Iter 29: loss 0.23406. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 24 Iter 29: loss 0.23406. :  13%|█████▋                                      | 29/224 [00:14<01:37,  2.00it/s]
Epoch 24 Iter 30: loss 0.24879. :  13%|█████▋                                      | 29/224 [00:14<01:37,  2.00it/s]
Epoch 24 Iter 30: loss 0.24879. :  13%|█████▉                                      | 30/224 [00:14<01:35,  2.03it/s]
Epoch 24 Iter 31: loss 0.21462. :  13%|█████▉                                      | 30/224 [00:15<01:35,  2.03it/s]
Epoch 24 Iter 31: loss 0.21462. :  14%|██████                                      | 31/224 [00:15<01:35,  2.03it/s]
Epoch 24 Iter 32: loss 0.24963. :  14%|██████                                      | 31/224 [00:15<01:35,  2.03it/s]
Epoch 24 Iter 32: loss 0.24963. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.04it/s]
Epoch 24 Iter 33: loss 0.23504. :  14%|██████▎                                     | 32/224 [00:16<01:33,  2.04it/s]
Epoch 24 Iter 33: loss 0.23504. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.05it/s]
Epoch 24 Iter 34: loss 0.24938. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.05it/s]
Epoch 24 Iter 34: loss 0.24938. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.04it/s]
Epoch 24 Iter 35: loss 0.25380. :  15%|██████▋                                     | 34/224 [00:17<01:32,  2.04it/s]
Epoch 24 Iter 35: loss 0.25380. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.05it/s]
Epoch 24 Iter 36: loss 0.23290. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.05it/s]
Epoch 24 Iter 36: loss 0.23290. :  16%|███████                                     | 36/224 [00:17<01:31,  2.04it/s]
Epoch 24 Iter 37: loss 0.23000. :  16%|███████                                     | 36/224 [00:17<01:31,  2.04it/s]
Epoch 24 Iter 37: loss 0.23000. :  17%|███████▎                                    | 37/224 [00:17<01:31,  2.05it/s]
Epoch 24 Iter 38: loss 0.24100. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.05it/s]
Epoch 24 Iter 38: loss 0.24100. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 24 Iter 39: loss 0.20459. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 24 Iter 39: loss 0.20459. :  17%|███████▋                                    | 39/224 [00:18<01:30,  2.05it/s]
Epoch 24 Iter 40: loss 0.22332. :  17%|███████▋                                    | 39/224 [00:19<01:30,  2.05it/s]
Epoch 24 Iter 40: loss 0.22332. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 24 Iter 41: loss 0.22645. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 24 Iter 41: loss 0.22645. :  18%|████████                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 24 Iter 42: loss 0.23839. :  18%|████████                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 24 Iter 42: loss 0.23839. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 43: loss 0.23416. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 43: loss 0.23416. :  19%|████████▍                                   | 43/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 44: loss 0.21527. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.05it/s]
Epoch 24 Iter 44: loss 0.21527. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 24 Iter 45: loss 0.23208. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 24 Iter 45: loss 0.23208. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 24 Iter 46: loss 0.21529. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 24 Iter 46: loss 0.21529. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 24 Iter 47: loss 0.22883. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 24 Iter 47: loss 0.22883. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 24 Iter 48: loss 0.22841. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 24 Iter 48: loss 0.22841. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.09it/s]
Epoch 24 Iter 49: loss 0.22759. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.09it/s]
Epoch 24 Iter 49: loss 0.22759. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.24247. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.24247. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 24 Iter 51: loss 0.23426. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 24 Iter 51: loss 0.23426. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 24 Iter 52: loss 0.21004. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 24 Iter 52: loss 0.21004. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 24 Iter 53: loss 0.24389. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 24 Iter 53: loss 0.24389. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 24 Iter 54: loss 0.21738. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 24 Iter 54: loss 0.21738. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 24 Iter 55: loss 0.23757. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 24 Iter 55: loss 0.23757. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.06it/s]
Epoch 24 Iter 56: loss 0.24160. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.06it/s]
Epoch 24 Iter 56: loss 0.24160. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 24 Iter 57: loss 0.22152. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 24 Iter 57: loss 0.22152. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 24 Iter 58: loss 0.21623. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 24 Iter 58: loss 0.21623. :  26%|███████████▍                                | 58/224 [00:28<01:21,  2.05it/s]
Epoch 24 Iter 59: loss 0.23450. :  26%|███████████▍                                | 58/224 [00:28<01:21,  2.05it/s]
Epoch 24 Iter 59: loss 0.23450. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.05it/s]
Epoch 24 Iter 60: loss 0.22637. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.05it/s]
Epoch 24 Iter 60: loss 0.22637. :  27%|███████████▊                                | 60/224 [00:29<01:20,  2.05it/s]
Epoch 24 Iter 61: loss 0.24812. :  27%|███████████▊                                | 60/224 [00:29<01:20,  2.05it/s]
Epoch 24 Iter 61: loss 0.24812. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 24 Iter 62: loss 0.26010. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 24 Iter 62: loss 0.26010. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 24 Iter 63: loss 0.24572. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 24 Iter 63: loss 0.24572. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 24 Iter 64: loss 0.23023. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.05it/s]
Epoch 24 Iter 64: loss 0.23023. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 24 Iter 65: loss 0.22975. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 24 Iter 65: loss 0.22975. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 24 Iter 66: loss 0.21214. :  29%|████████████▊                               | 65/224 [00:32<01:17,  2.06it/s]
Epoch 24 Iter 66: loss 0.21214. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 24 Iter 67: loss 0.25160. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 24 Iter 67: loss 0.25160. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 24 Iter 68: loss 0.21738. :  30%|█████████████▏                              | 67/224 [00:33<01:16,  2.05it/s]
Epoch 24 Iter 68: loss 0.21738. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 24 Iter 69: loss 0.23857. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 24 Iter 69: loss 0.23857. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 24 Iter 70: loss 0.23684. :  31%|█████████████▌                              | 69/224 [00:34<01:15,  2.06it/s]
Epoch 24 Iter 70: loss 0.23684. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 24 Iter 71: loss 0.20951. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 24 Iter 71: loss 0.20951. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 24 Iter 72: loss 0.26535. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 24 Iter 72: loss 0.26535. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 24 Iter 73: loss 0.22684. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 24 Iter 73: loss 0.22684. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 24 Iter 74: loss 0.24579. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 24 Iter 74: loss 0.24579. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 24 Iter 75: loss 0.24064. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 24 Iter 75: loss 0.24064. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 24 Iter 76: loss 0.24900. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 24 Iter 76: loss 0.24900. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 24 Iter 77: loss 0.24701. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 24 Iter 77: loss 0.24701. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 24 Iter 78: loss 0.22760. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 24 Iter 78: loss 0.22760. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 24 Iter 79: loss 0.23578. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 24 Iter 79: loss 0.23578. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.23861. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.23861. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 24 Iter 81: loss 0.26032. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 24 Iter 81: loss 0.26032. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.25213. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.25213. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 24 Iter 83: loss 0.21840. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 83: loss 0.21840. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 84: loss 0.23265. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 84: loss 0.23265. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 24 Iter 85: loss 0.21492. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 24 Iter 85: loss 0.21492. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.23798. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.23798. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 24 Iter 87: loss 0.22528. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 24 Iter 87: loss 0.22528. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 24 Iter 88: loss 0.22048. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 24 Iter 88: loss 0.22048. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.22406. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.22406. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 24 Iter 90: loss 0.24585. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 24 Iter 90: loss 0.24585. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 24 Iter 91: loss 0.22779. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 24 Iter 91: loss 0.22779. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 92: loss 0.23448. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 92: loss 0.23448. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 93: loss 0.23026. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 24 Iter 93: loss 0.23026. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 24 Iter 94: loss 0.22972. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 24 Iter 94: loss 0.22972. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.22179. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.22179. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 24 Iter 96: loss 0.24072. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 24 Iter 96: loss 0.24072. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 24 Iter 97: loss 0.22581. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 24 Iter 97: loss 0.22581. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 24 Iter 98: loss 0.21377. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 24 Iter 98: loss 0.21377. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 24 Iter 99: loss 0.24089. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.08it/s]
Epoch 24 Iter 99: loss 0.24089. :  44%|███████████████████▍                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 24 Iter 100: loss 0.24402. :  44%|███████████████████                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 24 Iter 100: loss 0.24402. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 24 Iter 101: loss 0.23999. :  45%|██████████████████▊                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 24 Iter 101: loss 0.23999. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 24 Iter 102: loss 0.23962. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 24 Iter 102: loss 0.23962. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 24 Iter 103: loss 0.23712. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 24 Iter 103: loss 0.23712. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 24 Iter 104: loss 0.23641. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 24 Iter 104: loss 0.23641. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 24 Iter 105: loss 0.22656. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 24 Iter 105: loss 0.22656. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 24 Iter 106: loss 0.21685. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 24 Iter 106: loss 0.21685. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 24 Iter 107: loss 0.24720. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 24 Iter 107: loss 0.24720. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 24 Iter 108: loss 0.24419. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 24 Iter 108: loss 0.24419. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 24 Iter 109: loss 0.22320. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 24 Iter 109: loss 0.22320. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 24 Iter 110: loss 0.21849. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 24 Iter 110: loss 0.21849. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 24 Iter 111: loss 0.21985. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 24 Iter 111: loss 0.21985. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 24 Iter 112: loss 0.23045. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 24 Iter 112: loss 0.23045. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 24 Iter 113: loss 0.22556. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 24 Iter 113: loss 0.22556. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 24 Iter 114: loss 0.25817. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 114: loss 0.25817. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 115: loss 0.24395. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 115: loss 0.24395. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 24 Iter 116: loss 0.23916. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 116: loss 0.23916. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 117: loss 0.21748. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 117: loss 0.21748. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 24 Iter 118: loss 0.21925. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 118: loss 0.21925. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 119: loss 0.23427. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 119: loss 0.23427. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 24 Iter 120: loss 0.23864. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 24 Iter 120: loss 0.23864. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 24 Iter 121: loss 0.23601. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 24 Iter 121: loss 0.23601. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 24 Iter 122: loss 0.22432. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 24 Iter 122: loss 0.22432. :  54%|██████████████████████▊                   | 122/224 [00:59<00:48,  2.08it/s]
Epoch 24 Iter 123: loss 0.22353. :  54%|██████████████████████▊                   | 122/224 [00:59<00:48,  2.08it/s]
Epoch 24 Iter 123: loss 0.22353. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 24 Iter 124: loss 0.23211. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.08it/s]
Epoch 24 Iter 124: loss 0.23211. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.23635. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.23635. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.22370. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.22370. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.23813. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.23813. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 24 Iter 128: loss 0.24693. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 24 Iter 128: loss 0.24693. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.24367. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.24367. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 24 Iter 130: loss 0.23259. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 130: loss 0.23259. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.22788. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.22788. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 24 Iter 132: loss 0.23052. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 24 Iter 132: loss 0.23052. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.09it/s]
Epoch 24 Iter 133: loss 0.25721. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.09it/s]
Epoch 24 Iter 133: loss 0.25721. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 24 Iter 134: loss 0.24189. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 24 Iter 134: loss 0.24189. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 24 Iter 135: loss 0.24763. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 24 Iter 135: loss 0.24763. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.09it/s]
Epoch 24 Iter 136: loss 0.24093. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.09it/s]
Epoch 24 Iter 136: loss 0.24093. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.09it/s]
Epoch 24 Iter 137: loss 0.23292. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.09it/s]
Epoch 24 Iter 137: loss 0.23292. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 24 Iter 138: loss 0.23583. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 24 Iter 138: loss 0.23583. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 24 Iter 139: loss 0.23540. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 24 Iter 139: loss 0.23540. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 24 Iter 140: loss 0.24414. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 24 Iter 140: loss 0.24414. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 24 Iter 141: loss 0.23594. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 24 Iter 141: loss 0.23594. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 24 Iter 142: loss 0.22757. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 24 Iter 142: loss 0.22757. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.23052. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.23052. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 24 Iter 144: loss 0.22835. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 24 Iter 144: loss 0.22835. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 24 Iter 145: loss 0.24173. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 24 Iter 145: loss 0.24173. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.23028. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.23028. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 24 Iter 147: loss 0.23574. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 24 Iter 147: loss 0.23574. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 24 Iter 148: loss 0.22289. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 24 Iter 148: loss 0.22289. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 24 Iter 149: loss 0.21969. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 24 Iter 149: loss 0.21969. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 150: loss 0.20882. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 150: loss 0.20882. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 24 Iter 151: loss 0.22985. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 151: loss 0.22985. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 152: loss 0.24464. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 24 Iter 152: loss 0.24464. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 24 Iter 153: loss 0.23107. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 24 Iter 153: loss 0.23107. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 24 Iter 154: loss 0.26217. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 24 Iter 154: loss 0.26217. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 24 Iter 155: loss 0.23845. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 155: loss 0.23845. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.24737. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.24737. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.05it/s]
Epoch 24 Iter 157: loss 0.23823. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.05it/s]
Epoch 24 Iter 157: loss 0.23823. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 24 Iter 158: loss 0.24947. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 24 Iter 158: loss 0.24947. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 24 Iter 159: loss 0.23444. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 24 Iter 159: loss 0.23444. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.24578. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.24578. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 161: loss 0.25422. :  71%|██████████████████████████████            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 24 Iter 161: loss 0.25422. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 24 Iter 162: loss 0.21641. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 24 Iter 162: loss 0.21641. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 24 Iter 163: loss 0.24015. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 24 Iter 163: loss 0.24015. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 24 Iter 164: loss 0.23790. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 164: loss 0.23790. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 165: loss 0.22158. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 165: loss 0.22158. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 24 Iter 166: loss 0.23996. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 24 Iter 166: loss 0.23996. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 24 Iter 167: loss 0.22619. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 24 Iter 167: loss 0.22619. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.06it/s]
Epoch 24 Iter 168: loss 0.24227. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 168: loss 0.24227. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.26451. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.26451. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 24 Iter 170: loss 0.23808. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 170: loss 0.23808. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 171: loss 0.23846. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 24 Iter 171: loss 0.23846. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 24 Iter 172: loss 0.24047. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 24 Iter 172: loss 0.24047. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.22559. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.22559. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 24 Iter 174: loss 0.22864. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 174: loss 0.22864. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 24 Iter 175: loss 0.21022. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 24 Iter 175: loss 0.21022. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 24 Iter 176: loss 0.23653. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 24 Iter 176: loss 0.23653. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 24 Iter 177: loss 0.20699. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 24 Iter 177: loss 0.20699. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 24 Iter 178: loss 0.24287. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 24 Iter 178: loss 0.24287. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 24 Iter 179: loss 0.25996. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 24 Iter 179: loss 0.25996. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 24 Iter 180: loss 0.23560. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 24 Iter 180: loss 0.23560. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 24 Iter 181: loss 0.22437. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 24 Iter 181: loss 0.22437. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 24 Iter 182: loss 0.24573. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 182: loss 0.24573. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 183: loss 0.23959. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 183: loss 0.23959. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 24 Iter 184: loss 0.23249. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 24 Iter 184: loss 0.23249. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 24 Iter 185: loss 0.22289. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 24 Iter 185: loss 0.22289. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 24 Iter 186: loss 0.22201. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 186: loss 0.22201. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 187: loss 0.25243. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 187: loss 0.25243. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 24 Iter 188: loss 0.24804. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 188: loss 0.24804. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 189: loss 0.23369. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 189: loss 0.23369. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 24 Iter 190: loss 0.22762. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 24 Iter 190: loss 0.22762. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 24 Iter 191: loss 0.22526. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 24 Iter 191: loss 0.22526. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 24 Iter 192: loss 0.22952. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 24 Iter 192: loss 0.22952. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.23462. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.23462. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 24 Iter 194: loss 0.24595. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 24 Iter 194: loss 0.24595. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 24 Iter 195: loss 0.24524. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 24 Iter 195: loss 0.24524. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 24 Iter 196: loss 0.21292. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 24 Iter 196: loss 0.21292. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 24 Iter 197: loss 0.23946. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 197: loss 0.23946. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 198: loss 0.24300. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 24 Iter 198: loss 0.24300. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 24 Iter 199: loss 0.24797. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 24 Iter 199: loss 0.24797. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 24 Iter 200: loss 0.23541. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 24 Iter 200: loss 0.23541. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 24 Iter 201: loss 0.20614. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 24 Iter 201: loss 0.20614. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 24 Iter 202: loss 0.24010. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 24 Iter 202: loss 0.24010. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 24 Iter 203: loss 0.22940. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 24 Iter 203: loss 0.22940. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 24 Iter 204: loss 0.21430. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 24 Iter 204: loss 0.21430. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 24 Iter 205: loss 0.23904. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 24 Iter 205: loss 0.23904. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 24 Iter 206: loss 0.22912. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 24 Iter 206: loss 0.22912. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 24 Iter 207: loss 0.23684. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 207: loss 0.23684. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 208: loss 0.22715. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 208: loss 0.22715. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 24 Iter 209: loss 0.22261. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 24 Iter 209: loss 0.22261. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.23882. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.23882. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 24 Iter 211: loss 0.23106. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 24 Iter 211: loss 0.23106. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.23044. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.23044. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.22833. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.22833. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.25821. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.25821. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.09it/s]
Epoch 24 Iter 215: loss 0.22780. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.09it/s]
Epoch 24 Iter 215: loss 0.22780. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 24 Iter 216: loss 0.21869. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 24 Iter 216: loss 0.21869. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 24 Iter 217: loss 0.24284. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 24 Iter 217: loss 0.24284. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 24 Iter 218: loss 0.25139. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 24 Iter 218: loss 0.25139. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 24 Iter 219: loss 0.22758. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 24 Iter 219: loss 0.22758. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 24 Iter 220: loss 0.23340. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 24 Iter 220: loss 0.23340. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 24 Iter 221: loss 0.22782. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 24 Iter 221: loss 0.22782. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 24 Iter 222: loss 0.23122. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 24 Iter 222: loss 0.23122. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 24 Iter 223: loss 0.24072. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.07it/s]
Epoch 24 Iter 223: loss 0.24072. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.23438. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.23438. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.23438. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.23351. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.23351. :   0%|▏                                             | 1/224 [00:00<01:46,  2.10it/s]
Epoch 25 Iter 2: loss 0.24533. :   0%|▏                                             | 1/224 [00:00<01:46,  2.10it/s]
Epoch 25 Iter 2: loss 0.24533. :   1%|▍                                             | 2/224 [00:00<01:46,  2.09it/s]
Epoch 25 Iter 3: loss 0.22267. :   1%|▍                                             | 2/224 [00:01<01:46,  2.09it/s]
Epoch 25 Iter 3: loss 0.22267. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 25 Iter 4: loss 0.22392. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 25 Iter 4: loss 0.22392. :   2%|▊                                             | 4/224 [00:01<01:45,  2.09it/s]
Epoch 25 Iter 5: loss 0.22019. :   2%|▊                                             | 4/224 [00:02<01:45,  2.09it/s]
Epoch 25 Iter 5: loss 0.22019. :   2%|█                                             | 5/224 [00:02<01:44,  2.10it/s]
Epoch 25 Iter 6: loss 0.24506. :   2%|█                                             | 5/224 [00:02<01:44,  2.10it/s]
Epoch 25 Iter 6: loss 0.24506. :   3%|█▏                                            | 6/224 [00:02<01:44,  2.09it/s]
Epoch 25 Iter 7: loss 0.22724. :   3%|█▏                                            | 6/224 [00:03<01:44,  2.09it/s]
Epoch 25 Iter 7: loss 0.22724. :   3%|█▍                                            | 7/224 [00:03<01:43,  2.10it/s]
Epoch 25 Iter 8: loss 0.25807. :   3%|█▍                                            | 7/224 [00:03<01:43,  2.10it/s]
Epoch 25 Iter 8: loss 0.25807. :   4%|█▋                                            | 8/224 [00:03<01:43,  2.09it/s]
Epoch 25 Iter 9: loss 0.23092. :   4%|█▋                                            | 8/224 [00:04<01:43,  2.09it/s]
Epoch 25 Iter 9: loss 0.23092. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 25 Iter 10: loss 0.23702. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 25 Iter 10: loss 0.23702. :   4%|█▉                                          | 10/224 [00:04<01:42,  2.09it/s]
Epoch 25 Iter 11: loss 0.22078. :   4%|█▉                                          | 10/224 [00:05<01:42,  2.09it/s]
Epoch 25 Iter 11: loss 0.22078. :   5%|██▏                                         | 11/224 [00:05<01:41,  2.09it/s]
Epoch 25 Iter 12: loss 0.23429. :   5%|██▏                                         | 11/224 [00:05<01:41,  2.09it/s]
Epoch 25 Iter 12: loss 0.23429. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.08it/s]
Epoch 25 Iter 13: loss 0.22989. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.08it/s]
Epoch 25 Iter 13: loss 0.22989. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 25 Iter 14: loss 0.23755. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 25 Iter 14: loss 0.23755. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 25 Iter 15: loss 0.23947. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 15: loss 0.23947. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 25 Iter 16: loss 0.24196. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 25 Iter 16: loss 0.24196. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 25 Iter 17: loss 0.22151. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 25 Iter 17: loss 0.22151. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 25 Iter 18: loss 0.23367. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 25 Iter 18: loss 0.23367. :   8%|███▌                                        | 18/224 [00:08<01:41,  2.03it/s]
Epoch 25 Iter 19: loss 0.22238. :   8%|███▌                                        | 18/224 [00:09<01:41,  2.03it/s]
Epoch 25 Iter 19: loss 0.22238. :   8%|███▋                                        | 19/224 [00:09<01:40,  2.04it/s]
Epoch 25 Iter 20: loss 0.24711. :   8%|███▋                                        | 19/224 [00:09<01:40,  2.04it/s]
Epoch 25 Iter 20: loss 0.24711. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 25 Iter 21: loss 0.24997. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 25 Iter 21: loss 0.24997. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 25 Iter 22: loss 0.22529. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 25 Iter 22: loss 0.22529. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 25 Iter 23: loss 0.21759. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 25 Iter 23: loss 0.21759. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.23286. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.23286. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 25 Iter 25: loss 0.24213. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 25 Iter 25: loss 0.24213. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 25 Iter 26: loss 0.23706. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 25 Iter 26: loss 0.23706. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 25 Iter 27: loss 0.24816. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 25 Iter 27: loss 0.24816. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 25 Iter 28: loss 0.22835. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 25 Iter 28: loss 0.22835. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 25 Iter 29: loss 0.24752. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 25 Iter 29: loss 0.24752. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 25 Iter 30: loss 0.22927. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 25 Iter 30: loss 0.22927. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 25 Iter 31: loss 0.23292. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 25 Iter 31: loss 0.23292. :  14%|██████                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.22460. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.22460. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.26317. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.26317. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.08it/s]
Epoch 25 Iter 34: loss 0.23614. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.08it/s]
Epoch 25 Iter 34: loss 0.23614. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 25 Iter 35: loss 0.23440. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 25 Iter 35: loss 0.23440. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 36: loss 0.25080. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 25 Iter 36: loss 0.25080. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 37: loss 0.22588. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 37: loss 0.22588. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 25 Iter 38: loss 0.22509. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 25 Iter 38: loss 0.22509. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 39: loss 0.23683. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 39: loss 0.23683. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.07it/s]
Epoch 25 Iter 40: loss 0.23530. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.07it/s]
Epoch 25 Iter 40: loss 0.23530. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.23940. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.23940. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.22731. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.22731. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 25 Iter 43: loss 0.22675. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 25 Iter 43: loss 0.22675. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.08it/s]
Epoch 25 Iter 44: loss 0.21970. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.08it/s]
Epoch 25 Iter 44: loss 0.21970. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 25 Iter 45: loss 0.22801. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 25 Iter 45: loss 0.22801. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.08it/s]
Epoch 25 Iter 46: loss 0.23218. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.08it/s]
Epoch 25 Iter 46: loss 0.23218. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 25 Iter 47: loss 0.22873. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 25 Iter 47: loss 0.22873. :  21%|█████████▏                                  | 47/224 [00:22<01:24,  2.08it/s]
Epoch 25 Iter 48: loss 0.22676. :  21%|█████████▏                                  | 47/224 [00:23<01:24,  2.08it/s]
Epoch 25 Iter 48: loss 0.22676. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 25 Iter 49: loss 0.23374. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 25 Iter 49: loss 0.23374. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.08it/s]
Epoch 25 Iter 50: loss 0.22315. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.08it/s]
Epoch 25 Iter 50: loss 0.22315. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 25 Iter 51: loss 0.22421. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 25 Iter 51: loss 0.22421. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 25 Iter 52: loss 0.22659. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 25 Iter 52: loss 0.22659. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.24611. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.24611. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.06it/s]
Epoch 25 Iter 54: loss 0.23977. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 54: loss 0.23977. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 25 Iter 55: loss 0.23235. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 25 Iter 55: loss 0.23235. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 25 Iter 56: loss 0.22521. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 25 Iter 56: loss 0.22521. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 25 Iter 57: loss 0.23617. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 25 Iter 57: loss 0.23617. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 25 Iter 58: loss 0.24940. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 25 Iter 58: loss 0.24940. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 25 Iter 59: loss 0.23594. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 25 Iter 59: loss 0.23594. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.06it/s]
Epoch 25 Iter 60: loss 0.21730. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.06it/s]
Epoch 25 Iter 60: loss 0.21730. :  27%|███████████▊                                | 60/224 [00:28<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.22229. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.22229. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 25 Iter 62: loss 0.22406. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 25 Iter 62: loss 0.22406. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.06it/s]
Epoch 25 Iter 63: loss 0.23538. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 25 Iter 63: loss 0.23538. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 25 Iter 64: loss 0.22317. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 25 Iter 64: loss 0.22317. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.05it/s]
Epoch 25 Iter 65: loss 0.23446. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 25 Iter 65: loss 0.23446. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 25 Iter 66: loss 0.22599. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 25 Iter 66: loss 0.22599. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 25 Iter 67: loss 0.23497. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 25 Iter 67: loss 0.23497. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 25 Iter 68: loss 0.23017. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 25 Iter 68: loss 0.23017. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 25 Iter 69: loss 0.23173. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 25 Iter 69: loss 0.23173. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 25 Iter 70: loss 0.24600. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 25 Iter 70: loss 0.24600. :  31%|█████████████▊                              | 70/224 [00:33<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.22705. :  31%|█████████████▊                              | 70/224 [00:34<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.22705. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 25 Iter 72: loss 0.25833. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 25 Iter 72: loss 0.25833. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 25 Iter 73: loss 0.23670. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 25 Iter 73: loss 0.23670. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 74: loss 0.24543. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 74: loss 0.24543. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 75: loss 0.21717. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 25 Iter 75: loss 0.21717. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 25 Iter 76: loss 0.24165. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 25 Iter 76: loss 0.24165. :  34%|██████████████▉                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.22848. :  34%|██████████████▉                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.22848. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.23469. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.23469. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.22559. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.22559. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 80: loss 0.21795. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 80: loss 0.21795. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 81: loss 0.24102. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 25 Iter 81: loss 0.24102. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 25 Iter 82: loss 0.23240. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 25 Iter 82: loss 0.23240. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 25 Iter 83: loss 0.23120. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 25 Iter 83: loss 0.23120. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.08it/s]
Epoch 25 Iter 84: loss 0.22774. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.08it/s]
Epoch 25 Iter 84: loss 0.22774. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.24918. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.24918. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 25 Iter 86: loss 0.24233. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 25 Iter 86: loss 0.24233. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.21831. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.21831. :  39%|█████████████████                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.24771. :  39%|█████████████████                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.24771. :  39%|█████████████████▎                          | 88/224 [00:42<01:07,  2.01it/s]
Epoch 25 Iter 89: loss 0.23125. :  39%|█████████████████▎                          | 88/224 [00:43<01:07,  2.01it/s]
Epoch 25 Iter 89: loss 0.23125. :  40%|█████████████████▍                          | 89/224 [00:43<01:06,  2.03it/s]
Epoch 25 Iter 90: loss 0.23512. :  40%|█████████████████▍                          | 89/224 [00:43<01:06,  2.03it/s]
Epoch 25 Iter 90: loss 0.23512. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.03it/s]
Epoch 25 Iter 91: loss 0.23377. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.03it/s]
Epoch 25 Iter 91: loss 0.23377. :  41%|█████████████████▉                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 25 Iter 92: loss 0.23027. :  41%|█████████████████▉                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 25 Iter 92: loss 0.23027. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.25775. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.25775. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.05it/s]
Epoch 25 Iter 94: loss 0.22460. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.05it/s]
Epoch 25 Iter 94: loss 0.22460. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 95: loss 0.23417. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 95: loss 0.23417. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.06it/s]
Epoch 25 Iter 96: loss 0.23923. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 25 Iter 96: loss 0.23923. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 25 Iter 97: loss 0.23824. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 25 Iter 97: loss 0.23824. :  43%|███████████████████                         | 97/224 [00:46<01:02,  2.04it/s]
Epoch 25 Iter 98: loss 0.23451. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 25 Iter 98: loss 0.23451. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.04it/s]
Epoch 25 Iter 99: loss 0.25298. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.04it/s]
Epoch 25 Iter 99: loss 0.25298. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.05it/s]
Epoch 25 Iter 100: loss 0.21170. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.05it/s]
Epoch 25 Iter 100: loss 0.21170. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.04it/s]
Epoch 25 Iter 101: loss 0.25735. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.04it/s]
Epoch 25 Iter 101: loss 0.25735. :  45%|██████████████████▉                       | 101/224 [00:48<01:00,  2.05it/s]
Epoch 25 Iter 102: loss 0.23542. :  45%|██████████████████▉                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 25 Iter 102: loss 0.23542. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 103: loss 0.22510. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 103: loss 0.22510. :  46%|███████████████████▎                      | 103/224 [00:49<00:59,  2.05it/s]
Epoch 25 Iter 104: loss 0.22482. :  46%|███████████████████▎                      | 103/224 [00:50<00:59,  2.05it/s]
Epoch 25 Iter 104: loss 0.22482. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.05it/s]
Epoch 25 Iter 105: loss 0.23370. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.05it/s]
Epoch 25 Iter 105: loss 0.23370. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 25 Iter 106: loss 0.22036. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 25 Iter 106: loss 0.22036. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 25 Iter 107: loss 0.21728. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 25 Iter 107: loss 0.21728. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 25 Iter 108: loss 0.22175. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 108: loss 0.22175. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 109: loss 0.22554. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 25 Iter 109: loss 0.22554. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 25 Iter 110: loss 0.24041. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 25 Iter 110: loss 0.24041. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.07it/s]
Epoch 25 Iter 111: loss 0.23773. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.07it/s]
Epoch 25 Iter 111: loss 0.23773. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 25 Iter 112: loss 0.23749. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 25 Iter 112: loss 0.23749. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.22717. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.22717. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.21302. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.21302. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.24832. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.24832. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.25094. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.25094. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 25 Iter 117: loss 0.21658. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 25 Iter 117: loss 0.21658. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 25 Iter 118: loss 0.23151. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 25 Iter 118: loss 0.23151. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.23365. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.23365. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.06it/s]
Epoch 25 Iter 120: loss 0.23195. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 25 Iter 120: loss 0.23195. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 25 Iter 121: loss 0.24486. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 25 Iter 121: loss 0.24486. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 25 Iter 122: loss 0.21940. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 25 Iter 122: loss 0.21940. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 25 Iter 123: loss 0.22541. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 25 Iter 123: loss 0.22541. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 25 Iter 124: loss 0.23036. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 25 Iter 124: loss 0.23036. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 25 Iter 125: loss 0.24705. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 25 Iter 125: loss 0.24705. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 25 Iter 126: loss 0.22700. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 126: loss 0.22700. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 25 Iter 127: loss 0.22553. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 25 Iter 127: loss 0.22553. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 25 Iter 128: loss 0.20521. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 25 Iter 128: loss 0.20521. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.23235. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.23235. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.23409. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.23409. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.05it/s]
Epoch 25 Iter 131: loss 0.21603. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 25 Iter 131: loss 0.21603. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.22655. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.22655. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 25 Iter 133: loss 0.23993. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 25 Iter 133: loss 0.23993. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 25 Iter 134: loss 0.24676. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 25 Iter 134: loss 0.24676. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 25 Iter 135: loss 0.22004. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 25 Iter 135: loss 0.22004. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 25 Iter 136: loss 0.22437. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 25 Iter 136: loss 0.22437. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 25 Iter 137: loss 0.23175. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 25 Iter 137: loss 0.23175. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 25 Iter 138: loss 0.25215. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 25 Iter 138: loss 0.25215. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 25 Iter 139: loss 0.23503. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 25 Iter 139: loss 0.23503. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 25 Iter 140: loss 0.21908. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 25 Iter 140: loss 0.21908. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 25 Iter 141: loss 0.23817. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 141: loss 0.23817. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 25 Iter 142: loss 0.24201. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 25 Iter 142: loss 0.24201. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 25 Iter 143: loss 0.24178. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 25 Iter 143: loss 0.24178. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 25 Iter 144: loss 0.23213. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 25 Iter 144: loss 0.23213. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 25 Iter 145: loss 0.23692. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 25 Iter 145: loss 0.23692. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 25 Iter 146: loss 0.23455. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 25 Iter 146: loss 0.23455. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 25 Iter 147: loss 0.22895. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 25 Iter 147: loss 0.22895. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 25 Iter 148: loss 0.23126. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 25 Iter 148: loss 0.23126. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 25 Iter 149: loss 0.24338. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 25 Iter 149: loss 0.24338. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 25 Iter 150: loss 0.24190. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 25 Iter 150: loss 0.24190. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 25 Iter 151: loss 0.21845. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 25 Iter 151: loss 0.21845. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 25 Iter 152: loss 0.22493. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 25 Iter 152: loss 0.22493. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 25 Iter 153: loss 0.22128. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 153: loss 0.22128. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 25 Iter 154: loss 0.22790. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 25 Iter 154: loss 0.22790. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 25 Iter 155: loss 0.23483. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 25 Iter 155: loss 0.23483. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 25 Iter 156: loss 0.26259. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 25 Iter 156: loss 0.26259. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 25 Iter 157: loss 0.22626. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.06it/s]
Epoch 25 Iter 157: loss 0.22626. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 25 Iter 158: loss 0.26479. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 25 Iter 158: loss 0.26479. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 25 Iter 159: loss 0.21713. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 159: loss 0.21713. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.24686. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.24686. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 25 Iter 161: loss 0.23413. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 25 Iter 161: loss 0.23413. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 25 Iter 162: loss 0.23748. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 25 Iter 162: loss 0.23748. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 25 Iter 163: loss 0.24352. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 25 Iter 163: loss 0.24352. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.23371. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.23371. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 25 Iter 165: loss 0.23891. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 25 Iter 165: loss 0.23891. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:29,  2.03it/s]
Epoch 25 Iter 166: loss 0.23595. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 25 Iter 166: loss 0.23595. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.03it/s]
Epoch 25 Iter 167: loss 0.22490. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.03it/s]
Epoch 25 Iter 167: loss 0.22490. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:28,  2.03it/s]
Epoch 25 Iter 168: loss 0.24208. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:28,  2.03it/s]
Epoch 25 Iter 168: loss 0.24208. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 25 Iter 169: loss 0.23360. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 25 Iter 169: loss 0.23360. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.04it/s]
Epoch 25 Iter 170: loss 0.22763. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.04it/s]
Epoch 25 Iter 170: loss 0.22763. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 25 Iter 171: loss 0.24010. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 25 Iter 171: loss 0.24010. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 25 Iter 172: loss 0.21465. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 25 Iter 172: loss 0.21465. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 25 Iter 173: loss 0.24682. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 25 Iter 173: loss 0.24682. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 25 Iter 174: loss 0.21959. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 174: loss 0.21959. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.24216. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.24216. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 25 Iter 176: loss 0.22039. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 25 Iter 176: loss 0.22039. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 25 Iter 177: loss 0.23674. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 25 Iter 177: loss 0.23674. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:23,  2.04it/s]
Epoch 25 Iter 178: loss 0.24724. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:23,  2.04it/s]
Epoch 25 Iter 178: loss 0.24724. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 25 Iter 179: loss 0.25307. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 25 Iter 179: loss 0.25307. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 25 Iter 180: loss 0.23625. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 25 Iter 180: loss 0.23625. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 25 Iter 181: loss 0.23190. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 25 Iter 181: loss 0.23190. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 25 Iter 182: loss 0.23527. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 182: loss 0.23527. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 183: loss 0.23016. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 183: loss 0.23016. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.05it/s]
Epoch 25 Iter 184: loss 0.22698. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 25 Iter 184: loss 0.22698. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 25 Iter 185: loss 0.24550. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 25 Iter 185: loss 0.24550. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 25 Iter 186: loss 0.23424. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 25 Iter 186: loss 0.23424. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 25 Iter 187: loss 0.23429. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 25 Iter 187: loss 0.23429. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 25 Iter 188: loss 0.21455. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 25 Iter 188: loss 0.21455. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 189: loss 0.22378. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 189: loss 0.22378. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 190: loss 0.22843. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 25 Iter 190: loss 0.22843. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 25 Iter 191: loss 0.23251. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 25 Iter 191: loss 0.23251. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 25 Iter 192: loss 0.25623. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 25 Iter 192: loss 0.25623. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 25 Iter 193: loss 0.23531. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 25 Iter 193: loss 0.23531. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 25 Iter 194: loss 0.22374. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.06it/s]
Epoch 25 Iter 194: loss 0.22374. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 25 Iter 195: loss 0.24436. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 25 Iter 195: loss 0.24436. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 25 Iter 196: loss 0.22761. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 25 Iter 196: loss 0.22761. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 197: loss 0.22471. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 197: loss 0.22471. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 198: loss 0.22631. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 25 Iter 198: loss 0.22631. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.09it/s]
Epoch 25 Iter 199: loss 0.24861. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.09it/s]
Epoch 25 Iter 199: loss 0.24861. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.08it/s]
Epoch 25 Iter 200: loss 0.22449. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.08it/s]
Epoch 25 Iter 200: loss 0.22449. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.23860. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.23860. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.21646. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.21646. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 25 Iter 203: loss 0.23717. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 203: loss 0.23717. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 204: loss 0.23452. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 204: loss 0.23452. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 25 Iter 205: loss 0.23324. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 25 Iter 205: loss 0.23324. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 25 Iter 206: loss 0.23969. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 25 Iter 206: loss 0.23969. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 25 Iter 207: loss 0.24647. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 25 Iter 207: loss 0.24647. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 25 Iter 208: loss 0.22569. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 25 Iter 208: loss 0.22569. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 25 Iter 209: loss 0.23372. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 25 Iter 209: loss 0.23372. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 25 Iter 210: loss 0.22595. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 25 Iter 210: loss 0.22595. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 25 Iter 211: loss 0.23226. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 25 Iter 211: loss 0.23226. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 25 Iter 212: loss 0.25323. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 25 Iter 212: loss 0.25323. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 25 Iter 213: loss 0.23055. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 25 Iter 213: loss 0.23055. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 25 Iter 214: loss 0.25736. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 25 Iter 214: loss 0.25736. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 25 Iter 215: loss 0.22731. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.07it/s]
Epoch 25 Iter 215: loss 0.22731. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 25 Iter 216: loss 0.24409. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 25 Iter 216: loss 0.24409. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 25 Iter 217: loss 0.24176. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 25 Iter 217: loss 0.24176. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 25 Iter 218: loss 0.25144. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 25 Iter 218: loss 0.25144. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 25 Iter 219: loss 0.23502. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.08it/s]
Epoch 25 Iter 219: loss 0.23502. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 25 Iter 220: loss 0.24531. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 25 Iter 220: loss 0.24531. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 25 Iter 221: loss 0.23717. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.08it/s]
Epoch 25 Iter 221: loss 0.23717. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 25 Iter 222: loss 0.21779. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 25 Iter 222: loss 0.21779. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 25 Iter 223: loss 0.22497. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.08it/s]
Epoch 25 Iter 223: loss 0.22497. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 25 Iter 224: loss 0.21932. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 25 Iter 224: loss 0.21932. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 25 Iter 224: loss 0.21932. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.2336
    Valid loss: 0.23553
       Valid loss recons: 0.22507
       Valid loss KL-D:   1.04629
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.22384. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.22384. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 26 Iter 2: loss 0.21920. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 26 Iter 2: loss 0.21920. :   1%|▍                                             | 2/224 [00:00<01:47,  2.06it/s]
Epoch 26 Iter 3: loss 0.24280. :   1%|▍                                             | 2/224 [00:01<01:47,  2.06it/s]
Epoch 26 Iter 3: loss 0.24280. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 26 Iter 4: loss 0.23644. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 26 Iter 4: loss 0.23644. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 26 Iter 5: loss 0.21361. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 5: loss 0.21361. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 6: loss 0.23504. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 6: loss 0.23504. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.06it/s]
Epoch 26 Iter 7: loss 0.24647. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.06it/s]
Epoch 26 Iter 7: loss 0.24647. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 26 Iter 8: loss 0.23481. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 26 Iter 8: loss 0.23481. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 26 Iter 9: loss 0.23386. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 26 Iter 9: loss 0.23386. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 26 Iter 10: loss 0.20983. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 26 Iter 10: loss 0.20983. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 26 Iter 11: loss 0.22574. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 26 Iter 11: loss 0.22574. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 26 Iter 12: loss 0.22299. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 26 Iter 12: loss 0.22299. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.06it/s]
Epoch 26 Iter 13: loss 0.24837. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 13: loss 0.24837. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 14: loss 0.26211. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 14: loss 0.26211. :   6%|██▊                                         | 14/224 [00:06<01:40,  2.08it/s]
Epoch 26 Iter 15: loss 0.23593. :   6%|██▊                                         | 14/224 [00:07<01:40,  2.08it/s]
Epoch 26 Iter 15: loss 0.23593. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 26 Iter 16: loss 0.23151. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 26 Iter 16: loss 0.23151. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 26 Iter 17: loss 0.24063. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 26 Iter 17: loss 0.24063. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 26 Iter 18: loss 0.24906. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 26 Iter 18: loss 0.24906. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 26 Iter 19: loss 0.23075. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 26 Iter 19: loss 0.23075. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 26 Iter 20: loss 0.21763. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 26 Iter 20: loss 0.21763. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.06it/s]
Epoch 26 Iter 21: loss 0.24370. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.06it/s]
Epoch 26 Iter 21: loss 0.24370. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.07it/s]
Epoch 26 Iter 22: loss 0.23811. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.07it/s]
Epoch 26 Iter 22: loss 0.23811. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 26 Iter 23: loss 0.22367. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 26 Iter 23: loss 0.22367. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 26 Iter 24: loss 0.23369. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 26 Iter 24: loss 0.23369. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 26 Iter 25: loss 0.23537. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 26 Iter 25: loss 0.23537. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 26 Iter 26: loss 0.22361. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 26 Iter 26: loss 0.22361. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 26 Iter 27: loss 0.21316. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 27: loss 0.21316. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 28: loss 0.22521. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 28: loss 0.22521. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 26 Iter 29: loss 0.23426. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 26 Iter 29: loss 0.23426. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 26 Iter 30: loss 0.22504. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 26 Iter 30: loss 0.22504. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 26 Iter 31: loss 0.23053. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 26 Iter 31: loss 0.23053. :  14%|██████                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 26 Iter 32: loss 0.21700. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 26 Iter 32: loss 0.21700. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 26 Iter 33: loss 0.22546. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 26 Iter 33: loss 0.22546. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 26 Iter 34: loss 0.24050. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 26 Iter 34: loss 0.24050. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 26 Iter 35: loss 0.23086. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 26 Iter 35: loss 0.23086. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 26 Iter 36: loss 0.24691. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 26 Iter 36: loss 0.24691. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 26 Iter 37: loss 0.23574. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 26 Iter 37: loss 0.23574. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 26 Iter 38: loss 0.22778. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 26 Iter 38: loss 0.22778. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 26 Iter 39: loss 0.23235. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 26 Iter 39: loss 0.23235. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.07it/s]
Epoch 26 Iter 40: loss 0.23680. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.07it/s]
Epoch 26 Iter 40: loss 0.23680. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 26 Iter 41: loss 0.20880. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 26 Iter 41: loss 0.20880. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 26 Iter 42: loss 0.22064. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 26 Iter 42: loss 0.22064. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 26 Iter 43: loss 0.23673. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 26 Iter 43: loss 0.23673. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 26 Iter 44: loss 0.23601. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 26 Iter 44: loss 0.23601. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 26 Iter 45: loss 0.22093. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 26 Iter 45: loss 0.22093. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 26 Iter 46: loss 0.23563. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 26 Iter 46: loss 0.23563. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 47: loss 0.22983. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 47: loss 0.22983. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 26 Iter 48: loss 0.23142. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 26 Iter 48: loss 0.23142. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 26 Iter 49: loss 0.23357. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 26 Iter 49: loss 0.23357. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.08it/s]
Epoch 26 Iter 50: loss 0.23218. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.08it/s]
Epoch 26 Iter 50: loss 0.23218. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 26 Iter 51: loss 0.24968. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 26 Iter 51: loss 0.24968. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 26 Iter 52: loss 0.23586. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 26 Iter 52: loss 0.23586. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 26 Iter 53: loss 0.24292. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 26 Iter 53: loss 0.24292. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 26 Iter 54: loss 0.22448. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 26 Iter 54: loss 0.22448. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 26 Iter 55: loss 0.21908. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 26 Iter 55: loss 0.21908. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.04it/s]
Epoch 26 Iter 56: loss 0.22553. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.04it/s]
Epoch 26 Iter 56: loss 0.22553. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 57: loss 0.23074. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 57: loss 0.23074. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 26 Iter 58: loss 0.23158. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 26 Iter 58: loss 0.23158. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 26 Iter 59: loss 0.24358. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 26 Iter 59: loss 0.24358. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.22939. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.22939. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.24278. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.24278. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 26 Iter 62: loss 0.23467. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 26 Iter 62: loss 0.23467. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.07it/s]
Epoch 26 Iter 63: loss 0.22709. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 26 Iter 63: loss 0.22709. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 26 Iter 64: loss 0.23646. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 26 Iter 64: loss 0.23646. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.08it/s]
Epoch 26 Iter 65: loss 0.23687. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.08it/s]
Epoch 26 Iter 65: loss 0.23687. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 26 Iter 66: loss 0.22944. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 26 Iter 66: loss 0.22944. :  29%|████████████▉                               | 66/224 [00:31<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.23567. :  29%|████████████▉                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.23567. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 68: loss 0.22373. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 68: loss 0.22373. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 69: loss 0.23497. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.08it/s]
Epoch 26 Iter 69: loss 0.23497. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.09it/s]
Epoch 26 Iter 70: loss 0.23114. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.09it/s]
Epoch 26 Iter 70: loss 0.23114. :  31%|█████████████▊                              | 70/224 [00:33<01:13,  2.09it/s]
Epoch 26 Iter 71: loss 0.21776. :  31%|█████████████▊                              | 70/224 [00:34<01:13,  2.09it/s]
Epoch 26 Iter 71: loss 0.21776. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 26 Iter 72: loss 0.23957. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 26 Iter 72: loss 0.23957. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 26 Iter 73: loss 0.21713. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 26 Iter 73: loss 0.21713. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 26 Iter 74: loss 0.23198. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 26 Iter 74: loss 0.23198. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.08it/s]
Epoch 26 Iter 75: loss 0.23143. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 26 Iter 75: loss 0.23143. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 26 Iter 76: loss 0.24711. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 26 Iter 76: loss 0.24711. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 26 Iter 77: loss 0.23640. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 26 Iter 77: loss 0.23640. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 26 Iter 78: loss 0.21687. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 26 Iter 78: loss 0.21687. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 26 Iter 79: loss 0.24316. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 26 Iter 79: loss 0.24316. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 26 Iter 80: loss 0.22411. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 26 Iter 80: loss 0.22411. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 26 Iter 81: loss 0.24081. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 81: loss 0.24081. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 82: loss 0.23365. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 82: loss 0.23365. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 26 Iter 83: loss 0.24117. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 26 Iter 83: loss 0.24117. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 26 Iter 84: loss 0.22667. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 26 Iter 84: loss 0.22667. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 26 Iter 85: loss 0.23773. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 26 Iter 85: loss 0.23773. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 26 Iter 86: loss 0.25271. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 26 Iter 86: loss 0.25271. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 26 Iter 87: loss 0.23683. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 26 Iter 87: loss 0.23683. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 26 Iter 88: loss 0.23717. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.09it/s]
Epoch 26 Iter 88: loss 0.23717. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.09it/s]
Epoch 26 Iter 89: loss 0.23298. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.09it/s]
Epoch 26 Iter 89: loss 0.23298. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 26 Iter 90: loss 0.23708. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 26 Iter 90: loss 0.23708. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.09it/s]
Epoch 26 Iter 91: loss 0.22530. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.09it/s]
Epoch 26 Iter 91: loss 0.22530. :  41%|█████████████████▉                          | 91/224 [00:43<01:03,  2.08it/s]
Epoch 26 Iter 92: loss 0.23482. :  41%|█████████████████▉                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 26 Iter 92: loss 0.23482. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 26 Iter 93: loss 0.23692. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 26 Iter 93: loss 0.23692. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.22505. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.22505. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.06it/s]
Epoch 26 Iter 95: loss 0.23510. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.06it/s]
Epoch 26 Iter 95: loss 0.23510. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.06it/s]
Epoch 26 Iter 96: loss 0.23301. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 26 Iter 96: loss 0.23301. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 26 Iter 97: loss 0.25177. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 26 Iter 97: loss 0.25177. :  43%|███████████████████                         | 97/224 [00:46<01:00,  2.08it/s]
Epoch 26 Iter 98: loss 0.24170. :  43%|███████████████████                         | 97/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 98: loss 0.24170. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 99: loss 0.20976. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 99: loss 0.20976. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 26 Iter 100: loss 0.23559. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 26 Iter 100: loss 0.23559. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 26 Iter 101: loss 0.22722. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 26 Iter 101: loss 0.22722. :  45%|██████████████████▉                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 26 Iter 102: loss 0.24074. :  45%|██████████████████▉                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 26 Iter 102: loss 0.24074. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 26 Iter 103: loss 0.20940. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 26 Iter 103: loss 0.20940. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.08it/s]
Epoch 26 Iter 104: loss 0.25168. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.08it/s]
Epoch 26 Iter 104: loss 0.25168. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 26 Iter 105: loss 0.23351. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 26 Iter 105: loss 0.23351. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 26 Iter 106: loss 0.21893. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 26 Iter 106: loss 0.21893. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 26 Iter 107: loss 0.22069. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 26 Iter 107: loss 0.22069. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 26 Iter 108: loss 0.23648. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 108: loss 0.23648. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 109: loss 0.22818. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 109: loss 0.22818. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 26 Iter 110: loss 0.25701. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 110: loss 0.25701. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 111: loss 0.23598. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 111: loss 0.23598. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 26 Iter 112: loss 0.23325. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 26 Iter 112: loss 0.23325. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 26 Iter 113: loss 0.23345. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 26 Iter 113: loss 0.23345. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 26 Iter 114: loss 0.25242. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 114: loss 0.25242. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 26 Iter 115: loss 0.21342. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 26 Iter 115: loss 0.21342. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.08it/s]
Epoch 26 Iter 116: loss 0.26580. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.08it/s]
Epoch 26 Iter 116: loss 0.26580. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.08it/s]
Epoch 26 Iter 117: loss 0.24155. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.08it/s]
Epoch 26 Iter 117: loss 0.24155. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 26 Iter 118: loss 0.24639. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 26 Iter 118: loss 0.24639. :  53%|██████████████████████▏                   | 118/224 [00:56<00:50,  2.08it/s]
Epoch 26 Iter 119: loss 0.22664. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.08it/s]
Epoch 26 Iter 119: loss 0.22664. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 26 Iter 120: loss 0.24729. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 26 Iter 120: loss 0.24729. :  54%|██████████████████████▌                   | 120/224 [00:57<00:50,  2.07it/s]
Epoch 26 Iter 121: loss 0.24338. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 26 Iter 121: loss 0.24338. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 26 Iter 122: loss 0.22305. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 26 Iter 122: loss 0.22305. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 26 Iter 123: loss 0.24719. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 26 Iter 123: loss 0.24719. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 26 Iter 124: loss 0.25438. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 26 Iter 124: loss 0.25438. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.06it/s]
Epoch 26 Iter 125: loss 0.24010. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 125: loss 0.24010. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 126: loss 0.22600. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 126: loss 0.22600. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 26 Iter 127: loss 0.24344. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 26 Iter 127: loss 0.24344. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 26 Iter 128: loss 0.22987. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 26 Iter 128: loss 0.22987. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 26 Iter 129: loss 0.23298. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 26 Iter 129: loss 0.23298. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.08it/s]
Epoch 26 Iter 130: loss 0.23148. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.08it/s]
Epoch 26 Iter 130: loss 0.23148. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.08it/s]
Epoch 26 Iter 131: loss 0.23792. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 26 Iter 131: loss 0.23792. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 26 Iter 132: loss 0.24146. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 26 Iter 132: loss 0.24146. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 26 Iter 133: loss 0.23271. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 26 Iter 133: loss 0.23271. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 26 Iter 134: loss 0.24784. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 26 Iter 134: loss 0.24784. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 26 Iter 135: loss 0.24467. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 26 Iter 135: loss 0.24467. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 26 Iter 136: loss 0.21245. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 26 Iter 136: loss 0.21245. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 26 Iter 137: loss 0.22550. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 26 Iter 137: loss 0.22550. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 26 Iter 138: loss 0.24825. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 26 Iter 138: loss 0.24825. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 26 Iter 139: loss 0.23295. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 26 Iter 139: loss 0.23295. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 26 Iter 140: loss 0.22222. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 26 Iter 140: loss 0.22222. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.08it/s]
Epoch 26 Iter 141: loss 0.21593. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.08it/s]
Epoch 26 Iter 141: loss 0.21593. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.09it/s]
Epoch 26 Iter 142: loss 0.25124. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.09it/s]
Epoch 26 Iter 142: loss 0.25124. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.09it/s]
Epoch 26 Iter 143: loss 0.22977. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.09it/s]
Epoch 26 Iter 143: loss 0.22977. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 26 Iter 144: loss 0.23263. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 26 Iter 144: loss 0.23263. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 26 Iter 145: loss 0.23905. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 26 Iter 145: loss 0.23905. :  65%|███████████████████████████▏              | 145/224 [01:09<00:38,  2.07it/s]
Epoch 26 Iter 146: loss 0.22549. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 26 Iter 146: loss 0.22549. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 26 Iter 147: loss 0.22369. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 26 Iter 147: loss 0.22369. :  66%|███████████████████████████▌              | 147/224 [01:10<00:37,  2.07it/s]
Epoch 26 Iter 148: loss 0.25546. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 26 Iter 148: loss 0.25546. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 26 Iter 149: loss 0.23461. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 26 Iter 149: loss 0.23461. :  67%|███████████████████████████▉              | 149/224 [01:11<00:36,  2.06it/s]
Epoch 26 Iter 150: loss 0.23061. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 26 Iter 150: loss 0.23061. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 26 Iter 151: loss 0.23550. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 26 Iter 151: loss 0.23550. :  67%|████████████████████████████▎             | 151/224 [01:12<00:35,  2.07it/s]
Epoch 26 Iter 152: loss 0.25626. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 26 Iter 152: loss 0.25626. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 26 Iter 153: loss 0.23438. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 26 Iter 153: loss 0.23438. :  68%|████████████████████████████▋             | 153/224 [01:13<00:34,  2.05it/s]
Epoch 26 Iter 154: loss 0.24119. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 26 Iter 154: loss 0.24119. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 155: loss 0.23877. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 26 Iter 155: loss 0.23877. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 26 Iter 156: loss 0.21340. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 26 Iter 156: loss 0.21340. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 26 Iter 157: loss 0.24642. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 26 Iter 157: loss 0.24642. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.08it/s]
Epoch 26 Iter 158: loss 0.24857. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 26 Iter 158: loss 0.24857. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 26 Iter 159: loss 0.22715. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 26 Iter 159: loss 0.22715. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 26 Iter 160: loss 0.23427. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 26 Iter 160: loss 0.23427. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 26 Iter 161: loss 0.24808. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 26 Iter 161: loss 0.24808. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 26 Iter 162: loss 0.24272. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 26 Iter 162: loss 0.24272. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 26 Iter 163: loss 0.22720. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 26 Iter 163: loss 0.22720. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 26 Iter 164: loss 0.25122. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 26 Iter 164: loss 0.25122. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 26 Iter 165: loss 0.21936. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 26 Iter 165: loss 0.21936. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 26 Iter 166: loss 0.23877. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 26 Iter 166: loss 0.23877. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 167: loss 0.22807. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 167: loss 0.22807. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.06it/s]
Epoch 26 Iter 168: loss 0.22462. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.06it/s]
Epoch 26 Iter 168: loss 0.22462. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 26 Iter 169: loss 0.23046. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 26 Iter 169: loss 0.23046. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 26 Iter 170: loss 0.21896. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 170: loss 0.21896. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 171: loss 0.22053. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 26 Iter 171: loss 0.22053. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 26 Iter 172: loss 0.22175. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 26 Iter 172: loss 0.22175. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 26 Iter 173: loss 0.21588. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 26 Iter 173: loss 0.21588. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 26 Iter 174: loss 0.22322. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 26 Iter 174: loss 0.22322. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 26 Iter 175: loss 0.25370. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 26 Iter 175: loss 0.25370. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 26 Iter 176: loss 0.22263. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 26 Iter 176: loss 0.22263. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 26 Iter 177: loss 0.22604. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 26 Iter 177: loss 0.22604. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 26 Iter 178: loss 0.21861. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 26 Iter 178: loss 0.21861. :  79%|█████████████████████████████████▍        | 178/224 [01:25<00:22,  2.07it/s]
Epoch 26 Iter 179: loss 0.21871. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 26 Iter 179: loss 0.21871. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 26 Iter 180: loss 0.23888. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 26 Iter 180: loss 0.23888. :  80%|█████████████████████████████████▊        | 180/224 [01:26<00:21,  2.07it/s]
Epoch 26 Iter 181: loss 0.25349. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 26 Iter 181: loss 0.25349. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.24722. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.24722. :  81%|██████████████████████████████████▏       | 182/224 [01:27<00:20,  2.06it/s]
Epoch 26 Iter 183: loss 0.25319. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 26 Iter 183: loss 0.25319. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 26 Iter 184: loss 0.23885. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 26 Iter 184: loss 0.23885. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.22113. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.22113. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.23610. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.23610. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 26 Iter 187: loss 0.20913. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 26 Iter 187: loss 0.20913. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.24259. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.24259. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.23557. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.23557. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 26 Iter 190: loss 0.22715. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 26 Iter 190: loss 0.22715. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 26 Iter 191: loss 0.22898. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 26 Iter 191: loss 0.22898. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 26 Iter 192: loss 0.24519. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 26 Iter 192: loss 0.24519. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.08it/s]
Epoch 26 Iter 193: loss 0.23308. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 26 Iter 193: loss 0.23308. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 26 Iter 194: loss 0.23857. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 26 Iter 194: loss 0.23857. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 26 Iter 195: loss 0.22887. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 195: loss 0.22887. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 196: loss 0.20869. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 196: loss 0.20869. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.23356. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.23356. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 198: loss 0.25488. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 198: loss 0.25488. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 26 Iter 199: loss 0.23636. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 26 Iter 199: loss 0.23636. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 26 Iter 200: loss 0.22613. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 26 Iter 200: loss 0.22613. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.22997. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.22997. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 202: loss 0.22631. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 202: loss 0.22631. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 26 Iter 203: loss 0.23568. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 203: loss 0.23568. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.23179. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.23179. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 26 Iter 205: loss 0.24586. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 26 Iter 205: loss 0.24586. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 26 Iter 206: loss 0.20747. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 26 Iter 206: loss 0.20747. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 26 Iter 207: loss 0.23349. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 26 Iter 207: loss 0.23349. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 26 Iter 208: loss 0.24511. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 26 Iter 208: loss 0.24511. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 26 Iter 209: loss 0.25092. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 26 Iter 209: loss 0.25092. :  93%|███████████████████████████████████████▏  | 209/224 [01:40<00:07,  2.08it/s]
Epoch 26 Iter 210: loss 0.23505. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 26 Iter 210: loss 0.23505. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.09it/s]
Epoch 26 Iter 211: loss 0.24114. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.09it/s]
Epoch 26 Iter 211: loss 0.24114. :  94%|███████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.10it/s]
Epoch 26 Iter 212: loss 0.22409. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.10it/s]
Epoch 26 Iter 212: loss 0.22409. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 26 Iter 213: loss 0.22176. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 26 Iter 213: loss 0.22176. :  95%|███████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.06it/s]
Epoch 26 Iter 214: loss 0.24537. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 26 Iter 214: loss 0.24537. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 26 Iter 215: loss 0.23808. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 26 Iter 215: loss 0.23808. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.06it/s]
Epoch 26 Iter 216: loss 0.22696. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 26 Iter 216: loss 0.22696. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 26 Iter 217: loss 0.22332. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 26 Iter 217: loss 0.22332. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.06it/s]
Epoch 26 Iter 218: loss 0.24045. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 26 Iter 218: loss 0.24045. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 26 Iter 219: loss 0.24062. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 26 Iter 219: loss 0.24062. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 26 Iter 220: loss 0.25481. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 26 Iter 220: loss 0.25481. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 26 Iter 221: loss 0.23754. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 26 Iter 221: loss 0.23754. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 26 Iter 222: loss 0.24452. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 26 Iter 222: loss 0.24452. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 26 Iter 223: loss 0.23666. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 26 Iter 223: loss 0.23666. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 26 Iter 224: loss 0.25110. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 26 Iter 224: loss 0.25110. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 26 Iter 224: loss 0.25110. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.22305. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.22305. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 27 Iter 2: loss 0.22336. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 27 Iter 2: loss 0.22336. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 27 Iter 3: loss 0.23508. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 27 Iter 3: loss 0.23508. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 27 Iter 4: loss 0.23158. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 27 Iter 4: loss 0.23158. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 27 Iter 5: loss 0.22626. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 27 Iter 5: loss 0.22626. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 27 Iter 6: loss 0.24071. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 27 Iter 6: loss 0.24071. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 27 Iter 7: loss 0.24325. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 27 Iter 7: loss 0.24325. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 27 Iter 8: loss 0.21517. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 27 Iter 8: loss 0.21517. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 27 Iter 9: loss 0.23193. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 27 Iter 9: loss 0.23193. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 27 Iter 10: loss 0.23392. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 27 Iter 10: loss 0.23392. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.06it/s]
Epoch 27 Iter 11: loss 0.23118. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.06it/s]
Epoch 27 Iter 11: loss 0.23118. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 27 Iter 12: loss 0.22142. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 27 Iter 12: loss 0.22142. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 27 Iter 13: loss 0.22406. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 27 Iter 13: loss 0.22406. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 27 Iter 14: loss 0.21928. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 27 Iter 14: loss 0.21928. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 27 Iter 15: loss 0.23432. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 27 Iter 15: loss 0.23432. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 27 Iter 16: loss 0.21064. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 27 Iter 16: loss 0.21064. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 27 Iter 17: loss 0.22497. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 27 Iter 17: loss 0.22497. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 27 Iter 18: loss 0.21427. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 27 Iter 18: loss 0.21427. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.06it/s]
Epoch 27 Iter 19: loss 0.24255. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.06it/s]
Epoch 27 Iter 19: loss 0.24255. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 27 Iter 20: loss 0.23038. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 27 Iter 20: loss 0.23038. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.06it/s]
Epoch 27 Iter 21: loss 0.23750. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.06it/s]
Epoch 27 Iter 21: loss 0.23750. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 27 Iter 22: loss 0.24308. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 27 Iter 22: loss 0.24308. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 27 Iter 23: loss 0.22756. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 27 Iter 23: loss 0.22756. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 27 Iter 24: loss 0.23130. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 27 Iter 24: loss 0.23130. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 27 Iter 25: loss 0.23713. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 27 Iter 25: loss 0.23713. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 27 Iter 26: loss 0.20853. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 27 Iter 26: loss 0.20853. :  12%|█████                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 27 Iter 27: loss 0.22731. :  12%|█████                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 27 Iter 27: loss 0.22731. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 27 Iter 28: loss 0.21893. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 27 Iter 28: loss 0.21893. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.08it/s]
Epoch 27 Iter 29: loss 0.24163. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.08it/s]
Epoch 27 Iter 29: loss 0.24163. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 27 Iter 30: loss 0.22927. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 27 Iter 30: loss 0.22927. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 27 Iter 31: loss 0.22765. :  13%|█████▉                                      | 30/224 [00:15<01:33,  2.07it/s]
Epoch 27 Iter 31: loss 0.22765. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 27 Iter 32: loss 0.22487. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 27 Iter 32: loss 0.22487. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 27 Iter 33: loss 0.23214. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 27 Iter 33: loss 0.23214. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.06it/s]
Epoch 27 Iter 34: loss 0.23442. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 27 Iter 34: loss 0.23442. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 27 Iter 35: loss 0.23650. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 27 Iter 35: loss 0.23650. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 27 Iter 36: loss 0.23853. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 27 Iter 36: loss 0.23853. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 27 Iter 37: loss 0.23938. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 27 Iter 37: loss 0.23938. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 27 Iter 38: loss 0.21863. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 38: loss 0.21863. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 39: loss 0.23659. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 39: loss 0.23659. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 27 Iter 40: loss 0.23514. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 40: loss 0.23514. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 41: loss 0.22198. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 41: loss 0.22198. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 27 Iter 42: loss 0.22926. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 27 Iter 42: loss 0.22926. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 27 Iter 43: loss 0.25333. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 27 Iter 43: loss 0.25333. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 27 Iter 44: loss 0.24025. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 27 Iter 44: loss 0.24025. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 27 Iter 45: loss 0.24526. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 27 Iter 45: loss 0.24526. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 27 Iter 46: loss 0.25875. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 27 Iter 46: loss 0.25875. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 27 Iter 47: loss 0.24015. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 27 Iter 47: loss 0.24015. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 27 Iter 48: loss 0.25003. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 27 Iter 48: loss 0.25003. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 27 Iter 49: loss 0.22952. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 27 Iter 49: loss 0.22952. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 27 Iter 50: loss 0.22094. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 27 Iter 50: loss 0.22094. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 27 Iter 51: loss 0.24068. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 27 Iter 51: loss 0.24068. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 27 Iter 52: loss 0.24384. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 27 Iter 52: loss 0.24384. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 27 Iter 53: loss 0.23512. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 27 Iter 53: loss 0.23512. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 27 Iter 54: loss 0.25106. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 27 Iter 54: loss 0.25106. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 27 Iter 55: loss 0.24397. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 27 Iter 55: loss 0.24397. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 27 Iter 56: loss 0.23557. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 27 Iter 56: loss 0.23557. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 27 Iter 57: loss 0.23140. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 27 Iter 57: loss 0.23140. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 27 Iter 58: loss 0.21791. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 27 Iter 58: loss 0.21791. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 27 Iter 59: loss 0.23680. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 27 Iter 59: loss 0.23680. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.08it/s]
Epoch 27 Iter 60: loss 0.25515. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.08it/s]
Epoch 27 Iter 60: loss 0.25515. :  27%|███████████▊                                | 60/224 [00:29<01:18,  2.09it/s]
Epoch 27 Iter 61: loss 0.22718. :  27%|███████████▊                                | 60/224 [00:29<01:18,  2.09it/s]
Epoch 27 Iter 61: loss 0.22718. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 27 Iter 62: loss 0.23243. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 27 Iter 62: loss 0.23243. :  28%|████████████▏                               | 62/224 [00:30<01:19,  2.05it/s]
Epoch 27 Iter 63: loss 0.21483. :  28%|████████████▏                               | 62/224 [00:30<01:19,  2.05it/s]
Epoch 27 Iter 63: loss 0.21483. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 27 Iter 64: loss 0.23121. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 27 Iter 64: loss 0.23121. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 27 Iter 65: loss 0.22576. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 27 Iter 65: loss 0.22576. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 27 Iter 66: loss 0.23330. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 27 Iter 66: loss 0.23330. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 27 Iter 67: loss 0.22135. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 27 Iter 67: loss 0.22135. :  30%|█████████████▏                              | 67/224 [00:32<01:14,  2.11it/s]
Epoch 27 Iter 68: loss 0.26420. :  30%|█████████████▏                              | 67/224 [00:32<01:14,  2.11it/s]
Epoch 27 Iter 68: loss 0.26420. :  30%|█████████████▎                              | 68/224 [00:32<01:14,  2.10it/s]
Epoch 27 Iter 69: loss 0.24837. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.10it/s]
Epoch 27 Iter 69: loss 0.24837. :  31%|█████████████▌                              | 69/224 [00:33<01:13,  2.11it/s]
Epoch 27 Iter 70: loss 0.23749. :  31%|█████████████▌                              | 69/224 [00:33<01:13,  2.11it/s]
Epoch 27 Iter 70: loss 0.23749. :  31%|█████████████▊                              | 70/224 [00:33<01:13,  2.10it/s]
Epoch 27 Iter 71: loss 0.22259. :  31%|█████████████▊                              | 70/224 [00:34<01:13,  2.10it/s]
Epoch 27 Iter 71: loss 0.22259. :  32%|█████████████▉                              | 71/224 [00:34<01:12,  2.10it/s]
Epoch 27 Iter 72: loss 0.21792. :  32%|█████████████▉                              | 71/224 [00:34<01:12,  2.10it/s]
Epoch 27 Iter 72: loss 0.21792. :  32%|██████████████▏                             | 72/224 [00:34<01:12,  2.09it/s]
Epoch 27 Iter 73: loss 0.23121. :  32%|██████████████▏                             | 72/224 [00:35<01:12,  2.09it/s]
Epoch 27 Iter 73: loss 0.23121. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 27 Iter 74: loss 0.22055. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 27 Iter 74: loss 0.22055. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 27 Iter 75: loss 0.24277. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 27 Iter 75: loss 0.24277. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 27 Iter 76: loss 0.23476. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 27 Iter 76: loss 0.23476. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 27 Iter 77: loss 0.24140. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 27 Iter 77: loss 0.24140. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 27 Iter 78: loss 0.23292. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 27 Iter 78: loss 0.23292. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 27 Iter 79: loss 0.22461. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 27 Iter 79: loss 0.22461. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 27 Iter 80: loss 0.21722. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 27 Iter 80: loss 0.21722. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 27 Iter 81: loss 0.24073. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 27 Iter 81: loss 0.24073. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 27 Iter 82: loss 0.23881. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 27 Iter 82: loss 0.23881. :  37%|████████████████                            | 82/224 [00:39<01:07,  2.09it/s]
Epoch 27 Iter 83: loss 0.24474. :  37%|████████████████                            | 82/224 [00:40<01:07,  2.09it/s]
Epoch 27 Iter 83: loss 0.24474. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 27 Iter 84: loss 0.23156. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 27 Iter 84: loss 0.23156. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 27 Iter 85: loss 0.24405. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 27 Iter 85: loss 0.24405. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.09it/s]
Epoch 27 Iter 86: loss 0.23251. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.09it/s]
Epoch 27 Iter 86: loss 0.23251. :  38%|████████████████▉                           | 86/224 [00:41<01:05,  2.10it/s]
Epoch 27 Iter 87: loss 0.23433. :  38%|████████████████▉                           | 86/224 [00:41<01:05,  2.10it/s]
Epoch 27 Iter 87: loss 0.23433. :  39%|█████████████████                           | 87/224 [00:41<01:05,  2.10it/s]
Epoch 27 Iter 88: loss 0.24910. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.10it/s]
Epoch 27 Iter 88: loss 0.24910. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.08it/s]
Epoch 27 Iter 89: loss 0.25116. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.08it/s]
Epoch 27 Iter 89: loss 0.25116. :  40%|█████████████████▍                          | 89/224 [00:42<01:05,  2.08it/s]
Epoch 27 Iter 90: loss 0.23894. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.08it/s]
Epoch 27 Iter 90: loss 0.23894. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 27 Iter 91: loss 0.22067. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 27 Iter 91: loss 0.22067. :  41%|█████████████████▉                          | 91/224 [00:43<01:03,  2.09it/s]
Epoch 27 Iter 92: loss 0.21772. :  41%|█████████████████▉                          | 91/224 [00:44<01:03,  2.09it/s]
Epoch 27 Iter 92: loss 0.21772. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 27 Iter 93: loss 0.22018. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 27 Iter 93: loss 0.22018. :  42%|██████████████████▎                         | 93/224 [00:44<01:02,  2.09it/s]
Epoch 27 Iter 94: loss 0.23325. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.09it/s]
Epoch 27 Iter 94: loss 0.23325. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.09it/s]
Epoch 27 Iter 95: loss 0.22436. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.09it/s]
Epoch 27 Iter 95: loss 0.22436. :  42%|██████████████████▋                         | 95/224 [00:45<01:01,  2.09it/s]
Epoch 27 Iter 96: loss 0.24973. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.09it/s]
Epoch 27 Iter 96: loss 0.24973. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.24773. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.24773. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.24709. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.24709. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.23908. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.23908. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.22046. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.22046. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 27 Iter 101: loss 0.22474. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 27 Iter 101: loss 0.22474. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 27 Iter 102: loss 0.22353. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 27 Iter 102: loss 0.22353. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 27 Iter 103: loss 0.21867. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 27 Iter 103: loss 0.21867. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.22345. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.22345. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.23351. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.23351. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 106: loss 0.24327. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 27 Iter 106: loss 0.24327. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 27 Iter 107: loss 0.23484. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 27 Iter 107: loss 0.23484. :  48%|████████████████████                      | 107/224 [00:51<00:55,  2.09it/s]
Epoch 27 Iter 108: loss 0.23800. :  48%|████████████████████                      | 107/224 [00:52<00:55,  2.09it/s]
Epoch 27 Iter 108: loss 0.23800. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.09it/s]
Epoch 27 Iter 109: loss 0.23196. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.09it/s]
Epoch 27 Iter 109: loss 0.23196. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.08it/s]
Epoch 27 Iter 110: loss 0.22523. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.08it/s]
Epoch 27 Iter 110: loss 0.22523. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 27 Iter 111: loss 0.23726. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 27 Iter 111: loss 0.23726. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.09it/s]
Epoch 27 Iter 112: loss 0.23408. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.09it/s]
Epoch 27 Iter 112: loss 0.23408. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 27 Iter 113: loss 0.22726. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 27 Iter 113: loss 0.22726. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.08it/s]
Epoch 27 Iter 114: loss 0.22855. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.08it/s]
Epoch 27 Iter 114: loss 0.22855. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 27 Iter 115: loss 0.24438. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 27 Iter 115: loss 0.24438. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 27 Iter 116: loss 0.20711. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 27 Iter 116: loss 0.20711. :  52%|█████████████████████▊                    | 116/224 [00:55<00:52,  2.06it/s]
Epoch 27 Iter 117: loss 0.21962. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 27 Iter 117: loss 0.21962. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 27 Iter 118: loss 0.24595. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 27 Iter 118: loss 0.24595. :  53%|██████████████████████▏                   | 118/224 [00:56<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.23013. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.23013. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.22420. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.22420. :  54%|██████████████████████▌                   | 120/224 [00:57<00:50,  2.06it/s]
Epoch 27 Iter 121: loss 0.23177. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 27 Iter 121: loss 0.23177. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 27 Iter 122: loss 0.23243. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 27 Iter 122: loss 0.23243. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.23275. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.23275. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 27 Iter 124: loss 0.21756. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 27 Iter 124: loss 0.21756. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.07it/s]
Epoch 27 Iter 125: loss 0.22449. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 27 Iter 125: loss 0.22449. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 27 Iter 126: loss 0.23372. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 27 Iter 126: loss 0.23372. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 27 Iter 127: loss 0.24382. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 27 Iter 127: loss 0.24382. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 27 Iter 128: loss 0.22591. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 27 Iter 128: loss 0.22591. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 27 Iter 129: loss 0.23013. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 129: loss 0.23013. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 27 Iter 130: loss 0.24513. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 27 Iter 130: loss 0.24513. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.24645. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.24645. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 27 Iter 132: loss 0.25568. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 27 Iter 132: loss 0.25568. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 27 Iter 133: loss 0.23975. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 27 Iter 133: loss 0.23975. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 134: loss 0.22884. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 134: loss 0.22884. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 135: loss 0.21003. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 27 Iter 135: loss 0.21003. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 136: loss 0.23526. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 136: loss 0.23526. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 27 Iter 137: loss 0.22924. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 27 Iter 137: loss 0.22924. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 27 Iter 138: loss 0.24080. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 27 Iter 138: loss 0.24080. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 27 Iter 139: loss 0.21211. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 27 Iter 139: loss 0.21211. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 27 Iter 140: loss 0.23654. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 27 Iter 140: loss 0.23654. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 27 Iter 141: loss 0.21713. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 27 Iter 141: loss 0.21713. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 27 Iter 142: loss 0.23160. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 27 Iter 142: loss 0.23160. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 27 Iter 143: loss 0.25528. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 27 Iter 143: loss 0.25528. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 27 Iter 144: loss 0.21713. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 27 Iter 144: loss 0.21713. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 27 Iter 145: loss 0.26331. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 27 Iter 145: loss 0.26331. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 27 Iter 146: loss 0.24547. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 27 Iter 146: loss 0.24547. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 27 Iter 147: loss 0.23702. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 27 Iter 147: loss 0.23702. :  66%|███████████████████████████▌              | 147/224 [01:10<00:37,  2.06it/s]
Epoch 27 Iter 148: loss 0.22826. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 27 Iter 148: loss 0.22826. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 27 Iter 149: loss 0.24012. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 27 Iter 149: loss 0.24012. :  67%|███████████████████████████▉              | 149/224 [01:11<00:36,  2.06it/s]
Epoch 27 Iter 150: loss 0.23239. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 27 Iter 150: loss 0.23239. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 151: loss 0.22427. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 151: loss 0.22427. :  67%|████████████████████████████▎             | 151/224 [01:12<00:35,  2.07it/s]
Epoch 27 Iter 152: loss 0.24641. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 27 Iter 152: loss 0.24641. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 27 Iter 153: loss 0.23899. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 27 Iter 153: loss 0.23899. :  68%|████████████████████████████▋             | 153/224 [01:13<00:34,  2.06it/s]
Epoch 27 Iter 154: loss 0.24041. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 27 Iter 154: loss 0.24041. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 27 Iter 155: loss 0.23501. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 27 Iter 155: loss 0.23501. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 27 Iter 156: loss 0.24353. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 27 Iter 156: loss 0.24353. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 27 Iter 157: loss 0.21159. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 27 Iter 157: loss 0.21159. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.06it/s]
Epoch 27 Iter 158: loss 0.23115. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 27 Iter 158: loss 0.23115. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 27 Iter 159: loss 0.21540. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 27 Iter 159: loss 0.21540. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 27 Iter 160: loss 0.22105. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 27 Iter 160: loss 0.22105. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 27 Iter 161: loss 0.23519. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 27 Iter 161: loss 0.23519. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.07it/s]
Epoch 27 Iter 162: loss 0.23022. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 27 Iter 162: loss 0.23022. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 27 Iter 163: loss 0.22462. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 27 Iter 163: loss 0.22462. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 27 Iter 164: loss 0.24215. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 27 Iter 164: loss 0.24215. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 27 Iter 165: loss 0.25971. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 27 Iter 165: loss 0.25971. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.21668. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.21668. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 167: loss 0.22289. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 167: loss 0.22289. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 27 Iter 168: loss 0.22244. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 27 Iter 168: loss 0.22244. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 27 Iter 169: loss 0.22571. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 27 Iter 169: loss 0.22571. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 27 Iter 170: loss 0.23882. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 27 Iter 170: loss 0.23882. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.08it/s]
Epoch 27 Iter 171: loss 0.21011. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.08it/s]
Epoch 27 Iter 171: loss 0.21011. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 27 Iter 172: loss 0.23595. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 27 Iter 172: loss 0.23595. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 173: loss 0.23283. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 173: loss 0.23283. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 27 Iter 174: loss 0.22770. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 174: loss 0.22770. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 175: loss 0.24495. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 175: loss 0.24495. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 27 Iter 176: loss 0.25895. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 27 Iter 176: loss 0.25895. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 27 Iter 177: loss 0.24605. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 27 Iter 177: loss 0.24605. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.09it/s]
Epoch 27 Iter 178: loss 0.25766. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.09it/s]
Epoch 27 Iter 178: loss 0.25766. :  79%|█████████████████████████████████▍        | 178/224 [01:25<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.24548. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.24548. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 27 Iter 180: loss 0.24191. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 27 Iter 180: loss 0.24191. :  80%|█████████████████████████████████▊        | 180/224 [01:26<00:21,  2.07it/s]
Epoch 27 Iter 181: loss 0.22383. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 27 Iter 181: loss 0.22383. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 27 Iter 182: loss 0.23360. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 27 Iter 182: loss 0.23360. :  81%|██████████████████████████████████▏       | 182/224 [01:27<00:20,  2.08it/s]
Epoch 27 Iter 183: loss 0.23051. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 27 Iter 183: loss 0.23051. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 27 Iter 184: loss 0.19321. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 27 Iter 184: loss 0.19321. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.07it/s]
Epoch 27 Iter 185: loss 0.23884. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 27 Iter 185: loss 0.23884. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 27 Iter 186: loss 0.24116. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 27 Iter 186: loss 0.24116. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 27 Iter 187: loss 0.24133. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 27 Iter 187: loss 0.24133. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.23586. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.23586. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 27 Iter 189: loss 0.23180. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 27 Iter 189: loss 0.23180. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 27 Iter 190: loss 0.23929. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 27 Iter 190: loss 0.23929. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 27 Iter 191: loss 0.20835. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 27 Iter 191: loss 0.20835. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 192: loss 0.23574. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 192: loss 0.23574. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 27 Iter 193: loss 0.23889. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 193: loss 0.23889. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 27 Iter 194: loss 0.21825. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 27 Iter 194: loss 0.21825. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 27 Iter 195: loss 0.25470. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 27 Iter 195: loss 0.25470. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 27 Iter 196: loss 0.22978. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 27 Iter 196: loss 0.22978. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.08it/s]
Epoch 27 Iter 197: loss 0.24539. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 27 Iter 197: loss 0.24539. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 27 Iter 198: loss 0.23771. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 27 Iter 198: loss 0.23771. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.08it/s]
Epoch 27 Iter 199: loss 0.22630. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.08it/s]
Epoch 27 Iter 199: loss 0.22630. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 27 Iter 200: loss 0.25211. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 27 Iter 200: loss 0.25211. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 27 Iter 201: loss 0.24647. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 201: loss 0.24647. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 202: loss 0.23712. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 27 Iter 202: loss 0.23712. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 27 Iter 203: loss 0.24180. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 27 Iter 203: loss 0.24180. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 204: loss 0.25191. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 204: loss 0.25191. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.23964. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.23964. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 206: loss 0.24209. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 206: loss 0.24209. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.22781. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.22781. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.23187. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.23187. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.23941. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.23941. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.04it/s]
Epoch 27 Iter 210: loss 0.23792. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.04it/s]
Epoch 27 Iter 210: loss 0.23792. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.04it/s]
Epoch 27 Iter 211: loss 0.25991. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.04it/s]
Epoch 27 Iter 211: loss 0.25991. :  94%|███████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.04it/s]
Epoch 27 Iter 212: loss 0.25907. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 27 Iter 212: loss 0.25907. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.04it/s]
Epoch 27 Iter 213: loss 0.23745. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.04it/s]
Epoch 27 Iter 213: loss 0.23745. :  95%|███████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.07it/s]
Epoch 27 Iter 214: loss 0.25852. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 27 Iter 214: loss 0.25852. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.08it/s]
Epoch 27 Iter 215: loss 0.23461. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.08it/s]
Epoch 27 Iter 215: loss 0.23461. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.08it/s]
Epoch 27 Iter 216: loss 0.23812. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 27 Iter 216: loss 0.23812. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 27 Iter 217: loss 0.23755. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 27 Iter 217: loss 0.23755. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.08it/s]
Epoch 27 Iter 218: loss 0.24187. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 27 Iter 218: loss 0.24187. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 27 Iter 219: loss 0.21947. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 27 Iter 219: loss 0.21947. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 27 Iter 220: loss 0.22891. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 27 Iter 220: loss 0.22891. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 27 Iter 221: loss 0.24914. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 27 Iter 221: loss 0.24914. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 27 Iter 222: loss 0.25301. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 27 Iter 222: loss 0.25301. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 27 Iter 223: loss 0.21605. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 27 Iter 223: loss 0.21605. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 27 Iter 224: loss 0.24049. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 27 Iter 224: loss 0.24049. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 27 Iter 224: loss 0.24049. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23385
    Valid loss: 0.2362
       Valid loss recons: 0.22523
       Valid loss KL-D:   1.09725
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.23207. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.23207. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 28 Iter 2: loss 0.22627. :   0%|▏                                             | 1/224 [00:00<01:48,  2.05it/s]
Epoch 28 Iter 2: loss 0.22627. :   1%|▍                                             | 2/224 [00:00<01:48,  2.04it/s]
Epoch 28 Iter 3: loss 0.23509. :   1%|▍                                             | 2/224 [00:01<01:48,  2.04it/s]
Epoch 28 Iter 3: loss 0.23509. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 28 Iter 4: loss 0.22679. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 28 Iter 4: loss 0.22679. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 28 Iter 5: loss 0.21906. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 28 Iter 5: loss 0.21906. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 28 Iter 6: loss 0.23608. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 28 Iter 6: loss 0.23608. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 28 Iter 7: loss 0.23636. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 28 Iter 7: loss 0.23636. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.05it/s]
Epoch 28 Iter 8: loss 0.23854. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.05it/s]
Epoch 28 Iter 8: loss 0.23854. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.04it/s]
Epoch 28 Iter 9: loss 0.24407. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.04it/s]
Epoch 28 Iter 9: loss 0.24407. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 28 Iter 10: loss 0.25413. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 28 Iter 10: loss 0.25413. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.06it/s]
Epoch 28 Iter 11: loss 0.23522. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.06it/s]
Epoch 28 Iter 11: loss 0.23522. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 28 Iter 12: loss 0.23382. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 28 Iter 12: loss 0.23382. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 28 Iter 13: loss 0.24802. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 28 Iter 13: loss 0.24802. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.05it/s]
Epoch 28 Iter 14: loss 0.23622. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.05it/s]
Epoch 28 Iter 14: loss 0.23622. :   6%|██▊                                         | 14/224 [00:06<01:42,  2.05it/s]
Epoch 28 Iter 15: loss 0.23719. :   6%|██▊                                         | 14/224 [00:07<01:42,  2.05it/s]
Epoch 28 Iter 15: loss 0.23719. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 28 Iter 16: loss 0.22538. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 28 Iter 16: loss 0.22538. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 28 Iter 17: loss 0.23163. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 28 Iter 17: loss 0.23163. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 28 Iter 18: loss 0.24335. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 28 Iter 18: loss 0.24335. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.05it/s]
Epoch 28 Iter 19: loss 0.23817. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.05it/s]
Epoch 28 Iter 19: loss 0.23817. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 28 Iter 20: loss 0.24333. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 28 Iter 20: loss 0.24333. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.23137. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.23137. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.07it/s]
Epoch 28 Iter 22: loss 0.25057. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.07it/s]
Epoch 28 Iter 22: loss 0.25057. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.22220. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.22220. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 28 Iter 24: loss 0.24059. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 28 Iter 24: loss 0.24059. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.06it/s]
Epoch 28 Iter 25: loss 0.23992. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.06it/s]
Epoch 28 Iter 25: loss 0.23992. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 28 Iter 26: loss 0.24207. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 28 Iter 26: loss 0.24207. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 28 Iter 27: loss 0.21824. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 28 Iter 27: loss 0.21824. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 28 Iter 28: loss 0.22408. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 28 Iter 28: loss 0.22408. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.08it/s]
Epoch 28 Iter 29: loss 0.21619. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.08it/s]
Epoch 28 Iter 29: loss 0.21619. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 30: loss 0.23498. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 30: loss 0.23498. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.05it/s]
Epoch 28 Iter 31: loss 0.24652. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.05it/s]
Epoch 28 Iter 31: loss 0.24652. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 28 Iter 32: loss 0.26077. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 28 Iter 32: loss 0.26077. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 28 Iter 33: loss 0.23004. :  14%|██████▎                                     | 32/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 33: loss 0.23004. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 34: loss 0.22098. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 28 Iter 34: loss 0.22098. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.23252. :  15%|██████▋                                     | 34/224 [00:17<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.23252. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.04it/s]
Epoch 28 Iter 36: loss 0.22713. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.04it/s]
Epoch 28 Iter 36: loss 0.22713. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.22252. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.22252. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 28 Iter 38: loss 0.24163. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 28 Iter 38: loss 0.24163. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.25142. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.25142. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 28 Iter 40: loss 0.25843. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 28 Iter 40: loss 0.25843. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 28 Iter 41: loss 0.24447. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 28 Iter 41: loss 0.24447. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 28 Iter 42: loss 0.21961. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 28 Iter 42: loss 0.21961. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.21140. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.21140. :  19%|████████▍                                   | 43/224 [00:20<01:28,  2.04it/s]
Epoch 28 Iter 44: loss 0.22075. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 44: loss 0.22075. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 28 Iter 45: loss 0.24899. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 28 Iter 45: loss 0.24899. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.23156. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.23156. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 28 Iter 47: loss 0.22301. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 28 Iter 47: loss 0.22301. :  21%|█████████▏                                  | 47/224 [00:22<01:26,  2.04it/s]
Epoch 28 Iter 48: loss 0.21845. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.04it/s]
Epoch 28 Iter 48: loss 0.21845. :  21%|█████████▍                                  | 48/224 [00:23<01:26,  2.04it/s]
Epoch 28 Iter 49: loss 0.21642. :  21%|█████████▍                                  | 48/224 [00:23<01:26,  2.04it/s]
Epoch 28 Iter 49: loss 0.21642. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.05it/s]
Epoch 28 Iter 50: loss 0.21017. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.05it/s]
Epoch 28 Iter 50: loss 0.21017. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 28 Iter 51: loss 0.22560. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 28 Iter 51: loss 0.22560. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.23612. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.23612. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.21900. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.21900. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 28 Iter 54: loss 0.24021. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 28 Iter 54: loss 0.24021. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 28 Iter 55: loss 0.23663. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 28 Iter 55: loss 0.23663. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.24223. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.24223. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 28 Iter 57: loss 0.23688. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 28 Iter 57: loss 0.23688. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.06it/s]
Epoch 28 Iter 58: loss 0.21010. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.06it/s]
Epoch 28 Iter 58: loss 0.21010. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 28 Iter 59: loss 0.23067. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 28 Iter 59: loss 0.23067. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.22198. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.22198. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 28 Iter 61: loss 0.24951. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 28 Iter 61: loss 0.24951. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.22224. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.22224. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.24838. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.24838. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.23608. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.23608. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 28 Iter 65: loss 0.23469. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 28 Iter 65: loss 0.23469. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 28 Iter 66: loss 0.23274. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.07it/s]
Epoch 28 Iter 66: loss 0.23274. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 28 Iter 67: loss 0.25090. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 28 Iter 67: loss 0.25090. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.08it/s]
Epoch 28 Iter 68: loss 0.22120. :  30%|█████████████▏                              | 67/224 [00:33<01:15,  2.08it/s]
Epoch 28 Iter 68: loss 0.22120. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.08it/s]
Epoch 28 Iter 69: loss 0.21658. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.08it/s]
Epoch 28 Iter 69: loss 0.21658. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 70: loss 0.25650. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 70: loss 0.25650. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.08it/s]
Epoch 28 Iter 71: loss 0.23890. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.08it/s]
Epoch 28 Iter 71: loss 0.23890. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 28 Iter 72: loss 0.23563. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 28 Iter 72: loss 0.23563. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.08it/s]
Epoch 28 Iter 73: loss 0.21535. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.08it/s]
Epoch 28 Iter 73: loss 0.21535. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 28 Iter 74: loss 0.22395. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 28 Iter 74: loss 0.22395. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 28 Iter 75: loss 0.26298. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 75: loss 0.26298. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 76: loss 0.24645. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 76: loss 0.24645. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 28 Iter 77: loss 0.24945. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 28 Iter 77: loss 0.24945. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 28 Iter 78: loss 0.22689. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 28 Iter 78: loss 0.22689. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 28 Iter 79: loss 0.25360. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 28 Iter 79: loss 0.25360. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 28 Iter 80: loss 0.24614. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 28 Iter 80: loss 0.24614. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.08it/s]
Epoch 28 Iter 81: loss 0.22399. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.08it/s]
Epoch 28 Iter 81: loss 0.22399. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 28 Iter 82: loss 0.23291. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 28 Iter 82: loss 0.23291. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 28 Iter 83: loss 0.22191. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 83: loss 0.22191. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 84: loss 0.22787. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 84: loss 0.22787. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 28 Iter 85: loss 0.24220. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 28 Iter 85: loss 0.24220. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 28 Iter 86: loss 0.21519. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 28 Iter 86: loss 0.21519. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 28 Iter 87: loss 0.23075. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 28 Iter 87: loss 0.23075. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 28 Iter 88: loss 0.24393. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 28 Iter 88: loss 0.24393. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.06it/s]
Epoch 28 Iter 89: loss 0.23155. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.06it/s]
Epoch 28 Iter 89: loss 0.23155. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 28 Iter 90: loss 0.23117. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 28 Iter 90: loss 0.23117. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 28 Iter 91: loss 0.22782. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 28 Iter 91: loss 0.22782. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 92: loss 0.24121. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 92: loss 0.24121. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.21645. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.21645. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.23919. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.23919. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 28 Iter 95: loss 0.23074. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.06it/s]
Epoch 28 Iter 95: loss 0.23074. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.04it/s]
Epoch 28 Iter 96: loss 0.22658. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.04it/s]
Epoch 28 Iter 96: loss 0.22658. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 28 Iter 97: loss 0.21088. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 28 Iter 97: loss 0.21088. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 28 Iter 98: loss 0.24711. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 28 Iter 98: loss 0.24711. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 28 Iter 99: loss 0.21174. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 28 Iter 99: loss 0.21174. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 28 Iter 100: loss 0.21839. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 28 Iter 100: loss 0.21839. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 28 Iter 101: loss 0.24462. :  45%|██████████████████▊                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 28 Iter 101: loss 0.24462. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 28 Iter 102: loss 0.22372. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 28 Iter 102: loss 0.22372. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 28 Iter 103: loss 0.22575. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 28 Iter 103: loss 0.22575. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.24469. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.24469. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 105: loss 0.25593. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 105: loss 0.25593. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.22353. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.22353. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.23726. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.23726. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 28 Iter 108: loss 0.22143. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 28 Iter 108: loss 0.22143. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 28 Iter 109: loss 0.24061. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 28 Iter 109: loss 0.24061. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 28 Iter 110: loss 0.22029. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 28 Iter 110: loss 0.22029. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 28 Iter 111: loss 0.22390. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 28 Iter 111: loss 0.22390. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 28 Iter 112: loss 0.26029. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 28 Iter 112: loss 0.26029. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 28 Iter 113: loss 0.23452. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 28 Iter 113: loss 0.23452. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.08it/s]
Epoch 28 Iter 114: loss 0.22706. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.08it/s]
Epoch 28 Iter 114: loss 0.22706. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 28 Iter 115: loss 0.23180. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 28 Iter 115: loss 0.23180. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 28 Iter 116: loss 0.22619. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 28 Iter 116: loss 0.22619. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 28 Iter 117: loss 0.21947. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 28 Iter 117: loss 0.21947. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 28 Iter 118: loss 0.22383. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 28 Iter 118: loss 0.22383. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.08it/s]
Epoch 28 Iter 119: loss 0.21555. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.08it/s]
Epoch 28 Iter 119: loss 0.21555. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 28 Iter 120: loss 0.23641. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.07it/s]
Epoch 28 Iter 120: loss 0.23641. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 121: loss 0.23272. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 121: loss 0.23272. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 122: loss 0.24381. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 28 Iter 122: loss 0.24381. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.23035. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.23035. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 28 Iter 124: loss 0.23745. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 28 Iter 124: loss 0.23745. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.22284. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.22284. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.22674. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.22674. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 127: loss 0.22092. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 127: loss 0.22092. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 28 Iter 128: loss 0.22006. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 28 Iter 128: loss 0.22006. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 28 Iter 129: loss 0.25827. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 28 Iter 129: loss 0.25827. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 28 Iter 130: loss 0.23060. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.07it/s]
Epoch 28 Iter 130: loss 0.23060. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 28 Iter 131: loss 0.23822. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 28 Iter 131: loss 0.23822. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 132: loss 0.21364. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 132: loss 0.21364. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.24708. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.24708. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 28 Iter 134: loss 0.24221. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 28 Iter 134: loss 0.24221. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 28 Iter 135: loss 0.24599. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 28 Iter 135: loss 0.24599. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 28 Iter 136: loss 0.21698. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 28 Iter 136: loss 0.21698. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 28 Iter 137: loss 0.23908. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 28 Iter 137: loss 0.23908. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 28 Iter 138: loss 0.24766. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 28 Iter 138: loss 0.24766. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 28 Iter 139: loss 0.21855. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 28 Iter 139: loss 0.21855. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 28 Iter 140: loss 0.22943. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 28 Iter 140: loss 0.22943. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 28 Iter 141: loss 0.24546. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 141: loss 0.24546. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 142: loss 0.24237. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 142: loss 0.24237. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 28 Iter 143: loss 0.22628. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 28 Iter 143: loss 0.22628. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 28 Iter 144: loss 0.24963. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 28 Iter 144: loss 0.24963. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 28 Iter 145: loss 0.24715. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 28 Iter 145: loss 0.24715. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 28 Iter 146: loss 0.23785. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 28 Iter 146: loss 0.23785. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.23775. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.23775. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 28 Iter 148: loss 0.24574. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 28 Iter 148: loss 0.24574. :  66%|███████████████████████████▊              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 28 Iter 149: loss 0.22322. :  66%|███████████████████████████▊              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 28 Iter 149: loss 0.22322. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 28 Iter 150: loss 0.23623. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 28 Iter 150: loss 0.23623. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.04it/s]
Epoch 28 Iter 151: loss 0.24212. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 28 Iter 151: loss 0.24212. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 28 Iter 152: loss 0.22242. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 28 Iter 152: loss 0.22242. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 28 Iter 153: loss 0.21701. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 28 Iter 153: loss 0.21701. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 28 Iter 154: loss 0.24930. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 28 Iter 154: loss 0.24930. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 28 Iter 155: loss 0.24165. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 28 Iter 155: loss 0.24165. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 28 Iter 156: loss 0.22538. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 28 Iter 156: loss 0.22538. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 28 Iter 157: loss 0.21675. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 28 Iter 157: loss 0.21675. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 28 Iter 158: loss 0.24667. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 28 Iter 158: loss 0.24667. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 28 Iter 159: loss 0.21893. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.09it/s]
Epoch 28 Iter 159: loss 0.21893. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 28 Iter 160: loss 0.24331. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 28 Iter 160: loss 0.24331. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 28 Iter 161: loss 0.24157. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 28 Iter 161: loss 0.24157. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 28 Iter 162: loss 0.22860. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 28 Iter 162: loss 0.22860. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 28 Iter 163: loss 0.24637. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 28 Iter 163: loss 0.24637. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 28 Iter 164: loss 0.25440. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 28 Iter 164: loss 0.25440. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 28 Iter 165: loss 0.22235. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 28 Iter 165: loss 0.22235. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.04it/s]
Epoch 28 Iter 166: loss 0.24090. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.04it/s]
Epoch 28 Iter 166: loss 0.24090. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 28 Iter 167: loss 0.22730. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 28 Iter 167: loss 0.22730. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 28 Iter 168: loss 0.24864. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 168: loss 0.24864. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 169: loss 0.24718. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 28 Iter 169: loss 0.24718. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.04it/s]
Epoch 28 Iter 170: loss 0.23367. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.04it/s]
Epoch 28 Iter 170: loss 0.23367. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 28 Iter 171: loss 0.22694. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 28 Iter 171: loss 0.22694. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.04it/s]
Epoch 28 Iter 172: loss 0.24245. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.04it/s]
Epoch 28 Iter 172: loss 0.24245. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 28 Iter 173: loss 0.23538. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 28 Iter 173: loss 0.23538. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 28 Iter 174: loss 0.23389. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 28 Iter 174: loss 0.23389. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 28 Iter 175: loss 0.22762. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 28 Iter 175: loss 0.22762. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 28 Iter 176: loss 0.22349. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 28 Iter 176: loss 0.22349. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 28 Iter 177: loss 0.25130. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 28 Iter 177: loss 0.25130. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 28 Iter 178: loss 0.22751. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 28 Iter 178: loss 0.22751. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 28 Iter 179: loss 0.24873. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 28 Iter 179: loss 0.24873. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 28 Iter 180: loss 0.22788. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 28 Iter 180: loss 0.22788. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 28 Iter 181: loss 0.23436. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 28 Iter 181: loss 0.23436. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 28 Iter 182: loss 0.22180. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 28 Iter 182: loss 0.22180. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 28 Iter 183: loss 0.25103. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 28 Iter 183: loss 0.25103. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 28 Iter 184: loss 0.20935. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 28 Iter 184: loss 0.20935. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 28 Iter 185: loss 0.24347. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 28 Iter 185: loss 0.24347. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 28 Iter 186: loss 0.22889. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 28 Iter 186: loss 0.22889. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 28 Iter 187: loss 0.23133. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 28 Iter 187: loss 0.23133. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 28 Iter 188: loss 0.22467. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 188: loss 0.22467. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 189: loss 0.21400. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 189: loss 0.21400. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 28 Iter 190: loss 0.21704. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 28 Iter 190: loss 0.21704. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 28 Iter 191: loss 0.24723. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 28 Iter 191: loss 0.24723. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 28 Iter 192: loss 0.21985. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.08it/s]
Epoch 28 Iter 192: loss 0.21985. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 28 Iter 193: loss 0.25468. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 28 Iter 193: loss 0.25468. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 28 Iter 194: loss 0.23008. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:14,  2.07it/s]
Epoch 28 Iter 194: loss 0.23008. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 28 Iter 195: loss 0.23603. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 28 Iter 195: loss 0.23603. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 28 Iter 196: loss 0.23133. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 28 Iter 196: loss 0.23133. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 197: loss 0.22229. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 197: loss 0.22229. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 198: loss 0.25308. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 198: loss 0.25308. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 28 Iter 199: loss 0.22564. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 199: loss 0.22564. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 200: loss 0.22370. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 200: loss 0.22370. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 28 Iter 201: loss 0.22237. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 28 Iter 201: loss 0.22237. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 28 Iter 202: loss 0.25664. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 28 Iter 202: loss 0.25664. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 28 Iter 203: loss 0.25030. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 28 Iter 203: loss 0.25030. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 28 Iter 204: loss 0.22787. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 28 Iter 204: loss 0.22787. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 28 Iter 205: loss 0.23666. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 28 Iter 205: loss 0.23666. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 28 Iter 206: loss 0.23676. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 28 Iter 206: loss 0.23676. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 28 Iter 207: loss 0.23716. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 28 Iter 207: loss 0.23716. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 28 Iter 208: loss 0.24797. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 28 Iter 208: loss 0.24797. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 28 Iter 209: loss 0.21126. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 28 Iter 209: loss 0.21126. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 28 Iter 210: loss 0.23713. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 28 Iter 210: loss 0.23713. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.23541. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.23541. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.23754. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.23754. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.23371. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.23371. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 28 Iter 214: loss 0.25792. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 28 Iter 214: loss 0.25792. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 28 Iter 215: loss 0.24373. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.07it/s]
Epoch 28 Iter 215: loss 0.24373. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 28 Iter 216: loss 0.23071. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 28 Iter 216: loss 0.23071. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 28 Iter 217: loss 0.24716. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 28 Iter 217: loss 0.24716. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 28 Iter 218: loss 0.23976. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 28 Iter 218: loss 0.23976. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 28 Iter 219: loss 0.22854. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 28 Iter 219: loss 0.22854. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 28 Iter 220: loss 0.22811. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 28 Iter 220: loss 0.22811. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 28 Iter 221: loss 0.24018. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.07it/s]
Epoch 28 Iter 221: loss 0.24018. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 28 Iter 222: loss 0.23010. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 28 Iter 222: loss 0.23010. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 28 Iter 223: loss 0.22563. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 223: loss 0.22563. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.24641. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.24641. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.24641. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.23516. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.23516. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 29 Iter 2: loss 0.21795. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 29 Iter 2: loss 0.21795. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 29 Iter 3: loss 0.21241. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 29 Iter 3: loss 0.21241. :   1%|▌                                             | 3/224 [00:01<01:47,  2.07it/s]
Epoch 29 Iter 4: loss 0.22497. :   1%|▌                                             | 3/224 [00:01<01:47,  2.07it/s]
Epoch 29 Iter 4: loss 0.22497. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 29 Iter 5: loss 0.26520. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 29 Iter 5: loss 0.26520. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 29 Iter 6: loss 0.23394. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 29 Iter 6: loss 0.23394. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 29 Iter 7: loss 0.24824. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 29 Iter 7: loss 0.24824. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 29 Iter 8: loss 0.25791. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 29 Iter 8: loss 0.25791. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 29 Iter 9: loss 0.23898. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 9: loss 0.23898. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 10: loss 0.22413. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 10: loss 0.22413. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.24515. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.24515. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 29 Iter 12: loss 0.24397. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 29 Iter 12: loss 0.24397. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.06it/s]
Epoch 29 Iter 13: loss 0.22675. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.06it/s]
Epoch 29 Iter 13: loss 0.22675. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 29 Iter 14: loss 0.26258. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 29 Iter 14: loss 0.26258. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 29 Iter 15: loss 0.21899. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 29 Iter 15: loss 0.21899. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 29 Iter 16: loss 0.23386. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 29 Iter 16: loss 0.23386. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.05it/s]
Epoch 29 Iter 17: loss 0.22572. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.05it/s]
Epoch 29 Iter 17: loss 0.22572. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 29 Iter 18: loss 0.23291. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 29 Iter 18: loss 0.23291. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 29 Iter 19: loss 0.22881. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 29 Iter 19: loss 0.22881. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 29 Iter 20: loss 0.25750. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 29 Iter 20: loss 0.25750. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 29 Iter 21: loss 0.20943. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 29 Iter 21: loss 0.20943. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 22: loss 0.23031. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 22: loss 0.23031. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 23: loss 0.23595. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 29 Iter 23: loss 0.23595. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.23840. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.23840. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 25: loss 0.22818. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 29 Iter 25: loss 0.22818. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.23962. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.23962. :  12%|█████                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 29 Iter 27: loss 0.20471. :  12%|█████                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 29 Iter 27: loss 0.20471. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.04it/s]
Epoch 29 Iter 28: loss 0.22478. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.04it/s]
Epoch 29 Iter 28: loss 0.22478. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 29 Iter 29: loss 0.22622. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 29 Iter 29: loss 0.22622. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.04it/s]
Epoch 29 Iter 30: loss 0.22698. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.04it/s]
Epoch 29 Iter 30: loss 0.22698. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.05it/s]
Epoch 29 Iter 31: loss 0.23667. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.05it/s]
Epoch 29 Iter 31: loss 0.23667. :  14%|██████                                      | 31/224 [00:15<01:33,  2.05it/s]
Epoch 29 Iter 32: loss 0.22685. :  14%|██████                                      | 31/224 [00:15<01:33,  2.05it/s]
Epoch 29 Iter 32: loss 0.22685. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 29 Iter 33: loss 0.22549. :  14%|██████▎                                     | 32/224 [00:16<01:32,  2.07it/s]
Epoch 29 Iter 33: loss 0.22549. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 34: loss 0.25953. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 34: loss 0.25953. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 35: loss 0.23652. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 29 Iter 35: loss 0.23652. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 29 Iter 36: loss 0.23420. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 29 Iter 36: loss 0.23420. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 29 Iter 37: loss 0.21260. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 29 Iter 37: loss 0.21260. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 29 Iter 38: loss 0.24770. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 29 Iter 38: loss 0.24770. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 29 Iter 39: loss 0.25476. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 29 Iter 39: loss 0.25476. :  17%|███████▋                                    | 39/224 [00:18<01:28,  2.09it/s]
Epoch 29 Iter 40: loss 0.22053. :  17%|███████▋                                    | 39/224 [00:19<01:28,  2.09it/s]
Epoch 29 Iter 40: loss 0.22053. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 29 Iter 41: loss 0.22077. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 29 Iter 41: loss 0.22077. :  18%|████████                                    | 41/224 [00:19<01:28,  2.08it/s]
Epoch 29 Iter 42: loss 0.23689. :  18%|████████                                    | 41/224 [00:20<01:28,  2.08it/s]
Epoch 29 Iter 42: loss 0.23689. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 29 Iter 43: loss 0.23714. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 29 Iter 43: loss 0.23714. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 29 Iter 44: loss 0.23945. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 29 Iter 44: loss 0.23945. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 29 Iter 45: loss 0.23243. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 29 Iter 45: loss 0.23243. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 29 Iter 46: loss 0.25540. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 29 Iter 46: loss 0.25540. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 29 Iter 47: loss 0.21339. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 29 Iter 47: loss 0.21339. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 29 Iter 48: loss 0.23842. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 29 Iter 48: loss 0.23842. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 29 Iter 49: loss 0.23794. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 29 Iter 49: loss 0.23794. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 29 Iter 50: loss 0.22757. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 29 Iter 50: loss 0.22757. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 29 Iter 51: loss 0.22427. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 29 Iter 51: loss 0.22427. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 29 Iter 52: loss 0.21575. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 29 Iter 52: loss 0.21575. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 29 Iter 53: loss 0.23183. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 29 Iter 53: loss 0.23183. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 29 Iter 54: loss 0.24642. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 29 Iter 54: loss 0.24642. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 29 Iter 55: loss 0.24097. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 29 Iter 55: loss 0.24097. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.06it/s]
Epoch 29 Iter 56: loss 0.24154. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.06it/s]
Epoch 29 Iter 56: loss 0.24154. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 29 Iter 57: loss 0.23687. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 29 Iter 57: loss 0.23687. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 29 Iter 58: loss 0.22396. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 29 Iter 58: loss 0.22396. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 29 Iter 59: loss 0.22191. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 29 Iter 59: loss 0.22191. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 29 Iter 60: loss 0.23612. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 29 Iter 60: loss 0.23612. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 29 Iter 61: loss 0.22891. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 29 Iter 61: loss 0.22891. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 29 Iter 62: loss 0.26635. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 29 Iter 62: loss 0.26635. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 29 Iter 63: loss 0.21729. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 29 Iter 63: loss 0.21729. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 29 Iter 64: loss 0.23531. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.06it/s]
Epoch 29 Iter 64: loss 0.23531. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 29 Iter 65: loss 0.23353. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 29 Iter 65: loss 0.23353. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 29 Iter 66: loss 0.23682. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 29 Iter 66: loss 0.23682. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 29 Iter 67: loss 0.24054. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 29 Iter 67: loss 0.24054. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 29 Iter 68: loss 0.22610. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 29 Iter 68: loss 0.22610. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.07it/s]
Epoch 29 Iter 69: loss 0.24820. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 29 Iter 69: loss 0.24820. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 29 Iter 70: loss 0.22544. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 29 Iter 70: loss 0.22544. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.08it/s]
Epoch 29 Iter 71: loss 0.22627. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.08it/s]
Epoch 29 Iter 71: loss 0.22627. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 29 Iter 72: loss 0.23056. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 29 Iter 72: loss 0.23056. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 29 Iter 73: loss 0.22281. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 29 Iter 73: loss 0.22281. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 29 Iter 74: loss 0.23647. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 29 Iter 74: loss 0.23647. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 29 Iter 75: loss 0.21636. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 29 Iter 75: loss 0.21636. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 29 Iter 76: loss 0.22375. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 29 Iter 76: loss 0.22375. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 29 Iter 77: loss 0.25556. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 29 Iter 77: loss 0.25556. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 29 Iter 78: loss 0.24041. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 29 Iter 78: loss 0.24041. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 29 Iter 79: loss 0.23059. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 29 Iter 79: loss 0.23059. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 29 Iter 80: loss 0.22102. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 29 Iter 80: loss 0.22102. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 29 Iter 81: loss 0.25924. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 29 Iter 81: loss 0.25924. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 29 Iter 82: loss 0.23887. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 29 Iter 82: loss 0.23887. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 29 Iter 83: loss 0.22660. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 29 Iter 83: loss 0.22660. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.08it/s]
Epoch 29 Iter 84: loss 0.22717. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.08it/s]
Epoch 29 Iter 84: loss 0.22717. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.08it/s]
Epoch 29 Iter 85: loss 0.22694. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.08it/s]
Epoch 29 Iter 85: loss 0.22694. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 29 Iter 86: loss 0.21662. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 29 Iter 86: loss 0.21662. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 29 Iter 87: loss 0.24286. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 29 Iter 87: loss 0.24286. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 29 Iter 88: loss 0.22156. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 29 Iter 88: loss 0.22156. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 29 Iter 89: loss 0.23305. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.06it/s]
Epoch 29 Iter 89: loss 0.23305. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 29 Iter 90: loss 0.23886. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 29 Iter 90: loss 0.23886. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.06it/s]
Epoch 29 Iter 91: loss 0.21678. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.06it/s]
Epoch 29 Iter 91: loss 0.21678. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 29 Iter 92: loss 0.21686. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 29 Iter 92: loss 0.21686. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 29 Iter 93: loss 0.22650. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 29 Iter 93: loss 0.22650. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 29 Iter 94: loss 0.23307. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 29 Iter 94: loss 0.23307. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 29 Iter 95: loss 0.22133. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 29 Iter 95: loss 0.22133. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.08it/s]
Epoch 29 Iter 96: loss 0.23265. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.08it/s]
Epoch 29 Iter 96: loss 0.23265. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 29 Iter 97: loss 0.22593. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 29 Iter 97: loss 0.22593. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 29 Iter 98: loss 0.23563. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 29 Iter 98: loss 0.23563. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 99: loss 0.23423. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 99: loss 0.23423. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 100: loss 0.24375. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 29 Iter 100: loss 0.24375. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 101: loss 0.22714. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 101: loss 0.22714. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 102: loss 0.25582. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 29 Iter 102: loss 0.25582. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 29 Iter 103: loss 0.26674. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 29 Iter 103: loss 0.26674. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.08it/s]
Epoch 29 Iter 104: loss 0.23789. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.08it/s]
Epoch 29 Iter 104: loss 0.23789. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 29 Iter 105: loss 0.23250. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 29 Iter 105: loss 0.23250. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 29 Iter 106: loss 0.23261. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 29 Iter 106: loss 0.23261. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 29 Iter 107: loss 0.23361. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 29 Iter 107: loss 0.23361. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 29 Iter 108: loss 0.24530. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 29 Iter 108: loss 0.24530. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 29 Iter 109: loss 0.22293. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 29 Iter 109: loss 0.22293. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 29 Iter 110: loss 0.24194. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 29 Iter 110: loss 0.24194. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 29 Iter 111: loss 0.21700. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 29 Iter 111: loss 0.21700. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 29 Iter 112: loss 0.23325. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 29 Iter 112: loss 0.23325. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 29 Iter 113: loss 0.22168. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 29 Iter 113: loss 0.22168. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 29 Iter 114: loss 0.23367. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 29 Iter 114: loss 0.23367. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 29 Iter 115: loss 0.22746. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 29 Iter 115: loss 0.22746. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.03it/s]
Epoch 29 Iter 116: loss 0.24532. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.03it/s]
Epoch 29 Iter 116: loss 0.24532. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 117: loss 0.23945. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 117: loss 0.23945. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 29 Iter 118: loss 0.24609. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 29 Iter 118: loss 0.24609. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.22965. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.22965. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.04it/s]
Epoch 29 Iter 120: loss 0.23612. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.04it/s]
Epoch 29 Iter 120: loss 0.23612. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 29 Iter 121: loss 0.22444. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 29 Iter 121: loss 0.22444. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 29 Iter 122: loss 0.26021. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 29 Iter 122: loss 0.26021. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 29 Iter 123: loss 0.21971. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 29 Iter 123: loss 0.21971. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 29 Iter 124: loss 0.22723. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.08it/s]
Epoch 29 Iter 124: loss 0.22723. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 29 Iter 125: loss 0.23928. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 29 Iter 125: loss 0.23928. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 29 Iter 126: loss 0.24615. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 29 Iter 126: loss 0.24615. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 29 Iter 127: loss 0.24654. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 29 Iter 127: loss 0.24654. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.20953. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.20953. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 129: loss 0.23645. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 29 Iter 129: loss 0.23645. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 29 Iter 130: loss 0.22984. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 29 Iter 130: loss 0.22984. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.08it/s]
Epoch 29 Iter 131: loss 0.21566. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 29 Iter 131: loss 0.21566. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 29 Iter 132: loss 0.23472. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 29 Iter 132: loss 0.23472. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 29 Iter 133: loss 0.22849. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 29 Iter 133: loss 0.22849. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 29 Iter 134: loss 0.24629. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 29 Iter 134: loss 0.24629. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.23320. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.23320. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 29 Iter 136: loss 0.21955. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 29 Iter 136: loss 0.21955. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.08it/s]
Epoch 29 Iter 137: loss 0.21388. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.08it/s]
Epoch 29 Iter 137: loss 0.21388. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 29 Iter 138: loss 0.23986. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 29 Iter 138: loss 0.23986. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 29 Iter 139: loss 0.24056. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 29 Iter 139: loss 0.24056. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 29 Iter 140: loss 0.22175. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 29 Iter 140: loss 0.22175. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 29 Iter 141: loss 0.23620. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 29 Iter 141: loss 0.23620. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 142: loss 0.23128. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 142: loss 0.23128. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 143: loss 0.23395. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 29 Iter 143: loss 0.23395. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 29 Iter 144: loss 0.21974. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 29 Iter 144: loss 0.21974. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.09it/s]
Epoch 29 Iter 145: loss 0.21844. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.09it/s]
Epoch 29 Iter 145: loss 0.21844. :  65%|███████████████████████████▏              | 145/224 [01:10<00:37,  2.09it/s]
Epoch 29 Iter 146: loss 0.22222. :  65%|███████████████████████████▏              | 145/224 [01:10<00:37,  2.09it/s]
Epoch 29 Iter 146: loss 0.22222. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 29 Iter 147: loss 0.24063. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 29 Iter 147: loss 0.24063. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 29 Iter 148: loss 0.21775. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 29 Iter 148: loss 0.21775. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 29 Iter 149: loss 0.22102. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 29 Iter 149: loss 0.22102. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 150: loss 0.21909. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 150: loss 0.21909. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.06it/s]
Epoch 29 Iter 151: loss 0.24387. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.06it/s]
Epoch 29 Iter 151: loss 0.24387. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 29 Iter 152: loss 0.24824. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 29 Iter 152: loss 0.24824. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 29 Iter 153: loss 0.25160. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 29 Iter 153: loss 0.25160. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 29 Iter 154: loss 0.21934. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 29 Iter 154: loss 0.21934. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 29 Iter 155: loss 0.24489. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 155: loss 0.24489. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 29 Iter 156: loss 0.23299. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 29 Iter 156: loss 0.23299. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 157: loss 0.22188. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 29 Iter 157: loss 0.22188. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.06it/s]
Epoch 29 Iter 158: loss 0.24616. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 29 Iter 158: loss 0.24616. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.22475. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.22475. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.23188. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.23188. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 29 Iter 161: loss 0.23859. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 29 Iter 161: loss 0.23859. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.07it/s]
Epoch 29 Iter 162: loss 0.21660. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 29 Iter 162: loss 0.21660. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 29 Iter 163: loss 0.25165. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 29 Iter 163: loss 0.25165. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 29 Iter 164: loss 0.24280. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 29 Iter 164: loss 0.24280. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 29 Iter 165: loss 0.22092. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 29 Iter 165: loss 0.22092. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.24572. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.24572. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 167: loss 0.21521. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 167: loss 0.21521. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.23282. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.23282. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.23399. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.23399. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 29 Iter 170: loss 0.22474. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 170: loss 0.22474. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 171: loss 0.22625. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 29 Iter 171: loss 0.22625. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 29 Iter 172: loss 0.23670. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 172: loss 0.23670. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 173: loss 0.22346. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 173: loss 0.22346. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.10it/s]
Epoch 29 Iter 174: loss 0.23528. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.10it/s]
Epoch 29 Iter 174: loss 0.23528. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 29 Iter 175: loss 0.23538. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 29 Iter 175: loss 0.23538. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 29 Iter 176: loss 0.24931. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 29 Iter 176: loss 0.24931. :  79%|█████████████████████████████████         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 29 Iter 177: loss 0.23556. :  79%|█████████████████████████████████         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 29 Iter 177: loss 0.23556. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.09it/s]
Epoch 29 Iter 178: loss 0.23310. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.09it/s]
Epoch 29 Iter 178: loss 0.23310. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 29 Iter 179: loss 0.24862. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 29 Iter 179: loss 0.24862. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 29 Iter 180: loss 0.21460. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 180: loss 0.21460. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 181: loss 0.22777. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 29 Iter 181: loss 0.22777. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 29 Iter 182: loss 0.24100. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 29 Iter 182: loss 0.24100. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 29 Iter 183: loss 0.24369. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 29 Iter 183: loss 0.24369. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 29 Iter 184: loss 0.24441. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 29 Iter 184: loss 0.24441. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 29 Iter 185: loss 0.22622. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 29 Iter 185: loss 0.22622. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 29 Iter 186: loss 0.21930. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 29 Iter 186: loss 0.21930. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 29 Iter 187: loss 0.24524. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 29 Iter 187: loss 0.24524. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 29 Iter 188: loss 0.22787. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 29 Iter 188: loss 0.22787. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 29 Iter 189: loss 0.24444. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 29 Iter 189: loss 0.24444. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 29 Iter 190: loss 0.21771. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 29 Iter 190: loss 0.21771. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 29 Iter 191: loss 0.23018. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 29 Iter 191: loss 0.23018. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 29 Iter 192: loss 0.23955. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 29 Iter 192: loss 0.23955. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.05it/s]
Epoch 29 Iter 193: loss 0.23501. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 29 Iter 193: loss 0.23501. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 29 Iter 194: loss 0.24201. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 29 Iter 194: loss 0.24201. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.05it/s]
Epoch 29 Iter 195: loss 0.25232. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 29 Iter 195: loss 0.25232. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 29 Iter 196: loss 0.22747. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 29 Iter 196: loss 0.22747. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.23545. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.23545. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 29 Iter 198: loss 0.22937. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 29 Iter 198: loss 0.22937. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.23725. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.23725. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 200: loss 0.24706. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 200: loss 0.24706. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 29 Iter 201: loss 0.22347. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 29 Iter 201: loss 0.22347. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 29 Iter 202: loss 0.24253. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 29 Iter 202: loss 0.24253. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 29 Iter 203: loss 0.24569. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 29 Iter 203: loss 0.24569. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 29 Iter 204: loss 0.22550. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 29 Iter 204: loss 0.22550. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 29 Iter 205: loss 0.22261. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 29 Iter 205: loss 0.22261. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 29 Iter 206: loss 0.22408. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 29 Iter 206: loss 0.22408. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.04it/s]
Epoch 29 Iter 207: loss 0.24525. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 29 Iter 207: loss 0.24525. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.24025. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.24025. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.25731. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.25731. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 29 Iter 210: loss 0.23776. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 29 Iter 210: loss 0.23776. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.21617. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.21617. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 212: loss 0.26201. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 29 Iter 212: loss 0.26201. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 29 Iter 213: loss 0.24518. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 213: loss 0.24518. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.24407. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.24407. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.08it/s]
Epoch 29 Iter 215: loss 0.23951. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.08it/s]
Epoch 29 Iter 215: loss 0.23951. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 29 Iter 216: loss 0.22915. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 29 Iter 216: loss 0.22915. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.09it/s]
Epoch 29 Iter 217: loss 0.23041. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.09it/s]
Epoch 29 Iter 217: loss 0.23041. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.10it/s]
Epoch 29 Iter 218: loss 0.24290. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.10it/s]
Epoch 29 Iter 218: loss 0.24290. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.10it/s]
Epoch 29 Iter 219: loss 0.23417. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.10it/s]
Epoch 29 Iter 219: loss 0.23417. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.09it/s]
Epoch 29 Iter 220: loss 0.23812. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.09it/s]
Epoch 29 Iter 220: loss 0.23812. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.10it/s]
Epoch 29 Iter 221: loss 0.23496. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.10it/s]
Epoch 29 Iter 221: loss 0.23496. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.11it/s]
Epoch 29 Iter 222: loss 0.24262. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.11it/s]
Epoch 29 Iter 222: loss 0.24262. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.09it/s]
Epoch 29 Iter 223: loss 0.22142. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.09it/s]
Epoch 29 Iter 223: loss 0.22142. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.09it/s]
Epoch 29 Iter 224: loss 0.24697. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 29 Iter 224: loss 0.24697. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.10it/s]
Epoch 29 Iter 224: loss 0.24697. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23369
    Valid loss: 0.23551
       Valid loss recons: 0.22516
       Valid loss KL-D:   1.03501
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.22363. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.22363. :   0%|▏                                             | 1/224 [00:00<01:49,  2.04it/s]
Epoch 30 Iter 2: loss 0.21814. :   0%|▏                                             | 1/224 [00:00<01:49,  2.04it/s]
Epoch 30 Iter 2: loss 0.21814. :   1%|▍                                             | 2/224 [00:00<01:49,  2.03it/s]
Epoch 30 Iter 3: loss 0.23775. :   1%|▍                                             | 2/224 [00:01<01:49,  2.03it/s]
Epoch 30 Iter 3: loss 0.23775. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 30 Iter 4: loss 0.24125. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 30 Iter 4: loss 0.24125. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 30 Iter 5: loss 0.23468. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 30 Iter 5: loss 0.23468. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 30 Iter 6: loss 0.22627. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 30 Iter 6: loss 0.22627. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.06it/s]
Epoch 30 Iter 7: loss 0.23971. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.06it/s]
Epoch 30 Iter 7: loss 0.23971. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 30 Iter 8: loss 0.22481. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 30 Iter 8: loss 0.22481. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 30 Iter 9: loss 0.23913. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 30 Iter 9: loss 0.23913. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 30 Iter 10: loss 0.24200. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 30 Iter 10: loss 0.24200. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 30 Iter 11: loss 0.22192. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 11: loss 0.22192. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 12: loss 0.21184. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 30 Iter 12: loss 0.21184. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.08it/s]
Epoch 30 Iter 13: loss 0.23492. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.08it/s]
Epoch 30 Iter 13: loss 0.23492. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 30 Iter 14: loss 0.22891. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 30 Iter 14: loss 0.22891. :   6%|██▊                                         | 14/224 [00:06<01:40,  2.08it/s]
Epoch 30 Iter 15: loss 0.21764. :   6%|██▊                                         | 14/224 [00:07<01:40,  2.08it/s]
Epoch 30 Iter 15: loss 0.21764. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 16: loss 0.24695. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 16: loss 0.24695. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 17: loss 0.22066. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 30 Iter 17: loss 0.22066. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 30 Iter 18: loss 0.22458. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 30 Iter 18: loss 0.22458. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.08it/s]
Epoch 30 Iter 19: loss 0.22751. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.08it/s]
Epoch 30 Iter 19: loss 0.22751. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.09it/s]
Epoch 30 Iter 20: loss 0.22662. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.09it/s]
Epoch 30 Iter 20: loss 0.22662. :   9%|███▉                                        | 20/224 [00:09<01:37,  2.09it/s]
Epoch 30 Iter 21: loss 0.24687. :   9%|███▉                                        | 20/224 [00:10<01:37,  2.09it/s]
Epoch 30 Iter 21: loss 0.24687. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 30 Iter 22: loss 0.22732. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 30 Iter 22: loss 0.22732. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 30 Iter 23: loss 0.24202. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 30 Iter 23: loss 0.24202. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.21794. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.21794. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.23477. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.23477. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 30 Iter 26: loss 0.23451. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.08it/s]
Epoch 30 Iter 26: loss 0.23451. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 30 Iter 27: loss 0.24273. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 30 Iter 27: loss 0.24273. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 28: loss 0.24597. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 28: loss 0.24597. :  12%|█████▌                                      | 28/224 [00:13<01:36,  2.03it/s]
Epoch 30 Iter 29: loss 0.23276. :  12%|█████▌                                      | 28/224 [00:14<01:36,  2.03it/s]
Epoch 30 Iter 29: loss 0.23276. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.04it/s]
Epoch 30 Iter 30: loss 0.22706. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.04it/s]
Epoch 30 Iter 30: loss 0.22706. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.04it/s]
Epoch 30 Iter 31: loss 0.24947. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.04it/s]
Epoch 30 Iter 31: loss 0.24947. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.22872. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.22872. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 30 Iter 33: loss 0.24461. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 30 Iter 33: loss 0.24461. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 30 Iter 34: loss 0.22960. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 30 Iter 34: loss 0.22960. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 30 Iter 35: loss 0.23731. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 30 Iter 35: loss 0.23731. :  16%|██████▉                                     | 35/224 [00:16<01:30,  2.08it/s]
Epoch 30 Iter 36: loss 0.23742. :  16%|██████▉                                     | 35/224 [00:17<01:30,  2.08it/s]
Epoch 30 Iter 36: loss 0.23742. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 30 Iter 37: loss 0.26468. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 30 Iter 37: loss 0.26468. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 30 Iter 38: loss 0.24095. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 30 Iter 38: loss 0.24095. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 30 Iter 39: loss 0.22369. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 30 Iter 39: loss 0.22369. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 30 Iter 40: loss 0.24909. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 30 Iter 40: loss 0.24909. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 30 Iter 41: loss 0.22234. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 30 Iter 41: loss 0.22234. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 30 Iter 42: loss 0.21441. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 42: loss 0.21441. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 43: loss 0.22518. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 43: loss 0.22518. :  19%|████████▍                                   | 43/224 [00:20<01:28,  2.05it/s]
Epoch 30 Iter 44: loss 0.22649. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.05it/s]
Epoch 30 Iter 44: loss 0.22649. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 30 Iter 45: loss 0.22914. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 30 Iter 45: loss 0.22914. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.06it/s]
Epoch 30 Iter 46: loss 0.26166. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.06it/s]
Epoch 30 Iter 46: loss 0.26166. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 30 Iter 47: loss 0.22657. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 30 Iter 47: loss 0.22657. :  21%|█████████▏                                  | 47/224 [00:22<01:24,  2.08it/s]
Epoch 30 Iter 48: loss 0.22208. :  21%|█████████▏                                  | 47/224 [00:23<01:24,  2.08it/s]
Epoch 30 Iter 48: loss 0.22208. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.07it/s]
Epoch 30 Iter 49: loss 0.23580. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.07it/s]
Epoch 30 Iter 49: loss 0.23580. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 30 Iter 50: loss 0.22778. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 30 Iter 50: loss 0.22778. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 30 Iter 51: loss 0.24516. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 30 Iter 51: loss 0.24516. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.23114. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.23114. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 30 Iter 53: loss 0.23056. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 30 Iter 53: loss 0.23056. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 30 Iter 54: loss 0.22233. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 30 Iter 54: loss 0.22233. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 30 Iter 55: loss 0.22213. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 30 Iter 55: loss 0.22213. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 30 Iter 56: loss 0.25862. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 56: loss 0.25862. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 57: loss 0.21716. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 30 Iter 57: loss 0.21716. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.25146. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.25146. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.25089. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.25089. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 60: loss 0.22177. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.08it/s]
Epoch 30 Iter 60: loss 0.22177. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 30 Iter 61: loss 0.23442. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 30 Iter 61: loss 0.23442. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 30 Iter 62: loss 0.23674. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 30 Iter 62: loss 0.23674. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 63: loss 0.22704. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 63: loss 0.22704. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 30 Iter 64: loss 0.24061. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 30 Iter 64: loss 0.24061. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.06it/s]
Epoch 30 Iter 65: loss 0.22397. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 65: loss 0.22397. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.05it/s]
Epoch 30 Iter 66: loss 0.22824. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.05it/s]
Epoch 30 Iter 66: loss 0.22824. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 30 Iter 67: loss 0.23530. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 30 Iter 67: loss 0.23530. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.07it/s]
Epoch 30 Iter 68: loss 0.20663. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.07it/s]
Epoch 30 Iter 68: loss 0.20663. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.23420. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.23420. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 30 Iter 70: loss 0.22795. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 30 Iter 70: loss 0.22795. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 30 Iter 71: loss 0.25080. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 30 Iter 71: loss 0.25080. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 30 Iter 72: loss 0.25005. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 30 Iter 72: loss 0.25005. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.08it/s]
Epoch 30 Iter 73: loss 0.21711. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.08it/s]
Epoch 30 Iter 73: loss 0.21711. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 30 Iter 74: loss 0.23973. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 30 Iter 74: loss 0.23973. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.08it/s]
Epoch 30 Iter 75: loss 0.23457. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 30 Iter 75: loss 0.23457. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 30 Iter 76: loss 0.22381. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 30 Iter 76: loss 0.22381. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 30 Iter 77: loss 0.26211. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 30 Iter 77: loss 0.26211. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.09it/s]
Epoch 30 Iter 78: loss 0.23482. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.09it/s]
Epoch 30 Iter 78: loss 0.23482. :  35%|███████████████▎                            | 78/224 [00:37<01:09,  2.09it/s]
Epoch 30 Iter 79: loss 0.23962. :  35%|███████████████▎                            | 78/224 [00:38<01:09,  2.09it/s]
Epoch 30 Iter 79: loss 0.23962. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 30 Iter 80: loss 0.21539. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 30 Iter 80: loss 0.21539. :  36%|███████████████▋                            | 80/224 [00:38<01:08,  2.09it/s]
Epoch 30 Iter 81: loss 0.22684. :  36%|███████████████▋                            | 80/224 [00:39<01:08,  2.09it/s]
Epoch 30 Iter 81: loss 0.22684. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 30 Iter 82: loss 0.20834. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 30 Iter 82: loss 0.20834. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 30 Iter 83: loss 0.22710. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 83: loss 0.22710. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 84: loss 0.21780. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 30 Iter 84: loss 0.21780. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.08it/s]
Epoch 30 Iter 85: loss 0.25982. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.08it/s]
Epoch 30 Iter 85: loss 0.25982. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.10it/s]
Epoch 30 Iter 86: loss 0.21967. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.10it/s]
Epoch 30 Iter 86: loss 0.21967. :  38%|████████████████▉                           | 86/224 [00:41<01:05,  2.09it/s]
Epoch 30 Iter 87: loss 0.22892. :  38%|████████████████▉                           | 86/224 [00:42<01:05,  2.09it/s]
Epoch 30 Iter 87: loss 0.22892. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 30 Iter 88: loss 0.24376. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 30 Iter 88: loss 0.24376. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.08it/s]
Epoch 30 Iter 89: loss 0.21347. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.08it/s]
Epoch 30 Iter 89: loss 0.21347. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 30 Iter 90: loss 0.24337. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 30 Iter 90: loss 0.24337. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 30 Iter 91: loss 0.21271. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 30 Iter 91: loss 0.21271. :  41%|█████████████████▉                          | 91/224 [00:43<01:04,  2.07it/s]
Epoch 30 Iter 92: loss 0.22717. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 30 Iter 92: loss 0.22717. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 30 Iter 93: loss 0.21406. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 30 Iter 93: loss 0.21406. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 30 Iter 94: loss 0.24812. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 30 Iter 94: loss 0.24812. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 30 Iter 95: loss 0.25078. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 30 Iter 95: loss 0.25078. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.06it/s]
Epoch 30 Iter 96: loss 0.24441. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 96: loss 0.24441. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 97: loss 0.22528. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 30 Iter 97: loss 0.22528. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.22343. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.22343. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.23788. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.23788. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.23448. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.23448. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.22996. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.22996. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.25107. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.25107. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.25693. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.25693. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.24092. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.24092. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 30 Iter 105: loss 0.24689. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 30 Iter 105: loss 0.24689. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.23757. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.23757. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 30 Iter 107: loss 0.23141. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 30 Iter 107: loss 0.23141. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 30 Iter 108: loss 0.22800. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 30 Iter 108: loss 0.22800. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 30 Iter 109: loss 0.23679. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 30 Iter 109: loss 0.23679. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 30 Iter 110: loss 0.22051. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 30 Iter 110: loss 0.22051. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 30 Iter 111: loss 0.25033. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 30 Iter 111: loss 0.25033. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 30 Iter 112: loss 0.25703. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 30 Iter 112: loss 0.25703. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 30 Iter 113: loss 0.21009. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 30 Iter 113: loss 0.21009. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 30 Iter 114: loss 0.22187. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 30 Iter 114: loss 0.22187. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 30 Iter 115: loss 0.22081. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 30 Iter 115: loss 0.22081. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.06it/s]
Epoch 30 Iter 116: loss 0.24532. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.06it/s]
Epoch 30 Iter 116: loss 0.24532. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 30 Iter 117: loss 0.25215. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 30 Iter 117: loss 0.25215. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 30 Iter 118: loss 0.22982. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 30 Iter 118: loss 0.22982. :  53%|██████████████████████▏                   | 118/224 [00:57<00:52,  2.03it/s]
Epoch 30 Iter 119: loss 0.21838. :  53%|██████████████████████▏                   | 118/224 [00:57<00:52,  2.03it/s]
Epoch 30 Iter 119: loss 0.21838. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.04it/s]
Epoch 30 Iter 120: loss 0.22101. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.04it/s]
Epoch 30 Iter 120: loss 0.22101. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 30 Iter 121: loss 0.23437. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 30 Iter 121: loss 0.23437. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 30 Iter 122: loss 0.24263. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 30 Iter 122: loss 0.24263. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 30 Iter 123: loss 0.21531. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 30 Iter 123: loss 0.21531. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 30 Iter 124: loss 0.23711. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 30 Iter 124: loss 0.23711. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 30 Iter 125: loss 0.24039. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 30 Iter 125: loss 0.24039. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 30 Iter 126: loss 0.22508. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 30 Iter 126: loss 0.22508. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.06it/s]
Epoch 30 Iter 127: loss 0.23382. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 30 Iter 127: loss 0.23382. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 128: loss 0.21951. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 128: loss 0.21951. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 30 Iter 129: loss 0.22468. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 30 Iter 129: loss 0.22468. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 130: loss 0.23240. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 130: loss 0.23240. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.22976. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.22976. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 30 Iter 132: loss 0.24399. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 30 Iter 132: loss 0.24399. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 30 Iter 133: loss 0.24469. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 30 Iter 133: loss 0.24469. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 30 Iter 134: loss 0.23254. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 30 Iter 134: loss 0.23254. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 30 Iter 135: loss 0.21994. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 30 Iter 135: loss 0.21994. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 30 Iter 136: loss 0.26587. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 30 Iter 136: loss 0.26587. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 30 Iter 137: loss 0.23759. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 137: loss 0.23759. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 138: loss 0.23943. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 30 Iter 138: loss 0.23943. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 30 Iter 139: loss 0.24406. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 30 Iter 139: loss 0.24406. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.04it/s]
Epoch 30 Iter 140: loss 0.24386. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.04it/s]
Epoch 30 Iter 140: loss 0.24386. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 30 Iter 141: loss 0.22766. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 30 Iter 141: loss 0.22766. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 30 Iter 142: loss 0.21958. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 30 Iter 142: loss 0.21958. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 30 Iter 143: loss 0.24052. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 30 Iter 143: loss 0.24052. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 30 Iter 144: loss 0.23210. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 30 Iter 144: loss 0.23210. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 30 Iter 145: loss 0.23639. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 30 Iter 145: loss 0.23639. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 30 Iter 146: loss 0.21242. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 30 Iter 146: loss 0.21242. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 30 Iter 147: loss 0.22278. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 147: loss 0.22278. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.22998. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.22998. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 30 Iter 149: loss 0.23279. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 30 Iter 149: loss 0.23279. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 30 Iter 150: loss 0.25617. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 30 Iter 150: loss 0.25617. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 30 Iter 151: loss 0.24111. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 30 Iter 151: loss 0.24111. :  67%|████████████████████████████▎             | 151/224 [01:13<00:34,  2.09it/s]
Epoch 30 Iter 152: loss 0.23023. :  67%|████████████████████████████▎             | 151/224 [01:13<00:34,  2.09it/s]
Epoch 30 Iter 152: loss 0.23023. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 30 Iter 153: loss 0.25519. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 30 Iter 153: loss 0.25519. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 30 Iter 154: loss 0.24236. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 30 Iter 154: loss 0.24236. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.24945. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.24945. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.25030. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.25030. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 30 Iter 157: loss 0.22067. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 30 Iter 157: loss 0.22067. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.06it/s]
Epoch 30 Iter 158: loss 0.21916. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 30 Iter 158: loss 0.21916. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 30 Iter 159: loss 0.22183. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 30 Iter 159: loss 0.22183. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 30 Iter 160: loss 0.23947. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 30 Iter 160: loss 0.23947. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 30 Iter 161: loss 0.22415. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 30 Iter 161: loss 0.22415. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 30 Iter 162: loss 0.22031. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 30 Iter 162: loss 0.22031. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 30 Iter 163: loss 0.25246. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 30 Iter 163: loss 0.25246. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 30 Iter 164: loss 0.23088. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 30 Iter 164: loss 0.23088. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 30 Iter 165: loss 0.24143. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 30 Iter 165: loss 0.24143. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 30 Iter 166: loss 0.23217. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 30 Iter 166: loss 0.23217. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 30 Iter 167: loss 0.24010. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 30 Iter 167: loss 0.24010. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 30 Iter 168: loss 0.21764. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 168: loss 0.21764. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 169: loss 0.24171. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 169: loss 0.24171. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 30 Iter 170: loss 0.24142. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 30 Iter 170: loss 0.24142. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 30 Iter 171: loss 0.23169. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 30 Iter 171: loss 0.23169. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.23216. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.23216. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 30 Iter 173: loss 0.22416. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 30 Iter 173: loss 0.22416. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 30 Iter 174: loss 0.22869. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 30 Iter 174: loss 0.22869. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 30 Iter 175: loss 0.23813. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 30 Iter 175: loss 0.23813. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 30 Iter 176: loss 0.24844. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 30 Iter 176: loss 0.24844. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 30 Iter 177: loss 0.22563. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 30 Iter 177: loss 0.22563. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 30 Iter 178: loss 0.23009. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 30 Iter 178: loss 0.23009. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 30 Iter 179: loss 0.24528. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 30 Iter 179: loss 0.24528. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 30 Iter 180: loss 0.24052. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 30 Iter 180: loss 0.24052. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 30 Iter 181: loss 0.24154. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 30 Iter 181: loss 0.24154. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 30 Iter 182: loss 0.23870. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 30 Iter 182: loss 0.23870. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 30 Iter 183: loss 0.25108. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 30 Iter 183: loss 0.25108. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:20,  2.05it/s]
Epoch 30 Iter 184: loss 0.24440. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:20,  2.05it/s]
Epoch 30 Iter 184: loss 0.24440. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 30 Iter 185: loss 0.25079. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 30 Iter 185: loss 0.25079. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 30 Iter 186: loss 0.24605. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 30 Iter 186: loss 0.24605. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 30 Iter 187: loss 0.22381. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 30 Iter 187: loss 0.22381. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 30 Iter 188: loss 0.22043. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 30 Iter 188: loss 0.22043. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.08it/s]
Epoch 30 Iter 189: loss 0.22346. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.08it/s]
Epoch 30 Iter 189: loss 0.22346. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.10it/s]
Epoch 30 Iter 190: loss 0.23007. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.10it/s]
Epoch 30 Iter 190: loss 0.23007. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.11it/s]
Epoch 30 Iter 191: loss 0.23934. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.11it/s]
Epoch 30 Iter 191: loss 0.23934. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 30 Iter 192: loss 0.21068. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 30 Iter 192: loss 0.21068. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.09it/s]
Epoch 30 Iter 193: loss 0.22824. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.09it/s]
Epoch 30 Iter 193: loss 0.22824. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.10it/s]
Epoch 30 Iter 194: loss 0.22429. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.10it/s]
Epoch 30 Iter 194: loss 0.22429. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.10it/s]
Epoch 30 Iter 195: loss 0.23089. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.10it/s]
Epoch 30 Iter 195: loss 0.23089. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:13,  2.09it/s]
Epoch 30 Iter 196: loss 0.23315. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:13,  2.09it/s]
Epoch 30 Iter 196: loss 0.23315. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.08it/s]
Epoch 30 Iter 197: loss 0.24289. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 30 Iter 197: loss 0.24289. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 30 Iter 198: loss 0.22652. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 30 Iter 198: loss 0.22652. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 30 Iter 199: loss 0.23943. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 30 Iter 199: loss 0.23943. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 30 Iter 200: loss 0.23170. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 30 Iter 200: loss 0.23170. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 30 Iter 201: loss 0.20862. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 30 Iter 201: loss 0.20862. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 30 Iter 202: loss 0.20734. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 30 Iter 202: loss 0.20734. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 30 Iter 203: loss 0.23415. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 30 Iter 203: loss 0.23415. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 30 Iter 204: loss 0.24687. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 30 Iter 204: loss 0.24687. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 30 Iter 205: loss 0.22021. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 30 Iter 205: loss 0.22021. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 30 Iter 206: loss 0.23556. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 30 Iter 206: loss 0.23556. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.05it/s]
Epoch 30 Iter 207: loss 0.23041. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 30 Iter 207: loss 0.23041. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 30 Iter 208: loss 0.22739. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 30 Iter 208: loss 0.22739. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 30 Iter 209: loss 0.21639. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 30 Iter 209: loss 0.21639. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 30 Iter 210: loss 0.23402. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 30 Iter 210: loss 0.23402. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 30 Iter 211: loss 0.22792. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 30 Iter 211: loss 0.22792. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 30 Iter 212: loss 0.23026. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 30 Iter 212: loss 0.23026. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 30 Iter 213: loss 0.23722. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 213: loss 0.23722. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.25580. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.25580. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.23652. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.23652. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 216: loss 0.24990. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 216: loss 0.24990. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 30 Iter 217: loss 0.23801. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 217: loss 0.23801. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 30 Iter 218: loss 0.21624. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 30 Iter 218: loss 0.21624. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 30 Iter 219: loss 0.24133. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 30 Iter 219: loss 0.24133. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 30 Iter 220: loss 0.22472. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 30 Iter 220: loss 0.22472. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 30 Iter 221: loss 0.23798. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 30 Iter 221: loss 0.23798. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 30 Iter 222: loss 0.22747. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 30 Iter 222: loss 0.22747. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 30 Iter 223: loss 0.22497. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 30 Iter 223: loss 0.22497. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.24708. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.24708. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.09it/s]
Epoch 30 Iter 224: loss 0.24708. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.22457. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.22457. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.21365. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.21365. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.24650. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.24650. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 31 Iter 4: loss 0.23685. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 31 Iter 4: loss 0.23685. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 31 Iter 5: loss 0.23107. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 31 Iter 5: loss 0.23107. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 31 Iter 6: loss 0.23181. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 31 Iter 6: loss 0.23181. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 31 Iter 7: loss 0.23233. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 31 Iter 7: loss 0.23233. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 31 Iter 8: loss 0.22633. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 31 Iter 8: loss 0.22633. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 31 Iter 9: loss 0.22625. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 31 Iter 9: loss 0.22625. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.07it/s]
Epoch 31 Iter 10: loss 0.25387. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.07it/s]
Epoch 31 Iter 10: loss 0.25387. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.22167. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.22167. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.22889. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.22889. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.25319. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.25319. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.22705. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.22705. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 31 Iter 15: loss 0.22474. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 15: loss 0.22474. :   7%|██▉                                         | 15/224 [00:07<01:42,  2.05it/s]
Epoch 31 Iter 16: loss 0.22834. :   7%|██▉                                         | 15/224 [00:07<01:42,  2.05it/s]
Epoch 31 Iter 16: loss 0.22834. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 17: loss 0.22267. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 31 Iter 17: loss 0.22267. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 31 Iter 18: loss 0.22766. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 31 Iter 18: loss 0.22766. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.05it/s]
Epoch 31 Iter 19: loss 0.24272. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.05it/s]
Epoch 31 Iter 19: loss 0.24272. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 31 Iter 20: loss 0.24131. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 31 Iter 20: loss 0.24131. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.04it/s]
Epoch 31 Iter 21: loss 0.23390. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.04it/s]
Epoch 31 Iter 21: loss 0.23390. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 31 Iter 22: loss 0.21189. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 31 Iter 22: loss 0.21189. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 31 Iter 23: loss 0.20269. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 31 Iter 23: loss 0.20269. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 31 Iter 24: loss 0.24147. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 31 Iter 24: loss 0.24147. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.06it/s]
Epoch 31 Iter 25: loss 0.23962. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 25: loss 0.23962. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 26: loss 0.21824. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 26: loss 0.21824. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 27: loss 0.23010. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 31 Iter 27: loss 0.23010. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 31 Iter 28: loss 0.25554. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 31 Iter 28: loss 0.25554. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 31 Iter 29: loss 0.23960. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 31 Iter 29: loss 0.23960. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 31 Iter 30: loss 0.21957. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 31 Iter 30: loss 0.21957. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.04it/s]
Epoch 31 Iter 31: loss 0.25214. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.04it/s]
Epoch 31 Iter 31: loss 0.25214. :  14%|██████                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 31 Iter 32: loss 0.21744. :  14%|██████                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 31 Iter 32: loss 0.21744. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.05it/s]
Epoch 31 Iter 33: loss 0.23340. :  14%|██████▎                                     | 32/224 [00:16<01:33,  2.05it/s]
Epoch 31 Iter 33: loss 0.23340. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.05it/s]
Epoch 31 Iter 34: loss 0.21684. :  15%|██████▍                                     | 33/224 [00:16<01:33,  2.05it/s]
Epoch 31 Iter 34: loss 0.21684. :  15%|██████▋                                     | 34/224 [00:16<01:33,  2.04it/s]
Epoch 31 Iter 35: loss 0.21750. :  15%|██████▋                                     | 34/224 [00:17<01:33,  2.04it/s]
Epoch 31 Iter 35: loss 0.21750. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 31 Iter 36: loss 0.21366. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 31 Iter 36: loss 0.21366. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 31 Iter 37: loss 0.20626. :  16%|███████                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 31 Iter 37: loss 0.20626. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.04it/s]
Epoch 31 Iter 38: loss 0.23015. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.04it/s]
Epoch 31 Iter 38: loss 0.23015. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 31 Iter 39: loss 0.23291. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 31 Iter 39: loss 0.23291. :  17%|███████▋                                    | 39/224 [00:18<01:30,  2.06it/s]
Epoch 31 Iter 40: loss 0.23934. :  17%|███████▋                                    | 39/224 [00:19<01:30,  2.06it/s]
Epoch 31 Iter 40: loss 0.23934. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 31 Iter 41: loss 0.24008. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 31 Iter 41: loss 0.24008. :  18%|████████                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 31 Iter 42: loss 0.22955. :  18%|████████                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 31 Iter 42: loss 0.22955. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 31 Iter 43: loss 0.22142. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 31 Iter 43: loss 0.22142. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 31 Iter 44: loss 0.23326. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 31 Iter 44: loss 0.23326. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 31 Iter 45: loss 0.23249. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 31 Iter 45: loss 0.23249. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 31 Iter 46: loss 0.23657. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 31 Iter 46: loss 0.23657. :  21%|█████████                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 31 Iter 47: loss 0.24732. :  21%|█████████                                   | 46/224 [00:22<01:27,  2.03it/s]
Epoch 31 Iter 47: loss 0.24732. :  21%|█████████▏                                  | 47/224 [00:22<01:26,  2.04it/s]
Epoch 31 Iter 48: loss 0.23319. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.04it/s]
Epoch 31 Iter 48: loss 0.23319. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 31 Iter 49: loss 0.22542. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 31 Iter 49: loss 0.22542. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 31 Iter 50: loss 0.23480. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 50: loss 0.23480. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 31 Iter 51: loss 0.22439. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 31 Iter 51: loss 0.22439. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.24492. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.24492. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 31 Iter 53: loss 0.22443. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 31 Iter 53: loss 0.22443. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.23741. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.23741. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 31 Iter 55: loss 0.22934. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 31 Iter 55: loss 0.22934. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 31 Iter 56: loss 0.25355. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 31 Iter 56: loss 0.25355. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 57: loss 0.24602. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 57: loss 0.24602. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 58: loss 0.26225. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 31 Iter 58: loss 0.26225. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 31 Iter 59: loss 0.22853. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 31 Iter 59: loss 0.22853. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 31 Iter 60: loss 0.22531. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 31 Iter 60: loss 0.22531. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.08it/s]
Epoch 31 Iter 61: loss 0.23303. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.08it/s]
Epoch 31 Iter 61: loss 0.23303. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 31 Iter 62: loss 0.22794. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 31 Iter 62: loss 0.22794. :  28%|████████████▏                               | 62/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 63: loss 0.23996. :  28%|████████████▏                               | 62/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 63: loss 0.23996. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.24098. :  28%|████████████▍                               | 63/224 [00:31<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.24098. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 31 Iter 65: loss 0.25413. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 31 Iter 65: loss 0.25413. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 31 Iter 66: loss 0.25164. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.07it/s]
Epoch 31 Iter 66: loss 0.25164. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 31 Iter 67: loss 0.23350. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 31 Iter 67: loss 0.23350. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 31 Iter 68: loss 0.22598. :  30%|█████████████▏                              | 67/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 68: loss 0.22598. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 69: loss 0.22547. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 69: loss 0.22547. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 70: loss 0.20427. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 70: loss 0.20427. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 31 Iter 71: loss 0.22302. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 31 Iter 71: loss 0.22302. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 31 Iter 72: loss 0.23347. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 31 Iter 72: loss 0.23347. :  32%|██████████████▏                             | 72/224 [00:34<01:12,  2.09it/s]
Epoch 31 Iter 73: loss 0.23966. :  32%|██████████████▏                             | 72/224 [00:35<01:12,  2.09it/s]
Epoch 31 Iter 73: loss 0.23966. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.22780. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.22780. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 31 Iter 75: loss 0.24026. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 31 Iter 75: loss 0.24026. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 31 Iter 76: loss 0.21931. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 31 Iter 76: loss 0.21931. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 31 Iter 77: loss 0.24793. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 31 Iter 77: loss 0.24793. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 31 Iter 78: loss 0.22122. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 31 Iter 78: loss 0.22122. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 31 Iter 79: loss 0.24078. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 31 Iter 79: loss 0.24078. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 31 Iter 80: loss 0.22862. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.09it/s]
Epoch 31 Iter 80: loss 0.22862. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.08it/s]
Epoch 31 Iter 81: loss 0.23237. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.08it/s]
Epoch 31 Iter 81: loss 0.23237. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 31 Iter 82: loss 0.20959. :  36%|███████████████▉                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 31 Iter 82: loss 0.20959. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 31 Iter 83: loss 0.23843. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 31 Iter 83: loss 0.23843. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.07it/s]
Epoch 31 Iter 84: loss 0.22186. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.07it/s]
Epoch 31 Iter 84: loss 0.22186. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.08it/s]
Epoch 31 Iter 85: loss 0.26255. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.08it/s]
Epoch 31 Iter 85: loss 0.26255. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 31 Iter 86: loss 0.23278. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 31 Iter 86: loss 0.23278. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 31 Iter 87: loss 0.25025. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 31 Iter 87: loss 0.25025. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 31 Iter 88: loss 0.23619. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 31 Iter 88: loss 0.23619. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 31 Iter 89: loss 0.27685. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 31 Iter 89: loss 0.27685. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 31 Iter 90: loss 0.25851. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 31 Iter 90: loss 0.25851. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 31 Iter 91: loss 0.22057. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 31 Iter 91: loss 0.22057. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 31 Iter 92: loss 0.23564. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 31 Iter 92: loss 0.23564. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 31 Iter 93: loss 0.22231. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 31 Iter 93: loss 0.22231. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 31 Iter 94: loss 0.22655. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 31 Iter 94: loss 0.22655. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 31 Iter 95: loss 0.23484. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.07it/s]
Epoch 31 Iter 95: loss 0.23484. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 31 Iter 96: loss 0.23520. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 31 Iter 96: loss 0.23520. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 31 Iter 97: loss 0.24565. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.09it/s]
Epoch 31 Iter 97: loss 0.24565. :  43%|███████████████████                         | 97/224 [00:47<01:00,  2.09it/s]
Epoch 31 Iter 98: loss 0.22141. :  43%|███████████████████                         | 97/224 [00:47<01:00,  2.09it/s]
Epoch 31 Iter 98: loss 0.22141. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 99: loss 0.25287. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 99: loss 0.25287. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 100: loss 0.21934. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 31 Iter 100: loss 0.21934. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 101: loss 0.23473. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 101: loss 0.23473. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.22269. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.22269. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 31 Iter 103: loss 0.25032. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 31 Iter 103: loss 0.25032. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 31 Iter 104: loss 0.24259. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 31 Iter 104: loss 0.24259. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 31 Iter 105: loss 0.23080. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 31 Iter 105: loss 0.23080. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.23652. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.23652. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 107: loss 0.21933. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 107: loss 0.21933. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.23320. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.23320. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.23332. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.23332. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.24455. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.24455. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 31 Iter 111: loss 0.24885. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 31 Iter 111: loss 0.24885. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 112: loss 0.25060. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 31 Iter 112: loss 0.25060. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 31 Iter 113: loss 0.24525. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 31 Iter 113: loss 0.24525. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 31 Iter 114: loss 0.23588. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 31 Iter 114: loss 0.23588. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 31 Iter 115: loss 0.22560. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 31 Iter 115: loss 0.22560. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 31 Iter 116: loss 0.20269. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 31 Iter 116: loss 0.20269. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 31 Iter 117: loss 0.23438. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 31 Iter 117: loss 0.23438. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.04it/s]
Epoch 31 Iter 118: loss 0.23544. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 31 Iter 118: loss 0.23544. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 31 Iter 119: loss 0.24309. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 31 Iter 119: loss 0.24309. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.06it/s]
Epoch 31 Iter 120: loss 0.23505. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 31 Iter 120: loss 0.23505. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 31 Iter 121: loss 0.22292. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 31 Iter 121: loss 0.22292. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 31 Iter 122: loss 0.22041. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 31 Iter 122: loss 0.22041. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 31 Iter 123: loss 0.23733. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 31 Iter 123: loss 0.23733. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 31 Iter 124: loss 0.23211. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 31 Iter 124: loss 0.23211. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 31 Iter 125: loss 0.24644. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 31 Iter 125: loss 0.24644. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 31 Iter 126: loss 0.22445. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 31 Iter 126: loss 0.22445. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 31 Iter 127: loss 0.22141. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 31 Iter 127: loss 0.22141. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 31 Iter 128: loss 0.22656. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 31 Iter 128: loss 0.22656. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 31 Iter 129: loss 0.23172. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 31 Iter 129: loss 0.23172. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 31 Iter 130: loss 0.25752. :  58%|████████████████████████▏                 | 129/224 [01:03<00:46,  2.06it/s]
Epoch 31 Iter 130: loss 0.25752. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 31 Iter 131: loss 0.23590. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 31 Iter 131: loss 0.23590. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.03it/s]
Epoch 31 Iter 132: loss 0.22915. :  58%|████████████████████████▌                 | 131/224 [01:04<00:45,  2.03it/s]
Epoch 31 Iter 132: loss 0.22915. :  59%|████████████████████████▊                 | 132/224 [01:04<00:45,  2.04it/s]
Epoch 31 Iter 133: loss 0.22999. :  59%|████████████████████████▊                 | 132/224 [01:04<00:45,  2.04it/s]
Epoch 31 Iter 133: loss 0.22999. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 31 Iter 134: loss 0.21939. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 31 Iter 134: loss 0.21939. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 31 Iter 135: loss 0.23349. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 31 Iter 135: loss 0.23349. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 31 Iter 136: loss 0.22289. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 31 Iter 136: loss 0.22289. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 31 Iter 137: loss 0.20642. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 31 Iter 137: loss 0.20642. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 31 Iter 138: loss 0.22819. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 31 Iter 138: loss 0.22819. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 31 Iter 139: loss 0.22489. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 31 Iter 139: loss 0.22489. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 31 Iter 140: loss 0.24136. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 31 Iter 140: loss 0.24136. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 31 Iter 141: loss 0.22287. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 31 Iter 141: loss 0.22287. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 31 Iter 142: loss 0.23449. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 31 Iter 142: loss 0.23449. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 31 Iter 143: loss 0.23519. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 31 Iter 143: loss 0.23519. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 31 Iter 144: loss 0.24610. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 31 Iter 144: loss 0.24610. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 31 Iter 145: loss 0.23572. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 31 Iter 145: loss 0.23572. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 31 Iter 146: loss 0.26694. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 31 Iter 146: loss 0.26694. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 31 Iter 147: loss 0.22602. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 31 Iter 147: loss 0.22602. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 31 Iter 148: loss 0.23915. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 31 Iter 148: loss 0.23915. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 31 Iter 149: loss 0.24917. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 31 Iter 149: loss 0.24917. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 31 Iter 150: loss 0.23140. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 31 Iter 150: loss 0.23140. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 31 Iter 151: loss 0.22308. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 151: loss 0.22308. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 152: loss 0.23347. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 152: loss 0.23347. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 31 Iter 153: loss 0.23282. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 31 Iter 153: loss 0.23282. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 31 Iter 154: loss 0.22677. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 31 Iter 154: loss 0.22677. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 31 Iter 155: loss 0.26051. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 31 Iter 155: loss 0.26051. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 156: loss 0.22525. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 156: loss 0.22525. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 31 Iter 157: loss 0.21319. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 31 Iter 157: loss 0.21319. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 31 Iter 158: loss 0.20864. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 31 Iter 158: loss 0.20864. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 31 Iter 159: loss 0.23270. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 31 Iter 159: loss 0.23270. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 31 Iter 160: loss 0.22418. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 31 Iter 160: loss 0.22418. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 31 Iter 161: loss 0.22911. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 31 Iter 161: loss 0.22911. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 31 Iter 162: loss 0.23612. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 31 Iter 162: loss 0.23612. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 31 Iter 163: loss 0.23225. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 31 Iter 163: loss 0.23225. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 31 Iter 164: loss 0.23098. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 31 Iter 164: loss 0.23098. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 31 Iter 165: loss 0.24429. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 31 Iter 165: loss 0.24429. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.24529. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.24529. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 31 Iter 167: loss 0.24731. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 31 Iter 167: loss 0.24731. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 31 Iter 168: loss 0.23579. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 31 Iter 168: loss 0.23579. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 31 Iter 169: loss 0.24271. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 31 Iter 169: loss 0.24271. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 31 Iter 170: loss 0.24396. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 31 Iter 170: loss 0.24396. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 31 Iter 171: loss 0.21962. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 31 Iter 171: loss 0.21962. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 31 Iter 172: loss 0.22717. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 31 Iter 172: loss 0.22717. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 31 Iter 173: loss 0.22088. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 31 Iter 173: loss 0.22088. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.09it/s]
Epoch 31 Iter 174: loss 0.21700. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 31 Iter 174: loss 0.21700. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 31 Iter 175: loss 0.23068. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 31 Iter 175: loss 0.23068. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 31 Iter 176: loss 0.22162. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 31 Iter 176: loss 0.22162. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 31 Iter 177: loss 0.25106. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 31 Iter 177: loss 0.25106. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.22254. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.22254. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 31 Iter 179: loss 0.24124. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 31 Iter 179: loss 0.24124. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 31 Iter 180: loss 0.24060. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 31 Iter 180: loss 0.24060. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 31 Iter 181: loss 0.24331. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 31 Iter 181: loss 0.24331. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 31 Iter 182: loss 0.23944. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 31 Iter 182: loss 0.23944. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 31 Iter 183: loss 0.22928. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 31 Iter 183: loss 0.22928. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 31 Iter 184: loss 0.22111. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 31 Iter 184: loss 0.22111. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 31 Iter 185: loss 0.22965. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 31 Iter 185: loss 0.22965. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 31 Iter 186: loss 0.23657. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 31 Iter 186: loss 0.23657. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.03it/s]
Epoch 31 Iter 187: loss 0.22402. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.03it/s]
Epoch 31 Iter 187: loss 0.22402. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.03it/s]
Epoch 31 Iter 188: loss 0.23213. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.03it/s]
Epoch 31 Iter 188: loss 0.23213. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.03it/s]
Epoch 31 Iter 189: loss 0.23777. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.03it/s]
Epoch 31 Iter 189: loss 0.23777. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 31 Iter 190: loss 0.23293. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.04it/s]
Epoch 31 Iter 190: loss 0.23293. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 191: loss 0.23314. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 191: loss 0.23314. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 192: loss 0.23428. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 31 Iter 192: loss 0.23428. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 193: loss 0.23995. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 193: loss 0.23995. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.23402. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.23402. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 31 Iter 195: loss 0.22724. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 31 Iter 195: loss 0.22724. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 31 Iter 196: loss 0.23515. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 31 Iter 196: loss 0.23515. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 31 Iter 197: loss 0.23599. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 31 Iter 197: loss 0.23599. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 31 Iter 198: loss 0.23474. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 31 Iter 198: loss 0.23474. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.09it/s]
Epoch 31 Iter 199: loss 0.24151. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.09it/s]
Epoch 31 Iter 199: loss 0.24151. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 200: loss 0.23804. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 200: loss 0.23804. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 31 Iter 201: loss 0.23350. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 201: loss 0.23350. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 202: loss 0.23285. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 202: loss 0.23285. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 31 Iter 203: loss 0.22659. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 31 Iter 203: loss 0.22659. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 31 Iter 204: loss 0.22373. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 31 Iter 204: loss 0.22373. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.08it/s]
Epoch 31 Iter 205: loss 0.24200. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.08it/s]
Epoch 31 Iter 205: loss 0.24200. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 31 Iter 206: loss 0.25127. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 31 Iter 206: loss 0.25127. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 31 Iter 207: loss 0.21480. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 31 Iter 207: loss 0.21480. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 31 Iter 208: loss 0.22277. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 31 Iter 208: loss 0.22277. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 31 Iter 209: loss 0.25878. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 31 Iter 209: loss 0.25878. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 31 Iter 210: loss 0.21890. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 31 Iter 210: loss 0.21890. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 31 Iter 211: loss 0.24207. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 31 Iter 211: loss 0.24207. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 31 Iter 212: loss 0.23440. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 31 Iter 212: loss 0.23440. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 31 Iter 213: loss 0.24696. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 31 Iter 213: loss 0.24696. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 31 Iter 214: loss 0.22748. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 31 Iter 214: loss 0.22748. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.10it/s]
Epoch 31 Iter 215: loss 0.22962. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.10it/s]
Epoch 31 Iter 215: loss 0.22962. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 31 Iter 216: loss 0.22630. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 31 Iter 216: loss 0.22630. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 31 Iter 217: loss 0.22300. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 31 Iter 217: loss 0.22300. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 31 Iter 218: loss 0.25512. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 31 Iter 218: loss 0.25512. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 31 Iter 219: loss 0.22411. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 31 Iter 219: loss 0.22411. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 31 Iter 220: loss 0.23801. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 31 Iter 220: loss 0.23801. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 31 Iter 221: loss 0.22494. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 31 Iter 221: loss 0.22494. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 31 Iter 222: loss 0.24932. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 31 Iter 222: loss 0.24932. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.23846. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.23846. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 31 Iter 224: loss 0.23084. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 31 Iter 224: loss 0.23084. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 31 Iter 224: loss 0.23084. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23321
    Valid loss: 0.23461
       Valid loss recons: 0.22224
       Valid loss KL-D:   1.23707
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.24125. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.24125. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 32 Iter 2: loss 0.21317. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 32 Iter 2: loss 0.21317. :   1%|▍                                             | 2/224 [00:00<01:46,  2.09it/s]
Epoch 32 Iter 3: loss 0.23800. :   1%|▍                                             | 2/224 [00:01<01:46,  2.09it/s]
Epoch 32 Iter 3: loss 0.23800. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 32 Iter 4: loss 0.24573. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 32 Iter 4: loss 0.24573. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 32 Iter 5: loss 0.25102. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 32 Iter 5: loss 0.25102. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 32 Iter 6: loss 0.23883. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 32 Iter 6: loss 0.23883. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 32 Iter 7: loss 0.23727. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 32 Iter 7: loss 0.23727. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.08it/s]
Epoch 32 Iter 8: loss 0.24601. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.08it/s]
Epoch 32 Iter 8: loss 0.24601. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 32 Iter 9: loss 0.24610. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 32 Iter 9: loss 0.24610. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 10: loss 0.24718. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 10: loss 0.24718. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.06it/s]
Epoch 32 Iter 11: loss 0.24323. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.06it/s]
Epoch 32 Iter 11: loss 0.24323. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 32 Iter 12: loss 0.21491. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 32 Iter 12: loss 0.21491. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.09it/s]
Epoch 32 Iter 13: loss 0.22173. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.09it/s]
Epoch 32 Iter 13: loss 0.22173. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 32 Iter 14: loss 0.24483. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 32 Iter 14: loss 0.24483. :   6%|██▊                                         | 14/224 [00:06<01:40,  2.08it/s]
Epoch 32 Iter 15: loss 0.22219. :   6%|██▊                                         | 14/224 [00:07<01:40,  2.08it/s]
Epoch 32 Iter 15: loss 0.22219. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 32 Iter 16: loss 0.23878. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 32 Iter 16: loss 0.23878. :   7%|███▏                                        | 16/224 [00:07<01:39,  2.08it/s]
Epoch 32 Iter 17: loss 0.21532. :   7%|███▏                                        | 16/224 [00:08<01:39,  2.08it/s]
Epoch 32 Iter 17: loss 0.21532. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 32 Iter 18: loss 0.21276. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 32 Iter 18: loss 0.21276. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 32 Iter 19: loss 0.22510. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 32 Iter 19: loss 0.22510. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 32 Iter 20: loss 0.24553. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 32 Iter 20: loss 0.24553. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 32 Iter 21: loss 0.25417. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 32 Iter 21: loss 0.25417. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 32 Iter 22: loss 0.22239. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 32 Iter 22: loss 0.22239. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.04it/s]
Epoch 32 Iter 23: loss 0.23812. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.04it/s]
Epoch 32 Iter 23: loss 0.23812. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 24: loss 0.23044. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 24: loss 0.23044. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 32 Iter 25: loss 0.23181. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 32 Iter 25: loss 0.23181. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 32 Iter 26: loss 0.24370. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 32 Iter 26: loss 0.24370. :  12%|█████                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 32 Iter 27: loss 0.24390. :  12%|█████                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 32 Iter 27: loss 0.24390. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 32 Iter 28: loss 0.24170. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 32 Iter 28: loss 0.24170. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.06it/s]
Epoch 32 Iter 29: loss 0.20993. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.06it/s]
Epoch 32 Iter 29: loss 0.20993. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.09it/s]
Epoch 32 Iter 30: loss 0.22455. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.09it/s]
Epoch 32 Iter 30: loss 0.22455. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 32 Iter 31: loss 0.22641. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 32 Iter 31: loss 0.22641. :  14%|██████                                      | 31/224 [00:14<01:33,  2.07it/s]
Epoch 32 Iter 32: loss 0.21293. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 32 Iter 32: loss 0.21293. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 32 Iter 33: loss 0.25642. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 32 Iter 33: loss 0.25642. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 32 Iter 34: loss 0.23406. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 32 Iter 34: loss 0.23406. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 35: loss 0.22935. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 35: loss 0.22935. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 32 Iter 36: loss 0.22124. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 32 Iter 36: loss 0.22124. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 37: loss 0.23423. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 37: loss 0.23423. :  17%|███████▎                                    | 37/224 [00:17<01:31,  2.05it/s]
Epoch 32 Iter 38: loss 0.23910. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.05it/s]
Epoch 32 Iter 38: loss 0.23910. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 32 Iter 39: loss 0.23383. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 32 Iter 39: loss 0.23383. :  17%|███████▋                                    | 39/224 [00:18<01:30,  2.05it/s]
Epoch 32 Iter 40: loss 0.21940. :  17%|███████▋                                    | 39/224 [00:19<01:30,  2.05it/s]
Epoch 32 Iter 40: loss 0.21940. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 32 Iter 41: loss 0.23477. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 32 Iter 41: loss 0.23477. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 32 Iter 42: loss 0.23405. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 32 Iter 42: loss 0.23405. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 32 Iter 43: loss 0.22819. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 32 Iter 43: loss 0.22819. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 32 Iter 44: loss 0.23106. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 32 Iter 44: loss 0.23106. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 32 Iter 45: loss 0.23611. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 32 Iter 45: loss 0.23611. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.06it/s]
Epoch 32 Iter 46: loss 0.22884. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.06it/s]
Epoch 32 Iter 46: loss 0.22884. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 32 Iter 47: loss 0.22436. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 32 Iter 47: loss 0.22436. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 32 Iter 48: loss 0.23139. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 32 Iter 48: loss 0.23139. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 32 Iter 49: loss 0.23400. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 32 Iter 49: loss 0.23400. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 32 Iter 50: loss 0.22813. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 32 Iter 50: loss 0.22813. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 32 Iter 51: loss 0.23873. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 32 Iter 51: loss 0.23873. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 32 Iter 52: loss 0.21691. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 32 Iter 52: loss 0.21691. :  23%|██████████▏                                 | 52/224 [00:25<01:24,  2.04it/s]
Epoch 32 Iter 53: loss 0.25596. :  23%|██████████▏                                 | 52/224 [00:25<01:24,  2.04it/s]
Epoch 32 Iter 53: loss 0.25596. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.23717. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.23717. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 32 Iter 55: loss 0.23403. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.05it/s]
Epoch 32 Iter 55: loss 0.23403. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.05it/s]
Epoch 32 Iter 56: loss 0.21773. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.05it/s]
Epoch 32 Iter 56: loss 0.21773. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 32 Iter 57: loss 0.22730. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 32 Iter 57: loss 0.22730. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.05it/s]
Epoch 32 Iter 58: loss 0.23248. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.05it/s]
Epoch 32 Iter 58: loss 0.23248. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 32 Iter 59: loss 0.23376. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 32 Iter 59: loss 0.23376. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 32 Iter 60: loss 0.20421. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 60: loss 0.20421. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 61: loss 0.21038. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 32 Iter 61: loss 0.21038. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 32 Iter 62: loss 0.23903. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 32 Iter 62: loss 0.23903. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 32 Iter 63: loss 0.22974. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 32 Iter 63: loss 0.22974. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.06it/s]
Epoch 32 Iter 64: loss 0.24414. :  28%|████████████▍                               | 63/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 64: loss 0.24414. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 65: loss 0.22585. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 65: loss 0.22585. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 66: loss 0.24090. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 32 Iter 66: loss 0.24090. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 32 Iter 67: loss 0.24339. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 32 Iter 67: loss 0.24339. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 32 Iter 68: loss 0.22074. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 32 Iter 68: loss 0.22074. :  30%|█████████████▎                              | 68/224 [00:32<01:16,  2.05it/s]
Epoch 32 Iter 69: loss 0.24339. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 32 Iter 69: loss 0.24339. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.23987. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.23987. :  31%|█████████████▊                              | 70/224 [00:33<01:15,  2.04it/s]
Epoch 32 Iter 71: loss 0.22810. :  31%|█████████████▊                              | 70/224 [00:34<01:15,  2.04it/s]
Epoch 32 Iter 71: loss 0.22810. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 32 Iter 72: loss 0.23965. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 32 Iter 72: loss 0.23965. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.23468. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.23468. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 32 Iter 74: loss 0.23235. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.07it/s]
Epoch 32 Iter 74: loss 0.23235. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 32 Iter 75: loss 0.21399. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 32 Iter 75: loss 0.21399. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 32 Iter 76: loss 0.23343. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 32 Iter 76: loss 0.23343. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 32 Iter 77: loss 0.23961. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 32 Iter 77: loss 0.23961. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 32 Iter 78: loss 0.25889. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 32 Iter 78: loss 0.25889. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 32 Iter 79: loss 0.22886. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 32 Iter 79: loss 0.22886. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 80: loss 0.23451. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 80: loss 0.23451. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 81: loss 0.23172. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.05it/s]
Epoch 32 Iter 81: loss 0.23172. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.21803. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.21803. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 32 Iter 83: loss 0.23853. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 32 Iter 83: loss 0.23853. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 32 Iter 84: loss 0.22184. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 32 Iter 84: loss 0.22184. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 32 Iter 85: loss 0.22549. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 85: loss 0.22549. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.25379. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.25379. :  38%|████████████████▉                           | 86/224 [00:41<01:08,  2.02it/s]
Epoch 32 Iter 87: loss 0.22006. :  38%|████████████████▉                           | 86/224 [00:42<01:08,  2.02it/s]
Epoch 32 Iter 87: loss 0.22006. :  39%|█████████████████                           | 87/224 [00:42<01:07,  2.01it/s]
Epoch 32 Iter 88: loss 0.20381. :  39%|█████████████████                           | 87/224 [00:42<01:07,  2.01it/s]
Epoch 32 Iter 88: loss 0.20381. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.23805. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.23805. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 32 Iter 90: loss 0.22391. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 32 Iter 90: loss 0.22391. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 32 Iter 91: loss 0.24814. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 32 Iter 91: loss 0.24814. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 32 Iter 92: loss 0.22887. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 32 Iter 92: loss 0.22887. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 32 Iter 93: loss 0.23544. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 32 Iter 93: loss 0.23544. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.09it/s]
Epoch 32 Iter 94: loss 0.24251. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.09it/s]
Epoch 32 Iter 94: loss 0.24251. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.09it/s]
Epoch 32 Iter 95: loss 0.24159. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.09it/s]
Epoch 32 Iter 95: loss 0.24159. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.09it/s]
Epoch 32 Iter 96: loss 0.22514. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.09it/s]
Epoch 32 Iter 96: loss 0.22514. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 32 Iter 97: loss 0.23480. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 32 Iter 97: loss 0.23480. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 32 Iter 98: loss 0.22844. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 32 Iter 98: loss 0.22844. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 32 Iter 99: loss 0.22996. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 32 Iter 99: loss 0.22996. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 32 Iter 100: loss 0.22737. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 32 Iter 100: loss 0.22737. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 32 Iter 101: loss 0.23336. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 32 Iter 101: loss 0.23336. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 32 Iter 102: loss 0.22037. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 32 Iter 102: loss 0.22037. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 32 Iter 103: loss 0.23758. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 32 Iter 103: loss 0.23758. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.08it/s]
Epoch 32 Iter 104: loss 0.23999. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.08it/s]
Epoch 32 Iter 104: loss 0.23999. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 32 Iter 105: loss 0.24015. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 32 Iter 105: loss 0.24015. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 32 Iter 106: loss 0.23626. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 32 Iter 106: loss 0.23626. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 32 Iter 107: loss 0.23713. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 32 Iter 107: loss 0.23713. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 32 Iter 108: loss 0.22894. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 32 Iter 108: loss 0.22894. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.10it/s]
Epoch 32 Iter 109: loss 0.22101. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.10it/s]
Epoch 32 Iter 109: loss 0.22101. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.09it/s]
Epoch 32 Iter 110: loss 0.23436. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.09it/s]
Epoch 32 Iter 110: loss 0.23436. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 32 Iter 111: loss 0.22281. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 32 Iter 111: loss 0.22281. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 32 Iter 112: loss 0.23809. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 32 Iter 112: loss 0.23809. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 32 Iter 113: loss 0.26703. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 32 Iter 113: loss 0.26703. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.08it/s]
Epoch 32 Iter 114: loss 0.22975. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.08it/s]
Epoch 32 Iter 114: loss 0.22975. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 32 Iter 115: loss 0.24756. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 32 Iter 115: loss 0.24756. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.08it/s]
Epoch 32 Iter 116: loss 0.23220. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.08it/s]
Epoch 32 Iter 116: loss 0.23220. :  52%|█████████████████████▊                    | 116/224 [00:56<00:51,  2.09it/s]
Epoch 32 Iter 117: loss 0.25408. :  52%|█████████████████████▊                    | 116/224 [00:56<00:51,  2.09it/s]
Epoch 32 Iter 117: loss 0.25408. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 32 Iter 118: loss 0.22870. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 32 Iter 118: loss 0.22870. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 32 Iter 119: loss 0.24828. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 32 Iter 119: loss 0.24828. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 32 Iter 120: loss 0.22399. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.07it/s]
Epoch 32 Iter 120: loss 0.22399. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 32 Iter 121: loss 0.22695. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 32 Iter 121: loss 0.22695. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 32 Iter 122: loss 0.23636. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 32 Iter 122: loss 0.23636. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 32 Iter 123: loss 0.23588. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 32 Iter 123: loss 0.23588. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 32 Iter 124: loss 0.24056. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 32 Iter 124: loss 0.24056. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 32 Iter 125: loss 0.21491. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 32 Iter 125: loss 0.21491. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 32 Iter 126: loss 0.25479. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 32 Iter 126: loss 0.25479. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.08it/s]
Epoch 32 Iter 127: loss 0.24071. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 32 Iter 127: loss 0.24071. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 32 Iter 128: loss 0.21882. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 32 Iter 128: loss 0.21882. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.05it/s]
Epoch 32 Iter 129: loss 0.22467. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 32 Iter 129: loss 0.22467. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 32 Iter 130: loss 0.25511. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 32 Iter 130: loss 0.25511. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.22396. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.22396. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 32 Iter 132: loss 0.24516. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 32 Iter 132: loss 0.24516. :  59%|████████████████████████▊                 | 132/224 [01:03<00:45,  2.04it/s]
Epoch 32 Iter 133: loss 0.23499. :  59%|████████████████████████▊                 | 132/224 [01:04<00:45,  2.04it/s]
Epoch 32 Iter 133: loss 0.23499. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 32 Iter 134: loss 0.22062. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 32 Iter 134: loss 0.22062. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 32 Iter 135: loss 0.24112. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 135: loss 0.24112. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 136: loss 0.23257. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 136: loss 0.23257. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 32 Iter 137: loss 0.22256. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 32 Iter 137: loss 0.22256. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 32 Iter 138: loss 0.24107. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 32 Iter 138: loss 0.24107. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 32 Iter 139: loss 0.22416. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 139: loss 0.22416. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 140: loss 0.23254. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 32 Iter 140: loss 0.23254. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 32 Iter 141: loss 0.23976. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 32 Iter 141: loss 0.23976. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 32 Iter 142: loss 0.22030. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 32 Iter 142: loss 0.22030. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 32 Iter 143: loss 0.24109. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 32 Iter 143: loss 0.24109. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 32 Iter 144: loss 0.22941. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 32 Iter 144: loss 0.22941. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.20629. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.20629. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 32 Iter 146: loss 0.24507. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 32 Iter 146: loss 0.24507. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 32 Iter 147: loss 0.27111. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 32 Iter 147: loss 0.27111. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 32 Iter 148: loss 0.21617. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 32 Iter 148: loss 0.21617. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 32 Iter 149: loss 0.23237. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 32 Iter 149: loss 0.23237. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 32 Iter 150: loss 0.24429. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 32 Iter 150: loss 0.24429. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 32 Iter 151: loss 0.21901. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 32 Iter 151: loss 0.21901. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 32 Iter 152: loss 0.23165. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 32 Iter 152: loss 0.23165. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.25746. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.25746. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 154: loss 0.24835. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 154: loss 0.24835. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 32 Iter 155: loss 0.23477. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 155: loss 0.23477. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 156: loss 0.21947. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 156: loss 0.21947. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.05it/s]
Epoch 32 Iter 157: loss 0.25098. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.05it/s]
Epoch 32 Iter 157: loss 0.25098. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 158: loss 0.24094. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 158: loss 0.24094. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 159: loss 0.23069. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.04it/s]
Epoch 32 Iter 159: loss 0.23069. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 32 Iter 160: loss 0.21117. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.04it/s]
Epoch 32 Iter 160: loss 0.21117. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 32 Iter 161: loss 0.23504. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 32 Iter 161: loss 0.23504. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.05it/s]
Epoch 32 Iter 162: loss 0.22075. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.05it/s]
Epoch 32 Iter 162: loss 0.22075. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 32 Iter 163: loss 0.24098. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 32 Iter 163: loss 0.24098. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 32 Iter 164: loss 0.24263. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 32 Iter 164: loss 0.24263. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 32 Iter 165: loss 0.23183. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 32 Iter 165: loss 0.23183. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 32 Iter 166: loss 0.23429. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 32 Iter 166: loss 0.23429. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.22405. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.22405. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.23875. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.23875. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 169: loss 0.20130. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 169: loss 0.20130. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 32 Iter 170: loss 0.24923. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 170: loss 0.24923. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 171: loss 0.23867. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 171: loss 0.23867. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 32 Iter 172: loss 0.21978. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 32 Iter 172: loss 0.21978. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.04it/s]
Epoch 32 Iter 173: loss 0.21681. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.04it/s]
Epoch 32 Iter 173: loss 0.21681. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 32 Iter 174: loss 0.23121. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 174: loss 0.23121. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 32 Iter 175: loss 0.23363. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 32 Iter 175: loss 0.23363. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:24,  2.04it/s]
Epoch 32 Iter 176: loss 0.22440. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:24,  2.04it/s]
Epoch 32 Iter 176: loss 0.22440. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 32 Iter 177: loss 0.23430. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 32 Iter 177: loss 0.23430. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.05it/s]
Epoch 32 Iter 178: loss 0.23169. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.05it/s]
Epoch 32 Iter 178: loss 0.23169. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 32 Iter 179: loss 0.24592. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 32 Iter 179: loss 0.24592. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:22,  2.03it/s]
Epoch 32 Iter 180: loss 0.23620. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:22,  2.03it/s]
Epoch 32 Iter 180: loss 0.23620. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 32 Iter 181: loss 0.23627. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 32 Iter 181: loss 0.23627. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:21,  2.04it/s]
Epoch 32 Iter 182: loss 0.23404. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:21,  2.04it/s]
Epoch 32 Iter 182: loss 0.23404. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 32 Iter 183: loss 0.22962. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 32 Iter 183: loss 0.22962. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:20,  2.05it/s]
Epoch 32 Iter 184: loss 0.23037. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:20,  2.05it/s]
Epoch 32 Iter 184: loss 0.23037. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.03it/s]
Epoch 32 Iter 185: loss 0.23505. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.03it/s]
Epoch 32 Iter 185: loss 0.23505. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 32 Iter 186: loss 0.24906. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:19,  2.04it/s]
Epoch 32 Iter 186: loss 0.24906. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 32 Iter 187: loss 0.21404. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 32 Iter 187: loss 0.21404. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.02it/s]
Epoch 32 Iter 188: loss 0.24507. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.02it/s]
Epoch 32 Iter 188: loss 0.24507. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.03it/s]
Epoch 32 Iter 189: loss 0.21133. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.03it/s]
Epoch 32 Iter 189: loss 0.21133. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.01it/s]
Epoch 32 Iter 190: loss 0.25867. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.01it/s]
Epoch 32 Iter 190: loss 0.25867. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.02it/s]
Epoch 32 Iter 191: loss 0.22943. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.02it/s]
Epoch 32 Iter 191: loss 0.22943. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.03it/s]
Epoch 32 Iter 192: loss 0.23920. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.03it/s]
Epoch 32 Iter 192: loss 0.23920. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 32 Iter 193: loss 0.24783. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 32 Iter 193: loss 0.24783. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 32 Iter 194: loss 0.23653. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 32 Iter 194: loss 0.23653. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 32 Iter 195: loss 0.21594. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 32 Iter 195: loss 0.21594. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 32 Iter 196: loss 0.23009. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 32 Iter 196: loss 0.23009. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 32 Iter 197: loss 0.23218. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 32 Iter 197: loss 0.23218. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 32 Iter 198: loss 0.23717. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 32 Iter 198: loss 0.23717. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 32 Iter 199: loss 0.22498. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 32 Iter 199: loss 0.22498. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 32 Iter 200: loss 0.23090. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 32 Iter 200: loss 0.23090. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.24717. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.24717. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 202: loss 0.25592. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 202: loss 0.25592. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 32 Iter 203: loss 0.23895. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 32 Iter 203: loss 0.23895. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 32 Iter 204: loss 0.24416. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 32 Iter 204: loss 0.24416. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 32 Iter 205: loss 0.23551. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 205: loss 0.23551. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 206: loss 0.22308. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 206: loss 0.22308. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 32 Iter 207: loss 0.22953. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 32 Iter 207: loss 0.22953. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 32 Iter 208: loss 0.22702. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 32 Iter 208: loss 0.22702. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 32 Iter 209: loss 0.22276. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 32 Iter 209: loss 0.22276. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 32 Iter 210: loss 0.23649. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 32 Iter 210: loss 0.23649. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 32 Iter 211: loss 0.24804. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 32 Iter 211: loss 0.24804. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 32 Iter 212: loss 0.23885. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 32 Iter 212: loss 0.23885. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.22301. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.22301. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 214: loss 0.22634. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 214: loss 0.22634. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 32 Iter 215: loss 0.23746. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 32 Iter 215: loss 0.23746. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.22316. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.22316. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 32 Iter 217: loss 0.24302. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 217: loss 0.24302. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.22479. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.22479. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 32 Iter 219: loss 0.25289. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 32 Iter 219: loss 0.25289. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 32 Iter 220: loss 0.24362. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 32 Iter 220: loss 0.24362. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 32 Iter 221: loss 0.23252. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 221: loss 0.23252. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.22742. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.22742. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 32 Iter 223: loss 0.22105. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 223: loss 0.22105. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.22408. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.22408. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.22408. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.24286. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.24286. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 33 Iter 2: loss 0.22021. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 33 Iter 2: loss 0.22021. :   1%|▍                                             | 2/224 [00:00<01:50,  2.01it/s]
Epoch 33 Iter 3: loss 0.23575. :   1%|▍                                             | 2/224 [00:01<01:50,  2.01it/s]
Epoch 33 Iter 3: loss 0.23575. :   1%|▌                                             | 3/224 [00:01<01:50,  2.01it/s]
Epoch 33 Iter 4: loss 0.23019. :   1%|▌                                             | 3/224 [00:01<01:50,  2.01it/s]
Epoch 33 Iter 4: loss 0.23019. :   2%|▊                                             | 4/224 [00:01<01:48,  2.03it/s]
Epoch 33 Iter 5: loss 0.24448. :   2%|▊                                             | 4/224 [00:02<01:48,  2.03it/s]
Epoch 33 Iter 5: loss 0.24448. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 33 Iter 6: loss 0.24188. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 33 Iter 6: loss 0.24188. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 33 Iter 7: loss 0.24752. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 33 Iter 7: loss 0.24752. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 33 Iter 8: loss 0.24855. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 33 Iter 8: loss 0.24855. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 33 Iter 9: loss 0.22026. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 33 Iter 9: loss 0.22026. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 33 Iter 10: loss 0.23635. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 33 Iter 10: loss 0.23635. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.05it/s]
Epoch 33 Iter 11: loss 0.23128. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.05it/s]
Epoch 33 Iter 11: loss 0.23128. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 33 Iter 12: loss 0.25590. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 33 Iter 12: loss 0.25590. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 33 Iter 13: loss 0.23130. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 33 Iter 13: loss 0.23130. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 33 Iter 14: loss 0.23769. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 33 Iter 14: loss 0.23769. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 33 Iter 15: loss 0.21510. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 33 Iter 15: loss 0.21510. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 33 Iter 16: loss 0.22990. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 33 Iter 16: loss 0.22990. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.06it/s]
Epoch 33 Iter 17: loss 0.23102. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.06it/s]
Epoch 33 Iter 17: loss 0.23102. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 18: loss 0.24500. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 18: loss 0.24500. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.06it/s]
Epoch 33 Iter 19: loss 0.22736. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.06it/s]
Epoch 33 Iter 19: loss 0.22736. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 33 Iter 20: loss 0.23740. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 33 Iter 20: loss 0.23740. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 33 Iter 21: loss 0.21534. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 33 Iter 21: loss 0.21534. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 22: loss 0.21565. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 22: loss 0.21565. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 23: loss 0.23745. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 33 Iter 23: loss 0.23745. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 24: loss 0.22389. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 24: loss 0.22389. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 25: loss 0.25062. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 33 Iter 25: loss 0.25062. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 33 Iter 26: loss 0.21612. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 33 Iter 26: loss 0.21612. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.23582. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.23582. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 33 Iter 28: loss 0.19659. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 33 Iter 28: loss 0.19659. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 33 Iter 29: loss 0.23964. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 33 Iter 29: loss 0.23964. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 33 Iter 30: loss 0.23705. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.05it/s]
Epoch 33 Iter 30: loss 0.23705. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.22608. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.22608. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.22041. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.22041. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.05it/s]
Epoch 33 Iter 33: loss 0.24456. :  14%|██████▎                                     | 32/224 [00:16<01:33,  2.05it/s]
Epoch 33 Iter 33: loss 0.24456. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 33 Iter 34: loss 0.22041. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 33 Iter 34: loss 0.22041. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 33 Iter 35: loss 0.20990. :  15%|██████▋                                     | 34/224 [00:17<01:31,  2.08it/s]
Epoch 33 Iter 35: loss 0.20990. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 33 Iter 36: loss 0.22079. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 33 Iter 36: loss 0.22079. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 33 Iter 37: loss 0.21807. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 33 Iter 37: loss 0.21807. :  17%|███████▎                                    | 37/224 [00:17<01:31,  2.05it/s]
Epoch 33 Iter 38: loss 0.22107. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.05it/s]
Epoch 33 Iter 38: loss 0.22107. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 33 Iter 39: loss 0.21922. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 33 Iter 39: loss 0.21922. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.08it/s]
Epoch 33 Iter 40: loss 0.22353. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.08it/s]
Epoch 33 Iter 40: loss 0.22353. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 33 Iter 41: loss 0.22140. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 33 Iter 41: loss 0.22140. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 33 Iter 42: loss 0.23852. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 33 Iter 42: loss 0.23852. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 33 Iter 43: loss 0.24440. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 33 Iter 43: loss 0.24440. :  19%|████████▍                                   | 43/224 [00:20<01:26,  2.08it/s]
Epoch 33 Iter 44: loss 0.25897. :  19%|████████▍                                   | 43/224 [00:21<01:26,  2.08it/s]
Epoch 33 Iter 44: loss 0.25897. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.09it/s]
Epoch 33 Iter 45: loss 0.23537. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.09it/s]
Epoch 33 Iter 45: loss 0.23537. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 33 Iter 46: loss 0.23299. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 33 Iter 46: loss 0.23299. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.23716. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.23716. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 48: loss 0.23720. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 33 Iter 48: loss 0.23720. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 33 Iter 49: loss 0.22933. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 33 Iter 49: loss 0.22933. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 33 Iter 50: loss 0.24431. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 33 Iter 50: loss 0.24431. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 33 Iter 51: loss 0.24837. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 33 Iter 51: loss 0.24837. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 33 Iter 52: loss 0.25749. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 33 Iter 52: loss 0.25749. :  23%|██████████▏                                 | 52/224 [00:25<01:21,  2.10it/s]
Epoch 33 Iter 53: loss 0.23551. :  23%|██████████▏                                 | 52/224 [00:25<01:21,  2.10it/s]
Epoch 33 Iter 53: loss 0.23551. :  24%|██████████▍                                 | 53/224 [00:25<01:21,  2.10it/s]
Epoch 33 Iter 54: loss 0.24924. :  24%|██████████▍                                 | 53/224 [00:26<01:21,  2.10it/s]
Epoch 33 Iter 54: loss 0.24924. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.09it/s]
Epoch 33 Iter 55: loss 0.23281. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.09it/s]
Epoch 33 Iter 55: loss 0.23281. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.08it/s]
Epoch 33 Iter 56: loss 0.21710. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.08it/s]
Epoch 33 Iter 56: loss 0.21710. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 57: loss 0.24527. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 57: loss 0.24527. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 58: loss 0.24375. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 33 Iter 58: loss 0.24375. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 33 Iter 59: loss 0.22178. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 33 Iter 59: loss 0.22178. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.05it/s]
Epoch 33 Iter 60: loss 0.23823. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.05it/s]
Epoch 33 Iter 60: loss 0.23823. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 33 Iter 61: loss 0.22516. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 33 Iter 61: loss 0.22516. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 33 Iter 62: loss 0.23235. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 33 Iter 62: loss 0.23235. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 33 Iter 63: loss 0.24893. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 33 Iter 63: loss 0.24893. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 33 Iter 64: loss 0.23910. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.06it/s]
Epoch 33 Iter 64: loss 0.23910. :  29%|████████████▌                               | 64/224 [00:31<01:18,  2.05it/s]
Epoch 33 Iter 65: loss 0.25333. :  29%|████████████▌                               | 64/224 [00:31<01:18,  2.05it/s]
Epoch 33 Iter 65: loss 0.25333. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 33 Iter 66: loss 0.20168. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 33 Iter 66: loss 0.20168. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 33 Iter 67: loss 0.23253. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 33 Iter 67: loss 0.23253. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.04it/s]
Epoch 33 Iter 68: loss 0.25095. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.04it/s]
Epoch 33 Iter 68: loss 0.25095. :  30%|█████████████▎                              | 68/224 [00:32<01:16,  2.05it/s]
Epoch 33 Iter 69: loss 0.24009. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 33 Iter 69: loss 0.24009. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 33 Iter 70: loss 0.24031. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 33 Iter 70: loss 0.24031. :  31%|█████████████▊                              | 70/224 [00:33<01:15,  2.04it/s]
Epoch 33 Iter 71: loss 0.22869. :  31%|█████████████▊                              | 70/224 [00:34<01:15,  2.04it/s]
Epoch 33 Iter 71: loss 0.22869. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 33 Iter 72: loss 0.22164. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 33 Iter 72: loss 0.22164. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.04it/s]
Epoch 33 Iter 73: loss 0.22379. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.04it/s]
Epoch 33 Iter 73: loss 0.22379. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 33 Iter 74: loss 0.25355. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 33 Iter 74: loss 0.25355. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 33 Iter 75: loss 0.23637. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 33 Iter 75: loss 0.23637. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 33 Iter 76: loss 0.23245. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 33 Iter 76: loss 0.23245. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 33 Iter 77: loss 0.22566. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 33 Iter 77: loss 0.22566. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 33 Iter 78: loss 0.22290. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 33 Iter 78: loss 0.22290. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 33 Iter 79: loss 0.23514. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 33 Iter 79: loss 0.23514. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 33 Iter 80: loss 0.23661. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 33 Iter 80: loss 0.23661. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 33 Iter 81: loss 0.21522. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 33 Iter 81: loss 0.21522. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 33 Iter 82: loss 0.24087. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 33 Iter 82: loss 0.24087. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.23522. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.23522. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 33 Iter 84: loss 0.24198. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 33 Iter 84: loss 0.24198. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 33 Iter 85: loss 0.22337. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 85: loss 0.22337. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 33 Iter 86: loss 0.23498. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 33 Iter 86: loss 0.23498. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 87: loss 0.22413. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 33 Iter 87: loss 0.22413. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.22388. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.22388. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 89: loss 0.23437. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.06it/s]
Epoch 33 Iter 89: loss 0.23437. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 33 Iter 90: loss 0.24323. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 33 Iter 90: loss 0.24323. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.21323. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.21323. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 33 Iter 92: loss 0.23887. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 33 Iter 92: loss 0.23887. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 33 Iter 93: loss 0.23053. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 33 Iter 93: loss 0.23053. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 94: loss 0.21336. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 94: loss 0.21336. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.24002. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.24002. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 96: loss 0.24477. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 96: loss 0.24477. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.23355. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.23355. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.23435. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.23435. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.23489. :  44%|███████████████████▎                        | 98/224 [00:48<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.23489. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 100: loss 0.23440. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 100: loss 0.23440. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 101: loss 0.23261. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 101: loss 0.23261. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 33 Iter 102: loss 0.23798. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 33 Iter 102: loss 0.23798. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 33 Iter 103: loss 0.23756. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 33 Iter 103: loss 0.23756. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 33 Iter 104: loss 0.23087. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 33 Iter 104: loss 0.23087. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 33 Iter 105: loss 0.22283. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 33 Iter 105: loss 0.22283. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 33 Iter 106: loss 0.25917. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 106: loss 0.25917. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 107: loss 0.22461. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 33 Iter 107: loss 0.22461. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 33 Iter 108: loss 0.21904. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 33 Iter 108: loss 0.21904. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 33 Iter 109: loss 0.24689. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 33 Iter 109: loss 0.24689. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.24065. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.24065. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.22616. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.22616. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.22684. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.22684. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 113: loss 0.21684. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 113: loss 0.21684. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.08it/s]
Epoch 33 Iter 114: loss 0.24679. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.08it/s]
Epoch 33 Iter 114: loss 0.24679. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 33 Iter 115: loss 0.25114. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 33 Iter 115: loss 0.25114. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 33 Iter 116: loss 0.23073. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 33 Iter 116: loss 0.23073. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 33 Iter 117: loss 0.21380. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 33 Iter 117: loss 0.21380. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 33 Iter 118: loss 0.23331. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 33 Iter 118: loss 0.23331. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 33 Iter 119: loss 0.23543. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 33 Iter 119: loss 0.23543. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.05it/s]
Epoch 33 Iter 120: loss 0.23483. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.05it/s]
Epoch 33 Iter 120: loss 0.23483. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 33 Iter 121: loss 0.24541. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 33 Iter 121: loss 0.24541. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 33 Iter 122: loss 0.24683. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 33 Iter 122: loss 0.24683. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 33 Iter 123: loss 0.21049. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 33 Iter 123: loss 0.21049. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.22055. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.22055. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 125: loss 0.23862. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 125: loss 0.23862. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 33 Iter 126: loss 0.21448. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 33 Iter 126: loss 0.21448. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 33 Iter 127: loss 0.22687. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 33 Iter 127: loss 0.22687. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 33 Iter 128: loss 0.25625. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 33 Iter 128: loss 0.25625. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 33 Iter 129: loss 0.24903. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 33 Iter 129: loss 0.24903. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 33 Iter 130: loss 0.24220. :  58%|████████████████████████▏                 | 129/224 [01:03<00:46,  2.05it/s]
Epoch 33 Iter 130: loss 0.24220. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 33 Iter 131: loss 0.21166. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 33 Iter 131: loss 0.21166. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 33 Iter 132: loss 0.24540. :  58%|████████████████████████▌                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 33 Iter 132: loss 0.24540. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 33 Iter 133: loss 0.22029. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 33 Iter 133: loss 0.22029. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 33 Iter 134: loss 0.24536. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 33 Iter 134: loss 0.24536. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 33 Iter 135: loss 0.24440. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 135: loss 0.24440. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 136: loss 0.25571. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 136: loss 0.25571. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 33 Iter 137: loss 0.21705. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 137: loss 0.21705. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 138: loss 0.23304. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 138: loss 0.23304. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.23866. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.23866. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.23914. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.23914. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.23110. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.23110. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 33 Iter 142: loss 0.24125. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 33 Iter 142: loss 0.24125. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 33 Iter 143: loss 0.20773. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 143: loss 0.20773. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.21938. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.21938. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 33 Iter 145: loss 0.22121. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 145: loss 0.22121. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 146: loss 0.24738. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 33 Iter 146: loss 0.24738. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 33 Iter 147: loss 0.22680. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 33 Iter 147: loss 0.22680. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.23066. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.23066. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.22620. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.22620. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 33 Iter 150: loss 0.24959. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 33 Iter 150: loss 0.24959. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 33 Iter 151: loss 0.22951. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 33 Iter 151: loss 0.22951. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.08it/s]
Epoch 33 Iter 152: loss 0.25348. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.08it/s]
Epoch 33 Iter 152: loss 0.25348. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 33 Iter 153: loss 0.24218. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 33 Iter 153: loss 0.24218. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 33 Iter 154: loss 0.22262. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 33 Iter 154: loss 0.22262. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 33 Iter 155: loss 0.22763. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 155: loss 0.22763. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 156: loss 0.24114. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 156: loss 0.24114. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 33 Iter 157: loss 0.23411. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 33 Iter 157: loss 0.23411. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 33 Iter 158: loss 0.24229. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 33 Iter 158: loss 0.24229. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 33 Iter 159: loss 0.25641. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 159: loss 0.25641. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 160: loss 0.22535. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 160: loss 0.22535. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 33 Iter 161: loss 0.23902. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 33 Iter 161: loss 0.23902. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 162: loss 0.23134. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 162: loss 0.23134. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 163: loss 0.23777. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 163: loss 0.23777. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 33 Iter 164: loss 0.22998. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 33 Iter 164: loss 0.22998. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 33 Iter 165: loss 0.23235. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 33 Iter 165: loss 0.23235. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:29,  2.03it/s]
Epoch 33 Iter 166: loss 0.26303. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 33 Iter 166: loss 0.26303. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.03it/s]
Epoch 33 Iter 167: loss 0.24134. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.03it/s]
Epoch 33 Iter 167: loss 0.24134. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.04it/s]
Epoch 33 Iter 168: loss 0.20952. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.04it/s]
Epoch 33 Iter 168: loss 0.20952. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 33 Iter 169: loss 0.24072. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 33 Iter 169: loss 0.24072. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:27,  2.03it/s]
Epoch 33 Iter 170: loss 0.24753. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:27,  2.03it/s]
Epoch 33 Iter 170: loss 0.24753. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 33 Iter 171: loss 0.24601. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 33 Iter 171: loss 0.24601. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 33 Iter 172: loss 0.23006. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 33 Iter 172: loss 0.23006. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.23597. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.23597. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 33 Iter 174: loss 0.23001. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 33 Iter 174: loss 0.23001. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 33 Iter 175: loss 0.22047. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 33 Iter 175: loss 0.22047. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 33 Iter 176: loss 0.23019. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 33 Iter 176: loss 0.23019. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 33 Iter 177: loss 0.22554. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 33 Iter 177: loss 0.22554. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 33 Iter 178: loss 0.23216. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 33 Iter 178: loss 0.23216. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 33 Iter 179: loss 0.23117. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 33 Iter 179: loss 0.23117. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 33 Iter 180: loss 0.23343. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 33 Iter 180: loss 0.23343. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 33 Iter 181: loss 0.22544. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 33 Iter 181: loss 0.22544. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 33 Iter 182: loss 0.22619. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 182: loss 0.22619. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 183: loss 0.25353. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 33 Iter 183: loss 0.25353. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:20,  2.05it/s]
Epoch 33 Iter 184: loss 0.25626. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:20,  2.05it/s]
Epoch 33 Iter 184: loss 0.25626. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 33 Iter 185: loss 0.24443. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 33 Iter 185: loss 0.24443. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 33 Iter 186: loss 0.23091. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 33 Iter 186: loss 0.23091. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 33 Iter 187: loss 0.23273. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 33 Iter 187: loss 0.23273. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.09it/s]
Epoch 33 Iter 188: loss 0.23347. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.09it/s]
Epoch 33 Iter 188: loss 0.23347. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.10it/s]
Epoch 33 Iter 189: loss 0.21783. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.10it/s]
Epoch 33 Iter 189: loss 0.21783. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.11it/s]
Epoch 33 Iter 190: loss 0.23334. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:16,  2.11it/s]
Epoch 33 Iter 190: loss 0.23334. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.09it/s]
Epoch 33 Iter 191: loss 0.22965. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.09it/s]
Epoch 33 Iter 191: loss 0.22965. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 33 Iter 192: loss 0.22043. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.09it/s]
Epoch 33 Iter 192: loss 0.22043. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 33 Iter 193: loss 0.25018. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 33 Iter 193: loss 0.25018. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 33 Iter 194: loss 0.21486. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 33 Iter 194: loss 0.21486. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.24360. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.24360. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 33 Iter 196: loss 0.21076. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 33 Iter 196: loss 0.21076. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 33 Iter 197: loss 0.23909. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 33 Iter 197: loss 0.23909. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 33 Iter 198: loss 0.23220. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 33 Iter 198: loss 0.23220. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 33 Iter 199: loss 0.23733. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 33 Iter 199: loss 0.23733. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 200: loss 0.24040. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 200: loss 0.24040. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 33 Iter 201: loss 0.22565. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 33 Iter 201: loss 0.22565. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 33 Iter 202: loss 0.24569. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 33 Iter 202: loss 0.24569. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 33 Iter 203: loss 0.23570. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 33 Iter 203: loss 0.23570. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.24967. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.24967. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 33 Iter 205: loss 0.22392. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 33 Iter 205: loss 0.22392. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.22557. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.22557. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.22436. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.22436. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 33 Iter 208: loss 0.25374. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 33 Iter 208: loss 0.25374. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.23819. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.23819. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 33 Iter 210: loss 0.25689. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 33 Iter 210: loss 0.25689. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.22826. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.22826. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 212: loss 0.25462. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 212: loss 0.25462. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 33 Iter 213: loss 0.23819. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 33 Iter 213: loss 0.23819. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 33 Iter 214: loss 0.22388. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 33 Iter 214: loss 0.22388. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 33 Iter 215: loss 0.22242. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 215: loss 0.22242. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 216: loss 0.22440. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 216: loss 0.22440. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 33 Iter 217: loss 0.25054. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 217: loss 0.25054. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 218: loss 0.23125. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 218: loss 0.23125. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 33 Iter 219: loss 0.21541. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 219: loss 0.21541. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.24346. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.24346. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.23574. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.23574. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 222: loss 0.23408. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 222: loss 0.23408. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 33 Iter 223: loss 0.21907. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 33 Iter 223: loss 0.21907. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 33 Iter 224: loss 0.22469. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 33 Iter 224: loss 0.22469. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 33 Iter 224: loss 0.22469. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23357
    Valid loss: 0.23499
       Valid loss recons: 0.22324
       Valid loss KL-D:   1.1755
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.22172. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.22172. :   0%|▏                                             | 1/224 [00:00<01:46,  2.10it/s]
Epoch 34 Iter 2: loss 0.24175. :   0%|▏                                             | 1/224 [00:00<01:46,  2.10it/s]
Epoch 34 Iter 2: loss 0.24175. :   1%|▍                                             | 2/224 [00:00<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.23483. :   1%|▍                                             | 2/224 [00:01<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.23483. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 34 Iter 4: loss 0.23546. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 34 Iter 4: loss 0.23546. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 34 Iter 5: loss 0.25710. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 34 Iter 5: loss 0.25710. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 34 Iter 6: loss 0.24046. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 34 Iter 6: loss 0.24046. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 34 Iter 7: loss 0.24202. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 34 Iter 7: loss 0.24202. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 34 Iter 8: loss 0.24041. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 34 Iter 8: loss 0.24041. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 9: loss 0.24400. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.06it/s]
Epoch 34 Iter 9: loss 0.24400. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 10: loss 0.22132. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 10: loss 0.22132. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.21860. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.21860. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 34 Iter 12: loss 0.23934. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 34 Iter 12: loss 0.23934. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.08it/s]
Epoch 34 Iter 13: loss 0.23967. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.08it/s]
Epoch 34 Iter 13: loss 0.23967. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.05it/s]
Epoch 34 Iter 14: loss 0.21789. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.05it/s]
Epoch 34 Iter 14: loss 0.21789. :   6%|██▊                                         | 14/224 [00:06<01:42,  2.06it/s]
Epoch 34 Iter 15: loss 0.21283. :   6%|██▊                                         | 14/224 [00:07<01:42,  2.06it/s]
Epoch 34 Iter 15: loss 0.21283. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 34 Iter 16: loss 0.23115. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 34 Iter 16: loss 0.23115. :   7%|███▏                                        | 16/224 [00:07<01:39,  2.08it/s]
Epoch 34 Iter 17: loss 0.23900. :   7%|███▏                                        | 16/224 [00:08<01:39,  2.08it/s]
Epoch 34 Iter 17: loss 0.23900. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 34 Iter 18: loss 0.24737. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 34 Iter 18: loss 0.24737. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.05it/s]
Epoch 34 Iter 19: loss 0.25366. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.05it/s]
Epoch 34 Iter 19: loss 0.25366. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 34 Iter 20: loss 0.22777. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 34 Iter 20: loss 0.22777. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.22493. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.22493. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 34 Iter 22: loss 0.21917. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 34 Iter 22: loss 0.21917. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.04it/s]
Epoch 34 Iter 23: loss 0.25178. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 23: loss 0.25178. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 24: loss 0.24519. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.04it/s]
Epoch 34 Iter 24: loss 0.24519. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 34 Iter 25: loss 0.20688. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 34 Iter 25: loss 0.20688. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 26: loss 0.24598. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 26: loss 0.24598. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 27: loss 0.22603. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 34 Iter 27: loss 0.22603. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 34 Iter 28: loss 0.22833. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 34 Iter 28: loss 0.22833. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 34 Iter 29: loss 0.21515. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.07it/s]
Epoch 34 Iter 29: loss 0.21515. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 34 Iter 30: loss 0.24158. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 34 Iter 30: loss 0.24158. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 34 Iter 31: loss 0.23524. :  13%|█████▉                                      | 30/224 [00:15<01:33,  2.07it/s]
Epoch 34 Iter 31: loss 0.23524. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 34 Iter 32: loss 0.23827. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 34 Iter 32: loss 0.23827. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.10it/s]
Epoch 34 Iter 33: loss 0.23892. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.10it/s]
Epoch 34 Iter 33: loss 0.23892. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.10it/s]
Epoch 34 Iter 34: loss 0.24723. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.10it/s]
Epoch 34 Iter 34: loss 0.24723. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 34 Iter 35: loss 0.22480. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 34 Iter 35: loss 0.22480. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 34 Iter 36: loss 0.22685. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 36: loss 0.22685. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 34 Iter 37: loss 0.22558. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 34 Iter 37: loss 0.22558. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 34 Iter 38: loss 0.22230. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 34 Iter 38: loss 0.22230. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 34 Iter 39: loss 0.23060. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 34 Iter 39: loss 0.23060. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 34 Iter 40: loss 0.22345. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 34 Iter 40: loss 0.22345. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 34 Iter 41: loss 0.20536. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 34 Iter 41: loss 0.20536. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 34 Iter 42: loss 0.24329. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 34 Iter 42: loss 0.24329. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 34 Iter 43: loss 0.20995. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 34 Iter 43: loss 0.20995. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 34 Iter 44: loss 0.22773. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 34 Iter 44: loss 0.22773. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 34 Iter 45: loss 0.22722. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 34 Iter 45: loss 0.22722. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.08it/s]
Epoch 34 Iter 46: loss 0.21703. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.08it/s]
Epoch 34 Iter 46: loss 0.21703. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 47: loss 0.22997. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 47: loss 0.22997. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.23689. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.23689. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 34 Iter 49: loss 0.24340. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 34 Iter 49: loss 0.24340. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 34 Iter 50: loss 0.22998. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 34 Iter 50: loss 0.22998. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 34 Iter 51: loss 0.23303. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 34 Iter 51: loss 0.23303. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 34 Iter 52: loss 0.22500. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 34 Iter 52: loss 0.22500. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 53: loss 0.22070. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 53: loss 0.22070. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 34 Iter 54: loss 0.23420. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 34 Iter 54: loss 0.23420. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 34 Iter 55: loss 0.24445. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 34 Iter 55: loss 0.24445. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 34 Iter 56: loss 0.24261. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 34 Iter 56: loss 0.24261. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 34 Iter 57: loss 0.24780. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 34 Iter 57: loss 0.24780. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 34 Iter 58: loss 0.25549. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 58: loss 0.25549. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.22072. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.22072. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.26770. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.26770. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.23237. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.23237. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 34 Iter 62: loss 0.24306. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 34 Iter 62: loss 0.24306. :  28%|████████████▏                               | 62/224 [00:29<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.23221. :  28%|████████████▏                               | 62/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.23221. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.22133. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.22133. :  29%|████████████▌                               | 64/224 [00:30<01:16,  2.09it/s]
Epoch 34 Iter 65: loss 0.25575. :  29%|████████████▌                               | 64/224 [00:31<01:16,  2.09it/s]
Epoch 34 Iter 65: loss 0.25575. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.09it/s]
Epoch 34 Iter 66: loss 0.23432. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.09it/s]
Epoch 34 Iter 66: loss 0.23432. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 67: loss 0.22569. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 34 Iter 67: loss 0.22569. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 34 Iter 68: loss 0.24550. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 34 Iter 68: loss 0.24550. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.07it/s]
Epoch 34 Iter 69: loss 0.23556. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 34 Iter 69: loss 0.23556. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 34 Iter 70: loss 0.25325. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 34 Iter 70: loss 0.25325. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.25604. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.25604. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 34 Iter 72: loss 0.21960. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 34 Iter 72: loss 0.21960. :  32%|██████████████▏                             | 72/224 [00:34<01:12,  2.09it/s]
Epoch 34 Iter 73: loss 0.22122. :  32%|██████████████▏                             | 72/224 [00:35<01:12,  2.09it/s]
Epoch 34 Iter 73: loss 0.22122. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 34 Iter 74: loss 0.25313. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 34 Iter 74: loss 0.25313. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 34 Iter 75: loss 0.24211. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 34 Iter 75: loss 0.24211. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 34 Iter 76: loss 0.25265. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 34 Iter 76: loss 0.25265. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 34 Iter 77: loss 0.22510. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 77: loss 0.22510. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 78: loss 0.23604. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 78: loss 0.23604. :  35%|███████████████▎                            | 78/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 79: loss 0.23713. :  35%|███████████████▎                            | 78/224 [00:38<01:11,  2.06it/s]
Epoch 34 Iter 79: loss 0.23713. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 80: loss 0.22707. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 80: loss 0.22707. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 81: loss 0.23937. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.05it/s]
Epoch 34 Iter 81: loss 0.23937. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 34 Iter 82: loss 0.23537. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 34 Iter 82: loss 0.23537. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 34 Iter 83: loss 0.25103. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 34 Iter 83: loss 0.25103. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 34 Iter 84: loss 0.22016. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 34 Iter 84: loss 0.22016. :  38%|████████████████▌                           | 84/224 [00:40<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.22601. :  38%|████████████████▌                           | 84/224 [00:41<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.22601. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 34 Iter 86: loss 0.23582. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 34 Iter 86: loss 0.23582. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 34 Iter 87: loss 0.19483. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 34 Iter 87: loss 0.19483. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 34 Iter 88: loss 0.22496. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 34 Iter 88: loss 0.22496. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 34 Iter 89: loss 0.22577. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 34 Iter 89: loss 0.22577. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 90: loss 0.23373. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 90: loss 0.23373. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 91: loss 0.24653. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 34 Iter 91: loss 0.24653. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 34 Iter 92: loss 0.21907. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 34 Iter 92: loss 0.21907. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 34 Iter 93: loss 0.22114. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 34 Iter 93: loss 0.22114. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 34 Iter 94: loss 0.21981. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 34 Iter 94: loss 0.21981. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 34 Iter 95: loss 0.23825. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 34 Iter 95: loss 0.23825. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.05it/s]
Epoch 34 Iter 96: loss 0.22984. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.05it/s]
Epoch 34 Iter 96: loss 0.22984. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.22689. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.22689. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 34 Iter 98: loss 0.24340. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 34 Iter 98: loss 0.24340. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 34 Iter 99: loss 0.22845. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 34 Iter 99: loss 0.22845. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 34 Iter 100: loss 0.22063. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 34 Iter 100: loss 0.22063. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 34 Iter 101: loss 0.23979. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 34 Iter 101: loss 0.23979. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 34 Iter 102: loss 0.23783. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 102: loss 0.23783. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 103: loss 0.21503. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 34 Iter 103: loss 0.21503. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.05it/s]
Epoch 34 Iter 104: loss 0.21369. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.05it/s]
Epoch 34 Iter 104: loss 0.21369. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 34 Iter 105: loss 0.25982. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 34 Iter 105: loss 0.25982. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 34 Iter 106: loss 0.23080. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 34 Iter 106: loss 0.23080. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 34 Iter 107: loss 0.23539. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 34 Iter 107: loss 0.23539. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 34 Iter 108: loss 0.22726. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 108: loss 0.22726. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 109: loss 0.23241. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 34 Iter 109: loss 0.23241. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 34 Iter 110: loss 0.23637. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 34 Iter 110: loss 0.23637. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.22796. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.22796. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 34 Iter 112: loss 0.24358. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 34 Iter 112: loss 0.24358. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 34 Iter 113: loss 0.24728. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 34 Iter 113: loss 0.24728. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 34 Iter 114: loss 0.23068. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 34 Iter 114: loss 0.23068. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 34 Iter 115: loss 0.24140. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 34 Iter 115: loss 0.24140. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.08it/s]
Epoch 34 Iter 116: loss 0.22657. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.08it/s]
Epoch 34 Iter 116: loss 0.22657. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 34 Iter 117: loss 0.25434. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 34 Iter 117: loss 0.25434. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 34 Iter 118: loss 0.25740. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 34 Iter 118: loss 0.25740. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 34 Iter 119: loss 0.23340. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 34 Iter 119: loss 0.23340. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.08it/s]
Epoch 34 Iter 120: loss 0.22475. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.08it/s]
Epoch 34 Iter 120: loss 0.22475. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.08it/s]
Epoch 34 Iter 121: loss 0.23188. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.08it/s]
Epoch 34 Iter 121: loss 0.23188. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 34 Iter 122: loss 0.24370. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 34 Iter 122: loss 0.24370. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 34 Iter 123: loss 0.23161. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 34 Iter 123: loss 0.23161. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 34 Iter 124: loss 0.22750. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 34 Iter 124: loss 0.22750. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.07it/s]
Epoch 34 Iter 125: loss 0.22691. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 34 Iter 125: loss 0.22691. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 34 Iter 126: loss 0.22851. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 34 Iter 126: loss 0.22851. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 34 Iter 127: loss 0.21940. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 34 Iter 127: loss 0.21940. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 34 Iter 128: loss 0.24389. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 34 Iter 128: loss 0.24389. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 34 Iter 129: loss 0.23096. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 34 Iter 129: loss 0.23096. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 34 Iter 130: loss 0.23109. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 34 Iter 130: loss 0.23109. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.06it/s]
Epoch 34 Iter 131: loss 0.25010. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 34 Iter 131: loss 0.25010. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 34 Iter 132: loss 0.24168. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 34 Iter 132: loss 0.24168. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 34 Iter 133: loss 0.22903. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 34 Iter 133: loss 0.22903. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.23777. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.23777. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 34 Iter 135: loss 0.22093. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 34 Iter 135: loss 0.22093. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.23077. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.23077. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.05it/s]
Epoch 34 Iter 137: loss 0.23000. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.05it/s]
Epoch 34 Iter 137: loss 0.23000. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 34 Iter 138: loss 0.22330. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 34 Iter 138: loss 0.22330. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 34 Iter 139: loss 0.24814. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 34 Iter 139: loss 0.24814. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 34 Iter 140: loss 0.22971. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 34 Iter 140: loss 0.22971. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 34 Iter 141: loss 0.22235. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 34 Iter 141: loss 0.22235. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 34 Iter 142: loss 0.21618. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 34 Iter 142: loss 0.21618. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.24390. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.24390. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.22636. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.22636. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 34 Iter 145: loss 0.23226. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 145: loss 0.23226. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.23479. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.23479. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 34 Iter 147: loss 0.23234. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 34 Iter 147: loss 0.23234. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.22749. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.22749. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.24998. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.24998. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 150: loss 0.24543. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 150: loss 0.24543. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.21973. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.21973. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.23600. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.23600. :  68%|████████████████████████████▌             | 152/224 [01:13<00:36,  1.99it/s]
Epoch 34 Iter 153: loss 0.25857. :  68%|████████████████████████████▌             | 152/224 [01:14<00:36,  1.99it/s]
Epoch 34 Iter 153: loss 0.25857. :  68%|████████████████████████████▋             | 153/224 [01:14<00:35,  2.00it/s]
Epoch 34 Iter 154: loss 0.24113. :  68%|████████████████████████████▋             | 153/224 [01:14<00:35,  2.00it/s]
Epoch 34 Iter 154: loss 0.24113. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.02it/s]
Epoch 34 Iter 155: loss 0.23226. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.02it/s]
Epoch 34 Iter 155: loss 0.23226. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.04it/s]
Epoch 34 Iter 156: loss 0.23336. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.04it/s]
Epoch 34 Iter 156: loss 0.23336. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.04it/s]
Epoch 34 Iter 157: loss 0.22022. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.04it/s]
Epoch 34 Iter 157: loss 0.22022. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 34 Iter 158: loss 0.23153. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 34 Iter 158: loss 0.23153. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.22156. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.22156. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 34 Iter 160: loss 0.23839. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 34 Iter 160: loss 0.23839. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 34 Iter 161: loss 0.22873. :  71%|██████████████████████████████            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 34 Iter 161: loss 0.22873. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.05it/s]
Epoch 34 Iter 162: loss 0.22654. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.05it/s]
Epoch 34 Iter 162: loss 0.22654. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.05it/s]
Epoch 34 Iter 163: loss 0.23142. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:30,  2.05it/s]
Epoch 34 Iter 163: loss 0.23142. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 34 Iter 164: loss 0.23868. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 34 Iter 164: loss 0.23868. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 34 Iter 165: loss 0.23347. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 34 Iter 165: loss 0.23347. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 34 Iter 166: loss 0.24688. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 34 Iter 166: loss 0.24688. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 34 Iter 167: loss 0.23962. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 34 Iter 167: loss 0.23962. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.08it/s]
Epoch 34 Iter 168: loss 0.23837. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.08it/s]
Epoch 34 Iter 168: loss 0.23837. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 34 Iter 169: loss 0.22113. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 34 Iter 169: loss 0.22113. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 34 Iter 170: loss 0.25174. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 34 Iter 170: loss 0.25174. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 34 Iter 171: loss 0.20777. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 34 Iter 171: loss 0.20777. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 34 Iter 172: loss 0.22581. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 172: loss 0.22581. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 173: loss 0.24059. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 173: loss 0.24059. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.22352. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.22352. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.23284. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.23284. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.22836. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.22836. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.23534. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.23534. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.25455. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.25455. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 179: loss 0.22101. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 179: loss 0.22101. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 34 Iter 180: loss 0.23602. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 180: loss 0.23602. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.24301. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.24301. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.22762. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.22762. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 34 Iter 183: loss 0.24650. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 34 Iter 183: loss 0.24650. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.26781. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.26781. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.20905. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.20905. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.25145. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.25145. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.24804. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.24804. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 34 Iter 188: loss 0.21396. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 34 Iter 188: loss 0.21396. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.23340. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.23340. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.22484. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.22484. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 34 Iter 191: loss 0.24063. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 34 Iter 191: loss 0.24063. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 34 Iter 192: loss 0.23320. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 34 Iter 192: loss 0.23320. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 34 Iter 193: loss 0.22369. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 34 Iter 193: loss 0.22369. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 34 Iter 194: loss 0.22360. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 34 Iter 194: loss 0.22360. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 34 Iter 195: loss 0.23969. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 34 Iter 195: loss 0.23969. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 34 Iter 196: loss 0.24098. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 34 Iter 196: loss 0.24098. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.04it/s]
Epoch 34 Iter 197: loss 0.23770. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 34 Iter 197: loss 0.23770. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 34 Iter 198: loss 0.23723. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 34 Iter 198: loss 0.23723. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.05it/s]
Epoch 34 Iter 199: loss 0.24102. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 34 Iter 199: loss 0.24102. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 200: loss 0.22978. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 200: loss 0.22978. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 34 Iter 201: loss 0.23072. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 201: loss 0.23072. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.23971. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.23971. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 34 Iter 203: loss 0.22908. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 34 Iter 203: loss 0.22908. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.23089. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.23089. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.24893. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.24893. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 206: loss 0.23022. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 206: loss 0.23022. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 34 Iter 207: loss 0.21926. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 34 Iter 207: loss 0.21926. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 34 Iter 208: loss 0.20889. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 34 Iter 208: loss 0.20889. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.22601. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.22601. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.23694. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.23694. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.22383. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.22383. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.23273. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.23273. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.23788. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.23788. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 34 Iter 214: loss 0.23267. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 34 Iter 214: loss 0.23267. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 34 Iter 215: loss 0.23825. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 34 Iter 215: loss 0.23825. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 34 Iter 216: loss 0.22529. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 34 Iter 216: loss 0.22529. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 34 Iter 217: loss 0.23667. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 34 Iter 217: loss 0.23667. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 34 Iter 218: loss 0.21488. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 34 Iter 218: loss 0.21488. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 34 Iter 219: loss 0.22160. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 219: loss 0.22160. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 220: loss 0.22699. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 220: loss 0.22699. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 34 Iter 221: loss 0.25416. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 34 Iter 221: loss 0.25416. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 34 Iter 222: loss 0.22247. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 34 Iter 222: loss 0.22247. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.24986. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.24986. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.23158. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.23158. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.23158. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.21663. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.21663. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 35 Iter 2: loss 0.24737. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 35 Iter 2: loss 0.24737. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 35 Iter 3: loss 0.22971. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 35 Iter 3: loss 0.22971. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.23372. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.23372. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.24438. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.24438. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 35 Iter 6: loss 0.23966. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 35 Iter 6: loss 0.23966. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.06it/s]
Epoch 35 Iter 7: loss 0.23832. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.06it/s]
Epoch 35 Iter 7: loss 0.23832. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 35 Iter 8: loss 0.23608. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 35 Iter 8: loss 0.23608. :   4%|█▋                                            | 8/224 [00:03<01:43,  2.08it/s]
Epoch 35 Iter 9: loss 0.23372. :   4%|█▋                                            | 8/224 [00:04<01:43,  2.08it/s]
Epoch 35 Iter 9: loss 0.23372. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 35 Iter 10: loss 0.21953. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 35 Iter 10: loss 0.21953. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 35 Iter 11: loss 0.23503. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 35 Iter 11: loss 0.23503. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 35 Iter 12: loss 0.21901. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 35 Iter 12: loss 0.21901. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.08it/s]
Epoch 35 Iter 13: loss 0.25004. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.08it/s]
Epoch 35 Iter 13: loss 0.25004. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 35 Iter 14: loss 0.21689. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 35 Iter 14: loss 0.21689. :   6%|██▊                                         | 14/224 [00:06<01:40,  2.08it/s]
Epoch 35 Iter 15: loss 0.23078. :   6%|██▊                                         | 14/224 [00:07<01:40,  2.08it/s]
Epoch 35 Iter 15: loss 0.23078. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 35 Iter 16: loss 0.24659. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 35 Iter 16: loss 0.24659. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 35 Iter 17: loss 0.21854. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 35 Iter 17: loss 0.21854. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 35 Iter 18: loss 0.22632. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 35 Iter 18: loss 0.22632. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.08it/s]
Epoch 35 Iter 19: loss 0.25570. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.08it/s]
Epoch 35 Iter 19: loss 0.25570. :   8%|███▋                                        | 19/224 [00:09<01:37,  2.09it/s]
Epoch 35 Iter 20: loss 0.25359. :   8%|███▋                                        | 19/224 [00:09<01:37,  2.09it/s]
Epoch 35 Iter 20: loss 0.25359. :   9%|███▉                                        | 20/224 [00:09<01:37,  2.09it/s]
Epoch 35 Iter 21: loss 0.23481. :   9%|███▉                                        | 20/224 [00:10<01:37,  2.09it/s]
Epoch 35 Iter 21: loss 0.23481. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 35 Iter 22: loss 0.24407. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 35 Iter 22: loss 0.24407. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.08it/s]
Epoch 35 Iter 23: loss 0.23536. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.08it/s]
Epoch 35 Iter 23: loss 0.23536. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 35 Iter 24: loss 0.23257. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 35 Iter 24: loss 0.23257. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 35 Iter 25: loss 0.23545. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 35 Iter 25: loss 0.23545. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 35 Iter 26: loss 0.23194. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 35 Iter 26: loss 0.23194. :  12%|█████                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 35 Iter 27: loss 0.22309. :  12%|█████                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 35 Iter 27: loss 0.22309. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 35 Iter 28: loss 0.22365. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 35 Iter 28: loss 0.22365. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 35 Iter 29: loss 0.22701. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 35 Iter 29: loss 0.22701. :  13%|█████▋                                      | 29/224 [00:13<01:34,  2.07it/s]
Epoch 35 Iter 30: loss 0.24279. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 35 Iter 30: loss 0.24279. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 35 Iter 31: loss 0.22738. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 35 Iter 31: loss 0.22738. :  14%|██████                                      | 31/224 [00:14<01:33,  2.07it/s]
Epoch 35 Iter 32: loss 0.23085. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 35 Iter 32: loss 0.23085. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 35 Iter 33: loss 0.24868. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 35 Iter 33: loss 0.24868. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.26033. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.26033. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 35 Iter 35: loss 0.22951. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 35 Iter 35: loss 0.22951. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 35 Iter 36: loss 0.24095. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 35 Iter 36: loss 0.24095. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 35 Iter 37: loss 0.22686. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 35 Iter 37: loss 0.22686. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 35 Iter 38: loss 0.23373. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 35 Iter 38: loss 0.23373. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 39: loss 0.23597. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 39: loss 0.23597. :  17%|███████▋                                    | 39/224 [00:18<01:28,  2.08it/s]
Epoch 35 Iter 40: loss 0.24455. :  17%|███████▋                                    | 39/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 40: loss 0.24455. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.22103. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.22103. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.22342. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.22342. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 35 Iter 43: loss 0.25798. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.08it/s]
Epoch 35 Iter 43: loss 0.25798. :  19%|████████▍                                   | 43/224 [00:20<01:26,  2.09it/s]
Epoch 35 Iter 44: loss 0.24035. :  19%|████████▍                                   | 43/224 [00:21<01:26,  2.09it/s]
Epoch 35 Iter 44: loss 0.24035. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.08it/s]
Epoch 35 Iter 45: loss 0.21579. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.08it/s]
Epoch 35 Iter 45: loss 0.21579. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.08it/s]
Epoch 35 Iter 46: loss 0.22771. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.08it/s]
Epoch 35 Iter 46: loss 0.22771. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.09it/s]
Epoch 35 Iter 47: loss 0.22120. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.09it/s]
Epoch 35 Iter 47: loss 0.22120. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 35 Iter 48: loss 0.23725. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 35 Iter 48: loss 0.23725. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 35 Iter 49: loss 0.24365. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 35 Iter 49: loss 0.24365. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 35 Iter 50: loss 0.25777. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 35 Iter 50: loss 0.25777. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 35 Iter 51: loss 0.22343. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 35 Iter 51: loss 0.22343. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 35 Iter 52: loss 0.23187. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 35 Iter 52: loss 0.23187. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 35 Iter 53: loss 0.24624. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 35 Iter 53: loss 0.24624. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.06it/s]
Epoch 35 Iter 54: loss 0.24827. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.06it/s]
Epoch 35 Iter 54: loss 0.24827. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 35 Iter 55: loss 0.24120. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 35 Iter 55: loss 0.24120. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.06it/s]
Epoch 35 Iter 56: loss 0.22102. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.06it/s]
Epoch 35 Iter 56: loss 0.22102. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 57: loss 0.22714. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 57: loss 0.22714. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 58: loss 0.24140. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 35 Iter 58: loss 0.24140. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.22660. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.22660. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 35 Iter 60: loss 0.25345. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 35 Iter 60: loss 0.25345. :  27%|███████████▊                                | 60/224 [00:28<01:19,  2.07it/s]
Epoch 35 Iter 61: loss 0.24523. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 35 Iter 61: loss 0.24523. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 35 Iter 62: loss 0.22367. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 35 Iter 62: loss 0.22367. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.06it/s]
Epoch 35 Iter 63: loss 0.23201. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 35 Iter 63: loss 0.23201. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 35 Iter 64: loss 0.24400. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 35 Iter 64: loss 0.24400. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.06it/s]
Epoch 35 Iter 65: loss 0.23959. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 65: loss 0.23959. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 66: loss 0.22698. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 66: loss 0.22698. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 35 Iter 67: loss 0.24617. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 67: loss 0.24617. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.21964. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.21964. :  30%|█████████████▎                              | 68/224 [00:32<01:16,  2.05it/s]
Epoch 35 Iter 69: loss 0.23926. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 35 Iter 69: loss 0.23926. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 35 Iter 70: loss 0.23243. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 35 Iter 70: loss 0.23243. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 35 Iter 71: loss 0.22433. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 35 Iter 71: loss 0.22433. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 35 Iter 72: loss 0.22489. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 35 Iter 72: loss 0.22489. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.05it/s]
Epoch 35 Iter 73: loss 0.21850. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.05it/s]
Epoch 35 Iter 73: loss 0.21850. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.04it/s]
Epoch 35 Iter 74: loss 0.22331. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.04it/s]
Epoch 35 Iter 74: loss 0.22331. :  33%|██████████████▌                             | 74/224 [00:35<01:13,  2.05it/s]
Epoch 35 Iter 75: loss 0.23019. :  33%|██████████████▌                             | 74/224 [00:36<01:13,  2.05it/s]
Epoch 35 Iter 75: loss 0.23019. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 76: loss 0.22765. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 76: loss 0.22765. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 35 Iter 77: loss 0.23071. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 35 Iter 77: loss 0.23071. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 78: loss 0.22765. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 78: loss 0.22765. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 35 Iter 79: loss 0.22433. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 35 Iter 79: loss 0.22433. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.03it/s]
Epoch 35 Iter 80: loss 0.23601. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.03it/s]
Epoch 35 Iter 80: loss 0.23601. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.03it/s]
Epoch 35 Iter 81: loss 0.21197. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.03it/s]
Epoch 35 Iter 81: loss 0.21197. :  36%|███████████████▉                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 35 Iter 82: loss 0.23929. :  36%|███████████████▉                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 35 Iter 82: loss 0.23929. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 35 Iter 83: loss 0.23633. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 35 Iter 83: loss 0.23633. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.22914. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.22914. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 35 Iter 85: loss 0.24050. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 35 Iter 85: loss 0.24050. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 35 Iter 86: loss 0.21871. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 35 Iter 86: loss 0.21871. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 35 Iter 87: loss 0.23713. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 87: loss 0.23713. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 35 Iter 88: loss 0.23014. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 35 Iter 88: loss 0.23014. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 89: loss 0.22135. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.06it/s]
Epoch 35 Iter 89: loss 0.22135. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 35 Iter 90: loss 0.23315. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 35 Iter 90: loss 0.23315. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 35 Iter 91: loss 0.24257. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 35 Iter 91: loss 0.24257. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 35 Iter 92: loss 0.22278. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 35 Iter 92: loss 0.22278. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.22707. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.22707. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 94: loss 0.22726. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 94: loss 0.22726. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 35 Iter 95: loss 0.23287. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 35 Iter 95: loss 0.23287. :  42%|██████████████████▋                         | 95/224 [00:45<01:01,  2.09it/s]
Epoch 35 Iter 96: loss 0.23153. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.09it/s]
Epoch 35 Iter 96: loss 0.23153. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 35 Iter 97: loss 0.23890. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 35 Iter 97: loss 0.23890. :  43%|███████████████████                         | 97/224 [00:46<01:00,  2.08it/s]
Epoch 35 Iter 98: loss 0.23347. :  43%|███████████████████                         | 97/224 [00:47<01:00,  2.08it/s]
Epoch 35 Iter 98: loss 0.23347. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 35 Iter 99: loss 0.23098. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 35 Iter 99: loss 0.23098. :  44%|███████████████████▍                        | 99/224 [00:47<00:59,  2.09it/s]
Epoch 35 Iter 100: loss 0.23721. :  44%|███████████████████                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 35 Iter 100: loss 0.23721. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 35 Iter 101: loss 0.22404. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 35 Iter 101: loss 0.22404. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 35 Iter 102: loss 0.24352. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 35 Iter 102: loss 0.24352. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 35 Iter 103: loss 0.22356. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 35 Iter 103: loss 0.22356. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 35 Iter 104: loss 0.21821. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 104: loss 0.21821. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 35 Iter 105: loss 0.23245. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 35 Iter 105: loss 0.23245. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 35 Iter 106: loss 0.25717. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 106: loss 0.25717. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 107: loss 0.24275. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 35 Iter 107: loss 0.24275. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 35 Iter 108: loss 0.24898. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 35 Iter 108: loss 0.24898. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 35 Iter 109: loss 0.22635. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 35 Iter 109: loss 0.22635. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.08it/s]
Epoch 35 Iter 110: loss 0.25006. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.08it/s]
Epoch 35 Iter 110: loss 0.25006. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 35 Iter 111: loss 0.22656. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 35 Iter 111: loss 0.22656. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 35 Iter 112: loss 0.22746. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 112: loss 0.22746. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 113: loss 0.23486. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 35 Iter 113: loss 0.23486. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 35 Iter 114: loss 0.23667. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 114: loss 0.23667. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 115: loss 0.22573. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 35 Iter 115: loss 0.22573. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 35 Iter 116: loss 0.23190. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 35 Iter 116: loss 0.23190. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 35 Iter 117: loss 0.23269. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 35 Iter 117: loss 0.23269. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 35 Iter 118: loss 0.22675. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 35 Iter 118: loss 0.22675. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 35 Iter 119: loss 0.22736. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 35 Iter 119: loss 0.22736. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.05it/s]
Epoch 35 Iter 120: loss 0.22929. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.05it/s]
Epoch 35 Iter 120: loss 0.22929. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 121: loss 0.22132. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 121: loss 0.22132. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 35 Iter 122: loss 0.21569. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 35 Iter 122: loss 0.21569. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 35 Iter 123: loss 0.23539. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 35 Iter 123: loss 0.23539. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 35 Iter 124: loss 0.22507. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 35 Iter 124: loss 0.22507. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 125: loss 0.23222. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 125: loss 0.23222. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 35 Iter 126: loss 0.23856. :  56%|███████████████████████▍                  | 125/224 [01:01<00:48,  2.05it/s]
Epoch 35 Iter 126: loss 0.23856. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 35 Iter 127: loss 0.25260. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 35 Iter 127: loss 0.25260. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 35 Iter 128: loss 0.22650. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 35 Iter 128: loss 0.22650. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.04it/s]
Epoch 35 Iter 129: loss 0.23542. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.04it/s]
Epoch 35 Iter 129: loss 0.23542. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 35 Iter 130: loss 0.23244. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 35 Iter 130: loss 0.23244. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.06it/s]
Epoch 35 Iter 131: loss 0.24302. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 35 Iter 131: loss 0.24302. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 35 Iter 132: loss 0.21057. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 35 Iter 132: loss 0.21057. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 35 Iter 133: loss 0.23860. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 35 Iter 133: loss 0.23860. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 35 Iter 134: loss 0.22456. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 35 Iter 134: loss 0.22456. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 35 Iter 135: loss 0.24628. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 35 Iter 135: loss 0.24628. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 35 Iter 136: loss 0.22350. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 35 Iter 136: loss 0.22350. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 35 Iter 137: loss 0.20499. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 35 Iter 137: loss 0.20499. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 35 Iter 138: loss 0.23869. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 35 Iter 138: loss 0.23869. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.22934. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.22934. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 35 Iter 140: loss 0.20944. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 35 Iter 140: loss 0.20944. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.05it/s]
Epoch 35 Iter 141: loss 0.23646. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.05it/s]
Epoch 35 Iter 141: loss 0.23646. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.05it/s]
Epoch 35 Iter 142: loss 0.23906. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.05it/s]
Epoch 35 Iter 142: loss 0.23906. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.21678. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.21678. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 35 Iter 144: loss 0.23944. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 35 Iter 144: loss 0.23944. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.22897. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.22897. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 146: loss 0.22068. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 146: loss 0.22068. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.05it/s]
Epoch 35 Iter 147: loss 0.23566. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.05it/s]
Epoch 35 Iter 147: loss 0.23566. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 35 Iter 148: loss 0.25479. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 35 Iter 148: loss 0.25479. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 35 Iter 149: loss 0.21045. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 35 Iter 149: loss 0.21045. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 35 Iter 150: loss 0.24147. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 35 Iter 150: loss 0.24147. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 35 Iter 151: loss 0.23018. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 35 Iter 151: loss 0.23018. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.24132. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.24132. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 35 Iter 153: loss 0.25132. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 153: loss 0.25132. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 154: loss 0.21454. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 35 Iter 154: loss 0.21454. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 35 Iter 155: loss 0.24016. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 155: loss 0.24016. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 156: loss 0.23228. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 35 Iter 156: loss 0.23228. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.23625. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.23625. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.23949. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.23949. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.25105. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.25105. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 35 Iter 160: loss 0.22775. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 35 Iter 160: loss 0.22775. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.06it/s]
Epoch 35 Iter 161: loss 0.24370. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 161: loss 0.24370. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 162: loss 0.22577. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 162: loss 0.22577. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 163: loss 0.25284. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 35 Iter 163: loss 0.25284. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.05it/s]
Epoch 35 Iter 164: loss 0.24739. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 35 Iter 164: loss 0.24739. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.23407. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.23407. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 35 Iter 166: loss 0.21270. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 35 Iter 166: loss 0.21270. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 35 Iter 167: loss 0.21098. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 35 Iter 167: loss 0.21098. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.21772. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.21772. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 35 Iter 169: loss 0.22229. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 35 Iter 169: loss 0.22229. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 35 Iter 170: loss 0.21886. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 35 Iter 170: loss 0.21886. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.22304. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.22304. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.23114. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.23114. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 35 Iter 173: loss 0.23266. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 35 Iter 173: loss 0.23266. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 35 Iter 174: loss 0.25561. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 35 Iter 174: loss 0.25561. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 35 Iter 175: loss 0.21704. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 35 Iter 175: loss 0.21704. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 35 Iter 176: loss 0.25885. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 35 Iter 176: loss 0.25885. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.25351. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.25351. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.21715. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.21715. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 179: loss 0.24910. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 179: loss 0.24910. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 35 Iter 180: loss 0.22072. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 180: loss 0.22072. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 181: loss 0.23234. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 181: loss 0.23234. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 35 Iter 182: loss 0.22248. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 182: loss 0.22248. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 183: loss 0.22127. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 183: loss 0.22127. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 35 Iter 184: loss 0.24575. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 35 Iter 184: loss 0.24575. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 35 Iter 185: loss 0.24460. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 35 Iter 185: loss 0.24460. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 35 Iter 186: loss 0.24658. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 35 Iter 186: loss 0.24658. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 35 Iter 187: loss 0.23117. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 35 Iter 187: loss 0.23117. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 35 Iter 188: loss 0.24647. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.04it/s]
Epoch 35 Iter 188: loss 0.24647. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 35 Iter 189: loss 0.24257. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 35 Iter 189: loss 0.24257. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 35 Iter 190: loss 0.22667. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 35 Iter 190: loss 0.22667. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 191: loss 0.22695. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 191: loss 0.22695. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 35 Iter 192: loss 0.23350. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.05it/s]
Epoch 35 Iter 192: loss 0.23350. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 35 Iter 193: loss 0.25144. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 35 Iter 193: loss 0.25144. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 35 Iter 194: loss 0.24900. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 35 Iter 194: loss 0.24900. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 195: loss 0.24211. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 195: loss 0.24211. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 196: loss 0.25641. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 35 Iter 196: loss 0.25641. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.24116. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.24116. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 198: loss 0.22781. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 198: loss 0.22781. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 35 Iter 199: loss 0.21841. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 35 Iter 199: loss 0.21841. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 35 Iter 200: loss 0.21867. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 35 Iter 200: loss 0.21867. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 35 Iter 201: loss 0.23341. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 35 Iter 201: loss 0.23341. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 35 Iter 202: loss 0.23933. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 35 Iter 202: loss 0.23933. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 35 Iter 203: loss 0.24432. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 35 Iter 203: loss 0.24432. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 35 Iter 204: loss 0.22205. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 35 Iter 204: loss 0.22205. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 35 Iter 205: loss 0.23465. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 35 Iter 205: loss 0.23465. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 35 Iter 206: loss 0.24378. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 35 Iter 206: loss 0.24378. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.05it/s]
Epoch 35 Iter 207: loss 0.23311. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 35 Iter 207: loss 0.23311. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 35 Iter 208: loss 0.22490. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 35 Iter 208: loss 0.22490. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 35 Iter 209: loss 0.23811. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 35 Iter 209: loss 0.23811. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 35 Iter 210: loss 0.21705. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 35 Iter 210: loss 0.21705. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 35 Iter 211: loss 0.23545. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 35 Iter 211: loss 0.23545. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 35 Iter 212: loss 0.22908. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 35 Iter 212: loss 0.22908. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 35 Iter 213: loss 0.23353. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 35 Iter 213: loss 0.23353. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 35 Iter 214: loss 0.24337. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 35 Iter 214: loss 0.24337. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 35 Iter 215: loss 0.21451. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 35 Iter 215: loss 0.21451. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 35 Iter 216: loss 0.25711. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 35 Iter 216: loss 0.25711. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.21305. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.21305. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 35 Iter 218: loss 0.25657. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 35 Iter 218: loss 0.25657. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 35 Iter 219: loss 0.23327. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 35 Iter 219: loss 0.23327. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 35 Iter 220: loss 0.22835. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 35 Iter 220: loss 0.22835. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.05it/s]
Epoch 35 Iter 221: loss 0.23140. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.05it/s]
Epoch 35 Iter 221: loss 0.23140. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 35 Iter 222: loss 0.23439. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 35 Iter 222: loss 0.23439. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 35 Iter 223: loss 0.21716. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 35 Iter 223: loss 0.21716. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 35 Iter 224: loss 0.22167. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 35 Iter 224: loss 0.22167. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 35 Iter 224: loss 0.22167. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23319
    Valid loss: 0.23469
       Valid loss recons: 0.22338
       Valid loss KL-D:   1.13115
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.24861. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.24861. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 36 Iter 2: loss 0.23406. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 36 Iter 2: loss 0.23406. :   1%|▍                                             | 2/224 [00:00<01:46,  2.08it/s]
Epoch 36 Iter 3: loss 0.24474. :   1%|▍                                             | 2/224 [00:01<01:46,  2.08it/s]
Epoch 36 Iter 3: loss 0.24474. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 4: loss 0.22806. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 4: loss 0.22806. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 36 Iter 5: loss 0.22847. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 5: loss 0.22847. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.23537. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.23537. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.06it/s]
Epoch 36 Iter 7: loss 0.23272. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 7: loss 0.23272. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 8: loss 0.25281. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 36 Iter 8: loss 0.25281. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 36 Iter 9: loss 0.23203. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 36 Iter 9: loss 0.23203. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.23490. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.23490. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 36 Iter 11: loss 0.24609. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 36 Iter 11: loss 0.24609. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.08it/s]
Epoch 36 Iter 12: loss 0.21890. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.08it/s]
Epoch 36 Iter 12: loss 0.21890. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 13: loss 0.25709. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 36 Iter 13: loss 0.25709. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 36 Iter 14: loss 0.22776. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 36 Iter 14: loss 0.22776. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 36 Iter 15: loss 0.20697. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 36 Iter 15: loss 0.20697. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 16: loss 0.22439. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 16: loss 0.22439. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 36 Iter 17: loss 0.24190. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 36 Iter 17: loss 0.24190. :   8%|███▎                                        | 17/224 [00:08<01:41,  2.05it/s]
Epoch 36 Iter 18: loss 0.23611. :   8%|███▎                                        | 17/224 [00:08<01:41,  2.05it/s]
Epoch 36 Iter 18: loss 0.23611. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.23973. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.23973. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.22379. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.22379. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.22284. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.22284. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 36 Iter 22: loss 0.22956. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 36 Iter 22: loss 0.22956. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 36 Iter 23: loss 0.22193. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 36 Iter 23: loss 0.22193. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 36 Iter 24: loss 0.23380. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 36 Iter 24: loss 0.23380. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 36 Iter 25: loss 0.22307. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 36 Iter 25: loss 0.22307. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 36 Iter 26: loss 0.23621. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 36 Iter 26: loss 0.23621. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 27: loss 0.23818. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 36 Iter 27: loss 0.23818. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.24380. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.24380. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 36 Iter 29: loss 0.24393. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.07it/s]
Epoch 36 Iter 29: loss 0.24393. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 36 Iter 30: loss 0.23412. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 36 Iter 30: loss 0.23412. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 36 Iter 31: loss 0.23175. :  13%|█████▉                                      | 30/224 [00:15<01:33,  2.07it/s]
Epoch 36 Iter 31: loss 0.23175. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 36 Iter 32: loss 0.22047. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 36 Iter 32: loss 0.22047. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 36 Iter 33: loss 0.21548. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 36 Iter 33: loss 0.21548. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.06it/s]
Epoch 36 Iter 34: loss 0.21925. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 36 Iter 34: loss 0.21925. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 36 Iter 35: loss 0.22516. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 36 Iter 35: loss 0.22516. :  16%|██████▉                                     | 35/224 [00:16<01:32,  2.05it/s]
Epoch 36 Iter 36: loss 0.23157. :  16%|██████▉                                     | 35/224 [00:17<01:32,  2.05it/s]
Epoch 36 Iter 36: loss 0.23157. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 36 Iter 37: loss 0.26053. :  16%|███████                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 36 Iter 37: loss 0.26053. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 36 Iter 38: loss 0.24307. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 36 Iter 38: loss 0.24307. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 36 Iter 39: loss 0.22565. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 36 Iter 39: loss 0.22565. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 36 Iter 40: loss 0.20114. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 36 Iter 40: loss 0.20114. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 36 Iter 41: loss 0.23592. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 36 Iter 41: loss 0.23592. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 36 Iter 42: loss 0.23146. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 36 Iter 42: loss 0.23146. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 36 Iter 43: loss 0.23146. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 36 Iter 43: loss 0.23146. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 36 Iter 44: loss 0.23175. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 36 Iter 44: loss 0.23175. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 36 Iter 45: loss 0.24012. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 36 Iter 45: loss 0.24012. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.08it/s]
Epoch 36 Iter 46: loss 0.23155. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.08it/s]
Epoch 36 Iter 46: loss 0.23155. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 36 Iter 47: loss 0.23833. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 36 Iter 47: loss 0.23833. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 36 Iter 48: loss 0.22802. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 36 Iter 48: loss 0.22802. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 36 Iter 49: loss 0.22458. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 36 Iter 49: loss 0.22458. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 36 Iter 50: loss 0.23263. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 36 Iter 50: loss 0.23263. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 36 Iter 51: loss 0.22610. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 36 Iter 51: loss 0.22610. :  23%|██████████                                  | 51/224 [00:24<01:22,  2.09it/s]
Epoch 36 Iter 52: loss 0.21064. :  23%|██████████                                  | 51/224 [00:25<01:22,  2.09it/s]
Epoch 36 Iter 52: loss 0.21064. :  23%|██████████▏                                 | 52/224 [00:25<01:22,  2.10it/s]
Epoch 36 Iter 53: loss 0.23574. :  23%|██████████▏                                 | 52/224 [00:25<01:22,  2.10it/s]
Epoch 36 Iter 53: loss 0.23574. :  24%|██████████▍                                 | 53/224 [00:25<01:21,  2.10it/s]
Epoch 36 Iter 54: loss 0.23378. :  24%|██████████▍                                 | 53/224 [00:26<01:21,  2.10it/s]
Epoch 36 Iter 54: loss 0.23378. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.10it/s]
Epoch 36 Iter 55: loss 0.23949. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.10it/s]
Epoch 36 Iter 55: loss 0.23949. :  25%|██████████▊                                 | 55/224 [00:26<01:20,  2.10it/s]
Epoch 36 Iter 56: loss 0.22769. :  25%|██████████▊                                 | 55/224 [00:27<01:20,  2.10it/s]
Epoch 36 Iter 56: loss 0.22769. :  25%|███████████                                 | 56/224 [00:27<01:19,  2.11it/s]
Epoch 36 Iter 57: loss 0.25060. :  25%|███████████                                 | 56/224 [00:27<01:19,  2.11it/s]
Epoch 36 Iter 57: loss 0.25060. :  25%|███████████▏                                | 57/224 [00:27<01:19,  2.09it/s]
Epoch 36 Iter 58: loss 0.25462. :  25%|███████████▏                                | 57/224 [00:28<01:19,  2.09it/s]
Epoch 36 Iter 58: loss 0.25462. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.10it/s]
Epoch 36 Iter 59: loss 0.22373. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.10it/s]
Epoch 36 Iter 59: loss 0.22373. :  26%|███████████▌                                | 59/224 [00:28<01:18,  2.11it/s]
Epoch 36 Iter 60: loss 0.21856. :  26%|███████████▌                                | 59/224 [00:28<01:18,  2.11it/s]
Epoch 36 Iter 60: loss 0.21856. :  27%|███████████▊                                | 60/224 [00:28<01:17,  2.12it/s]
Epoch 36 Iter 61: loss 0.23066. :  27%|███████████▊                                | 60/224 [00:29<01:17,  2.12it/s]
Epoch 36 Iter 61: loss 0.23066. :  27%|███████████▉                                | 61/224 [00:29<01:16,  2.12it/s]
Epoch 36 Iter 62: loss 0.22743. :  27%|███████████▉                                | 61/224 [00:29<01:16,  2.12it/s]
Epoch 36 Iter 62: loss 0.22743. :  28%|████████████▏                               | 62/224 [00:29<01:16,  2.11it/s]
Epoch 36 Iter 63: loss 0.24306. :  28%|████████████▏                               | 62/224 [00:30<01:16,  2.11it/s]
Epoch 36 Iter 63: loss 0.24306. :  28%|████████████▍                               | 63/224 [00:30<01:16,  2.11it/s]
Epoch 36 Iter 64: loss 0.23560. :  28%|████████████▍                               | 63/224 [00:30<01:16,  2.11it/s]
Epoch 36 Iter 64: loss 0.23560. :  29%|████████████▌                               | 64/224 [00:30<01:15,  2.11it/s]
Epoch 36 Iter 65: loss 0.22522. :  29%|████████████▌                               | 64/224 [00:31<01:15,  2.11it/s]
Epoch 36 Iter 65: loss 0.22522. :  29%|████████████▊                               | 65/224 [00:31<01:15,  2.09it/s]
Epoch 36 Iter 66: loss 0.23622. :  29%|████████████▊                               | 65/224 [00:31<01:15,  2.09it/s]
Epoch 36 Iter 66: loss 0.23622. :  29%|████████████▉                               | 66/224 [00:31<01:15,  2.09it/s]
Epoch 36 Iter 67: loss 0.24857. :  29%|████████████▉                               | 66/224 [00:32<01:15,  2.09it/s]
Epoch 36 Iter 67: loss 0.24857. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.09it/s]
Epoch 36 Iter 68: loss 0.23655. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.09it/s]
Epoch 36 Iter 68: loss 0.23655. :  30%|█████████████▎                              | 68/224 [00:32<01:14,  2.09it/s]
Epoch 36 Iter 69: loss 0.25610. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.09it/s]
Epoch 36 Iter 69: loss 0.25610. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 36 Iter 70: loss 0.22275. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 36 Iter 70: loss 0.22275. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 36 Iter 71: loss 0.23721. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 36 Iter 71: loss 0.23721. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 36 Iter 72: loss 0.22318. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 36 Iter 72: loss 0.22318. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 36 Iter 73: loss 0.22318. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 36 Iter 73: loss 0.22318. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 36 Iter 74: loss 0.22990. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 36 Iter 74: loss 0.22990. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 36 Iter 75: loss 0.22693. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 36 Iter 75: loss 0.22693. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 36 Iter 76: loss 0.24722. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 36 Iter 76: loss 0.24722. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 36 Iter 77: loss 0.22900. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 36 Iter 77: loss 0.22900. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 36 Iter 78: loss 0.22847. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 36 Iter 78: loss 0.22847. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 36 Iter 79: loss 0.24007. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 36 Iter 79: loss 0.24007. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.04it/s]
Epoch 36 Iter 80: loss 0.22923. :  35%|███████████████▌                            | 79/224 [00:38<01:11,  2.04it/s]
Epoch 36 Iter 80: loss 0.22923. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.05it/s]
Epoch 36 Iter 81: loss 0.24000. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.05it/s]
Epoch 36 Iter 81: loss 0.24000. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 36 Iter 82: loss 0.22590. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 36 Iter 82: loss 0.22590. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 36 Iter 83: loss 0.25834. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 36 Iter 83: loss 0.25834. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 36 Iter 84: loss 0.25152. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 36 Iter 84: loss 0.25152. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 36 Iter 85: loss 0.24357. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 85: loss 0.24357. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.23816. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.23816. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 87: loss 0.23214. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 36 Iter 87: loss 0.23214. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 36 Iter 88: loss 0.21987. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 36 Iter 88: loss 0.21987. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 36 Iter 89: loss 0.24635. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 36 Iter 89: loss 0.24635. :  40%|█████████████████▍                          | 89/224 [00:42<01:05,  2.06it/s]
Epoch 36 Iter 90: loss 0.24415. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 36 Iter 90: loss 0.24415. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 36 Iter 91: loss 0.22770. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 36 Iter 91: loss 0.22770. :  41%|█████████████████▉                          | 91/224 [00:43<01:04,  2.06it/s]
Epoch 36 Iter 92: loss 0.23977. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 36 Iter 92: loss 0.23977. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 36 Iter 93: loss 0.24998. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 36 Iter 93: loss 0.24998. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.05it/s]
Epoch 36 Iter 94: loss 0.23982. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.05it/s]
Epoch 36 Iter 94: loss 0.23982. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 36 Iter 95: loss 0.22875. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 36 Iter 95: loss 0.22875. :  42%|██████████████████▋                         | 95/224 [00:45<01:03,  2.04it/s]
Epoch 36 Iter 96: loss 0.24790. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.04it/s]
Epoch 36 Iter 96: loss 0.24790. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 36 Iter 97: loss 0.24846. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 36 Iter 97: loss 0.24846. :  43%|███████████████████                         | 97/224 [00:46<01:02,  2.05it/s]
Epoch 36 Iter 98: loss 0.22855. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 36 Iter 98: loss 0.22855. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 99: loss 0.23246. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 99: loss 0.23246. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 36 Iter 100: loss 0.25182. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 36 Iter 100: loss 0.25182. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 36 Iter 101: loss 0.23255. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 36 Iter 101: loss 0.23255. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.05it/s]
Epoch 36 Iter 102: loss 0.24406. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 36 Iter 102: loss 0.24406. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.22025. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.22025. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 36 Iter 104: loss 0.24072. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 104: loss 0.24072. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 105: loss 0.21156. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 36 Iter 105: loss 0.21156. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 36 Iter 106: loss 0.24215. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 36 Iter 106: loss 0.24215. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 36 Iter 107: loss 0.21587. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 36 Iter 107: loss 0.21587. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 36 Iter 108: loss 0.21081. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 36 Iter 108: loss 0.21081. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 109: loss 0.23115. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 109: loss 0.23115. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 36 Iter 110: loss 0.24847. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 36 Iter 110: loss 0.24847. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 36 Iter 111: loss 0.23786. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 36 Iter 111: loss 0.23786. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 36 Iter 112: loss 0.24010. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 36 Iter 112: loss 0.24010. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 36 Iter 113: loss 0.23460. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 36 Iter 113: loss 0.23460. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 36 Iter 114: loss 0.22902. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 36 Iter 114: loss 0.22902. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 36 Iter 115: loss 0.23581. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 36 Iter 115: loss 0.23581. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 36 Iter 116: loss 0.24738. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 36 Iter 116: loss 0.24738. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 36 Iter 117: loss 0.22742. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 36 Iter 117: loss 0.22742. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 36 Iter 118: loss 0.23288. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 36 Iter 118: loss 0.23288. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 119: loss 0.21182. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 119: loss 0.21182. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 120: loss 0.23512. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 36 Iter 120: loss 0.23512. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 36 Iter 121: loss 0.23737. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 36 Iter 121: loss 0.23737. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 36 Iter 122: loss 0.21744. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 122: loss 0.21744. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 123: loss 0.24829. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 36 Iter 123: loss 0.24829. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 36 Iter 124: loss 0.24951. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 36 Iter 124: loss 0.24951. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.05it/s]
Epoch 36 Iter 125: loss 0.23423. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 36 Iter 125: loss 0.23423. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 36 Iter 126: loss 0.24068. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 36 Iter 126: loss 0.24068. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.04it/s]
Epoch 36 Iter 127: loss 0.24704. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.04it/s]
Epoch 36 Iter 127: loss 0.24704. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 36 Iter 128: loss 0.24708. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 36 Iter 128: loss 0.24708. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 36 Iter 129: loss 0.22850. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 36 Iter 129: loss 0.22850. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.23588. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.23588. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 131: loss 0.23910. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 36 Iter 131: loss 0.23910. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 36 Iter 132: loss 0.21920. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 36 Iter 132: loss 0.21920. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 36 Iter 133: loss 0.23124. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 36 Iter 133: loss 0.23124. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 36 Iter 134: loss 0.25678. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 36 Iter 134: loss 0.25678. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 36 Iter 135: loss 0.23717. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 36 Iter 135: loss 0.23717. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 36 Iter 136: loss 0.22754. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 36 Iter 136: loss 0.22754. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 36 Iter 137: loss 0.23750. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 36 Iter 137: loss 0.23750. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 36 Iter 138: loss 0.23189. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 36 Iter 138: loss 0.23189. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 36 Iter 139: loss 0.24010. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 36 Iter 139: loss 0.24010. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 36 Iter 140: loss 0.22661. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 36 Iter 140: loss 0.22661. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 36 Iter 141: loss 0.22349. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 141: loss 0.22349. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 142: loss 0.22428. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 142: loss 0.22428. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 36 Iter 143: loss 0.23807. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 36 Iter 143: loss 0.23807. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 36 Iter 144: loss 0.22690. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 36 Iter 144: loss 0.22690. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 36 Iter 145: loss 0.25447. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 36 Iter 145: loss 0.25447. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 36 Iter 146: loss 0.25045. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 36 Iter 146: loss 0.25045. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 36 Iter 147: loss 0.21712. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 36 Iter 147: loss 0.21712. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 36 Iter 148: loss 0.23382. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 36 Iter 148: loss 0.23382. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 36 Iter 149: loss 0.23318. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 36 Iter 149: loss 0.23318. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 36 Iter 150: loss 0.22008. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 36 Iter 150: loss 0.22008. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 36 Iter 151: loss 0.23394. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 36 Iter 151: loss 0.23394. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 36 Iter 152: loss 0.20584. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 36 Iter 152: loss 0.20584. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 36 Iter 153: loss 0.25774. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 36 Iter 153: loss 0.25774. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 36 Iter 154: loss 0.22756. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 36 Iter 154: loss 0.22756. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 36 Iter 155: loss 0.22553. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 36 Iter 155: loss 0.22553. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 36 Iter 156: loss 0.23906. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 36 Iter 156: loss 0.23906. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 36 Iter 157: loss 0.22584. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 36 Iter 157: loss 0.22584. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 36 Iter 158: loss 0.23769. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 36 Iter 158: loss 0.23769. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 36 Iter 159: loss 0.24702. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 36 Iter 159: loss 0.24702. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 36 Iter 160: loss 0.22636. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 36 Iter 160: loss 0.22636. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 36 Iter 161: loss 0.24102. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 36 Iter 161: loss 0.24102. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 36 Iter 162: loss 0.21938. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 36 Iter 162: loss 0.21938. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 36 Iter 163: loss 0.24105. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 36 Iter 163: loss 0.24105. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.04it/s]
Epoch 36 Iter 164: loss 0.22536. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.04it/s]
Epoch 36 Iter 164: loss 0.22536. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 36 Iter 165: loss 0.24276. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 36 Iter 165: loss 0.24276. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 36 Iter 166: loss 0.23448. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 36 Iter 166: loss 0.23448. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 36 Iter 167: loss 0.23473. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 36 Iter 167: loss 0.23473. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 36 Iter 168: loss 0.22356. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 36 Iter 168: loss 0.22356. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 36 Iter 169: loss 0.23335. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 36 Iter 169: loss 0.23335. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 36 Iter 170: loss 0.24315. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 36 Iter 170: loss 0.24315. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 36 Iter 171: loss 0.21663. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 36 Iter 171: loss 0.21663. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 36 Iter 172: loss 0.23480. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 36 Iter 172: loss 0.23480. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 36 Iter 173: loss 0.23147. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 36 Iter 173: loss 0.23147. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 36 Iter 174: loss 0.24482. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 36 Iter 174: loss 0.24482. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 36 Iter 175: loss 0.22048. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 36 Iter 175: loss 0.22048. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 36 Iter 176: loss 0.23943. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 36 Iter 176: loss 0.23943. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 36 Iter 177: loss 0.23802. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 36 Iter 177: loss 0.23802. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 36 Iter 178: loss 0.23729. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 36 Iter 178: loss 0.23729. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 36 Iter 179: loss 0.21631. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 36 Iter 179: loss 0.21631. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 36 Iter 180: loss 0.23572. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 36 Iter 180: loss 0.23572. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 36 Iter 181: loss 0.24498. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 36 Iter 181: loss 0.24498. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 36 Iter 182: loss 0.23827. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 36 Iter 182: loss 0.23827. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.09it/s]
Epoch 36 Iter 183: loss 0.24751. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.09it/s]
Epoch 36 Iter 183: loss 0.24751. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 36 Iter 184: loss 0.22522. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 36 Iter 184: loss 0.22522. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 36 Iter 185: loss 0.23940. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 36 Iter 185: loss 0.23940. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 36 Iter 186: loss 0.24479. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 36 Iter 186: loss 0.24479. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 36 Iter 187: loss 0.23827. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 36 Iter 187: loss 0.23827. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 36 Iter 188: loss 0.25402. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 36 Iter 188: loss 0.25402. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.07it/s]
Epoch 36 Iter 189: loss 0.23144. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 36 Iter 189: loss 0.23144. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 36 Iter 190: loss 0.24164. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 36 Iter 190: loss 0.24164. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 36 Iter 191: loss 0.22967. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 36 Iter 191: loss 0.22967. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 36 Iter 192: loss 0.21425. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 36 Iter 192: loss 0.21425. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 36 Iter 193: loss 0.23899. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 36 Iter 193: loss 0.23899. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 36 Iter 194: loss 0.23601. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 36 Iter 194: loss 0.23601. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 36 Iter 195: loss 0.22558. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 36 Iter 195: loss 0.22558. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 36 Iter 196: loss 0.19864. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 36 Iter 196: loss 0.19864. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.05it/s]
Epoch 36 Iter 197: loss 0.22968. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 36 Iter 197: loss 0.22968. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 36 Iter 198: loss 0.21926. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 36 Iter 198: loss 0.21926. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 36 Iter 199: loss 0.23862. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 36 Iter 199: loss 0.23862. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 36 Iter 200: loss 0.21658. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 36 Iter 200: loss 0.21658. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 36 Iter 201: loss 0.24127. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 36 Iter 201: loss 0.24127. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 36 Iter 202: loss 0.23055. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 36 Iter 202: loss 0.23055. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 36 Iter 203: loss 0.22113. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 36 Iter 203: loss 0.22113. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 36 Iter 204: loss 0.23634. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 36 Iter 204: loss 0.23634. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 36 Iter 205: loss 0.21648. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 36 Iter 205: loss 0.21648. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 36 Iter 206: loss 0.22395. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 36 Iter 206: loss 0.22395. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 36 Iter 207: loss 0.23596. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 36 Iter 207: loss 0.23596. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 36 Iter 208: loss 0.25701. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 36 Iter 208: loss 0.25701. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 36 Iter 209: loss 0.22198. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 36 Iter 209: loss 0.22198. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 36 Iter 210: loss 0.24942. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 36 Iter 210: loss 0.24942. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 36 Iter 211: loss 0.23724. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 36 Iter 211: loss 0.23724. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 36 Iter 212: loss 0.24290. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 36 Iter 212: loss 0.24290. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 36 Iter 213: loss 0.22888. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 213: loss 0.22888. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 214: loss 0.23850. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 36 Iter 214: loss 0.23850. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 36 Iter 215: loss 0.21640. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 36 Iter 215: loss 0.21640. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.03it/s]
Epoch 36 Iter 216: loss 0.22363. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.03it/s]
Epoch 36 Iter 216: loss 0.22363. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 36 Iter 217: loss 0.22514. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 36 Iter 217: loss 0.22514. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 36 Iter 218: loss 0.21277. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 36 Iter 218: loss 0.21277. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.01it/s]
Epoch 36 Iter 219: loss 0.22638. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.01it/s]
Epoch 36 Iter 219: loss 0.22638. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.02it/s]
Epoch 36 Iter 220: loss 0.22473. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.02it/s]
Epoch 36 Iter 220: loss 0.22473. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.03it/s]
Epoch 36 Iter 221: loss 0.23990. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.03it/s]
Epoch 36 Iter 221: loss 0.23990. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.04it/s]
Epoch 36 Iter 222: loss 0.21372. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.04it/s]
Epoch 36 Iter 222: loss 0.21372. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 36 Iter 223: loss 0.23871. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.04it/s]
Epoch 36 Iter 223: loss 0.23871. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 36 Iter 224: loss 0.22399. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 36 Iter 224: loss 0.22399. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 36 Iter 224: loss 0.22399. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.25045. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.25045. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 37 Iter 2: loss 0.21605. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 37 Iter 2: loss 0.21605. :   1%|▍                                             | 2/224 [00:00<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.23093. :   1%|▍                                             | 2/224 [00:01<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.23093. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 37 Iter 4: loss 0.21602. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 37 Iter 4: loss 0.21602. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 37 Iter 5: loss 0.22595. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 37 Iter 5: loss 0.22595. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.20823. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.20823. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.06it/s]
Epoch 37 Iter 7: loss 0.23926. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 7: loss 0.23926. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 8: loss 0.21800. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 8: loss 0.21800. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 37 Iter 9: loss 0.25708. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 37 Iter 9: loss 0.25708. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 37 Iter 10: loss 0.23882. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 37 Iter 10: loss 0.23882. :   4%|█▉                                          | 10/224 [00:04<01:42,  2.09it/s]
Epoch 37 Iter 11: loss 0.22531. :   4%|█▉                                          | 10/224 [00:05<01:42,  2.09it/s]
Epoch 37 Iter 11: loss 0.22531. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.08it/s]
Epoch 37 Iter 12: loss 0.24598. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.08it/s]
Epoch 37 Iter 12: loss 0.24598. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 37 Iter 13: loss 0.26118. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 37 Iter 13: loss 0.26118. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 37 Iter 14: loss 0.24434. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 37 Iter 14: loss 0.24434. :   6%|██▊                                         | 14/224 [00:06<01:40,  2.09it/s]
Epoch 37 Iter 15: loss 0.23067. :   6%|██▊                                         | 14/224 [00:07<01:40,  2.09it/s]
Epoch 37 Iter 15: loss 0.23067. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.09it/s]
Epoch 37 Iter 16: loss 0.24910. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.09it/s]
Epoch 37 Iter 16: loss 0.24910. :   7%|███▏                                        | 16/224 [00:07<01:39,  2.10it/s]
Epoch 37 Iter 17: loss 0.21921. :   7%|███▏                                        | 16/224 [00:08<01:39,  2.10it/s]
Epoch 37 Iter 17: loss 0.21921. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 37 Iter 18: loss 0.23436. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 37 Iter 18: loss 0.23436. :   8%|███▌                                        | 18/224 [00:08<01:38,  2.09it/s]
Epoch 37 Iter 19: loss 0.26821. :   8%|███▌                                        | 18/224 [00:09<01:38,  2.09it/s]
Epoch 37 Iter 19: loss 0.26821. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.09it/s]
Epoch 37 Iter 20: loss 0.21922. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.09it/s]
Epoch 37 Iter 20: loss 0.21922. :   9%|███▉                                        | 20/224 [00:09<01:37,  2.09it/s]
Epoch 37 Iter 21: loss 0.22973. :   9%|███▉                                        | 20/224 [00:10<01:37,  2.09it/s]
Epoch 37 Iter 21: loss 0.22973. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 37 Iter 22: loss 0.23001. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 37 Iter 22: loss 0.23001. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 37 Iter 23: loss 0.22999. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 37 Iter 23: loss 0.22999. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 37 Iter 24: loss 0.20680. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 37 Iter 24: loss 0.20680. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.05it/s]
Epoch 37 Iter 25: loss 0.24904. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.05it/s]
Epoch 37 Iter 25: loss 0.24904. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 37 Iter 26: loss 0.22002. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 37 Iter 26: loss 0.22002. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 37 Iter 27: loss 0.23308. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 37 Iter 27: loss 0.23308. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 37 Iter 28: loss 0.22673. :  12%|█████▎                                      | 27/224 [00:13<01:34,  2.08it/s]
Epoch 37 Iter 28: loss 0.22673. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 37 Iter 29: loss 0.22794. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 37 Iter 29: loss 0.22794. :  13%|█████▋                                      | 29/224 [00:13<01:34,  2.07it/s]
Epoch 37 Iter 30: loss 0.24248. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 37 Iter 30: loss 0.24248. :  13%|█████▉                                      | 30/224 [00:14<01:32,  2.09it/s]
Epoch 37 Iter 31: loss 0.23723. :  13%|█████▉                                      | 30/224 [00:14<01:32,  2.09it/s]
Epoch 37 Iter 31: loss 0.23723. :  14%|██████                                      | 31/224 [00:14<01:32,  2.09it/s]
Epoch 37 Iter 32: loss 0.21705. :  14%|██████                                      | 31/224 [00:15<01:32,  2.09it/s]
Epoch 37 Iter 32: loss 0.21705. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.09it/s]
Epoch 37 Iter 33: loss 0.22879. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.09it/s]
Epoch 37 Iter 33: loss 0.22879. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.09it/s]
Epoch 37 Iter 34: loss 0.20835. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.09it/s]
Epoch 37 Iter 34: loss 0.20835. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 37 Iter 35: loss 0.23577. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 37 Iter 35: loss 0.23577. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.08it/s]
Epoch 37 Iter 36: loss 0.21792. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.08it/s]
Epoch 37 Iter 36: loss 0.21792. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 37 Iter 37: loss 0.24066. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 37 Iter 37: loss 0.24066. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 37 Iter 38: loss 0.22619. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 38: loss 0.22619. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 39: loss 0.23236. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 37 Iter 39: loss 0.23236. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 37 Iter 40: loss 0.23157. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 37 Iter 40: loss 0.23157. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 37 Iter 41: loss 0.21055. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 37 Iter 41: loss 0.21055. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 37 Iter 42: loss 0.25039. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 37 Iter 42: loss 0.25039. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 37 Iter 43: loss 0.24132. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 37 Iter 43: loss 0.24132. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.08it/s]
Epoch 37 Iter 44: loss 0.22908. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.08it/s]
Epoch 37 Iter 44: loss 0.22908. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.09it/s]
Epoch 37 Iter 45: loss 0.25181. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.09it/s]
Epoch 37 Iter 45: loss 0.25181. :  20%|████████▊                                   | 45/224 [00:21<01:25,  2.09it/s]
Epoch 37 Iter 46: loss 0.24979. :  20%|████████▊                                   | 45/224 [00:22<01:25,  2.09it/s]
Epoch 37 Iter 46: loss 0.24979. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 37 Iter 47: loss 0.21051. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 37 Iter 47: loss 0.21051. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.08it/s]
Epoch 37 Iter 48: loss 0.23356. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.08it/s]
Epoch 37 Iter 48: loss 0.23356. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 37 Iter 49: loss 0.22141. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 37 Iter 49: loss 0.22141. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.08it/s]
Epoch 37 Iter 50: loss 0.23694. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.08it/s]
Epoch 37 Iter 50: loss 0.23694. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 51: loss 0.23714. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 51: loss 0.23714. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 37 Iter 52: loss 0.21748. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 52: loss 0.21748. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 53: loss 0.24592. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 53: loss 0.24592. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 37 Iter 54: loss 0.24389. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 37 Iter 54: loss 0.24389. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 37 Iter 55: loss 0.22896. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 37 Iter 55: loss 0.22896. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 37 Iter 56: loss 0.24149. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 37 Iter 56: loss 0.24149. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 37 Iter 57: loss 0.24942. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 37 Iter 57: loss 0.24942. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 37 Iter 58: loss 0.24588. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 37 Iter 58: loss 0.24588. :  26%|███████████▍                                | 58/224 [00:27<01:19,  2.09it/s]
Epoch 37 Iter 59: loss 0.22829. :  26%|███████████▍                                | 58/224 [00:28<01:19,  2.09it/s]
Epoch 37 Iter 59: loss 0.22829. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 37 Iter 60: loss 0.22089. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 37 Iter 60: loss 0.22089. :  27%|███████████▊                                | 60/224 [00:28<01:19,  2.07it/s]
Epoch 37 Iter 61: loss 0.21965. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 37 Iter 61: loss 0.21965. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 37 Iter 62: loss 0.22930. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 37 Iter 62: loss 0.22930. :  28%|████████████▏                               | 62/224 [00:29<01:17,  2.08it/s]
Epoch 37 Iter 63: loss 0.23450. :  28%|████████████▏                               | 62/224 [00:30<01:17,  2.08it/s]
Epoch 37 Iter 63: loss 0.23450. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 37 Iter 64: loss 0.23159. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.08it/s]
Epoch 37 Iter 64: loss 0.23159. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 37 Iter 65: loss 0.22758. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 37 Iter 65: loss 0.22758. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 37 Iter 66: loss 0.21861. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 37 Iter 66: loss 0.21861. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 37 Iter 67: loss 0.20707. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 37 Iter 67: loss 0.20707. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 37 Iter 68: loss 0.27835. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 37 Iter 68: loss 0.27835. :  30%|█████████████▎                              | 68/224 [00:32<01:14,  2.08it/s]
Epoch 37 Iter 69: loss 0.23950. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.08it/s]
Epoch 37 Iter 69: loss 0.23950. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.09it/s]
Epoch 37 Iter 70: loss 0.24079. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.09it/s]
Epoch 37 Iter 70: loss 0.24079. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 37 Iter 71: loss 0.22361. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 37 Iter 71: loss 0.22361. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 37 Iter 72: loss 0.21031. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 37 Iter 72: loss 0.21031. :  32%|██████████████▏                             | 72/224 [00:34<01:12,  2.08it/s]
Epoch 37 Iter 73: loss 0.21552. :  32%|██████████████▏                             | 72/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 73: loss 0.21552. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 74: loss 0.24627. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 74: loss 0.24627. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 75: loss 0.24829. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.08it/s]
Epoch 37 Iter 75: loss 0.24829. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 37 Iter 76: loss 0.24594. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 37 Iter 76: loss 0.24594. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 37 Iter 77: loss 0.23624. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 37 Iter 77: loss 0.23624. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 37 Iter 78: loss 0.23781. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 37 Iter 78: loss 0.23781. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 37 Iter 79: loss 0.23434. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 37 Iter 79: loss 0.23434. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 37 Iter 80: loss 0.23896. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 37 Iter 80: loss 0.23896. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 37 Iter 81: loss 0.24664. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 81: loss 0.24664. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 82: loss 0.23149. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 82: loss 0.23149. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 37 Iter 83: loss 0.23440. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 83: loss 0.23440. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 84: loss 0.23312. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 84: loss 0.23312. :  38%|████████████████▌                           | 84/224 [00:40<01:08,  2.05it/s]
Epoch 37 Iter 85: loss 0.24199. :  38%|████████████████▌                           | 84/224 [00:41<01:08,  2.05it/s]
Epoch 37 Iter 85: loss 0.24199. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.04it/s]
Epoch 37 Iter 86: loss 0.22505. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.04it/s]
Epoch 37 Iter 86: loss 0.22505. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 37 Iter 87: loss 0.26563. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 37 Iter 87: loss 0.26563. :  39%|█████████████████                           | 87/224 [00:41<01:06,  2.06it/s]
Epoch 37 Iter 88: loss 0.24610. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 37 Iter 88: loss 0.24610. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 37 Iter 89: loss 0.24763. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 37 Iter 89: loss 0.24763. :  40%|█████████████████▍                          | 89/224 [00:42<01:04,  2.08it/s]
Epoch 37 Iter 90: loss 0.22166. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 37 Iter 90: loss 0.22166. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.06it/s]
Epoch 37 Iter 91: loss 0.22754. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.06it/s]
Epoch 37 Iter 91: loss 0.22754. :  41%|█████████████████▉                          | 91/224 [00:43<01:04,  2.06it/s]
Epoch 37 Iter 92: loss 0.22917. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 37 Iter 92: loss 0.22917. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.23248. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.23248. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.06it/s]
Epoch 37 Iter 94: loss 0.23914. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 37 Iter 94: loss 0.23914. :  42%|██████████████████▍                         | 94/224 [00:45<01:04,  2.03it/s]
Epoch 37 Iter 95: loss 0.21290. :  42%|██████████████████▍                         | 94/224 [00:45<01:04,  2.03it/s]
Epoch 37 Iter 95: loss 0.21290. :  42%|██████████████████▋                         | 95/224 [00:45<01:03,  2.04it/s]
Epoch 37 Iter 96: loss 0.25422. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.04it/s]
Epoch 37 Iter 96: loss 0.25422. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 37 Iter 97: loss 0.22251. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 37 Iter 97: loss 0.22251. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 37 Iter 98: loss 0.21706. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 37 Iter 98: loss 0.21706. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 37 Iter 99: loss 0.22131. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 37 Iter 99: loss 0.22131. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 37 Iter 100: loss 0.23047. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 37 Iter 100: loss 0.23047. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 37 Iter 101: loss 0.22052. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 37 Iter 101: loss 0.22052. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 37 Iter 102: loss 0.24119. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 102: loss 0.24119. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 103: loss 0.22837. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 103: loss 0.22837. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 37 Iter 104: loss 0.23884. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 37 Iter 104: loss 0.23884. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 37 Iter 105: loss 0.23943. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 37 Iter 105: loss 0.23943. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 37 Iter 106: loss 0.23679. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 37 Iter 106: loss 0.23679. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 37 Iter 107: loss 0.22949. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 37 Iter 107: loss 0.22949. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 37 Iter 108: loss 0.21407. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 37 Iter 108: loss 0.21407. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 37 Iter 109: loss 0.23303. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 37 Iter 109: loss 0.23303. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.09it/s]
Epoch 37 Iter 110: loss 0.22662. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.09it/s]
Epoch 37 Iter 110: loss 0.22662. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.10it/s]
Epoch 37 Iter 111: loss 0.22151. :  49%|████████████████████▋                     | 110/224 [00:53<00:54,  2.10it/s]
Epoch 37 Iter 111: loss 0.22151. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 37 Iter 112: loss 0.25693. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 37 Iter 112: loss 0.25693. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.22505. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.22505. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.22762. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.22762. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.09it/s]
Epoch 37 Iter 115: loss 0.25053. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.09it/s]
Epoch 37 Iter 115: loss 0.25053. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.08it/s]
Epoch 37 Iter 116: loss 0.21970. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.08it/s]
Epoch 37 Iter 116: loss 0.21970. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 37 Iter 117: loss 0.23738. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 37 Iter 117: loss 0.23738. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 37 Iter 118: loss 0.22367. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 37 Iter 118: loss 0.22367. :  53%|██████████████████████▏                   | 118/224 [00:56<00:50,  2.10it/s]
Epoch 37 Iter 119: loss 0.22579. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.10it/s]
Epoch 37 Iter 119: loss 0.22579. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.08it/s]
Epoch 37 Iter 120: loss 0.23602. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.08it/s]
Epoch 37 Iter 120: loss 0.23602. :  54%|██████████████████████▌                   | 120/224 [00:57<00:50,  2.06it/s]
Epoch 37 Iter 121: loss 0.25583. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 37 Iter 121: loss 0.25583. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 37 Iter 122: loss 0.23674. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 37 Iter 122: loss 0.23674. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 37 Iter 123: loss 0.21287. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 37 Iter 123: loss 0.21287. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 124: loss 0.23876. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 124: loss 0.23876. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.05it/s]
Epoch 37 Iter 125: loss 0.23020. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.05it/s]
Epoch 37 Iter 125: loss 0.23020. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 37 Iter 126: loss 0.24306. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 37 Iter 126: loss 0.24306. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.06it/s]
Epoch 37 Iter 127: loss 0.24859. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 37 Iter 127: loss 0.24859. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 37 Iter 128: loss 0.23787. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 37 Iter 128: loss 0.23787. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.05it/s]
Epoch 37 Iter 129: loss 0.23272. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 37 Iter 129: loss 0.23272. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 37 Iter 130: loss 0.22215. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 37 Iter 130: loss 0.22215. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.06it/s]
Epoch 37 Iter 131: loss 0.24074. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 131: loss 0.24074. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 132: loss 0.22666. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 37 Iter 132: loss 0.22666. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 37 Iter 133: loss 0.22537. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 37 Iter 133: loss 0.22537. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 37 Iter 134: loss 0.26123. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 37 Iter 134: loss 0.26123. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 37 Iter 135: loss 0.24482. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 37 Iter 135: loss 0.24482. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 37 Iter 136: loss 0.23967. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 37 Iter 136: loss 0.23967. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 37 Iter 137: loss 0.24973. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 137: loss 0.24973. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 138: loss 0.21809. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 138: loss 0.21809. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 37 Iter 139: loss 0.23790. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 37 Iter 139: loss 0.23790. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 37 Iter 140: loss 0.24571. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.09it/s]
Epoch 37 Iter 140: loss 0.24571. :  62%|██████████████████████████▎               | 140/224 [01:07<00:39,  2.11it/s]
Epoch 37 Iter 141: loss 0.22311. :  62%|██████████████████████████▎               | 140/224 [01:08<00:39,  2.11it/s]
Epoch 37 Iter 141: loss 0.22311. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.11it/s]
Epoch 37 Iter 142: loss 0.23248. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.11it/s]
Epoch 37 Iter 142: loss 0.23248. :  63%|██████████████████████████▋               | 142/224 [01:08<00:38,  2.10it/s]
Epoch 37 Iter 143: loss 0.21679. :  63%|██████████████████████████▋               | 142/224 [01:09<00:38,  2.10it/s]
Epoch 37 Iter 143: loss 0.21679. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.12it/s]
Epoch 37 Iter 144: loss 0.24448. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.12it/s]
Epoch 37 Iter 144: loss 0.24448. :  64%|███████████████████████████               | 144/224 [01:09<00:37,  2.12it/s]
Epoch 37 Iter 145: loss 0.22910. :  64%|███████████████████████████               | 144/224 [01:09<00:37,  2.12it/s]
Epoch 37 Iter 145: loss 0.22910. :  65%|███████████████████████████▏              | 145/224 [01:09<00:37,  2.11it/s]
Epoch 37 Iter 146: loss 0.20426. :  65%|███████████████████████████▏              | 145/224 [01:10<00:37,  2.11it/s]
Epoch 37 Iter 146: loss 0.20426. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.09it/s]
Epoch 37 Iter 147: loss 0.23146. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.09it/s]
Epoch 37 Iter 147: loss 0.23146. :  66%|███████████████████████████▌              | 147/224 [01:10<00:37,  2.08it/s]
Epoch 37 Iter 148: loss 0.23544. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 37 Iter 148: loss 0.23544. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 37 Iter 149: loss 0.23740. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 37 Iter 149: loss 0.23740. :  67%|███████████████████████████▉              | 149/224 [01:11<00:36,  2.08it/s]
Epoch 37 Iter 150: loss 0.21033. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 37 Iter 150: loss 0.21033. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.02it/s]
Epoch 37 Iter 151: loss 0.24766. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.02it/s]
Epoch 37 Iter 151: loss 0.24766. :  67%|████████████████████████████▎             | 151/224 [01:12<00:35,  2.04it/s]
Epoch 37 Iter 152: loss 0.22664. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.04it/s]
Epoch 37 Iter 152: loss 0.22664. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.04it/s]
Epoch 37 Iter 153: loss 0.22280. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.04it/s]
Epoch 37 Iter 153: loss 0.22280. :  68%|████████████████████████████▋             | 153/224 [01:13<00:34,  2.05it/s]
Epoch 37 Iter 154: loss 0.24415. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 37 Iter 154: loss 0.24415. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 37 Iter 155: loss 0.24153. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 37 Iter 155: loss 0.24153. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 37 Iter 156: loss 0.24158. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 37 Iter 156: loss 0.24158. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.06it/s]
Epoch 37 Iter 157: loss 0.22330. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.06it/s]
Epoch 37 Iter 157: loss 0.22330. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.06it/s]
Epoch 37 Iter 158: loss 0.21444. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 37 Iter 158: loss 0.21444. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 37 Iter 159: loss 0.21477. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 37 Iter 159: loss 0.21477. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 37 Iter 160: loss 0.24664. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 37 Iter 160: loss 0.24664. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 37 Iter 161: loss 0.22968. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 37 Iter 161: loss 0.22968. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 37 Iter 162: loss 0.23757. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 37 Iter 162: loss 0.23757. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 37 Iter 163: loss 0.21678. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 37 Iter 163: loss 0.21678. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 37 Iter 164: loss 0.24445. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 164: loss 0.24445. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 37 Iter 165: loss 0.25184. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 37 Iter 165: loss 0.25184. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.04it/s]
Epoch 37 Iter 166: loss 0.23802. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.04it/s]
Epoch 37 Iter 166: loss 0.23802. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 37 Iter 167: loss 0.21193. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 37 Iter 167: loss 0.21193. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.04it/s]
Epoch 37 Iter 168: loss 0.20912. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.04it/s]
Epoch 37 Iter 168: loss 0.20912. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 37 Iter 169: loss 0.21170. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 37 Iter 169: loss 0.21170. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 37 Iter 170: loss 0.22526. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 37 Iter 170: loss 0.22526. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 37 Iter 171: loss 0.24559. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 37 Iter 171: loss 0.24559. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 37 Iter 172: loss 0.25808. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 37 Iter 172: loss 0.25808. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 37 Iter 173: loss 0.22989. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 37 Iter 173: loss 0.22989. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 37 Iter 174: loss 0.21923. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 37 Iter 174: loss 0.21923. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 37 Iter 175: loss 0.24759. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 37 Iter 175: loss 0.24759. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.09it/s]
Epoch 37 Iter 176: loss 0.23627. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.09it/s]
Epoch 37 Iter 176: loss 0.23627. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 37 Iter 177: loss 0.26449. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 37 Iter 177: loss 0.26449. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 37 Iter 178: loss 0.21129. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 37 Iter 178: loss 0.21129. :  79%|█████████████████████████████████▍        | 178/224 [01:25<00:22,  2.07it/s]
Epoch 37 Iter 179: loss 0.24026. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 37 Iter 179: loss 0.24026. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 37 Iter 180: loss 0.25751. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 37 Iter 180: loss 0.25751. :  80%|█████████████████████████████████▊        | 180/224 [01:26<00:21,  2.07it/s]
Epoch 37 Iter 181: loss 0.23061. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 37 Iter 181: loss 0.23061. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 37 Iter 182: loss 0.23630. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 37 Iter 182: loss 0.23630. :  81%|██████████████████████████████████▏       | 182/224 [01:27<00:20,  2.08it/s]
Epoch 37 Iter 183: loss 0.22321. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 37 Iter 183: loss 0.22321. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 37 Iter 184: loss 0.23425. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 37 Iter 184: loss 0.23425. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.07it/s]
Epoch 37 Iter 185: loss 0.22355. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 37 Iter 185: loss 0.22355. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 37 Iter 186: loss 0.21215. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 37 Iter 186: loss 0.21215. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.05it/s]
Epoch 37 Iter 187: loss 0.24803. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 37 Iter 187: loss 0.24803. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 37 Iter 188: loss 0.22981. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 37 Iter 188: loss 0.22981. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.04it/s]
Epoch 37 Iter 189: loss 0.23628. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.04it/s]
Epoch 37 Iter 189: loss 0.23628. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 37 Iter 190: loss 0.23038. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 37 Iter 190: loss 0.23038. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 37 Iter 191: loss 0.22246. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 37 Iter 191: loss 0.22246. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 37 Iter 192: loss 0.24945. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 37 Iter 192: loss 0.24945. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 37 Iter 193: loss 0.23686. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 37 Iter 193: loss 0.23686. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 37 Iter 194: loss 0.24547. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 37 Iter 194: loss 0.24547. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 37 Iter 195: loss 0.22163. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 37 Iter 195: loss 0.22163. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 37 Iter 196: loss 0.23880. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 37 Iter 196: loss 0.23880. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 37 Iter 197: loss 0.23296. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 37 Iter 197: loss 0.23296. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 37 Iter 198: loss 0.23068. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 37 Iter 198: loss 0.23068. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 37 Iter 199: loss 0.23099. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 37 Iter 199: loss 0.23099. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 37 Iter 200: loss 0.23967. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 37 Iter 200: loss 0.23967. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 37 Iter 201: loss 0.24231. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 37 Iter 201: loss 0.24231. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 37 Iter 202: loss 0.22929. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 37 Iter 202: loss 0.22929. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 37 Iter 203: loss 0.25503. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 37 Iter 203: loss 0.25503. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 37 Iter 204: loss 0.22999. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 37 Iter 204: loss 0.22999. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 37 Iter 205: loss 0.22679. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 205: loss 0.22679. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 37 Iter 206: loss 0.23642. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 37 Iter 206: loss 0.23642. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 37 Iter 207: loss 0.22643. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 37 Iter 207: loss 0.22643. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 37 Iter 208: loss 0.25073. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 37 Iter 208: loss 0.25073. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 37 Iter 209: loss 0.21247. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 209: loss 0.21247. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 210: loss 0.25121. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 210: loss 0.25121. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.22227. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.22227. :  94%|███████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.06it/s]
Epoch 37 Iter 212: loss 0.22206. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 37 Iter 212: loss 0.22206. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 37 Iter 213: loss 0.22007. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 37 Iter 213: loss 0.22007. :  95%|███████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.23461. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.23461. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 37 Iter 215: loss 0.23860. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 37 Iter 215: loss 0.23860. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.24800. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.24800. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 37 Iter 217: loss 0.23971. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 37 Iter 217: loss 0.23971. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.06it/s]
Epoch 37 Iter 218: loss 0.22863. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 37 Iter 218: loss 0.22863. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 37 Iter 219: loss 0.24635. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 37 Iter 219: loss 0.24635. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.06it/s]
Epoch 37 Iter 220: loss 0.22558. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 37 Iter 220: loss 0.22558. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 37 Iter 221: loss 0.24807. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 37 Iter 221: loss 0.24807. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 37 Iter 222: loss 0.24082. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 37 Iter 222: loss 0.24082. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 37 Iter 223: loss 0.22113. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 37 Iter 223: loss 0.22113. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.23180. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.23180. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.23180. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23325
    Valid loss: 0.23491
       Valid loss recons: 0.22378
       Valid loss KL-D:   1.11375
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.24740. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.24740. :   0%|▏                                             | 1/224 [00:00<01:50,  2.02it/s]
Epoch 38 Iter 2: loss 0.25212. :   0%|▏                                             | 1/224 [00:00<01:50,  2.02it/s]
Epoch 38 Iter 2: loss 0.25212. :   1%|▍                                             | 2/224 [00:00<01:49,  2.03it/s]
Epoch 38 Iter 3: loss 0.24361. :   1%|▍                                             | 2/224 [00:01<01:49,  2.03it/s]
Epoch 38 Iter 3: loss 0.24361. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 38 Iter 4: loss 0.22796. :   1%|▌                                             | 3/224 [00:01<01:47,  2.05it/s]
Epoch 38 Iter 4: loss 0.22796. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 38 Iter 5: loss 0.24866. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 38 Iter 5: loss 0.24866. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 38 Iter 6: loss 0.23386. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 38 Iter 6: loss 0.23386. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 38 Iter 7: loss 0.23648. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 38 Iter 7: loss 0.23648. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 38 Iter 8: loss 0.23713. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 38 Iter 8: loss 0.23713. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 38 Iter 9: loss 0.23586. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 38 Iter 9: loss 0.23586. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 38 Iter 10: loss 0.25499. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 38 Iter 10: loss 0.25499. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 38 Iter 11: loss 0.21637. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 38 Iter 11: loss 0.21637. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 38 Iter 12: loss 0.24788. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 38 Iter 12: loss 0.24788. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.06it/s]
Epoch 38 Iter 13: loss 0.25434. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.06it/s]
Epoch 38 Iter 13: loss 0.25434. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 38 Iter 14: loss 0.23080. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.08it/s]
Epoch 38 Iter 14: loss 0.23080. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 38 Iter 15: loss 0.22426. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 38 Iter 15: loss 0.22426. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 38 Iter 16: loss 0.24357. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 38 Iter 16: loss 0.24357. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.06it/s]
Epoch 38 Iter 17: loss 0.22915. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.06it/s]
Epoch 38 Iter 17: loss 0.22915. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 38 Iter 18: loss 0.24190. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 38 Iter 18: loss 0.24190. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.04it/s]
Epoch 38 Iter 19: loss 0.23846. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.04it/s]
Epoch 38 Iter 19: loss 0.23846. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 20: loss 0.23090. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 20: loss 0.23090. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 21: loss 0.23254. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 38 Iter 21: loss 0.23254. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 22: loss 0.22075. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 22: loss 0.22075. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 23: loss 0.23574. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 38 Iter 23: loss 0.23574. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 38 Iter 24: loss 0.22808. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.07it/s]
Epoch 38 Iter 24: loss 0.22808. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 38 Iter 25: loss 0.23506. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 38 Iter 25: loss 0.23506. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 26: loss 0.24080. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 26: loss 0.24080. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 38 Iter 27: loss 0.22419. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 38 Iter 27: loss 0.22419. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 28: loss 0.26104. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 28: loss 0.26104. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.06it/s]
Epoch 38 Iter 29: loss 0.22277. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.06it/s]
Epoch 38 Iter 29: loss 0.22277. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.23278. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.23278. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 38 Iter 31: loss 0.24843. :  13%|█████▉                                      | 30/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 31: loss 0.24843. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.21684. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.21684. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 38 Iter 33: loss 0.24407. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 38 Iter 33: loss 0.24407. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.08it/s]
Epoch 38 Iter 34: loss 0.24591. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.08it/s]
Epoch 38 Iter 34: loss 0.24591. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.23491. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.23491. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 38 Iter 36: loss 0.21915. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 38 Iter 36: loss 0.21915. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 38 Iter 37: loss 0.20760. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 38 Iter 37: loss 0.20760. :  17%|███████▎                                    | 37/224 [00:17<01:31,  2.05it/s]
Epoch 38 Iter 38: loss 0.23917. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.05it/s]
Epoch 38 Iter 38: loss 0.23917. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 38 Iter 39: loss 0.22871. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 38 Iter 39: loss 0.22871. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 38 Iter 40: loss 0.23566. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 38 Iter 40: loss 0.23566. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 38 Iter 41: loss 0.21350. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 38 Iter 41: loss 0.21350. :  18%|████████                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.22033. :  18%|████████                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.22033. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.22230. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.22230. :  19%|████████▍                                   | 43/224 [00:20<01:29,  2.03it/s]
Epoch 38 Iter 44: loss 0.22733. :  19%|████████▍                                   | 43/224 [00:21<01:29,  2.03it/s]
Epoch 38 Iter 44: loss 0.22733. :  20%|████████▋                                   | 44/224 [00:21<01:28,  2.04it/s]
Epoch 38 Iter 45: loss 0.21788. :  20%|████████▋                                   | 44/224 [00:21<01:28,  2.04it/s]
Epoch 38 Iter 45: loss 0.21788. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 38 Iter 46: loss 0.23651. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 38 Iter 46: loss 0.23651. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 38 Iter 47: loss 0.25133. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 38 Iter 47: loss 0.25133. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 38 Iter 48: loss 0.24135. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 38 Iter 48: loss 0.24135. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 38 Iter 49: loss 0.22864. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 38 Iter 49: loss 0.22864. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 38 Iter 50: loss 0.25003. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 38 Iter 50: loss 0.25003. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 38 Iter 51: loss 0.22282. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 38 Iter 51: loss 0.22282. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 38 Iter 52: loss 0.23121. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 52: loss 0.23121. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 53: loss 0.22283. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 38 Iter 53: loss 0.22283. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.23149. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.23149. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 38 Iter 55: loss 0.22167. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 38 Iter 55: loss 0.22167. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.22573. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.22573. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 38 Iter 57: loss 0.23191. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 38 Iter 57: loss 0.23191. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.06it/s]
Epoch 38 Iter 58: loss 0.21425. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.06it/s]
Epoch 38 Iter 58: loss 0.21425. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 38 Iter 59: loss 0.24525. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 38 Iter 59: loss 0.24525. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 38 Iter 60: loss 0.21067. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 38 Iter 60: loss 0.21067. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 38 Iter 61: loss 0.23955. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 38 Iter 61: loss 0.23955. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 38 Iter 62: loss 0.24275. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 38 Iter 62: loss 0.24275. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 38 Iter 63: loss 0.24267. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 38 Iter 63: loss 0.24267. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 38 Iter 64: loss 0.23563. :  28%|████████████▍                               | 63/224 [00:31<01:17,  2.07it/s]
Epoch 38 Iter 64: loss 0.23563. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 38 Iter 65: loss 0.23745. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 38 Iter 65: loss 0.23745. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.08it/s]
Epoch 38 Iter 66: loss 0.24279. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.08it/s]
Epoch 38 Iter 66: loss 0.24279. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 38 Iter 67: loss 0.21444. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 38 Iter 67: loss 0.21444. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 68: loss 0.22790. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 68: loss 0.22790. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 69: loss 0.24412. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 38 Iter 69: loss 0.24412. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.23300. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.23300. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 38 Iter 71: loss 0.24000. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 38 Iter 71: loss 0.24000. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 38 Iter 72: loss 0.24062. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 38 Iter 72: loss 0.24062. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.05it/s]
Epoch 38 Iter 73: loss 0.24536. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.05it/s]
Epoch 38 Iter 73: loss 0.24536. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 38 Iter 74: loss 0.24608. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 38 Iter 74: loss 0.24608. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 38 Iter 75: loss 0.23076. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 38 Iter 75: loss 0.23076. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 38 Iter 76: loss 0.23192. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 38 Iter 76: loss 0.23192. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 38 Iter 77: loss 0.23393. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 38 Iter 77: loss 0.23393. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 38 Iter 78: loss 0.23899. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 38 Iter 78: loss 0.23899. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 38 Iter 79: loss 0.24410. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 38 Iter 79: loss 0.24410. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 38 Iter 80: loss 0.23987. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 38 Iter 80: loss 0.23987. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 38 Iter 81: loss 0.22749. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 38 Iter 81: loss 0.22749. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 38 Iter 82: loss 0.21028. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 38 Iter 82: loss 0.21028. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 38 Iter 83: loss 0.23831. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 38 Iter 83: loss 0.23831. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 38 Iter 84: loss 0.22936. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 38 Iter 84: loss 0.22936. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 38 Iter 85: loss 0.23930. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 38 Iter 85: loss 0.23930. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.09it/s]
Epoch 38 Iter 86: loss 0.23944. :  38%|████████████████▋                           | 85/224 [00:41<01:06,  2.09it/s]
Epoch 38 Iter 86: loss 0.23944. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 38 Iter 87: loss 0.21389. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 38 Iter 87: loss 0.21389. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 38 Iter 88: loss 0.22667. :  39%|█████████████████                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 38 Iter 88: loss 0.22667. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 38 Iter 89: loss 0.22651. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 38 Iter 89: loss 0.22651. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 38 Iter 90: loss 0.22300. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 38 Iter 90: loss 0.22300. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.09it/s]
Epoch 38 Iter 91: loss 0.22407. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.09it/s]
Epoch 38 Iter 91: loss 0.22407. :  41%|█████████████████▉                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 38 Iter 92: loss 0.23277. :  41%|█████████████████▉                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 38 Iter 92: loss 0.23277. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 38 Iter 93: loss 0.22092. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 38 Iter 93: loss 0.22092. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 38 Iter 94: loss 0.24163. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 38 Iter 94: loss 0.24163. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 38 Iter 95: loss 0.23411. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.06it/s]
Epoch 38 Iter 95: loss 0.23411. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 38 Iter 96: loss 0.24349. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 38 Iter 96: loss 0.24349. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 38 Iter 97: loss 0.23299. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 38 Iter 97: loss 0.23299. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 38 Iter 98: loss 0.24251. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.05it/s]
Epoch 38 Iter 98: loss 0.24251. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.07it/s]
Epoch 38 Iter 99: loss 0.27747. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.07it/s]
Epoch 38 Iter 99: loss 0.27747. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 38 Iter 100: loss 0.23734. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 38 Iter 100: loss 0.23734. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 38 Iter 101: loss 0.23215. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 38 Iter 101: loss 0.23215. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 38 Iter 102: loss 0.22113. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 38 Iter 102: loss 0.22113. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.08it/s]
Epoch 38 Iter 103: loss 0.22782. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.08it/s]
Epoch 38 Iter 103: loss 0.22782. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 38 Iter 104: loss 0.22777. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 38 Iter 104: loss 0.22777. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 38 Iter 105: loss 0.23159. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 38 Iter 105: loss 0.23159. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 38 Iter 106: loss 0.22597. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 38 Iter 106: loss 0.22597. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 38 Iter 107: loss 0.24524. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 38 Iter 107: loss 0.24524. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 38 Iter 108: loss 0.22994. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 108: loss 0.22994. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 109: loss 0.25292. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 38 Iter 109: loss 0.25292. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 38 Iter 110: loss 0.22858. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 38 Iter 110: loss 0.22858. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.04it/s]
Epoch 38 Iter 111: loss 0.23967. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.04it/s]
Epoch 38 Iter 111: loss 0.23967. :  50%|████████████████████▊                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 38 Iter 112: loss 0.21565. :  50%|████████████████████▊                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 38 Iter 112: loss 0.21565. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 38 Iter 113: loss 0.21511. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 38 Iter 113: loss 0.21511. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.24724. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.24724. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 115: loss 0.23808. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 115: loss 0.23808. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 116: loss 0.21873. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.05it/s]
Epoch 38 Iter 116: loss 0.21873. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.24823. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.24823. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.21858. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.21858. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 119: loss 0.25228. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 119: loss 0.25228. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.05it/s]
Epoch 38 Iter 120: loss 0.25444. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.05it/s]
Epoch 38 Iter 120: loss 0.25444. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 38 Iter 121: loss 0.21319. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 38 Iter 121: loss 0.21319. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 38 Iter 122: loss 0.23172. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 38 Iter 122: loss 0.23172. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 38 Iter 123: loss 0.20906. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 38 Iter 123: loss 0.20906. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 38 Iter 124: loss 0.21304. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.08it/s]
Epoch 38 Iter 124: loss 0.21304. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.11it/s]
Epoch 38 Iter 125: loss 0.23747. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.11it/s]
Epoch 38 Iter 125: loss 0.23747. :  56%|███████████████████████▍                  | 125/224 [01:00<00:46,  2.11it/s]
Epoch 38 Iter 126: loss 0.25481. :  56%|███████████████████████▍                  | 125/224 [01:00<00:46,  2.11it/s]
Epoch 38 Iter 126: loss 0.25481. :  56%|███████████████████████▋                  | 126/224 [01:00<00:46,  2.11it/s]
Epoch 38 Iter 127: loss 0.24966. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.11it/s]
Epoch 38 Iter 127: loss 0.24966. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.09it/s]
Epoch 38 Iter 128: loss 0.22804. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.09it/s]
Epoch 38 Iter 128: loss 0.22804. :  57%|████████████████████████                  | 128/224 [01:01<00:45,  2.12it/s]
Epoch 38 Iter 129: loss 0.24631. :  57%|████████████████████████                  | 128/224 [01:02<00:45,  2.12it/s]
Epoch 38 Iter 129: loss 0.24631. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.10it/s]
Epoch 38 Iter 130: loss 0.23742. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.10it/s]
Epoch 38 Iter 130: loss 0.23742. :  58%|████████████████████████▍                 | 130/224 [01:02<00:44,  2.10it/s]
Epoch 38 Iter 131: loss 0.22450. :  58%|████████████████████████▍                 | 130/224 [01:03<00:44,  2.10it/s]
Epoch 38 Iter 131: loss 0.22450. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 38 Iter 132: loss 0.22534. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 38 Iter 132: loss 0.22534. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 38 Iter 133: loss 0.20820. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 38 Iter 133: loss 0.20820. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 38 Iter 134: loss 0.23683. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 38 Iter 134: loss 0.23683. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 38 Iter 135: loss 0.23688. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 38 Iter 135: loss 0.23688. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.21903. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.21903. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.23568. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.23568. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 38 Iter 138: loss 0.22274. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 38 Iter 138: loss 0.22274. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 38 Iter 139: loss 0.22807. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 38 Iter 139: loss 0.22807. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 38 Iter 140: loss 0.24492. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 38 Iter 140: loss 0.24492. :  62%|██████████████████████████▎               | 140/224 [01:07<00:41,  2.04it/s]
Epoch 38 Iter 141: loss 0.24556. :  62%|██████████████████████████▎               | 140/224 [01:08<00:41,  2.04it/s]
Epoch 38 Iter 141: loss 0.24556. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.05it/s]
Epoch 38 Iter 142: loss 0.23323. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.05it/s]
Epoch 38 Iter 142: loss 0.23323. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 38 Iter 143: loss 0.22766. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 38 Iter 143: loss 0.22766. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 38 Iter 144: loss 0.23078. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 38 Iter 144: loss 0.23078. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 38 Iter 145: loss 0.21069. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 38 Iter 145: loss 0.21069. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 38 Iter 146: loss 0.23932. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 38 Iter 146: loss 0.23932. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.22413. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.22413. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 38 Iter 148: loss 0.23885. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 38 Iter 148: loss 0.23885. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 38 Iter 149: loss 0.23199. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 38 Iter 149: loss 0.23199. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 38 Iter 150: loss 0.21725. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 38 Iter 150: loss 0.21725. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 38 Iter 151: loss 0.23235. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 38 Iter 151: loss 0.23235. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.08it/s]
Epoch 38 Iter 152: loss 0.21047. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.08it/s]
Epoch 38 Iter 152: loss 0.21047. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 38 Iter 153: loss 0.23139. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 38 Iter 153: loss 0.23139. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 38 Iter 154: loss 0.21698. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 38 Iter 154: loss 0.21698. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 38 Iter 155: loss 0.24317. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 38 Iter 155: loss 0.24317. :  69%|█████████████████████████████             | 155/224 [01:14<00:32,  2.09it/s]
Epoch 38 Iter 156: loss 0.22587. :  69%|█████████████████████████████             | 155/224 [01:15<00:32,  2.09it/s]
Epoch 38 Iter 156: loss 0.22587. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 157: loss 0.23081. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 157: loss 0.23081. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 158: loss 0.23844. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 38 Iter 158: loss 0.23844. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 159: loss 0.23080. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 159: loss 0.23080. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.22323. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.22323. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 38 Iter 161: loss 0.23347. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 38 Iter 161: loss 0.23347. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 38 Iter 162: loss 0.23414. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 38 Iter 162: loss 0.23414. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 38 Iter 163: loss 0.21592. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 38 Iter 163: loss 0.21592. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 38 Iter 164: loss 0.25308. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 38 Iter 164: loss 0.25308. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 38 Iter 165: loss 0.24136. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 38 Iter 165: loss 0.24136. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.08it/s]
Epoch 38 Iter 166: loss 0.20868. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 38 Iter 166: loss 0.20868. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 38 Iter 167: loss 0.23073. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 38 Iter 167: loss 0.23073. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 38 Iter 168: loss 0.23198. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 38 Iter 168: loss 0.23198. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 38 Iter 169: loss 0.22665. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 38 Iter 169: loss 0.22665. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 38 Iter 170: loss 0.22852. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 170: loss 0.22852. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.22235. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.22235. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 38 Iter 172: loss 0.22966. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 38 Iter 172: loss 0.22966. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 173: loss 0.23362. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 173: loss 0.23362. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 38 Iter 174: loss 0.24988. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 174: loss 0.24988. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 175: loss 0.25214. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 175: loss 0.25214. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 38 Iter 176: loss 0.24817. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 38 Iter 176: loss 0.24817. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 38 Iter 177: loss 0.21169. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 38 Iter 177: loss 0.21169. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 38 Iter 178: loss 0.22200. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 38 Iter 178: loss 0.22200. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 38 Iter 179: loss 0.24625. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.04it/s]
Epoch 38 Iter 179: loss 0.24625. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 38 Iter 180: loss 0.22970. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 38 Iter 180: loss 0.22970. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 38 Iter 181: loss 0.24576. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 38 Iter 181: loss 0.24576. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 38 Iter 182: loss 0.22892. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 38 Iter 182: loss 0.22892. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 38 Iter 183: loss 0.26486. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 38 Iter 183: loss 0.26486. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:20,  2.04it/s]
Epoch 38 Iter 184: loss 0.22156. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:20,  2.04it/s]
Epoch 38 Iter 184: loss 0.22156. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 38 Iter 185: loss 0.23501. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.04it/s]
Epoch 38 Iter 185: loss 0.23501. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 38 Iter 186: loss 0.24016. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 38 Iter 186: loss 0.24016. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.06it/s]
Epoch 38 Iter 187: loss 0.21278. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 38 Iter 187: loss 0.21278. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 38 Iter 188: loss 0.23564. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 38 Iter 188: loss 0.23564. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 38 Iter 189: loss 0.23203. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 38 Iter 189: loss 0.23203. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 38 Iter 190: loss 0.21530. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 38 Iter 190: loss 0.21530. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.08it/s]
Epoch 38 Iter 191: loss 0.23612. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 38 Iter 191: loss 0.23612. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 38 Iter 192: loss 0.20448. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 38 Iter 192: loss 0.20448. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 38 Iter 193: loss 0.21858. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 38 Iter 193: loss 0.21858. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 38 Iter 194: loss 0.24293. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 38 Iter 194: loss 0.24293. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 38 Iter 195: loss 0.25578. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 38 Iter 195: loss 0.25578. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 38 Iter 196: loss 0.23414. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 38 Iter 196: loss 0.23414. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 38 Iter 197: loss 0.22274. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 38 Iter 197: loss 0.22274. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 38 Iter 198: loss 0.22580. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 38 Iter 198: loss 0.22580. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.09it/s]
Epoch 38 Iter 199: loss 0.23544. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.09it/s]
Epoch 38 Iter 199: loss 0.23544. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 38 Iter 200: loss 0.22877. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 38 Iter 200: loss 0.22877. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 38 Iter 201: loss 0.24948. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 38 Iter 201: loss 0.24948. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 38 Iter 202: loss 0.23697. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 38 Iter 202: loss 0.23697. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 38 Iter 203: loss 0.23635. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 38 Iter 203: loss 0.23635. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 38 Iter 204: loss 0.25738. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 38 Iter 204: loss 0.25738. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 38 Iter 205: loss 0.21184. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 38 Iter 205: loss 0.21184. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 38 Iter 206: loss 0.24639. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 38 Iter 206: loss 0.24639. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.23586. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.23586. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 38 Iter 208: loss 0.21450. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 38 Iter 208: loss 0.21450. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 38 Iter 209: loss 0.24532. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 38 Iter 209: loss 0.24532. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 38 Iter 210: loss 0.21989. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 38 Iter 210: loss 0.21989. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 38 Iter 211: loss 0.23987. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 38 Iter 211: loss 0.23987. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 38 Iter 212: loss 0.24255. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 38 Iter 212: loss 0.24255. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 38 Iter 213: loss 0.22977. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 38 Iter 213: loss 0.22977. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 38 Iter 214: loss 0.23250. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 38 Iter 214: loss 0.23250. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 38 Iter 215: loss 0.21809. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 38 Iter 215: loss 0.21809. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.07it/s]
Epoch 38 Iter 216: loss 0.23039. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 38 Iter 216: loss 0.23039. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.25352. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.25352. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.07it/s]
Epoch 38 Iter 218: loss 0.22765. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 38 Iter 218: loss 0.22765. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 38 Iter 219: loss 0.22883. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 38 Iter 219: loss 0.22883. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 38 Iter 220: loss 0.25902. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 38 Iter 220: loss 0.25902. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 38 Iter 221: loss 0.23983. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 38 Iter 221: loss 0.23983. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.05it/s]
Epoch 38 Iter 222: loss 0.23504. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 38 Iter 222: loss 0.23504. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 223: loss 0.24874. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 223: loss 0.24874. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.04it/s]
Epoch 38 Iter 224: loss 0.22615. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 38 Iter 224: loss 0.22615. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 38 Iter 224: loss 0.22615. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.24092. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.24092. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 39 Iter 2: loss 0.26855. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 39 Iter 2: loss 0.26855. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 39 Iter 3: loss 0.24030. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 39 Iter 3: loss 0.24030. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 39 Iter 4: loss 0.22286. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 39 Iter 4: loss 0.22286. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 39 Iter 5: loss 0.22832. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 39 Iter 5: loss 0.22832. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.24862. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.24862. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 39 Iter 7: loss 0.23265. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 7: loss 0.23265. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 8: loss 0.21920. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 8: loss 0.21920. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.06it/s]
Epoch 39 Iter 9: loss 0.22883. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.06it/s]
Epoch 39 Iter 9: loss 0.22883. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 39 Iter 10: loss 0.23609. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 39 Iter 10: loss 0.23609. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.22638. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.22638. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 12: loss 0.22558. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 12: loss 0.22558. :   5%|██▎                                         | 12/224 [00:05<01:43,  2.05it/s]
Epoch 39 Iter 13: loss 0.23569. :   5%|██▎                                         | 12/224 [00:06<01:43,  2.05it/s]
Epoch 39 Iter 13: loss 0.23569. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 39 Iter 14: loss 0.22900. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 39 Iter 14: loss 0.22900. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 39 Iter 15: loss 0.22705. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 39 Iter 15: loss 0.22705. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 39 Iter 16: loss 0.23322. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 39 Iter 16: loss 0.23322. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 39 Iter 17: loss 0.22571. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 39 Iter 17: loss 0.22571. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 39 Iter 18: loss 0.21389. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 39 Iter 18: loss 0.21389. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 39 Iter 19: loss 0.23616. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 39 Iter 19: loss 0.23616. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 39 Iter 20: loss 0.23689. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 39 Iter 20: loss 0.23689. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 39 Iter 21: loss 0.23560. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 39 Iter 21: loss 0.23560. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 39 Iter 22: loss 0.25742. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 39 Iter 22: loss 0.25742. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 39 Iter 23: loss 0.23790. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 23: loss 0.23790. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 24: loss 0.22522. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 24: loss 0.22522. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.20986. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.20986. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 26: loss 0.21617. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 26: loss 0.21617. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 27: loss 0.26290. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 39 Iter 27: loss 0.26290. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 39 Iter 28: loss 0.22148. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 39 Iter 28: loss 0.22148. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.23217. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.23217. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 30: loss 0.22271. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 30: loss 0.22271. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.22713. :  13%|█████▉                                      | 30/224 [00:15<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.22713. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.24616. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.24616. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 33: loss 0.24311. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 33: loss 0.24311. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.08it/s]
Epoch 39 Iter 34: loss 0.23496. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.08it/s]
Epoch 39 Iter 34: loss 0.23496. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 35: loss 0.23744. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 35: loss 0.23744. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 39 Iter 36: loss 0.24187. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 39 Iter 36: loss 0.24187. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 39 Iter 37: loss 0.25157. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 39 Iter 37: loss 0.25157. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 39 Iter 38: loss 0.22044. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 38: loss 0.22044. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 39: loss 0.23062. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 39 Iter 39: loss 0.23062. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.24323. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.24323. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.07it/s]
Epoch 39 Iter 41: loss 0.22943. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.07it/s]
Epoch 39 Iter 41: loss 0.22943. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.22848. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.22848. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 39 Iter 43: loss 0.25172. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.07it/s]
Epoch 39 Iter 43: loss 0.25172. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 39 Iter 44: loss 0.24328. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 39 Iter 44: loss 0.24328. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 39 Iter 45: loss 0.23925. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 39 Iter 45: loss 0.23925. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.06it/s]
Epoch 39 Iter 46: loss 0.23862. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.06it/s]
Epoch 39 Iter 46: loss 0.23862. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 39 Iter 47: loss 0.24282. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 39 Iter 47: loss 0.24282. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 39 Iter 48: loss 0.24148. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 39 Iter 48: loss 0.24148. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 39 Iter 49: loss 0.21206. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 39 Iter 49: loss 0.21206. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 39 Iter 50: loss 0.24460. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 39 Iter 50: loss 0.24460. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 39 Iter 51: loss 0.21626. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.07it/s]
Epoch 39 Iter 51: loss 0.21626. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 39 Iter 52: loss 0.23330. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 39 Iter 52: loss 0.23330. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 39 Iter 53: loss 0.23555. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 39 Iter 53: loss 0.23555. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 39 Iter 54: loss 0.23109. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 39 Iter 54: loss 0.23109. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 39 Iter 55: loss 0.23640. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 39 Iter 55: loss 0.23640. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 39 Iter 56: loss 0.23347. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 56: loss 0.23347. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.22343. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.22343. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.23108. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.23108. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.24021. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.24021. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.24343. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.24343. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.25073. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.25073. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.22252. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.22252. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 63: loss 0.22543. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 63: loss 0.22543. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 64: loss 0.24655. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 39 Iter 64: loss 0.24655. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.24442. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.24442. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 39 Iter 66: loss 0.23273. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 39 Iter 66: loss 0.23273. :  29%|████████████▉                               | 66/224 [00:31<01:17,  2.05it/s]
Epoch 39 Iter 67: loss 0.23077. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 39 Iter 67: loss 0.23077. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.04it/s]
Epoch 39 Iter 68: loss 0.22800. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.04it/s]
Epoch 39 Iter 68: loss 0.22800. :  30%|█████████████▎                              | 68/224 [00:32<01:16,  2.05it/s]
Epoch 39 Iter 69: loss 0.23067. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.05it/s]
Epoch 39 Iter 69: loss 0.23067. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 39 Iter 70: loss 0.21474. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 39 Iter 70: loss 0.21474. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 39 Iter 71: loss 0.22456. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 39 Iter 71: loss 0.22456. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 39 Iter 72: loss 0.22851. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 39 Iter 72: loss 0.22851. :  32%|██████████████▏                             | 72/224 [00:34<01:14,  2.05it/s]
Epoch 39 Iter 73: loss 0.21885. :  32%|██████████████▏                             | 72/224 [00:35<01:14,  2.05it/s]
Epoch 39 Iter 73: loss 0.21885. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.24738. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.24738. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 39 Iter 75: loss 0.21517. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 39 Iter 75: loss 0.21517. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 39 Iter 76: loss 0.23977. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 39 Iter 76: loss 0.23977. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 39 Iter 77: loss 0.22191. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 39 Iter 77: loss 0.22191. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 39 Iter 78: loss 0.21606. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 39 Iter 78: loss 0.21606. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 39 Iter 79: loss 0.20923. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 79: loss 0.20923. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 80: loss 0.24512. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 39 Iter 80: loss 0.24512. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 39 Iter 81: loss 0.23985. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 39 Iter 81: loss 0.23985. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 39 Iter 82: loss 0.24359. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 39 Iter 82: loss 0.24359. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 39 Iter 83: loss 0.22057. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 83: loss 0.22057. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 84: loss 0.23041. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 39 Iter 84: loss 0.23041. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 39 Iter 85: loss 0.23375. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 85: loss 0.23375. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 86: loss 0.25762. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 39 Iter 86: loss 0.25762. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 39 Iter 87: loss 0.23440. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 39 Iter 87: loss 0.23440. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 39 Iter 88: loss 0.24841. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 39 Iter 88: loss 0.24841. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.21579. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.21579. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 39 Iter 90: loss 0.21810. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 39 Iter 90: loss 0.21810. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 39 Iter 91: loss 0.22341. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.08it/s]
Epoch 39 Iter 91: loss 0.22341. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 39 Iter 92: loss 0.23489. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 39 Iter 92: loss 0.23489. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 39 Iter 93: loss 0.23455. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 39 Iter 93: loss 0.23455. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.23330. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.23330. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.04it/s]
Epoch 39 Iter 95: loss 0.21120. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.04it/s]
Epoch 39 Iter 95: loss 0.21120. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.03it/s]
Epoch 39 Iter 96: loss 0.22804. :  42%|██████████████████▋                         | 95/224 [00:46<01:03,  2.03it/s]
Epoch 39 Iter 96: loss 0.22804. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 39 Iter 97: loss 0.22540. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 39 Iter 97: loss 0.22540. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.03it/s]
Epoch 39 Iter 98: loss 0.24901. :  43%|███████████████████                         | 97/224 [00:47<01:02,  2.03it/s]
Epoch 39 Iter 98: loss 0.24901. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.04it/s]
Epoch 39 Iter 99: loss 0.23056. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.04it/s]
Epoch 39 Iter 99: loss 0.23056. :  44%|███████████████████▍                        | 99/224 [00:47<01:01,  2.03it/s]
Epoch 39 Iter 100: loss 0.22720. :  44%|███████████████████                        | 99/224 [00:48<01:01,  2.03it/s]
Epoch 39 Iter 100: loss 0.22720. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.03it/s]
Epoch 39 Iter 101: loss 0.22326. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.03it/s]
Epoch 39 Iter 101: loss 0.22326. :  45%|██████████████████▉                       | 101/224 [00:48<01:00,  2.04it/s]
Epoch 39 Iter 102: loss 0.23533. :  45%|██████████████████▉                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 39 Iter 102: loss 0.23533. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 39 Iter 103: loss 0.23051. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 39 Iter 103: loss 0.23051. :  46%|███████████████████▎                      | 103/224 [00:49<00:59,  2.05it/s]
Epoch 39 Iter 104: loss 0.24377. :  46%|███████████████████▎                      | 103/224 [00:50<00:59,  2.05it/s]
Epoch 39 Iter 104: loss 0.24377. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 39 Iter 105: loss 0.22170. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.04it/s]
Epoch 39 Iter 105: loss 0.22170. :  47%|███████████████████▋                      | 105/224 [00:50<00:58,  2.04it/s]
Epoch 39 Iter 106: loss 0.23417. :  47%|███████████████████▋                      | 105/224 [00:51<00:58,  2.04it/s]
Epoch 39 Iter 106: loss 0.23417. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 107: loss 0.23291. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 107: loss 0.23291. :  48%|████████████████████                      | 107/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 108: loss 0.21496. :  48%|████████████████████                      | 107/224 [00:52<00:57,  2.05it/s]
Epoch 39 Iter 108: loss 0.21496. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 39 Iter 109: loss 0.23030. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 39 Iter 109: loss 0.23030. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 39 Iter 110: loss 0.23443. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 39 Iter 110: loss 0.23443. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 39 Iter 111: loss 0.22282. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 39 Iter 111: loss 0.22282. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 39 Iter 112: loss 0.22475. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 39 Iter 112: loss 0.22475. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 39 Iter 113: loss 0.23677. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 39 Iter 113: loss 0.23677. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 39 Iter 114: loss 0.24395. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 39 Iter 114: loss 0.24395. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 39 Iter 115: loss 0.21881. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 39 Iter 115: loss 0.21881. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.06it/s]
Epoch 39 Iter 116: loss 0.24003. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.06it/s]
Epoch 39 Iter 116: loss 0.24003. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.01it/s]
Epoch 39 Iter 117: loss 0.23101. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.01it/s]
Epoch 39 Iter 117: loss 0.23101. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.03it/s]
Epoch 39 Iter 118: loss 0.20981. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.03it/s]
Epoch 39 Iter 118: loss 0.20981. :  53%|██████████████████████▏                   | 118/224 [00:57<00:52,  2.04it/s]
Epoch 39 Iter 119: loss 0.24242. :  53%|██████████████████████▏                   | 118/224 [00:57<00:52,  2.04it/s]
Epoch 39 Iter 119: loss 0.24242. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.06it/s]
Epoch 39 Iter 120: loss 0.20940. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 39 Iter 120: loss 0.20940. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 121: loss 0.26273. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 121: loss 0.26273. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 39 Iter 122: loss 0.22757. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 39 Iter 122: loss 0.22757. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 39 Iter 123: loss 0.23972. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 39 Iter 123: loss 0.23972. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.09it/s]
Epoch 39 Iter 124: loss 0.23029. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.09it/s]
Epoch 39 Iter 124: loss 0.23029. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.10it/s]
Epoch 39 Iter 125: loss 0.23473. :  55%|███████████████████████▎                  | 124/224 [01:00<00:47,  2.10it/s]
Epoch 39 Iter 125: loss 0.23473. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.09it/s]
Epoch 39 Iter 126: loss 0.23775. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.09it/s]
Epoch 39 Iter 126: loss 0.23775. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 39 Iter 127: loss 0.23104. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 39 Iter 127: loss 0.23104. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.09it/s]
Epoch 39 Iter 128: loss 0.23872. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.09it/s]
Epoch 39 Iter 128: loss 0.23872. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 39 Iter 129: loss 0.22414. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 39 Iter 129: loss 0.22414. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.26290. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.26290. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 39 Iter 131: loss 0.22107. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 39 Iter 131: loss 0.22107. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 39 Iter 132: loss 0.25822. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 39 Iter 132: loss 0.25822. :  59%|████████████████████████▊                 | 132/224 [01:03<00:43,  2.09it/s]
Epoch 39 Iter 133: loss 0.22710. :  59%|████████████████████████▊                 | 132/224 [01:04<00:43,  2.09it/s]
Epoch 39 Iter 133: loss 0.22710. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 39 Iter 134: loss 0.21487. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 39 Iter 134: loss 0.21487. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 39 Iter 135: loss 0.22743. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 39 Iter 135: loss 0.22743. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 39 Iter 136: loss 0.21311. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 39 Iter 136: loss 0.21311. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 39 Iter 137: loss 0.23018. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 39 Iter 137: loss 0.23018. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 39 Iter 138: loss 0.23768. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 39 Iter 138: loss 0.23768. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 39 Iter 139: loss 0.24871. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 39 Iter 139: loss 0.24871. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 39 Iter 140: loss 0.23779. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 39 Iter 140: loss 0.23779. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.08it/s]
Epoch 39 Iter 141: loss 0.22017. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.08it/s]
Epoch 39 Iter 141: loss 0.22017. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 39 Iter 142: loss 0.22926. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 39 Iter 142: loss 0.22926. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.24216. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.24216. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 144: loss 0.24355. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 144: loss 0.24355. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 39 Iter 145: loss 0.22793. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 145: loss 0.22793. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 146: loss 0.23294. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 146: loss 0.23294. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 39 Iter 147: loss 0.23889. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 39 Iter 147: loss 0.23889. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 39 Iter 148: loss 0.22798. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 39 Iter 148: loss 0.22798. :  66%|███████████████████████████▊              | 148/224 [01:11<00:37,  2.05it/s]
Epoch 39 Iter 149: loss 0.25359. :  66%|███████████████████████████▊              | 148/224 [01:12<00:37,  2.05it/s]
Epoch 39 Iter 149: loss 0.25359. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 39 Iter 150: loss 0.21621. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 39 Iter 150: loss 0.21621. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 39 Iter 151: loss 0.24168. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 39 Iter 151: loss 0.24168. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 39 Iter 152: loss 0.21908. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 39 Iter 152: loss 0.21908. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 39 Iter 153: loss 0.24766. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 39 Iter 153: loss 0.24766. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 39 Iter 154: loss 0.23537. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 39 Iter 154: loss 0.23537. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 39 Iter 155: loss 0.24748. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 39 Iter 155: loss 0.24748. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 39 Iter 156: loss 0.24444. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 39 Iter 156: loss 0.24444. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 39 Iter 157: loss 0.23420. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.08it/s]
Epoch 39 Iter 157: loss 0.23420. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.10it/s]
Epoch 39 Iter 158: loss 0.23115. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.10it/s]
Epoch 39 Iter 158: loss 0.23115. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 39 Iter 159: loss 0.24256. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 39 Iter 159: loss 0.24256. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.09it/s]
Epoch 39 Iter 160: loss 0.24778. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 39 Iter 160: loss 0.24778. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 161: loss 0.22509. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 161: loss 0.22509. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 162: loss 0.22826. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 39 Iter 162: loss 0.22826. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 39 Iter 163: loss 0.21994. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.07it/s]
Epoch 39 Iter 163: loss 0.21994. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 39 Iter 164: loss 0.22857. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 39 Iter 164: loss 0.22857. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 165: loss 0.22867. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 165: loss 0.22867. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.23215. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.23215. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 39 Iter 167: loss 0.21782. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 39 Iter 167: loss 0.21782. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.05it/s]
Epoch 39 Iter 168: loss 0.22207. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.05it/s]
Epoch 39 Iter 168: loss 0.22207. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 39 Iter 169: loss 0.23395. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 39 Iter 169: loss 0.23395. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 39 Iter 170: loss 0.23028. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 39 Iter 170: loss 0.23028. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 39 Iter 171: loss 0.24496. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 39 Iter 171: loss 0.24496. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.04it/s]
Epoch 39 Iter 172: loss 0.24589. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.04it/s]
Epoch 39 Iter 172: loss 0.24589. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 39 Iter 173: loss 0.22280. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 39 Iter 173: loss 0.22280. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 39 Iter 174: loss 0.25059. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 39 Iter 174: loss 0.25059. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 39 Iter 175: loss 0.23012. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 39 Iter 175: loss 0.23012. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 39 Iter 176: loss 0.22995. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 39 Iter 176: loss 0.22995. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 39 Iter 177: loss 0.23238. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 39 Iter 177: loss 0.23238. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 39 Iter 178: loss 0.24415. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 39 Iter 178: loss 0.24415. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 39 Iter 179: loss 0.23902. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 39 Iter 179: loss 0.23902. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 39 Iter 180: loss 0.24001. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 180: loss 0.24001. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 181: loss 0.23155. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 181: loss 0.23155. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 39 Iter 182: loss 0.25177. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 39 Iter 182: loss 0.25177. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 39 Iter 183: loss 0.21385. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.07it/s]
Epoch 39 Iter 183: loss 0.21385. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 39 Iter 184: loss 0.25176. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 39 Iter 184: loss 0.25176. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 39 Iter 185: loss 0.24807. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 39 Iter 185: loss 0.24807. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.21302. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.21302. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 39 Iter 187: loss 0.25624. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 39 Iter 187: loss 0.25624. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 39 Iter 188: loss 0.22343. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 39 Iter 188: loss 0.22343. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 189: loss 0.21964. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 189: loss 0.21964. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.24474. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.24474. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 39 Iter 191: loss 0.24774. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 39 Iter 191: loss 0.24774. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 39 Iter 192: loss 0.22356. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 39 Iter 192: loss 0.22356. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.23625. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.23625. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.23232. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.23232. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 39 Iter 195: loss 0.23126. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 195: loss 0.23126. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 196: loss 0.24493. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 196: loss 0.24493. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 39 Iter 197: loss 0.23332. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 197: loss 0.23332. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 198: loss 0.23342. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 39 Iter 198: loss 0.23342. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 39 Iter 199: loss 0.22082. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 199: loss 0.22082. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 200: loss 0.23907. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 39 Iter 200: loss 0.23907. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 39 Iter 201: loss 0.25225. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 39 Iter 201: loss 0.25225. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 39 Iter 202: loss 0.25479. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 39 Iter 202: loss 0.25479. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 39 Iter 203: loss 0.25228. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 39 Iter 203: loss 0.25228. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.23939. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.23939. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 39 Iter 205: loss 0.23483. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 39 Iter 205: loss 0.23483. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.21458. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.21458. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 39 Iter 207: loss 0.22116. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 39 Iter 207: loss 0.22116. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 39 Iter 208: loss 0.22970. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 39 Iter 208: loss 0.22970. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 39 Iter 209: loss 0.22400. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 209: loss 0.22400. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 39 Iter 210: loss 0.22200. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.05it/s]
Epoch 39 Iter 210: loss 0.22200. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 39 Iter 211: loss 0.21388. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 211: loss 0.21388. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 39 Iter 212: loss 0.27111. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 39 Iter 212: loss 0.27111. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 39 Iter 213: loss 0.25203. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 39 Iter 213: loss 0.25203. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 39 Iter 214: loss 0.23773. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 39 Iter 214: loss 0.23773. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 39 Iter 215: loss 0.22714. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 39 Iter 215: loss 0.22714. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 39 Iter 216: loss 0.23132. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 39 Iter 216: loss 0.23132. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 39 Iter 217: loss 0.24119. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 39 Iter 217: loss 0.24119. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 39 Iter 218: loss 0.25105. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 39 Iter 218: loss 0.25105. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 39 Iter 219: loss 0.23301. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 39 Iter 219: loss 0.23301. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 39 Iter 220: loss 0.22444. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 39 Iter 220: loss 0.22444. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 39 Iter 221: loss 0.24410. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 39 Iter 221: loss 0.24410. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 39 Iter 222: loss 0.23052. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 39 Iter 222: loss 0.23052. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 39 Iter 223: loss 0.22040. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 39 Iter 223: loss 0.22040. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.21197. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.21197. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 39 Iter 224: loss 0.21197. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23336
    Valid loss: 0.23379
       Valid loss recons: 0.22262
       Valid loss KL-D:   1.11707
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.24717. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.24717. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 40 Iter 2: loss 0.22916. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 40 Iter 2: loss 0.22916. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 40 Iter 3: loss 0.23997. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 40 Iter 3: loss 0.23997. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 4: loss 0.23006. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 4: loss 0.23006. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 40 Iter 5: loss 0.25733. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 40 Iter 5: loss 0.25733. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 40 Iter 6: loss 0.22617. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 40 Iter 6: loss 0.22617. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 40 Iter 7: loss 0.23582. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 40 Iter 7: loss 0.23582. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 8: loss 0.24995. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 8: loss 0.24995. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 40 Iter 9: loss 0.24841. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 40 Iter 9: loss 0.24841. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 40 Iter 10: loss 0.23872. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.07it/s]
Epoch 40 Iter 10: loss 0.23872. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 40 Iter 11: loss 0.24883. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 40 Iter 11: loss 0.24883. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 40 Iter 12: loss 0.26005. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 40 Iter 12: loss 0.26005. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 40 Iter 13: loss 0.24520. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 40 Iter 13: loss 0.24520. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 14: loss 0.22736. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 14: loss 0.22736. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 40 Iter 15: loss 0.24059. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 40 Iter 15: loss 0.24059. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.22255. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.22255. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 17: loss 0.23648. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.08it/s]
Epoch 40 Iter 17: loss 0.23648. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 40 Iter 18: loss 0.21258. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.07it/s]
Epoch 40 Iter 18: loss 0.21258. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.08it/s]
Epoch 40 Iter 19: loss 0.24460. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.08it/s]
Epoch 40 Iter 19: loss 0.24460. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 40 Iter 20: loss 0.26827. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 40 Iter 20: loss 0.26827. :   9%|███▉                                        | 20/224 [00:09<01:37,  2.08it/s]
Epoch 40 Iter 21: loss 0.24327. :   9%|███▉                                        | 20/224 [00:10<01:37,  2.08it/s]
Epoch 40 Iter 21: loss 0.24327. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 40 Iter 22: loss 0.22015. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 40 Iter 22: loss 0.22015. :  10%|████▎                                       | 22/224 [00:10<01:36,  2.09it/s]
Epoch 40 Iter 23: loss 0.21867. :  10%|████▎                                       | 22/224 [00:11<01:36,  2.09it/s]
Epoch 40 Iter 23: loss 0.21867. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 40 Iter 24: loss 0.25164. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 40 Iter 24: loss 0.25164. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 40 Iter 25: loss 0.22449. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 40 Iter 25: loss 0.22449. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 26: loss 0.23915. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 26: loss 0.23915. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 27: loss 0.23916. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 40 Iter 27: loss 0.23916. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 40 Iter 28: loss 0.22978. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 40 Iter 28: loss 0.22978. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.06it/s]
Epoch 40 Iter 29: loss 0.24023. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.06it/s]
Epoch 40 Iter 29: loss 0.24023. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 40 Iter 30: loss 0.22958. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 40 Iter 30: loss 0.22958. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 40 Iter 31: loss 0.25037. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.07it/s]
Epoch 40 Iter 31: loss 0.25037. :  14%|██████                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 40 Iter 32: loss 0.23878. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 40 Iter 32: loss 0.23878. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 40 Iter 33: loss 0.26656. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 40 Iter 33: loss 0.26656. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 40 Iter 34: loss 0.22034. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 40 Iter 34: loss 0.22034. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 40 Iter 35: loss 0.21448. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 40 Iter 35: loss 0.21448. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.21914. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.21914. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.22869. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.22869. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.23216. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.23216. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.22722. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.22722. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.23937. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.23937. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 40 Iter 41: loss 0.24274. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 40 Iter 41: loss 0.24274. :  18%|████████                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 40 Iter 42: loss 0.23527. :  18%|████████                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 40 Iter 42: loss 0.23527. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.25478. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.25478. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 40 Iter 44: loss 0.22887. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 40 Iter 44: loss 0.22887. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 40 Iter 45: loss 0.22575. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 40 Iter 45: loss 0.22575. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.06it/s]
Epoch 40 Iter 46: loss 0.22441. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.06it/s]
Epoch 40 Iter 46: loss 0.22441. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 40 Iter 47: loss 0.24112. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 40 Iter 47: loss 0.24112. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 40 Iter 48: loss 0.21521. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 40 Iter 48: loss 0.21521. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.24610. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.24610. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 40 Iter 50: loss 0.23464. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 50: loss 0.23464. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.23367. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.23367. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 40 Iter 52: loss 0.22233. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 40 Iter 52: loss 0.22233. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 40 Iter 53: loss 0.23767. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 40 Iter 53: loss 0.23767. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.23127. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.23127. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.07it/s]
Epoch 40 Iter 55: loss 0.26011. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.07it/s]
Epoch 40 Iter 55: loss 0.26011. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.23079. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.23079. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 40 Iter 57: loss 0.23306. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 40 Iter 57: loss 0.23306. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.06it/s]
Epoch 40 Iter 58: loss 0.25881. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 58: loss 0.25881. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 40 Iter 59: loss 0.23457. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 40 Iter 59: loss 0.23457. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.05it/s]
Epoch 40 Iter 60: loss 0.23543. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.05it/s]
Epoch 40 Iter 60: loss 0.23543. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 40 Iter 61: loss 0.22643. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 40 Iter 61: loss 0.22643. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.21612. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.21612. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 40 Iter 63: loss 0.23720. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 40 Iter 63: loss 0.23720. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.05it/s]
Epoch 40 Iter 64: loss 0.22473. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.05it/s]
Epoch 40 Iter 64: loss 0.22473. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 40 Iter 65: loss 0.23686. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 40 Iter 65: loss 0.23686. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.23427. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.23427. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 67: loss 0.21629. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 40 Iter 67: loss 0.21629. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.23215. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.23215. :  30%|█████████████▎                              | 68/224 [00:32<01:14,  2.08it/s]
Epoch 40 Iter 69: loss 0.22376. :  30%|█████████████▎                              | 68/224 [00:33<01:14,  2.08it/s]
Epoch 40 Iter 69: loss 0.22376. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 70: loss 0.21120. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 70: loss 0.21120. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 71: loss 0.22453. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 40 Iter 71: loss 0.22453. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 40 Iter 72: loss 0.21994. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 40 Iter 72: loss 0.21994. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 40 Iter 73: loss 0.24602. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 40 Iter 73: loss 0.24602. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 40 Iter 74: loss 0.23037. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 40 Iter 74: loss 0.23037. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 40 Iter 75: loss 0.21402. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 40 Iter 75: loss 0.21402. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 40 Iter 76: loss 0.23603. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.07it/s]
Epoch 40 Iter 76: loss 0.23603. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 40 Iter 77: loss 0.23903. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 40 Iter 77: loss 0.23903. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 40 Iter 78: loss 0.22781. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 40 Iter 78: loss 0.22781. :  35%|███████████████▎                            | 78/224 [00:37<01:11,  2.05it/s]
Epoch 40 Iter 79: loss 0.22225. :  35%|███████████████▎                            | 78/224 [00:38<01:11,  2.05it/s]
Epoch 40 Iter 79: loss 0.22225. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 40 Iter 80: loss 0.21643. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.05it/s]
Epoch 40 Iter 80: loss 0.21643. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.06it/s]
Epoch 40 Iter 81: loss 0.25278. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.06it/s]
Epoch 40 Iter 81: loss 0.25278. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 40 Iter 82: loss 0.22802. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 40 Iter 82: loss 0.22802. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 40 Iter 83: loss 0.23377. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 40 Iter 83: loss 0.23377. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.07it/s]
Epoch 40 Iter 84: loss 0.23718. :  37%|████████████████▎                           | 83/224 [00:40<01:07,  2.07it/s]
Epoch 40 Iter 84: loss 0.23718. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 40 Iter 85: loss 0.22072. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 85: loss 0.22072. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 86: loss 0.23175. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 86: loss 0.23175. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 40 Iter 87: loss 0.23581. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 40 Iter 87: loss 0.23581. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 40 Iter 88: loss 0.22656. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 40 Iter 88: loss 0.22656. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 40 Iter 89: loss 0.24244. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 40 Iter 89: loss 0.24244. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 40 Iter 90: loss 0.23164. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 40 Iter 90: loss 0.23164. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.05it/s]
Epoch 40 Iter 91: loss 0.22830. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.05it/s]
Epoch 40 Iter 91: loss 0.22830. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 40 Iter 92: loss 0.24246. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 40 Iter 92: loss 0.24246. :  41%|██████████████████                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 40 Iter 93: loss 0.20177. :  41%|██████████████████                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 40 Iter 93: loss 0.20177. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.04it/s]
Epoch 40 Iter 94: loss 0.23401. :  42%|██████████████████▎                         | 93/224 [00:45<01:04,  2.04it/s]
Epoch 40 Iter 94: loss 0.23401. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.05it/s]
Epoch 40 Iter 95: loss 0.23712. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.05it/s]
Epoch 40 Iter 95: loss 0.23712. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 40 Iter 96: loss 0.26007. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 40 Iter 96: loss 0.26007. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 40 Iter 97: loss 0.21782. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 40 Iter 97: loss 0.21782. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 40 Iter 98: loss 0.23448. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 40 Iter 98: loss 0.23448. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 99: loss 0.23287. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 99: loss 0.23287. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 40 Iter 100: loss 0.22425. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 40 Iter 100: loss 0.22425. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 40 Iter 101: loss 0.22019. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 40 Iter 101: loss 0.22019. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 40 Iter 102: loss 0.23694. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 40 Iter 102: loss 0.23694. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 40 Iter 103: loss 0.22127. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 40 Iter 103: loss 0.22127. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 40 Iter 104: loss 0.21832. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 40 Iter 104: loss 0.21832. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 40 Iter 105: loss 0.23133. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 40 Iter 105: loss 0.23133. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.22358. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.22358. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 107: loss 0.22586. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 107: loss 0.22586. :  48%|████████████████████                      | 107/224 [00:51<00:57,  2.05it/s]
Epoch 40 Iter 108: loss 0.23825. :  48%|████████████████████                      | 107/224 [00:52<00:57,  2.05it/s]
Epoch 40 Iter 108: loss 0.23825. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.23242. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.23242. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 40 Iter 110: loss 0.23287. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 40 Iter 110: loss 0.23287. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 40 Iter 111: loss 0.24461. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 40 Iter 111: loss 0.24461. :  50%|████████████████████▊                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 40 Iter 112: loss 0.21296. :  50%|████████████████████▊                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 40 Iter 112: loss 0.21296. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 40 Iter 113: loss 0.24862. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 40 Iter 113: loss 0.24862. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 40 Iter 114: loss 0.23703. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 40 Iter 114: loss 0.23703. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.23115. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.23115. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.23810. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.23810. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 40 Iter 117: loss 0.22017. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 40 Iter 117: loss 0.22017. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.03it/s]
Epoch 40 Iter 118: loss 0.24099. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.03it/s]
Epoch 40 Iter 118: loss 0.24099. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 40 Iter 119: loss 0.22052. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 40 Iter 119: loss 0.22052. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 40 Iter 120: loss 0.21973. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 40 Iter 120: loss 0.21973. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 40 Iter 121: loss 0.24145. :  54%|██████████████████████▌                   | 120/224 [00:58<00:49,  2.08it/s]
Epoch 40 Iter 121: loss 0.24145. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.09it/s]
Epoch 40 Iter 122: loss 0.23401. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.09it/s]
Epoch 40 Iter 122: loss 0.23401. :  54%|██████████████████████▊                   | 122/224 [00:59<00:48,  2.09it/s]
Epoch 40 Iter 123: loss 0.23125. :  54%|██████████████████████▊                   | 122/224 [00:59<00:48,  2.09it/s]
Epoch 40 Iter 123: loss 0.23125. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 40 Iter 124: loss 0.24132. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.08it/s]
Epoch 40 Iter 124: loss 0.24132. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 40 Iter 125: loss 0.21792. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 40 Iter 125: loss 0.21792. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.09it/s]
Epoch 40 Iter 126: loss 0.23318. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.09it/s]
Epoch 40 Iter 126: loss 0.23318. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 40 Iter 127: loss 0.23964. :  56%|███████████████████████▋                  | 126/224 [01:01<00:46,  2.09it/s]
Epoch 40 Iter 127: loss 0.23964. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 40 Iter 128: loss 0.23119. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 40 Iter 128: loss 0.23119. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 129: loss 0.22842. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 129: loss 0.22842. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 130: loss 0.24384. :  58%|████████████████████████▏                 | 129/224 [01:03<00:46,  2.07it/s]
Epoch 40 Iter 130: loss 0.24384. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 131: loss 0.21180. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 131: loss 0.21180. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 40 Iter 132: loss 0.23782. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 40 Iter 132: loss 0.23782. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 40 Iter 133: loss 0.22177. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 40 Iter 133: loss 0.22177. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 40 Iter 134: loss 0.23251. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 40 Iter 134: loss 0.23251. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 40 Iter 135: loss 0.21931. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 40 Iter 135: loss 0.21931. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 40 Iter 136: loss 0.23337. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 40 Iter 136: loss 0.23337. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 40 Iter 137: loss 0.24879. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 40 Iter 137: loss 0.24879. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 40 Iter 138: loss 0.23066. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 40 Iter 138: loss 0.23066. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 40 Iter 139: loss 0.23856. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 40 Iter 139: loss 0.23856. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 40 Iter 140: loss 0.23658. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 40 Iter 140: loss 0.23658. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 40 Iter 141: loss 0.21888. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 141: loss 0.21888. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 142: loss 0.23678. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 142: loss 0.23678. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.23718. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.23718. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.23947. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.23947. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 40 Iter 145: loss 0.23390. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 40 Iter 145: loss 0.23390. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.05it/s]
Epoch 40 Iter 146: loss 0.22682. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.05it/s]
Epoch 40 Iter 146: loss 0.22682. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.23415. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.23415. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 40 Iter 148: loss 0.23021. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 40 Iter 148: loss 0.23021. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 40 Iter 149: loss 0.22580. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 40 Iter 149: loss 0.22580. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 150: loss 0.24125. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 150: loss 0.24125. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 40 Iter 151: loss 0.23073. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 40 Iter 151: loss 0.23073. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 40 Iter 152: loss 0.23912. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 40 Iter 152: loss 0.23912. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 40 Iter 153: loss 0.24661. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 40 Iter 153: loss 0.24661. :  68%|████████████████████████████▋             | 153/224 [01:14<00:33,  2.09it/s]
Epoch 40 Iter 154: loss 0.22075. :  68%|████████████████████████████▋             | 153/224 [01:14<00:33,  2.09it/s]
Epoch 40 Iter 154: loss 0.22075. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.10it/s]
Epoch 40 Iter 155: loss 0.23148. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.10it/s]
Epoch 40 Iter 155: loss 0.23148. :  69%|█████████████████████████████             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 40 Iter 156: loss 0.22925. :  69%|█████████████████████████████             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 40 Iter 156: loss 0.22925. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.11it/s]
Epoch 40 Iter 157: loss 0.24650. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.11it/s]
Epoch 40 Iter 157: loss 0.24650. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.12it/s]
Epoch 40 Iter 158: loss 0.21497. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:31,  2.12it/s]
Epoch 40 Iter 158: loss 0.21497. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 40 Iter 159: loss 0.24001. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.10it/s]
Epoch 40 Iter 159: loss 0.24001. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.09it/s]
Epoch 40 Iter 160: loss 0.23238. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 40 Iter 160: loss 0.23238. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 40 Iter 161: loss 0.21886. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 40 Iter 161: loss 0.21886. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 40 Iter 162: loss 0.22374. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 40 Iter 162: loss 0.22374. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 40 Iter 163: loss 0.24419. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 40 Iter 163: loss 0.24419. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 40 Iter 164: loss 0.22558. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 40 Iter 164: loss 0.22558. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.26374. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.26374. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 40 Iter 166: loss 0.23967. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 40 Iter 166: loss 0.23967. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 40 Iter 167: loss 0.25605. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 40 Iter 167: loss 0.25605. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 40 Iter 168: loss 0.24065. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 40 Iter 168: loss 0.24065. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 40 Iter 169: loss 0.22762. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 40 Iter 169: loss 0.22762. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 40 Iter 170: loss 0.21815. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 40 Iter 170: loss 0.21815. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 40 Iter 171: loss 0.21764. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 40 Iter 171: loss 0.21764. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 40 Iter 172: loss 0.23290. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 40 Iter 172: loss 0.23290. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 40 Iter 173: loss 0.24404. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 40 Iter 173: loss 0.24404. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 40 Iter 174: loss 0.23374. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 40 Iter 174: loss 0.23374. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.08it/s]
Epoch 40 Iter 175: loss 0.23266. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:23,  2.08it/s]
Epoch 40 Iter 175: loss 0.23266. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 40 Iter 176: loss 0.23457. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 40 Iter 176: loss 0.23457. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 40 Iter 177: loss 0.22099. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 40 Iter 177: loss 0.22099. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.08it/s]
Epoch 40 Iter 178: loss 0.25687. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.08it/s]
Epoch 40 Iter 178: loss 0.25687. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 40 Iter 179: loss 0.22645. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 40 Iter 179: loss 0.22645. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 40 Iter 180: loss 0.23989. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 40 Iter 180: loss 0.23989. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 40 Iter 181: loss 0.25220. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 40 Iter 181: loss 0.25220. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 40 Iter 182: loss 0.23664. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 40 Iter 182: loss 0.23664. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 40 Iter 183: loss 0.22978. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 40 Iter 183: loss 0.22978. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 40 Iter 184: loss 0.23798. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.09it/s]
Epoch 40 Iter 184: loss 0.23798. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 40 Iter 185: loss 0.22784. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 40 Iter 185: loss 0.22784. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 40 Iter 186: loss 0.23285. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 40 Iter 186: loss 0.23285. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 40 Iter 187: loss 0.23830. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 40 Iter 187: loss 0.23830. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 40 Iter 188: loss 0.20626. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 40 Iter 188: loss 0.20626. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 40 Iter 189: loss 0.22941. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 40 Iter 189: loss 0.22941. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 40 Iter 190: loss 0.24643. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 40 Iter 190: loss 0.24643. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 40 Iter 191: loss 0.23465. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 40 Iter 191: loss 0.23465. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.23351. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.23351. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 40 Iter 193: loss 0.24073. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 40 Iter 193: loss 0.24073. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 40 Iter 194: loss 0.24580. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 40 Iter 194: loss 0.24580. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.22793. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.22793. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 40 Iter 196: loss 0.24439. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 40 Iter 196: loss 0.24439. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.23226. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.23226. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 40 Iter 198: loss 0.20657. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 40 Iter 198: loss 0.20657. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 40 Iter 199: loss 0.22320. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 199: loss 0.22320. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 200: loss 0.23378. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 200: loss 0.23378. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 40 Iter 201: loss 0.22164. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 40 Iter 201: loss 0.22164. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 40 Iter 202: loss 0.23575. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 40 Iter 202: loss 0.23575. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 40 Iter 203: loss 0.23361. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 40 Iter 203: loss 0.23361. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 40 Iter 204: loss 0.20770. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 40 Iter 204: loss 0.20770. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 40 Iter 205: loss 0.21183. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 40 Iter 205: loss 0.21183. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 40 Iter 206: loss 0.23317. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 40 Iter 206: loss 0.23317. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 40 Iter 207: loss 0.22457. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 40 Iter 207: loss 0.22457. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 40 Iter 208: loss 0.25424. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 40 Iter 208: loss 0.25424. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 40 Iter 209: loss 0.22813. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 40 Iter 209: loss 0.22813. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 40 Iter 210: loss 0.21958. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 40 Iter 210: loss 0.21958. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 40 Iter 211: loss 0.24498. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 40 Iter 211: loss 0.24498. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 40 Iter 212: loss 0.23108. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 40 Iter 212: loss 0.23108. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 40 Iter 213: loss 0.24494. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 40 Iter 213: loss 0.24494. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 40 Iter 214: loss 0.23144. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 40 Iter 214: loss 0.23144. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 40 Iter 215: loss 0.22928. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 40 Iter 215: loss 0.22928. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 40 Iter 216: loss 0.22002. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 40 Iter 216: loss 0.22002. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 40 Iter 217: loss 0.21282. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 217: loss 0.21282. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 218: loss 0.22913. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 40 Iter 218: loss 0.22913. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 40 Iter 219: loss 0.20495. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 40 Iter 219: loss 0.20495. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 40 Iter 220: loss 0.23330. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 40 Iter 220: loss 0.23330. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.05it/s]
Epoch 40 Iter 221: loss 0.23989. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.05it/s]
Epoch 40 Iter 221: loss 0.23989. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 40 Iter 222: loss 0.24474. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 40 Iter 222: loss 0.24474. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 40 Iter 223: loss 0.23435. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 40 Iter 223: loss 0.23435. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.05it/s]
Epoch 40 Iter 224: loss 0.24908. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 40 Iter 224: loss 0.24908. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 40 Iter 224: loss 0.24908. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.21808. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.21808. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 41 Iter 2: loss 0.21992. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 41 Iter 2: loss 0.21992. :   1%|▍                                             | 2/224 [00:00<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.23161. :   1%|▍                                             | 2/224 [00:01<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.23161. :   1%|▌                                             | 3/224 [00:01<01:45,  2.08it/s]
Epoch 41 Iter 4: loss 0.23223. :   1%|▌                                             | 3/224 [00:01<01:45,  2.08it/s]
Epoch 41 Iter 4: loss 0.23223. :   2%|▊                                             | 4/224 [00:01<01:45,  2.08it/s]
Epoch 41 Iter 5: loss 0.23507. :   2%|▊                                             | 4/224 [00:02<01:45,  2.08it/s]
Epoch 41 Iter 5: loss 0.23507. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 41 Iter 6: loss 0.23619. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 41 Iter 6: loss 0.23619. :   3%|█▏                                            | 6/224 [00:02<01:44,  2.08it/s]
Epoch 41 Iter 7: loss 0.22137. :   3%|█▏                                            | 6/224 [00:03<01:44,  2.08it/s]
Epoch 41 Iter 7: loss 0.22137. :   3%|█▍                                            | 7/224 [00:03<01:43,  2.09it/s]
Epoch 41 Iter 8: loss 0.22364. :   3%|█▍                                            | 7/224 [00:03<01:43,  2.09it/s]
Epoch 41 Iter 8: loss 0.22364. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 41 Iter 9: loss 0.23472. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 41 Iter 9: loss 0.23472. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 41 Iter 10: loss 0.23868. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.08it/s]
Epoch 41 Iter 10: loss 0.23868. :   4%|█▉                                          | 10/224 [00:04<01:42,  2.08it/s]
Epoch 41 Iter 11: loss 0.26636. :   4%|█▉                                          | 10/224 [00:05<01:42,  2.08it/s]
Epoch 41 Iter 11: loss 0.26636. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 41 Iter 12: loss 0.24136. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 41 Iter 12: loss 0.24136. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.23085. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.23085. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 41 Iter 14: loss 0.24917. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 41 Iter 14: loss 0.24917. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.08it/s]
Epoch 41 Iter 15: loss 0.26469. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.08it/s]
Epoch 41 Iter 15: loss 0.26469. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 41 Iter 16: loss 0.21503. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.07it/s]
Epoch 41 Iter 16: loss 0.21503. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.08it/s]
Epoch 41 Iter 17: loss 0.24780. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.08it/s]
Epoch 41 Iter 17: loss 0.24780. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 18: loss 0.24787. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 18: loss 0.24787. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 19: loss 0.22612. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 41 Iter 19: loss 0.22612. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 41 Iter 20: loss 0.21867. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 41 Iter 20: loss 0.21867. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 41 Iter 21: loss 0.22598. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 41 Iter 21: loss 0.22598. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 41 Iter 22: loss 0.20835. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 41 Iter 22: loss 0.20835. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 41 Iter 23: loss 0.23483. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 41 Iter 23: loss 0.23483. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 41 Iter 24: loss 0.24499. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 41 Iter 24: loss 0.24499. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.08it/s]
Epoch 41 Iter 25: loss 0.21413. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.08it/s]
Epoch 41 Iter 25: loss 0.21413. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 26: loss 0.22858. :  11%|████▉                                       | 25/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 26: loss 0.22858. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 41 Iter 27: loss 0.21350. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 41 Iter 27: loss 0.21350. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 41 Iter 28: loss 0.23719. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 41 Iter 28: loss 0.23719. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.23137. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.23137. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 41 Iter 30: loss 0.22658. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.07it/s]
Epoch 41 Iter 30: loss 0.22658. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.06it/s]
Epoch 41 Iter 31: loss 0.22315. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.06it/s]
Epoch 41 Iter 31: loss 0.22315. :  14%|██████                                      | 31/224 [00:14<01:33,  2.07it/s]
Epoch 41 Iter 32: loss 0.22155. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 41 Iter 32: loss 0.22155. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 33: loss 0.22877. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 33: loss 0.22877. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 41 Iter 34: loss 0.22990. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 41 Iter 34: loss 0.22990. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.24158. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.24158. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 36: loss 0.23744. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 41 Iter 36: loss 0.23744. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 41 Iter 37: loss 0.22023. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 41 Iter 37: loss 0.22023. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 41 Iter 38: loss 0.22703. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 38: loss 0.22703. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 41 Iter 39: loss 0.23821. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 41 Iter 39: loss 0.23821. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 41 Iter 40: loss 0.23559. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 41 Iter 40: loss 0.23559. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 41 Iter 41: loss 0.23608. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.06it/s]
Epoch 41 Iter 41: loss 0.23608. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 41 Iter 42: loss 0.24137. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 41 Iter 42: loss 0.24137. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 41 Iter 43: loss 0.24485. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 41 Iter 43: loss 0.24485. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 41 Iter 44: loss 0.23871. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 41 Iter 44: loss 0.23871. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 41 Iter 45: loss 0.20428. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.07it/s]
Epoch 41 Iter 45: loss 0.20428. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 41 Iter 46: loss 0.24339. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 41 Iter 46: loss 0.24339. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 41 Iter 47: loss 0.22258. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 41 Iter 47: loss 0.22258. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 41 Iter 48: loss 0.23925. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 41 Iter 48: loss 0.23925. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 41 Iter 49: loss 0.23981. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.07it/s]
Epoch 41 Iter 49: loss 0.23981. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.07it/s]
Epoch 41 Iter 50: loss 0.24281. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.07it/s]
Epoch 41 Iter 50: loss 0.24281. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 41 Iter 51: loss 0.22187. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 41 Iter 51: loss 0.22187. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 41 Iter 52: loss 0.23765. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 41 Iter 52: loss 0.23765. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 41 Iter 53: loss 0.21715. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 41 Iter 53: loss 0.21715. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.06it/s]
Epoch 41 Iter 54: loss 0.21208. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.06it/s]
Epoch 41 Iter 54: loss 0.21208. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 41 Iter 55: loss 0.24773. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 41 Iter 55: loss 0.24773. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.08it/s]
Epoch 41 Iter 56: loss 0.22402. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.08it/s]
Epoch 41 Iter 56: loss 0.22402. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 57: loss 0.23289. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 57: loss 0.23289. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.07it/s]
Epoch 41 Iter 58: loss 0.22355. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.07it/s]
Epoch 41 Iter 58: loss 0.22355. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 41 Iter 59: loss 0.23906. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 41 Iter 59: loss 0.23906. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 41 Iter 60: loss 0.24070. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 41 Iter 60: loss 0.24070. :  27%|███████████▊                                | 60/224 [00:28<01:18,  2.08it/s]
Epoch 41 Iter 61: loss 0.23344. :  27%|███████████▊                                | 60/224 [00:29<01:18,  2.08it/s]
Epoch 41 Iter 61: loss 0.23344. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 41 Iter 62: loss 0.22045. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 41 Iter 62: loss 0.22045. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.07it/s]
Epoch 41 Iter 63: loss 0.23687. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 41 Iter 63: loss 0.23687. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 41 Iter 64: loss 0.23648. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 41 Iter 64: loss 0.23648. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.21503. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.21503. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.24026. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.24026. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.23064. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.23064. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 41 Iter 68: loss 0.24208. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 41 Iter 68: loss 0.24208. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.07it/s]
Epoch 41 Iter 69: loss 0.22120. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 41 Iter 69: loss 0.22120. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.07it/s]
Epoch 41 Iter 70: loss 0.21743. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.07it/s]
Epoch 41 Iter 70: loss 0.21743. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 41 Iter 71: loss 0.24953. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 41 Iter 71: loss 0.24953. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 41 Iter 72: loss 0.24594. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 41 Iter 72: loss 0.24594. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 41 Iter 73: loss 0.21982. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 41 Iter 73: loss 0.21982. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 41 Iter 74: loss 0.24303. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 41 Iter 74: loss 0.24303. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 41 Iter 75: loss 0.25685. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 41 Iter 75: loss 0.25685. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 41 Iter 76: loss 0.22086. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 41 Iter 76: loss 0.22086. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 41 Iter 77: loss 0.23949. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 41 Iter 77: loss 0.23949. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 41 Iter 78: loss 0.24137. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 41 Iter 78: loss 0.24137. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 41 Iter 79: loss 0.21693. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 41 Iter 79: loss 0.21693. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 41 Iter 80: loss 0.24315. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 41 Iter 80: loss 0.24315. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 41 Iter 81: loss 0.20928. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 41 Iter 81: loss 0.20928. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 41 Iter 82: loss 0.22039. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 41 Iter 82: loss 0.22039. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 41 Iter 83: loss 0.22505. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 41 Iter 83: loss 0.22505. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 41 Iter 84: loss 0.22616. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 41 Iter 84: loss 0.22616. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 41 Iter 85: loss 0.22494. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 41 Iter 85: loss 0.22494. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 41 Iter 86: loss 0.23899. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 41 Iter 86: loss 0.23899. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 41 Iter 87: loss 0.23061. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 41 Iter 87: loss 0.23061. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 41 Iter 88: loss 0.21636. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 41 Iter 88: loss 0.21636. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 41 Iter 89: loss 0.24374. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 41 Iter 89: loss 0.24374. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 41 Iter 90: loss 0.23771. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 41 Iter 90: loss 0.23771. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 41 Iter 91: loss 0.22225. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 41 Iter 91: loss 0.22225. :  41%|█████████████████▉                          | 91/224 [00:43<01:04,  2.07it/s]
Epoch 41 Iter 92: loss 0.24927. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 41 Iter 92: loss 0.24927. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 41 Iter 93: loss 0.26150. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 41 Iter 93: loss 0.26150. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.08it/s]
Epoch 41 Iter 94: loss 0.23499. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.08it/s]
Epoch 41 Iter 94: loss 0.23499. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 41 Iter 95: loss 0.22546. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 41 Iter 95: loss 0.22546. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.07it/s]
Epoch 41 Iter 96: loss 0.25037. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 41 Iter 96: loss 0.25037. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 41 Iter 97: loss 0.23646. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 41 Iter 97: loss 0.23646. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 41 Iter 98: loss 0.25167. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 41 Iter 98: loss 0.25167. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 41 Iter 99: loss 0.22965. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 41 Iter 99: loss 0.22965. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 41 Iter 100: loss 0.22825. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 41 Iter 100: loss 0.22825. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 41 Iter 101: loss 0.23287. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 41 Iter 101: loss 0.23287. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 41 Iter 102: loss 0.26397. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 41 Iter 102: loss 0.26397. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 41 Iter 103: loss 0.23909. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 41 Iter 103: loss 0.23909. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 41 Iter 104: loss 0.24903. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 41 Iter 104: loss 0.24903. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 41 Iter 105: loss 0.23765. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 41 Iter 105: loss 0.23765. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 41 Iter 106: loss 0.23518. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 41 Iter 106: loss 0.23518. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 41 Iter 107: loss 0.20437. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 41 Iter 107: loss 0.20437. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 41 Iter 108: loss 0.23985. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 41 Iter 108: loss 0.23985. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 41 Iter 109: loss 0.23873. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 41 Iter 109: loss 0.23873. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 41 Iter 110: loss 0.23907. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 41 Iter 110: loss 0.23907. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 41 Iter 111: loss 0.23135. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 41 Iter 111: loss 0.23135. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 41 Iter 112: loss 0.23565. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 41 Iter 112: loss 0.23565. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.10it/s]
Epoch 41 Iter 113: loss 0.24573. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.10it/s]
Epoch 41 Iter 113: loss 0.24573. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 41 Iter 114: loss 0.22806. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 41 Iter 114: loss 0.22806. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 41 Iter 115: loss 0.22307. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 41 Iter 115: loss 0.22307. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 41 Iter 116: loss 0.21702. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 41 Iter 116: loss 0.21702. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.01it/s]
Epoch 41 Iter 117: loss 0.23226. :  52%|█████████████████████▊                    | 116/224 [00:56<00:53,  2.01it/s]
Epoch 41 Iter 117: loss 0.23226. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.03it/s]
Epoch 41 Iter 118: loss 0.25602. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.03it/s]
Epoch 41 Iter 118: loss 0.25602. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 41 Iter 119: loss 0.22133. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.05it/s]
Epoch 41 Iter 119: loss 0.22133. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.23170. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.23170. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.23134. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.23134. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 41 Iter 122: loss 0.24369. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 41 Iter 122: loss 0.24369. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.05it/s]
Epoch 41 Iter 123: loss 0.24235. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 41 Iter 123: loss 0.24235. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 41 Iter 124: loss 0.22981. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 41 Iter 124: loss 0.22981. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.07it/s]
Epoch 41 Iter 125: loss 0.23768. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 41 Iter 125: loss 0.23768. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.03it/s]
Epoch 41 Iter 126: loss 0.21888. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.03it/s]
Epoch 41 Iter 126: loss 0.21888. :  56%|███████████████████████▋                  | 126/224 [01:00<00:48,  2.02it/s]
Epoch 41 Iter 127: loss 0.22248. :  56%|███████████████████████▋                  | 126/224 [01:01<00:48,  2.02it/s]
Epoch 41 Iter 127: loss 0.22248. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 41 Iter 128: loss 0.23062. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 41 Iter 128: loss 0.23062. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.05it/s]
Epoch 41 Iter 129: loss 0.24134. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 41 Iter 129: loss 0.24134. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 41 Iter 130: loss 0.21570. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 41 Iter 130: loss 0.21570. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.05it/s]
Epoch 41 Iter 131: loss 0.22192. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 131: loss 0.22192. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 132: loss 0.22530. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 132: loss 0.22530. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.22993. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.22993. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 134: loss 0.21441. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 134: loss 0.21441. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 41 Iter 135: loss 0.23960. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 135: loss 0.23960. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 136: loss 0.24876. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 41 Iter 136: loss 0.24876. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.05it/s]
Epoch 41 Iter 137: loss 0.23304. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.05it/s]
Epoch 41 Iter 137: loss 0.23304. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 41 Iter 138: loss 0.22389. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 41 Iter 138: loss 0.22389. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 41 Iter 139: loss 0.21362. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 41 Iter 139: loss 0.21362. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 41 Iter 140: loss 0.23156. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 41 Iter 140: loss 0.23156. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 41 Iter 141: loss 0.21912. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 41 Iter 141: loss 0.21912. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 41 Iter 142: loss 0.24768. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 41 Iter 142: loss 0.24768. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 41 Iter 143: loss 0.23145. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 143: loss 0.23145. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 144: loss 0.22362. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 144: loss 0.22362. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 41 Iter 145: loss 0.23468. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 41 Iter 145: loss 0.23468. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 41 Iter 146: loss 0.24151. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.08it/s]
Epoch 41 Iter 146: loss 0.24151. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 41 Iter 147: loss 0.25453. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 41 Iter 147: loss 0.25453. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 148: loss 0.24886. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 41 Iter 148: loss 0.24886. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 41 Iter 149: loss 0.25451. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 41 Iter 149: loss 0.25451. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 150: loss 0.24418. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 150: loss 0.24418. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 41 Iter 151: loss 0.21738. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 41 Iter 151: loss 0.21738. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 41 Iter 152: loss 0.22807. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 41 Iter 152: loss 0.22807. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 41 Iter 153: loss 0.21542. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 41 Iter 153: loss 0.21542. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 41 Iter 154: loss 0.25101. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 41 Iter 154: loss 0.25101. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 41 Iter 155: loss 0.24300. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 41 Iter 155: loss 0.24300. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.08it/s]
Epoch 41 Iter 156: loss 0.23018. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 41 Iter 156: loss 0.23018. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 41 Iter 157: loss 0.24809. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 41 Iter 157: loss 0.24809. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.08it/s]
Epoch 41 Iter 158: loss 0.21072. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 41 Iter 158: loss 0.21072. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 41 Iter 159: loss 0.24567. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 41 Iter 159: loss 0.24567. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.08it/s]
Epoch 41 Iter 160: loss 0.21919. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 41 Iter 160: loss 0.21919. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.23772. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.23772. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.24350. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.24350. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.09it/s]
Epoch 41 Iter 163: loss 0.24815. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.09it/s]
Epoch 41 Iter 163: loss 0.24815. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.22130. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.22130. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 41 Iter 165: loss 0.26355. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.09it/s]
Epoch 41 Iter 165: loss 0.26355. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 41 Iter 166: loss 0.22246. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 166: loss 0.22246. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 167: loss 0.22645. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 167: loss 0.22645. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 41 Iter 168: loss 0.22762. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 41 Iter 168: loss 0.22762. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.01it/s]
Epoch 41 Iter 169: loss 0.24686. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.01it/s]
Epoch 41 Iter 169: loss 0.24686. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:27,  2.02it/s]
Epoch 41 Iter 170: loss 0.22572. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:27,  2.02it/s]
Epoch 41 Iter 170: loss 0.22572. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.03it/s]
Epoch 41 Iter 171: loss 0.23497. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.03it/s]
Epoch 41 Iter 171: loss 0.23497. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 41 Iter 172: loss 0.24523. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 41 Iter 172: loss 0.24523. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 41 Iter 173: loss 0.21935. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 41 Iter 173: loss 0.21935. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.04it/s]
Epoch 41 Iter 174: loss 0.23519. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.04it/s]
Epoch 41 Iter 174: loss 0.23519. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 41 Iter 175: loss 0.23578. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 41 Iter 175: loss 0.23578. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 41 Iter 176: loss 0.23661. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 41 Iter 176: loss 0.23661. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 41 Iter 177: loss 0.24587. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 41 Iter 177: loss 0.24587. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 41 Iter 178: loss 0.23277. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 41 Iter 178: loss 0.23277. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 41 Iter 179: loss 0.22618. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 41 Iter 179: loss 0.22618. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 41 Iter 180: loss 0.23396. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 41 Iter 180: loss 0.23396. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 41 Iter 181: loss 0.21626. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 41 Iter 181: loss 0.21626. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 41 Iter 182: loss 0.23002. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 41 Iter 182: loss 0.23002. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.09it/s]
Epoch 41 Iter 183: loss 0.24364. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.09it/s]
Epoch 41 Iter 183: loss 0.24364. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 41 Iter 184: loss 0.24126. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 41 Iter 184: loss 0.24126. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 41 Iter 185: loss 0.20899. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 41 Iter 185: loss 0.20899. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 41 Iter 186: loss 0.24661. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 41 Iter 186: loss 0.24661. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.08it/s]
Epoch 41 Iter 187: loss 0.22469. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 41 Iter 187: loss 0.22469. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 41 Iter 188: loss 0.25002. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 41 Iter 188: loss 0.25002. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 41 Iter 189: loss 0.22783. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 41 Iter 189: loss 0.22783. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 41 Iter 190: loss 0.22316. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 41 Iter 190: loss 0.22316. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 41 Iter 191: loss 0.23287. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 41 Iter 191: loss 0.23287. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 41 Iter 192: loss 0.22484. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 41 Iter 192: loss 0.22484. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 41 Iter 193: loss 0.23695. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 41 Iter 193: loss 0.23695. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 41 Iter 194: loss 0.21818. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.08it/s]
Epoch 41 Iter 194: loss 0.21818. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 41 Iter 195: loss 0.21803. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 41 Iter 195: loss 0.21803. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 41 Iter 196: loss 0.23956. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 41 Iter 196: loss 0.23956. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 41 Iter 197: loss 0.22494. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 41 Iter 197: loss 0.22494. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 41 Iter 198: loss 0.23655. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 41 Iter 198: loss 0.23655. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 41 Iter 199: loss 0.23700. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 41 Iter 199: loss 0.23700. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 41 Iter 200: loss 0.23722. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 41 Iter 200: loss 0.23722. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 41 Iter 201: loss 0.23464. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 41 Iter 201: loss 0.23464. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 41 Iter 202: loss 0.21737. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 41 Iter 202: loss 0.21737. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 41 Iter 203: loss 0.25941. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 41 Iter 203: loss 0.25941. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 41 Iter 204: loss 0.22195. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 41 Iter 204: loss 0.22195. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 41 Iter 205: loss 0.23209. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 41 Iter 205: loss 0.23209. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 41 Iter 206: loss 0.23699. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 41 Iter 206: loss 0.23699. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.22301. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.22301. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 208: loss 0.22412. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 208: loss 0.22412. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 41 Iter 209: loss 0.22832. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 41 Iter 209: loss 0.22832. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 41 Iter 210: loss 0.22754. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 41 Iter 210: loss 0.22754. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 41 Iter 211: loss 0.23259. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 41 Iter 211: loss 0.23259. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 41 Iter 212: loss 0.22609. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 41 Iter 212: loss 0.22609. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.25055. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.25055. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 41 Iter 214: loss 0.23365. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 41 Iter 214: loss 0.23365. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 41 Iter 215: loss 0.24508. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 215: loss 0.24508. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.22683. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.22683. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 41 Iter 217: loss 0.23241. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 41 Iter 217: loss 0.23241. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 41 Iter 218: loss 0.22710. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 41 Iter 218: loss 0.22710. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 41 Iter 219: loss 0.23120. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 41 Iter 219: loss 0.23120. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 41 Iter 220: loss 0.23291. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 41 Iter 220: loss 0.23291. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 41 Iter 221: loss 0.24533. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 41 Iter 221: loss 0.24533. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 41 Iter 222: loss 0.22833. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 41 Iter 222: loss 0.22833. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 41 Iter 223: loss 0.24315. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 41 Iter 223: loss 0.24315. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.24541. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.24541. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 41 Iter 224: loss 0.24541. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.233
    Valid loss: 0.23402
       Valid loss recons: 0.22266
       Valid loss KL-D:   1.13597
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.23557. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.23557. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 2: loss 0.22795. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 2: loss 0.22795. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 3: loss 0.23337. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 42 Iter 3: loss 0.23337. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 42 Iter 4: loss 0.20893. :   1%|▌                                             | 3/224 [00:01<01:46,  2.07it/s]
Epoch 42 Iter 4: loss 0.20893. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 42 Iter 5: loss 0.21454. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 42 Iter 5: loss 0.21454. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.21279. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.21279. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 42 Iter 7: loss 0.24081. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 42 Iter 7: loss 0.24081. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.08it/s]
Epoch 42 Iter 8: loss 0.24096. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.08it/s]
Epoch 42 Iter 8: loss 0.24096. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 42 Iter 9: loss 0.23696. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 42 Iter 9: loss 0.23696. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 10: loss 0.23923. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 10: loss 0.23923. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 11: loss 0.25629. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 42 Iter 11: loss 0.25629. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.07it/s]
Epoch 42 Iter 12: loss 0.23809. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.07it/s]
Epoch 42 Iter 12: loss 0.23809. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.08it/s]
Epoch 42 Iter 13: loss 0.23754. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.08it/s]
Epoch 42 Iter 13: loss 0.23754. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 42 Iter 14: loss 0.23896. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 42 Iter 14: loss 0.23896. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.06it/s]
Epoch 42 Iter 15: loss 0.24151. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 15: loss 0.24151. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.20583. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.20583. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 17: loss 0.22574. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 42 Iter 17: loss 0.22574. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.24182. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.24182. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 42 Iter 19: loss 0.21824. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 42 Iter 19: loss 0.21824. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 42 Iter 20: loss 0.20918. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 42 Iter 20: loss 0.20918. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 42 Iter 21: loss 0.25580. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 42 Iter 21: loss 0.25580. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 42 Iter 22: loss 0.21754. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 42 Iter 22: loss 0.21754. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 42 Iter 23: loss 0.23668. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 42 Iter 23: loss 0.23668. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 42 Iter 24: loss 0.24569. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 42 Iter 24: loss 0.24569. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 42 Iter 25: loss 0.22147. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 25: loss 0.22147. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 26: loss 0.23401. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 26: loss 0.23401. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 42 Iter 27: loss 0.24274. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 42 Iter 27: loss 0.24274. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 42 Iter 28: loss 0.24766. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 42 Iter 28: loss 0.24766. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 42 Iter 29: loss 0.22260. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 29: loss 0.22260. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 30: loss 0.21420. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.05it/s]
Epoch 42 Iter 30: loss 0.21420. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.21757. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.21757. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 32: loss 0.23548. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 32: loss 0.23548. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.05it/s]
Epoch 42 Iter 33: loss 0.24192. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.05it/s]
Epoch 42 Iter 33: loss 0.24192. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.06it/s]
Epoch 42 Iter 34: loss 0.23690. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 42 Iter 34: loss 0.23690. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 42 Iter 35: loss 0.22307. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 42 Iter 35: loss 0.22307. :  16%|██████▉                                     | 35/224 [00:16<01:30,  2.08it/s]
Epoch 42 Iter 36: loss 0.23290. :  16%|██████▉                                     | 35/224 [00:17<01:30,  2.08it/s]
Epoch 42 Iter 36: loss 0.23290. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 42 Iter 37: loss 0.25973. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 42 Iter 37: loss 0.25973. :  17%|███████▎                                    | 37/224 [00:17<01:29,  2.08it/s]
Epoch 42 Iter 38: loss 0.24066. :  17%|███████▎                                    | 37/224 [00:18<01:29,  2.08it/s]
Epoch 42 Iter 38: loss 0.24066. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 42 Iter 39: loss 0.24538. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 42 Iter 39: loss 0.24538. :  17%|███████▋                                    | 39/224 [00:18<01:28,  2.08it/s]
Epoch 42 Iter 40: loss 0.23280. :  17%|███████▋                                    | 39/224 [00:19<01:28,  2.08it/s]
Epoch 42 Iter 40: loss 0.23280. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 42 Iter 41: loss 0.24721. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 42 Iter 41: loss 0.24721. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 42 Iter 42: loss 0.23095. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 42 Iter 42: loss 0.23095. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 42 Iter 43: loss 0.23784. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 42 Iter 43: loss 0.23784. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 42 Iter 44: loss 0.23879. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 42 Iter 44: loss 0.23879. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 42 Iter 45: loss 0.23834. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 42 Iter 45: loss 0.23834. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.06it/s]
Epoch 42 Iter 46: loss 0.22818. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.06it/s]
Epoch 42 Iter 46: loss 0.22818. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 42 Iter 47: loss 0.21972. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 42 Iter 47: loss 0.21972. :  21%|█████████▏                                  | 47/224 [00:22<01:26,  2.05it/s]
Epoch 42 Iter 48: loss 0.22168. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.05it/s]
Epoch 42 Iter 48: loss 0.22168. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 42 Iter 49: loss 0.23280. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 42 Iter 49: loss 0.23280. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 42 Iter 50: loss 0.24135. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 42 Iter 50: loss 0.24135. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 42 Iter 51: loss 0.20145. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 42 Iter 51: loss 0.20145. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 42 Iter 52: loss 0.22381. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 42 Iter 52: loss 0.22381. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 42 Iter 53: loss 0.23103. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 42 Iter 53: loss 0.23103. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.05it/s]
Epoch 42 Iter 54: loss 0.22603. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.05it/s]
Epoch 42 Iter 54: loss 0.22603. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 42 Iter 55: loss 0.22636. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 42 Iter 55: loss 0.22636. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.06it/s]
Epoch 42 Iter 56: loss 0.24179. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.06it/s]
Epoch 42 Iter 56: loss 0.24179. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 42 Iter 57: loss 0.23946. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 42 Iter 57: loss 0.23946. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.08it/s]
Epoch 42 Iter 58: loss 0.24392. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.08it/s]
Epoch 42 Iter 58: loss 0.24392. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 42 Iter 59: loss 0.21748. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 42 Iter 59: loss 0.21748. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 42 Iter 60: loss 0.24305. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 42 Iter 60: loss 0.24305. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 42 Iter 61: loss 0.19986. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 42 Iter 61: loss 0.19986. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 42 Iter 62: loss 0.24788. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 42 Iter 62: loss 0.24788. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 63: loss 0.22135. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 63: loss 0.22135. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.04it/s]
Epoch 42 Iter 64: loss 0.24461. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.04it/s]
Epoch 42 Iter 64: loss 0.24461. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 42 Iter 65: loss 0.21594. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.05it/s]
Epoch 42 Iter 65: loss 0.21594. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.05it/s]
Epoch 42 Iter 66: loss 0.22833. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.05it/s]
Epoch 42 Iter 66: loss 0.22833. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 42 Iter 67: loss 0.24181. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 42 Iter 67: loss 0.24181. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 42 Iter 68: loss 0.21746. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 42 Iter 68: loss 0.21746. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.08it/s]
Epoch 42 Iter 69: loss 0.22758. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.08it/s]
Epoch 42 Iter 69: loss 0.22758. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 42 Iter 70: loss 0.24218. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 42 Iter 70: loss 0.24218. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 42 Iter 71: loss 0.24878. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 42 Iter 71: loss 0.24878. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 42 Iter 72: loss 0.21643. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 42 Iter 72: loss 0.21643. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 42 Iter 73: loss 0.22444. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 42 Iter 73: loss 0.22444. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 42 Iter 74: loss 0.22878. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.08it/s]
Epoch 42 Iter 74: loss 0.22878. :  33%|██████████████▌                             | 74/224 [00:35<01:11,  2.09it/s]
Epoch 42 Iter 75: loss 0.23404. :  33%|██████████████▌                             | 74/224 [00:36<01:11,  2.09it/s]
Epoch 42 Iter 75: loss 0.23404. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.09it/s]
Epoch 42 Iter 76: loss 0.21781. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.09it/s]
Epoch 42 Iter 76: loss 0.21781. :  34%|██████████████▉                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 42 Iter 77: loss 0.22059. :  34%|██████████████▉                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 42 Iter 77: loss 0.22059. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 42 Iter 78: loss 0.26214. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 42 Iter 78: loss 0.26214. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 42 Iter 79: loss 0.23245. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 42 Iter 79: loss 0.23245. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 42 Iter 80: loss 0.25216. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 42 Iter 80: loss 0.25216. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 42 Iter 81: loss 0.22450. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 42 Iter 81: loss 0.22450. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 42 Iter 82: loss 0.24960. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 42 Iter 82: loss 0.24960. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 42 Iter 83: loss 0.24487. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 42 Iter 83: loss 0.24487. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 42 Iter 84: loss 0.22871. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 42 Iter 84: loss 0.22871. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 42 Iter 85: loss 0.24145. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 42 Iter 85: loss 0.24145. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 42 Iter 86: loss 0.23524. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 42 Iter 86: loss 0.23524. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 42 Iter 87: loss 0.22722. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 42 Iter 87: loss 0.22722. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 42 Iter 88: loss 0.24339. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 42 Iter 88: loss 0.24339. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.06it/s]
Epoch 42 Iter 89: loss 0.23539. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 89: loss 0.23539. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 90: loss 0.24210. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 90: loss 0.24210. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 42 Iter 91: loss 0.23072. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 42 Iter 91: loss 0.23072. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 42 Iter 92: loss 0.23586. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 42 Iter 92: loss 0.23586. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 42 Iter 93: loss 0.21173. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 42 Iter 93: loss 0.21173. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.08it/s]
Epoch 42 Iter 94: loss 0.23579. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.08it/s]
Epoch 42 Iter 94: loss 0.23579. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 42 Iter 95: loss 0.24890. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 42 Iter 95: loss 0.24890. :  42%|██████████████████▋                         | 95/224 [00:45<01:01,  2.11it/s]
Epoch 42 Iter 96: loss 0.22576. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.11it/s]
Epoch 42 Iter 96: loss 0.22576. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 42 Iter 97: loss 0.22700. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 42 Iter 97: loss 0.22700. :  43%|███████████████████                         | 97/224 [00:46<01:00,  2.09it/s]
Epoch 42 Iter 98: loss 0.23402. :  43%|███████████████████                         | 97/224 [00:47<01:00,  2.09it/s]
Epoch 42 Iter 98: loss 0.23402. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.09it/s]
Epoch 42 Iter 99: loss 0.22426. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.09it/s]
Epoch 42 Iter 99: loss 0.22426. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.08it/s]
Epoch 42 Iter 100: loss 0.24675. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 42 Iter 100: loss 0.24675. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 42 Iter 101: loss 0.25125. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 42 Iter 101: loss 0.25125. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 42 Iter 102: loss 0.22849. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 42 Iter 102: loss 0.22849. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 42 Iter 103: loss 0.21660. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 42 Iter 103: loss 0.21660. :  46%|███████████████████▎                      | 103/224 [00:49<00:57,  2.09it/s]
Epoch 42 Iter 104: loss 0.26328. :  46%|███████████████████▎                      | 103/224 [00:50<00:57,  2.09it/s]
Epoch 42 Iter 104: loss 0.26328. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 42 Iter 105: loss 0.22409. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 42 Iter 105: loss 0.22409. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 42 Iter 106: loss 0.22209. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 42 Iter 106: loss 0.22209. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 42 Iter 107: loss 0.24182. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 42 Iter 107: loss 0.24182. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 42 Iter 108: loss 0.23326. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 108: loss 0.23326. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 109: loss 0.22096. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 109: loss 0.22096. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.26715. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.26715. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 42 Iter 111: loss 0.22355. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 42 Iter 111: loss 0.22355. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.23589. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.23589. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.22967. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.22967. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.23778. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.23778. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 42 Iter 115: loss 0.25486. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.07it/s]
Epoch 42 Iter 115: loss 0.25486. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 42 Iter 116: loss 0.22803. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 42 Iter 116: loss 0.22803. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 42 Iter 117: loss 0.23110. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 42 Iter 117: loss 0.23110. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.24264. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.24264. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.23228. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.23228. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 42 Iter 120: loss 0.24715. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 120: loss 0.24715. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.24045. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.24045. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.23374. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.23374. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 123: loss 0.24363. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 123: loss 0.24363. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 42 Iter 124: loss 0.21540. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 42 Iter 124: loss 0.21540. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.07it/s]
Epoch 42 Iter 125: loss 0.22886. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 42 Iter 125: loss 0.22886. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 126: loss 0.23416. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 126: loss 0.23416. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.24070. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.24070. :  57%|███████████████████████▊                  | 127/224 [01:01<00:48,  2.01it/s]
Epoch 42 Iter 128: loss 0.22241. :  57%|███████████████████████▊                  | 127/224 [01:01<00:48,  2.01it/s]
Epoch 42 Iter 128: loss 0.22241. :  57%|████████████████████████                  | 128/224 [01:01<00:47,  2.03it/s]
Epoch 42 Iter 129: loss 0.22538. :  57%|████████████████████████                  | 128/224 [01:02<00:47,  2.03it/s]
Epoch 42 Iter 129: loss 0.22538. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.23293. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.23293. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 42 Iter 131: loss 0.21980. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 42 Iter 131: loss 0.21980. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 42 Iter 132: loss 0.24628. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 42 Iter 132: loss 0.24628. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 42 Iter 133: loss 0.22643. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 42 Iter 133: loss 0.22643. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.10it/s]
Epoch 42 Iter 134: loss 0.22900. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.10it/s]
Epoch 42 Iter 134: loss 0.22900. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.09it/s]
Epoch 42 Iter 135: loss 0.23864. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.09it/s]
Epoch 42 Iter 135: loss 0.23864. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 42 Iter 136: loss 0.22367. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 42 Iter 136: loss 0.22367. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.08it/s]
Epoch 42 Iter 137: loss 0.24160. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.08it/s]
Epoch 42 Iter 137: loss 0.24160. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 42 Iter 138: loss 0.22740. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 42 Iter 138: loss 0.22740. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 42 Iter 139: loss 0.22765. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 42 Iter 139: loss 0.22765. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 42 Iter 140: loss 0.24533. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 42 Iter 140: loss 0.24533. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.08it/s]
Epoch 42 Iter 141: loss 0.20873. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.08it/s]
Epoch 42 Iter 141: loss 0.20873. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 142: loss 0.22898. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 142: loss 0.22898. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 42 Iter 143: loss 0.22004. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 42 Iter 143: loss 0.22004. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 42 Iter 144: loss 0.22641. :  64%|██████████████████████████▊               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 42 Iter 144: loss 0.22641. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 42 Iter 145: loss 0.20891. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 145: loss 0.20891. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 146: loss 0.22973. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 146: loss 0.22973. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.24297. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.24297. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 148: loss 0.23114. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 148: loss 0.23114. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 42 Iter 149: loss 0.22799. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 149: loss 0.22799. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 150: loss 0.24803. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 150: loss 0.24803. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.23510. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.23510. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 42 Iter 152: loss 0.24717. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 42 Iter 152: loss 0.24717. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 42 Iter 153: loss 0.23823. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 42 Iter 153: loss 0.23823. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 42 Iter 154: loss 0.21460. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 42 Iter 154: loss 0.21460. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 42 Iter 155: loss 0.22731. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 42 Iter 155: loss 0.22731. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 42 Iter 156: loss 0.24715. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 42 Iter 156: loss 0.24715. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.06it/s]
Epoch 42 Iter 157: loss 0.21708. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.06it/s]
Epoch 42 Iter 157: loss 0.21708. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 42 Iter 158: loss 0.21265. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 42 Iter 158: loss 0.21265. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 42 Iter 159: loss 0.24767. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 42 Iter 159: loss 0.24767. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 42 Iter 160: loss 0.23881. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 42 Iter 160: loss 0.23881. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 42 Iter 161: loss 0.24943. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 42 Iter 161: loss 0.24943. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.08it/s]
Epoch 42 Iter 162: loss 0.21920. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 42 Iter 162: loss 0.21920. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 42 Iter 163: loss 0.22273. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 42 Iter 163: loss 0.22273. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 42 Iter 164: loss 0.22327. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 42 Iter 164: loss 0.22327. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 42 Iter 165: loss 0.24389. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 42 Iter 165: loss 0.24389. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 42 Iter 166: loss 0.25604. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 42 Iter 166: loss 0.25604. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 42 Iter 167: loss 0.24758. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 42 Iter 167: loss 0.24758. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.09it/s]
Epoch 42 Iter 168: loss 0.24541. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.09it/s]
Epoch 42 Iter 168: loss 0.24541. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 42 Iter 169: loss 0.24138. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 42 Iter 169: loss 0.24138. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.09it/s]
Epoch 42 Iter 170: loss 0.22345. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.09it/s]
Epoch 42 Iter 170: loss 0.22345. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 42 Iter 171: loss 0.22120. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 42 Iter 171: loss 0.22120. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.09it/s]
Epoch 42 Iter 172: loss 0.23044. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.09it/s]
Epoch 42 Iter 172: loss 0.23044. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.08it/s]
Epoch 42 Iter 173: loss 0.23797. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.08it/s]
Epoch 42 Iter 173: loss 0.23797. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 42 Iter 174: loss 0.23619. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 42 Iter 174: loss 0.23619. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 42 Iter 175: loss 0.22461. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 42 Iter 175: loss 0.22461. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.23741. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.23741. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 177: loss 0.23032. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 177: loss 0.23032. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 42 Iter 178: loss 0.25020. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 42 Iter 178: loss 0.25020. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 42 Iter 179: loss 0.24543. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 42 Iter 179: loss 0.24543. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.23920. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.23920. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 42 Iter 181: loss 0.24135. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 42 Iter 181: loss 0.24135. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.24960. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.24960. :  81%|██████████████████████████████████▏       | 182/224 [01:27<00:20,  2.08it/s]
Epoch 42 Iter 183: loss 0.24382. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 42 Iter 183: loss 0.24382. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 42 Iter 184: loss 0.22020. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 42 Iter 184: loss 0.22020. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.09it/s]
Epoch 42 Iter 185: loss 0.22941. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 42 Iter 185: loss 0.22941. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 42 Iter 186: loss 0.24924. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 42 Iter 186: loss 0.24924. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.08it/s]
Epoch 42 Iter 187: loss 0.22591. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 42 Iter 187: loss 0.22591. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 42 Iter 188: loss 0.25243. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 42 Iter 188: loss 0.25243. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.07it/s]
Epoch 42 Iter 189: loss 0.23393. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 42 Iter 189: loss 0.23393. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 42 Iter 190: loss 0.25224. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 42 Iter 190: loss 0.25224. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 42 Iter 191: loss 0.24072. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 42 Iter 191: loss 0.24072. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 42 Iter 192: loss 0.22207. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 42 Iter 192: loss 0.22207. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 42 Iter 193: loss 0.21808. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 193: loss 0.21808. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 194: loss 0.22342. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 42 Iter 194: loss 0.22342. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.05it/s]
Epoch 42 Iter 195: loss 0.24662. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 42 Iter 195: loss 0.24662. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 42 Iter 196: loss 0.24849. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 42 Iter 196: loss 0.24849. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 42 Iter 197: loss 0.22818. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 42 Iter 197: loss 0.22818. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 42 Iter 198: loss 0.23341. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 42 Iter 198: loss 0.23341. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 42 Iter 199: loss 0.23476. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 42 Iter 199: loss 0.23476. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 42 Iter 200: loss 0.24153. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 42 Iter 200: loss 0.24153. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 42 Iter 201: loss 0.22788. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 201: loss 0.22788. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 202: loss 0.21443. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 202: loss 0.21443. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 42 Iter 203: loss 0.21703. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 42 Iter 203: loss 0.21703. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 42 Iter 204: loss 0.22934. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 42 Iter 204: loss 0.22934. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.23504. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.23504. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 42 Iter 206: loss 0.22788. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 42 Iter 206: loss 0.22788. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.05it/s]
Epoch 42 Iter 207: loss 0.23907. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 42 Iter 207: loss 0.23907. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 42 Iter 208: loss 0.23291. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 42 Iter 208: loss 0.23291. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 42 Iter 209: loss 0.24014. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 42 Iter 209: loss 0.24014. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 42 Iter 210: loss 0.23895. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 42 Iter 210: loss 0.23895. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 42 Iter 211: loss 0.24671. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 42 Iter 211: loss 0.24671. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 42 Iter 212: loss 0.23211. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.03it/s]
Epoch 42 Iter 212: loss 0.23211. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 42 Iter 213: loss 0.22766. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 42 Iter 213: loss 0.22766. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 42 Iter 214: loss 0.23776. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 42 Iter 214: loss 0.23776. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 42 Iter 215: loss 0.24008. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 42 Iter 215: loss 0.24008. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.05it/s]
Epoch 42 Iter 216: loss 0.22680. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 42 Iter 216: loss 0.22680. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 42 Iter 217: loss 0.22936. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 42 Iter 217: loss 0.22936. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.05it/s]
Epoch 42 Iter 218: loss 0.21903. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 42 Iter 218: loss 0.21903. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 42 Iter 219: loss 0.23212. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 42 Iter 219: loss 0.23212. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.05it/s]
Epoch 42 Iter 220: loss 0.23014. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 42 Iter 220: loss 0.23014. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.04it/s]
Epoch 42 Iter 221: loss 0.25343. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.04it/s]
Epoch 42 Iter 221: loss 0.25343. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 42 Iter 222: loss 0.22935. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 42 Iter 222: loss 0.22935. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 42 Iter 223: loss 0.21698. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 42 Iter 223: loss 0.21698. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 42 Iter 224: loss 0.23251. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 42 Iter 224: loss 0.23251. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.04it/s]
Epoch 42 Iter 224: loss 0.23251. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.22275. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.22275. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 43 Iter 2: loss 0.22239. :   0%|▏                                             | 1/224 [00:00<01:47,  2.08it/s]
Epoch 43 Iter 2: loss 0.22239. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 43 Iter 3: loss 0.22034. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 43 Iter 3: loss 0.22034. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 43 Iter 4: loss 0.23669. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 43 Iter 4: loss 0.23669. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 43 Iter 5: loss 0.23565. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 43 Iter 5: loss 0.23565. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 43 Iter 6: loss 0.22618. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 43 Iter 6: loss 0.22618. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 43 Iter 7: loss 0.23015. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 43 Iter 7: loss 0.23015. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 43 Iter 8: loss 0.21735. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 43 Iter 8: loss 0.21735. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 43 Iter 9: loss 0.23696. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 43 Iter 9: loss 0.23696. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 43 Iter 10: loss 0.23581. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 43 Iter 10: loss 0.23581. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.06it/s]
Epoch 43 Iter 11: loss 0.22489. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.06it/s]
Epoch 43 Iter 11: loss 0.22489. :   5%|██▏                                         | 11/224 [00:05<01:46,  2.01it/s]
Epoch 43 Iter 12: loss 0.20591. :   5%|██▏                                         | 11/224 [00:05<01:46,  2.01it/s]
Epoch 43 Iter 12: loss 0.20591. :   5%|██▎                                         | 12/224 [00:05<01:45,  2.02it/s]
Epoch 43 Iter 13: loss 0.25363. :   5%|██▎                                         | 12/224 [00:06<01:45,  2.02it/s]
Epoch 43 Iter 13: loss 0.25363. :   6%|██▌                                         | 13/224 [00:06<01:44,  2.03it/s]
Epoch 43 Iter 14: loss 0.22295. :   6%|██▌                                         | 13/224 [00:06<01:44,  2.03it/s]
Epoch 43 Iter 14: loss 0.22295. :   6%|██▊                                         | 14/224 [00:06<01:43,  2.04it/s]
Epoch 43 Iter 15: loss 0.24231. :   6%|██▊                                         | 14/224 [00:07<01:43,  2.04it/s]
Epoch 43 Iter 15: loss 0.24231. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 43 Iter 16: loss 0.21272. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.05it/s]
Epoch 43 Iter 16: loss 0.21272. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.05it/s]
Epoch 43 Iter 17: loss 0.24024. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.05it/s]
Epoch 43 Iter 17: loss 0.24024. :   8%|███▎                                        | 17/224 [00:08<01:41,  2.04it/s]
Epoch 43 Iter 18: loss 0.24128. :   8%|███▎                                        | 17/224 [00:08<01:41,  2.04it/s]
Epoch 43 Iter 18: loss 0.24128. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.06it/s]
Epoch 43 Iter 19: loss 0.22865. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.06it/s]
Epoch 43 Iter 19: loss 0.22865. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 43 Iter 20: loss 0.24036. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 43 Iter 20: loss 0.24036. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.08it/s]
Epoch 43 Iter 21: loss 0.23737. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.08it/s]
Epoch 43 Iter 21: loss 0.23737. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 43 Iter 22: loss 0.23038. :   9%|████▏                                       | 21/224 [00:10<01:37,  2.08it/s]
Epoch 43 Iter 22: loss 0.23038. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.08it/s]
Epoch 43 Iter 23: loss 0.24949. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.08it/s]
Epoch 43 Iter 23: loss 0.24949. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 43 Iter 24: loss 0.22989. :  10%|████▌                                       | 23/224 [00:11<01:36,  2.08it/s]
Epoch 43 Iter 24: loss 0.22989. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.08it/s]
Epoch 43 Iter 25: loss 0.24308. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.08it/s]
Epoch 43 Iter 25: loss 0.24308. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 43 Iter 26: loss 0.25560. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 43 Iter 26: loss 0.25560. :  12%|█████                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.22278. :  12%|█████                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.22278. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 28: loss 0.21895. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 28: loss 0.21895. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.23863. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.23863. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 43 Iter 30: loss 0.22677. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 43 Iter 30: loss 0.22677. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 43 Iter 31: loss 0.22540. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 43 Iter 31: loss 0.22540. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 43 Iter 32: loss 0.24144. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 43 Iter 32: loss 0.24144. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 43 Iter 33: loss 0.22939. :  14%|██████▎                                     | 32/224 [00:16<01:32,  2.07it/s]
Epoch 43 Iter 33: loss 0.22939. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 43 Iter 34: loss 0.25001. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.06it/s]
Epoch 43 Iter 34: loss 0.25001. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 43 Iter 35: loss 0.24783. :  15%|██████▋                                     | 34/224 [00:17<01:31,  2.07it/s]
Epoch 43 Iter 35: loss 0.24783. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.08it/s]
Epoch 43 Iter 36: loss 0.21500. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.08it/s]
Epoch 43 Iter 36: loss 0.21500. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 43 Iter 37: loss 0.24139. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 43 Iter 37: loss 0.24139. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 43 Iter 38: loss 0.22999. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 43 Iter 38: loss 0.22999. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 43 Iter 39: loss 0.22241. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 43 Iter 39: loss 0.22241. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.07it/s]
Epoch 43 Iter 40: loss 0.23705. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.07it/s]
Epoch 43 Iter 40: loss 0.23705. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 43 Iter 41: loss 0.24030. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 43 Iter 41: loss 0.24030. :  18%|████████                                    | 41/224 [00:19<01:27,  2.08it/s]
Epoch 43 Iter 42: loss 0.22439. :  18%|████████                                    | 41/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 42: loss 0.22439. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.09it/s]
Epoch 43 Iter 43: loss 0.23546. :  19%|████████▎                                   | 42/224 [00:20<01:27,  2.09it/s]
Epoch 43 Iter 43: loss 0.23546. :  19%|████████▍                                   | 43/224 [00:20<01:26,  2.09it/s]
Epoch 43 Iter 44: loss 0.20759. :  19%|████████▍                                   | 43/224 [00:21<01:26,  2.09it/s]
Epoch 43 Iter 44: loss 0.20759. :  20%|████████▋                                   | 44/224 [00:21<01:25,  2.10it/s]
Epoch 43 Iter 45: loss 0.25136. :  20%|████████▋                                   | 44/224 [00:21<01:25,  2.10it/s]
Epoch 43 Iter 45: loss 0.25136. :  20%|████████▊                                   | 45/224 [00:21<01:25,  2.10it/s]
Epoch 43 Iter 46: loss 0.22858. :  20%|████████▊                                   | 45/224 [00:22<01:25,  2.10it/s]
Epoch 43 Iter 46: loss 0.22858. :  21%|█████████                                   | 46/224 [00:22<01:24,  2.10it/s]
Epoch 43 Iter 47: loss 0.22737. :  21%|█████████                                   | 46/224 [00:22<01:24,  2.10it/s]
Epoch 43 Iter 47: loss 0.22737. :  21%|█████████▏                                  | 47/224 [00:22<01:24,  2.09it/s]
Epoch 43 Iter 48: loss 0.22475. :  21%|█████████▏                                  | 47/224 [00:23<01:24,  2.09it/s]
Epoch 43 Iter 48: loss 0.22475. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 43 Iter 49: loss 0.24054. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 43 Iter 49: loss 0.24054. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.08it/s]
Epoch 43 Iter 50: loss 0.23724. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.08it/s]
Epoch 43 Iter 50: loss 0.23724. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 43 Iter 51: loss 0.27223. :  22%|█████████▊                                  | 50/224 [00:24<01:23,  2.08it/s]
Epoch 43 Iter 51: loss 0.27223. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 43 Iter 52: loss 0.22465. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 43 Iter 52: loss 0.22465. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 43 Iter 53: loss 0.22784. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 43 Iter 53: loss 0.22784. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.24313. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.24313. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 43 Iter 55: loss 0.22180. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 43 Iter 55: loss 0.22180. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.06it/s]
Epoch 43 Iter 56: loss 0.22765. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.06it/s]
Epoch 43 Iter 56: loss 0.22765. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 43 Iter 57: loss 0.23007. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 43 Iter 57: loss 0.23007. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 43 Iter 58: loss 0.23882. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 43 Iter 58: loss 0.23882. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 43 Iter 59: loss 0.23546. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 43 Iter 59: loss 0.23546. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.22784. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.22784. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.25311. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.25311. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 43 Iter 62: loss 0.23566. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 43 Iter 62: loss 0.23566. :  28%|████████████▏                               | 62/224 [00:30<01:19,  2.05it/s]
Epoch 43 Iter 63: loss 0.23808. :  28%|████████████▏                               | 62/224 [00:30<01:19,  2.05it/s]
Epoch 43 Iter 63: loss 0.23808. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.04it/s]
Epoch 43 Iter 64: loss 0.23297. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 64: loss 0.23297. :  29%|████████████▌                               | 64/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 65: loss 0.23028. :  29%|████████████▌                               | 64/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 65: loss 0.23028. :  29%|████████████▊                               | 65/224 [00:31<01:18,  2.04it/s]
Epoch 43 Iter 66: loss 0.22877. :  29%|████████████▊                               | 65/224 [00:32<01:18,  2.04it/s]
Epoch 43 Iter 66: loss 0.22877. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 43 Iter 67: loss 0.23895. :  29%|████████████▉                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 43 Iter 67: loss 0.23895. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 43 Iter 68: loss 0.23002. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.05it/s]
Epoch 43 Iter 68: loss 0.23002. :  30%|█████████████▎                              | 68/224 [00:32<01:16,  2.04it/s]
Epoch 43 Iter 69: loss 0.23070. :  30%|█████████████▎                              | 68/224 [00:33<01:16,  2.04it/s]
Epoch 43 Iter 69: loss 0.23070. :  31%|█████████████▌                              | 69/224 [00:33<01:16,  2.04it/s]
Epoch 43 Iter 70: loss 0.23328. :  31%|█████████████▌                              | 69/224 [00:33<01:16,  2.04it/s]
Epoch 43 Iter 70: loss 0.23328. :  31%|█████████████▊                              | 70/224 [00:33<01:15,  2.05it/s]
Epoch 43 Iter 71: loss 0.25354. :  31%|█████████████▊                              | 70/224 [00:34<01:15,  2.05it/s]
Epoch 43 Iter 71: loss 0.25354. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 43 Iter 72: loss 0.26346. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 43 Iter 72: loss 0.26346. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 43 Iter 73: loss 0.24409. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 43 Iter 73: loss 0.24409. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.22876. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.22876. :  33%|██████████████▌                             | 74/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 75: loss 0.21280. :  33%|██████████████▌                             | 74/224 [00:36<01:13,  2.05it/s]
Epoch 43 Iter 75: loss 0.21280. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.23572. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.23572. :  34%|██████████████▉                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.25251. :  34%|██████████████▉                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.25251. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.22758. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.22758. :  35%|███████████████▎                            | 78/224 [00:37<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.26210. :  35%|███████████████▎                            | 78/224 [00:38<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.26210. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 43 Iter 80: loss 0.22308. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 43 Iter 80: loss 0.22308. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 43 Iter 81: loss 0.22555. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 43 Iter 81: loss 0.22555. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 43 Iter 82: loss 0.22277. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 43 Iter 82: loss 0.22277. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 43 Iter 83: loss 0.24251. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 43 Iter 83: loss 0.24251. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 84: loss 0.22465. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 84: loss 0.22465. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 43 Iter 85: loss 0.21963. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 43 Iter 85: loss 0.21963. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 43 Iter 86: loss 0.24682. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 43 Iter 86: loss 0.24682. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 43 Iter 87: loss 0.22576. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 43 Iter 87: loss 0.22576. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 43 Iter 88: loss 0.24795. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 43 Iter 88: loss 0.24795. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 43 Iter 89: loss 0.25036. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 43 Iter 89: loss 0.25036. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 43 Iter 90: loss 0.23449. :  40%|█████████████████▍                          | 89/224 [00:43<01:04,  2.08it/s]
Epoch 43 Iter 90: loss 0.23449. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.08it/s]
Epoch 43 Iter 91: loss 0.22273. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.08it/s]
Epoch 43 Iter 91: loss 0.22273. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.23003. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.23003. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 43 Iter 93: loss 0.21103. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.08it/s]
Epoch 43 Iter 93: loss 0.21103. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.08it/s]
Epoch 43 Iter 94: loss 0.25081. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.08it/s]
Epoch 43 Iter 94: loss 0.25081. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 43 Iter 95: loss 0.21969. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.07it/s]
Epoch 43 Iter 95: loss 0.21969. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 96: loss 0.22842. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 96: loss 0.22842. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 97: loss 0.23024. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 43 Iter 97: loss 0.23024. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 43 Iter 98: loss 0.23077. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 43 Iter 98: loss 0.23077. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 43 Iter 99: loss 0.24714. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 43 Iter 99: loss 0.24714. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 43 Iter 100: loss 0.24608. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 43 Iter 100: loss 0.24608. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 43 Iter 101: loss 0.25617. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.07it/s]
Epoch 43 Iter 101: loss 0.25617. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 43 Iter 102: loss 0.24006. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 43 Iter 102: loss 0.24006. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 43 Iter 103: loss 0.23693. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 43 Iter 103: loss 0.23693. :  46%|███████████████████▎                      | 103/224 [00:49<00:57,  2.09it/s]
Epoch 43 Iter 104: loss 0.22670. :  46%|███████████████████▎                      | 103/224 [00:50<00:57,  2.09it/s]
Epoch 43 Iter 104: loss 0.22670. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 43 Iter 105: loss 0.23114. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.08it/s]
Epoch 43 Iter 105: loss 0.23114. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 43 Iter 106: loss 0.23340. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 43 Iter 106: loss 0.23340. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 43 Iter 107: loss 0.23929. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 43 Iter 107: loss 0.23929. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.09it/s]
Epoch 43 Iter 108: loss 0.24848. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 43 Iter 108: loss 0.24848. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.09it/s]
Epoch 43 Iter 109: loss 0.22298. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.09it/s]
Epoch 43 Iter 109: loss 0.22298. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.25094. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.25094. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 111: loss 0.23140. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 111: loss 0.23140. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 43 Iter 112: loss 0.23661. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 43 Iter 112: loss 0.23661. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 43 Iter 113: loss 0.22651. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 43 Iter 113: loss 0.22651. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.06it/s]
Epoch 43 Iter 114: loss 0.23174. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.06it/s]
Epoch 43 Iter 114: loss 0.23174. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 115: loss 0.21234. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 115: loss 0.21234. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 116: loss 0.23341. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.05it/s]
Epoch 43 Iter 116: loss 0.23341. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 43 Iter 117: loss 0.22617. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 43 Iter 117: loss 0.22617. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 43 Iter 118: loss 0.23825. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 43 Iter 118: loss 0.23825. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 43 Iter 119: loss 0.25320. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 43 Iter 119: loss 0.25320. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 43 Iter 120: loss 0.21133. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 43 Iter 120: loss 0.21133. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 43 Iter 121: loss 0.22464. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 43 Iter 121: loss 0.22464. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 43 Iter 122: loss 0.21713. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 122: loss 0.21713. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 123: loss 0.23223. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 123: loss 0.23223. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 43 Iter 124: loss 0.23380. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 43 Iter 124: loss 0.23380. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 43 Iter 125: loss 0.23067. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 43 Iter 125: loss 0.23067. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.08it/s]
Epoch 43 Iter 126: loss 0.22929. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.08it/s]
Epoch 43 Iter 126: loss 0.22929. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 127: loss 0.24027. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 127: loss 0.24027. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 43 Iter 128: loss 0.23572. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 43 Iter 128: loss 0.23572. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.22833. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.22833. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 130: loss 0.22797. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 130: loss 0.22797. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 131: loss 0.22074. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 43 Iter 131: loss 0.22074. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 43 Iter 132: loss 0.23355. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 43 Iter 132: loss 0.23355. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.25040. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.25040. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 43 Iter 134: loss 0.20930. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 43 Iter 134: loss 0.20930. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 43 Iter 135: loss 0.22105. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 43 Iter 135: loss 0.22105. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 43 Iter 136: loss 0.24651. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 43 Iter 136: loss 0.24651. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 43 Iter 137: loss 0.23478. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 43 Iter 137: loss 0.23478. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 43 Iter 138: loss 0.23995. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 43 Iter 138: loss 0.23995. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.09it/s]
Epoch 43 Iter 139: loss 0.21462. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.09it/s]
Epoch 43 Iter 139: loss 0.21462. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 43 Iter 140: loss 0.20477. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 43 Iter 140: loss 0.20477. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 43 Iter 141: loss 0.22476. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 43 Iter 141: loss 0.22476. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 142: loss 0.20608. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 142: loss 0.20608. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 43 Iter 143: loss 0.25165. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 143: loss 0.25165. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.21809. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.21809. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.24961. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.24961. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.05it/s]
Epoch 43 Iter 146: loss 0.22870. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.05it/s]
Epoch 43 Iter 146: loss 0.22870. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.20573. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.20573. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.24120. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.24120. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 43 Iter 149: loss 0.22072. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 43 Iter 149: loss 0.22072. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 150: loss 0.22859. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 150: loss 0.22859. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 43 Iter 151: loss 0.25069. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 43 Iter 151: loss 0.25069. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 43 Iter 152: loss 0.21495. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 43 Iter 152: loss 0.21495. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 43 Iter 153: loss 0.23172. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 153: loss 0.23172. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 154: loss 0.26374. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 43 Iter 154: loss 0.26374. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 43 Iter 155: loss 0.22266. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 43 Iter 155: loss 0.22266. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 43 Iter 156: loss 0.25069. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 43 Iter 156: loss 0.25069. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 43 Iter 157: loss 0.24855. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.08it/s]
Epoch 43 Iter 157: loss 0.24855. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 43 Iter 158: loss 0.23801. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 43 Iter 158: loss 0.23801. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 43 Iter 159: loss 0.24507. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 43 Iter 159: loss 0.24507. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 43 Iter 160: loss 0.23428. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 43 Iter 160: loss 0.23428. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 43 Iter 161: loss 0.23443. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 43 Iter 161: loss 0.23443. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.07it/s]
Epoch 43 Iter 162: loss 0.24045. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 43 Iter 162: loss 0.24045. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 43 Iter 163: loss 0.20556. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 43 Iter 163: loss 0.20556. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 43 Iter 164: loss 0.23230. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 43 Iter 164: loss 0.23230. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 43 Iter 165: loss 0.23687. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 43 Iter 165: loss 0.23687. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.24876. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.24876. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 43 Iter 167: loss 0.22733. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 43 Iter 167: loss 0.22733. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 43 Iter 168: loss 0.22647. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 43 Iter 168: loss 0.22647. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 43 Iter 169: loss 0.21035. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 43 Iter 169: loss 0.21035. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 43 Iter 170: loss 0.25145. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 43 Iter 170: loss 0.25145. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 43 Iter 171: loss 0.23346. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 43 Iter 171: loss 0.23346. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 43 Iter 172: loss 0.24938. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 172: loss 0.24938. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 43 Iter 173: loss 0.24282. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 43 Iter 173: loss 0.24282. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 43 Iter 174: loss 0.22478. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 43 Iter 174: loss 0.22478. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 43 Iter 175: loss 0.22388. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 43 Iter 175: loss 0.22388. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 43 Iter 176: loss 0.23569. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 43 Iter 176: loss 0.23569. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 43 Iter 177: loss 0.24240. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 43 Iter 177: loss 0.24240. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.22091. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.22091. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 43 Iter 179: loss 0.25653. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 43 Iter 179: loss 0.25653. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 43 Iter 180: loss 0.23738. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 180: loss 0.23738. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 181: loss 0.22620. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 43 Iter 181: loss 0.22620. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 43 Iter 182: loss 0.23158. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 182: loss 0.23158. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 183: loss 0.23325. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 183: loss 0.23325. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 43 Iter 184: loss 0.21972. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 43 Iter 184: loss 0.21972. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 43 Iter 185: loss 0.20572. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 43 Iter 185: loss 0.20572. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 43 Iter 186: loss 0.22397. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 43 Iter 186: loss 0.22397. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 43 Iter 187: loss 0.23426. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 43 Iter 187: loss 0.23426. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 43 Iter 188: loss 0.24158. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 43 Iter 188: loss 0.24158. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 43 Iter 189: loss 0.23420. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 43 Iter 189: loss 0.23420. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.03it/s]
Epoch 43 Iter 190: loss 0.24033. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.03it/s]
Epoch 43 Iter 190: loss 0.24033. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 43 Iter 191: loss 0.23525. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 43 Iter 191: loss 0.23525. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.04it/s]
Epoch 43 Iter 192: loss 0.24609. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 43 Iter 192: loss 0.24609. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 43 Iter 193: loss 0.22393. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 43 Iter 193: loss 0.22393. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 43 Iter 194: loss 0.23999. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 43 Iter 194: loss 0.23999. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 43 Iter 195: loss 0.21176. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 43 Iter 195: loss 0.21176. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 43 Iter 196: loss 0.22674. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 43 Iter 196: loss 0.22674. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 43 Iter 197: loss 0.22805. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 43 Iter 197: loss 0.22805. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 43 Iter 198: loss 0.24729. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 43 Iter 198: loss 0.24729. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.06it/s]
Epoch 43 Iter 199: loss 0.21221. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 43 Iter 199: loss 0.21221. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 43 Iter 200: loss 0.22394. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 43 Iter 200: loss 0.22394. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 43 Iter 201: loss 0.24704. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 43 Iter 201: loss 0.24704. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 43 Iter 202: loss 0.23058. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 43 Iter 202: loss 0.23058. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 43 Iter 203: loss 0.25479. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 43 Iter 203: loss 0.25479. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.10it/s]
Epoch 43 Iter 204: loss 0.25160. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.10it/s]
Epoch 43 Iter 204: loss 0.25160. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 43 Iter 205: loss 0.21995. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 43 Iter 205: loss 0.21995. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 43 Iter 206: loss 0.22252. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 43 Iter 206: loss 0.22252. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 43 Iter 207: loss 0.22229. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 43 Iter 207: loss 0.22229. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 43 Iter 208: loss 0.21007. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 43 Iter 208: loss 0.21007. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 43 Iter 209: loss 0.23422. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 43 Iter 209: loss 0.23422. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 43 Iter 210: loss 0.23752. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 43 Iter 210: loss 0.23752. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.22104. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.22104. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 43 Iter 212: loss 0.23554. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 43 Iter 212: loss 0.23554. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.23587. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.23587. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 214: loss 0.22613. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 214: loss 0.22613. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.08it/s]
Epoch 43 Iter 215: loss 0.24721. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.08it/s]
Epoch 43 Iter 215: loss 0.24721. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 43 Iter 216: loss 0.24066. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 43 Iter 216: loss 0.24066. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 43 Iter 217: loss 0.22411. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 43 Iter 217: loss 0.22411. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 43 Iter 218: loss 0.24070. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 43 Iter 218: loss 0.24070. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 43 Iter 219: loss 0.23669. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 43 Iter 219: loss 0.23669. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 43 Iter 220: loss 0.23105. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 43 Iter 220: loss 0.23105. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.07it/s]
Epoch 43 Iter 221: loss 0.22604. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.07it/s]
Epoch 43 Iter 221: loss 0.22604. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.09it/s]
Epoch 43 Iter 222: loss 0.24349. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.09it/s]
Epoch 43 Iter 222: loss 0.24349. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 43 Iter 223: loss 0.21110. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.08it/s]
Epoch 43 Iter 223: loss 0.21110. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 43 Iter 224: loss 0.25817. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 43 Iter 224: loss 0.25817. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.09it/s]
Epoch 43 Iter 224: loss 0.25817. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.23296
    Valid loss: 0.23452
       Valid loss recons: 0.22324
       Valid loss KL-D:   1.12728
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.22615. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.22615. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 44 Iter 2: loss 0.22014. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 44 Iter 2: loss 0.22014. :   1%|▍                                             | 2/224 [00:00<01:48,  2.04it/s]
Epoch 44 Iter 3: loss 0.23956. :   1%|▍                                             | 2/224 [00:01<01:48,  2.04it/s]
Epoch 44 Iter 3: loss 0.23956. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 44 Iter 4: loss 0.22414. :   1%|▌                                             | 3/224 [00:01<01:48,  2.04it/s]
Epoch 44 Iter 4: loss 0.22414. :   2%|▊                                             | 4/224 [00:01<01:46,  2.06it/s]
Epoch 44 Iter 5: loss 0.23609. :   2%|▊                                             | 4/224 [00:02<01:46,  2.06it/s]
Epoch 44 Iter 5: loss 0.23609. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 44 Iter 6: loss 0.25347. :   2%|█                                             | 5/224 [00:02<01:45,  2.08it/s]
Epoch 44 Iter 6: loss 0.25347. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 44 Iter 7: loss 0.24215. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 44 Iter 7: loss 0.24215. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.04it/s]
Epoch 44 Iter 8: loss 0.23662. :   3%|█▍                                            | 7/224 [00:03<01:46,  2.04it/s]
Epoch 44 Iter 8: loss 0.23662. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 44 Iter 9: loss 0.24148. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 44 Iter 9: loss 0.24148. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 44 Iter 10: loss 0.22749. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 44 Iter 10: loss 0.22749. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 44 Iter 11: loss 0.21655. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 44 Iter 11: loss 0.21655. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 44 Iter 12: loss 0.24243. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 44 Iter 12: loss 0.24243. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.23688. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.23688. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 44 Iter 14: loss 0.24332. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.07it/s]
Epoch 44 Iter 14: loss 0.24332. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 44 Iter 15: loss 0.21782. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 44 Iter 15: loss 0.21782. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 44 Iter 16: loss 0.23071. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.06it/s]
Epoch 44 Iter 16: loss 0.23071. :   7%|███▏                                        | 16/224 [00:07<01:41,  2.06it/s]
Epoch 44 Iter 17: loss 0.21893. :   7%|███▏                                        | 16/224 [00:08<01:41,  2.06it/s]
Epoch 44 Iter 17: loss 0.21893. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.05it/s]
Epoch 44 Iter 18: loss 0.23587. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.05it/s]
Epoch 44 Iter 18: loss 0.23587. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.06it/s]
Epoch 44 Iter 19: loss 0.23970. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.06it/s]
Epoch 44 Iter 19: loss 0.23970. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 44 Iter 20: loss 0.26758. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 44 Iter 20: loss 0.26758. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 44 Iter 21: loss 0.21831. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 44 Iter 21: loss 0.21831. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 44 Iter 22: loss 0.21615. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 44 Iter 22: loss 0.21615. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 44 Iter 23: loss 0.25376. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 44 Iter 23: loss 0.25376. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 44 Iter 24: loss 0.23158. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 44 Iter 24: loss 0.23158. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.06it/s]
Epoch 44 Iter 25: loss 0.23724. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.06it/s]
Epoch 44 Iter 25: loss 0.23724. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 44 Iter 26: loss 0.22617. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.06it/s]
Epoch 44 Iter 26: loss 0.22617. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 44 Iter 27: loss 0.24171. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 44 Iter 27: loss 0.24171. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 44 Iter 28: loss 0.21308. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 44 Iter 28: loss 0.21308. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.23239. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.23239. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 44 Iter 30: loss 0.23372. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 44 Iter 30: loss 0.23372. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 44 Iter 31: loss 0.23842. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.06it/s]
Epoch 44 Iter 31: loss 0.23842. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 44 Iter 32: loss 0.22367. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 44 Iter 32: loss 0.22367. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 44 Iter 33: loss 0.23020. :  14%|██████▎                                     | 32/224 [00:16<01:32,  2.07it/s]
Epoch 44 Iter 33: loss 0.23020. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 44 Iter 34: loss 0.23738. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 44 Iter 34: loss 0.23738. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.23635. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.23635. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 44 Iter 36: loss 0.24674. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 44 Iter 36: loss 0.24674. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 37: loss 0.23944. :  16%|███████                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 37: loss 0.23944. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.21134. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.21134. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 44 Iter 39: loss 0.24816. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 44 Iter 39: loss 0.24816. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.07it/s]
Epoch 44 Iter 40: loss 0.26141. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.07it/s]
Epoch 44 Iter 40: loss 0.26141. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 44 Iter 41: loss 0.23701. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 44 Iter 41: loss 0.23701. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 44 Iter 42: loss 0.20151. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 42: loss 0.20151. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.22280. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.22280. :  19%|████████▍                                   | 43/224 [00:20<01:28,  2.05it/s]
Epoch 44 Iter 44: loss 0.22995. :  19%|████████▍                                   | 43/224 [00:21<01:28,  2.05it/s]
Epoch 44 Iter 44: loss 0.22995. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 45: loss 0.22816. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 45: loss 0.22816. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.23545. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.23545. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.22454. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.22454. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 44 Iter 48: loss 0.24484. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 48: loss 0.24484. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 49: loss 0.23548. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 49: loss 0.23548. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.23499. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.23499. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 44 Iter 51: loss 0.22613. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.05it/s]
Epoch 44 Iter 51: loss 0.22613. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 44 Iter 52: loss 0.22671. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 44 Iter 52: loss 0.22671. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 44 Iter 53: loss 0.23703. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.05it/s]
Epoch 44 Iter 53: loss 0.23703. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.06it/s]
Epoch 44 Iter 54: loss 0.23755. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.06it/s]
Epoch 44 Iter 54: loss 0.23755. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 44 Iter 55: loss 0.25170. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 44 Iter 55: loss 0.25170. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.05it/s]
Epoch 44 Iter 56: loss 0.24023. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.05it/s]
Epoch 44 Iter 56: loss 0.24023. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 44 Iter 57: loss 0.24466. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 44 Iter 57: loss 0.24466. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.06it/s]
Epoch 44 Iter 58: loss 0.22822. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.06it/s]
Epoch 44 Iter 58: loss 0.22822. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 44 Iter 59: loss 0.25270. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 44 Iter 59: loss 0.25270. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.05it/s]
Epoch 44 Iter 60: loss 0.23661. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.05it/s]
Epoch 44 Iter 60: loss 0.23661. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 44 Iter 61: loss 0.24454. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 44 Iter 61: loss 0.24454. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 44 Iter 62: loss 0.21977. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 44 Iter 62: loss 0.21977. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 44 Iter 63: loss 0.23213. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 44 Iter 63: loss 0.23213. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.06it/s]
Epoch 44 Iter 64: loss 0.23119. :  28%|████████████▍                               | 63/224 [00:31<01:17,  2.06it/s]
Epoch 44 Iter 64: loss 0.23119. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 44 Iter 65: loss 0.22632. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 44 Iter 65: loss 0.22632. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 44 Iter 66: loss 0.21023. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.07it/s]
Epoch 44 Iter 66: loss 0.21023. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 67: loss 0.22987. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 67: loss 0.22987. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 68: loss 0.22752. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 68: loss 0.22752. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.05it/s]
Epoch 44 Iter 69: loss 0.23036. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.05it/s]
Epoch 44 Iter 69: loss 0.23036. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 70: loss 0.23221. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 70: loss 0.23221. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.23947. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.23947. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.22886. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.22886. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 44 Iter 73: loss 0.23915. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 44 Iter 73: loss 0.23915. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 74: loss 0.23043. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 74: loss 0.23043. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 75: loss 0.24102. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.07it/s]
Epoch 44 Iter 75: loss 0.24102. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 44 Iter 76: loss 0.23025. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 44 Iter 76: loss 0.23025. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 44 Iter 77: loss 0.24457. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 44 Iter 77: loss 0.24457. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.25783. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.25783. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.23195. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.23195. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 44 Iter 80: loss 0.24409. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 44 Iter 80: loss 0.24409. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 44 Iter 81: loss 0.22124. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 81: loss 0.22124. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 82: loss 0.23786. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 44 Iter 82: loss 0.23786. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 44 Iter 83: loss 0.21724. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 44 Iter 83: loss 0.21724. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 44 Iter 84: loss 0.23696. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 44 Iter 84: loss 0.23696. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.23554. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.23554. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 44 Iter 86: loss 0.23407. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 44 Iter 86: loss 0.23407. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.21740. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.21740. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.08it/s]
Epoch 44 Iter 88: loss 0.22265. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.08it/s]
Epoch 44 Iter 88: loss 0.22265. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 44 Iter 89: loss 0.24514. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 44 Iter 89: loss 0.24514. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 44 Iter 90: loss 0.23967. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 44 Iter 90: loss 0.23967. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.07it/s]
Epoch 44 Iter 91: loss 0.23514. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 91: loss 0.23514. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 92: loss 0.22130. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 92: loss 0.22130. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 44 Iter 93: loss 0.21783. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 93: loss 0.21783. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 94: loss 0.22780. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 94: loss 0.22780. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 95: loss 0.24428. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.06it/s]
Epoch 44 Iter 95: loss 0.24428. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 44 Iter 96: loss 0.23469. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 44 Iter 96: loss 0.23469. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 44 Iter 97: loss 0.23198. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 44 Iter 97: loss 0.23198. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 44 Iter 98: loss 0.22250. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 44 Iter 98: loss 0.22250. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.07it/s]
Epoch 44 Iter 99: loss 0.21702. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.07it/s]
Epoch 44 Iter 99: loss 0.21702. :  44%|███████████████████▍                        | 99/224 [00:47<00:59,  2.08it/s]
Epoch 44 Iter 100: loss 0.22195. :  44%|███████████████████                        | 99/224 [00:48<00:59,  2.08it/s]
Epoch 44 Iter 100: loss 0.22195. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 44 Iter 101: loss 0.22643. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 44 Iter 101: loss 0.22643. :  45%|██████████████████▉                       | 101/224 [00:48<00:58,  2.10it/s]
Epoch 44 Iter 102: loss 0.22387. :  45%|██████████████████▉                       | 101/224 [00:49<00:58,  2.10it/s]
Epoch 44 Iter 102: loss 0.22387. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.09it/s]
Epoch 44 Iter 103: loss 0.22983. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.09it/s]
Epoch 44 Iter 103: loss 0.22983. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.08it/s]
Epoch 44 Iter 104: loss 0.25563. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.08it/s]
Epoch 44 Iter 104: loss 0.25563. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 44 Iter 105: loss 0.22048. :  46%|███████████████████▌                      | 104/224 [00:50<00:57,  2.07it/s]
Epoch 44 Iter 105: loss 0.22048. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 44 Iter 106: loss 0.23047. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 44 Iter 106: loss 0.23047. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 44 Iter 107: loss 0.24385. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 44 Iter 107: loss 0.24385. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 44 Iter 108: loss 0.23110. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 44 Iter 108: loss 0.23110. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 44 Iter 109: loss 0.21398. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 44 Iter 109: loss 0.21398. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.23148. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.23148. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 111: loss 0.24011. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 111: loss 0.24011. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.23581. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.23581. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 113: loss 0.22495. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 113: loss 0.22495. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.21433. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.21433. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.24150. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.24150. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 116: loss 0.20930. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.06it/s]
Epoch 44 Iter 116: loss 0.20930. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 117: loss 0.23599. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 117: loss 0.23599. :  52%|█████████████████████▉                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 44 Iter 118: loss 0.23302. :  52%|█████████████████████▉                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 44 Iter 118: loss 0.23302. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 119: loss 0.22266. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 119: loss 0.22266. :  53%|██████████████████████▎                   | 119/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 120: loss 0.22931. :  53%|██████████████████████▎                   | 119/224 [00:58<00:51,  2.06it/s]
Epoch 44 Iter 120: loss 0.22931. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.23747. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.23747. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.23882. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.23882. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 123: loss 0.23599. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 123: loss 0.23599. :  55%|███████████████████████                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.22134. :  55%|███████████████████████                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.22134. :  55%|███████████████████████▎                  | 124/224 [01:00<00:49,  2.04it/s]
Epoch 44 Iter 125: loss 0.20870. :  55%|███████████████████████▎                  | 124/224 [01:00<00:49,  2.04it/s]
Epoch 44 Iter 125: loss 0.20870. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.05it/s]
Epoch 44 Iter 126: loss 0.20970. :  56%|███████████████████████▍                  | 125/224 [01:01<00:48,  2.05it/s]
Epoch 44 Iter 126: loss 0.20970. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 44 Iter 127: loss 0.23543. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 44 Iter 127: loss 0.23543. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 44 Iter 128: loss 0.21509. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 44 Iter 128: loss 0.21509. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.22328. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.22328. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 44 Iter 130: loss 0.22567. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 44 Iter 130: loss 0.22567. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.08it/s]
Epoch 44 Iter 131: loss 0.23387. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.08it/s]
Epoch 44 Iter 131: loss 0.23387. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 44 Iter 132: loss 0.23318. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 44 Iter 132: loss 0.23318. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 44 Iter 133: loss 0.22099. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 44 Iter 133: loss 0.22099. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 44 Iter 134: loss 0.23604. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 44 Iter 134: loss 0.23604. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.08it/s]
Epoch 44 Iter 135: loss 0.24166. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.08it/s]
Epoch 44 Iter 135: loss 0.24166. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 44 Iter 136: loss 0.21734. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.08it/s]
Epoch 44 Iter 136: loss 0.21734. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.08it/s]
Epoch 44 Iter 137: loss 0.23658. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.08it/s]
Epoch 44 Iter 137: loss 0.23658. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 44 Iter 138: loss 0.22994. :  61%|█████████████████████████▋                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 44 Iter 138: loss 0.22994. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 44 Iter 139: loss 0.24225. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 44 Iter 139: loss 0.24225. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 44 Iter 140: loss 0.23430. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 44 Iter 140: loss 0.23430. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 44 Iter 141: loss 0.23826. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 44 Iter 141: loss 0.23826. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 44 Iter 142: loss 0.25158. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 44 Iter 142: loss 0.25158. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 44 Iter 143: loss 0.25146. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 143: loss 0.25146. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 144: loss 0.22760. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 144: loss 0.22760. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.05it/s]
Epoch 44 Iter 145: loss 0.21853. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.05it/s]
Epoch 44 Iter 145: loss 0.21853. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 44 Iter 146: loss 0.24907. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 44 Iter 146: loss 0.24907. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 44 Iter 147: loss 0.22586. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 44 Iter 147: loss 0.22586. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 44 Iter 148: loss 0.23493. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 44 Iter 148: loss 0.23493. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 44 Iter 149: loss 0.22630. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 149: loss 0.22630. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 150: loss 0.22170. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 150: loss 0.22170. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 44 Iter 151: loss 0.23653. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 44 Iter 151: loss 0.23653. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 44 Iter 152: loss 0.23534. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 44 Iter 152: loss 0.23534. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.06it/s]
Epoch 44 Iter 153: loss 0.24446. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.06it/s]
Epoch 44 Iter 153: loss 0.24446. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 44 Iter 154: loss 0.22563. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 44 Iter 154: loss 0.22563. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 44 Iter 155: loss 0.24652. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 44 Iter 155: loss 0.24652. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 44 Iter 156: loss 0.25399. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 44 Iter 156: loss 0.25399. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 44 Iter 157: loss 0.23756. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 44 Iter 157: loss 0.23756. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 44 Iter 158: loss 0.25777. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 44 Iter 158: loss 0.25777. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 44 Iter 159: loss 0.23747. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 44 Iter 159: loss 0.23747. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 44 Iter 160: loss 0.22786. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 44 Iter 160: loss 0.22786. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 44 Iter 161: loss 0.23321. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 44 Iter 161: loss 0.23321. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 44 Iter 162: loss 0.22765. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 44 Iter 162: loss 0.22765. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 44 Iter 163: loss 0.24825. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.06it/s]
Epoch 44 Iter 163: loss 0.24825. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 44 Iter 164: loss 0.22064. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 44 Iter 164: loss 0.22064. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 44 Iter 165: loss 0.22336. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 44 Iter 165: loss 0.22336. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 44 Iter 166: loss 0.22991. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 44 Iter 166: loss 0.22991. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 44 Iter 167: loss 0.23412. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.05it/s]
Epoch 44 Iter 167: loss 0.23412. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.05it/s]
Epoch 44 Iter 168: loss 0.22195. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.05it/s]
Epoch 44 Iter 168: loss 0.22195. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 44 Iter 169: loss 0.23652. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 44 Iter 169: loss 0.23652. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 44 Iter 170: loss 0.23309. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 44 Iter 170: loss 0.23309. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 44 Iter 171: loss 0.23235. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 44 Iter 171: loss 0.23235. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 44 Iter 172: loss 0.22680. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 44 Iter 172: loss 0.22680. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 44 Iter 173: loss 0.22994. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 44 Iter 173: loss 0.22994. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 44 Iter 174: loss 0.22207. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 44 Iter 174: loss 0.22207. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 44 Iter 175: loss 0.23412. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 44 Iter 175: loss 0.23412. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 44 Iter 176: loss 0.23393. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 44 Iter 176: loss 0.23393. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 44 Iter 177: loss 0.24109. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 44 Iter 177: loss 0.24109. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.05it/s]
Epoch 44 Iter 178: loss 0.25396. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.05it/s]
Epoch 44 Iter 178: loss 0.25396. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 44 Iter 179: loss 0.23241. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 44 Iter 179: loss 0.23241. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:22,  2.04it/s]
Epoch 44 Iter 180: loss 0.21093. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:22,  2.04it/s]
Epoch 44 Iter 180: loss 0.21093. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 44 Iter 181: loss 0.22649. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 44 Iter 181: loss 0.22649. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 44 Iter 182: loss 0.22614. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 44 Iter 182: loss 0.22614. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 44 Iter 183: loss 0.23825. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 44 Iter 183: loss 0.23825. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 44 Iter 184: loss 0.22052. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 184: loss 0.22052. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 44 Iter 185: loss 0.22756. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 44 Iter 185: loss 0.22756. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 44 Iter 186: loss 0.23683. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:19,  2.04it/s]
Epoch 44 Iter 186: loss 0.23683. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 44 Iter 187: loss 0.25087. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 44 Iter 187: loss 0.25087. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.22743. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.22743. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 44 Iter 189: loss 0.22823. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.05it/s]
Epoch 44 Iter 189: loss 0.22823. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 44 Iter 190: loss 0.21588. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 44 Iter 190: loss 0.21588. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 44 Iter 191: loss 0.22073. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 44 Iter 191: loss 0.22073. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 192: loss 0.21845. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 44 Iter 192: loss 0.21845. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 44 Iter 193: loss 0.25242. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 44 Iter 193: loss 0.25242. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.07it/s]
Epoch 44 Iter 194: loss 0.23524. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.07it/s]
Epoch 44 Iter 194: loss 0.23524. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.23059. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.23059. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 196: loss 0.24144. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 44 Iter 196: loss 0.24144. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.22501. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.22501. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 198: loss 0.23136. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 198: loss 0.23136. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.07it/s]
Epoch 44 Iter 199: loss 0.24187. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.07it/s]
Epoch 44 Iter 199: loss 0.24187. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 44 Iter 200: loss 0.23302. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 44 Iter 200: loss 0.23302. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 44 Iter 201: loss 0.23318. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 44 Iter 201: loss 0.23318. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 44 Iter 202: loss 0.22574. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 44 Iter 202: loss 0.22574. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 44 Iter 203: loss 0.22966. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 44 Iter 203: loss 0.22966. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 44 Iter 204: loss 0.23282. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 44 Iter 204: loss 0.23282. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.08it/s]
Epoch 44 Iter 205: loss 0.25075. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.08it/s]
Epoch 44 Iter 205: loss 0.25075. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 44 Iter 206: loss 0.22664. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 44 Iter 206: loss 0.22664. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 44 Iter 207: loss 0.23585. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 44 Iter 207: loss 0.23585. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 44 Iter 208: loss 0.23205. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 44 Iter 208: loss 0.23205. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 44 Iter 209: loss 0.24061. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 209: loss 0.24061. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 44 Iter 210: loss 0.23009. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 44 Iter 210: loss 0.23009. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 44 Iter 211: loss 0.23655. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 44 Iter 211: loss 0.23655. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 44 Iter 212: loss 0.23331. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 44 Iter 212: loss 0.23331. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 44 Iter 213: loss 0.23059. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 44 Iter 213: loss 0.23059. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 44 Iter 214: loss 0.22442. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 44 Iter 214: loss 0.22442. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.06it/s]
Epoch 44 Iter 215: loss 0.24265. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 215: loss 0.24265. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 216: loss 0.23713. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 44 Iter 216: loss 0.23713. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 44 Iter 217: loss 0.25977. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 44 Iter 217: loss 0.25977. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 44 Iter 218: loss 0.23221. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 44 Iter 218: loss 0.23221. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 44 Iter 219: loss 0.23587. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 44 Iter 219: loss 0.23587. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 44 Iter 220: loss 0.23362. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 44 Iter 220: loss 0.23362. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.05it/s]
Epoch 44 Iter 221: loss 0.24637. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.05it/s]
Epoch 44 Iter 221: loss 0.24637. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 44 Iter 222: loss 0.23574. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 44 Iter 222: loss 0.23574. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.25187. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.25187. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 44 Iter 224: loss 0.23485. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 44 Iter 224: loss 0.23485. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 44 Iter 224: loss 0.23485. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.22876. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.22876. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 2: loss 0.23499. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 2: loss 0.23499. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 3: loss 0.24660. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 45 Iter 3: loss 0.24660. :   1%|▌                                             | 3/224 [00:01<01:46,  2.08it/s]
Epoch 45 Iter 4: loss 0.23933. :   1%|▌                                             | 3/224 [00:01<01:46,  2.08it/s]
Epoch 45 Iter 4: loss 0.23933. :   2%|▊                                             | 4/224 [00:01<01:45,  2.08it/s]
Epoch 45 Iter 5: loss 0.24250. :   2%|▊                                             | 4/224 [00:02<01:45,  2.08it/s]
Epoch 45 Iter 5: loss 0.24250. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 45 Iter 6: loss 0.22794. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 45 Iter 6: loss 0.22794. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.23597. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.23597. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 45 Iter 8: loss 0.22993. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 45 Iter 8: loss 0.22993. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.22132. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.22132. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 10: loss 0.22742. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 10: loss 0.22742. :   4%|█▉                                          | 10/224 [00:04<01:42,  2.08it/s]
Epoch 45 Iter 11: loss 0.23988. :   4%|█▉                                          | 10/224 [00:05<01:42,  2.08it/s]
Epoch 45 Iter 11: loss 0.23988. :   5%|██▏                                         | 11/224 [00:05<01:41,  2.09it/s]
Epoch 45 Iter 12: loss 0.24268. :   5%|██▏                                         | 11/224 [00:05<01:41,  2.09it/s]
Epoch 45 Iter 12: loss 0.24268. :   5%|██▎                                         | 12/224 [00:05<01:41,  2.09it/s]
Epoch 45 Iter 13: loss 0.24565. :   5%|██▎                                         | 12/224 [00:06<01:41,  2.09it/s]
Epoch 45 Iter 13: loss 0.24565. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 45 Iter 14: loss 0.21321. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 45 Iter 14: loss 0.21321. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.08it/s]
Epoch 45 Iter 15: loss 0.24528. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.08it/s]
Epoch 45 Iter 15: loss 0.24528. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 45 Iter 16: loss 0.22323. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 45 Iter 16: loss 0.22323. :   7%|███▏                                        | 16/224 [00:07<01:39,  2.08it/s]
Epoch 45 Iter 17: loss 0.22381. :   7%|███▏                                        | 16/224 [00:08<01:39,  2.08it/s]
Epoch 45 Iter 17: loss 0.22381. :   8%|███▎                                        | 17/224 [00:08<01:38,  2.10it/s]
Epoch 45 Iter 18: loss 0.22549. :   8%|███▎                                        | 17/224 [00:08<01:38,  2.10it/s]
Epoch 45 Iter 18: loss 0.22549. :   8%|███▌                                        | 18/224 [00:08<01:38,  2.08it/s]
Epoch 45 Iter 19: loss 0.24164. :   8%|███▌                                        | 18/224 [00:09<01:38,  2.08it/s]
Epoch 45 Iter 19: loss 0.24164. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 45 Iter 20: loss 0.20220. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.07it/s]
Epoch 45 Iter 20: loss 0.20220. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.06it/s]
Epoch 45 Iter 21: loss 0.23633. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 21: loss 0.23633. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 22: loss 0.24132. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 22: loss 0.24132. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 23: loss 0.24299. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.06it/s]
Epoch 45 Iter 23: loss 0.24299. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 45 Iter 24: loss 0.21533. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.06it/s]
Epoch 45 Iter 24: loss 0.21533. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.05it/s]
Epoch 45 Iter 25: loss 0.23172. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.05it/s]
Epoch 45 Iter 25: loss 0.23172. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 45 Iter 26: loss 0.23631. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 45 Iter 26: loss 0.23631. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 45 Iter 27: loss 0.23397. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 45 Iter 27: loss 0.23397. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 45 Iter 28: loss 0.21905. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 45 Iter 28: loss 0.21905. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 45 Iter 29: loss 0.22625. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 45 Iter 29: loss 0.22625. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 45 Iter 30: loss 0.25070. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 45 Iter 30: loss 0.25070. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 45 Iter 31: loss 0.25174. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.06it/s]
Epoch 45 Iter 31: loss 0.25174. :  14%|██████                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 45 Iter 32: loss 0.24084. :  14%|██████                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 45 Iter 32: loss 0.24084. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 45 Iter 33: loss 0.21707. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 45 Iter 33: loss 0.21707. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.08it/s]
Epoch 45 Iter 34: loss 0.23283. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 34: loss 0.23283. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 35: loss 0.23473. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 35: loss 0.23473. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 45 Iter 36: loss 0.25609. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 45 Iter 36: loss 0.25609. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 45 Iter 37: loss 0.23837. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 45 Iter 37: loss 0.23837. :  17%|███████▎                                    | 37/224 [00:17<01:31,  2.05it/s]
Epoch 45 Iter 38: loss 0.25174. :  17%|███████▎                                    | 37/224 [00:18<01:31,  2.05it/s]
Epoch 45 Iter 38: loss 0.25174. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 45 Iter 39: loss 0.23012. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.05it/s]
Epoch 45 Iter 39: loss 0.23012. :  17%|███████▋                                    | 39/224 [00:18<01:30,  2.05it/s]
Epoch 45 Iter 40: loss 0.23124. :  17%|███████▋                                    | 39/224 [00:19<01:30,  2.05it/s]
Epoch 45 Iter 40: loss 0.23124. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 45 Iter 41: loss 0.24864. :  18%|███████▊                                    | 40/224 [00:19<01:29,  2.05it/s]
Epoch 45 Iter 41: loss 0.24864. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 45 Iter 42: loss 0.22888. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 45 Iter 42: loss 0.22888. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 45 Iter 43: loss 0.22930. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 45 Iter 43: loss 0.22930. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 45 Iter 44: loss 0.24426. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 45 Iter 44: loss 0.24426. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 45 Iter 45: loss 0.23882. :  20%|████████▋                                   | 44/224 [00:21<01:26,  2.07it/s]
Epoch 45 Iter 45: loss 0.23882. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 45 Iter 46: loss 0.23162. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 46: loss 0.23162. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 45 Iter 47: loss 0.24389. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 45 Iter 47: loss 0.24389. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.23753. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.23753. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.21864. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.21864. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 45 Iter 50: loss 0.23826. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 45 Iter 50: loss 0.23826. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 45 Iter 51: loss 0.22170. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 45 Iter 51: loss 0.22170. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.23865. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.23865. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 45 Iter 53: loss 0.24311. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 45 Iter 53: loss 0.24311. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.07it/s]
Epoch 45 Iter 54: loss 0.23908. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.07it/s]
Epoch 45 Iter 54: loss 0.23908. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 45 Iter 55: loss 0.22411. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 45 Iter 55: loss 0.22411. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.06it/s]
Epoch 45 Iter 56: loss 0.23504. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.06it/s]
Epoch 45 Iter 56: loss 0.23504. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 45 Iter 57: loss 0.24650. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 45 Iter 57: loss 0.24650. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.06it/s]
Epoch 45 Iter 58: loss 0.22836. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.06it/s]
Epoch 45 Iter 58: loss 0.22836. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.25605. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.25605. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.24409. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.24409. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 45 Iter 61: loss 0.23259. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.06it/s]
Epoch 45 Iter 61: loss 0.23259. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 45 Iter 62: loss 0.22249. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 45 Iter 62: loss 0.22249. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 45 Iter 63: loss 0.21535. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.05it/s]
Epoch 45 Iter 63: loss 0.21535. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.24117. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.24117. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.21187. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.21187. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 66: loss 0.23830. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 66: loss 0.23830. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.22737. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.22737. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.22643. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.22643. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 45 Iter 69: loss 0.23184. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 69: loss 0.23184. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 70: loss 0.25482. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 70: loss 0.25482. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 45 Iter 71: loss 0.22768. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 45 Iter 71: loss 0.22768. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 72: loss 0.22761. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 72: loss 0.22761. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 45 Iter 73: loss 0.21502. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 45 Iter 73: loss 0.21502. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 45 Iter 74: loss 0.26119. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 45 Iter 74: loss 0.26119. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 45 Iter 75: loss 0.22771. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 45 Iter 75: loss 0.22771. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 45 Iter 76: loss 0.23898. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.07it/s]
Epoch 45 Iter 76: loss 0.23898. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 45 Iter 77: loss 0.21740. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 45 Iter 77: loss 0.21740. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 45 Iter 78: loss 0.23018. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.06it/s]
Epoch 45 Iter 78: loss 0.23018. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.06it/s]
Epoch 45 Iter 79: loss 0.23402. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.06it/s]
Epoch 45 Iter 79: loss 0.23402. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 45 Iter 80: loss 0.25289. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 45 Iter 80: loss 0.25289. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.06it/s]
Epoch 45 Iter 81: loss 0.24819. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.06it/s]
Epoch 45 Iter 81: loss 0.24819. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 45 Iter 82: loss 0.22377. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 45 Iter 82: loss 0.22377. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 45 Iter 83: loss 0.22881. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 45 Iter 83: loss 0.22881. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 84: loss 0.24931. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 84: loss 0.24931. :  38%|████████████████▌                           | 84/224 [00:40<01:08,  2.05it/s]
Epoch 45 Iter 85: loss 0.22092. :  38%|████████████████▌                           | 84/224 [00:41<01:08,  2.05it/s]
Epoch 45 Iter 85: loss 0.22092. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 45 Iter 86: loss 0.22393. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.06it/s]
Epoch 45 Iter 86: loss 0.22393. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 45 Iter 87: loss 0.21571. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 45 Iter 87: loss 0.21571. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 45 Iter 88: loss 0.23399. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 45 Iter 88: loss 0.23399. :  39%|█████████████████▎                          | 88/224 [00:42<01:05,  2.07it/s]
Epoch 45 Iter 89: loss 0.23363. :  39%|█████████████████▎                          | 88/224 [00:43<01:05,  2.07it/s]
Epoch 45 Iter 89: loss 0.23363. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 45 Iter 90: loss 0.25153. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.06it/s]
Epoch 45 Iter 90: loss 0.25153. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.06it/s]
Epoch 45 Iter 91: loss 0.24117. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.06it/s]
Epoch 45 Iter 91: loss 0.24117. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 45 Iter 92: loss 0.22813. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 45 Iter 92: loss 0.22813. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 45 Iter 93: loss 0.24996. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.08it/s]
Epoch 45 Iter 93: loss 0.24996. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.09it/s]
Epoch 45 Iter 94: loss 0.22905. :  42%|██████████████████▎                         | 93/224 [00:45<01:02,  2.09it/s]
Epoch 45 Iter 94: loss 0.22905. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.09it/s]
Epoch 45 Iter 95: loss 0.22747. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.09it/s]
Epoch 45 Iter 95: loss 0.22747. :  42%|██████████████████▋                         | 95/224 [00:45<01:01,  2.08it/s]
Epoch 45 Iter 96: loss 0.22837. :  42%|██████████████████▋                         | 95/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 96: loss 0.22837. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 97: loss 0.21997. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 97: loss 0.21997. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 98: loss 0.25770. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 45 Iter 98: loss 0.25770. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 45 Iter 99: loss 0.22645. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 45 Iter 99: loss 0.22645. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.07it/s]
Epoch 45 Iter 100: loss 0.24489. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 45 Iter 100: loss 0.24489. :  45%|██████████████████▊                       | 100/224 [00:48<01:01,  2.03it/s]
Epoch 45 Iter 101: loss 0.23013. :  45%|██████████████████▊                       | 100/224 [00:48<01:01,  2.03it/s]
Epoch 45 Iter 101: loss 0.23013. :  45%|██████████████████▉                       | 101/224 [00:48<01:00,  2.05it/s]
Epoch 45 Iter 102: loss 0.25204. :  45%|██████████████████▉                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 45 Iter 102: loss 0.25204. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 45 Iter 103: loss 0.23495. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.07it/s]
Epoch 45 Iter 103: loss 0.23495. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.05it/s]
Epoch 45 Iter 104: loss 0.22813. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.05it/s]
Epoch 45 Iter 104: loss 0.22813. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 45 Iter 105: loss 0.23566. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 45 Iter 105: loss 0.23566. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 45 Iter 106: loss 0.22538. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 45 Iter 106: loss 0.22538. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 45 Iter 107: loss 0.23075. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 45 Iter 107: loss 0.23075. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 45 Iter 108: loss 0.22345. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 45 Iter 108: loss 0.22345. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 45 Iter 109: loss 0.22228. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 45 Iter 109: loss 0.22228. :  49%|████████████████████▍                     | 109/224 [00:52<00:56,  2.04it/s]
Epoch 45 Iter 110: loss 0.21929. :  49%|████████████████████▍                     | 109/224 [00:53<00:56,  2.04it/s]
Epoch 45 Iter 110: loss 0.21929. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 45 Iter 111: loss 0.24624. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 45 Iter 111: loss 0.24624. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 45 Iter 112: loss 0.24507. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 112: loss 0.24507. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 113: loss 0.22469. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 113: loss 0.22469. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 45 Iter 114: loss 0.23378. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 45 Iter 114: loss 0.23378. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 45 Iter 115: loss 0.20998. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 45 Iter 115: loss 0.20998. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.07it/s]
Epoch 45 Iter 116: loss 0.24199. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.07it/s]
Epoch 45 Iter 116: loss 0.24199. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 45 Iter 117: loss 0.22467. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 45 Iter 117: loss 0.22467. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.23173. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.23173. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 45 Iter 119: loss 0.25599. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.07it/s]
Epoch 45 Iter 119: loss 0.25599. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 45 Iter 120: loss 0.22166. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.07it/s]
Epoch 45 Iter 120: loss 0.22166. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 121: loss 0.21146. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 121: loss 0.21146. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 45 Iter 122: loss 0.22578. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 45 Iter 122: loss 0.22578. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.23924. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.23924. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 45 Iter 124: loss 0.24578. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 45 Iter 124: loss 0.24578. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 45 Iter 125: loss 0.21471. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.07it/s]
Epoch 45 Iter 125: loss 0.21471. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.07it/s]
Epoch 45 Iter 126: loss 0.21541. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.07it/s]
Epoch 45 Iter 126: loss 0.21541. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 127: loss 0.21820. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 127: loss 0.21820. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 128: loss 0.23675. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 45 Iter 128: loss 0.23675. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.22872. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.22872. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 45 Iter 130: loss 0.22078. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 45 Iter 130: loss 0.22078. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 45 Iter 131: loss 0.21584. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 45 Iter 131: loss 0.21584. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.22116. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.22116. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.25906. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.25906. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 134: loss 0.23271. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 134: loss 0.23271. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 45 Iter 135: loss 0.22490. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 45 Iter 135: loss 0.22490. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 45 Iter 136: loss 0.23910. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 45 Iter 136: loss 0.23910. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 45 Iter 137: loss 0.23956. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 137: loss 0.23956. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 138: loss 0.22092. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 45 Iter 138: loss 0.22092. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 45 Iter 139: loss 0.24514. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 139: loss 0.24514. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 140: loss 0.22856. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 45 Iter 140: loss 0.22856. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.06it/s]
Epoch 45 Iter 141: loss 0.23188. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.06it/s]
Epoch 45 Iter 141: loss 0.23188. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 45 Iter 142: loss 0.24090. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.06it/s]
Epoch 45 Iter 142: loss 0.24090. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 45 Iter 143: loss 0.22062. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 45 Iter 143: loss 0.22062. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 45 Iter 144: loss 0.23952. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 45 Iter 144: loss 0.23952. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 45 Iter 145: loss 0.25610. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 45 Iter 145: loss 0.25610. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 45 Iter 146: loss 0.23424. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 45 Iter 146: loss 0.23424. :  65%|███████████████████████████▍              | 146/224 [01:10<00:38,  2.05it/s]
Epoch 45 Iter 147: loss 0.22809. :  65%|███████████████████████████▍              | 146/224 [01:11<00:38,  2.05it/s]
Epoch 45 Iter 147: loss 0.22809. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 45 Iter 148: loss 0.22881. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 45 Iter 148: loss 0.22881. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 45 Iter 149: loss 0.22649. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 45 Iter 149: loss 0.22649. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 45 Iter 150: loss 0.21233. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 45 Iter 150: loss 0.21233. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 45 Iter 151: loss 0.26666. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 45 Iter 151: loss 0.26666. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.22644. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.22644. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 45 Iter 153: loss 0.24557. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 45 Iter 153: loss 0.24557. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.23344. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.23344. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.24002. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.24002. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.21966. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.21966. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.06it/s]
Epoch 45 Iter 157: loss 0.24162. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.06it/s]
Epoch 45 Iter 157: loss 0.24162. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 45 Iter 158: loss 0.21746. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 45 Iter 158: loss 0.21746. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.24211. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.24211. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.21170. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.21170. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.25584. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.25584. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 45 Iter 162: loss 0.22374. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.08it/s]
Epoch 45 Iter 162: loss 0.22374. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.23111. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.23111. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 45 Iter 164: loss 0.22279. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 164: loss 0.22279. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.24173. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.24173. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.23089. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.23089. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 45 Iter 167: loss 0.22775. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.06it/s]
Epoch 45 Iter 167: loss 0.22775. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:28,  2.02it/s]
Epoch 45 Iter 168: loss 0.23266. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:28,  2.02it/s]
Epoch 45 Iter 168: loss 0.23266. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.02it/s]
Epoch 45 Iter 169: loss 0.23901. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.02it/s]
Epoch 45 Iter 169: loss 0.23901. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:27,  2.03it/s]
Epoch 45 Iter 170: loss 0.20873. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:27,  2.03it/s]
Epoch 45 Iter 170: loss 0.20873. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.03it/s]
Epoch 45 Iter 171: loss 0.22476. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.03it/s]
Epoch 45 Iter 171: loss 0.22476. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 45 Iter 172: loss 0.26105. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 45 Iter 172: loss 0.26105. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 45 Iter 173: loss 0.22776. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.05it/s]
Epoch 45 Iter 173: loss 0.22776. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 45 Iter 174: loss 0.24614. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 45 Iter 174: loss 0.24614. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 45 Iter 175: loss 0.23662. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 45 Iter 175: loss 0.23662. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 45 Iter 176: loss 0.23940. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 45 Iter 176: loss 0.23940. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 45 Iter 177: loss 0.26600. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 45 Iter 177: loss 0.26600. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.06it/s]
Epoch 45 Iter 178: loss 0.24311. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.06it/s]
Epoch 45 Iter 178: loss 0.24311. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 45 Iter 179: loss 0.22959. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 45 Iter 179: loss 0.22959. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 45 Iter 180: loss 0.23995. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 45 Iter 180: loss 0.23995. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 45 Iter 181: loss 0.22017. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 45 Iter 181: loss 0.22017. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 45 Iter 182: loss 0.22105. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 45 Iter 182: loss 0.22105. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 45 Iter 183: loss 0.25037. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 45 Iter 183: loss 0.25037. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.05it/s]
Epoch 45 Iter 184: loss 0.23588. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 45 Iter 184: loss 0.23588. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 45 Iter 185: loss 0.22293. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 45 Iter 185: loss 0.22293. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 45 Iter 186: loss 0.22708. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 45 Iter 186: loss 0.22708. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 45 Iter 187: loss 0.22427. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 45 Iter 187: loss 0.22427. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 45 Iter 188: loss 0.22724. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 45 Iter 188: loss 0.22724. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 189: loss 0.25032. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 189: loss 0.25032. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 45 Iter 190: loss 0.22459. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.04it/s]
Epoch 45 Iter 190: loss 0.22459. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 45 Iter 191: loss 0.22107. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 45 Iter 191: loss 0.22107. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.04it/s]
Epoch 45 Iter 192: loss 0.22773. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 45 Iter 192: loss 0.22773. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 45 Iter 193: loss 0.23120. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 45 Iter 193: loss 0.23120. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.05it/s]
Epoch 45 Iter 194: loss 0.23755. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:15,  2.05it/s]
Epoch 45 Iter 194: loss 0.23755. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.22690. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.22690. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 196: loss 0.22924. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 45 Iter 196: loss 0.22924. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 45 Iter 197: loss 0.22820. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 45 Iter 197: loss 0.22820. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 45 Iter 198: loss 0.22608. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 45 Iter 198: loss 0.22608. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 45 Iter 199: loss 0.23885. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.06it/s]
Epoch 45 Iter 199: loss 0.23885. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 45 Iter 200: loss 0.22706. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 45 Iter 200: loss 0.22706. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 201: loss 0.23316. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 201: loss 0.23316. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.24196. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.24196. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 45 Iter 203: loss 0.23667. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 45 Iter 203: loss 0.23667. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 45 Iter 204: loss 0.22345. :  91%|██████████████████████████████████████    | 203/224 [01:39<00:10,  2.04it/s]
Epoch 45 Iter 204: loss 0.22345. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.03it/s]
Epoch 45 Iter 205: loss 0.23657. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.03it/s]
Epoch 45 Iter 205: loss 0.23657. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 45 Iter 206: loss 0.22343. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 45 Iter 206: loss 0.22343. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 45 Iter 207: loss 0.23492. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 45 Iter 207: loss 0.23492. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 45 Iter 208: loss 0.24199. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 45 Iter 208: loss 0.24199. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 45 Iter 209: loss 0.20580. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 45 Iter 209: loss 0.20580. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.22858. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.22858. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 45 Iter 211: loss 0.23685. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 45 Iter 211: loss 0.23685. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.23091. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.23091. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.24137. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.24137. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 45 Iter 214: loss 0.20925. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 45 Iter 214: loss 0.20925. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 45 Iter 215: loss 0.23000. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 45 Iter 215: loss 0.23000. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 45 Iter 216: loss 0.24472. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 45 Iter 216: loss 0.24472. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 45 Iter 217: loss 0.20319. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 217: loss 0.20319. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.24324. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.24324. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 45 Iter 219: loss 0.23339. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 45 Iter 219: loss 0.23339. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 45 Iter 220: loss 0.23268. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 45 Iter 220: loss 0.23268. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 45 Iter 221: loss 0.22835. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.08it/s]
Epoch 45 Iter 221: loss 0.22835. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 45 Iter 222: loss 0.21988. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 45 Iter 222: loss 0.21988. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 45 Iter 223: loss 0.23740. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.07it/s]
Epoch 45 Iter 223: loss 0.23740. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 224: loss 0.22104. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 45 Iter 224: loss 0.22104. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 45 Iter 224: loss 0.22104. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23277
    Valid loss: 0.23437
       Valid loss recons: 0.2215
       Valid loss KL-D:   1.2875
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.22482. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.22482. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 46 Iter 2: loss 0.25769. :   0%|▏                                             | 1/224 [00:00<01:48,  2.06it/s]
Epoch 46 Iter 2: loss 0.25769. :   1%|▍                                             | 2/224 [00:00<01:48,  2.06it/s]
Epoch 46 Iter 3: loss 0.24752. :   1%|▍                                             | 2/224 [00:01<01:48,  2.06it/s]
Epoch 46 Iter 3: loss 0.24752. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 4: loss 0.24660. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 4: loss 0.24660. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 46 Iter 5: loss 0.20637. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 46 Iter 5: loss 0.20637. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.23181. :   2%|█                                             | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.23181. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 46 Iter 7: loss 0.24566. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 46 Iter 7: loss 0.24566. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 46 Iter 8: loss 0.23695. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 46 Iter 8: loss 0.23695. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 46 Iter 9: loss 0.24254. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 46 Iter 9: loss 0.24254. :   4%|█▊                                            | 9/224 [00:04<01:42,  2.09it/s]
Epoch 46 Iter 10: loss 0.23182. :   4%|█▊                                           | 9/224 [00:04<01:42,  2.09it/s]
Epoch 46 Iter 10: loss 0.23182. :   4%|█▉                                          | 10/224 [00:04<01:42,  2.08it/s]
Epoch 46 Iter 11: loss 0.22579. :   4%|█▉                                          | 10/224 [00:05<01:42,  2.08it/s]
Epoch 46 Iter 11: loss 0.22579. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 12: loss 0.22256. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 12: loss 0.22256. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 13: loss 0.23716. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 46 Iter 13: loss 0.23716. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.09it/s]
Epoch 46 Iter 14: loss 0.20655. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.09it/s]
Epoch 46 Iter 14: loss 0.20655. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.08it/s]
Epoch 46 Iter 15: loss 0.22598. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.08it/s]
Epoch 46 Iter 15: loss 0.22598. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 46 Iter 16: loss 0.22905. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 46 Iter 16: loss 0.22905. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.23804. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.23804. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 18: loss 0.21721. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 18: loss 0.21721. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 19: loss 0.23686. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.07it/s]
Epoch 46 Iter 19: loss 0.23686. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.21183. :   8%|███▋                                        | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.21183. :   9%|███▉                                        | 20/224 [00:09<01:38,  2.07it/s]
Epoch 46 Iter 21: loss 0.23414. :   9%|███▉                                        | 20/224 [00:10<01:38,  2.07it/s]
Epoch 46 Iter 21: loss 0.23414. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 46 Iter 22: loss 0.23002. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.06it/s]
Epoch 46 Iter 22: loss 0.23002. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.06it/s]
Epoch 46 Iter 23: loss 0.23280. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.06it/s]
Epoch 46 Iter 23: loss 0.23280. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 46 Iter 24: loss 0.23047. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 46 Iter 24: loss 0.23047. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.07it/s]
Epoch 46 Iter 25: loss 0.21740. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.07it/s]
Epoch 46 Iter 25: loss 0.21740. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 46 Iter 26: loss 0.24155. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 46 Iter 26: loss 0.24155. :  12%|█████                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 46 Iter 27: loss 0.24372. :  12%|█████                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 46 Iter 27: loss 0.24372. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 46 Iter 28: loss 0.23561. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.07it/s]
Epoch 46 Iter 28: loss 0.23561. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 46 Iter 29: loss 0.24899. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.07it/s]
Epoch 46 Iter 29: loss 0.24899. :  13%|█████▋                                      | 29/224 [00:13<01:33,  2.07it/s]
Epoch 46 Iter 30: loss 0.23352. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.07it/s]
Epoch 46 Iter 30: loss 0.23352. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 46 Iter 31: loss 0.21377. :  13%|█████▉                                      | 30/224 [00:14<01:33,  2.08it/s]
Epoch 46 Iter 31: loss 0.21377. :  14%|██████                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 46 Iter 32: loss 0.23804. :  14%|██████                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 46 Iter 32: loss 0.23804. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.09it/s]
Epoch 46 Iter 33: loss 0.22282. :  14%|██████▎                                     | 32/224 [00:15<01:31,  2.09it/s]
Epoch 46 Iter 33: loss 0.22282. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 46 Iter 34: loss 0.22355. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 46 Iter 34: loss 0.22355. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 46 Iter 35: loss 0.22767. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 46 Iter 35: loss 0.22767. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.07it/s]
Epoch 46 Iter 36: loss 0.22614. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.07it/s]
Epoch 46 Iter 36: loss 0.22614. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 46 Iter 37: loss 0.26840. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 46 Iter 37: loss 0.26840. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 46 Iter 38: loss 0.23662. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 46 Iter 38: loss 0.23662. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 46 Iter 39: loss 0.22570. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 46 Iter 39: loss 0.22570. :  17%|███████▋                                    | 39/224 [00:18<01:28,  2.08it/s]
Epoch 46 Iter 40: loss 0.23750. :  17%|███████▋                                    | 39/224 [00:19<01:28,  2.08it/s]
Epoch 46 Iter 40: loss 0.23750. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 46 Iter 41: loss 0.22492. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.08it/s]
Epoch 46 Iter 41: loss 0.22492. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 46 Iter 42: loss 0.24020. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 46 Iter 42: loss 0.24020. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.24960. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.24960. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.22359. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.22359. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 45: loss 0.24828. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 45: loss 0.24828. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 46 Iter 46: loss 0.23886. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 46 Iter 46: loss 0.23886. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 46 Iter 47: loss 0.22638. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 46 Iter 47: loss 0.22638. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.22741. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.22741. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.22425. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.22425. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.23085. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.23085. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 46 Iter 51: loss 0.23591. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 46 Iter 51: loss 0.23591. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 46 Iter 52: loss 0.24103. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 46 Iter 52: loss 0.24103. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 46 Iter 53: loss 0.23023. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.07it/s]
Epoch 46 Iter 53: loss 0.23023. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.08it/s]
Epoch 46 Iter 54: loss 0.24950. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.08it/s]
Epoch 46 Iter 54: loss 0.24950. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 55: loss 0.24558. :  24%|██████████▌                                 | 54/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 55: loss 0.24558. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 46 Iter 56: loss 0.21435. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 46 Iter 56: loss 0.21435. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 46 Iter 57: loss 0.22641. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 46 Iter 57: loss 0.22641. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.08it/s]
Epoch 46 Iter 58: loss 0.24127. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.08it/s]
Epoch 46 Iter 58: loss 0.24127. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 46 Iter 59: loss 0.25106. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.07it/s]
Epoch 46 Iter 59: loss 0.25106. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 46 Iter 60: loss 0.22279. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 46 Iter 60: loss 0.22279. :  27%|███████████▊                                | 60/224 [00:28<01:19,  2.07it/s]
Epoch 46 Iter 61: loss 0.25398. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 46 Iter 61: loss 0.25398. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 46 Iter 62: loss 0.22481. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 46 Iter 62: loss 0.22481. :  28%|████████████▏                               | 62/224 [00:29<01:18,  2.07it/s]
Epoch 46 Iter 63: loss 0.21231. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.07it/s]
Epoch 46 Iter 63: loss 0.21231. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 46 Iter 64: loss 0.24143. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 46 Iter 64: loss 0.24143. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.06it/s]
Epoch 46 Iter 65: loss 0.21493. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 65: loss 0.21493. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 66: loss 0.23451. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 66: loss 0.23451. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.05it/s]
Epoch 46 Iter 67: loss 0.22888. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.05it/s]
Epoch 46 Iter 67: loss 0.22888. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.22329. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.22329. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 46 Iter 69: loss 0.23264. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 46 Iter 69: loss 0.23264. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 46 Iter 70: loss 0.23318. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.06it/s]
Epoch 46 Iter 70: loss 0.23318. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 46 Iter 71: loss 0.24686. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 71: loss 0.24686. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 72: loss 0.23857. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 72: loss 0.23857. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.06it/s]
Epoch 46 Iter 73: loss 0.22398. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 73: loss 0.22398. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 46 Iter 74: loss 0.23760. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 46 Iter 74: loss 0.23760. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 46 Iter 75: loss 0.21004. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 46 Iter 75: loss 0.21004. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 46 Iter 76: loss 0.21790. :  33%|██████████████▋                             | 75/224 [00:36<01:11,  2.08it/s]
Epoch 46 Iter 76: loss 0.21790. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 46 Iter 77: loss 0.22385. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 46 Iter 77: loss 0.22385. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 46 Iter 78: loss 0.23046. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.07it/s]
Epoch 46 Iter 78: loss 0.23046. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 46 Iter 79: loss 0.21976. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 46 Iter 79: loss 0.21976. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.21864. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.21864. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 81: loss 0.22404. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.08it/s]
Epoch 46 Iter 81: loss 0.22404. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 46 Iter 82: loss 0.23072. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 46 Iter 82: loss 0.23072. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 46 Iter 83: loss 0.24161. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 46 Iter 83: loss 0.24161. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 46 Iter 84: loss 0.23387. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.05it/s]
Epoch 46 Iter 84: loss 0.23387. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.06it/s]
Epoch 46 Iter 85: loss 0.22943. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.06it/s]
Epoch 46 Iter 85: loss 0.22943. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 46 Iter 86: loss 0.23613. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.05it/s]
Epoch 46 Iter 86: loss 0.23613. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 46 Iter 87: loss 0.25357. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 46 Iter 87: loss 0.25357. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 88: loss 0.21851. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 88: loss 0.21851. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 89: loss 0.22003. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 46 Iter 89: loss 0.22003. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 46 Iter 90: loss 0.22894. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 46 Iter 90: loss 0.22894. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 46 Iter 91: loss 0.24310. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 46 Iter 91: loss 0.24310. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 46 Iter 92: loss 0.23540. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 46 Iter 92: loss 0.23540. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 46 Iter 93: loss 0.23696. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 46 Iter 93: loss 0.23696. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 46 Iter 94: loss 0.23067. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 46 Iter 94: loss 0.23067. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 95: loss 0.23969. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 95: loss 0.23969. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.07it/s]
Epoch 46 Iter 96: loss 0.23138. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 46 Iter 96: loss 0.23138. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 46 Iter 97: loss 0.24812. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 46 Iter 97: loss 0.24812. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 46 Iter 98: loss 0.24074. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 46 Iter 98: loss 0.24074. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 46 Iter 99: loss 0.20439. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 46 Iter 99: loss 0.20439. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 46 Iter 100: loss 0.22835. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 46 Iter 100: loss 0.22835. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 46 Iter 101: loss 0.25369. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 46 Iter 101: loss 0.25369. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 46 Iter 102: loss 0.22046. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 46 Iter 102: loss 0.22046. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 46 Iter 103: loss 0.23390. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 46 Iter 103: loss 0.23390. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 46 Iter 104: loss 0.23073. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 46 Iter 104: loss 0.23073. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 46 Iter 105: loss 0.23468. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 46 Iter 105: loss 0.23468. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 46 Iter 106: loss 0.24956. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 46 Iter 106: loss 0.24956. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 107: loss 0.21748. :  47%|███████████████████▉                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 107: loss 0.21748. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.19794. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.19794. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 46 Iter 109: loss 0.24119. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.08it/s]
Epoch 46 Iter 109: loss 0.24119. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 46 Iter 110: loss 0.23549. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 110: loss 0.23549. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 111: loss 0.23618. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 111: loss 0.23618. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 46 Iter 112: loss 0.21746. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 112: loss 0.21746. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 113: loss 0.24597. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 46 Iter 113: loss 0.24597. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.22895. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.22895. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 46 Iter 115: loss 0.23490. :  51%|█████████████████████▍                    | 114/224 [00:55<00:52,  2.08it/s]
Epoch 46 Iter 115: loss 0.23490. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.08it/s]
Epoch 46 Iter 116: loss 0.23633. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.08it/s]
Epoch 46 Iter 116: loss 0.23633. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 46 Iter 117: loss 0.24522. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 46 Iter 117: loss 0.24522. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 46 Iter 118: loss 0.25278. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 46 Iter 118: loss 0.25278. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.09it/s]
Epoch 46 Iter 119: loss 0.23107. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.09it/s]
Epoch 46 Iter 119: loss 0.23107. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.07it/s]
Epoch 46 Iter 120: loss 0.22700. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.07it/s]
Epoch 46 Iter 120: loss 0.22700. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 46 Iter 121: loss 0.22658. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 46 Iter 121: loss 0.22658. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 46 Iter 122: loss 0.24085. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 46 Iter 122: loss 0.24085. :  54%|██████████████████████▊                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 46 Iter 123: loss 0.24584. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 46 Iter 123: loss 0.24584. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 46 Iter 124: loss 0.22447. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 46 Iter 124: loss 0.22447. :  55%|███████████████████████▎                  | 124/224 [00:59<00:48,  2.08it/s]
Epoch 46 Iter 125: loss 0.22676. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.08it/s]
Epoch 46 Iter 125: loss 0.22676. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.09it/s]
Epoch 46 Iter 126: loss 0.22984. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.09it/s]
Epoch 46 Iter 126: loss 0.22984. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.08it/s]
Epoch 46 Iter 127: loss 0.21781. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 46 Iter 127: loss 0.21781. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 46 Iter 128: loss 0.25655. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 46 Iter 128: loss 0.25655. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 46 Iter 129: loss 0.23469. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 46 Iter 129: loss 0.23469. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 46 Iter 130: loss 0.24516. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 46 Iter 130: loss 0.24516. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.07it/s]
Epoch 46 Iter 131: loss 0.22603. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 46 Iter 131: loss 0.22603. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 46 Iter 132: loss 0.24238. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 46 Iter 132: loss 0.24238. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 46 Iter 133: loss 0.21153. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 46 Iter 133: loss 0.21153. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 46 Iter 134: loss 0.22937. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 46 Iter 134: loss 0.22937. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.06it/s]
Epoch 46 Iter 135: loss 0.23738. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 46 Iter 135: loss 0.23738. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 46 Iter 136: loss 0.22869. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.06it/s]
Epoch 46 Iter 136: loss 0.22869. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.05it/s]
Epoch 46 Iter 137: loss 0.23451. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.05it/s]
Epoch 46 Iter 137: loss 0.23451. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 46 Iter 138: loss 0.24262. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 46 Iter 138: loss 0.24262. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 46 Iter 139: loss 0.22844. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 139: loss 0.22844. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.23651. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.23651. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.08it/s]
Epoch 46 Iter 141: loss 0.24439. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.08it/s]
Epoch 46 Iter 141: loss 0.24439. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 46 Iter 142: loss 0.21428. :  63%|██████████████████████████▍               | 141/224 [01:08<00:39,  2.08it/s]
Epoch 46 Iter 142: loss 0.21428. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 46 Iter 143: loss 0.22708. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 46 Iter 143: loss 0.22708. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 46 Iter 144: loss 0.24577. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 46 Iter 144: loss 0.24577. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 46 Iter 145: loss 0.23669. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 46 Iter 145: loss 0.23669. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.23370. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.23370. :  65%|███████████████████████████▍              | 146/224 [01:10<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.24729. :  65%|███████████████████████████▍              | 146/224 [01:11<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.24729. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 46 Iter 148: loss 0.25116. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.05it/s]
Epoch 46 Iter 148: loss 0.25116. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 46 Iter 149: loss 0.24497. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 149: loss 0.24497. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 150: loss 0.22871. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 150: loss 0.22871. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 46 Iter 151: loss 0.21382. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 151: loss 0.21382. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.23939. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.23939. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 46 Iter 153: loss 0.23766. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 46 Iter 153: loss 0.23766. :  68%|████████████████████████████▋             | 153/224 [01:13<00:34,  2.06it/s]
Epoch 46 Iter 154: loss 0.23321. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 46 Iter 154: loss 0.23321. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 46 Iter 155: loss 0.21899. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 46 Iter 155: loss 0.21899. :  69%|█████████████████████████████             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.22907. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.22907. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 46 Iter 157: loss 0.25200. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.08it/s]
Epoch 46 Iter 157: loss 0.25200. :  70%|█████████████████████████████▍            | 157/224 [01:15<00:32,  2.09it/s]
Epoch 46 Iter 158: loss 0.24557. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.09it/s]
Epoch 46 Iter 158: loss 0.24557. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 46 Iter 159: loss 0.22286. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 46 Iter 159: loss 0.22286. :  71%|█████████████████████████████▊            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 46 Iter 160: loss 0.25278. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 46 Iter 160: loss 0.25278. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 46 Iter 161: loss 0.22264. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 46 Iter 161: loss 0.22264. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.07it/s]
Epoch 46 Iter 162: loss 0.23818. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.07it/s]
Epoch 46 Iter 162: loss 0.23818. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 46 Iter 163: loss 0.22919. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 46 Iter 163: loss 0.22919. :  73%|██████████████████████████████▌           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 46 Iter 164: loss 0.24087. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 46 Iter 164: loss 0.24087. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 46 Iter 165: loss 0.23766. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 46 Iter 165: loss 0.23766. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.09it/s]
Epoch 46 Iter 166: loss 0.21800. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.09it/s]
Epoch 46 Iter 166: loss 0.21800. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 46 Iter 167: loss 0.21491. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.07it/s]
Epoch 46 Iter 167: loss 0.21491. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.07it/s]
Epoch 46 Iter 168: loss 0.21789. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.07it/s]
Epoch 46 Iter 168: loss 0.21789. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 46 Iter 169: loss 0.26429. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 46 Iter 169: loss 0.26429. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 46 Iter 170: loss 0.24493. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 170: loss 0.24493. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 171: loss 0.21850. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 171: loss 0.21850. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 46 Iter 172: loss 0.23404. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 46 Iter 172: loss 0.23404. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 46 Iter 173: loss 0.22209. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 46 Iter 173: loss 0.22209. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 46 Iter 174: loss 0.23360. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 46 Iter 174: loss 0.23360. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 46 Iter 175: loss 0.24404. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 46 Iter 175: loss 0.24404. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.23862. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.23862. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 46 Iter 177: loss 0.23117. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 46 Iter 177: loss 0.23117. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.24083. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.24083. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 46 Iter 179: loss 0.23397. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 46 Iter 179: loss 0.23397. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 46 Iter 180: loss 0.25479. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 46 Iter 180: loss 0.25479. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 46 Iter 181: loss 0.23155. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 46 Iter 181: loss 0.23155. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.22667. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.22667. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 46 Iter 183: loss 0.23863. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.06it/s]
Epoch 46 Iter 183: loss 0.23863. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 46 Iter 184: loss 0.23225. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 46 Iter 184: loss 0.23225. :  82%|██████████████████████████████████▌       | 184/224 [01:28<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.24298. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.24298. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 46 Iter 186: loss 0.24364. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 46 Iter 186: loss 0.24364. :  83%|██████████████████████████████████▉       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 46 Iter 187: loss 0.21869. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 46 Iter 187: loss 0.21869. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.22078. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.22078. :  84%|███████████████████████████████████▎      | 188/224 [01:30<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.24958. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.24958. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.23864. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.23864. :  85%|███████████████████████████████████▋      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 191: loss 0.23351. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 46 Iter 191: loss 0.23351. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.22168. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.22168. :  86%|████████████████████████████████████      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.24036. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.24036. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 46 Iter 194: loss 0.24595. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:15,  2.06it/s]
Epoch 46 Iter 194: loss 0.24595. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.05it/s]
Epoch 46 Iter 195: loss 0.21774. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 46 Iter 195: loss 0.21774. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 196: loss 0.22948. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 196: loss 0.22948. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.05it/s]
Epoch 46 Iter 197: loss 0.23562. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 46 Iter 197: loss 0.23562. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 46 Iter 198: loss 0.23043. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 46 Iter 198: loss 0.23043. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.05it/s]
Epoch 46 Iter 199: loss 0.23189. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 46 Iter 199: loss 0.23189. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 46 Iter 200: loss 0.23969. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 46 Iter 200: loss 0.23969. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.05it/s]
Epoch 46 Iter 201: loss 0.23252. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.05it/s]
Epoch 46 Iter 201: loss 0.23252. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 46 Iter 202: loss 0.22795. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 46 Iter 202: loss 0.22795. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 46 Iter 203: loss 0.23056. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 203: loss 0.23056. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 46 Iter 204: loss 0.22982. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 46 Iter 204: loss 0.22982. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 46 Iter 205: loss 0.22031. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 46 Iter 205: loss 0.22031. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.23422. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.23422. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 46 Iter 207: loss 0.24125. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 46 Iter 207: loss 0.24125. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 46 Iter 208: loss 0.21802. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 46 Iter 208: loss 0.21802. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 46 Iter 209: loss 0.22512. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 46 Iter 209: loss 0.22512. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 46 Iter 210: loss 0.23100. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 46 Iter 210: loss 0.23100. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 46 Iter 211: loss 0.23460. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 46 Iter 211: loss 0.23460. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 46 Iter 212: loss 0.23227. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 46 Iter 212: loss 0.23227. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 46 Iter 213: loss 0.22119. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 46 Iter 213: loss 0.22119. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 46 Iter 214: loss 0.23763. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 46 Iter 214: loss 0.23763. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 46 Iter 215: loss 0.22744. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 46 Iter 215: loss 0.22744. :  96%|████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.08it/s]
Epoch 46 Iter 216: loss 0.23733. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 46 Iter 216: loss 0.23733. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 46 Iter 217: loss 0.22224. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 46 Iter 217: loss 0.22224. :  97%|████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.09it/s]
Epoch 46 Iter 218: loss 0.22236. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 46 Iter 218: loss 0.22236. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 46 Iter 219: loss 0.24092. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 46 Iter 219: loss 0.24092. :  98%|█████████████████████████████████████████ | 219/224 [01:45<00:02,  2.09it/s]
Epoch 46 Iter 220: loss 0.24289. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.09it/s]
Epoch 46 Iter 220: loss 0.24289. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 46 Iter 221: loss 0.25213. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.08it/s]
Epoch 46 Iter 221: loss 0.25213. :  99%|█████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 46 Iter 222: loss 0.22380. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 46 Iter 222: loss 0.22380. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 46 Iter 223: loss 0.23385. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 46 Iter 223: loss 0.23385. : 100%|█████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.08it/s]
Epoch 46 Iter 224: loss 0.23833. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 46 Iter 224: loss 0.23833. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 46 Iter 224: loss 0.23833. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.23393. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.23393. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 47 Iter 2: loss 0.21308. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 47 Iter 2: loss 0.21308. :   1%|▍                                             | 2/224 [00:00<01:47,  2.06it/s]
Epoch 47 Iter 3: loss 0.21717. :   1%|▍                                             | 2/224 [00:01<01:47,  2.06it/s]
Epoch 47 Iter 3: loss 0.21717. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 47 Iter 4: loss 0.24778. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 47 Iter 4: loss 0.24778. :   2%|▊                                             | 4/224 [00:01<01:47,  2.05it/s]
Epoch 47 Iter 5: loss 0.23481. :   2%|▊                                             | 4/224 [00:02<01:47,  2.05it/s]
Epoch 47 Iter 5: loss 0.23481. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 47 Iter 6: loss 0.23441. :   2%|█                                             | 5/224 [00:02<01:46,  2.05it/s]
Epoch 47 Iter 6: loss 0.23441. :   3%|█▏                                            | 6/224 [00:02<01:46,  2.05it/s]
Epoch 47 Iter 7: loss 0.22300. :   3%|█▏                                            | 6/224 [00:03<01:46,  2.05it/s]
Epoch 47 Iter 7: loss 0.22300. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 47 Iter 8: loss 0.22347. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.05it/s]
Epoch 47 Iter 8: loss 0.22347. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.06it/s]
Epoch 47 Iter 9: loss 0.23363. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.06it/s]
Epoch 47 Iter 9: loss 0.23363. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 47 Iter 10: loss 0.24619. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 47 Iter 10: loss 0.24619. :   4%|█▉                                          | 10/224 [00:04<01:44,  2.06it/s]
Epoch 47 Iter 11: loss 0.22128. :   4%|█▉                                          | 10/224 [00:05<01:44,  2.06it/s]
Epoch 47 Iter 11: loss 0.22128. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 47 Iter 12: loss 0.24819. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.05it/s]
Epoch 47 Iter 12: loss 0.24819. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.06it/s]
Epoch 47 Iter 13: loss 0.23236. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 13: loss 0.23236. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 14: loss 0.24032. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 47 Iter 14: loss 0.24032. :   6%|██▊                                         | 14/224 [00:06<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.23509. :   6%|██▊                                         | 14/224 [00:07<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.23509. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 47 Iter 16: loss 0.21639. :   7%|██▉                                         | 15/224 [00:07<01:41,  2.07it/s]
Epoch 47 Iter 16: loss 0.21639. :   7%|███▏                                        | 16/224 [00:07<01:39,  2.08it/s]
Epoch 47 Iter 17: loss 0.25283. :   7%|███▏                                        | 16/224 [00:08<01:39,  2.08it/s]
Epoch 47 Iter 17: loss 0.25283. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 47 Iter 18: loss 0.23310. :   8%|███▎                                        | 17/224 [00:08<01:39,  2.08it/s]
Epoch 47 Iter 18: loss 0.23310. :   8%|███▌                                        | 18/224 [00:08<01:39,  2.08it/s]
Epoch 47 Iter 19: loss 0.22758. :   8%|███▌                                        | 18/224 [00:09<01:39,  2.08it/s]
Epoch 47 Iter 19: loss 0.22758. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 20: loss 0.22524. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 20: loss 0.22524. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 47 Iter 21: loss 0.25418. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 47 Iter 21: loss 0.25418. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 47 Iter 22: loss 0.23124. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 47 Iter 22: loss 0.23124. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.05it/s]
Epoch 47 Iter 23: loss 0.23398. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.05it/s]
Epoch 47 Iter 23: loss 0.23398. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.05it/s]
Epoch 47 Iter 24: loss 0.23073. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.05it/s]
Epoch 47 Iter 24: loss 0.23073. :  11%|████▋                                       | 24/224 [00:11<01:37,  2.06it/s]
Epoch 47 Iter 25: loss 0.20664. :  11%|████▋                                       | 24/224 [00:12<01:37,  2.06it/s]
Epoch 47 Iter 25: loss 0.20664. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 47 Iter 26: loss 0.20422. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.07it/s]
Epoch 47 Iter 26: loss 0.20422. :  12%|█████                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 27: loss 0.24185. :  12%|█████                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 47 Iter 27: loss 0.24185. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 47 Iter 28: loss 0.25589. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.06it/s]
Epoch 47 Iter 28: loss 0.25589. :  12%|█████▌                                      | 28/224 [00:13<01:34,  2.08it/s]
Epoch 47 Iter 29: loss 0.21293. :  12%|█████▌                                      | 28/224 [00:14<01:34,  2.08it/s]
Epoch 47 Iter 29: loss 0.21293. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 47 Iter 30: loss 0.22963. :  13%|█████▋                                      | 29/224 [00:14<01:33,  2.08it/s]
Epoch 47 Iter 30: loss 0.22963. :  13%|█████▉                                      | 30/224 [00:14<01:32,  2.10it/s]
Epoch 47 Iter 31: loss 0.23228. :  13%|█████▉                                      | 30/224 [00:15<01:32,  2.10it/s]
Epoch 47 Iter 31: loss 0.23228. :  14%|██████                                      | 31/224 [00:15<01:32,  2.09it/s]
Epoch 47 Iter 32: loss 0.23179. :  14%|██████                                      | 31/224 [00:15<01:32,  2.09it/s]
Epoch 47 Iter 32: loss 0.23179. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 47 Iter 33: loss 0.23508. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.08it/s]
Epoch 47 Iter 33: loss 0.23508. :  15%|██████▍                                     | 33/224 [00:15<01:31,  2.09it/s]
Epoch 47 Iter 34: loss 0.22852. :  15%|██████▍                                     | 33/224 [00:16<01:31,  2.09it/s]
Epoch 47 Iter 34: loss 0.22852. :  15%|██████▋                                     | 34/224 [00:16<01:30,  2.10it/s]
Epoch 47 Iter 35: loss 0.21472. :  15%|██████▋                                     | 34/224 [00:16<01:30,  2.10it/s]
Epoch 47 Iter 35: loss 0.21472. :  16%|██████▉                                     | 35/224 [00:16<01:30,  2.09it/s]
Epoch 47 Iter 36: loss 0.25090. :  16%|██████▉                                     | 35/224 [00:17<01:30,  2.09it/s]
Epoch 47 Iter 36: loss 0.25090. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 47 Iter 37: loss 0.24673. :  16%|███████                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 47 Iter 37: loss 0.24673. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.07it/s]
Epoch 47 Iter 38: loss 0.24383. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.07it/s]
Epoch 47 Iter 38: loss 0.24383. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 47 Iter 39: loss 0.23717. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.08it/s]
Epoch 47 Iter 39: loss 0.23717. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.08it/s]
Epoch 47 Iter 40: loss 0.24186. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.08it/s]
Epoch 47 Iter 40: loss 0.24186. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 47 Iter 41: loss 0.24619. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 47 Iter 41: loss 0.24619. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 47 Iter 42: loss 0.22137. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 47 Iter 42: loss 0.22137. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 47 Iter 43: loss 0.23639. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.07it/s]
Epoch 47 Iter 43: loss 0.23639. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.07it/s]
Epoch 47 Iter 44: loss 0.23320. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.07it/s]
Epoch 47 Iter 44: loss 0.23320. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 47 Iter 45: loss 0.22595. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 47 Iter 45: loss 0.22595. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.06it/s]
Epoch 47 Iter 46: loss 0.22864. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.06it/s]
Epoch 47 Iter 46: loss 0.22864. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 47 Iter 47: loss 0.24311. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 47 Iter 47: loss 0.24311. :  21%|█████████▏                                  | 47/224 [00:22<01:25,  2.07it/s]
Epoch 47 Iter 48: loss 0.22355. :  21%|█████████▏                                  | 47/224 [00:23<01:25,  2.07it/s]
Epoch 47 Iter 48: loss 0.22355. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 47 Iter 49: loss 0.23506. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.06it/s]
Epoch 47 Iter 49: loss 0.23506. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.06it/s]
Epoch 47 Iter 50: loss 0.22165. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.06it/s]
Epoch 47 Iter 50: loss 0.22165. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 47 Iter 51: loss 0.23428. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 47 Iter 51: loss 0.23428. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 47 Iter 52: loss 0.22312. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 47 Iter 52: loss 0.22312. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 47 Iter 53: loss 0.25492. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 47 Iter 53: loss 0.25492. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.06it/s]
Epoch 47 Iter 54: loss 0.21110. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.06it/s]
Epoch 47 Iter 54: loss 0.21110. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 47 Iter 55: loss 0.22897. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.07it/s]
Epoch 47 Iter 55: loss 0.22897. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 47 Iter 56: loss 0.24331. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 47 Iter 56: loss 0.24331. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 47 Iter 57: loss 0.24797. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 47 Iter 57: loss 0.24797. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.05it/s]
Epoch 47 Iter 58: loss 0.19996. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.05it/s]
Epoch 47 Iter 58: loss 0.19996. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 47 Iter 59: loss 0.22709. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 47 Iter 59: loss 0.22709. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 47 Iter 60: loss 0.22153. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 47 Iter 60: loss 0.22153. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 47 Iter 61: loss 0.20755. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 47 Iter 61: loss 0.20755. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 47 Iter 62: loss 0.24137. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 47 Iter 62: loss 0.24137. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 47 Iter 63: loss 0.23755. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 47 Iter 63: loss 0.23755. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 47 Iter 64: loss 0.24742. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 47 Iter 64: loss 0.24742. :  29%|████████████▌                               | 64/224 [00:30<01:17,  2.07it/s]
Epoch 47 Iter 65: loss 0.23024. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 47 Iter 65: loss 0.23024. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 47 Iter 66: loss 0.22478. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 47 Iter 66: loss 0.22478. :  29%|████████████▉                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 47 Iter 67: loss 0.22090. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 67: loss 0.22090. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 68: loss 0.22664. :  30%|█████████████▏                              | 67/224 [00:32<01:16,  2.06it/s]
Epoch 47 Iter 68: loss 0.22664. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 47 Iter 69: loss 0.20948. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 47 Iter 69: loss 0.20948. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 47 Iter 70: loss 0.21986. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.08it/s]
Epoch 47 Iter 70: loss 0.21986. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.07it/s]
Epoch 47 Iter 71: loss 0.24931. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.07it/s]
Epoch 47 Iter 71: loss 0.24931. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 72: loss 0.23712. :  32%|█████████████▉                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 72: loss 0.23712. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 73: loss 0.23393. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 73: loss 0.23393. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 47 Iter 74: loss 0.24195. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 47 Iter 74: loss 0.24195. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 47 Iter 75: loss 0.23296. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 47 Iter 75: loss 0.23296. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 47 Iter 76: loss 0.23326. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 47 Iter 76: loss 0.23326. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 47 Iter 77: loss 0.21391. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 47 Iter 77: loss 0.21391. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 47 Iter 78: loss 0.25417. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.08it/s]
Epoch 47 Iter 78: loss 0.25417. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 47 Iter 79: loss 0.25860. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 47 Iter 79: loss 0.25860. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 47 Iter 80: loss 0.21727. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.06it/s]
Epoch 47 Iter 80: loss 0.21727. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 47 Iter 81: loss 0.24145. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 81: loss 0.24145. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.22968. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.22968. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 47 Iter 83: loss 0.24241. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 47 Iter 83: loss 0.24241. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 47 Iter 84: loss 0.22829. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.07it/s]
Epoch 47 Iter 84: loss 0.22829. :  38%|████████████████▌                           | 84/224 [00:40<01:07,  2.07it/s]
Epoch 47 Iter 85: loss 0.25717. :  38%|████████████████▌                           | 84/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 85: loss 0.25717. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 86: loss 0.23066. :  38%|████████████████▋                           | 85/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 86: loss 0.23066. :  38%|████████████████▉                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 47 Iter 87: loss 0.25207. :  38%|████████████████▉                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 47 Iter 87: loss 0.25207. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 88: loss 0.22826. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 88: loss 0.22826. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.06it/s]
Epoch 47 Iter 89: loss 0.23931. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.06it/s]
Epoch 47 Iter 89: loss 0.23931. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 47 Iter 90: loss 0.21307. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.07it/s]
Epoch 47 Iter 90: loss 0.21307. :  40%|█████████████████▋                          | 90/224 [00:43<01:04,  2.06it/s]
Epoch 47 Iter 91: loss 0.23830. :  40%|█████████████████▋                          | 90/224 [00:44<01:04,  2.06it/s]
Epoch 47 Iter 91: loss 0.23830. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 47 Iter 92: loss 0.23135. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 47 Iter 92: loss 0.23135. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 47 Iter 93: loss 0.23826. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 47 Iter 93: loss 0.23826. :  42%|██████████████████▎                         | 93/224 [00:44<01:03,  2.07it/s]
Epoch 47 Iter 94: loss 0.21364. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 47 Iter 94: loss 0.21364. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 47 Iter 95: loss 0.24426. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.07it/s]
Epoch 47 Iter 95: loss 0.24426. :  42%|██████████████████▋                         | 95/224 [00:45<01:02,  2.08it/s]
Epoch 47 Iter 96: loss 0.25076. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.08it/s]
Epoch 47 Iter 96: loss 0.25076. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 47 Iter 97: loss 0.21983. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 47 Iter 97: loss 0.21983. :  43%|███████████████████                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 47 Iter 98: loss 0.23932. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 47 Iter 98: loss 0.23932. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 47 Iter 99: loss 0.22802. :  44%|███████████████████▎                        | 98/224 [00:47<01:01,  2.06it/s]
Epoch 47 Iter 99: loss 0.22802. :  44%|███████████████████▍                        | 99/224 [00:47<01:00,  2.06it/s]
Epoch 47 Iter 100: loss 0.23846. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 47 Iter 100: loss 0.23846. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 47 Iter 101: loss 0.24386. :  45%|██████████████████▊                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 47 Iter 101: loss 0.24386. :  45%|██████████████████▉                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 47 Iter 102: loss 0.23147. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 47 Iter 102: loss 0.23147. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 47 Iter 103: loss 0.24287. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.06it/s]
Epoch 47 Iter 103: loss 0.24287. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 47 Iter 104: loss 0.23339. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 47 Iter 104: loss 0.23339. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 47 Iter 105: loss 0.22997. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 47 Iter 105: loss 0.22997. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 47 Iter 106: loss 0.23390. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 47 Iter 106: loss 0.23390. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 47 Iter 107: loss 0.21982. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 47 Iter 107: loss 0.21982. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 47 Iter 108: loss 0.22672. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 108: loss 0.22672. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.23542. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.23542. :  49%|████████████████████▍                     | 109/224 [00:52<00:56,  2.04it/s]
Epoch 47 Iter 110: loss 0.22251. :  49%|████████████████████▍                     | 109/224 [00:53<00:56,  2.04it/s]
Epoch 47 Iter 110: loss 0.22251. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 111: loss 0.23620. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 111: loss 0.23620. :  50%|████████████████████▊                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 112: loss 0.25045. :  50%|████████████████████▊                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 47 Iter 112: loss 0.25045. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 47 Iter 113: loss 0.23766. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 47 Iter 113: loss 0.23766. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 47 Iter 114: loss 0.21520. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 47 Iter 114: loss 0.21520. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.23747. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.23747. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 47 Iter 116: loss 0.23449. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 116: loss 0.23449. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 117: loss 0.24787. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 117: loss 0.24787. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 47 Iter 118: loss 0.25073. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 47 Iter 118: loss 0.25073. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.08it/s]
Epoch 47 Iter 119: loss 0.23997. :  53%|██████████████████████▏                   | 118/224 [00:57<00:50,  2.08it/s]
Epoch 47 Iter 119: loss 0.23997. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.08it/s]
Epoch 47 Iter 120: loss 0.21716. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.08it/s]
Epoch 47 Iter 120: loss 0.21716. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.08it/s]
Epoch 47 Iter 121: loss 0.24745. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.08it/s]
Epoch 47 Iter 121: loss 0.24745. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 47 Iter 122: loss 0.25223. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 47 Iter 122: loss 0.25223. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 47 Iter 123: loss 0.24604. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 47 Iter 123: loss 0.24604. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 47 Iter 124: loss 0.22504. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 124: loss 0.22504. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 125: loss 0.24298. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 125: loss 0.24298. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.06it/s]
Epoch 47 Iter 126: loss 0.22148. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.06it/s]
Epoch 47 Iter 126: loss 0.22148. :  56%|███████████████████████▋                  | 126/224 [01:00<00:47,  2.06it/s]
Epoch 47 Iter 127: loss 0.21515. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 47 Iter 127: loss 0.21515. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 47 Iter 128: loss 0.24004. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 47 Iter 128: loss 0.24004. :  57%|████████████████████████                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 47 Iter 129: loss 0.23798. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 47 Iter 129: loss 0.23798. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 47 Iter 130: loss 0.22186. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 47 Iter 130: loss 0.22186. :  58%|████████████████████████▍                 | 130/224 [01:02<00:45,  2.06it/s]
Epoch 47 Iter 131: loss 0.22861. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.06it/s]
Epoch 47 Iter 131: loss 0.22861. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 47 Iter 132: loss 0.23120. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 47 Iter 132: loss 0.23120. :  59%|████████████████████████▊                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 47 Iter 133: loss 0.21934. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 133: loss 0.21934. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 134: loss 0.24103. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 47 Iter 134: loss 0.24103. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.05it/s]
Epoch 47 Iter 135: loss 0.23948. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 135: loss 0.23948. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 136: loss 0.22040. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 136: loss 0.22040. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 47 Iter 137: loss 0.24274. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 47 Iter 137: loss 0.24274. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 47 Iter 138: loss 0.21649. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 47 Iter 138: loss 0.21649. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 47 Iter 139: loss 0.24838. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 47 Iter 139: loss 0.24838. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 47 Iter 140: loss 0.24241. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 47 Iter 140: loss 0.24241. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 47 Iter 141: loss 0.19998. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 141: loss 0.19998. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 142: loss 0.25856. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 142: loss 0.25856. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 47 Iter 143: loss 0.22819. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 143: loss 0.22819. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 47 Iter 144: loss 0.21043. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 47 Iter 144: loss 0.21043. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 47 Iter 145: loss 0.23593. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 47 Iter 145: loss 0.23593. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 47 Iter 146: loss 0.22745. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.06it/s]
Epoch 47 Iter 146: loss 0.22745. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.08it/s]
Epoch 47 Iter 147: loss 0.23216. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.08it/s]
Epoch 47 Iter 147: loss 0.23216. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 47 Iter 148: loss 0.23142. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 47 Iter 148: loss 0.23142. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 47 Iter 149: loss 0.22293. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 47 Iter 149: loss 0.22293. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 150: loss 0.22492. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 150: loss 0.22492. :  67%|████████████████████████████              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 47 Iter 151: loss 0.21771. :  67%|████████████████████████████              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 47 Iter 151: loss 0.21771. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 152: loss 0.22117. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 152: loss 0.22117. :  68%|████████████████████████████▌             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 47 Iter 153: loss 0.24100. :  68%|████████████████████████████▌             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 47 Iter 153: loss 0.24100. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 154: loss 0.22297. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 154: loss 0.22297. :  69%|████████████████████████████▉             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 155: loss 0.23283. :  69%|████████████████████████████▉             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 47 Iter 155: loss 0.23283. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 47 Iter 156: loss 0.21674. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 47 Iter 156: loss 0.21674. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 47 Iter 157: loss 0.23004. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.06it/s]
Epoch 47 Iter 157: loss 0.23004. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 47 Iter 158: loss 0.23244. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 47 Iter 158: loss 0.23244. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 47 Iter 159: loss 0.22705. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 47 Iter 159: loss 0.22705. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 160: loss 0.23618. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 160: loss 0.23618. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.23114. :  71%|██████████████████████████████            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.23114. :  72%|██████████████████████████████▏           | 161/224 [01:17<00:30,  2.06it/s]
Epoch 47 Iter 162: loss 0.25367. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 47 Iter 162: loss 0.25367. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:30,  2.00it/s]
Epoch 47 Iter 163: loss 0.22246. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:30,  2.00it/s]
Epoch 47 Iter 163: loss 0.22246. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:30,  2.01it/s]
Epoch 47 Iter 164: loss 0.24714. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:30,  2.01it/s]
Epoch 47 Iter 164: loss 0.24714. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.03it/s]
Epoch 47 Iter 165: loss 0.23564. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.03it/s]
Epoch 47 Iter 165: loss 0.23564. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.04it/s]
Epoch 47 Iter 166: loss 0.22300. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.04it/s]
Epoch 47 Iter 166: loss 0.22300. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 47 Iter 167: loss 0.23506. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.04it/s]
Epoch 47 Iter 167: loss 0.23506. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.04it/s]
Epoch 47 Iter 168: loss 0.24954. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.04it/s]
Epoch 47 Iter 168: loss 0.24954. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 47 Iter 169: loss 0.22575. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 47 Iter 169: loss 0.22575. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 47 Iter 170: loss 0.22202. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 170: loss 0.22202. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 171: loss 0.23298. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 47 Iter 171: loss 0.23298. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 47 Iter 172: loss 0.23621. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 47 Iter 172: loss 0.23621. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:24,  2.08it/s]
Epoch 47 Iter 173: loss 0.22528. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:24,  2.08it/s]
Epoch 47 Iter 173: loss 0.22528. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 47 Iter 174: loss 0.23209. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 47 Iter 174: loss 0.23209. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 47 Iter 175: loss 0.22850. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 47 Iter 175: loss 0.22850. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 47 Iter 176: loss 0.23884. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 47 Iter 176: loss 0.23884. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 47 Iter 177: loss 0.22816. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 47 Iter 177: loss 0.22816. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.09it/s]
Epoch 47 Iter 178: loss 0.26494. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.09it/s]
Epoch 47 Iter 178: loss 0.26494. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 47 Iter 179: loss 0.21579. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 47 Iter 179: loss 0.21579. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 47 Iter 180: loss 0.24743. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 47 Iter 180: loss 0.24743. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 47 Iter 181: loss 0.22075. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 47 Iter 181: loss 0.22075. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 47 Iter 182: loss 0.21186. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 47 Iter 182: loss 0.21186. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 47 Iter 183: loss 0.24595. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.08it/s]
Epoch 47 Iter 183: loss 0.24595. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 47 Iter 184: loss 0.24143. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 47 Iter 184: loss 0.24143. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 47 Iter 185: loss 0.23537. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 47 Iter 185: loss 0.23537. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 47 Iter 186: loss 0.23403. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 47 Iter 186: loss 0.23403. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 47 Iter 187: loss 0.23500. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 47 Iter 187: loss 0.23500. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.23507. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.23507. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.22505. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.22505. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.22781. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.22781. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 191: loss 0.24337. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 47 Iter 191: loss 0.24337. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 47 Iter 192: loss 0.23574. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 192: loss 0.23574. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 193: loss 0.23184. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 193: loss 0.23184. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 47 Iter 194: loss 0.23890. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 47 Iter 194: loss 0.23890. :  87%|████████████████████████████████████▍     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 47 Iter 195: loss 0.23302. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 47 Iter 195: loss 0.23302. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 47 Iter 196: loss 0.23856. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 47 Iter 196: loss 0.23856. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.04it/s]
Epoch 47 Iter 197: loss 0.23134. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 47 Iter 197: loss 0.23134. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 47 Iter 198: loss 0.24047. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.04it/s]
Epoch 47 Iter 198: loss 0.24047. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.05it/s]
Epoch 47 Iter 199: loss 0.24144. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.05it/s]
Epoch 47 Iter 199: loss 0.24144. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.23547. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.23547. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 47 Iter 201: loss 0.23056. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 47 Iter 201: loss 0.23056. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.23421. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.23421. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 47 Iter 203: loss 0.23317. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 203: loss 0.23317. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.23673. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.23673. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.23896. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.23896. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 47 Iter 206: loss 0.23281. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 47 Iter 206: loss 0.23281. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 47 Iter 207: loss 0.24948. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 47 Iter 207: loss 0.24948. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 47 Iter 208: loss 0.24390. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 47 Iter 208: loss 0.24390. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 47 Iter 209: loss 0.23167. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 47 Iter 209: loss 0.23167. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 47 Iter 210: loss 0.24992. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.08it/s]
Epoch 47 Iter 210: loss 0.24992. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 47 Iter 211: loss 0.22867. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 47 Iter 211: loss 0.22867. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 47 Iter 212: loss 0.22539. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 47 Iter 212: loss 0.22539. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 47 Iter 213: loss 0.24190. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 47 Iter 213: loss 0.24190. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 47 Iter 214: loss 0.23761. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 47 Iter 214: loss 0.23761. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.05it/s]
Epoch 47 Iter 215: loss 0.22413. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 215: loss 0.22413. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 216: loss 0.23229. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 47 Iter 216: loss 0.23229. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 47 Iter 217: loss 0.23625. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 47 Iter 217: loss 0.23625. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 47 Iter 218: loss 0.22263. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 47 Iter 218: loss 0.22263. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 47 Iter 219: loss 0.23415. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 47 Iter 219: loss 0.23415. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 47 Iter 220: loss 0.25559. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 47 Iter 220: loss 0.25559. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.05it/s]
Epoch 47 Iter 221: loss 0.24834. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.05it/s]
Epoch 47 Iter 221: loss 0.24834. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 47 Iter 222: loss 0.24450. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 47 Iter 222: loss 0.24450. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.24026. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.24026. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.21519. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.21519. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 47 Iter 224: loss 0.21519. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.23312
    Valid loss: 0.23466
       Valid loss recons: 0.22113
       Valid loss KL-D:   1.35318
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.22213. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.22213. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 48 Iter 2: loss 0.20850. :   0%|▏                                             | 1/224 [00:00<01:47,  2.07it/s]
Epoch 48 Iter 2: loss 0.20850. :   1%|▍                                             | 2/224 [00:00<01:47,  2.07it/s]
Epoch 48 Iter 3: loss 0.23862. :   1%|▍                                             | 2/224 [00:01<01:47,  2.07it/s]
Epoch 48 Iter 3: loss 0.23862. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 48 Iter 4: loss 0.20984. :   1%|▌                                             | 3/224 [00:01<01:45,  2.09it/s]
Epoch 48 Iter 4: loss 0.20984. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 48 Iter 5: loss 0.21924. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 48 Iter 5: loss 0.21924. :   2%|█                                             | 5/224 [00:02<01:46,  2.07it/s]
Epoch 48 Iter 6: loss 0.23674. :   2%|█                                             | 5/224 [00:02<01:46,  2.07it/s]
Epoch 48 Iter 6: loss 0.23674. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 48 Iter 7: loss 0.22439. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 48 Iter 7: loss 0.22439. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 8: loss 0.23623. :   3%|█▍                                            | 7/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 8: loss 0.23623. :   4%|█▋                                            | 8/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 9: loss 0.23438. :   4%|█▋                                            | 8/224 [00:04<01:44,  2.07it/s]
Epoch 48 Iter 9: loss 0.23438. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 10: loss 0.22004. :   4%|█▊                                           | 9/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 10: loss 0.22004. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 11: loss 0.24157. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.07it/s]
Epoch 48 Iter 11: loss 0.24157. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 48 Iter 12: loss 0.24090. :   5%|██▏                                         | 11/224 [00:05<01:42,  2.07it/s]
Epoch 48 Iter 12: loss 0.24090. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.07it/s]
Epoch 48 Iter 13: loss 0.23749. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.07it/s]
Epoch 48 Iter 13: loss 0.23749. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 48 Iter 14: loss 0.21670. :   6%|██▌                                         | 13/224 [00:06<01:41,  2.07it/s]
Epoch 48 Iter 14: loss 0.21670. :   6%|██▊                                         | 14/224 [00:06<01:41,  2.07it/s]
Epoch 48 Iter 15: loss 0.23652. :   6%|██▊                                         | 14/224 [00:07<01:41,  2.07it/s]
Epoch 48 Iter 15: loss 0.23652. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 48 Iter 16: loss 0.23166. :   7%|██▉                                         | 15/224 [00:07<01:40,  2.08it/s]
Epoch 48 Iter 16: loss 0.23166. :   7%|███▏                                        | 16/224 [00:07<01:40,  2.07it/s]
Epoch 48 Iter 17: loss 0.23000. :   7%|███▏                                        | 16/224 [00:08<01:40,  2.07it/s]
Epoch 48 Iter 17: loss 0.23000. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.24026. :   8%|███▎                                        | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.24026. :   8%|███▌                                        | 18/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 19: loss 0.26365. :   8%|███▌                                        | 18/224 [00:09<01:40,  2.06it/s]
Epoch 48 Iter 19: loss 0.26365. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 48 Iter 20: loss 0.22046. :   8%|███▋                                        | 19/224 [00:09<01:39,  2.07it/s]
Epoch 48 Iter 20: loss 0.22046. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.06it/s]
Epoch 48 Iter 21: loss 0.25524. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.06it/s]
Epoch 48 Iter 21: loss 0.25524. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 48 Iter 22: loss 0.23867. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 48 Iter 22: loss 0.23867. :  10%|████▎                                       | 22/224 [00:10<01:37,  2.07it/s]
Epoch 48 Iter 23: loss 0.24812. :  10%|████▎                                       | 22/224 [00:11<01:37,  2.07it/s]
Epoch 48 Iter 23: loss 0.24812. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 48 Iter 24: loss 0.24155. :  10%|████▌                                       | 23/224 [00:11<01:37,  2.07it/s]
Epoch 48 Iter 24: loss 0.24155. :  11%|████▋                                       | 24/224 [00:11<01:36,  2.06it/s]
Epoch 48 Iter 25: loss 0.23919. :  11%|████▋                                       | 24/224 [00:12<01:36,  2.06it/s]
Epoch 48 Iter 25: loss 0.23919. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 48 Iter 26: loss 0.22019. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 48 Iter 26: loss 0.22019. :  12%|█████                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 48 Iter 27: loss 0.23543. :  12%|█████                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 48 Iter 27: loss 0.23543. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.05it/s]
Epoch 48 Iter 28: loss 0.22191. :  12%|█████▎                                      | 27/224 [00:13<01:35,  2.05it/s]
Epoch 48 Iter 28: loss 0.22191. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.06it/s]
Epoch 48 Iter 29: loss 0.22782. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.06it/s]
Epoch 48 Iter 29: loss 0.22782. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 48 Iter 30: loss 0.21968. :  13%|█████▋                                      | 29/224 [00:14<01:34,  2.06it/s]
Epoch 48 Iter 30: loss 0.21968. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.05it/s]
Epoch 48 Iter 31: loss 0.22212. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.05it/s]
Epoch 48 Iter 31: loss 0.22212. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 48 Iter 32: loss 0.23388. :  14%|██████                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 48 Iter 32: loss 0.23388. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 48 Iter 33: loss 0.24083. :  14%|██████▎                                     | 32/224 [00:15<01:32,  2.07it/s]
Epoch 48 Iter 33: loss 0.24083. :  15%|██████▍                                     | 33/224 [00:15<01:32,  2.07it/s]
Epoch 48 Iter 34: loss 0.24126. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 48 Iter 34: loss 0.24126. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 48 Iter 35: loss 0.23875. :  15%|██████▋                                     | 34/224 [00:16<01:32,  2.06it/s]
Epoch 48 Iter 35: loss 0.23875. :  16%|██████▉                                     | 35/224 [00:16<01:31,  2.06it/s]
Epoch 48 Iter 36: loss 0.22888. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 48 Iter 36: loss 0.22888. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 48 Iter 37: loss 0.24721. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 48 Iter 37: loss 0.24721. :  17%|███████▎                                    | 37/224 [00:17<01:30,  2.06it/s]
Epoch 48 Iter 38: loss 0.21702. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 48 Iter 38: loss 0.21702. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 48 Iter 39: loss 0.24803. :  17%|███████▍                                    | 38/224 [00:18<01:30,  2.06it/s]
Epoch 48 Iter 39: loss 0.24803. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.06it/s]
Epoch 48 Iter 40: loss 0.22368. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.06it/s]
Epoch 48 Iter 40: loss 0.22368. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 48 Iter 41: loss 0.22804. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 48 Iter 41: loss 0.22804. :  18%|████████                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 48 Iter 42: loss 0.25541. :  18%|████████                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 48 Iter 42: loss 0.25541. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 48 Iter 43: loss 0.20889. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 48 Iter 43: loss 0.20889. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 48 Iter 44: loss 0.22955. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 48 Iter 44: loss 0.22955. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 48 Iter 45: loss 0.23866. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.05it/s]
Epoch 48 Iter 45: loss 0.23866. :  20%|████████▊                                   | 45/224 [00:21<01:27,  2.05it/s]
Epoch 48 Iter 46: loss 0.24484. :  20%|████████▊                                   | 45/224 [00:22<01:27,  2.05it/s]
Epoch 48 Iter 46: loss 0.24484. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 48 Iter 47: loss 0.22947. :  21%|█████████                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 48 Iter 47: loss 0.22947. :  21%|█████████▏                                  | 47/224 [00:22<01:26,  2.05it/s]
Epoch 48 Iter 48: loss 0.21924. :  21%|█████████▏                                  | 47/224 [00:23<01:26,  2.05it/s]
Epoch 48 Iter 48: loss 0.21924. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 48 Iter 49: loss 0.23214. :  21%|█████████▍                                  | 48/224 [00:23<01:25,  2.05it/s]
Epoch 48 Iter 49: loss 0.23214. :  22%|█████████▋                                  | 49/224 [00:23<01:25,  2.06it/s]
Epoch 48 Iter 50: loss 0.22334. :  22%|█████████▋                                  | 49/224 [00:24<01:25,  2.06it/s]
Epoch 48 Iter 50: loss 0.22334. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 48 Iter 51: loss 0.23290. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.06it/s]
Epoch 48 Iter 51: loss 0.23290. :  23%|██████████                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 48 Iter 52: loss 0.24610. :  23%|██████████                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 48 Iter 52: loss 0.24610. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 48 Iter 53: loss 0.23641. :  23%|██████████▏                                 | 52/224 [00:25<01:23,  2.06it/s]
Epoch 48 Iter 53: loss 0.23641. :  24%|██████████▍                                 | 53/224 [00:25<01:22,  2.06it/s]
Epoch 48 Iter 54: loss 0.21952. :  24%|██████████▍                                 | 53/224 [00:26<01:22,  2.06it/s]
Epoch 48 Iter 54: loss 0.21952. :  24%|██████████▌                                 | 54/224 [00:26<01:23,  2.03it/s]
Epoch 48 Iter 55: loss 0.23641. :  24%|██████████▌                                 | 54/224 [00:26<01:23,  2.03it/s]
Epoch 48 Iter 55: loss 0.23641. :  25%|██████████▊                                 | 55/224 [00:26<01:22,  2.04it/s]
Epoch 48 Iter 56: loss 0.26241. :  25%|██████████▊                                 | 55/224 [00:27<01:22,  2.04it/s]
Epoch 48 Iter 56: loss 0.26241. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 48 Iter 57: loss 0.23621. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 48 Iter 57: loss 0.23621. :  25%|███████████▏                                | 57/224 [00:27<01:21,  2.05it/s]
Epoch 48 Iter 58: loss 0.24253. :  25%|███████████▏                                | 57/224 [00:28<01:21,  2.05it/s]
Epoch 48 Iter 58: loss 0.24253. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 48 Iter 59: loss 0.25838. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.05it/s]
Epoch 48 Iter 59: loss 0.25838. :  26%|███████████▌                                | 59/224 [00:28<01:20,  2.06it/s]
Epoch 48 Iter 60: loss 0.20897. :  26%|███████████▌                                | 59/224 [00:29<01:20,  2.06it/s]
Epoch 48 Iter 60: loss 0.20897. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 48 Iter 61: loss 0.23448. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.05it/s]
Epoch 48 Iter 61: loss 0.23448. :  27%|███████████▉                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 48 Iter 62: loss 0.23567. :  27%|███████████▉                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 48 Iter 62: loss 0.23567. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 48 Iter 63: loss 0.23819. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 48 Iter 63: loss 0.23819. :  28%|████████████▍                               | 63/224 [00:30<01:17,  2.07it/s]
Epoch 48 Iter 64: loss 0.23658. :  28%|████████████▍                               | 63/224 [00:31<01:17,  2.07it/s]
Epoch 48 Iter 64: loss 0.23658. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 65: loss 0.23310. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 65: loss 0.23310. :  29%|████████████▊                               | 65/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.21632. :  29%|████████████▊                               | 65/224 [00:32<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.21632. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 48 Iter 67: loss 0.23313. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 48 Iter 67: loss 0.23313. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.21954. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.21954. :  30%|█████████████▎                              | 68/224 [00:32<01:15,  2.06it/s]
Epoch 48 Iter 69: loss 0.24648. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.06it/s]
Epoch 48 Iter 69: loss 0.24648. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 48 Iter 70: loss 0.21612. :  31%|█████████████▌                              | 69/224 [00:33<01:15,  2.05it/s]
Epoch 48 Iter 70: loss 0.21612. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 48 Iter 71: loss 0.22710. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 71: loss 0.22710. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 72: loss 0.23517. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 72: loss 0.23517. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.05it/s]
Epoch 48 Iter 73: loss 0.22964. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.05it/s]
Epoch 48 Iter 73: loss 0.22964. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 48 Iter 74: loss 0.22434. :  33%|██████████████▎                             | 73/224 [00:35<01:13,  2.06it/s]
Epoch 48 Iter 74: loss 0.22434. :  33%|██████████████▌                             | 74/224 [00:35<01:13,  2.05it/s]
Epoch 48 Iter 75: loss 0.22322. :  33%|██████████████▌                             | 74/224 [00:36<01:13,  2.05it/s]
Epoch 48 Iter 75: loss 0.22322. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 48 Iter 76: loss 0.22729. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 48 Iter 76: loss 0.22729. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 48 Iter 77: loss 0.21800. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 48 Iter 77: loss 0.21800. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.05it/s]
Epoch 48 Iter 78: loss 0.22610. :  34%|███████████████▏                            | 77/224 [00:37<01:11,  2.05it/s]
Epoch 48 Iter 78: loss 0.22610. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.07it/s]
Epoch 48 Iter 79: loss 0.23429. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.07it/s]
Epoch 48 Iter 79: loss 0.23429. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 48 Iter 80: loss 0.22793. :  35%|███████████████▌                            | 79/224 [00:38<01:10,  2.07it/s]
Epoch 48 Iter 80: loss 0.22793. :  36%|███████████████▋                            | 80/224 [00:38<01:10,  2.05it/s]
Epoch 48 Iter 81: loss 0.23248. :  36%|███████████████▋                            | 80/224 [00:39<01:10,  2.05it/s]
Epoch 48 Iter 81: loss 0.23248. :  36%|███████████████▉                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 48 Iter 82: loss 0.21261. :  36%|███████████████▉                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 48 Iter 82: loss 0.21261. :  37%|████████████████                            | 82/224 [00:39<01:09,  2.05it/s]
Epoch 48 Iter 83: loss 0.22721. :  37%|████████████████                            | 82/224 [00:40<01:09,  2.05it/s]
Epoch 48 Iter 83: loss 0.22721. :  37%|████████████████▎                           | 83/224 [00:40<01:09,  2.04it/s]
Epoch 48 Iter 84: loss 0.22698. :  37%|████████████████▎                           | 83/224 [00:40<01:09,  2.04it/s]
Epoch 48 Iter 84: loss 0.22698. :  38%|████████████████▌                           | 84/224 [00:40<01:08,  2.05it/s]
Epoch 48 Iter 85: loss 0.24115. :  38%|████████████████▌                           | 84/224 [00:41<01:08,  2.05it/s]
Epoch 48 Iter 85: loss 0.24115. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.04it/s]
Epoch 48 Iter 86: loss 0.25300. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.04it/s]
Epoch 48 Iter 86: loss 0.25300. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 48 Iter 87: loss 0.24078. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 48 Iter 87: loss 0.24078. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 48 Iter 88: loss 0.23076. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 48 Iter 88: loss 0.23076. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.23496. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.23496. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.21588. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.21588. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.23992. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.23992. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 48 Iter 92: loss 0.22853. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 48 Iter 92: loss 0.22853. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 48 Iter 93: loss 0.20801. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 48 Iter 93: loss 0.20801. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.25541. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.25541. :  42%|██████████████████▍                         | 94/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 95: loss 0.24903. :  42%|██████████████████▍                         | 94/224 [00:46<01:03,  2.06it/s]
Epoch 48 Iter 95: loss 0.24903. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 48 Iter 96: loss 0.20800. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 48 Iter 96: loss 0.20800. :  43%|██████████████████▊                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 48 Iter 97: loss 0.23356. :  43%|██████████████████▊                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 97: loss 0.23356. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.23821. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.23821. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.07it/s]
Epoch 48 Iter 99: loss 0.23231. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.07it/s]
Epoch 48 Iter 99: loss 0.23231. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.21661. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.21661. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 48 Iter 101: loss 0.24148. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 48 Iter 101: loss 0.24148. :  45%|██████████████████▉                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 48 Iter 102: loss 0.22035. :  45%|██████████████████▉                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 48 Iter 102: loss 0.22035. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.08it/s]
Epoch 48 Iter 103: loss 0.23418. :  46%|███████████████████▏                      | 102/224 [00:49<00:58,  2.08it/s]
Epoch 48 Iter 103: loss 0.23418. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.07it/s]
Epoch 48 Iter 104: loss 0.24890. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 104: loss 0.24890. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 105: loss 0.23228. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 105: loss 0.23228. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.22790. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.22790. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 48 Iter 107: loss 0.22898. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 48 Iter 107: loss 0.22898. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 48 Iter 108: loss 0.24609. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 108: loss 0.24609. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 109: loss 0.24132. :  48%|████████████████████▎                     | 108/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 109: loss 0.24132. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 48 Iter 110: loss 0.23431. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 48 Iter 110: loss 0.23431. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 48 Iter 111: loss 0.23760. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 48 Iter 111: loss 0.23760. :  50%|████████████████████▊                     | 111/224 [00:53<00:55,  2.04it/s]
Epoch 48 Iter 112: loss 0.23639. :  50%|████████████████████▊                     | 111/224 [00:54<00:55,  2.04it/s]
Epoch 48 Iter 112: loss 0.23639. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.04it/s]
Epoch 48 Iter 113: loss 0.23822. :  50%|█████████████████████                     | 112/224 [00:54<00:54,  2.04it/s]
Epoch 48 Iter 113: loss 0.23822. :  50%|█████████████████████▏                    | 113/224 [00:54<00:54,  2.05it/s]
Epoch 48 Iter 114: loss 0.23475. :  50%|█████████████████████▏                    | 113/224 [00:55<00:54,  2.05it/s]
Epoch 48 Iter 114: loss 0.23475. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 48 Iter 115: loss 0.24368. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 48 Iter 115: loss 0.24368. :  51%|█████████████████████▌                    | 115/224 [00:55<00:52,  2.06it/s]
Epoch 48 Iter 116: loss 0.22207. :  51%|█████████████████████▌                    | 115/224 [00:56<00:52,  2.06it/s]
Epoch 48 Iter 116: loss 0.22207. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 48 Iter 117: loss 0.21958. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 48 Iter 117: loss 0.21958. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 48 Iter 118: loss 0.24912. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 48 Iter 118: loss 0.24912. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 48 Iter 119: loss 0.23514. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 48 Iter 119: loss 0.23514. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 48 Iter 120: loss 0.22499. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 48 Iter 120: loss 0.22499. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 48 Iter 121: loss 0.22527. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.05it/s]
Epoch 48 Iter 121: loss 0.22527. :  54%|██████████████████████▋                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 48 Iter 122: loss 0.23987. :  54%|██████████████████████▋                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 48 Iter 122: loss 0.23987. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 48 Iter 123: loss 0.23105. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 48 Iter 123: loss 0.23105. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 48 Iter 124: loss 0.25160. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 48 Iter 124: loss 0.25160. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 48 Iter 125: loss 0.21322. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 48 Iter 125: loss 0.21322. :  56%|███████████████████████▍                  | 125/224 [01:00<00:47,  2.06it/s]
Epoch 48 Iter 126: loss 0.23289. :  56%|███████████████████████▍                  | 125/224 [01:01<00:47,  2.06it/s]
Epoch 48 Iter 126: loss 0.23289. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 48 Iter 127: loss 0.22262. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 48 Iter 127: loss 0.22262. :  57%|███████████████████████▊                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 48 Iter 128: loss 0.24336. :  57%|███████████████████████▊                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 48 Iter 128: loss 0.24336. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 48 Iter 129: loss 0.21890. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 48 Iter 129: loss 0.21890. :  58%|████████████████████████▏                 | 129/224 [01:02<00:45,  2.07it/s]
Epoch 48 Iter 130: loss 0.20972. :  58%|████████████████████████▏                 | 129/224 [01:03<00:45,  2.07it/s]
Epoch 48 Iter 130: loss 0.20972. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 48 Iter 131: loss 0.21407. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 48 Iter 131: loss 0.21407. :  58%|████████████████████████▌                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 48 Iter 132: loss 0.25161. :  58%|████████████████████████▌                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 48 Iter 132: loss 0.25161. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 48 Iter 133: loss 0.24490. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 48 Iter 133: loss 0.24490. :  59%|████████████████████████▉                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 48 Iter 134: loss 0.22505. :  59%|████████████████████████▉                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 48 Iter 134: loss 0.22505. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 48 Iter 135: loss 0.22957. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.06it/s]
Epoch 48 Iter 135: loss 0.22957. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 136: loss 0.22664. :  60%|█████████████████████████▎                | 135/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 136: loss 0.22664. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 137: loss 0.22811. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 137: loss 0.22811. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 138: loss 0.23312. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 138: loss 0.23312. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 48 Iter 139: loss 0.25841. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 48 Iter 139: loss 0.25841. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 48 Iter 140: loss 0.22432. :  62%|██████████████████████████                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 48 Iter 140: loss 0.22432. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 48 Iter 141: loss 0.23320. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 141: loss 0.23320. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 142: loss 0.23453. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 142: loss 0.23453. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 48 Iter 143: loss 0.23911. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 143: loss 0.23911. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 144: loss 0.23845. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 48 Iter 144: loss 0.23845. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 48 Iter 145: loss 0.23360. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 48 Iter 145: loss 0.23360. :  65%|███████████████████████████▏              | 145/224 [01:10<00:37,  2.08it/s]
Epoch 48 Iter 146: loss 0.26149. :  65%|███████████████████████████▏              | 145/224 [01:10<00:37,  2.08it/s]
Epoch 48 Iter 146: loss 0.26149. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.06it/s]
Epoch 48 Iter 147: loss 0.22740. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.06it/s]
Epoch 48 Iter 147: loss 0.22740. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 48 Iter 148: loss 0.22440. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 48 Iter 148: loss 0.22440. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 48 Iter 149: loss 0.21709. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 48 Iter 149: loss 0.21709. :  67%|███████████████████████████▉              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 48 Iter 150: loss 0.22161. :  67%|███████████████████████████▉              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 48 Iter 150: loss 0.22161. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 48 Iter 151: loss 0.21005. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 48 Iter 151: loss 0.21005. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 48 Iter 152: loss 0.21369. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.07it/s]
Epoch 48 Iter 152: loss 0.21369. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.21009. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.21009. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.22651. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.22651. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 48 Iter 155: loss 0.22249. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 48 Iter 155: loss 0.22249. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.25173. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.25173. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.22017. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.22017. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.22800. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.22800. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.26218. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.26218. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 48 Iter 160: loss 0.22653. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 48 Iter 160: loss 0.22653. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 48 Iter 161: loss 0.22528. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 48 Iter 161: loss 0.22528. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 48 Iter 162: loss 0.23228. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.06it/s]
Epoch 48 Iter 162: loss 0.23228. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.07it/s]
Epoch 48 Iter 163: loss 0.24814. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:29,  2.07it/s]
Epoch 48 Iter 163: loss 0.24814. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 48 Iter 164: loss 0.21409. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 48 Iter 164: loss 0.21409. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 48 Iter 165: loss 0.22113. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 48 Iter 165: loss 0.22113. :  74%|██████████████████████████████▉           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.23746. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.23746. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.22561. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.22561. :  75%|███████████████████████████████▎          | 167/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.21905. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.21905. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 48 Iter 169: loss 0.21991. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 48 Iter 169: loss 0.21991. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.25587. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.25587. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.24522. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.24522. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 48 Iter 172: loss 0.22108. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 48 Iter 172: loss 0.22108. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 48 Iter 173: loss 0.23931. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.06it/s]
Epoch 48 Iter 173: loss 0.23931. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 48 Iter 174: loss 0.25412. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 48 Iter 174: loss 0.25412. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.21517. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.21517. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 48 Iter 176: loss 0.24824. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 48 Iter 176: loss 0.24824. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 48 Iter 177: loss 0.21950. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 48 Iter 177: loss 0.21950. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.07it/s]
Epoch 48 Iter 178: loss 0.23948. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 178: loss 0.23948. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 179: loss 0.25238. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 48 Iter 179: loss 0.25238. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 48 Iter 180: loss 0.22764. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 48 Iter 180: loss 0.22764. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 48 Iter 181: loss 0.22435. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 48 Iter 181: loss 0.22435. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 48 Iter 182: loss 0.24390. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 182: loss 0.24390. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.22726. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.22726. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 48 Iter 184: loss 0.24720. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 184: loss 0.24720. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.23407. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.23407. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 48 Iter 186: loss 0.22648. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 186: loss 0.22648. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.23253. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.23253. :  83%|███████████████████████████████████       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 48 Iter 188: loss 0.22804. :  83%|███████████████████████████████████       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 48 Iter 188: loss 0.22804. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 189: loss 0.22663. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 189: loss 0.22663. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.22319. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.22319. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 191: loss 0.21936. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 191: loss 0.21936. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 48 Iter 192: loss 0.23022. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 192: loss 0.23022. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 193: loss 0.25791. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 193: loss 0.25791. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 48 Iter 194: loss 0.24594. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:14,  2.07it/s]
Epoch 48 Iter 194: loss 0.24594. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 195: loss 0.23710. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 195: loss 0.23710. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 196: loss 0.24356. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 196: loss 0.24356. :  88%|████████████████████████████████████▊     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 48 Iter 197: loss 0.25566. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 48 Iter 197: loss 0.25566. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 198: loss 0.22419. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 198: loss 0.22419. :  88%|█████████████████████████████████████▏    | 198/224 [01:35<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.25236. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.25236. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.23889. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.23889. :  89%|█████████████████████████████████████▌    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 48 Iter 201: loss 0.22618. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 48 Iter 201: loss 0.22618. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 48 Iter 202: loss 0.23020. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 48 Iter 202: loss 0.23020. :  90%|█████████████████████████████████████▉    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 48 Iter 203: loss 0.22383. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 48 Iter 203: loss 0.22383. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.23856. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.23856. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.26350. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.26350. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 48 Iter 206: loss 0.22753. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 48 Iter 206: loss 0.22753. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 48 Iter 207: loss 0.23668. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 48 Iter 207: loss 0.23668. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 208: loss 0.24779. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 208: loss 0.24779. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 48 Iter 209: loss 0.23775. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 209: loss 0.23775. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 210: loss 0.23307. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 210: loss 0.23307. :  94%|███████████████████████████████████████▍  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 48 Iter 211: loss 0.26755. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 211: loss 0.26755. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.22812. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.22812. :  95%|███████████████████████████████████████▊  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 48 Iter 213: loss 0.22816. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 48 Iter 213: loss 0.22816. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 48 Iter 214: loss 0.23415. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 48 Iter 214: loss 0.23415. :  96%|████████████████████████████████████████▏ | 214/224 [01:43<00:04,  2.07it/s]
Epoch 48 Iter 215: loss 0.22194. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:04,  2.07it/s]
Epoch 48 Iter 215: loss 0.22194. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 48 Iter 216: loss 0.23997. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 48 Iter 216: loss 0.23997. :  96%|████████████████████████████████████████▌ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 48 Iter 217: loss 0.22379. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 48 Iter 217: loss 0.22379. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 48 Iter 218: loss 0.23160. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 48 Iter 218: loss 0.23160. :  97%|████████████████████████████████████████▉ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 48 Iter 219: loss 0.24064. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 48 Iter 219: loss 0.24064. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 48 Iter 220: loss 0.21505. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 48 Iter 220: loss 0.21505. :  98%|█████████████████████████████████████████▎| 220/224 [01:46<00:01,  2.06it/s]
Epoch 48 Iter 221: loss 0.22167. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 48 Iter 221: loss 0.22167. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 48 Iter 222: loss 0.24210. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 48 Iter 222: loss 0.24210. :  99%|█████████████████████████████████████████▋| 222/224 [01:47<00:00,  2.07it/s]
Epoch 48 Iter 223: loss 0.22583. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.07it/s]
Epoch 48 Iter 223: loss 0.22583. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 48 Iter 224: loss 0.22867. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 48 Iter 224: loss 0.22867. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 48 Iter 224: loss 0.22867. : 100%|██████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.22024. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.22024. :   0%|▏                                             | 1/224 [00:00<01:46,  2.09it/s]
Epoch 49 Iter 2: loss 0.25192. :   0%|▏                                             | 1/224 [00:00<01:46,  2.09it/s]
Epoch 49 Iter 2: loss 0.25192. :   1%|▍                                             | 2/224 [00:00<01:46,  2.09it/s]
Epoch 49 Iter 3: loss 0.23896. :   1%|▍                                             | 2/224 [00:01<01:46,  2.09it/s]
Epoch 49 Iter 3: loss 0.23896. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 49 Iter 4: loss 0.26094. :   1%|▌                                             | 3/224 [00:01<01:47,  2.06it/s]
Epoch 49 Iter 4: loss 0.26094. :   2%|▊                                             | 4/224 [00:01<01:46,  2.07it/s]
Epoch 49 Iter 5: loss 0.23001. :   2%|▊                                             | 4/224 [00:02<01:46,  2.07it/s]
Epoch 49 Iter 5: loss 0.23001. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 49 Iter 6: loss 0.22508. :   2%|█                                             | 5/224 [00:02<01:45,  2.07it/s]
Epoch 49 Iter 6: loss 0.22508. :   3%|█▏                                            | 6/224 [00:02<01:45,  2.07it/s]
Epoch 49 Iter 7: loss 0.23090. :   3%|█▏                                            | 6/224 [00:03<01:45,  2.07it/s]
Epoch 49 Iter 7: loss 0.23090. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 49 Iter 8: loss 0.22992. :   3%|█▍                                            | 7/224 [00:03<01:45,  2.06it/s]
Epoch 49 Iter 8: loss 0.22992. :   4%|█▋                                            | 8/224 [00:03<01:45,  2.05it/s]
Epoch 49 Iter 9: loss 0.23290. :   4%|█▋                                            | 8/224 [00:04<01:45,  2.05it/s]
Epoch 49 Iter 9: loss 0.23290. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 49 Iter 10: loss 0.23607. :   4%|█▊                                           | 9/224 [00:04<01:44,  2.05it/s]
Epoch 49 Iter 10: loss 0.23607. :   4%|█▉                                          | 10/224 [00:04<01:43,  2.06it/s]
Epoch 49 Iter 11: loss 0.22727. :   4%|█▉                                          | 10/224 [00:05<01:43,  2.06it/s]
Epoch 49 Iter 11: loss 0.22727. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 49 Iter 12: loss 0.22999. :   5%|██▏                                         | 11/224 [00:05<01:43,  2.06it/s]
Epoch 49 Iter 12: loss 0.22999. :   5%|██▎                                         | 12/224 [00:05<01:42,  2.08it/s]
Epoch 49 Iter 13: loss 0.23516. :   5%|██▎                                         | 12/224 [00:06<01:42,  2.08it/s]
Epoch 49 Iter 13: loss 0.23516. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 49 Iter 14: loss 0.22140. :   6%|██▌                                         | 13/224 [00:06<01:42,  2.06it/s]
Epoch 49 Iter 14: loss 0.22140. :   6%|██▊                                         | 14/224 [00:06<01:42,  2.06it/s]
Epoch 49 Iter 15: loss 0.24303. :   6%|██▊                                         | 14/224 [00:07<01:42,  2.06it/s]
Epoch 49 Iter 15: loss 0.24303. :   7%|██▉                                         | 15/224 [00:07<01:43,  2.01it/s]
Epoch 49 Iter 16: loss 0.23764. :   7%|██▉                                         | 15/224 [00:07<01:43,  2.01it/s]
Epoch 49 Iter 16: loss 0.23764. :   7%|███▏                                        | 16/224 [00:07<01:42,  2.02it/s]
Epoch 49 Iter 17: loss 0.23400. :   7%|███▏                                        | 16/224 [00:08<01:42,  2.02it/s]
Epoch 49 Iter 17: loss 0.23400. :   8%|███▎                                        | 17/224 [00:08<01:42,  2.02it/s]
Epoch 49 Iter 18: loss 0.23501. :   8%|███▎                                        | 17/224 [00:08<01:42,  2.02it/s]
Epoch 49 Iter 18: loss 0.23501. :   8%|███▌                                        | 18/224 [00:08<01:41,  2.03it/s]
Epoch 49 Iter 19: loss 0.22313. :   8%|███▌                                        | 18/224 [00:09<01:41,  2.03it/s]
Epoch 49 Iter 19: loss 0.22313. :   8%|███▋                                        | 19/224 [00:09<01:40,  2.04it/s]
Epoch 49 Iter 20: loss 0.25958. :   8%|███▋                                        | 19/224 [00:09<01:40,  2.04it/s]
Epoch 49 Iter 20: loss 0.25958. :   9%|███▉                                        | 20/224 [00:09<01:39,  2.05it/s]
Epoch 49 Iter 21: loss 0.22914. :   9%|███▉                                        | 20/224 [00:10<01:39,  2.05it/s]
Epoch 49 Iter 21: loss 0.22914. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 49 Iter 22: loss 0.23194. :   9%|████▏                                       | 21/224 [00:10<01:38,  2.05it/s]
Epoch 49 Iter 22: loss 0.23194. :  10%|████▎                                       | 22/224 [00:10<01:38,  2.05it/s]
Epoch 49 Iter 23: loss 0.22450. :  10%|████▎                                       | 22/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 23: loss 0.22450. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 24: loss 0.21207. :  10%|████▌                                       | 23/224 [00:11<01:38,  2.05it/s]
Epoch 49 Iter 24: loss 0.21207. :  11%|████▋                                       | 24/224 [00:11<01:38,  2.04it/s]
Epoch 49 Iter 25: loss 0.23490. :  11%|████▋                                       | 24/224 [00:12<01:38,  2.04it/s]
Epoch 49 Iter 25: loss 0.23490. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 49 Iter 26: loss 0.23237. :  11%|████▉                                       | 25/224 [00:12<01:36,  2.05it/s]
Epoch 49 Iter 26: loss 0.23237. :  12%|█████                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 49 Iter 27: loss 0.23839. :  12%|█████                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 49 Iter 27: loss 0.23839. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.05it/s]
Epoch 49 Iter 28: loss 0.24249. :  12%|█████▎                                      | 27/224 [00:13<01:36,  2.05it/s]
Epoch 49 Iter 28: loss 0.24249. :  12%|█████▌                                      | 28/224 [00:13<01:35,  2.05it/s]
Epoch 49 Iter 29: loss 0.22734. :  12%|█████▌                                      | 28/224 [00:14<01:35,  2.05it/s]
Epoch 49 Iter 29: loss 0.22734. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.05it/s]
Epoch 49 Iter 30: loss 0.22676. :  13%|█████▋                                      | 29/224 [00:14<01:35,  2.05it/s]
Epoch 49 Iter 30: loss 0.22676. :  13%|█████▉                                      | 30/224 [00:14<01:34,  2.05it/s]
Epoch 49 Iter 31: loss 0.22281. :  13%|█████▉                                      | 30/224 [00:15<01:34,  2.05it/s]
Epoch 49 Iter 31: loss 0.22281. :  14%|██████                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 49 Iter 32: loss 0.23423. :  14%|██████                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 49 Iter 32: loss 0.23423. :  14%|██████▎                                     | 32/224 [00:15<01:33,  2.06it/s]
Epoch 49 Iter 33: loss 0.23696. :  14%|██████▎                                     | 32/224 [00:16<01:33,  2.06it/s]
Epoch 49 Iter 33: loss 0.23696. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 49 Iter 34: loss 0.23910. :  15%|██████▍                                     | 33/224 [00:16<01:32,  2.07it/s]
Epoch 49 Iter 34: loss 0.23910. :  15%|██████▋                                     | 34/224 [00:16<01:31,  2.07it/s]
Epoch 49 Iter 35: loss 0.22410. :  15%|██████▋                                     | 34/224 [00:17<01:31,  2.07it/s]
Epoch 49 Iter 35: loss 0.22410. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 36: loss 0.24366. :  16%|██████▉                                     | 35/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 36: loss 0.24366. :  16%|███████                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 49 Iter 37: loss 0.25931. :  16%|███████                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 49 Iter 37: loss 0.25931. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 49 Iter 38: loss 0.22353. :  17%|███████▎                                    | 37/224 [00:18<01:30,  2.06it/s]
Epoch 49 Iter 38: loss 0.22353. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 49 Iter 39: loss 0.24555. :  17%|███████▍                                    | 38/224 [00:18<01:29,  2.07it/s]
Epoch 49 Iter 39: loss 0.24555. :  17%|███████▋                                    | 39/224 [00:18<01:29,  2.08it/s]
Epoch 49 Iter 40: loss 0.26107. :  17%|███████▋                                    | 39/224 [00:19<01:29,  2.08it/s]
Epoch 49 Iter 40: loss 0.26107. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 49 Iter 41: loss 0.22725. :  18%|███████▊                                    | 40/224 [00:19<01:28,  2.07it/s]
Epoch 49 Iter 41: loss 0.22725. :  18%|████████                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 49 Iter 42: loss 0.24072. :  18%|████████                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 49 Iter 42: loss 0.24072. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 49 Iter 43: loss 0.23324. :  19%|████████▎                                   | 42/224 [00:20<01:28,  2.06it/s]
Epoch 49 Iter 43: loss 0.23324. :  19%|████████▍                                   | 43/224 [00:20<01:27,  2.06it/s]
Epoch 49 Iter 44: loss 0.22002. :  19%|████████▍                                   | 43/224 [00:21<01:27,  2.06it/s]
Epoch 49 Iter 44: loss 0.22002. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 49 Iter 45: loss 0.24341. :  20%|████████▋                                   | 44/224 [00:21<01:27,  2.06it/s]
Epoch 49 Iter 45: loss 0.24341. :  20%|████████▊                                   | 45/224 [00:21<01:26,  2.07it/s]
Epoch 49 Iter 46: loss 0.21882. :  20%|████████▊                                   | 45/224 [00:22<01:26,  2.07it/s]
Epoch 49 Iter 46: loss 0.21882. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 49 Iter 47: loss 0.23765. :  21%|█████████                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 49 Iter 47: loss 0.23765. :  21%|█████████▏                                  | 47/224 [00:22<01:24,  2.08it/s]
Epoch 49 Iter 48: loss 0.23136. :  21%|█████████▏                                  | 47/224 [00:23<01:24,  2.08it/s]
Epoch 49 Iter 48: loss 0.23136. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 49 Iter 49: loss 0.22824. :  21%|█████████▍                                  | 48/224 [00:23<01:24,  2.08it/s]
Epoch 49 Iter 49: loss 0.22824. :  22%|█████████▋                                  | 49/224 [00:23<01:24,  2.08it/s]
Epoch 49 Iter 50: loss 0.25657. :  22%|█████████▋                                  | 49/224 [00:24<01:24,  2.08it/s]
Epoch 49 Iter 50: loss 0.25657. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 49 Iter 51: loss 0.22369. :  22%|█████████▊                                  | 50/224 [00:24<01:24,  2.07it/s]
Epoch 49 Iter 51: loss 0.22369. :  23%|██████████                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 49 Iter 52: loss 0.23324. :  23%|██████████                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 49 Iter 52: loss 0.23324. :  23%|██████████▏                                 | 52/224 [00:25<01:22,  2.07it/s]
Epoch 49 Iter 53: loss 0.23497. :  23%|██████████▏                                 | 52/224 [00:25<01:22,  2.07it/s]
Epoch 49 Iter 53: loss 0.23497. :  24%|██████████▍                                 | 53/224 [00:25<01:23,  2.06it/s]
Epoch 49 Iter 54: loss 0.21668. :  24%|██████████▍                                 | 53/224 [00:26<01:23,  2.06it/s]
Epoch 49 Iter 54: loss 0.21668. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 49 Iter 55: loss 0.22592. :  24%|██████████▌                                 | 54/224 [00:26<01:22,  2.06it/s]
Epoch 49 Iter 55: loss 0.22592. :  25%|██████████▊                                 | 55/224 [00:26<01:21,  2.07it/s]
Epoch 49 Iter 56: loss 0.22244. :  25%|██████████▊                                 | 55/224 [00:27<01:21,  2.07it/s]
Epoch 49 Iter 56: loss 0.22244. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 49 Iter 57: loss 0.22106. :  25%|███████████                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 49 Iter 57: loss 0.22106. :  25%|███████████▏                                | 57/224 [00:27<01:20,  2.06it/s]
Epoch 49 Iter 58: loss 0.21254. :  25%|███████████▏                                | 57/224 [00:28<01:20,  2.06it/s]
Epoch 49 Iter 58: loss 0.21254. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 49 Iter 59: loss 0.25544. :  26%|███████████▍                                | 58/224 [00:28<01:20,  2.06it/s]
Epoch 49 Iter 59: loss 0.25544. :  26%|███████████▌                                | 59/224 [00:28<01:19,  2.07it/s]
Epoch 49 Iter 60: loss 0.21691. :  26%|███████████▌                                | 59/224 [00:29<01:19,  2.07it/s]
Epoch 49 Iter 60: loss 0.21691. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 49 Iter 61: loss 0.24550. :  27%|███████████▊                                | 60/224 [00:29<01:19,  2.07it/s]
Epoch 49 Iter 61: loss 0.24550. :  27%|███████████▉                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 49 Iter 62: loss 0.24138. :  27%|███████████▉                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 62: loss 0.24138. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 63: loss 0.22601. :  28%|████████████▏                               | 62/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 63: loss 0.22601. :  28%|████████████▍                               | 63/224 [00:30<01:18,  2.06it/s]
Epoch 49 Iter 64: loss 0.26506. :  28%|████████████▍                               | 63/224 [00:31<01:18,  2.06it/s]
Epoch 49 Iter 64: loss 0.26506. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 49 Iter 65: loss 0.21395. :  29%|████████████▌                               | 64/224 [00:31<01:17,  2.07it/s]
Epoch 49 Iter 65: loss 0.21395. :  29%|████████████▊                               | 65/224 [00:31<01:16,  2.07it/s]
Epoch 49 Iter 66: loss 0.21208. :  29%|████████████▊                               | 65/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 66: loss 0.21208. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 67: loss 0.23033. :  29%|████████████▉                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 49 Iter 67: loss 0.23033. :  30%|█████████████▏                              | 67/224 [00:32<01:15,  2.07it/s]
Epoch 49 Iter 68: loss 0.24186. :  30%|█████████████▏                              | 67/224 [00:33<01:15,  2.07it/s]
Epoch 49 Iter 68: loss 0.24186. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 49 Iter 69: loss 0.21802. :  30%|█████████████▎                              | 68/224 [00:33<01:15,  2.07it/s]
Epoch 49 Iter 69: loss 0.21802. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 49 Iter 70: loss 0.22108. :  31%|█████████████▌                              | 69/224 [00:33<01:14,  2.07it/s]
Epoch 49 Iter 70: loss 0.22108. :  31%|█████████████▊                              | 70/224 [00:33<01:14,  2.06it/s]
Epoch 49 Iter 71: loss 0.21558. :  31%|█████████████▊                              | 70/224 [00:34<01:14,  2.06it/s]
Epoch 49 Iter 71: loss 0.21558. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 49 Iter 72: loss 0.21977. :  32%|█████████████▉                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 49 Iter 72: loss 0.21977. :  32%|██████████████▏                             | 72/224 [00:34<01:13,  2.07it/s]
Epoch 49 Iter 73: loss 0.23281. :  32%|██████████████▏                             | 72/224 [00:35<01:13,  2.07it/s]
Epoch 49 Iter 73: loss 0.23281. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 49 Iter 74: loss 0.22849. :  33%|██████████████▎                             | 73/224 [00:35<01:12,  2.07it/s]
Epoch 49 Iter 74: loss 0.22849. :  33%|██████████████▌                             | 74/224 [00:35<01:12,  2.06it/s]
Epoch 49 Iter 75: loss 0.23220. :  33%|██████████████▌                             | 74/224 [00:36<01:12,  2.06it/s]
Epoch 49 Iter 75: loss 0.23220. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 49 Iter 76: loss 0.24427. :  33%|██████████████▋                             | 75/224 [00:36<01:12,  2.06it/s]
Epoch 49 Iter 76: loss 0.24427. :  34%|██████████████▉                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 49 Iter 77: loss 0.23271. :  34%|██████████████▉                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 49 Iter 77: loss 0.23271. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 49 Iter 78: loss 0.22155. :  34%|███████████████▏                            | 77/224 [00:37<01:10,  2.07it/s]
Epoch 49 Iter 78: loss 0.22155. :  35%|███████████████▎                            | 78/224 [00:37<01:10,  2.08it/s]
Epoch 49 Iter 79: loss 0.23508. :  35%|███████████████▎                            | 78/224 [00:38<01:10,  2.08it/s]
Epoch 49 Iter 79: loss 0.23508. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 49 Iter 80: loss 0.23797. :  35%|███████████████▌                            | 79/224 [00:38<01:09,  2.07it/s]
Epoch 49 Iter 80: loss 0.23797. :  36%|███████████████▋                            | 80/224 [00:38<01:09,  2.07it/s]
Epoch 49 Iter 81: loss 0.22211. :  36%|███████████████▋                            | 80/224 [00:39<01:09,  2.07it/s]
Epoch 49 Iter 81: loss 0.22211. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 49 Iter 82: loss 0.24627. :  36%|███████████████▉                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 49 Iter 82: loss 0.24627. :  37%|████████████████                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 49 Iter 83: loss 0.23466. :  37%|████████████████                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 49 Iter 83: loss 0.23466. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 49 Iter 84: loss 0.26185. :  37%|████████████████▎                           | 83/224 [00:40<01:08,  2.06it/s]
Epoch 49 Iter 84: loss 0.26185. :  38%|████████████████▌                           | 84/224 [00:40<01:09,  2.02it/s]
Epoch 49 Iter 85: loss 0.21818. :  38%|████████████████▌                           | 84/224 [00:41<01:09,  2.02it/s]
Epoch 49 Iter 85: loss 0.21818. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.03it/s]
Epoch 49 Iter 86: loss 0.23443. :  38%|████████████████▋                           | 85/224 [00:41<01:08,  2.03it/s]
Epoch 49 Iter 86: loss 0.23443. :  38%|████████████████▉                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 49 Iter 87: loss 0.21874. :  38%|████████████████▉                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 49 Iter 87: loss 0.21874. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 49 Iter 88: loss 0.23810. :  39%|█████████████████                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 49 Iter 88: loss 0.23810. :  39%|█████████████████▎                          | 88/224 [00:42<01:06,  2.04it/s]
Epoch 49 Iter 89: loss 0.24248. :  39%|█████████████████▎                          | 88/224 [00:43<01:06,  2.04it/s]
Epoch 49 Iter 89: loss 0.24248. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 49 Iter 90: loss 0.25428. :  40%|█████████████████▍                          | 89/224 [00:43<01:05,  2.05it/s]
Epoch 49 Iter 90: loss 0.25428. :  40%|█████████████████▋                          | 90/224 [00:43<01:05,  2.06it/s]
Epoch 49 Iter 91: loss 0.22829. :  40%|█████████████████▋                          | 90/224 [00:44<01:05,  2.06it/s]
Epoch 49 Iter 91: loss 0.22829. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 49 Iter 92: loss 0.23725. :  41%|█████████████████▉                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 49 Iter 92: loss 0.23725. :  41%|██████████████████                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 49 Iter 93: loss 0.24093. :  41%|██████████████████                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 49 Iter 93: loss 0.24093. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 49 Iter 94: loss 0.24320. :  42%|██████████████████▎                         | 93/224 [00:45<01:03,  2.07it/s]
Epoch 49 Iter 94: loss 0.24320. :  42%|██████████████████▍                         | 94/224 [00:45<01:02,  2.08it/s]
Epoch 49 Iter 95: loss 0.24142. :  42%|██████████████████▍                         | 94/224 [00:46<01:02,  2.08it/s]
Epoch 49 Iter 95: loss 0.24142. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 49 Iter 96: loss 0.22532. :  42%|██████████████████▋                         | 95/224 [00:46<01:02,  2.07it/s]
Epoch 49 Iter 96: loss 0.22532. :  43%|██████████████████▊                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 49 Iter 97: loss 0.25166. :  43%|██████████████████▊                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 49 Iter 97: loss 0.25166. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 49 Iter 98: loss 0.24799. :  43%|███████████████████                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 49 Iter 98: loss 0.24799. :  44%|███████████████████▎                        | 98/224 [00:47<01:00,  2.08it/s]
Epoch 49 Iter 99: loss 0.23416. :  44%|███████████████████▎                        | 98/224 [00:48<01:00,  2.08it/s]
Epoch 49 Iter 99: loss 0.23416. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 49 Iter 100: loss 0.20086. :  44%|███████████████████                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 49 Iter 100: loss 0.20086. :  45%|██████████████████▊                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 49 Iter 101: loss 0.21003. :  45%|██████████████████▊                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 49 Iter 101: loss 0.21003. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 49 Iter 102: loss 0.22998. :  45%|██████████████████▉                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 49 Iter 102: loss 0.22998. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 49 Iter 103: loss 0.23188. :  46%|███████████████████▏                      | 102/224 [00:49<00:59,  2.05it/s]
Epoch 49 Iter 103: loss 0.23188. :  46%|███████████████████▎                      | 103/224 [00:49<00:58,  2.06it/s]
Epoch 49 Iter 104: loss 0.24219. :  46%|███████████████████▎                      | 103/224 [00:50<00:58,  2.06it/s]
Epoch 49 Iter 104: loss 0.24219. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 49 Iter 105: loss 0.23946. :  46%|███████████████████▌                      | 104/224 [00:50<00:58,  2.06it/s]
Epoch 49 Iter 105: loss 0.23946. :  47%|███████████████████▋                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 49 Iter 106: loss 0.22385. :  47%|███████████████████▋                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 49 Iter 106: loss 0.22385. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 49 Iter 107: loss 0.21820. :  47%|███████████████████▉                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 49 Iter 107: loss 0.21820. :  48%|████████████████████                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 49 Iter 108: loss 0.22047. :  48%|████████████████████                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 49 Iter 108: loss 0.22047. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 49 Iter 109: loss 0.22500. :  48%|████████████████████▎                     | 108/224 [00:52<00:55,  2.07it/s]
Epoch 49 Iter 109: loss 0.22500. :  49%|████████████████████▍                     | 109/224 [00:52<00:55,  2.07it/s]
Epoch 49 Iter 110: loss 0.23709. :  49%|████████████████████▍                     | 109/224 [00:53<00:55,  2.07it/s]
Epoch 49 Iter 110: loss 0.23709. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 49 Iter 111: loss 0.23980. :  49%|████████████████████▋                     | 110/224 [00:53<00:55,  2.06it/s]
Epoch 49 Iter 111: loss 0.23980. :  50%|████████████████████▊                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 49 Iter 112: loss 0.22649. :  50%|████████████████████▊                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 49 Iter 112: loss 0.22649. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 49 Iter 113: loss 0.23525. :  50%|█████████████████████                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 49 Iter 113: loss 0.23525. :  50%|█████████████████████▏                    | 113/224 [00:54<00:53,  2.07it/s]
Epoch 49 Iter 114: loss 0.21016. :  50%|█████████████████████▏                    | 113/224 [00:55<00:53,  2.07it/s]
Epoch 49 Iter 114: loss 0.21016. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 49 Iter 115: loss 0.23893. :  51%|█████████████████████▍                    | 114/224 [00:55<00:53,  2.05it/s]
Epoch 49 Iter 115: loss 0.23893. :  51%|█████████████████████▌                    | 115/224 [00:55<00:53,  2.06it/s]
Epoch 49 Iter 116: loss 0.23834. :  51%|█████████████████████▌                    | 115/224 [00:56<00:53,  2.06it/s]
Epoch 49 Iter 116: loss 0.23834. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 49 Iter 117: loss 0.23086. :  52%|█████████████████████▊                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 49 Iter 117: loss 0.23086. :  52%|█████████████████████▉                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 49 Iter 118: loss 0.22621. :  52%|█████████████████████▉                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 49 Iter 118: loss 0.22621. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 49 Iter 119: loss 0.19716. :  53%|██████████████████████▏                   | 118/224 [00:57<00:51,  2.06it/s]
Epoch 49 Iter 119: loss 0.19716. :  53%|██████████████████████▎                   | 119/224 [00:57<00:50,  2.06it/s]
Epoch 49 Iter 120: loss 0.23431. :  53%|██████████████████████▎                   | 119/224 [00:58<00:50,  2.06it/s]
Epoch 49 Iter 120: loss 0.23431. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 49 Iter 121: loss 0.23373. :  54%|██████████████████████▌                   | 120/224 [00:58<00:50,  2.07it/s]
Epoch 49 Iter 121: loss 0.23373. :  54%|██████████████████████▋                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 49 Iter 122: loss 0.22523. :  54%|██████████████████████▋                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 49 Iter 122: loss 0.22523. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 49 Iter 123: loss 0.22937. :  54%|██████████████████████▊                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 49 Iter 123: loss 0.22937. :  55%|███████████████████████                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 49 Iter 124: loss 0.22568. :  55%|███████████████████████                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 124: loss 0.22568. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 125: loss 0.25544. :  55%|███████████████████████▎                  | 124/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 125: loss 0.25544. :  56%|███████████████████████▍                  | 125/224 [01:00<00:48,  2.06it/s]
Epoch 49 Iter 126: loss 0.24507. :  56%|███████████████████████▍                  | 125/224 [01:01<00:48,  2.06it/s]
Epoch 49 Iter 126: loss 0.24507. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 49 Iter 127: loss 0.23582. :  56%|███████████████████████▋                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 49 Iter 127: loss 0.23582. :  57%|███████████████████████▊                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 49 Iter 128: loss 0.24557. :  57%|███████████████████████▊                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 49 Iter 128: loss 0.24557. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 49 Iter 129: loss 0.23926. :  57%|████████████████████████                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 49 Iter 129: loss 0.23926. :  58%|████████████████████████▏                 | 129/224 [01:02<00:46,  2.06it/s]
Epoch 49 Iter 130: loss 0.25350. :  58%|████████████████████████▏                 | 129/224 [01:03<00:46,  2.06it/s]
Epoch 49 Iter 130: loss 0.25350. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 49 Iter 131: loss 0.23190. :  58%|████████████████████████▍                 | 130/224 [01:03<00:45,  2.07it/s]
Epoch 49 Iter 131: loss 0.23190. :  58%|████████████████████████▌                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 49 Iter 132: loss 0.24177. :  58%|████████████████████████▌                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 49 Iter 132: loss 0.24177. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 49 Iter 133: loss 0.22530. :  59%|████████████████████████▊                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 49 Iter 133: loss 0.22530. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 49 Iter 134: loss 0.22930. :  59%|████████████████████████▉                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 49 Iter 134: loss 0.22930. :  60%|█████████████████████████▏                | 134/224 [01:04<00:43,  2.07it/s]
Epoch 49 Iter 135: loss 0.24594. :  60%|█████████████████████████▏                | 134/224 [01:05<00:43,  2.07it/s]
Epoch 49 Iter 135: loss 0.24594. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 49 Iter 136: loss 0.23753. :  60%|█████████████████████████▎                | 135/224 [01:05<00:43,  2.07it/s]
Epoch 49 Iter 136: loss 0.23753. :  61%|█████████████████████████▍                | 136/224 [01:05<00:42,  2.06it/s]
Epoch 49 Iter 137: loss 0.22362. :  61%|█████████████████████████▍                | 136/224 [01:06<00:42,  2.06it/s]
Epoch 49 Iter 137: loss 0.22362. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 49 Iter 138: loss 0.24085. :  61%|█████████████████████████▋                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 49 Iter 138: loss 0.24085. :  62%|█████████████████████████▉                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 49 Iter 139: loss 0.23852. :  62%|█████████████████████████▉                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 49 Iter 139: loss 0.23852. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 49 Iter 140: loss 0.21887. :  62%|██████████████████████████                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 49 Iter 140: loss 0.21887. :  62%|██████████████████████████▎               | 140/224 [01:07<00:40,  2.07it/s]
Epoch 49 Iter 141: loss 0.24537. :  62%|██████████████████████████▎               | 140/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 141: loss 0.24537. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 142: loss 0.22394. :  63%|██████████████████████████▍               | 141/224 [01:08<00:40,  2.07it/s]
Epoch 49 Iter 142: loss 0.22394. :  63%|██████████████████████████▋               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 49 Iter 143: loss 0.22931. :  63%|██████████████████████████▋               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 49 Iter 143: loss 0.22931. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 49 Iter 144: loss 0.23363. :  64%|██████████████████████████▊               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 49 Iter 144: loss 0.23363. :  64%|███████████████████████████               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 49 Iter 145: loss 0.23676. :  64%|███████████████████████████               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 49 Iter 145: loss 0.23676. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 49 Iter 146: loss 0.25427. :  65%|███████████████████████████▏              | 145/224 [01:10<00:38,  2.07it/s]
Epoch 49 Iter 146: loss 0.25427. :  65%|███████████████████████████▍              | 146/224 [01:10<00:37,  2.07it/s]
Epoch 49 Iter 147: loss 0.25028. :  65%|███████████████████████████▍              | 146/224 [01:11<00:37,  2.07it/s]
Epoch 49 Iter 147: loss 0.25028. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 49 Iter 148: loss 0.23341. :  66%|███████████████████████████▌              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 49 Iter 148: loss 0.23341. :  66%|███████████████████████████▊              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 49 Iter 149: loss 0.23470. :  66%|███████████████████████████▊              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 149: loss 0.23470. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 150: loss 0.23176. :  67%|███████████████████████████▉              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 49 Iter 150: loss 0.23176. :  67%|████████████████████████████              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 49 Iter 151: loss 0.22425. :  67%|████████████████████████████              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 49 Iter 151: loss 0.22425. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 49 Iter 152: loss 0.23094. :  67%|████████████████████████████▎             | 151/224 [01:13<00:35,  2.05it/s]
Epoch 49 Iter 152: loss 0.23094. :  68%|████████████████████████████▌             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 49 Iter 153: loss 0.25174. :  68%|████████████████████████████▌             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 49 Iter 153: loss 0.25174. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 49 Iter 154: loss 0.24093. :  68%|████████████████████████████▋             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 49 Iter 154: loss 0.24093. :  69%|████████████████████████████▉             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 49 Iter 155: loss 0.24861. :  69%|████████████████████████████▉             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 49 Iter 155: loss 0.24861. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 49 Iter 156: loss 0.21250. :  69%|█████████████████████████████             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 49 Iter 156: loss 0.21250. :  70%|█████████████████████████████▎            | 156/224 [01:15<00:33,  2.06it/s]
Epoch 49 Iter 157: loss 0.22048. :  70%|█████████████████████████████▎            | 156/224 [01:16<00:33,  2.06it/s]
Epoch 49 Iter 157: loss 0.22048. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 49 Iter 158: loss 0.23068. :  70%|█████████████████████████████▍            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 49 Iter 158: loss 0.23068. :  71%|█████████████████████████████▋            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 49 Iter 159: loss 0.21535. :  71%|█████████████████████████████▋            | 158/224 [01:17<00:31,  2.06it/s]
Epoch 49 Iter 159: loss 0.21535. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 49 Iter 160: loss 0.21570. :  71%|█████████████████████████████▊            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 49 Iter 160: loss 0.21570. :  71%|██████████████████████████████            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 49 Iter 161: loss 0.23475. :  71%|██████████████████████████████            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 49 Iter 161: loss 0.23475. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.09it/s]
Epoch 49 Iter 162: loss 0.24105. :  72%|██████████████████████████████▏           | 161/224 [01:18<00:30,  2.09it/s]
Epoch 49 Iter 162: loss 0.24105. :  72%|██████████████████████████████▍           | 162/224 [01:18<00:29,  2.08it/s]
Epoch 49 Iter 163: loss 0.24963. :  72%|██████████████████████████████▍           | 162/224 [01:19<00:29,  2.08it/s]
Epoch 49 Iter 163: loss 0.24963. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.03it/s]
Epoch 49 Iter 164: loss 0.23289. :  73%|██████████████████████████████▌           | 163/224 [01:19<00:29,  2.03it/s]
Epoch 49 Iter 164: loss 0.23289. :  73%|██████████████████████████████▋           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 49 Iter 165: loss 0.22903. :  73%|██████████████████████████████▋           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 49 Iter 165: loss 0.22903. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 49 Iter 166: loss 0.23365. :  74%|██████████████████████████████▉           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 49 Iter 166: loss 0.23365. :  74%|███████████████████████████████▏          | 166/224 [01:20<00:28,  2.03it/s]
Epoch 49 Iter 167: loss 0.22481. :  74%|███████████████████████████████▏          | 166/224 [01:21<00:28,  2.03it/s]
Epoch 49 Iter 167: loss 0.22481. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.04it/s]
Epoch 49 Iter 168: loss 0.24409. :  75%|███████████████████████████████▎          | 167/224 [01:21<00:27,  2.04it/s]
Epoch 49 Iter 168: loss 0.24409. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 49 Iter 169: loss 0.23705. :  75%|███████████████████████████████▌          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 49 Iter 169: loss 0.23705. :  75%|███████████████████████████████▋          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 49 Iter 170: loss 0.22438. :  75%|███████████████████████████████▋          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 49 Iter 170: loss 0.22438. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 49 Iter 171: loss 0.24600. :  76%|███████████████████████████████▉          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 49 Iter 171: loss 0.24600. :  76%|████████████████████████████████          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 49 Iter 172: loss 0.21473. :  76%|████████████████████████████████          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 49 Iter 172: loss 0.21473. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 49 Iter 173: loss 0.23728. :  77%|████████████████████████████████▎         | 172/224 [01:23<00:25,  2.07it/s]
Epoch 49 Iter 173: loss 0.23728. :  77%|████████████████████████████████▍         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 49 Iter 174: loss 0.21563. :  77%|████████████████████████████████▍         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 49 Iter 174: loss 0.21563. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 49 Iter 175: loss 0.22490. :  78%|████████████████████████████████▋         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 49 Iter 175: loss 0.22490. :  78%|████████████████████████████████▊         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 49 Iter 176: loss 0.22887. :  78%|████████████████████████████████▊         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 49 Iter 176: loss 0.22887. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 49 Iter 177: loss 0.22153. :  79%|█████████████████████████████████         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 49 Iter 177: loss 0.22153. :  79%|█████████████████████████████████▏        | 177/224 [01:25<00:22,  2.05it/s]
Epoch 49 Iter 178: loss 0.24536. :  79%|█████████████████████████████████▏        | 177/224 [01:26<00:22,  2.05it/s]
Epoch 49 Iter 178: loss 0.24536. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 49 Iter 179: loss 0.22916. :  79%|█████████████████████████████████▍        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 49 Iter 179: loss 0.22916. :  80%|█████████████████████████████████▌        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 49 Iter 180: loss 0.22702. :  80%|█████████████████████████████████▌        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 49 Iter 180: loss 0.22702. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.04it/s]
Epoch 49 Iter 181: loss 0.21748. :  80%|█████████████████████████████████▊        | 180/224 [01:27<00:21,  2.04it/s]
Epoch 49 Iter 181: loss 0.21748. :  81%|█████████████████████████████████▉        | 181/224 [01:27<00:20,  2.05it/s]
Epoch 49 Iter 182: loss 0.24505. :  81%|█████████████████████████████████▉        | 181/224 [01:28<00:20,  2.05it/s]
Epoch 49 Iter 182: loss 0.24505. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 49 Iter 183: loss 0.21165. :  81%|██████████████████████████████████▏       | 182/224 [01:28<00:20,  2.05it/s]
Epoch 49 Iter 183: loss 0.21165. :  82%|██████████████████████████████████▎       | 183/224 [01:28<00:20,  2.03it/s]
Epoch 49 Iter 184: loss 0.25687. :  82%|██████████████████████████████████▎       | 183/224 [01:29<00:20,  2.03it/s]
Epoch 49 Iter 184: loss 0.25687. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.02it/s]
Epoch 49 Iter 185: loss 0.23410. :  82%|██████████████████████████████████▌       | 184/224 [01:29<00:19,  2.02it/s]
Epoch 49 Iter 185: loss 0.23410. :  83%|██████████████████████████████████▋       | 185/224 [01:29<00:19,  2.03it/s]
Epoch 49 Iter 186: loss 0.22591. :  83%|██████████████████████████████████▋       | 185/224 [01:30<00:19,  2.03it/s]
Epoch 49 Iter 186: loss 0.22591. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.03it/s]
Epoch 49 Iter 187: loss 0.22908. :  83%|██████████████████████████████████▉       | 186/224 [01:30<00:18,  2.03it/s]
Epoch 49 Iter 187: loss 0.22908. :  83%|███████████████████████████████████       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 49 Iter 188: loss 0.26111. :  83%|███████████████████████████████████       | 187/224 [01:31<00:18,  2.04it/s]
Epoch 49 Iter 188: loss 0.26111. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 49 Iter 189: loss 0.23916. :  84%|███████████████████████████████████▎      | 188/224 [01:31<00:17,  2.06it/s]
Epoch 49 Iter 189: loss 0.23916. :  84%|███████████████████████████████████▍      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 49 Iter 190: loss 0.23635. :  84%|███████████████████████████████████▍      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 49 Iter 190: loss 0.23635. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 49 Iter 191: loss 0.24148. :  85%|███████████████████████████████████▋      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 49 Iter 191: loss 0.24148. :  85%|███████████████████████████████████▊      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 49 Iter 192: loss 0.20737. :  85%|███████████████████████████████████▊      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 49 Iter 192: loss 0.20737. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 49 Iter 193: loss 0.23719. :  86%|████████████████████████████████████      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 49 Iter 193: loss 0.23719. :  86%|████████████████████████████████████▏     | 193/224 [01:33<00:14,  2.07it/s]
Epoch 49 Iter 194: loss 0.22467. :  86%|████████████████████████████████████▏     | 193/224 [01:34<00:14,  2.07it/s]
Epoch 49 Iter 194: loss 0.22467. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 49 Iter 195: loss 0.23366. :  87%|████████████████████████████████████▍     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 49 Iter 195: loss 0.23366. :  87%|████████████████████████████████████▌     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 49 Iter 196: loss 0.21408. :  87%|████████████████████████████████████▌     | 195/224 [01:35<00:13,  2.07it/s]
Epoch 49 Iter 196: loss 0.21408. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 49 Iter 197: loss 0.23607. :  88%|████████████████████████████████████▊     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 49 Iter 197: loss 0.23607. :  88%|████████████████████████████████████▉     | 197/224 [01:35<00:13,  2.08it/s]
Epoch 49 Iter 198: loss 0.24171. :  88%|████████████████████████████████████▉     | 197/224 [01:36<00:13,  2.08it/s]
Epoch 49 Iter 198: loss 0.24171. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.08it/s]
Epoch 49 Iter 199: loss 0.23088. :  88%|█████████████████████████████████████▏    | 198/224 [01:36<00:12,  2.08it/s]
Epoch 49 Iter 199: loss 0.23088. :  89%|█████████████████████████████████████▎    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 49 Iter 200: loss 0.24078. :  89%|█████████████████████████████████████▎    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 49 Iter 200: loss 0.24078. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 49 Iter 201: loss 0.22606. :  89%|█████████████████████████████████████▌    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 49 Iter 201: loss 0.22606. :  90%|█████████████████████████████████████▋    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 49 Iter 202: loss 0.22453. :  90%|█████████████████████████████████████▋    | 201/224 [01:38<00:11,  2.07it/s]
Epoch 49 Iter 202: loss 0.22453. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 49 Iter 203: loss 0.20679. :  90%|█████████████████████████████████████▉    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 49 Iter 203: loss 0.20679. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 49 Iter 204: loss 0.22628. :  91%|██████████████████████████████████████    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 49 Iter 204: loss 0.22628. :  91%|██████████████████████████████████████▎   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 49 Iter 205: loss 0.22643. :  91%|██████████████████████████████████████▎   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 49 Iter 205: loss 0.22643. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 49 Iter 206: loss 0.23936. :  92%|██████████████████████████████████████▍   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 49 Iter 206: loss 0.23936. :  92%|██████████████████████████████████████▋   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 49 Iter 207: loss 0.24078. :  92%|██████████████████████████████████████▋   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 49 Iter 207: loss 0.24078. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 49 Iter 208: loss 0.23124. :  92%|██████████████████████████████████████▊   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 49 Iter 208: loss 0.23124. :  93%|███████████████████████████████████████   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 49 Iter 209: loss 0.22523. :  93%|███████████████████████████████████████   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 49 Iter 209: loss 0.22523. :  93%|███████████████████████████████████████▏  | 209/224 [01:41<00:07,  2.06it/s]
Epoch 49 Iter 210: loss 0.22104. :  93%|███████████████████████████████████████▏  | 209/224 [01:42<00:07,  2.06it/s]
Epoch 49 Iter 210: loss 0.22104. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:09,  1.55it/s]
Epoch 49 Iter 211: loss 0.23620. :  94%|███████████████████████████████████████▍  | 210/224 [01:42<00:09,  1.55it/s]
Epoch 49 Iter 211: loss 0.23620. :  94%|███████████████████████████████████████▌  | 211/224 [01:42<00:07,  1.67it/s]
Epoch 49 Iter 212: loss 0.21012. :  94%|███████████████████████████████████████▌  | 211/224 [01:43<00:07,  1.67it/s]
Epoch 49 Iter 212: loss 0.21012. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:06,  1.76it/s]
Epoch 49 Iter 213: loss 0.21836. :  95%|███████████████████████████████████████▊  | 212/224 [01:43<00:06,  1.76it/s]
Epoch 49 Iter 213: loss 0.21836. :  95%|███████████████████████████████████████▉  | 213/224 [01:43<00:05,  1.84it/s]
Epoch 49 Iter 214: loss 0.23335. :  95%|███████████████████████████████████████▉  | 213/224 [01:44<00:05,  1.84it/s]
Epoch 49 Iter 214: loss 0.23335. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:05,  1.92it/s]
Epoch 49 Iter 215: loss 0.23294. :  96%|████████████████████████████████████████▏ | 214/224 [01:44<00:05,  1.92it/s]
Epoch 49 Iter 215: loss 0.23294. :  96%|████████████████████████████████████████▎ | 215/224 [01:44<00:04,  1.97it/s]
Epoch 49 Iter 216: loss 0.24038. :  96%|████████████████████████████████████████▎ | 215/224 [01:45<00:04,  1.97it/s]
Epoch 49 Iter 216: loss 0.24038. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.00it/s]
Epoch 49 Iter 217: loss 0.23271. :  96%|████████████████████████████████████████▌ | 216/224 [01:45<00:03,  2.00it/s]
Epoch 49 Iter 217: loss 0.23271. :  97%|████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.02it/s]
Epoch 49 Iter 218: loss 0.25437. :  97%|████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.02it/s]
Epoch 49 Iter 218: loss 0.25437. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 49 Iter 219: loss 0.23463. :  97%|████████████████████████████████████████▉ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 49 Iter 219: loss 0.23463. :  98%|█████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 49 Iter 220: loss 0.23002. :  98%|█████████████████████████████████████████ | 219/224 [01:47<00:02,  2.06it/s]
Epoch 49 Iter 220: loss 0.23002. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 49 Iter 221: loss 0.22378. :  98%|█████████████████████████████████████████▎| 220/224 [01:47<00:01,  2.06it/s]
Epoch 49 Iter 221: loss 0.22378. :  99%|█████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.09it/s]
Epoch 49 Iter 222: loss 0.22854. :  99%|█████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.09it/s]
Epoch 49 Iter 222: loss 0.22854. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.09it/s]
Epoch 49 Iter 223: loss 0.23895. :  99%|█████████████████████████████████████████▋| 222/224 [01:48<00:00,  2.09it/s]
Epoch 49 Iter 223: loss 0.23895. : 100%|█████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.11it/s]
Epoch 49 Iter 224: loss 0.23191. : 100%|█████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.11it/s]
Epoch 49 Iter 224: loss 0.23191. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.12it/s]
Epoch 49 Iter 224: loss 0.23191. : 100%|██████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]

    Train loss: 0.23256
    Valid loss: 0.23397
       Valid loss recons: 0.22172
       Valid loss KL-D:   1.22535
  0%|                                                                                       | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.24291. :   0%|                                                      | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.24291. :   0%|▏                                             | 1/224 [00:00<01:42,  2.17it/s]
Epoch 50 Iter 2: loss 0.23208. :   0%|▏                                             | 1/224 [00:00<01:42,  2.17it/s]
Epoch 50 Iter 2: loss 0.23208. :   1%|▍                                             | 2/224 [00:00<01:41,  2.19it/s]
Epoch 50 Iter 3: loss 0.23099. :   1%|▍                                             | 2/224 [00:01<01:41,  2.19it/s]
Epoch 50 Iter 3: loss 0.23099. :   1%|▌                                             | 3/224 [00:01<01:41,  2.17it/s]
Epoch 50 Iter 4: loss 0.24210. :   1%|▌                                             | 3/224 [00:01<01:41,  2.17it/s]
Epoch 50 Iter 4: loss 0.24210. :   2%|▊                                             | 4/224 [00:01<01:40,  2.19it/s]
Epoch 50 Iter 5: loss 0.23701. :   2%|▊                                             | 4/224 [00:02<01:40,  2.19it/s]
Epoch 50 Iter 5: loss 0.23701. :   2%|█                                             | 5/224 [00:02<01:40,  2.18it/s]
Epoch 50 Iter 6: loss 0.21070. :   2%|█                                             | 5/224 [00:02<01:40,  2.18it/s]
Epoch 50 Iter 6: loss 0.21070. :   3%|█▏                                            | 6/224 [00:02<01:40,  2.17it/s]
Epoch 50 Iter 7: loss 0.22915. :   3%|█▏                                            | 6/224 [00:03<01:40,  2.17it/s]
Epoch 50 Iter 7: loss 0.22915. :   3%|█▍                                            | 7/224 [00:03<01:40,  2.16it/s]
Epoch 50 Iter 8: loss 0.23751. :   3%|█▍                                            | 7/224 [00:03<01:40,  2.16it/s]
Epoch 50 Iter 8: loss 0.23751. :   4%|█▋                                            | 8/224 [00:03<01:39,  2.17it/s]
Epoch 50 Iter 9: loss 0.25036. :   4%|█▋                                            | 8/224 [00:04<01:39,  2.17it/s]
Epoch 50 Iter 9: loss 0.25036. :   4%|█▊                                            | 9/224 [00:04<01:39,  2.15it/s]
Epoch 50 Iter 10: loss 0.22746. :   4%|█▊                                           | 9/224 [00:04<01:39,  2.15it/s]
Epoch 50 Iter 10: loss 0.22746. :   4%|█▉                                          | 10/224 [00:04<01:39,  2.15it/s]
Epoch 50 Iter 11: loss 0.25062. :   4%|█▉                                          | 10/224 [00:05<01:39,  2.15it/s]
Epoch 50 Iter 11: loss 0.25062. :   5%|██▏                                         | 11/224 [00:05<01:38,  2.16it/s]
Epoch 50 Iter 12: loss 0.22975. :   5%|██▏                                         | 11/224 [00:05<01:38,  2.16it/s]
Epoch 50 Iter 12: loss 0.22975. :   5%|██▎                                         | 12/224 [00:05<01:37,  2.17it/s]
Epoch 50 Iter 13: loss 0.22502. :   5%|██▎                                         | 12/224 [00:05<01:37,  2.17it/s]
Epoch 50 Iter 13: loss 0.22502. :   6%|██▌                                         | 13/224 [00:05<01:37,  2.18it/s]
Epoch 50 Iter 14: loss 0.23208. :   6%|██▌                                         | 13/224 [00:06<01:37,  2.18it/s]
Epoch 50 Iter 14: loss 0.23208. :   6%|██▊                                         | 14/224 [00:06<01:36,  2.17it/s]
Epoch 50 Iter 15: loss 0.23068. :   6%|██▊                                         | 14/224 [00:06<01:36,  2.17it/s]
Epoch 50 Iter 15: loss 0.23068. :   7%|██▉                                         | 15/224 [00:06<01:36,  2.17it/s]
Epoch 50 Iter 16: loss 0.23355. :   7%|██▉                                         | 15/224 [00:07<01:36,  2.17it/s]
Epoch 50 Iter 16: loss 0.23355. :   7%|███▏                                        | 16/224 [00:07<01:35,  2.17it/s]
Epoch 50 Iter 17: loss 0.22676. :   7%|███▏                                        | 16/224 [00:07<01:35,  2.17it/s]
Epoch 50 Iter 17: loss 0.22676. :   8%|███▎                                        | 17/224 [00:07<01:35,  2.17it/s]
Epoch 50 Iter 18: loss 0.25378. :   8%|███▎                                        | 17/224 [00:08<01:35,  2.17it/s]
Epoch 50 Iter 18: loss 0.25378. :   8%|███▌                                        | 18/224 [00:08<01:34,  2.17it/s]
Epoch 50 Iter 19: loss 0.23393. :   8%|███▌                                        | 18/224 [00:08<01:34,  2.17it/s]
Epoch 50 Iter 19: loss 0.23393. :   8%|███▋                                        | 19/224 [00:08<01:34,  2.17it/s]
Epoch 50 Iter 20: loss 0.21276. :   8%|███▋                                        | 19/224 [00:09<01:34,  2.17it/s]
Epoch 50 Iter 20: loss 0.21276. :   9%|███▉                                        | 20/224 [00:09<01:34,  2.15it/s]
Epoch 50 Iter 21: loss 0.25288. :   9%|███▉                                        | 20/224 [00:09<01:34,  2.15it/s]
Epoch 50 Iter 21: loss 0.25288. :   9%|████▏                                       | 21/224 [00:09<01:34,  2.15it/s]
Epoch 50 Iter 22: loss 0.21985. :   9%|████▏                                       | 21/224 [00:10<01:34,  2.15it/s]
Epoch 50 Iter 22: loss 0.21985. :  10%|████▎                                       | 22/224 [00:10<01:33,  2.17it/s]
Epoch 50 Iter 23: loss 0.22300. :  10%|████▎                                       | 22/224 [00:10<01:33,  2.17it/s]
Epoch 50 Iter 23: loss 0.22300. :  10%|████▌                                       | 23/224 [00:10<01:32,  2.17it/s]
Epoch 50 Iter 24: loss 0.22011. :  10%|████▌                                       | 23/224 [00:11<01:32,  2.17it/s]
Epoch 50 Iter 24: loss 0.22011. :  11%|████▋                                       | 24/224 [00:11<01:31,  2.17it/s]
Epoch 50 Iter 25: loss 0.23979. :  11%|████▋                                       | 24/224 [00:11<01:31,  2.17it/s]
Epoch 50 Iter 25: loss 0.23979. :  11%|████▉                                       | 25/224 [00:11<01:31,  2.18it/s]
Epoch 50 Iter 26: loss 0.22067. :  11%|████▉                                       | 25/224 [00:11<01:31,  2.18it/s]
Epoch 50 Iter 26: loss 0.22067. :  12%|█████                                       | 26/224 [00:11<01:30,  2.19it/s]
Epoch 50 Iter 27: loss 0.25074. :  12%|█████                                       | 26/224 [00:12<01:30,  2.19it/s]
Epoch 50 Iter 27: loss 0.25074. :  12%|█████▎                                      | 27/224 [00:12<01:30,  2.17it/s]
Epoch 50 Iter 28: loss 0.22960. :  12%|█████▎                                      | 27/224 [00:12<01:30,  2.17it/s]
Epoch 50 Iter 28: loss 0.22960. :  12%|█████▌                                      | 28/224 [00:12<01:30,  2.17it/s]
Epoch 50 Iter 29: loss 0.23041. :  12%|█████▌                                      | 28/224 [00:13<01:30,  2.17it/s]
Epoch 50 Iter 29: loss 0.23041. :  13%|█████▋                                      | 29/224 [00:13<01:29,  2.17it/s]
Epoch 50 Iter 30: loss 0.21943. :  13%|█████▋                                      | 29/224 [00:13<01:29,  2.17it/s]
Epoch 50 Iter 30: loss 0.21943. :  13%|█████▉                                      | 30/224 [00:13<01:29,  2.17it/s]
Epoch 50 Iter 31: loss 0.23474. :  13%|█████▉                                      | 30/224 [00:14<01:29,  2.17it/s]
Epoch 50 Iter 31: loss 0.23474. :  14%|██████                                      | 31/224 [00:14<01:30,  2.14it/s]
Epoch 50 Iter 32: loss 0.23052. :  14%|██████                                      | 31/224 [00:14<01:30,  2.14it/s]
Epoch 50 Iter 32: loss 0.23052. :  14%|██████▎                                     | 32/224 [00:14<01:29,  2.15it/s]
Epoch 50 Iter 33: loss 0.22572. :  14%|██████▎                                     | 32/224 [00:15<01:29,  2.15it/s]
Epoch 50 Iter 33: loss 0.22572. :  15%|██████▍                                     | 33/224 [00:15<01:28,  2.16it/s]
Epoch 50 Iter 34: loss 0.24624. :  15%|██████▍                                     | 33/224 [00:15<01:28,  2.16it/s]
Epoch 50 Iter 34: loss 0.24624. :  15%|██████▋                                     | 34/224 [00:15<01:27,  2.16it/s]
Epoch 50 Iter 35: loss 0.23791. :  15%|██████▋                                     | 34/224 [00:16<01:27,  2.16it/s]
Epoch 50 Iter 35: loss 0.23791. :  16%|██████▉                                     | 35/224 [00:16<01:27,  2.17it/s]
Epoch 50 Iter 36: loss 0.23671. :  16%|██████▉                                     | 35/224 [00:16<01:27,  2.17it/s]
Epoch 50 Iter 36: loss 0.23671. :  16%|███████                                     | 36/224 [00:16<01:26,  2.18it/s]
Epoch 50 Iter 37: loss 0.24443. :  16%|███████                                     | 36/224 [00:17<01:26,  2.18it/s]
Epoch 50 Iter 37: loss 0.24443. :  17%|███████▎                                    | 37/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 38: loss 0.22646. :  17%|███████▎                                    | 37/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 38: loss 0.22646. :  17%|███████▍                                    | 38/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 39: loss 0.23801. :  17%|███████▍                                    | 38/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 39: loss 0.23801. :  17%|███████▋                                    | 39/224 [00:17<01:24,  2.18it/s]
Epoch 50 Iter 40: loss 0.23006. :  17%|███████▋                                    | 39/224 [00:18<01:24,  2.18it/s]
Epoch 50 Iter 40: loss 0.23006. :  18%|███████▊                                    | 40/224 [00:18<01:23,  2.20it/s]
Epoch 50 Iter 41: loss 0.22417. :  18%|███████▊                                    | 40/224 [00:18<01:23,  2.20it/s]
Epoch 50 Iter 41: loss 0.22417. :  18%|████████                                    | 41/224 [00:18<01:23,  2.19it/s]
Epoch 50 Iter 42: loss 0.23702. :  18%|████████                                    | 41/224 [00:19<01:23,  2.19it/s]
Epoch 50 Iter 42: loss 0.23702. :  19%|████████▎                                   | 42/224 [00:19<01:22,  2.20it/s]
Epoch 50 Iter 43: loss 0.22324. :  19%|████████▎                                   | 42/224 [00:19<01:22,  2.20it/s]
Epoch 50 Iter 43: loss 0.22324. :  19%|████████▍                                   | 43/224 [00:19<01:21,  2.22it/s]
Epoch 50 Iter 44: loss 0.23932. :  19%|████████▍                                   | 43/224 [00:20<01:21,  2.22it/s]
Epoch 50 Iter 44: loss 0.23932. :  20%|████████▋                                   | 44/224 [00:20<01:22,  2.19it/s]
Epoch 50 Iter 45: loss 0.23336. :  20%|████████▋                                   | 44/224 [00:20<01:22,  2.19it/s]
Epoch 50 Iter 45: loss 0.23336. :  20%|████████▊                                   | 45/224 [00:20<01:21,  2.20it/s]
Epoch 50 Iter 46: loss 0.25228. :  20%|████████▊                                   | 45/224 [00:21<01:21,  2.20it/s]
Epoch 50 Iter 46: loss 0.25228. :  21%|█████████                                   | 46/224 [00:21<01:20,  2.20it/s]
Epoch 50 Iter 47: loss 0.25235. :  21%|█████████                                   | 46/224 [00:21<01:20,  2.20it/s]
Epoch 50 Iter 47: loss 0.25235. :  21%|█████████▏                                  | 47/224 [00:21<01:20,  2.20it/s]
Epoch 50 Iter 48: loss 0.22500. :  21%|█████████▏                                  | 47/224 [00:22<01:20,  2.20it/s]
Epoch 50 Iter 48: loss 0.22500. :  21%|█████████▍                                  | 48/224 [00:22<01:20,  2.19it/s]
Epoch 50 Iter 49: loss 0.24082. :  21%|█████████▍                                  | 48/224 [00:22<01:20,  2.19it/s]
Epoch 50 Iter 49: loss 0.24082. :  22%|█████████▋                                  | 49/224 [00:22<01:20,  2.19it/s]
Epoch 50 Iter 50: loss 0.21785. :  22%|█████████▋                                  | 49/224 [00:22<01:20,  2.19it/s]
Epoch 50 Iter 50: loss 0.21785. :  22%|█████████▊                                  | 50/224 [00:22<01:19,  2.18it/s]
Epoch 50 Iter 51: loss 0.23267. :  22%|█████████▊                                  | 50/224 [00:23<01:19,  2.18it/s]
Epoch 50 Iter 51: loss 0.23267. :  23%|██████████                                  | 51/224 [00:23<01:19,  2.19it/s]
Epoch 50 Iter 52: loss 0.25178. :  23%|██████████                                  | 51/224 [00:23<01:19,  2.19it/s]
Epoch 50 Iter 52: loss 0.25178. :  23%|██████████▏                                 | 52/224 [00:23<01:18,  2.19it/s]
Epoch 50 Iter 53: loss 0.23450. :  23%|██████████▏                                 | 52/224 [00:24<01:18,  2.19it/s]
Epoch 50 Iter 53: loss 0.23450. :  24%|██████████▍                                 | 53/224 [00:24<01:18,  2.18it/s]
Epoch 50 Iter 54: loss 0.24031. :  24%|██████████▍                                 | 53/224 [00:24<01:18,  2.18it/s]
Epoch 50 Iter 54: loss 0.24031. :  24%|██████████▌                                 | 54/224 [00:24<01:17,  2.20it/s]
Epoch 50 Iter 55: loss 0.21609. :  24%|██████████▌                                 | 54/224 [00:25<01:17,  2.20it/s]
Epoch 50 Iter 55: loss 0.21609. :  25%|██████████▊                                 | 55/224 [00:25<01:17,  2.19it/s]
Epoch 50 Iter 56: loss 0.25080. :  25%|██████████▊                                 | 55/224 [00:25<01:17,  2.19it/s]
Epoch 50 Iter 56: loss 0.25080. :  25%|███████████                                 | 56/224 [00:25<01:16,  2.19it/s]
Epoch 50 Iter 57: loss 0.25032. :  25%|███████████                                 | 56/224 [00:26<01:16,  2.19it/s]
Epoch 50 Iter 57: loss 0.25032. :  25%|███████████▏                                | 57/224 [00:26<01:16,  2.19it/s]
Epoch 50 Iter 58: loss 0.22957. :  25%|███████████▏                                | 57/224 [00:26<01:16,  2.19it/s]
Epoch 50 Iter 58: loss 0.22957. :  26%|███████████▍                                | 58/224 [00:26<01:16,  2.18it/s]
Epoch 50 Iter 59: loss 0.23251. :  26%|███████████▍                                | 58/224 [00:27<01:16,  2.18it/s]
Epoch 50 Iter 59: loss 0.23251. :  26%|███████████▌                                | 59/224 [00:27<01:15,  2.17it/s]
Epoch 50 Iter 60: loss 0.21575. :  26%|███████████▌                                | 59/224 [00:27<01:15,  2.17it/s]
Epoch 50 Iter 60: loss 0.21575. :  27%|███████████▊                                | 60/224 [00:27<01:15,  2.18it/s]
Epoch 50 Iter 61: loss 0.21013. :  27%|███████████▊                                | 60/224 [00:28<01:15,  2.18it/s]
Epoch 50 Iter 61: loss 0.21013. :  27%|███████████▉                                | 61/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 62: loss 0.22123. :  27%|███████████▉                                | 61/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 62: loss 0.22123. :  28%|████████████▏                               | 62/224 [00:28<01:14,  2.17it/s]
Epoch 50 Iter 63: loss 0.22898. :  28%|████████████▏                               | 62/224 [00:28<01:14,  2.17it/s]
Epoch 50 Iter 63: loss 0.22898. :  28%|████████████▍                               | 63/224 [00:28<01:13,  2.18it/s]
Epoch 50 Iter 64: loss 0.23117. :  28%|████████████▍                               | 63/224 [00:29<01:13,  2.18it/s]
Epoch 50 Iter 64: loss 0.23117. :  29%|████████████▌                               | 64/224 [00:29<01:13,  2.17it/s]
Epoch 50 Iter 65: loss 0.21700. :  29%|████████████▌                               | 64/224 [00:29<01:13,  2.17it/s]
Epoch 50 Iter 65: loss 0.21700. :  29%|████████████▊                               | 65/224 [00:29<01:12,  2.20it/s]
Epoch 50 Iter 66: loss 0.22661. :  29%|████████████▊                               | 65/224 [00:30<01:12,  2.20it/s]
Epoch 50 Iter 66: loss 0.22661. :  29%|████████████▉                               | 66/224 [00:30<01:11,  2.20it/s]
Epoch 50 Iter 67: loss 0.21936. :  29%|████████████▉                               | 66/224 [00:30<01:11,  2.20it/s]
Epoch 50 Iter 67: loss 0.21936. :  30%|█████████████▏                              | 67/224 [00:30<01:12,  2.17it/s]
Epoch 50 Iter 68: loss 0.22758. :  30%|█████████████▏                              | 67/224 [00:31<01:12,  2.17it/s]
Epoch 50 Iter 68: loss 0.22758. :  30%|█████████████▎                              | 68/224 [00:31<01:12,  2.16it/s]
Epoch 50 Iter 69: loss 0.21790. :  30%|█████████████▎                              | 68/224 [00:31<01:12,  2.16it/s]
Epoch 50 Iter 69: loss 0.21790. :  31%|█████████████▌                              | 69/224 [00:31<01:12,  2.15it/s]
Epoch 50 Iter 70: loss 0.22777. :  31%|█████████████▌                              | 69/224 [00:32<01:12,  2.15it/s]
Epoch 50 Iter 70: loss 0.22777. :  31%|█████████████▊                              | 70/224 [00:32<01:11,  2.16it/s]
Epoch 50 Iter 71: loss 0.24192. :  31%|█████████████▊                              | 70/224 [00:32<01:11,  2.16it/s]
Epoch 50 Iter 71: loss 0.24192. :  32%|█████████████▉                              | 71/224 [00:32<01:10,  2.16it/s]
Epoch 50 Iter 72: loss 0.23673. :  32%|█████████████▉                              | 71/224 [00:33<01:10,  2.16it/s]
Epoch 50 Iter 72: loss 0.23673. :  32%|██████████████▏                             | 72/224 [00:33<01:09,  2.17it/s]
Epoch 50 Iter 73: loss 0.22558. :  32%|██████████████▏                             | 72/224 [00:33<01:09,  2.17it/s]
Epoch 50 Iter 73: loss 0.22558. :  33%|██████████████▎                             | 73/224 [00:33<01:09,  2.17it/s]
Epoch 50 Iter 74: loss 0.23525. :  33%|██████████████▎                             | 73/224 [00:33<01:09,  2.17it/s]
Epoch 50 Iter 74: loss 0.23525. :  33%|██████████████▌                             | 74/224 [00:33<01:08,  2.19it/s]
Epoch 50 Iter 75: loss 0.24877. :  33%|██████████████▌                             | 74/224 [00:34<01:08,  2.19it/s]
Epoch 50 Iter 75: loss 0.24877. :  33%|██████████████▋                             | 75/224 [00:34<01:07,  2.19it/s]
Epoch 50 Iter 76: loss 0.24136. :  33%|██████████████▋                             | 75/224 [00:34<01:07,  2.19it/s]
Epoch 50 Iter 76: loss 0.24136. :  34%|██████████████▉                             | 76/224 [00:34<01:07,  2.19it/s]
Epoch 50 Iter 77: loss 0.23171. :  34%|██████████████▉                             | 76/224 [00:35<01:07,  2.19it/s]
Epoch 50 Iter 77: loss 0.23171. :  34%|███████████████▏                            | 77/224 [00:35<01:07,  2.19it/s]
Epoch 50 Iter 78: loss 0.22240. :  34%|███████████████▏                            | 77/224 [00:35<01:07,  2.19it/s]
Epoch 50 Iter 78: loss 0.22240. :  35%|███████████████▎                            | 78/224 [00:35<01:06,  2.20it/s]
Epoch 50 Iter 79: loss 0.23059. :  35%|███████████████▎                            | 78/224 [00:36<01:06,  2.20it/s]
Epoch 50 Iter 79: loss 0.23059. :  35%|███████████████▌                            | 79/224 [00:36<01:05,  2.21it/s]
Epoch 50 Iter 80: loss 0.24266. :  35%|███████████████▌                            | 79/224 [00:36<01:05,  2.21it/s]
Epoch 50 Iter 80: loss 0.24266. :  36%|███████████████▋                            | 80/224 [00:36<01:05,  2.20it/s]
Epoch 50 Iter 81: loss 0.23114. :  36%|███████████████▋                            | 80/224 [00:37<01:05,  2.20it/s]
Epoch 50 Iter 81: loss 0.23114. :  36%|███████████████▉                            | 81/224 [00:37<01:04,  2.20it/s]
Epoch 50 Iter 82: loss 0.24390. :  36%|███████████████▉                            | 81/224 [00:37<01:04,  2.20it/s]
Epoch 50 Iter 82: loss 0.24390. :  37%|████████████████                            | 82/224 [00:37<01:04,  2.19it/s]
Epoch 50 Iter 83: loss 0.23285. :  37%|████████████████                            | 82/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 83: loss 0.23285. :  37%|████████████████▎                           | 83/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 84: loss 0.23368. :  37%|████████████████▎                           | 83/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 84: loss 0.23368. :  38%|████████████████▌                           | 84/224 [00:38<01:04,  2.18it/s]
Epoch 50 Iter 85: loss 0.23132. :  38%|████████████████▌                           | 84/224 [00:39<01:04,  2.18it/s]
Epoch 50 Iter 85: loss 0.23132. :  38%|████████████████▋                           | 85/224 [00:39<01:03,  2.18it/s]
Epoch 50 Iter 86: loss 0.23815. :  38%|████████████████▋                           | 85/224 [00:39<01:03,  2.18it/s]
Epoch 50 Iter 86: loss 0.23815. :  38%|████████████████▉                           | 86/224 [00:39<01:03,  2.19it/s]
Epoch 50 Iter 87: loss 0.22577. :  38%|████████████████▉                           | 86/224 [00:39<01:03,  2.19it/s]
Epoch 50 Iter 87: loss 0.22577. :  39%|█████████████████                           | 87/224 [00:39<01:02,  2.19it/s]
Epoch 50 Iter 88: loss 0.21829. :  39%|█████████████████                           | 87/224 [00:40<01:02,  2.19it/s]
Epoch 50 Iter 88: loss 0.21829. :  39%|█████████████████▎                          | 88/224 [00:40<01:01,  2.20it/s]
Epoch 50 Iter 89: loss 0.24559. :  39%|█████████████████▎                          | 88/224 [00:40<01:01,  2.20it/s]
Epoch 50 Iter 89: loss 0.24559. :  40%|█████████████████▍                          | 89/224 [00:40<01:01,  2.20it/s]
Epoch 50 Iter 90: loss 0.22311. :  40%|█████████████████▍                          | 89/224 [00:41<01:01,  2.20it/s]
Epoch 50 Iter 90: loss 0.22311. :  40%|█████████████████▋                          | 90/224 [00:41<01:01,  2.17it/s]
Epoch 50 Iter 91: loss 0.24563. :  40%|█████████████████▋                          | 90/224 [00:41<01:01,  2.17it/s]
Epoch 50 Iter 91: loss 0.24563. :  41%|█████████████████▉                          | 91/224 [00:41<01:01,  2.17it/s]
Epoch 50 Iter 92: loss 0.23463. :  41%|█████████████████▉                          | 91/224 [00:42<01:01,  2.17it/s]
Epoch 50 Iter 92: loss 0.23463. :  41%|██████████████████                          | 92/224 [00:42<01:00,  2.18it/s]
Epoch 50 Iter 93: loss 0.24301. :  41%|██████████████████                          | 92/224 [00:42<01:00,  2.18it/s]
Epoch 50 Iter 93: loss 0.24301. :  42%|██████████████████▎                         | 93/224 [00:42<01:00,  2.18it/s]
Epoch 50 Iter 94: loss 0.22638. :  42%|██████████████████▎                         | 93/224 [00:43<01:00,  2.18it/s]
Epoch 50 Iter 94: loss 0.22638. :  42%|██████████████████▍                         | 94/224 [00:43<00:59,  2.17it/s]
Epoch 50 Iter 95: loss 0.24065. :  42%|██████████████████▍                         | 94/224 [00:43<00:59,  2.17it/s]
Epoch 50 Iter 95: loss 0.24065. :  42%|██████████████████▋                         | 95/224 [00:43<00:59,  2.18it/s]
Epoch 50 Iter 96: loss 0.24649. :  42%|██████████████████▋                         | 95/224 [00:44<00:59,  2.18it/s]
Epoch 50 Iter 96: loss 0.24649. :  43%|██████████████████▊                         | 96/224 [00:44<00:58,  2.18it/s]
Epoch 50 Iter 97: loss 0.23549. :  43%|██████████████████▊                         | 96/224 [00:44<00:58,  2.18it/s]
Epoch 50 Iter 97: loss 0.23549. :  43%|███████████████████                         | 97/224 [00:44<00:57,  2.19it/s]
Epoch 50 Iter 98: loss 0.22703. :  43%|███████████████████                         | 97/224 [00:44<00:57,  2.19it/s]
Epoch 50 Iter 98: loss 0.22703. :  44%|███████████████████▎                        | 98/224 [00:44<00:57,  2.21it/s]
Epoch 50 Iter 99: loss 0.22865. :  44%|███████████████████▎                        | 98/224 [00:45<00:57,  2.21it/s]
Epoch 50 Iter 99: loss 0.22865. :  44%|███████████████████▍                        | 99/224 [00:45<00:56,  2.20it/s]
Epoch 50 Iter 100: loss 0.23632. :  44%|███████████████████                        | 99/224 [00:45<00:56,  2.20it/s]
Epoch 50 Iter 100: loss 0.23632. :  45%|██████████████████▊                       | 100/224 [00:45<00:56,  2.19it/s]
Epoch 50 Iter 101: loss 0.25125. :  45%|██████████████████▊                       | 100/224 [00:46<00:56,  2.19it/s]
Epoch 50 Iter 101: loss 0.25125. :  45%|██████████████████▉                       | 101/224 [00:46<00:56,  2.19it/s]
Epoch 50 Iter 102: loss 0.22891. :  45%|██████████████████▉                       | 101/224 [00:46<00:56,  2.19it/s]
Epoch 50 Iter 102: loss 0.22891. :  46%|███████████████████▏                      | 102/224 [00:46<00:55,  2.20it/s]
Epoch 50 Iter 103: loss 0.23655. :  46%|███████████████████▏                      | 102/224 [00:47<00:55,  2.20it/s]
Epoch 50 Iter 103: loss 0.23655. :  46%|███████████████████▎                      | 103/224 [00:47<00:54,  2.20it/s]
Epoch 50 Iter 104: loss 0.23651. :  46%|███████████████████▎                      | 103/224 [00:47<00:54,  2.20it/s]
Epoch 50 Iter 104: loss 0.23651. :  46%|███████████████████▌                      | 104/224 [00:47<00:54,  2.18it/s]
Epoch 50 Iter 105: loss 0.22884. :  46%|███████████████████▌                      | 104/224 [00:48<00:54,  2.18it/s]
Epoch 50 Iter 105: loss 0.22884. :  47%|███████████████████▋                      | 105/224 [00:48<00:54,  2.18it/s]
Epoch 50 Iter 106: loss 0.24805. :  47%|███████████████████▋                      | 105/224 [00:48<00:54,  2.18it/s]
Epoch 50 Iter 106: loss 0.24805. :  47%|███████████████████▉                      | 106/224 [00:48<00:54,  2.18it/s]
Epoch 50 Iter 107: loss 0.22647. :  47%|███████████████████▉                      | 106/224 [00:49<00:54,  2.18it/s]
Epoch 50 Iter 107: loss 0.22647. :  48%|████████████████████                      | 107/224 [00:49<00:53,  2.19it/s]
Epoch 50 Iter 108: loss 0.25408. :  48%|████████████████████                      | 107/224 [00:49<00:53,  2.19it/s]
Epoch 50 Iter 108: loss 0.25408. :  48%|████████████████████▎                     | 108/224 [00:49<00:53,  2.19it/s]
Epoch 50 Iter 109: loss 0.24019. :  48%|████████████████████▎                     | 108/224 [00:49<00:53,  2.19it/s]
Epoch 50 Iter 109: loss 0.24019. :  49%|████████████████████▍                     | 109/224 [00:49<00:52,  2.18it/s]
Epoch 50 Iter 110: loss 0.23327. :  49%|████████████████████▍                     | 109/224 [00:50<00:52,  2.18it/s]
Epoch 50 Iter 110: loss 0.23327. :  49%|████████████████████▋                     | 110/224 [00:50<00:52,  2.18it/s]
Epoch 50 Iter 111: loss 0.22700. :  49%|████████████████████▋                     | 110/224 [00:50<00:52,  2.18it/s]
Epoch 50 Iter 111: loss 0.22700. :  50%|████████████████████▊                     | 111/224 [00:50<00:51,  2.18it/s]
Epoch 50 Iter 112: loss 0.23556. :  50%|████████████████████▊                     | 111/224 [00:51<00:51,  2.18it/s]
Epoch 50 Iter 112: loss 0.23556. :  50%|█████████████████████                     | 112/224 [00:51<00:51,  2.19it/s]
Epoch 50 Iter 113: loss 0.22646. :  50%|█████████████████████                     | 112/224 [00:51<00:51,  2.19it/s]
Epoch 50 Iter 113: loss 0.22646. :  50%|█████████████████████▏                    | 113/224 [00:51<00:50,  2.19it/s]
Epoch 50 Iter 114: loss 0.22348. :  50%|█████████████████████▏                    | 113/224 [00:52<00:50,  2.19it/s]
Epoch 50 Iter 114: loss 0.22348. :  51%|█████████████████████▍                    | 114/224 [00:52<00:50,  2.18it/s]
Epoch 50 Iter 115: loss 0.20488. :  51%|█████████████████████▍                    | 114/224 [00:52<00:50,  2.18it/s]
Epoch 50 Iter 115: loss 0.20488. :  51%|█████████████████████▌                    | 115/224 [00:52<00:50,  2.18it/s]
Epoch 50 Iter 116: loss 0.22868. :  51%|█████████████████████▌                    | 115/224 [00:53<00:50,  2.18it/s]
Epoch 50 Iter 116: loss 0.22868. :  52%|█████████████████████▊                    | 116/224 [00:53<00:49,  2.18it/s]
Epoch 50 Iter 117: loss 0.23399. :  52%|█████████████████████▊                    | 116/224 [00:53<00:49,  2.18it/s]
Epoch 50 Iter 117: loss 0.23399. :  52%|█████████████████████▉                    | 117/224 [00:53<00:49,  2.17it/s]
Epoch 50 Iter 118: loss 0.22766. :  52%|█████████████████████▉                    | 117/224 [00:54<00:49,  2.17it/s]
Epoch 50 Iter 118: loss 0.22766. :  53%|██████████████████████▏                   | 118/224 [00:54<00:49,  2.16it/s]
Epoch 50 Iter 119: loss 0.23731. :  53%|██████████████████████▏                   | 118/224 [00:54<00:49,  2.16it/s]
Epoch 50 Iter 119: loss 0.23731. :  53%|██████████████████████▎                   | 119/224 [00:54<00:48,  2.18it/s]
Epoch 50 Iter 120: loss 0.22682. :  53%|██████████████████████▎                   | 119/224 [00:55<00:48,  2.18it/s]
Epoch 50 Iter 120: loss 0.22682. :  54%|██████████████████████▌                   | 120/224 [00:55<00:47,  2.20it/s]
Epoch 50 Iter 121: loss 0.22055. :  54%|██████████████████████▌                   | 120/224 [00:55<00:47,  2.20it/s]
Epoch 50 Iter 121: loss 0.22055. :  54%|██████████████████████▋                   | 121/224 [00:55<00:46,  2.20it/s]
Epoch 50 Iter 122: loss 0.20430. :  54%|██████████████████████▋                   | 121/224 [00:55<00:46,  2.20it/s]
Epoch 50 Iter 122: loss 0.20430. :  54%|██████████████████████▊                   | 122/224 [00:55<00:46,  2.19it/s]
Epoch 50 Iter 123: loss 0.25493. :  54%|██████████████████████▊                   | 122/224 [00:56<00:46,  2.19it/s]
Epoch 50 Iter 123: loss 0.25493. :  55%|███████████████████████                   | 123/224 [00:56<00:46,  2.17it/s]
Epoch 50 Iter 124: loss 0.22614. :  55%|███████████████████████                   | 123/224 [00:56<00:46,  2.17it/s]
Epoch 50 Iter 124: loss 0.22614. :  55%|███████████████████████▎                  | 124/224 [00:56<00:45,  2.18it/s]
Epoch 50 Iter 125: loss 0.24667. :  55%|███████████████████████▎                  | 124/224 [00:57<00:45,  2.18it/s]
Epoch 50 Iter 125: loss 0.24667. :  56%|███████████████████████▍                  | 125/224 [00:57<00:45,  2.18it/s]
Epoch 50 Iter 126: loss 0.21917. :  56%|███████████████████████▍                  | 125/224 [00:57<00:45,  2.18it/s]
Epoch 50 Iter 126: loss 0.21917. :  56%|███████████████████████▋                  | 126/224 [00:57<00:44,  2.19it/s]
Epoch 50 Iter 127: loss 0.24086. :  56%|███████████████████████▋                  | 126/224 [00:58<00:44,  2.19it/s]
Epoch 50 Iter 127: loss 0.24086. :  57%|███████████████████████▊                  | 127/224 [00:58<00:44,  2.16it/s]
Epoch 50 Iter 128: loss 0.24158. :  57%|███████████████████████▊                  | 127/224 [00:58<00:44,  2.16it/s]
Epoch 50 Iter 128: loss 0.24158. :  57%|████████████████████████                  | 128/224 [00:58<00:43,  2.19it/s]
Epoch 50 Iter 129: loss 0.20846. :  57%|████████████████████████                  | 128/224 [00:59<00:43,  2.19it/s]
Epoch 50 Iter 129: loss 0.20846. :  58%|████████████████████████▏                 | 129/224 [00:59<00:43,  2.18it/s]
Epoch 50 Iter 130: loss 0.23497. :  58%|████████████████████████▏                 | 129/224 [00:59<00:43,  2.18it/s]
Epoch 50 Iter 130: loss 0.23497. :  58%|████████████████████████▍                 | 130/224 [00:59<00:43,  2.19it/s]
Epoch 50 Iter 131: loss 0.21836. :  58%|████████████████████████▍                 | 130/224 [01:00<00:43,  2.19it/s]
Epoch 50 Iter 131: loss 0.21836. :  58%|████████████████████████▌                 | 131/224 [01:00<00:42,  2.17it/s]
Epoch 50 Iter 132: loss 0.23196. :  58%|████████████████████████▌                 | 131/224 [01:00<00:42,  2.17it/s]
Epoch 50 Iter 132: loss 0.23196. :  59%|████████████████████████▊                 | 132/224 [01:00<00:42,  2.17it/s]
Epoch 50 Iter 133: loss 0.22805. :  59%|████████████████████████▊                 | 132/224 [01:00<00:42,  2.17it/s]
Epoch 50 Iter 133: loss 0.22805. :  59%|████████████████████████▉                 | 133/224 [01:00<00:41,  2.17it/s]
Epoch 50 Iter 134: loss 0.23645. :  59%|████████████████████████▉                 | 133/224 [01:01<00:41,  2.17it/s]
Epoch 50 Iter 134: loss 0.23645. :  60%|█████████████████████████▏                | 134/224 [01:01<00:41,  2.18it/s]
Epoch 50 Iter 135: loss 0.24163. :  60%|█████████████████████████▏                | 134/224 [01:01<00:41,  2.18it/s]
Epoch 50 Iter 135: loss 0.24163. :  60%|█████████████████████████▎                | 135/224 [01:01<00:40,  2.19it/s]
Epoch 50 Iter 136: loss 0.23287. :  60%|█████████████████████████▎                | 135/224 [01:02<00:40,  2.19it/s]
Epoch 50 Iter 136: loss 0.23287. :  61%|█████████████████████████▍                | 136/224 [01:02<00:40,  2.18it/s]
Epoch 50 Iter 137: loss 0.22766. :  61%|█████████████████████████▍                | 136/224 [01:02<00:40,  2.18it/s]
Epoch 50 Iter 137: loss 0.22766. :  61%|█████████████████████████▋                | 137/224 [01:02<00:40,  2.16it/s]
Epoch 50 Iter 138: loss 0.22464. :  61%|█████████████████████████▋                | 137/224 [01:03<00:40,  2.16it/s]
Epoch 50 Iter 138: loss 0.22464. :  62%|█████████████████████████▉                | 138/224 [01:03<00:39,  2.17it/s]
Epoch 50 Iter 139: loss 0.23116. :  62%|█████████████████████████▉                | 138/224 [01:03<00:39,  2.17it/s]
Epoch 50 Iter 139: loss 0.23116. :  62%|██████████████████████████                | 139/224 [01:03<00:39,  2.17it/s]
Epoch 50 Iter 140: loss 0.23381. :  62%|██████████████████████████                | 139/224 [01:04<00:39,  2.17it/s]
Epoch 50 Iter 140: loss 0.23381. :  62%|██████████████████████████▎               | 140/224 [01:04<00:38,  2.16it/s]
Epoch 50 Iter 141: loss 0.23880. :  62%|██████████████████████████▎               | 140/224 [01:04<00:38,  2.16it/s]
Epoch 50 Iter 141: loss 0.23880. :  63%|██████████████████████████▍               | 141/224 [01:04<00:38,  2.17it/s]
Epoch 50 Iter 142: loss 0.24165. :  63%|██████████████████████████▍               | 141/224 [01:05<00:38,  2.17it/s]
Epoch 50 Iter 142: loss 0.24165. :  63%|██████████████████████████▋               | 142/224 [01:05<00:37,  2.17it/s]
Epoch 50 Iter 143: loss 0.22603. :  63%|██████████████████████████▋               | 142/224 [01:05<00:37,  2.17it/s]
Epoch 50 Iter 143: loss 0.22603. :  64%|██████████████████████████▊               | 143/224 [01:05<00:37,  2.18it/s]
Epoch 50 Iter 144: loss 0.22354. :  64%|██████████████████████████▊               | 143/224 [01:06<00:37,  2.18it/s]
Epoch 50 Iter 144: loss 0.22354. :  64%|███████████████████████████               | 144/224 [01:06<00:36,  2.18it/s]
Epoch 50 Iter 145: loss 0.22023. :  64%|███████████████████████████               | 144/224 [01:06<00:36,  2.18it/s]
Epoch 50 Iter 145: loss 0.22023. :  65%|███████████████████████████▏              | 145/224 [01:06<00:36,  2.16it/s]
Epoch 50 Iter 146: loss 0.24762. :  65%|███████████████████████████▏              | 145/224 [01:06<00:36,  2.16it/s]
Epoch 50 Iter 146: loss 0.24762. :  65%|███████████████████████████▍              | 146/224 [01:06<00:35,  2.18it/s]
Epoch 50 Iter 147: loss 0.23975. :  65%|███████████████████████████▍              | 146/224 [01:07<00:35,  2.18it/s]
Epoch 50 Iter 147: loss 0.23975. :  66%|███████████████████████████▌              | 147/224 [01:07<00:35,  2.18it/s]
Epoch 50 Iter 148: loss 0.23182. :  66%|███████████████████████████▌              | 147/224 [01:07<00:35,  2.18it/s]
Epoch 50 Iter 148: loss 0.23182. :  66%|███████████████████████████▊              | 148/224 [01:07<00:34,  2.19it/s]
Epoch 50 Iter 149: loss 0.24200. :  66%|███████████████████████████▊              | 148/224 [01:08<00:34,  2.19it/s]
Epoch 50 Iter 149: loss 0.24200. :  67%|███████████████████████████▉              | 149/224 [01:08<00:34,  2.19it/s]
Epoch 50 Iter 150: loss 0.24210. :  67%|███████████████████████████▉              | 149/224 [01:08<00:34,  2.19it/s]
Epoch 50 Iter 150: loss 0.24210. :  67%|████████████████████████████              | 150/224 [01:08<00:34,  2.17it/s]
Epoch 50 Iter 151: loss 0.23210. :  67%|████████████████████████████              | 150/224 [01:09<00:34,  2.17it/s]
Epoch 50 Iter 151: loss 0.23210. :  67%|████████████████████████████▎             | 151/224 [01:09<00:33,  2.18it/s]
Epoch 50 Iter 152: loss 0.22887. :  67%|████████████████████████████▎             | 151/224 [01:09<00:33,  2.18it/s]
Epoch 50 Iter 152: loss 0.22887. :  68%|████████████████████████████▌             | 152/224 [01:09<00:33,  2.17it/s]
Epoch 50 Iter 153: loss 0.24599. :  68%|████████████████████████████▌             | 152/224 [01:10<00:33,  2.17it/s]
Epoch 50 Iter 153: loss 0.24599. :  68%|████████████████████████████▋             | 153/224 [01:10<00:32,  2.17it/s]
Epoch 50 Iter 154: loss 0.21234. :  68%|████████████████████████████▋             | 153/224 [01:10<00:32,  2.17it/s]
Epoch 50 Iter 154: loss 0.21234. :  69%|████████████████████████████▉             | 154/224 [01:10<00:32,  2.14it/s]
Epoch 50 Iter 155: loss 0.21937. :  69%|████████████████████████████▉             | 154/224 [01:11<00:32,  2.14it/s]
Epoch 50 Iter 155: loss 0.21937. :  69%|█████████████████████████████             | 155/224 [01:11<00:32,  2.13it/s]
Epoch 50 Iter 156: loss 0.21788. :  69%|█████████████████████████████             | 155/224 [01:11<00:32,  2.13it/s]
Epoch 50 Iter 156: loss 0.21788. :  70%|█████████████████████████████▎            | 156/224 [01:11<00:31,  2.14it/s]
Epoch 50 Iter 157: loss 0.22829. :  70%|█████████████████████████████▎            | 156/224 [01:12<00:31,  2.14it/s]
Epoch 50 Iter 157: loss 0.22829. :  70%|█████████████████████████████▍            | 157/224 [01:12<00:31,  2.15it/s]
Epoch 50 Iter 158: loss 0.22362. :  70%|█████████████████████████████▍            | 157/224 [01:12<00:31,  2.15it/s]
Epoch 50 Iter 158: loss 0.22362. :  71%|█████████████████████████████▋            | 158/224 [01:12<00:30,  2.15it/s]
Epoch 50 Iter 159: loss 0.21191. :  71%|█████████████████████████████▋            | 158/224 [01:13<00:30,  2.15it/s]
Epoch 50 Iter 159: loss 0.21191. :  71%|█████████████████████████████▊            | 159/224 [01:13<00:30,  2.13it/s]
Epoch 50 Iter 160: loss 0.24139. :  71%|█████████████████████████████▊            | 159/224 [01:13<00:30,  2.13it/s]
Epoch 50 Iter 160: loss 0.24139. :  71%|██████████████████████████████            | 160/224 [01:13<00:29,  2.16it/s]
Epoch 50 Iter 161: loss 0.22951. :  71%|██████████████████████████████            | 160/224 [01:13<00:29,  2.16it/s]
Epoch 50 Iter 161: loss 0.22951. :  72%|██████████████████████████████▏           | 161/224 [01:13<00:28,  2.18it/s]
Epoch 50 Iter 162: loss 0.24607. :  72%|██████████████████████████████▏           | 161/224 [01:14<00:28,  2.18it/s]
Epoch 50 Iter 162: loss 0.24607. :  72%|██████████████████████████████▍           | 162/224 [01:14<00:28,  2.19it/s]
Epoch 50 Iter 163: loss 0.22917. :  72%|██████████████████████████████▍           | 162/224 [01:14<00:28,  2.19it/s]
Epoch 50 Iter 163: loss 0.22917. :  73%|██████████████████████████████▌           | 163/224 [01:14<00:28,  2.16it/s]
Epoch 50 Iter 164: loss 0.24293. :  73%|██████████████████████████████▌           | 163/224 [01:15<00:28,  2.16it/s]
Epoch 50 Iter 164: loss 0.24293. :  73%|██████████████████████████████▋           | 164/224 [01:15<00:27,  2.17it/s]
Epoch 50 Iter 165: loss 0.23568. :  73%|██████████████████████████████▋           | 164/224 [01:15<00:27,  2.17it/s]
Epoch 50 Iter 165: loss 0.23568. :  74%|██████████████████████████████▉           | 165/224 [01:15<00:27,  2.18it/s]
Epoch 50 Iter 166: loss 0.20010. :  74%|██████████████████████████████▉           | 165/224 [01:16<00:27,  2.18it/s]
Epoch 50 Iter 166: loss 0.20010. :  74%|███████████████████████████████▏          | 166/224 [01:16<00:27,  2.13it/s]
Epoch 50 Iter 167: loss 0.23099. :  74%|███████████████████████████████▏          | 166/224 [01:16<00:27,  2.13it/s]
Epoch 50 Iter 167: loss 0.23099. :  75%|███████████████████████████████▎          | 167/224 [01:16<00:26,  2.14it/s]
Epoch 50 Iter 168: loss 0.23920. :  75%|███████████████████████████████▎          | 167/224 [01:17<00:26,  2.14it/s]
Epoch 50 Iter 168: loss 0.23920. :  75%|███████████████████████████████▌          | 168/224 [01:17<00:26,  2.14it/s]
Epoch 50 Iter 169: loss 0.21277. :  75%|███████████████████████████████▌          | 168/224 [01:17<00:26,  2.14it/s]
Epoch 50 Iter 169: loss 0.21277. :  75%|███████████████████████████████▋          | 169/224 [01:17<00:25,  2.16it/s]
Epoch 50 Iter 170: loss 0.22220. :  75%|███████████████████████████████▋          | 169/224 [01:18<00:25,  2.16it/s]
Epoch 50 Iter 170: loss 0.22220. :  76%|███████████████████████████████▉          | 170/224 [01:18<00:24,  2.17it/s]
Epoch 50 Iter 171: loss 0.22842. :  76%|███████████████████████████████▉          | 170/224 [01:18<00:24,  2.17it/s]
Epoch 50 Iter 171: loss 0.22842. :  76%|████████████████████████████████          | 171/224 [01:18<00:24,  2.17it/s]
Epoch 50 Iter 172: loss 0.24196. :  76%|████████████████████████████████          | 171/224 [01:19<00:24,  2.17it/s]
Epoch 50 Iter 172: loss 0.24196. :  77%|████████████████████████████████▎         | 172/224 [01:19<00:23,  2.17it/s]
Epoch 50 Iter 173: loss 0.23729. :  77%|████████████████████████████████▎         | 172/224 [01:19<00:23,  2.17it/s]
Epoch 50 Iter 173: loss 0.23729. :  77%|████████████████████████████████▍         | 173/224 [01:19<00:23,  2.19it/s]
Epoch 50 Iter 174: loss 0.21285. :  77%|████████████████████████████████▍         | 173/224 [01:19<00:23,  2.19it/s]
Epoch 50 Iter 174: loss 0.21285. :  78%|████████████████████████████████▋         | 174/224 [01:19<00:22,  2.20it/s]
Epoch 50 Iter 175: loss 0.23395. :  78%|████████████████████████████████▋         | 174/224 [01:20<00:22,  2.20it/s]
Epoch 50 Iter 175: loss 0.23395. :  78%|████████████████████████████████▊         | 175/224 [01:20<00:22,  2.21it/s]
Epoch 50 Iter 176: loss 0.24389. :  78%|████████████████████████████████▊         | 175/224 [01:20<00:22,  2.21it/s]
Epoch 50 Iter 176: loss 0.24389. :  79%|█████████████████████████████████         | 176/224 [01:20<00:21,  2.21it/s]
Epoch 50 Iter 177: loss 0.23683. :  79%|█████████████████████████████████         | 176/224 [01:21<00:21,  2.21it/s]
Epoch 50 Iter 177: loss 0.23683. :  79%|█████████████████████████████████▏        | 177/224 [01:21<00:21,  2.19it/s]
Epoch 50 Iter 178: loss 0.24539. :  79%|█████████████████████████████████▏        | 177/224 [01:21<00:21,  2.19it/s]
Epoch 50 Iter 178: loss 0.24539. :  79%|█████████████████████████████████▍        | 178/224 [01:21<00:20,  2.21it/s]
Epoch 50 Iter 179: loss 0.22887. :  79%|█████████████████████████████████▍        | 178/224 [01:22<00:20,  2.21it/s]
Epoch 50 Iter 179: loss 0.22887. :  80%|█████████████████████████████████▌        | 179/224 [01:22<00:20,  2.20it/s]
Epoch 50 Iter 180: loss 0.24051. :  80%|█████████████████████████████████▌        | 179/224 [01:22<00:20,  2.20it/s]
Epoch 50 Iter 180: loss 0.24051. :  80%|█████████████████████████████████▊        | 180/224 [01:22<00:20,  2.20it/s]
Epoch 50 Iter 181: loss 0.22942. :  80%|█████████████████████████████████▊        | 180/224 [01:23<00:20,  2.20it/s]
Epoch 50 Iter 181: loss 0.22942. :  81%|█████████████████████████████████▉        | 181/224 [01:23<00:19,  2.20it/s]
Epoch 50 Iter 182: loss 0.23515. :  81%|█████████████████████████████████▉        | 181/224 [01:23<00:19,  2.20it/s]
Epoch 50 Iter 182: loss 0.23515. :  81%|██████████████████████████████████▏       | 182/224 [01:23<00:19,  2.20it/s]
Epoch 50 Iter 183: loss 0.23527. :  81%|██████████████████████████████████▏       | 182/224 [01:23<00:19,  2.20it/s]
Epoch 50 Iter 183: loss 0.23527. :  82%|██████████████████████████████████▎       | 183/224 [01:23<00:18,  2.21it/s]
Epoch 50 Iter 184: loss 0.22739. :  82%|██████████████████████████████████▎       | 183/224 [01:24<00:18,  2.21it/s]
Epoch 50 Iter 184: loss 0.22739. :  82%|██████████████████████████████████▌       | 184/224 [01:24<00:18,  2.21it/s]
Epoch 50 Iter 185: loss 0.23366. :  82%|██████████████████████████████████▌       | 184/224 [01:24<00:18,  2.21it/s]
Epoch 50 Iter 185: loss 0.23366. :  83%|██████████████████████████████████▋       | 185/224 [01:24<00:17,  2.21it/s]
Epoch 50 Iter 186: loss 0.23988. :  83%|██████████████████████████████████▋       | 185/224 [01:25<00:17,  2.21it/s]
Epoch 50 Iter 186: loss 0.23988. :  83%|██████████████████████████████████▉       | 186/224 [01:25<00:17,  2.19it/s]
Epoch 50 Iter 187: loss 0.23471. :  83%|██████████████████████████████████▉       | 186/224 [01:25<00:17,  2.19it/s]
Epoch 50 Iter 187: loss 0.23471. :  83%|███████████████████████████████████       | 187/224 [01:25<00:16,  2.19it/s]
Epoch 50 Iter 188: loss 0.23246. :  83%|███████████████████████████████████       | 187/224 [01:26<00:16,  2.19it/s]
Epoch 50 Iter 188: loss 0.23246. :  84%|███████████████████████████████████▎      | 188/224 [01:26<00:16,  2.19it/s]
Epoch 50 Iter 189: loss 0.22846. :  84%|███████████████████████████████████▎      | 188/224 [01:26<00:16,  2.19it/s]
Epoch 50 Iter 189: loss 0.22846. :  84%|███████████████████████████████████▍      | 189/224 [01:26<00:15,  2.21it/s]
Epoch 50 Iter 190: loss 0.24475. :  84%|███████████████████████████████████▍      | 189/224 [01:27<00:15,  2.21it/s]
Epoch 50 Iter 190: loss 0.24475. :  85%|███████████████████████████████████▋      | 190/224 [01:27<00:15,  2.20it/s]
Epoch 50 Iter 191: loss 0.24182. :  85%|███████████████████████████████████▋      | 190/224 [01:27<00:15,  2.20it/s]
Epoch 50 Iter 191: loss 0.24182. :  85%|███████████████████████████████████▊      | 191/224 [01:27<00:15,  2.18it/s]
Epoch 50 Iter 192: loss 0.23451. :  85%|███████████████████████████████████▊      | 191/224 [01:28<00:15,  2.18it/s]
Epoch 50 Iter 192: loss 0.23451. :  86%|████████████████████████████████████      | 192/224 [01:28<00:14,  2.18it/s]
Epoch 50 Iter 193: loss 0.22660. :  86%|████████████████████████████████████      | 192/224 [01:28<00:14,  2.18it/s]
Epoch 50 Iter 193: loss 0.22660. :  86%|████████████████████████████████████▏     | 193/224 [01:28<00:14,  2.19it/s]
Epoch 50 Iter 194: loss 0.22764. :  86%|████████████████████████████████████▏     | 193/224 [01:28<00:14,  2.19it/s]
Epoch 50 Iter 194: loss 0.22764. :  87%|████████████████████████████████████▍     | 194/224 [01:29<00:13,  2.20it/s]
Epoch 50 Iter 195: loss 0.23778. :  87%|████████████████████████████████████▍     | 194/224 [01:29<00:13,  2.20it/s]
Epoch 50 Iter 195: loss 0.23778. :  87%|████████████████████████████████████▌     | 195/224 [01:29<00:13,  2.19it/s]
Epoch 50 Iter 196: loss 0.22888. :  87%|████████████████████████████████████▌     | 195/224 [01:29<00:13,  2.19it/s]
Epoch 50 Iter 196: loss 0.22888. :  88%|████████████████████████████████████▊     | 196/224 [01:29<00:12,  2.19it/s]
Epoch 50 Iter 197: loss 0.25194. :  88%|████████████████████████████████████▊     | 196/224 [01:30<00:12,  2.19it/s]
Epoch 50 Iter 197: loss 0.25194. :  88%|████████████████████████████████████▉     | 197/224 [01:30<00:12,  2.20it/s]
Epoch 50 Iter 198: loss 0.20970. :  88%|████████████████████████████████████▉     | 197/224 [01:30<00:12,  2.20it/s]
Epoch 50 Iter 198: loss 0.20970. :  88%|█████████████████████████████████████▏    | 198/224 [01:30<00:11,  2.21it/s]
Epoch 50 Iter 199: loss 0.22969. :  88%|█████████████████████████████████████▏    | 198/224 [01:31<00:11,  2.21it/s]
Epoch 50 Iter 199: loss 0.22969. :  89%|█████████████████████████████████████▎    | 199/224 [01:31<00:11,  2.21it/s]
Epoch 50 Iter 200: loss 0.25645. :  89%|█████████████████████████████████████▎    | 199/224 [01:31<00:11,  2.21it/s]
Epoch 50 Iter 200: loss 0.25645. :  89%|█████████████████████████████████████▌    | 200/224 [01:31<00:10,  2.19it/s]
Epoch 50 Iter 201: loss 0.22985. :  89%|█████████████████████████████████████▌    | 200/224 [01:32<00:10,  2.19it/s]
Epoch 50 Iter 201: loss 0.22985. :  90%|█████████████████████████████████████▋    | 201/224 [01:32<00:10,  2.20it/s]
Epoch 50 Iter 202: loss 0.23222. :  90%|█████████████████████████████████████▋    | 201/224 [01:32<00:10,  2.20it/s]
Epoch 50 Iter 202: loss 0.23222. :  90%|█████████████████████████████████████▉    | 202/224 [01:32<00:09,  2.21it/s]
Epoch 50 Iter 203: loss 0.24048. :  90%|█████████████████████████████████████▉    | 202/224 [01:33<00:09,  2.21it/s]
Epoch 50 Iter 203: loss 0.24048. :  91%|██████████████████████████████████████    | 203/224 [01:33<00:09,  2.20it/s]
Epoch 50 Iter 204: loss 0.23493. :  91%|██████████████████████████████████████    | 203/224 [01:33<00:09,  2.20it/s]
Epoch 50 Iter 204: loss 0.23493. :  91%|██████████████████████████████████████▎   | 204/224 [01:33<00:09,  2.19it/s]
Epoch 50 Iter 205: loss 0.25312. :  91%|██████████████████████████████████████▎   | 204/224 [01:34<00:09,  2.19it/s]
Epoch 50 Iter 205: loss 0.25312. :  92%|██████████████████████████████████████▍   | 205/224 [01:34<00:08,  2.18it/s]
Epoch 50 Iter 206: loss 0.23616. :  92%|██████████████████████████████████████▍   | 205/224 [01:34<00:08,  2.18it/s]
Epoch 50 Iter 206: loss 0.23616. :  92%|██████████████████████████████████████▋   | 206/224 [01:34<00:08,  2.19it/s]
Epoch 50 Iter 207: loss 0.21263. :  92%|██████████████████████████████████████▋   | 206/224 [01:34<00:08,  2.19it/s]
Epoch 50 Iter 207: loss 0.21263. :  92%|██████████████████████████████████████▊   | 207/224 [01:34<00:07,  2.19it/s]
Epoch 50 Iter 208: loss 0.22062. :  92%|██████████████████████████████████████▊   | 207/224 [01:35<00:07,  2.19it/s]
Epoch 50 Iter 208: loss 0.22062. :  93%|███████████████████████████████████████   | 208/224 [01:35<00:07,  2.19it/s]
Epoch 50 Iter 209: loss 0.22178. :  93%|███████████████████████████████████████   | 208/224 [01:35<00:07,  2.19it/s]
Epoch 50 Iter 209: loss 0.22178. :  93%|███████████████████████████████████████▏  | 209/224 [01:35<00:06,  2.16it/s]
Epoch 50 Iter 210: loss 0.22124. :  93%|███████████████████████████████████████▏  | 209/224 [01:36<00:06,  2.16it/s]
Epoch 50 Iter 210: loss 0.22124. :  94%|███████████████████████████████████████▍  | 210/224 [01:36<00:06,  2.18it/s]
Epoch 50 Iter 211: loss 0.24035. :  94%|███████████████████████████████████████▍  | 210/224 [01:36<00:06,  2.18it/s]
Epoch 50 Iter 211: loss 0.24035. :  94%|███████████████████████████████████████▌  | 211/224 [01:36<00:05,  2.19it/s]
Epoch 50 Iter 212: loss 0.22546. :  94%|███████████████████████████████████████▌  | 211/224 [01:37<00:05,  2.19it/s]
Epoch 50 Iter 212: loss 0.22546. :  95%|███████████████████████████████████████▊  | 212/224 [01:37<00:05,  2.21it/s]
Epoch 50 Iter 213: loss 0.22960. :  95%|███████████████████████████████████████▊  | 212/224 [01:37<00:05,  2.21it/s]
Epoch 50 Iter 213: loss 0.22960. :  95%|███████████████████████████████████████▉  | 213/224 [01:37<00:05,  2.17it/s]
Epoch 50 Iter 214: loss 0.24274. :  95%|███████████████████████████████████████▉  | 213/224 [01:38<00:05,  2.17it/s]
Epoch 50 Iter 214: loss 0.24274. :  96%|████████████████████████████████████████▏ | 214/224 [01:38<00:04,  2.16it/s]
Epoch 50 Iter 215: loss 0.21658. :  96%|████████████████████████████████████████▏ | 214/224 [01:38<00:04,  2.16it/s]
Epoch 50 Iter 215: loss 0.21658. :  96%|████████████████████████████████████████▎ | 215/224 [01:38<00:04,  2.18it/s]
Epoch 50 Iter 216: loss 0.24593. :  96%|████████████████████████████████████████▎ | 215/224 [01:39<00:04,  2.18it/s]
Epoch 50 Iter 216: loss 0.24593. :  96%|████████████████████████████████████████▌ | 216/224 [01:39<00:03,  2.16it/s]
Epoch 50 Iter 217: loss 0.24064. :  96%|████████████████████████████████████████▌ | 216/224 [01:39<00:03,  2.16it/s]
Epoch 50 Iter 217: loss 0.24064. :  97%|████████████████████████████████████████▋ | 217/224 [01:39<00:03,  2.17it/s]
Epoch 50 Iter 218: loss 0.24378. :  97%|████████████████████████████████████████▋ | 217/224 [01:39<00:03,  2.17it/s]
Epoch 50 Iter 218: loss 0.24378. :  97%|████████████████████████████████████████▉ | 218/224 [01:39<00:02,  2.16it/s]
Epoch 50 Iter 219: loss 0.23368. :  97%|████████████████████████████████████████▉ | 218/224 [01:40<00:02,  2.16it/s]
Epoch 50 Iter 219: loss 0.23368. :  98%|█████████████████████████████████████████ | 219/224 [01:40<00:02,  2.17it/s]
Epoch 50 Iter 220: loss 0.21589. :  98%|█████████████████████████████████████████ | 219/224 [01:40<00:02,  2.17it/s]
Epoch 50 Iter 220: loss 0.21589. :  98%|█████████████████████████████████████████▎| 220/224 [01:40<00:01,  2.18it/s]
Epoch 50 Iter 221: loss 0.22451. :  98%|█████████████████████████████████████████▎| 220/224 [01:41<00:01,  2.18it/s]
Epoch 50 Iter 221: loss 0.22451. :  99%|█████████████████████████████████████████▍| 221/224 [01:41<00:01,  2.18it/s]
Epoch 50 Iter 222: loss 0.23671. :  99%|█████████████████████████████████████████▍| 221/224 [01:41<00:01,  2.18it/s]
Epoch 50 Iter 222: loss 0.23671. :  99%|█████████████████████████████████████████▋| 222/224 [01:41<00:00,  2.17it/s]
Epoch 50 Iter 223: loss 0.23923. :  99%|█████████████████████████████████████████▋| 222/224 [01:42<00:00,  2.17it/s]
Epoch 50 Iter 223: loss 0.23923. : 100%|█████████████████████████████████████████▊| 223/224 [01:42<00:00,  2.17it/s]
Epoch 50 Iter 224: loss 0.23514. : 100%|█████████████████████████████████████████▊| 223/224 [01:42<00:00,  2.17it/s]
Epoch 50 Iter 224: loss 0.23514. : 100%|██████████████████████████████████████████| 224/224 [01:42<00:00,  2.19it/s]
Epoch 50 Iter 224: loss 0.23514. : 100%|██████████████████████████████████████████| 224/224 [01:42<00:00,  2.18it/s]
    Train loss: 0.23247
    Valid loss: 0.23335
       Valid loss recons: 0.22137
       Valid loss KL-D:   1.1984
Training completed

Images vs recons¶

In [5]:
img_vs_recons(model, test_loader, device)
No description has been provided for this image

Inference¶

In [6]:
plot_recons(inference(configs,model))
No description has been provided for this image

Latent space visualization¶

In [7]:
vis_latent(test_loader, model, test_dataset)
No description has been provided for this image

Interpolation¶

In [5]:
plot_reconstructed(model, xrange=(-400, 400), yrange=(-400, 400), N=15)
No description has been provided for this image
  1. Experiment with KLD = 1e_4¶

In [4]:
seed_everything(42)

model = CVAE(latent_dim=configs["latent_dim"]).to(device)

optimizer = torch.optim.AdamW(model.parameters(), lr=configs["lr"], weight_decay=1e-5)
scheduler = torch.optim.lr_scheduler.ReduceLROnPlateau(optimizer, patience=7, factor=0.5, verbose=True)
model_name = configs["model_name"]+configs["exp"]+f"_KLD_{configs['lambda_kld']}"
savepath, writer = makedires(configs)

train_loss, val_loss, loss_iters, val_loss_recons, val_loss_kld = train_model(
        model=model, 
        model_name=model_name,
        optimizer=optimizer,
        scheduler=scheduler if configs["use_scheduler"] else None, 
        criterion=vae_loss_function,
        lambda_kld=configs["lambda_kld"],
        train_loader=train_loader, 
        valid_loader=test_loader, 
        num_epochs=configs["num_epochs"],
        save_frequency= 10, 
        savepath=savepath,
        writer=writer
    )

epoch = configs["num_epochs"]
lambda_kld = configs["lambda_kld"]

save_model(model, model_name, optimizer, epoch = epoch,lambda_kld = lambda_kld, stats = configs )
save_config(configs)
Seed set to 42
/home/user/soltania1/.local/lib/python3.8/site-packages/torch/optim/lr_scheduler.py:60: UserWarning: The verbose parameter is deprecated. Please use get_last_lr() to access the learning rate.
  warnings.warn(
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.53206. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 1 Iter 1: loss 0.53206. :   0%|▏                                               | 1/224 [00:00<02:10,  1.71it/s]
Epoch 1 Iter 2: loss 0.53072. :   0%|▏                                               | 1/224 [00:01<02:10,  1.71it/s]
Epoch 1 Iter 2: loss 0.53072. :   1%|▍                                               | 2/224 [00:01<01:59,  1.86it/s]
Epoch 1 Iter 3: loss 0.55081. :   1%|▍                                               | 2/224 [00:01<01:59,  1.86it/s]
Epoch 1 Iter 3: loss 0.55081. :   1%|▋                                               | 3/224 [00:01<01:54,  1.93it/s]
Epoch 1 Iter 4: loss 0.51249. :   1%|▋                                               | 3/224 [00:02<01:54,  1.93it/s]
Epoch 1 Iter 4: loss 0.51249. :   2%|▊                                               | 4/224 [00:02<01:52,  1.95it/s]
Epoch 1 Iter 5: loss 0.53741. :   2%|▊                                               | 4/224 [00:02<01:52,  1.95it/s]
Epoch 1 Iter 5: loss 0.53741. :   2%|█                                               | 5/224 [00:02<01:50,  1.98it/s]
Epoch 1 Iter 6: loss 0.53551. :   2%|█                                               | 5/224 [00:03<01:50,  1.98it/s]
Epoch 1 Iter 6: loss 0.53551. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.99it/s]
Epoch 1 Iter 7: loss 0.48607. :   3%|█▎                                              | 6/224 [00:03<01:49,  1.99it/s]
Epoch 1 Iter 7: loss 0.48607. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.01it/s]
Epoch 1 Iter 8: loss 0.46194. :   3%|█▌                                              | 7/224 [00:04<01:48,  2.01it/s]
Epoch 1 Iter 8: loss 0.46194. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 1 Iter 9: loss 0.42836. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 1 Iter 9: loss 0.42836. :   4%|█▉                                              | 9/224 [00:04<01:48,  1.98it/s]
Epoch 1 Iter 10: loss 0.47211. :   4%|█▉                                             | 9/224 [00:05<01:48,  1.98it/s]
Epoch 1 Iter 10: loss 0.47211. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 1 Iter 11: loss 0.43736. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 1 Iter 11: loss 0.43736. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 1 Iter 12: loss 0.40665. :   5%|██▎                                           | 11/224 [00:06<01:46,  2.00it/s]
Epoch 1 Iter 12: loss 0.40665. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.00it/s]
Epoch 1 Iter 13: loss 0.40689. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.00it/s]
Epoch 1 Iter 13: loss 0.40689. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 1 Iter 14: loss 0.38828. :   6%|██▋                                           | 13/224 [00:07<01:45,  2.00it/s]
Epoch 1 Iter 14: loss 0.38828. :   6%|██▉                                           | 14/224 [00:07<01:47,  1.96it/s]
Epoch 1 Iter 15: loss 0.39609. :   6%|██▉                                           | 14/224 [00:07<01:47,  1.96it/s]
Epoch 1 Iter 15: loss 0.39609. :   7%|███                                           | 15/224 [00:07<01:45,  1.97it/s]
Epoch 1 Iter 16: loss 0.35313. :   7%|███                                           | 15/224 [00:08<01:45,  1.97it/s]
Epoch 1 Iter 16: loss 0.35313. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 1 Iter 17: loss 0.34704. :   7%|███▎                                          | 16/224 [00:08<01:44,  1.99it/s]
Epoch 1 Iter 17: loss 0.34704. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.00it/s]
Epoch 1 Iter 18: loss 0.35329. :   8%|███▍                                          | 17/224 [00:09<01:43,  2.00it/s]
Epoch 1 Iter 18: loss 0.35329. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.01it/s]
Epoch 1 Iter 19: loss 0.32121. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.01it/s]
Epoch 1 Iter 19: loss 0.32121. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 1 Iter 20: loss 0.34905. :   8%|███▉                                          | 19/224 [00:10<01:41,  2.01it/s]
Epoch 1 Iter 20: loss 0.34905. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 1 Iter 21: loss 0.32028. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 1 Iter 21: loss 0.32028. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 1 Iter 22: loss 0.31976. :   9%|████▎                                         | 21/224 [00:11<01:40,  2.01it/s]
Epoch 1 Iter 22: loss 0.31976. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 1 Iter 23: loss 0.30540. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 1 Iter 23: loss 0.30540. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 1 Iter 24: loss 0.32894. :  10%|████▋                                         | 23/224 [00:12<01:39,  2.02it/s]
Epoch 1 Iter 24: loss 0.32894. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.02it/s]
Epoch 1 Iter 25: loss 0.30526. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.02it/s]
Epoch 1 Iter 25: loss 0.30526. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 1 Iter 26: loss 0.32935. :  11%|█████▏                                        | 25/224 [00:13<01:38,  2.02it/s]
Epoch 1 Iter 26: loss 0.32935. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.01it/s]
Epoch 1 Iter 27: loss 0.27337. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.01it/s]
Epoch 1 Iter 27: loss 0.27337. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 1 Iter 28: loss 0.25210. :  12%|█████▌                                        | 27/224 [00:14<01:37,  2.02it/s]
Epoch 1 Iter 28: loss 0.25210. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.02it/s]
Epoch 1 Iter 29: loss 0.29545. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.02it/s]
Epoch 1 Iter 29: loss 0.29545. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 1 Iter 30: loss 0.28234. :  13%|█████▉                                        | 29/224 [00:15<01:36,  2.02it/s]
Epoch 1 Iter 30: loss 0.28234. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 1 Iter 31: loss 0.27619. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 1 Iter 31: loss 0.27619. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.03it/s]
Epoch 1 Iter 32: loss 0.25837. :  14%|██████▎                                       | 31/224 [00:16<01:35,  2.03it/s]
Epoch 1 Iter 32: loss 0.25837. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.03it/s]
Epoch 1 Iter 33: loss 0.25732. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.03it/s]
Epoch 1 Iter 33: loss 0.25732. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.01it/s]
Epoch 1 Iter 34: loss 0.27236. :  15%|██████▊                                       | 33/224 [00:17<01:34,  2.01it/s]
Epoch 1 Iter 34: loss 0.27236. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.02it/s]
Epoch 1 Iter 35: loss 0.26171. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.02it/s]
Epoch 1 Iter 35: loss 0.26171. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.02it/s]
Epoch 1 Iter 36: loss 0.24573. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.02it/s]
Epoch 1 Iter 36: loss 0.24573. :  16%|███████▍                                      | 36/224 [00:17<01:33,  2.01it/s]
Epoch 1 Iter 37: loss 0.24229. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 1 Iter 37: loss 0.24229. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.02it/s]
Epoch 1 Iter 38: loss 0.27044. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.02it/s]
Epoch 1 Iter 38: loss 0.27044. :  17%|███████▊                                      | 38/224 [00:18<01:32,  2.01it/s]
Epoch 1 Iter 39: loss 0.28457. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.01it/s]
Epoch 1 Iter 39: loss 0.28457. :  17%|████████                                      | 39/224 [00:19<01:31,  2.03it/s]
Epoch 1 Iter 40: loss 0.23674. :  17%|████████                                      | 39/224 [00:19<01:31,  2.03it/s]
Epoch 1 Iter 40: loss 0.23674. :  18%|████████▏                                     | 40/224 [00:19<01:31,  2.01it/s]
Epoch 1 Iter 41: loss 0.26063. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 1 Iter 41: loss 0.26063. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 1 Iter 42: loss 0.23582. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 1 Iter 42: loss 0.23582. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 1 Iter 43: loss 0.23303. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 1 Iter 43: loss 0.23303. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 1 Iter 44: loss 0.21950. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 1 Iter 44: loss 0.21950. :  20%|█████████                                     | 44/224 [00:21<01:28,  2.02it/s]
Epoch 1 Iter 45: loss 0.24949. :  20%|█████████                                     | 44/224 [00:22<01:28,  2.02it/s]
Epoch 1 Iter 45: loss 0.24949. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 1 Iter 46: loss 0.24270. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 1 Iter 46: loss 0.24270. :  21%|█████████▍                                    | 46/224 [00:22<01:29,  1.99it/s]
Epoch 1 Iter 47: loss 0.23308. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  1.99it/s]
Epoch 1 Iter 47: loss 0.23308. :  21%|█████████▋                                    | 47/224 [00:23<01:30,  1.97it/s]
Epoch 1 Iter 48: loss 0.23384. :  21%|█████████▋                                    | 47/224 [00:24<01:30,  1.97it/s]
Epoch 1 Iter 48: loss 0.23384. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 1 Iter 49: loss 0.22495. :  21%|█████████▊                                    | 48/224 [00:24<01:30,  1.95it/s]
Epoch 1 Iter 49: loss 0.22495. :  22%|██████████                                    | 49/224 [00:24<01:31,  1.91it/s]
Epoch 1 Iter 50: loss 0.22577. :  22%|██████████                                    | 49/224 [00:25<01:31,  1.91it/s]
Epoch 1 Iter 50: loss 0.22577. :  22%|██████████▎                                   | 50/224 [00:25<01:32,  1.88it/s]
Epoch 1 Iter 51: loss 0.22932. :  22%|██████████▎                                   | 50/224 [00:25<01:32,  1.88it/s]
Epoch 1 Iter 51: loss 0.22932. :  23%|██████████▍                                   | 51/224 [00:25<01:30,  1.92it/s]
Epoch 1 Iter 52: loss 0.25359. :  23%|██████████▍                                   | 51/224 [00:26<01:30,  1.92it/s]
Epoch 1 Iter 52: loss 0.25359. :  23%|██████████▋                                   | 52/224 [00:26<01:28,  1.95it/s]
Epoch 1 Iter 53: loss 0.24024. :  23%|██████████▋                                   | 52/224 [00:26<01:28,  1.95it/s]
Epoch 1 Iter 53: loss 0.24024. :  24%|██████████▉                                   | 53/224 [00:26<01:27,  1.95it/s]
Epoch 1 Iter 54: loss 0.23580. :  24%|██████████▉                                   | 53/224 [00:27<01:27,  1.95it/s]
Epoch 1 Iter 54: loss 0.23580. :  24%|███████████                                   | 54/224 [00:27<01:26,  1.96it/s]
Epoch 1 Iter 55: loss 0.22863. :  24%|███████████                                   | 54/224 [00:27<01:26,  1.96it/s]
Epoch 1 Iter 55: loss 0.22863. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  1.99it/s]
Epoch 1 Iter 56: loss 0.23413. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  1.99it/s]
Epoch 1 Iter 56: loss 0.23413. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  2.00it/s]
Epoch 1 Iter 57: loss 0.23781. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  2.00it/s]
Epoch 1 Iter 57: loss 0.23781. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.99it/s]
Epoch 1 Iter 58: loss 0.20923. :  25%|███████████▋                                  | 57/224 [00:29<01:24,  1.99it/s]
Epoch 1 Iter 58: loss 0.20923. :  26%|███████████▉                                  | 58/224 [00:29<01:26,  1.92it/s]
Epoch 1 Iter 59: loss 0.20458. :  26%|███████████▉                                  | 58/224 [00:29<01:26,  1.92it/s]
Epoch 1 Iter 59: loss 0.20458. :  26%|████████████                                  | 59/224 [00:29<01:24,  1.95it/s]
Epoch 1 Iter 60: loss 0.21354. :  26%|████████████                                  | 59/224 [00:30<01:24,  1.95it/s]
Epoch 1 Iter 60: loss 0.21354. :  27%|████████████▎                                 | 60/224 [00:30<01:23,  1.96it/s]
Epoch 1 Iter 61: loss 0.23162. :  27%|████████████▎                                 | 60/224 [00:30<01:23,  1.96it/s]
Epoch 1 Iter 61: loss 0.23162. :  27%|████████████▌                                 | 61/224 [00:30<01:22,  1.97it/s]
Epoch 1 Iter 62: loss 0.21766. :  27%|████████████▌                                 | 61/224 [00:31<01:22,  1.97it/s]
Epoch 1 Iter 62: loss 0.21766. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.98it/s]
Epoch 1 Iter 63: loss 0.23200. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.98it/s]
Epoch 1 Iter 63: loss 0.23200. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.00it/s]
Epoch 1 Iter 64: loss 0.23176. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.00it/s]
Epoch 1 Iter 64: loss 0.23176. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.01it/s]
Epoch 1 Iter 65: loss 0.23533. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.01it/s]
Epoch 1 Iter 65: loss 0.23533. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.01it/s]
Epoch 1 Iter 66: loss 0.22510. :  29%|█████████████▎                                | 65/224 [00:33<01:19,  2.01it/s]
Epoch 1 Iter 66: loss 0.22510. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 1 Iter 67: loss 0.23932. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 1 Iter 67: loss 0.23932. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.00it/s]
Epoch 1 Iter 68: loss 0.21932. :  30%|█████████████▊                                | 67/224 [00:34<01:18,  2.00it/s]
Epoch 1 Iter 68: loss 0.21932. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.01it/s]
Epoch 1 Iter 69: loss 0.21513. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.01it/s]
Epoch 1 Iter 69: loss 0.21513. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.01it/s]
Epoch 1 Iter 70: loss 0.22616. :  31%|██████████████▏                               | 69/224 [00:35<01:16,  2.01it/s]
Epoch 1 Iter 70: loss 0.22616. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 1 Iter 71: loss 0.23794. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.00it/s]
Epoch 1 Iter 71: loss 0.23794. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.99it/s]
Epoch 1 Iter 72: loss 0.20157. :  32%|██████████████▌                               | 71/224 [00:36<01:17,  1.99it/s]
Epoch 1 Iter 72: loss 0.20157. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 1 Iter 73: loss 0.20716. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 1 Iter 73: loss 0.20716. :  33%|██████████████▉                               | 73/224 [00:36<01:15,  2.01it/s]
Epoch 1 Iter 74: loss 0.21071. :  33%|██████████████▉                               | 73/224 [00:37<01:15,  2.01it/s]
Epoch 1 Iter 74: loss 0.21071. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 1 Iter 75: loss 0.22685. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 1 Iter 75: loss 0.22685. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  2.00it/s]
Epoch 1 Iter 76: loss 0.21486. :  33%|███████████████▍                              | 75/224 [00:38<01:14,  2.00it/s]
Epoch 1 Iter 76: loss 0.21486. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.01it/s]
Epoch 1 Iter 77: loss 0.21006. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.01it/s]
Epoch 1 Iter 77: loss 0.21006. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.03it/s]
Epoch 1 Iter 78: loss 0.22147. :  34%|███████████████▊                              | 77/224 [00:39<01:12,  2.03it/s]
Epoch 1 Iter 78: loss 0.22147. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 1 Iter 79: loss 0.24124. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 1 Iter 79: loss 0.24124. :  35%|████████████████▏                             | 79/224 [00:39<01:12,  2.00it/s]
Epoch 1 Iter 80: loss 0.23094. :  35%|████████████████▏                             | 79/224 [00:40<01:12,  2.00it/s]
Epoch 1 Iter 80: loss 0.23094. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  2.00it/s]
Epoch 1 Iter 81: loss 0.21478. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  2.00it/s]
Epoch 1 Iter 81: loss 0.21478. :  36%|████████████████▋                             | 81/224 [00:40<01:11,  2.01it/s]
Epoch 1 Iter 82: loss 0.22854. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  2.01it/s]
Epoch 1 Iter 82: loss 0.22854. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.00it/s]
Epoch 1 Iter 83: loss 0.19924. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.00it/s]
Epoch 1 Iter 83: loss 0.19924. :  37%|█████████████████                             | 83/224 [00:41<01:10,  2.01it/s]
Epoch 1 Iter 84: loss 0.22032. :  37%|█████████████████                             | 83/224 [00:42<01:10,  2.01it/s]
Epoch 1 Iter 84: loss 0.22032. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.01it/s]
Epoch 1 Iter 85: loss 0.21615. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.01it/s]
Epoch 1 Iter 85: loss 0.21615. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  2.00it/s]
Epoch 1 Iter 86: loss 0.22084. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  2.00it/s]
Epoch 1 Iter 86: loss 0.22084. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 1 Iter 87: loss 0.20091. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 1 Iter 87: loss 0.20091. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.02it/s]
Epoch 1 Iter 88: loss 0.21737. :  39%|█████████████████▊                            | 87/224 [00:44<01:07,  2.02it/s]
Epoch 1 Iter 88: loss 0.21737. :  39%|██████████████████                            | 88/224 [00:44<01:09,  1.95it/s]
Epoch 1 Iter 89: loss 0.21872. :  39%|██████████████████                            | 88/224 [00:44<01:09,  1.95it/s]
Epoch 1 Iter 89: loss 0.21872. :  40%|██████████████████▎                           | 89/224 [00:44<01:08,  1.98it/s]
Epoch 1 Iter 90: loss 0.20164. :  40%|██████████████████▎                           | 89/224 [00:45<01:08,  1.98it/s]
Epoch 1 Iter 90: loss 0.20164. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 1 Iter 91: loss 0.22099. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  1.99it/s]
Epoch 1 Iter 91: loss 0.22099. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.00it/s]
Epoch 1 Iter 92: loss 0.20041. :  41%|██████████████████▋                           | 91/224 [00:46<01:06,  2.00it/s]
Epoch 1 Iter 92: loss 0.20041. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.00it/s]
Epoch 1 Iter 93: loss 0.20932. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.00it/s]
Epoch 1 Iter 93: loss 0.20932. :  42%|███████████████████                           | 93/224 [00:46<01:07,  1.95it/s]
Epoch 1 Iter 94: loss 0.21433. :  42%|███████████████████                           | 93/224 [00:47<01:07,  1.95it/s]
Epoch 1 Iter 94: loss 0.21433. :  42%|███████████████████▎                          | 94/224 [00:47<01:06,  1.95it/s]
Epoch 1 Iter 95: loss 0.19093. :  42%|███████████████████▎                          | 94/224 [00:47<01:06,  1.95it/s]
Epoch 1 Iter 95: loss 0.19093. :  42%|███████████████████▌                          | 95/224 [00:47<01:05,  1.97it/s]
Epoch 1 Iter 96: loss 0.20510. :  42%|███████████████████▌                          | 95/224 [00:48<01:05,  1.97it/s]
Epoch 1 Iter 96: loss 0.20510. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 1 Iter 97: loss 0.19853. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 1 Iter 97: loss 0.19853. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 1 Iter 98: loss 0.21228. :  43%|███████████████████▉                          | 97/224 [00:49<01:03,  2.00it/s]
Epoch 1 Iter 98: loss 0.21228. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 1 Iter 99: loss 0.21402. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 1 Iter 99: loss 0.21402. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  1.99it/s]
Epoch 1 Iter 100: loss 0.18669. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  1.99it/s]
Epoch 1 Iter 100: loss 0.18669. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.00it/s]
Epoch 1 Iter 101: loss 0.19972. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.00it/s]
Epoch 1 Iter 101: loss 0.19972. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.00it/s]
Epoch 1 Iter 102: loss 0.19125. :  45%|███████████████████▊                        | 101/224 [00:51<01:01,  2.00it/s]
Epoch 1 Iter 102: loss 0.19125. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.01it/s]
Epoch 1 Iter 103: loss 0.20178. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.01it/s]
Epoch 1 Iter 103: loss 0.20178. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 1 Iter 104: loss 0.21104. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  2.00it/s]
Epoch 1 Iter 104: loss 0.21104. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.01it/s]
Epoch 1 Iter 105: loss 0.19859. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.01it/s]
Epoch 1 Iter 105: loss 0.19859. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.02it/s]
Epoch 1 Iter 106: loss 0.20345. :  47%|████████████████████▋                       | 105/224 [00:53<00:59,  2.02it/s]
Epoch 1 Iter 106: loss 0.20345. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.02it/s]
Epoch 1 Iter 107: loss 0.21752. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.02it/s]
Epoch 1 Iter 107: loss 0.21752. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.00it/s]
Epoch 1 Iter 108: loss 0.18352. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  2.00it/s]
Epoch 1 Iter 108: loss 0.18352. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 1 Iter 109: loss 0.18826. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 1 Iter 109: loss 0.18826. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.00it/s]
Epoch 1 Iter 110: loss 0.20354. :  49%|█████████████████████▍                      | 109/224 [00:55<00:57,  2.00it/s]
Epoch 1 Iter 110: loss 0.20354. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.00it/s]
Epoch 1 Iter 111: loss 0.18046. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.00it/s]
Epoch 1 Iter 111: loss 0.18046. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.00it/s]
Epoch 1 Iter 112: loss 0.19471. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  2.00it/s]
Epoch 1 Iter 112: loss 0.19471. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.00it/s]
Epoch 1 Iter 113: loss 0.21321. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.00it/s]
Epoch 1 Iter 113: loss 0.21321. :  50%|██████████████████████▏                     | 113/224 [00:56<00:55,  2.00it/s]
Epoch 1 Iter 114: loss 0.20942. :  50%|██████████████████████▏                     | 113/224 [00:57<00:55,  2.00it/s]
Epoch 1 Iter 114: loss 0.20942. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.01it/s]
Epoch 1 Iter 115: loss 0.22363. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.01it/s]
Epoch 1 Iter 115: loss 0.22363. :  51%|██████████████████████▌                     | 115/224 [00:57<00:53,  2.03it/s]
Epoch 1 Iter 116: loss 0.22487. :  51%|██████████████████████▌                     | 115/224 [00:58<00:53,  2.03it/s]
Epoch 1 Iter 116: loss 0.22487. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.02it/s]
Epoch 1 Iter 117: loss 0.18909. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.02it/s]
Epoch 1 Iter 117: loss 0.18909. :  52%|██████████████████████▉                     | 117/224 [00:58<00:52,  2.03it/s]
Epoch 1 Iter 118: loss 0.19986. :  52%|██████████████████████▉                     | 117/224 [00:59<00:52,  2.03it/s]
Epoch 1 Iter 118: loss 0.19986. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.03it/s]
Epoch 1 Iter 119: loss 0.20650. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.03it/s]
Epoch 1 Iter 119: loss 0.20650. :  53%|███████████████████████▍                    | 119/224 [00:59<00:51,  2.03it/s]
Epoch 1 Iter 120: loss 0.18541. :  53%|███████████████████████▍                    | 119/224 [01:00<00:51,  2.03it/s]
Epoch 1 Iter 120: loss 0.18541. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 1 Iter 121: loss 0.19329. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 1 Iter 121: loss 0.19329. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.02it/s]
Epoch 1 Iter 122: loss 0.20130. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  2.02it/s]
Epoch 1 Iter 122: loss 0.20130. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.99it/s]
Epoch 1 Iter 123: loss 0.18511. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.99it/s]
Epoch 1 Iter 123: loss 0.18511. :  55%|████████████████████████▏                   | 123/224 [01:01<00:51,  1.98it/s]
Epoch 1 Iter 124: loss 0.20457. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.98it/s]
Epoch 1 Iter 124: loss 0.20457. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.99it/s]
Epoch 1 Iter 125: loss 0.20896. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.99it/s]
Epoch 1 Iter 125: loss 0.20896. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  1.99it/s]
Epoch 1 Iter 126: loss 0.18964. :  56%|████████████████████████▌                   | 125/224 [01:03<00:49,  1.99it/s]
Epoch 1 Iter 126: loss 0.18964. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.00it/s]
Epoch 1 Iter 127: loss 0.19938. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.00it/s]
Epoch 1 Iter 127: loss 0.19938. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.01it/s]
Epoch 1 Iter 128: loss 0.20534. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.01it/s]
Epoch 1 Iter 128: loss 0.20534. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 1 Iter 129: loss 0.18902. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 1 Iter 129: loss 0.18902. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.01it/s]
Epoch 1 Iter 130: loss 0.18333. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  2.01it/s]
Epoch 1 Iter 130: loss 0.18333. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 1 Iter 131: loss 0.20874. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 1 Iter 131: loss 0.20874. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:47,  1.97it/s]
Epoch 1 Iter 132: loss 0.18418. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:47,  1.97it/s]
Epoch 1 Iter 132: loss 0.18418. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:47,  1.92it/s]
Epoch 1 Iter 133: loss 0.20254. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:47,  1.92it/s]
Epoch 1 Iter 133: loss 0.20254. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:47,  1.94it/s]
Epoch 1 Iter 134: loss 0.18981. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:47,  1.94it/s]
Epoch 1 Iter 134: loss 0.18981. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:46,  1.95it/s]
Epoch 1 Iter 135: loss 0.18787. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:46,  1.95it/s]
Epoch 1 Iter 135: loss 0.18787. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:45,  1.97it/s]
Epoch 1 Iter 136: loss 0.18732. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:45,  1.97it/s]
Epoch 1 Iter 136: loss 0.18732. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.99it/s]
Epoch 1 Iter 137: loss 0.20201. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.99it/s]
Epoch 1 Iter 137: loss 0.20201. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:44,  1.97it/s]
Epoch 1 Iter 138: loss 0.19374. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:44,  1.97it/s]
Epoch 1 Iter 138: loss 0.19374. :  62%|███████████████████████████                 | 138/224 [01:09<00:43,  1.98it/s]
Epoch 1 Iter 139: loss 0.21668. :  62%|███████████████████████████                 | 138/224 [01:09<00:43,  1.98it/s]
Epoch 1 Iter 139: loss 0.21668. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.01it/s]
Epoch 1 Iter 140: loss 0.19471. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.01it/s]
Epoch 1 Iter 140: loss 0.19471. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 1 Iter 141: loss 0.20592. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 1 Iter 141: loss 0.20592. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  1.99it/s]
Epoch 1 Iter 142: loss 0.17466. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  1.99it/s]
Epoch 1 Iter 142: loss 0.17466. :  63%|███████████████████████████▉                | 142/224 [01:11<00:43,  1.88it/s]
Epoch 1 Iter 143: loss 0.20392. :  63%|███████████████████████████▉                | 142/224 [01:11<00:43,  1.88it/s]
Epoch 1 Iter 143: loss 0.20392. :  64%|████████████████████████████                | 143/224 [01:11<00:47,  1.71it/s]
Epoch 1 Iter 144: loss 0.21495. :  64%|████████████████████████████                | 143/224 [01:12<00:47,  1.71it/s]
Epoch 1 Iter 144: loss 0.21495. :  64%|████████████████████████████▎               | 144/224 [01:12<00:49,  1.63it/s]
Epoch 1 Iter 145: loss 0.19445. :  64%|████████████████████████████▎               | 144/224 [01:13<00:49,  1.63it/s]
Epoch 1 Iter 145: loss 0.19445. :  65%|████████████████████████████▍               | 145/224 [01:13<00:47,  1.67it/s]
Epoch 1 Iter 146: loss 0.22358. :  65%|████████████████████████████▍               | 145/224 [01:13<00:47,  1.67it/s]
Epoch 1 Iter 146: loss 0.22358. :  65%|████████████████████████████▋               | 146/224 [01:13<00:48,  1.61it/s]
Epoch 1 Iter 147: loss 0.19144. :  65%|████████████████████████████▋               | 146/224 [01:14<00:48,  1.61it/s]
Epoch 1 Iter 147: loss 0.19144. :  66%|████████████████████████████▉               | 147/224 [01:14<00:49,  1.55it/s]
Epoch 1 Iter 148: loss 0.23851. :  66%|████████████████████████████▉               | 147/224 [01:15<00:49,  1.55it/s]
Epoch 1 Iter 148: loss 0.23851. :  66%|█████████████████████████████               | 148/224 [01:15<00:46,  1.62it/s]
Epoch 1 Iter 149: loss 0.19903. :  66%|█████████████████████████████               | 148/224 [01:15<00:46,  1.62it/s]
Epoch 1 Iter 149: loss 0.19903. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:43,  1.71it/s]
Epoch 1 Iter 150: loss 0.21276. :  67%|█████████████████████████████▎              | 149/224 [01:16<00:43,  1.71it/s]
Epoch 1 Iter 150: loss 0.21276. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:41,  1.79it/s]
Epoch 1 Iter 151: loss 0.21355. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:41,  1.79it/s]
Epoch 1 Iter 151: loss 0.21355. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:39,  1.85it/s]
Epoch 1 Iter 152: loss 0.20631. :  67%|█████████████████████████████▋              | 151/224 [01:17<00:39,  1.85it/s]
Epoch 1 Iter 152: loss 0.20631. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:38,  1.88it/s]
Epoch 1 Iter 153: loss 0.20436. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:38,  1.88it/s]
Epoch 1 Iter 153: loss 0.20436. :  68%|██████████████████████████████              | 153/224 [01:17<00:37,  1.92it/s]
Epoch 1 Iter 154: loss 0.18015. :  68%|██████████████████████████████              | 153/224 [01:18<00:37,  1.92it/s]
Epoch 1 Iter 154: loss 0.18015. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:36,  1.94it/s]
Epoch 1 Iter 155: loss 0.18300. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:36,  1.94it/s]
Epoch 1 Iter 155: loss 0.18300. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:35,  1.96it/s]
Epoch 1 Iter 156: loss 0.19789. :  69%|██████████████████████████████▍             | 155/224 [01:19<00:35,  1.96it/s]
Epoch 1 Iter 156: loss 0.19789. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:35,  1.92it/s]
Epoch 1 Iter 157: loss 0.22622. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:35,  1.92it/s]
Epoch 1 Iter 157: loss 0.22622. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:34,  1.93it/s]
Epoch 1 Iter 158: loss 0.18294. :  70%|██████████████████████████████▊             | 157/224 [01:20<00:34,  1.93it/s]
Epoch 1 Iter 158: loss 0.18294. :  71%|███████████████████████████████             | 158/224 [01:20<00:33,  1.96it/s]
Epoch 1 Iter 159: loss 0.19583. :  71%|███████████████████████████████             | 158/224 [01:20<00:33,  1.96it/s]
Epoch 1 Iter 159: loss 0.19583. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  1.98it/s]
Epoch 1 Iter 160: loss 0.20711. :  71%|███████████████████████████████▏            | 159/224 [01:21<00:32,  1.98it/s]
Epoch 1 Iter 160: loss 0.20711. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.98it/s]
Epoch 1 Iter 161: loss 0.17824. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.98it/s]
Epoch 1 Iter 161: loss 0.17824. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.98it/s]
Epoch 1 Iter 162: loss 0.19374. :  72%|███████████████████████████████▋            | 161/224 [01:22<00:31,  1.98it/s]
Epoch 1 Iter 162: loss 0.19374. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.99it/s]
Epoch 1 Iter 163: loss 0.17823. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.99it/s]
Epoch 1 Iter 163: loss 0.17823. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.00it/s]
Epoch 1 Iter 164: loss 0.19827. :  73%|████████████████████████████████            | 163/224 [01:23<00:30,  2.00it/s]
Epoch 1 Iter 164: loss 0.19827. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.98it/s]
Epoch 1 Iter 165: loss 0.19401. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.98it/s]
Epoch 1 Iter 165: loss 0.19401. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.92it/s]
Epoch 1 Iter 166: loss 0.20369. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:30,  1.92it/s]
Epoch 1 Iter 166: loss 0.20369. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.95it/s]
Epoch 1 Iter 167: loss 0.20673. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.95it/s]
Epoch 1 Iter 167: loss 0.20673. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.96it/s]
Epoch 1 Iter 168: loss 0.20706. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.96it/s]
Epoch 1 Iter 168: loss 0.20706. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.99it/s]
Epoch 1 Iter 169: loss 0.18890. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.99it/s]
Epoch 1 Iter 169: loss 0.18890. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  2.00it/s]
Epoch 1 Iter 170: loss 0.22532. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:27,  2.00it/s]
Epoch 1 Iter 170: loss 0.22532. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.01it/s]
Epoch 1 Iter 171: loss 0.22899. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:26,  2.01it/s]
Epoch 1 Iter 171: loss 0.22899. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.99it/s]
Epoch 1 Iter 172: loss 0.19084. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  1.99it/s]
Epoch 1 Iter 172: loss 0.19084. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.99it/s]
Epoch 1 Iter 173: loss 0.20302. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.99it/s]
Epoch 1 Iter 173: loss 0.20302. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  1.99it/s]
Epoch 1 Iter 174: loss 0.19814. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:25,  1.99it/s]
Epoch 1 Iter 174: loss 0.19814. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.00it/s]
Epoch 1 Iter 175: loss 0.18318. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.00it/s]
Epoch 1 Iter 175: loss 0.18318. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.02it/s]
Epoch 1 Iter 176: loss 0.19101. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  2.02it/s]
Epoch 1 Iter 176: loss 0.19101. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.02it/s]
Epoch 1 Iter 177: loss 0.19177. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.02it/s]
Epoch 1 Iter 177: loss 0.19177. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  1.99it/s]
Epoch 1 Iter 178: loss 0.19692. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:23,  1.99it/s]
Epoch 1 Iter 178: loss 0.19692. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.98it/s]
Epoch 1 Iter 179: loss 0.20435. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.98it/s]
Epoch 1 Iter 179: loss 0.20435. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  1.97it/s]
Epoch 1 Iter 180: loss 0.19977. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  1.97it/s]
Epoch 1 Iter 180: loss 0.19977. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.97it/s]
Epoch 1 Iter 181: loss 0.21426. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.97it/s]
Epoch 1 Iter 181: loss 0.21426. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  1.98it/s]
Epoch 1 Iter 182: loss 0.20910. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  1.98it/s]
Epoch 1 Iter 182: loss 0.20910. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.99it/s]
Epoch 1 Iter 183: loss 0.19817. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.99it/s]
Epoch 1 Iter 183: loss 0.19817. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  1.98it/s]
Epoch 1 Iter 184: loss 0.18670. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  1.98it/s]
Epoch 1 Iter 184: loss 0.18670. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.96it/s]
Epoch 1 Iter 185: loss 0.18486. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.96it/s]
Epoch 1 Iter 185: loss 0.18486. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:20,  1.95it/s]
Epoch 1 Iter 186: loss 0.20050. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:20,  1.95it/s]
Epoch 1 Iter 186: loss 0.20050. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.95it/s]
Epoch 1 Iter 187: loss 0.18659. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.95it/s]
Epoch 1 Iter 187: loss 0.18659. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.96it/s]
Epoch 1 Iter 188: loss 0.20618. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.96it/s]
Epoch 1 Iter 188: loss 0.20618. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.96it/s]
Epoch 1 Iter 189: loss 0.19915. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.96it/s]
Epoch 1 Iter 189: loss 0.19915. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.95it/s]
Epoch 1 Iter 190: loss 0.16562. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  1.95it/s]
Epoch 1 Iter 190: loss 0.16562. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.95it/s]
Epoch 1 Iter 191: loss 0.19626. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.95it/s]
Epoch 1 Iter 191: loss 0.19626. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:17,  1.94it/s]
Epoch 1 Iter 192: loss 0.17818. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:17,  1.94it/s]
Epoch 1 Iter 192: loss 0.17818. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.95it/s]
Epoch 1 Iter 193: loss 0.18498. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.95it/s]
Epoch 1 Iter 193: loss 0.18498. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.96it/s]
Epoch 1 Iter 194: loss 0.19209. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.96it/s]
Epoch 1 Iter 194: loss 0.19209. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.96it/s]
Epoch 1 Iter 195: loss 0.19185. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.96it/s]
Epoch 1 Iter 195: loss 0.19185. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  1.98it/s]
Epoch 1 Iter 196: loss 0.18681. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.98it/s]
Epoch 1 Iter 196: loss 0.18681. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  2.00it/s]
Epoch 1 Iter 197: loss 0.21075. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  2.00it/s]
Epoch 1 Iter 197: loss 0.21075. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  1.99it/s]
Epoch 1 Iter 198: loss 0.21247. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.99it/s]
Epoch 1 Iter 198: loss 0.21247. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.99it/s]
Epoch 1 Iter 199: loss 0.18720. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.99it/s]
Epoch 1 Iter 199: loss 0.18720. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.00it/s]
Epoch 1 Iter 200: loss 0.20735. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  2.00it/s]
Epoch 1 Iter 200: loss 0.20735. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  2.00it/s]
Epoch 1 Iter 201: loss 0.17738. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  2.00it/s]
Epoch 1 Iter 201: loss 0.17738. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 1 Iter 202: loss 0.22945. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.99it/s]
Epoch 1 Iter 202: loss 0.22945. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 1 Iter 203: loss 0.19630. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 1 Iter 203: loss 0.19630. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.00it/s]
Epoch 1 Iter 204: loss 0.19159. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.00it/s]
Epoch 1 Iter 204: loss 0.19159. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.01it/s]
Epoch 1 Iter 205: loss 0.18185. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.01it/s]
Epoch 1 Iter 205: loss 0.18185. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.00it/s]
Epoch 1 Iter 206: loss 0.19684. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.00it/s]
Epoch 1 Iter 206: loss 0.19684. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.00it/s]
Epoch 1 Iter 207: loss 0.19063. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.00it/s]
Epoch 1 Iter 207: loss 0.19063. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.01it/s]
Epoch 1 Iter 208: loss 0.19208. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.01it/s]
Epoch 1 Iter 208: loss 0.19208. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 1 Iter 209: loss 0.19812. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.02it/s]
Epoch 1 Iter 209: loss 0.19812. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.02it/s]
Epoch 1 Iter 210: loss 0.18610. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.02it/s]
Epoch 1 Iter 210: loss 0.18610. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.02it/s]
Epoch 1 Iter 211: loss 0.19504. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.02it/s]
Epoch 1 Iter 211: loss 0.19504. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.03it/s]
Epoch 1 Iter 212: loss 0.20006. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.03it/s]
Epoch 1 Iter 212: loss 0.20006. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 1 Iter 213: loss 0.20689. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.02it/s]
Epoch 1 Iter 213: loss 0.20689. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.03it/s]
Epoch 1 Iter 214: loss 0.18929. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.03it/s]
Epoch 1 Iter 214: loss 0.18929. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.03it/s]
Epoch 1 Iter 215: loss 0.18022. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.03it/s]
Epoch 1 Iter 215: loss 0.18022. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.03it/s]
Epoch 1 Iter 216: loss 0.20286. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.03it/s]
Epoch 1 Iter 216: loss 0.20286. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.03it/s]
Epoch 1 Iter 217: loss 0.18773. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.03it/s]
Epoch 1 Iter 217: loss 0.18773. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.04it/s]
Epoch 1 Iter 218: loss 0.20874. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.04it/s]
Epoch 1 Iter 218: loss 0.20874. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.03it/s]
Epoch 1 Iter 219: loss 0.20689. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.03it/s]
Epoch 1 Iter 219: loss 0.20689. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.03it/s]
Epoch 1 Iter 220: loss 0.21617. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.03it/s]
Epoch 1 Iter 220: loss 0.21617. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.04it/s]
Epoch 1 Iter 221: loss 0.19263. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.04it/s]
Epoch 1 Iter 221: loss 0.19263. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.04it/s]
Epoch 1 Iter 222: loss 0.17570. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.04it/s]
Epoch 1 Iter 222: loss 0.17570. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 1 Iter 223: loss 0.17609. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 1 Iter 223: loss 0.17609. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.01it/s]
Epoch 1 Iter 224: loss 0.19898. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.01it/s]
Epoch 1 Iter 224: loss 0.19898. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  2.02it/s]
Epoch 1 Iter 224: loss 0.19898. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

    Train loss: 0.23342
    Valid loss: 0.59439
       Valid loss recons: 0.59439
       Valid loss KL-D:   0.01889
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.19287. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 2 Iter 1: loss 0.19287. :   0%|▏                                               | 1/224 [00:00<01:52,  1.98it/s]
Epoch 2 Iter 2: loss 0.19411. :   0%|▏                                               | 1/224 [00:01<01:52,  1.98it/s]
Epoch 2 Iter 2: loss 0.19411. :   1%|▍                                               | 2/224 [00:01<01:51,  1.99it/s]
Epoch 2 Iter 3: loss 0.18789. :   1%|▍                                               | 2/224 [00:01<01:51,  1.99it/s]
Epoch 2 Iter 3: loss 0.18789. :   1%|▋                                               | 3/224 [00:01<01:50,  2.00it/s]
Epoch 2 Iter 4: loss 0.20667. :   1%|▋                                               | 3/224 [00:02<01:50,  2.00it/s]
Epoch 2 Iter 4: loss 0.20667. :   2%|▊                                               | 4/224 [00:02<01:50,  2.00it/s]
Epoch 2 Iter 5: loss 0.17608. :   2%|▊                                               | 4/224 [00:02<01:50,  2.00it/s]
Epoch 2 Iter 5: loss 0.17608. :   2%|█                                               | 5/224 [00:02<01:48,  2.01it/s]
Epoch 2 Iter 6: loss 0.19821. :   2%|█                                               | 5/224 [00:02<01:48,  2.01it/s]
Epoch 2 Iter 6: loss 0.19821. :   3%|█▎                                              | 6/224 [00:02<01:48,  2.01it/s]
Epoch 2 Iter 7: loss 0.22772. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 2 Iter 7: loss 0.22772. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 2 Iter 8: loss 0.18255. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 2 Iter 8: loss 0.18255. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.01it/s]
Epoch 2 Iter 9: loss 0.20382. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.01it/s]
Epoch 2 Iter 9: loss 0.20382. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.02it/s]
Epoch 2 Iter 10: loss 0.19277. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 2 Iter 10: loss 0.19277. :   4%|██                                            | 10/224 [00:04<01:46,  2.01it/s]
Epoch 2 Iter 11: loss 0.18332. :   4%|██                                            | 10/224 [00:05<01:46,  2.01it/s]
Epoch 2 Iter 11: loss 0.18332. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 2 Iter 12: loss 0.19730. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.03it/s]
Epoch 2 Iter 12: loss 0.19730. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.03it/s]
Epoch 2 Iter 13: loss 0.18979. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.03it/s]
Epoch 2 Iter 13: loss 0.18979. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.04it/s]
Epoch 2 Iter 14: loss 0.18973. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.04it/s]
Epoch 2 Iter 14: loss 0.18973. :   6%|██▉                                           | 14/224 [00:06<01:43,  2.04it/s]
Epoch 2 Iter 15: loss 0.20233. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.04it/s]
Epoch 2 Iter 15: loss 0.20233. :   7%|███                                           | 15/224 [00:07<01:42,  2.03it/s]
Epoch 2 Iter 16: loss 0.20555. :   7%|███                                           | 15/224 [00:07<01:42,  2.03it/s]
Epoch 2 Iter 16: loss 0.20555. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.02it/s]
Epoch 2 Iter 17: loss 0.19271. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.02it/s]
Epoch 2 Iter 17: loss 0.19271. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.03it/s]
Epoch 2 Iter 18: loss 0.19086. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.03it/s]
Epoch 2 Iter 18: loss 0.19086. :   8%|███▋                                          | 18/224 [00:08<01:41,  2.03it/s]
Epoch 2 Iter 19: loss 0.20569. :   8%|███▋                                          | 18/224 [00:09<01:41,  2.03it/s]
Epoch 2 Iter 19: loss 0.20569. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.00it/s]
Epoch 2 Iter 20: loss 0.18817. :   8%|███▉                                          | 19/224 [00:09<01:42,  2.00it/s]
Epoch 2 Iter 20: loss 0.18817. :   9%|████                                          | 20/224 [00:09<01:41,  2.00it/s]
Epoch 2 Iter 21: loss 0.18626. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 2 Iter 21: loss 0.18626. :   9%|████▎                                         | 21/224 [00:10<01:41,  1.99it/s]
Epoch 2 Iter 22: loss 0.17874. :   9%|████▎                                         | 21/224 [00:10<01:41,  1.99it/s]
Epoch 2 Iter 22: loss 0.17874. :  10%|████▌                                         | 22/224 [00:10<01:41,  1.99it/s]
Epoch 2 Iter 23: loss 0.19605. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.99it/s]
Epoch 2 Iter 23: loss 0.19605. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 2 Iter 24: loss 0.18617. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 2 Iter 24: loss 0.18617. :  11%|████▉                                         | 24/224 [00:11<01:40,  1.99it/s]
Epoch 2 Iter 25: loss 0.20661. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 2 Iter 25: loss 0.20661. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 2 Iter 26: loss 0.19973. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.01it/s]
Epoch 2 Iter 26: loss 0.19973. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.01it/s]
Epoch 2 Iter 27: loss 0.19690. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.01it/s]
Epoch 2 Iter 27: loss 0.19690. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 2 Iter 28: loss 0.17903. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.02it/s]
Epoch 2 Iter 28: loss 0.17903. :  12%|█████▊                                        | 28/224 [00:13<01:37,  2.02it/s]
Epoch 2 Iter 29: loss 0.18195. :  12%|█████▊                                        | 28/224 [00:14<01:37,  2.02it/s]
Epoch 2 Iter 29: loss 0.18195. :  13%|█████▉                                        | 29/224 [00:14<01:35,  2.03it/s]
Epoch 2 Iter 30: loss 0.19844. :  13%|█████▉                                        | 29/224 [00:14<01:35,  2.03it/s]
Epoch 2 Iter 30: loss 0.19844. :  13%|██████▏                                       | 30/224 [00:14<01:35,  2.04it/s]
Epoch 2 Iter 31: loss 0.19940. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.04it/s]
Epoch 2 Iter 31: loss 0.19940. :  14%|██████▎                                       | 31/224 [00:15<01:34,  2.04it/s]
Epoch 2 Iter 32: loss 0.18562. :  14%|██████▎                                       | 31/224 [00:15<01:34,  2.04it/s]
Epoch 2 Iter 32: loss 0.18562. :  14%|██████▌                                       | 32/224 [00:15<01:33,  2.04it/s]
Epoch 2 Iter 33: loss 0.21141. :  14%|██████▌                                       | 32/224 [00:16<01:33,  2.04it/s]
Epoch 2 Iter 33: loss 0.21141. :  15%|██████▊                                       | 33/224 [00:16<01:33,  2.04it/s]
Epoch 2 Iter 34: loss 0.19995. :  15%|██████▊                                       | 33/224 [00:16<01:33,  2.04it/s]
Epoch 2 Iter 34: loss 0.19995. :  15%|██████▉                                       | 34/224 [00:16<01:33,  2.04it/s]
Epoch 2 Iter 35: loss 0.18844. :  15%|██████▉                                       | 34/224 [00:17<01:33,  2.04it/s]
Epoch 2 Iter 35: loss 0.18844. :  16%|███████▏                                      | 35/224 [00:17<01:32,  2.03it/s]
Epoch 2 Iter 36: loss 0.18061. :  16%|███████▏                                      | 35/224 [00:17<01:32,  2.03it/s]
Epoch 2 Iter 36: loss 0.18061. :  16%|███████▍                                      | 36/224 [00:17<01:32,  2.04it/s]
Epoch 2 Iter 37: loss 0.21055. :  16%|███████▍                                      | 36/224 [00:18<01:32,  2.04it/s]
Epoch 2 Iter 37: loss 0.21055. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.05it/s]
Epoch 2 Iter 38: loss 0.19275. :  17%|███████▌                                      | 37/224 [00:18<01:31,  2.05it/s]
Epoch 2 Iter 38: loss 0.19275. :  17%|███████▊                                      | 38/224 [00:18<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.16627. :  17%|███████▊                                      | 38/224 [00:19<01:31,  2.04it/s]
Epoch 2 Iter 39: loss 0.16627. :  17%|████████                                      | 39/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 40: loss 0.19471. :  17%|████████                                      | 39/224 [00:19<01:30,  2.03it/s]
Epoch 2 Iter 40: loss 0.19471. :  18%|████████▏                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 2 Iter 41: loss 0.18623. :  18%|████████▏                                     | 40/224 [00:20<01:30,  2.04it/s]
Epoch 2 Iter 41: loss 0.18623. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 2 Iter 42: loss 0.18701. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 2 Iter 42: loss 0.18701. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 2 Iter 43: loss 0.19527. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 2 Iter 43: loss 0.19527. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.97it/s]
Epoch 2 Iter 44: loss 0.19676. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.97it/s]
Epoch 2 Iter 44: loss 0.19676. :  20%|█████████                                     | 44/224 [00:21<01:30,  1.98it/s]
Epoch 2 Iter 45: loss 0.17953. :  20%|█████████                                     | 44/224 [00:22<01:30,  1.98it/s]
Epoch 2 Iter 45: loss 0.17953. :  20%|█████████▏                                    | 45/224 [00:22<01:30,  1.99it/s]
Epoch 2 Iter 46: loss 0.19404. :  20%|█████████▏                                    | 45/224 [00:22<01:30,  1.99it/s]
Epoch 2 Iter 46: loss 0.19404. :  21%|█████████▍                                    | 46/224 [00:22<01:29,  2.00it/s]
Epoch 2 Iter 47: loss 0.18636. :  21%|█████████▍                                    | 46/224 [00:23<01:29,  2.00it/s]
Epoch 2 Iter 47: loss 0.18636. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 2 Iter 48: loss 0.18858. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 2 Iter 48: loss 0.18858. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.00it/s]
Epoch 2 Iter 49: loss 0.20385. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 2 Iter 49: loss 0.20385. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.01it/s]
Epoch 2 Iter 50: loss 0.20283. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.01it/s]
Epoch 2 Iter 50: loss 0.20283. :  22%|██████████▎                                   | 50/224 [00:24<01:26,  2.01it/s]
Epoch 2 Iter 51: loss 0.20971. :  22%|██████████▎                                   | 50/224 [00:25<01:26,  2.01it/s]
Epoch 2 Iter 51: loss 0.20971. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 2 Iter 52: loss 0.18988. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 2 Iter 52: loss 0.18988. :  23%|██████████▋                                   | 52/224 [00:25<01:25,  2.01it/s]
Epoch 2 Iter 53: loss 0.19764. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 2 Iter 53: loss 0.19764. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 2 Iter 54: loss 0.18699. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 2 Iter 54: loss 0.18699. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.01it/s]
Epoch 2 Iter 55: loss 0.20315. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 2 Iter 55: loss 0.20315. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 2 Iter 56: loss 0.20139. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.03it/s]
Epoch 2 Iter 56: loss 0.20139. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.02it/s]
Epoch 2 Iter 57: loss 0.19641. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.02it/s]
Epoch 2 Iter 57: loss 0.19641. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.03it/s]
Epoch 2 Iter 58: loss 0.21418. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.03it/s]
Epoch 2 Iter 58: loss 0.21418. :  26%|███████████▉                                  | 58/224 [00:28<01:24,  1.98it/s]
Epoch 2 Iter 59: loss 0.18278. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.98it/s]
Epoch 2 Iter 59: loss 0.18278. :  26%|████████████                                  | 59/224 [00:29<01:28,  1.86it/s]
Epoch 2 Iter 60: loss 0.19370. :  26%|████████████                                  | 59/224 [00:29<01:28,  1.86it/s]
Epoch 2 Iter 60: loss 0.19370. :  27%|████████████▎                                 | 60/224 [00:29<01:26,  1.90it/s]
Epoch 2 Iter 61: loss 0.19337. :  27%|████████████▎                                 | 60/224 [00:30<01:26,  1.90it/s]
Epoch 2 Iter 61: loss 0.19337. :  27%|████████████▌                                 | 61/224 [00:30<01:24,  1.94it/s]
Epoch 2 Iter 62: loss 0.17885. :  27%|████████████▌                                 | 61/224 [00:30<01:24,  1.94it/s]
Epoch 2 Iter 62: loss 0.17885. :  28%|████████████▋                                 | 62/224 [00:30<01:22,  1.96it/s]
Epoch 2 Iter 63: loss 0.18919. :  28%|████████████▋                                 | 62/224 [00:31<01:22,  1.96it/s]
Epoch 2 Iter 63: loss 0.18919. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  1.99it/s]
Epoch 2 Iter 64: loss 0.19074. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  1.99it/s]
Epoch 2 Iter 64: loss 0.19074. :  29%|█████████████▏                                | 64/224 [00:31<01:20,  2.00it/s]
Epoch 2 Iter 65: loss 0.19010. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  2.00it/s]
Epoch 2 Iter 65: loss 0.19010. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 2 Iter 66: loss 0.20752. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 2 Iter 66: loss 0.20752. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.01it/s]
Epoch 2 Iter 67: loss 0.17103. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.01it/s]
Epoch 2 Iter 67: loss 0.17103. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.01it/s]
Epoch 2 Iter 68: loss 0.20716. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.01it/s]
Epoch 2 Iter 68: loss 0.20716. :  30%|█████████████▉                                | 68/224 [00:33<01:22,  1.89it/s]
Epoch 2 Iter 69: loss 0.19299. :  30%|█████████████▉                                | 68/224 [00:34<01:22,  1.89it/s]
Epoch 2 Iter 69: loss 0.19299. :  31%|██████████████▏                               | 69/224 [00:34<01:21,  1.89it/s]
Epoch 2 Iter 70: loss 0.18778. :  31%|██████████████▏                               | 69/224 [00:35<01:21,  1.89it/s]
Epoch 2 Iter 70: loss 0.18778. :  31%|██████████████▍                               | 70/224 [00:35<01:20,  1.91it/s]
Epoch 2 Iter 71: loss 0.17891. :  31%|██████████████▍                               | 70/224 [00:35<01:20,  1.91it/s]
Epoch 2 Iter 71: loss 0.17891. :  32%|██████████████▌                               | 71/224 [00:35<01:21,  1.88it/s]
Epoch 2 Iter 72: loss 0.18398. :  32%|██████████████▌                               | 71/224 [00:36<01:21,  1.88it/s]
Epoch 2 Iter 72: loss 0.18398. :  32%|██████████████▊                               | 72/224 [00:36<01:20,  1.90it/s]
Epoch 2 Iter 73: loss 0.20347. :  32%|██████████████▊                               | 72/224 [00:36<01:20,  1.90it/s]
Epoch 2 Iter 73: loss 0.20347. :  33%|██████████████▉                               | 73/224 [00:36<01:19,  1.91it/s]
Epoch 2 Iter 74: loss 0.18470. :  33%|██████████████▉                               | 73/224 [00:37<01:19,  1.91it/s]
Epoch 2 Iter 74: loss 0.18470. :  33%|███████████████▏                              | 74/224 [00:37<01:17,  1.93it/s]
Epoch 2 Iter 75: loss 0.20711. :  33%|███████████████▏                              | 74/224 [00:37<01:17,  1.93it/s]
Epoch 2 Iter 75: loss 0.20711. :  33%|███████████████▍                              | 75/224 [00:37<01:16,  1.94it/s]
Epoch 2 Iter 76: loss 0.20302. :  33%|███████████████▍                              | 75/224 [00:38<01:16,  1.94it/s]
Epoch 2 Iter 76: loss 0.20302. :  34%|███████████████▌                              | 76/224 [00:38<01:15,  1.96it/s]
Epoch 2 Iter 77: loss 0.19029. :  34%|███████████████▌                              | 76/224 [00:38<01:15,  1.96it/s]
Epoch 2 Iter 77: loss 0.19029. :  34%|███████████████▊                              | 77/224 [00:38<01:14,  1.97it/s]
Epoch 2 Iter 78: loss 0.18116. :  34%|███████████████▊                              | 77/224 [00:39<01:14,  1.97it/s]
Epoch 2 Iter 78: loss 0.18116. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.98it/s]
Epoch 2 Iter 79: loss 0.19234. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.98it/s]
Epoch 2 Iter 79: loss 0.19234. :  35%|████████████████▏                             | 79/224 [00:39<01:15,  1.92it/s]
Epoch 2 Iter 80: loss 0.18407. :  35%|████████████████▏                             | 79/224 [00:40<01:15,  1.92it/s]
Epoch 2 Iter 80: loss 0.18407. :  36%|████████████████▍                             | 80/224 [00:40<01:14,  1.94it/s]
Epoch 2 Iter 81: loss 0.18880. :  36%|████████████████▍                             | 80/224 [00:40<01:14,  1.94it/s]
Epoch 2 Iter 81: loss 0.18880. :  36%|████████████████▋                             | 81/224 [00:40<01:13,  1.96it/s]
Epoch 2 Iter 82: loss 0.19905. :  36%|████████████████▋                             | 81/224 [00:41<01:13,  1.96it/s]
Epoch 2 Iter 82: loss 0.19905. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.98it/s]
Epoch 2 Iter 83: loss 0.19047. :  37%|████████████████▊                             | 82/224 [00:41<01:11,  1.98it/s]
Epoch 2 Iter 83: loss 0.19047. :  37%|█████████████████                             | 83/224 [00:41<01:11,  1.98it/s]
Epoch 2 Iter 84: loss 0.18823. :  37%|█████████████████                             | 83/224 [00:42<01:11,  1.98it/s]
Epoch 2 Iter 84: loss 0.18823. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 2 Iter 85: loss 0.18920. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 2 Iter 85: loss 0.18920. :  38%|█████████████████▍                            | 85/224 [00:42<01:10,  1.98it/s]
Epoch 2 Iter 86: loss 0.18490. :  38%|█████████████████▍                            | 85/224 [00:43<01:10,  1.98it/s]
Epoch 2 Iter 86: loss 0.18490. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  1.98it/s]
Epoch 2 Iter 87: loss 0.19416. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  1.98it/s]
Epoch 2 Iter 87: loss 0.19416. :  39%|█████████████████▊                            | 87/224 [00:43<01:11,  1.91it/s]
Epoch 2 Iter 88: loss 0.19769. :  39%|█████████████████▊                            | 87/224 [00:44<01:11,  1.91it/s]
Epoch 2 Iter 88: loss 0.19769. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.93it/s]
Epoch 2 Iter 89: loss 0.17560. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.93it/s]
Epoch 2 Iter 89: loss 0.17560. :  40%|██████████████████▎                           | 89/224 [00:44<01:10,  1.92it/s]
Epoch 2 Iter 90: loss 0.18863. :  40%|██████████████████▎                           | 89/224 [00:45<01:10,  1.92it/s]
Epoch 2 Iter 90: loss 0.18863. :  40%|██████████████████▍                           | 90/224 [00:45<01:09,  1.93it/s]
Epoch 2 Iter 91: loss 0.16910. :  40%|██████████████████▍                           | 90/224 [00:45<01:09,  1.93it/s]
Epoch 2 Iter 91: loss 0.16910. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.96it/s]
Epoch 2 Iter 92: loss 0.20422. :  41%|██████████████████▋                           | 91/224 [00:46<01:07,  1.96it/s]
Epoch 2 Iter 92: loss 0.20422. :  41%|██████████████████▉                           | 92/224 [00:46<01:07,  1.96it/s]
Epoch 2 Iter 93: loss 0.21293. :  41%|██████████████████▉                           | 92/224 [00:46<01:07,  1.96it/s]
Epoch 2 Iter 93: loss 0.21293. :  42%|███████████████████                           | 93/224 [00:46<01:06,  1.97it/s]
Epoch 2 Iter 94: loss 0.20466. :  42%|███████████████████                           | 93/224 [00:47<01:06,  1.97it/s]
Epoch 2 Iter 94: loss 0.20466. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.97it/s]
Epoch 2 Iter 95: loss 0.19078. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.97it/s]
Epoch 2 Iter 95: loss 0.19078. :  42%|███████████████████▌                          | 95/224 [00:47<01:05,  1.97it/s]
Epoch 2 Iter 96: loss 0.19070. :  42%|███████████████████▌                          | 95/224 [00:48<01:05,  1.97it/s]
Epoch 2 Iter 96: loss 0.19070. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 2 Iter 97: loss 0.17584. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.98it/s]
Epoch 2 Iter 97: loss 0.17584. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.98it/s]
Epoch 2 Iter 98: loss 0.18241. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.98it/s]
Epoch 2 Iter 98: loss 0.18241. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.99it/s]
Epoch 2 Iter 99: loss 0.18429. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.99it/s]
Epoch 2 Iter 99: loss 0.18429. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.00it/s]
Epoch 2 Iter 100: loss 0.20136. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  2.00it/s]
Epoch 2 Iter 100: loss 0.20136. :  45%|███████████████████▋                        | 100/224 [00:50<01:02,  1.99it/s]
Epoch 2 Iter 101: loss 0.20092. :  45%|███████████████████▋                        | 100/224 [00:50<01:02,  1.99it/s]
Epoch 2 Iter 101: loss 0.20092. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  1.99it/s]
Epoch 2 Iter 102: loss 0.18258. :  45%|███████████████████▊                        | 101/224 [00:51<01:01,  1.99it/s]
Epoch 2 Iter 102: loss 0.18258. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 2 Iter 103: loss 0.20544. :  46%|████████████████████                        | 102/224 [00:51<01:02,  1.95it/s]
Epoch 2 Iter 103: loss 0.20544. :  46%|████████████████████▏                       | 103/224 [00:51<01:01,  1.97it/s]
Epoch 2 Iter 104: loss 0.19116. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.97it/s]
Epoch 2 Iter 104: loss 0.19116. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.99it/s]
Epoch 2 Iter 105: loss 0.20657. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.99it/s]
Epoch 2 Iter 105: loss 0.20657. :  47%|████████████████████▋                       | 105/224 [00:52<01:00,  1.98it/s]
Epoch 2 Iter 106: loss 0.18619. :  47%|████████████████████▋                       | 105/224 [00:53<01:00,  1.98it/s]
Epoch 2 Iter 106: loss 0.18619. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.99it/s]
Epoch 2 Iter 107: loss 0.18250. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  1.99it/s]
Epoch 2 Iter 107: loss 0.18250. :  48%|█████████████████████                       | 107/224 [00:53<00:59,  1.98it/s]
Epoch 2 Iter 108: loss 0.18675. :  48%|█████████████████████                       | 107/224 [00:54<00:59,  1.98it/s]
Epoch 2 Iter 108: loss 0.18675. :  48%|█████████████████████▏                      | 108/224 [00:54<01:01,  1.89it/s]
Epoch 2 Iter 109: loss 0.18450. :  48%|█████████████████████▏                      | 108/224 [00:54<01:01,  1.89it/s]
Epoch 2 Iter 109: loss 0.18450. :  49%|█████████████████████▍                      | 109/224 [00:54<01:01,  1.87it/s]
Epoch 2 Iter 110: loss 0.18227. :  49%|█████████████████████▍                      | 109/224 [00:55<01:01,  1.87it/s]
Epoch 2 Iter 110: loss 0.18227. :  49%|█████████████████████▌                      | 110/224 [00:55<01:00,  1.89it/s]
Epoch 2 Iter 111: loss 0.17081. :  49%|█████████████████████▌                      | 110/224 [00:56<01:00,  1.89it/s]
Epoch 2 Iter 111: loss 0.17081. :  50%|█████████████████████▊                      | 111/224 [00:56<00:59,  1.91it/s]
Epoch 2 Iter 112: loss 0.22552. :  50%|█████████████████████▊                      | 111/224 [00:56<00:59,  1.91it/s]
Epoch 2 Iter 112: loss 0.22552. :  50%|██████████████████████                      | 112/224 [00:56<00:58,  1.91it/s]
Epoch 2 Iter 113: loss 0.19351. :  50%|██████████████████████                      | 112/224 [00:57<00:58,  1.91it/s]
Epoch 2 Iter 113: loss 0.19351. :  50%|██████████████████████▏                     | 113/224 [00:57<00:57,  1.93it/s]
Epoch 2 Iter 114: loss 0.18590. :  50%|██████████████████████▏                     | 113/224 [00:57<00:57,  1.93it/s]
Epoch 2 Iter 114: loss 0.18590. :  51%|██████████████████████▍                     | 114/224 [00:57<00:56,  1.94it/s]
Epoch 2 Iter 115: loss 0.18196. :  51%|██████████████████████▍                     | 114/224 [00:58<00:56,  1.94it/s]
Epoch 2 Iter 115: loss 0.18196. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.95it/s]
Epoch 2 Iter 116: loss 0.20177. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.95it/s]
Epoch 2 Iter 116: loss 0.20177. :  52%|██████████████████████▊                     | 116/224 [00:58<00:55,  1.95it/s]
Epoch 2 Iter 117: loss 0.19529. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.95it/s]
Epoch 2 Iter 117: loss 0.19529. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.93it/s]
Epoch 2 Iter 118: loss 0.19059. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.93it/s]
Epoch 2 Iter 118: loss 0.19059. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.97it/s]
Epoch 2 Iter 119: loss 0.17911. :  53%|███████████████████████▏                    | 118/224 [01:00<00:53,  1.97it/s]
Epoch 2 Iter 119: loss 0.17911. :  53%|███████████████████████▍                    | 119/224 [01:00<00:52,  1.99it/s]
Epoch 2 Iter 120: loss 0.21018. :  53%|███████████████████████▍                    | 119/224 [01:00<00:52,  1.99it/s]
Epoch 2 Iter 120: loss 0.21018. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.99it/s]
Epoch 2 Iter 121: loss 0.17448. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.99it/s]
Epoch 2 Iter 121: loss 0.17448. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  1.99it/s]
Epoch 2 Iter 122: loss 0.18968. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  1.99it/s]
Epoch 2 Iter 122: loss 0.18968. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  2.00it/s]
Epoch 2 Iter 123: loss 0.17875. :  54%|███████████████████████▉                    | 122/224 [01:02<00:51,  2.00it/s]
Epoch 2 Iter 123: loss 0.17875. :  55%|████████████████████████▏                   | 123/224 [01:02<00:50,  2.01it/s]
Epoch 2 Iter 124: loss 0.17652. :  55%|████████████████████████▏                   | 123/224 [01:02<00:50,  2.01it/s]
Epoch 2 Iter 124: loss 0.17652. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 2 Iter 125: loss 0.20069. :  55%|████████████████████████▎                   | 124/224 [01:03<00:49,  2.01it/s]
Epoch 2 Iter 125: loss 0.20069. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.95it/s]
Epoch 2 Iter 126: loss 0.17737. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.95it/s]
Epoch 2 Iter 126: loss 0.17737. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.97it/s]
Epoch 2 Iter 127: loss 0.16173. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.97it/s]
Epoch 2 Iter 127: loss 0.16173. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  1.99it/s]
Epoch 2 Iter 128: loss 0.20018. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  1.99it/s]
Epoch 2 Iter 128: loss 0.20018. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:48,  1.99it/s]
Epoch 2 Iter 129: loss 0.17447. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.99it/s]
Epoch 2 Iter 129: loss 0.17447. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  1.99it/s]
Epoch 2 Iter 130: loss 0.19639. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  1.99it/s]
Epoch 2 Iter 130: loss 0.19639. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  1.99it/s]
Epoch 2 Iter 131: loss 0.18590. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:47,  1.99it/s]
Epoch 2 Iter 131: loss 0.18590. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.00it/s]
Epoch 2 Iter 132: loss 0.18390. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.00it/s]
Epoch 2 Iter 132: loss 0.18390. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.00it/s]
Epoch 2 Iter 133: loss 0.17520. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:45,  2.00it/s]
Epoch 2 Iter 133: loss 0.17520. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  2.00it/s]
Epoch 2 Iter 134: loss 0.20095. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  2.00it/s]
Epoch 2 Iter 134: loss 0.20095. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.01it/s]
Epoch 2 Iter 135: loss 0.19509. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:44,  2.01it/s]
Epoch 2 Iter 135: loss 0.19509. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  2.02it/s]
Epoch 2 Iter 136: loss 0.17208. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  2.02it/s]
Epoch 2 Iter 136: loss 0.17208. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.01it/s]
Epoch 2 Iter 137: loss 0.19646. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 137: loss 0.19646. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 138: loss 0.19169. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.01it/s]
Epoch 2 Iter 138: loss 0.19169. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.01it/s]
Epoch 2 Iter 139: loss 0.18767. :  62%|███████████████████████████                 | 138/224 [01:10<00:42,  2.01it/s]
Epoch 2 Iter 139: loss 0.18767. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.01it/s]
Epoch 2 Iter 140: loss 0.17195. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.01it/s]
Epoch 2 Iter 140: loss 0.17195. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.02it/s]
Epoch 2 Iter 141: loss 0.17448. :  62%|███████████████████████████▌                | 140/224 [01:11<00:41,  2.02it/s]
Epoch 2 Iter 141: loss 0.17448. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.01it/s]
Epoch 2 Iter 142: loss 0.17873. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.01it/s]
Epoch 2 Iter 142: loss 0.17873. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.01it/s]
Epoch 2 Iter 143: loss 0.18509. :  63%|███████████████████████████▉                | 142/224 [01:12<00:40,  2.01it/s]
Epoch 2 Iter 143: loss 0.18509. :  64%|████████████████████████████                | 143/224 [01:12<00:41,  1.97it/s]
Epoch 2 Iter 144: loss 0.16993. :  64%|████████████████████████████                | 143/224 [01:12<00:41,  1.97it/s]
Epoch 2 Iter 144: loss 0.16993. :  64%|████████████████████████████▎               | 144/224 [01:12<00:42,  1.90it/s]
Epoch 2 Iter 145: loss 0.18021. :  64%|████████████████████████████▎               | 144/224 [01:13<00:42,  1.90it/s]
Epoch 2 Iter 145: loss 0.18021. :  65%|████████████████████████████▍               | 145/224 [01:13<00:41,  1.89it/s]
Epoch 2 Iter 146: loss 0.20216. :  65%|████████████████████████████▍               | 145/224 [01:13<00:41,  1.89it/s]
Epoch 2 Iter 146: loss 0.20216. :  65%|████████████████████████████▋               | 146/224 [01:13<00:40,  1.92it/s]
Epoch 2 Iter 147: loss 0.18661. :  65%|████████████████████████████▋               | 146/224 [01:14<00:40,  1.92it/s]
Epoch 2 Iter 147: loss 0.18661. :  66%|████████████████████████████▉               | 147/224 [01:14<00:39,  1.95it/s]
Epoch 2 Iter 148: loss 0.18113. :  66%|████████████████████████████▉               | 147/224 [01:14<00:39,  1.95it/s]
Epoch 2 Iter 148: loss 0.18113. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.98it/s]
Epoch 2 Iter 149: loss 0.19158. :  66%|█████████████████████████████               | 148/224 [01:15<00:38,  1.98it/s]
Epoch 2 Iter 149: loss 0.19158. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  1.99it/s]
Epoch 2 Iter 150: loss 0.19079. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  1.99it/s]
Epoch 2 Iter 150: loss 0.19079. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:37,  1.99it/s]
Epoch 2 Iter 151: loss 0.17793. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:37,  1.99it/s]
Epoch 2 Iter 151: loss 0.17793. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.01it/s]
Epoch 2 Iter 152: loss 0.16556. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.01it/s]
Epoch 2 Iter 152: loss 0.16556. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.02it/s]
Epoch 2 Iter 153: loss 0.21663. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:35,  2.02it/s]
Epoch 2 Iter 153: loss 0.21663. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  2.02it/s]
Epoch 2 Iter 154: loss 0.20066. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  2.02it/s]
Epoch 2 Iter 154: loss 0.20066. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.02it/s]
Epoch 2 Iter 155: loss 0.20765. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:34,  2.02it/s]
Epoch 2 Iter 155: loss 0.20765. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.01it/s]
Epoch 2 Iter 156: loss 0.19767. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.01it/s]
Epoch 2 Iter 156: loss 0.19767. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.01it/s]
Epoch 2 Iter 157: loss 0.19376. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:33,  2.01it/s]
Epoch 2 Iter 157: loss 0.19376. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.02it/s]
Epoch 2 Iter 158: loss 0.20328. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.02it/s]
Epoch 2 Iter 158: loss 0.20328. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.01it/s]
Epoch 2 Iter 159: loss 0.20658. :  71%|███████████████████████████████             | 158/224 [01:20<00:32,  2.01it/s]
Epoch 2 Iter 159: loss 0.20658. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.02it/s]
Epoch 2 Iter 160: loss 0.17958. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.02it/s]
Epoch 2 Iter 160: loss 0.17958. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.02it/s]
Epoch 2 Iter 161: loss 0.19481. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:31,  2.02it/s]
Epoch 2 Iter 161: loss 0.19481. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.02it/s]
Epoch 2 Iter 162: loss 0.18227. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.02it/s]
Epoch 2 Iter 162: loss 0.18227. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.02it/s]
Epoch 2 Iter 163: loss 0.21502. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:30,  2.02it/s]
Epoch 2 Iter 163: loss 0.21502. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.01it/s]
Epoch 2 Iter 164: loss 0.16706. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.01it/s]
Epoch 2 Iter 164: loss 0.16706. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.99it/s]
Epoch 2 Iter 165: loss 0.19137. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.99it/s]
Epoch 2 Iter 165: loss 0.19137. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:31,  1.87it/s]
Epoch 2 Iter 166: loss 0.18369. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:31,  1.87it/s]
Epoch 2 Iter 166: loss 0.18369. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:30,  1.87it/s]
Epoch 2 Iter 167: loss 0.18897. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:30,  1.87it/s]
Epoch 2 Iter 167: loss 0.18897. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:30,  1.89it/s]
Epoch 2 Iter 168: loss 0.16815. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:30,  1.89it/s]
Epoch 2 Iter 168: loss 0.16815. :  75%|█████████████████████████████████           | 168/224 [01:24<00:28,  1.93it/s]
Epoch 2 Iter 169: loss 0.17307. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.93it/s]
Epoch 2 Iter 169: loss 0.17307. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:28,  1.96it/s]
Epoch 2 Iter 170: loss 0.17817. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:28,  1.96it/s]
Epoch 2 Iter 170: loss 0.17817. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:27,  1.98it/s]
Epoch 2 Iter 171: loss 0.18357. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.98it/s]
Epoch 2 Iter 171: loss 0.18357. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.98it/s]
Epoch 2 Iter 172: loss 0.16745. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.98it/s]
Epoch 2 Iter 172: loss 0.16745. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:26,  2.00it/s]
Epoch 2 Iter 173: loss 0.16913. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  2.00it/s]
Epoch 2 Iter 173: loss 0.16913. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.02it/s]
Epoch 2 Iter 174: loss 0.18314. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  2.02it/s]
Epoch 2 Iter 174: loss 0.18314. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.02it/s]
Epoch 2 Iter 175: loss 0.19658. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:24,  2.02it/s]
Epoch 2 Iter 175: loss 0.19658. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.01it/s]
Epoch 2 Iter 176: loss 0.18194. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  2.01it/s]
Epoch 2 Iter 176: loss 0.18194. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.01it/s]
Epoch 2 Iter 177: loss 0.16280. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:23,  2.01it/s]
Epoch 2 Iter 177: loss 0.16280. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.02it/s]
Epoch 2 Iter 178: loss 0.16411. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  2.02it/s]
Epoch 2 Iter 178: loss 0.16411. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.02it/s]
Epoch 2 Iter 179: loss 0.18873. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:22,  2.02it/s]
Epoch 2 Iter 179: loss 0.18873. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.01it/s]
Epoch 2 Iter 180: loss 0.21908. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.01it/s]
Epoch 2 Iter 180: loss 0.21908. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.02it/s]
Epoch 2 Iter 181: loss 0.19422. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.02it/s]
Epoch 2 Iter 181: loss 0.19422. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.02it/s]
Epoch 2 Iter 182: loss 0.18686. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.02it/s]
Epoch 2 Iter 182: loss 0.18686. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.01it/s]
Epoch 2 Iter 183: loss 0.17511. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.01it/s]
Epoch 2 Iter 183: loss 0.17511. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.00it/s]
Epoch 2 Iter 184: loss 0.18859. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.00it/s]
Epoch 2 Iter 184: loss 0.18859. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:21,  1.85it/s]
Epoch 2 Iter 185: loss 0.20512. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:21,  1.85it/s]
Epoch 2 Iter 185: loss 0.20512. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:21,  1.81it/s]
Epoch 2 Iter 186: loss 0.17198. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:21,  1.81it/s]
Epoch 2 Iter 186: loss 0.17198. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:20,  1.81it/s]
Epoch 2 Iter 187: loss 0.18403. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:20,  1.81it/s]
Epoch 2 Iter 187: loss 0.18403. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:20,  1.80it/s]
Epoch 2 Iter 188: loss 0.20080. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:20,  1.80it/s]
Epoch 2 Iter 188: loss 0.20080. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:19,  1.84it/s]
Epoch 2 Iter 189: loss 0.19578. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:19,  1.84it/s]
Epoch 2 Iter 189: loss 0.19578. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:18,  1.88it/s]
Epoch 2 Iter 190: loss 0.18116. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:18,  1.88it/s]
Epoch 2 Iter 190: loss 0.18116. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.91it/s]
Epoch 2 Iter 191: loss 0.20884. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.91it/s]
Epoch 2 Iter 191: loss 0.20884. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:17,  1.93it/s]
Epoch 2 Iter 192: loss 0.19225. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:17,  1.93it/s]
Epoch 2 Iter 192: loss 0.19225. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.95it/s]
Epoch 2 Iter 193: loss 0.17888. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.95it/s]
Epoch 2 Iter 193: loss 0.17888. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.97it/s]
Epoch 2 Iter 194: loss 0.18165. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.97it/s]
Epoch 2 Iter 194: loss 0.18165. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 2 Iter 195: loss 0.19610. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 2 Iter 195: loss 0.19610. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  1.98it/s]
Epoch 2 Iter 196: loss 0.19954. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.98it/s]
Epoch 2 Iter 196: loss 0.19954. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.99it/s]
Epoch 2 Iter 197: loss 0.18569. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.99it/s]
Epoch 2 Iter 197: loss 0.18569. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:14,  1.84it/s]
Epoch 2 Iter 198: loss 0.19041. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:14,  1.84it/s]
Epoch 2 Iter 198: loss 0.19041. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:14,  1.84it/s]
Epoch 2 Iter 199: loss 0.18029. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:14,  1.84it/s]
Epoch 2 Iter 199: loss 0.18029. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:13,  1.84it/s]
Epoch 2 Iter 200: loss 0.21165. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:13,  1.84it/s]
Epoch 2 Iter 200: loss 0.21165. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.87it/s]
Epoch 2 Iter 201: loss 0.18424. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.87it/s]
Epoch 2 Iter 201: loss 0.18424. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:12,  1.92it/s]
Epoch 2 Iter 202: loss 0.18685. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:12,  1.92it/s]
Epoch 2 Iter 202: loss 0.18685. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  1.95it/s]
Epoch 2 Iter 203: loss 0.18227. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  1.95it/s]
Epoch 2 Iter 203: loss 0.18227. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  1.97it/s]
Epoch 2 Iter 204: loss 0.21412. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.97it/s]
Epoch 2 Iter 204: loss 0.21412. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.98it/s]
Epoch 2 Iter 205: loss 0.18776. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.98it/s]
Epoch 2 Iter 205: loss 0.18776. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  1.99it/s]
Epoch 2 Iter 206: loss 0.18640. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.99it/s]
Epoch 2 Iter 206: loss 0.18640. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.01it/s]
Epoch 2 Iter 207: loss 0.21267. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.01it/s]
Epoch 2 Iter 207: loss 0.21267. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.01it/s]
Epoch 2 Iter 208: loss 0.16319. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.01it/s]
Epoch 2 Iter 208: loss 0.16319. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 2 Iter 209: loss 0.17420. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 2 Iter 209: loss 0.17420. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.01it/s]
Epoch 2 Iter 210: loss 0.20861. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 2 Iter 210: loss 0.20861. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.00it/s]
Epoch 2 Iter 211: loss 0.16921. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.00it/s]
Epoch 2 Iter 211: loss 0.16921. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.00it/s]
Epoch 2 Iter 212: loss 0.18290. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.00it/s]
Epoch 2 Iter 212: loss 0.18290. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.99it/s]
Epoch 2 Iter 213: loss 0.19975. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.99it/s]
Epoch 2 Iter 213: loss 0.19975. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.01it/s]
Epoch 2 Iter 214: loss 0.16885. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.01it/s]
Epoch 2 Iter 214: loss 0.16885. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 2 Iter 215: loss 0.21118. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 2 Iter 215: loss 0.21118. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.01it/s]
Epoch 2 Iter 216: loss 0.18761. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.01it/s]
Epoch 2 Iter 216: loss 0.18761. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.01it/s]
Epoch 2 Iter 217: loss 0.16989. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.01it/s]
Epoch 2 Iter 217: loss 0.16989. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.02it/s]
Epoch 2 Iter 218: loss 0.19465. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.02it/s]
Epoch 2 Iter 218: loss 0.19465. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.02it/s]
Epoch 2 Iter 219: loss 0.16331. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.02it/s]
Epoch 2 Iter 219: loss 0.16331. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.02it/s]
Epoch 2 Iter 220: loss 0.18057. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.02it/s]
Epoch 2 Iter 220: loss 0.18057. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.02it/s]
Epoch 2 Iter 221: loss 0.19786. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.02it/s]
Epoch 2 Iter 221: loss 0.19786. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.02it/s]
Epoch 2 Iter 222: loss 0.18126. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.02it/s]
Epoch 2 Iter 222: loss 0.18126. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 2 Iter 223: loss 0.19795. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 2 Iter 223: loss 0.19795. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.03it/s]
Epoch 2 Iter 224: loss 0.18401. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.03it/s]
Epoch 2 Iter 224: loss 0.18401. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  2.01it/s]
Epoch 2 Iter 224: loss 0.18401. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.18858. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 3 Iter 1: loss 0.18858. :   0%|▏                                               | 1/224 [00:00<01:49,  2.04it/s]
Epoch 3 Iter 2: loss 0.20662. :   0%|▏                                               | 1/224 [00:00<01:49,  2.04it/s]
Epoch 3 Iter 2: loss 0.20662. :   1%|▍                                               | 2/224 [00:00<01:49,  2.02it/s]
Epoch 3 Iter 3: loss 0.18958. :   1%|▍                                               | 2/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 3: loss 0.18958. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 4: loss 0.18865. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 3 Iter 4: loss 0.18865. :   2%|▊                                               | 4/224 [00:01<01:49,  2.01it/s]
Epoch 3 Iter 5: loss 0.18530. :   2%|▊                                               | 4/224 [00:02<01:49,  2.01it/s]
Epoch 3 Iter 5: loss 0.18530. :   2%|█                                               | 5/224 [00:02<01:48,  2.03it/s]
Epoch 3 Iter 6: loss 0.19340. :   2%|█                                               | 5/224 [00:02<01:48,  2.03it/s]
Epoch 3 Iter 6: loss 0.19340. :   3%|█▎                                              | 6/224 [00:02<01:47,  2.03it/s]
Epoch 3 Iter 7: loss 0.19753. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.03it/s]
Epoch 3 Iter 7: loss 0.19753. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.03it/s]
Epoch 3 Iter 8: loss 0.17789. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.03it/s]
Epoch 3 Iter 8: loss 0.17789. :   4%|█▋                                              | 8/224 [00:03<01:46,  2.02it/s]
Epoch 3 Iter 9: loss 0.18285. :   4%|█▋                                              | 8/224 [00:04<01:46,  2.02it/s]
Epoch 3 Iter 9: loss 0.18285. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.03it/s]
Epoch 3 Iter 10: loss 0.17021. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.03it/s]
Epoch 3 Iter 10: loss 0.17021. :   4%|██                                            | 10/224 [00:04<01:45,  2.03it/s]
Epoch 3 Iter 11: loss 0.22519. :   4%|██                                            | 10/224 [00:05<01:45,  2.03it/s]
Epoch 3 Iter 11: loss 0.22519. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.02it/s]
Epoch 3 Iter 12: loss 0.16778. :   5%|██▎                                           | 11/224 [00:05<01:45,  2.02it/s]
Epoch 3 Iter 12: loss 0.16778. :   5%|██▍                                           | 12/224 [00:05<01:44,  2.03it/s]
Epoch 3 Iter 13: loss 0.18189. :   5%|██▍                                           | 12/224 [00:06<01:44,  2.03it/s]
Epoch 3 Iter 13: loss 0.18189. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.03it/s]
Epoch 3 Iter 14: loss 0.17405. :   6%|██▋                                           | 13/224 [00:06<01:43,  2.03it/s]
Epoch 3 Iter 14: loss 0.17405. :   6%|██▉                                           | 14/224 [00:06<01:43,  2.04it/s]
Epoch 3 Iter 15: loss 0.19724. :   6%|██▉                                           | 14/224 [00:07<01:43,  2.04it/s]
Epoch 3 Iter 15: loss 0.19724. :   7%|███                                           | 15/224 [00:07<01:42,  2.04it/s]
Epoch 3 Iter 16: loss 0.21104. :   7%|███                                           | 15/224 [00:07<01:42,  2.04it/s]
Epoch 3 Iter 16: loss 0.21104. :   7%|███▎                                          | 16/224 [00:07<01:41,  2.05it/s]
Epoch 3 Iter 17: loss 0.16971. :   7%|███▎                                          | 16/224 [00:08<01:41,  2.05it/s]
Epoch 3 Iter 17: loss 0.16971. :   8%|███▍                                          | 17/224 [00:08<01:41,  2.03it/s]
Epoch 3 Iter 18: loss 0.16256. :   8%|███▍                                          | 17/224 [00:08<01:41,  2.03it/s]
Epoch 3 Iter 18: loss 0.16256. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.02it/s]
Epoch 3 Iter 19: loss 0.19001. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 3 Iter 19: loss 0.19001. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 3 Iter 20: loss 0.17625. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.01it/s]
Epoch 3 Iter 20: loss 0.17625. :   9%|████                                          | 20/224 [00:09<01:41,  2.01it/s]
Epoch 3 Iter 21: loss 0.20404. :   9%|████                                          | 20/224 [00:10<01:41,  2.01it/s]
Epoch 3 Iter 21: loss 0.20404. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 3 Iter 22: loss 0.17955. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.01it/s]
Epoch 3 Iter 22: loss 0.17955. :  10%|████▌                                         | 22/224 [00:10<01:39,  2.02it/s]
Epoch 3 Iter 23: loss 0.19504. :  10%|████▌                                         | 22/224 [00:11<01:39,  2.02it/s]
Epoch 3 Iter 23: loss 0.19504. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 3 Iter 24: loss 0.17117. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 3 Iter 24: loss 0.17117. :  11%|████▉                                         | 24/224 [00:11<01:38,  2.03it/s]
Epoch 3 Iter 25: loss 0.18878. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.03it/s]
Epoch 3 Iter 25: loss 0.18878. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 3 Iter 26: loss 0.19699. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 3 Iter 26: loss 0.19699. :  12%|█████▎                                        | 26/224 [00:12<01:37,  2.02it/s]
Epoch 3 Iter 27: loss 0.18417. :  12%|█████▎                                        | 26/224 [00:13<01:37,  2.02it/s]
Epoch 3 Iter 27: loss 0.18417. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 3 Iter 28: loss 0.17806. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 3 Iter 28: loss 0.17806. :  12%|█████▊                                        | 28/224 [00:13<01:36,  2.03it/s]
Epoch 3 Iter 29: loss 0.16996. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.03it/s]
Epoch 3 Iter 29: loss 0.16996. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 3 Iter 30: loss 0.19354. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 3 Iter 30: loss 0.19354. :  13%|██████▏                                       | 30/224 [00:14<01:35,  2.02it/s]
Epoch 3 Iter 31: loss 0.19495. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.02it/s]
Epoch 3 Iter 31: loss 0.19495. :  14%|██████▎                                       | 31/224 [00:15<01:34,  2.03it/s]
Epoch 3 Iter 32: loss 0.16937. :  14%|██████▎                                       | 31/224 [00:15<01:34,  2.03it/s]
Epoch 3 Iter 32: loss 0.16937. :  14%|██████▌                                       | 32/224 [00:15<01:34,  2.03it/s]
Epoch 3 Iter 33: loss 0.16656. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.03it/s]
Epoch 3 Iter 33: loss 0.16656. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.01it/s]
Epoch 3 Iter 34: loss 0.19027. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.01it/s]
Epoch 3 Iter 34: loss 0.19027. :  15%|██████▉                                       | 34/224 [00:16<01:34,  2.01it/s]
Epoch 3 Iter 35: loss 0.15917. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.01it/s]
Epoch 3 Iter 35: loss 0.15917. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.02it/s]
Epoch 3 Iter 36: loss 0.18886. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.02it/s]
Epoch 3 Iter 36: loss 0.18886. :  16%|███████▍                                      | 36/224 [00:17<01:33,  2.02it/s]
Epoch 3 Iter 37: loss 0.19426. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.02it/s]
Epoch 3 Iter 37: loss 0.19426. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 3 Iter 38: loss 0.19408. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.03it/s]
Epoch 3 Iter 38: loss 0.19408. :  17%|███████▊                                      | 38/224 [00:18<01:34,  1.97it/s]
Epoch 3 Iter 39: loss 0.18058. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.97it/s]
Epoch 3 Iter 39: loss 0.18058. :  17%|████████                                      | 39/224 [00:19<01:35,  1.95it/s]
Epoch 3 Iter 40: loss 0.19129. :  17%|████████                                      | 39/224 [00:19<01:35,  1.95it/s]
Epoch 3 Iter 40: loss 0.19129. :  18%|████████▏                                     | 40/224 [00:19<01:33,  1.96it/s]
Epoch 3 Iter 41: loss 0.19763. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.96it/s]
Epoch 3 Iter 41: loss 0.19763. :  18%|████████▍                                     | 41/224 [00:20<01:32,  1.98it/s]
Epoch 3 Iter 42: loss 0.18203. :  18%|████████▍                                     | 41/224 [00:20<01:32,  1.98it/s]
Epoch 3 Iter 42: loss 0.18203. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.98it/s]
Epoch 3 Iter 43: loss 0.19036. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.98it/s]
Epoch 3 Iter 43: loss 0.19036. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.99it/s]
Epoch 3 Iter 44: loss 0.18677. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.99it/s]
Epoch 3 Iter 44: loss 0.18677. :  20%|█████████                                     | 44/224 [00:21<01:30,  1.99it/s]
Epoch 3 Iter 45: loss 0.18615. :  20%|█████████                                     | 44/224 [00:22<01:30,  1.99it/s]
Epoch 3 Iter 45: loss 0.18615. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 3 Iter 46: loss 0.18891. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 3 Iter 46: loss 0.18891. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.01it/s]
Epoch 3 Iter 47: loss 0.18023. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 3 Iter 47: loss 0.18023. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 3 Iter 48: loss 0.21399. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 3 Iter 48: loss 0.21399. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.01it/s]
Epoch 3 Iter 49: loss 0.19339. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.01it/s]
Epoch 3 Iter 49: loss 0.19339. :  22%|██████████                                    | 49/224 [00:24<01:27,  1.99it/s]
Epoch 3 Iter 50: loss 0.17298. :  22%|██████████                                    | 49/224 [00:24<01:27,  1.99it/s]
Epoch 3 Iter 50: loss 0.17298. :  22%|██████████▎                                   | 50/224 [00:24<01:27,  2.00it/s]
Epoch 3 Iter 51: loss 0.18557. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  2.00it/s]
Epoch 3 Iter 51: loss 0.18557. :  23%|██████████▍                                   | 51/224 [00:25<01:28,  1.96it/s]
Epoch 3 Iter 52: loss 0.20577. :  23%|██████████▍                                   | 51/224 [00:25<01:28,  1.96it/s]
Epoch 3 Iter 52: loss 0.20577. :  23%|██████████▋                                   | 52/224 [00:25<01:26,  1.98it/s]
Epoch 3 Iter 53: loss 0.18300. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.98it/s]
Epoch 3 Iter 53: loss 0.18300. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  1.99it/s]
Epoch 3 Iter 54: loss 0.18910. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  1.99it/s]
Epoch 3 Iter 54: loss 0.18910. :  24%|███████████                                   | 54/224 [00:26<01:25,  1.99it/s]
Epoch 3 Iter 55: loss 0.16951. :  24%|███████████                                   | 54/224 [00:27<01:25,  1.99it/s]
Epoch 3 Iter 55: loss 0.16951. :  25%|███████████▎                                  | 55/224 [00:27<01:25,  1.99it/s]
Epoch 3 Iter 56: loss 0.18394. :  25%|███████████▎                                  | 55/224 [00:27<01:25,  1.99it/s]
Epoch 3 Iter 56: loss 0.18394. :  25%|███████████▌                                  | 56/224 [00:27<01:24,  1.99it/s]
Epoch 3 Iter 57: loss 0.18206. :  25%|███████████▌                                  | 56/224 [00:28<01:24,  1.99it/s]
Epoch 3 Iter 57: loss 0.18206. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 3 Iter 58: loss 0.18355. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 3 Iter 58: loss 0.18355. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.01it/s]
Epoch 3 Iter 59: loss 0.19114. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 3 Iter 59: loss 0.19114. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 3 Iter 60: loss 0.19365. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 3 Iter 60: loss 0.19365. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.02it/s]
Epoch 3 Iter 61: loss 0.17513. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.02it/s]
Epoch 3 Iter 61: loss 0.17513. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 3 Iter 62: loss 0.19024. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 3 Iter 62: loss 0.19024. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.02it/s]
Epoch 3 Iter 63: loss 0.19325. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.02it/s]
Epoch 3 Iter 63: loss 0.19325. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 3 Iter 64: loss 0.19709. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 3 Iter 64: loss 0.19709. :  29%|█████████████▏                                | 64/224 [00:31<01:19,  2.02it/s]
Epoch 3 Iter 65: loss 0.19976. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.02it/s]
Epoch 3 Iter 65: loss 0.19976. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 3 Iter 66: loss 0.16632. :  29%|█████████████▎                                | 65/224 [00:32<01:18,  2.01it/s]
Epoch 3 Iter 66: loss 0.16632. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.02it/s]
Epoch 3 Iter 67: loss 0.18760. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.02it/s]
Epoch 3 Iter 67: loss 0.18760. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 3 Iter 68: loss 0.18345. :  30%|█████████████▊                                | 67/224 [00:33<01:17,  2.03it/s]
Epoch 3 Iter 68: loss 0.18345. :  30%|█████████████▉                                | 68/224 [00:33<01:17,  2.02it/s]
Epoch 3 Iter 69: loss 0.18537. :  30%|█████████████▉                                | 68/224 [00:34<01:17,  2.02it/s]
Epoch 3 Iter 69: loss 0.18537. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 3 Iter 70: loss 0.16198. :  31%|██████████████▏                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 3 Iter 70: loss 0.16198. :  31%|██████████████▍                               | 70/224 [00:34<01:16,  2.01it/s]
Epoch 3 Iter 71: loss 0.18057. :  31%|██████████████▍                               | 70/224 [00:35<01:16,  2.01it/s]
Epoch 3 Iter 71: loss 0.18057. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.98it/s]
Epoch 3 Iter 72: loss 0.18363. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.98it/s]
Epoch 3 Iter 72: loss 0.18363. :  32%|██████████████▊                               | 72/224 [00:35<01:16,  1.98it/s]
Epoch 3 Iter 73: loss 0.18109. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  1.98it/s]
Epoch 3 Iter 73: loss 0.18109. :  33%|██████████████▉                               | 73/224 [00:36<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.17358. :  33%|██████████████▉                               | 73/224 [00:36<01:15,  2.00it/s]
Epoch 3 Iter 74: loss 0.17358. :  33%|███████████████▏                              | 74/224 [00:36<01:15,  1.98it/s]
Epoch 3 Iter 75: loss 0.18013. :  33%|███████████████▏                              | 74/224 [00:37<01:15,  1.98it/s]
Epoch 3 Iter 75: loss 0.18013. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  2.00it/s]
Epoch 3 Iter 76: loss 0.20506. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  2.00it/s]
Epoch 3 Iter 76: loss 0.20506. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.01it/s]
Epoch 3 Iter 77: loss 0.19008. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.01it/s]
Epoch 3 Iter 77: loss 0.19008. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 3 Iter 78: loss 0.18887. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.02it/s]
Epoch 3 Iter 78: loss 0.18887. :  35%|████████████████                              | 78/224 [00:38<01:12,  2.02it/s]
Epoch 3 Iter 79: loss 0.20540. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 3 Iter 79: loss 0.20540. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 3 Iter 80: loss 0.20545. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 3 Iter 80: loss 0.20545. :  36%|████████████████▍                             | 80/224 [00:39<01:11,  2.03it/s]
Epoch 3 Iter 81: loss 0.19649. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.03it/s]
Epoch 3 Iter 81: loss 0.19649. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.03it/s]
Epoch 3 Iter 82: loss 0.17187. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.03it/s]
Epoch 3 Iter 82: loss 0.17187. :  37%|████████████████▊                             | 82/224 [00:40<01:10,  2.02it/s]
Epoch 3 Iter 83: loss 0.18196. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 3 Iter 83: loss 0.18196. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 3 Iter 84: loss 0.17463. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 3 Iter 84: loss 0.17463. :  38%|█████████████████▎                            | 84/224 [00:41<01:09,  2.03it/s]
Epoch 3 Iter 85: loss 0.19199. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.03it/s]
Epoch 3 Iter 85: loss 0.19199. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 3 Iter 86: loss 0.19016. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 3 Iter 86: loss 0.19016. :  38%|█████████████████▋                            | 86/224 [00:42<01:08,  2.03it/s]
Epoch 3 Iter 87: loss 0.18262. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.03it/s]
Epoch 3 Iter 87: loss 0.18262. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.02it/s]
Epoch 3 Iter 88: loss 0.18001. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.02it/s]
Epoch 3 Iter 88: loss 0.18001. :  39%|██████████████████                            | 88/224 [00:43<01:07,  2.02it/s]
Epoch 3 Iter 89: loss 0.18486. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.02it/s]
Epoch 3 Iter 89: loss 0.18486. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 3 Iter 90: loss 0.18301. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 3 Iter 90: loss 0.18301. :  40%|██████████████████▍                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 3 Iter 91: loss 0.19379. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.02it/s]
Epoch 3 Iter 91: loss 0.19379. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.02it/s]
Epoch 3 Iter 92: loss 0.17422. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  2.02it/s]
Epoch 3 Iter 92: loss 0.17422. :  41%|██████████████████▉                           | 92/224 [00:45<01:05,  2.02it/s]
Epoch 3 Iter 93: loss 0.17196. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.02it/s]
Epoch 3 Iter 93: loss 0.17196. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 3 Iter 94: loss 0.18287. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.03it/s]
Epoch 3 Iter 94: loss 0.18287. :  42%|███████████████████▎                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 3 Iter 95: loss 0.18919. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.02it/s]
Epoch 3 Iter 95: loss 0.18919. :  42%|███████████████████▌                          | 95/224 [00:47<01:03,  2.02it/s]
Epoch 3 Iter 96: loss 0.19530. :  42%|███████████████████▌                          | 95/224 [00:47<01:03,  2.02it/s]
Epoch 3 Iter 96: loss 0.19530. :  43%|███████████████████▋                          | 96/224 [00:47<01:03,  2.03it/s]
Epoch 3 Iter 97: loss 0.18136. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.03it/s]
Epoch 3 Iter 97: loss 0.18136. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 3 Iter 98: loss 0.20502. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 3 Iter 98: loss 0.20502. :  44%|████████████████████▏                         | 98/224 [00:48<01:02,  2.02it/s]
Epoch 3 Iter 99: loss 0.19311. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.02it/s]
Epoch 3 Iter 99: loss 0.19311. :  44%|████████████████████▎                         | 99/224 [00:49<01:01,  2.02it/s]
Epoch 3 Iter 100: loss 0.21297. :  44%|███████████████████▉                         | 99/224 [00:49<01:01,  2.02it/s]
Epoch 3 Iter 100: loss 0.21297. :  45%|███████████████████▋                        | 100/224 [00:49<01:01,  2.03it/s]
Epoch 3 Iter 101: loss 0.18569. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.03it/s]
Epoch 3 Iter 101: loss 0.18569. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.02it/s]
Epoch 3 Iter 102: loss 0.20657. :  45%|███████████████████▊                        | 101/224 [00:50<01:00,  2.02it/s]
Epoch 3 Iter 102: loss 0.20657. :  46%|████████████████████                        | 102/224 [00:50<01:00,  2.02it/s]
Epoch 3 Iter 103: loss 0.18195. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.02it/s]
Epoch 3 Iter 103: loss 0.18195. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.03it/s]
Epoch 3 Iter 104: loss 0.18134. :  46%|████████████████████▏                       | 103/224 [00:51<00:59,  2.03it/s]
Epoch 3 Iter 104: loss 0.18134. :  46%|████████████████████▍                       | 104/224 [00:51<00:59,  2.02it/s]
Epoch 3 Iter 105: loss 0.18949. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 3 Iter 105: loss 0.18949. :  47%|████████████████████▋                       | 105/224 [00:52<00:58,  2.02it/s]
Epoch 3 Iter 106: loss 0.17523. :  47%|████████████████████▋                       | 105/224 [00:52<00:58,  2.02it/s]
Epoch 3 Iter 106: loss 0.17523. :  47%|████████████████████▊                       | 106/224 [00:52<00:58,  2.01it/s]
Epoch 3 Iter 107: loss 0.19430. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.01it/s]
Epoch 3 Iter 107: loss 0.19430. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.02it/s]
Epoch 3 Iter 108: loss 0.19817. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.02it/s]
Epoch 3 Iter 108: loss 0.19817. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.02it/s]
Epoch 3 Iter 109: loss 0.17879. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 3 Iter 109: loss 0.17879. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 110: loss 0.21102. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 110: loss 0.21102. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.03it/s]
Epoch 3 Iter 111: loss 0.16986. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 3 Iter 111: loss 0.16986. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.03it/s]
Epoch 3 Iter 112: loss 0.16930. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.03it/s]
Epoch 3 Iter 112: loss 0.16930. :  50%|██████████████████████                      | 112/224 [00:55<00:57,  1.96it/s]
Epoch 3 Iter 113: loss 0.18543. :  50%|██████████████████████                      | 112/224 [00:56<00:57,  1.96it/s]
Epoch 3 Iter 113: loss 0.18543. :  50%|██████████████████████▏                     | 113/224 [00:56<00:58,  1.91it/s]
Epoch 3 Iter 114: loss 0.18119. :  50%|██████████████████████▏                     | 113/224 [00:56<00:58,  1.91it/s]
Epoch 3 Iter 114: loss 0.18119. :  51%|██████████████████████▍                     | 114/224 [00:56<00:56,  1.94it/s]
Epoch 3 Iter 115: loss 0.19549. :  51%|██████████████████████▍                     | 114/224 [00:57<00:56,  1.94it/s]
Epoch 3 Iter 115: loss 0.19549. :  51%|██████████████████████▌                     | 115/224 [00:57<00:56,  1.92it/s]
Epoch 3 Iter 116: loss 0.18303. :  51%|██████████████████████▌                     | 115/224 [00:57<00:56,  1.92it/s]
Epoch 3 Iter 116: loss 0.18303. :  52%|██████████████████████▊                     | 116/224 [00:57<00:56,  1.93it/s]
Epoch 3 Iter 117: loss 0.18939. :  52%|██████████████████████▊                     | 116/224 [00:58<00:56,  1.93it/s]
Epoch 3 Iter 117: loss 0.18939. :  52%|██████████████████████▉                     | 117/224 [00:58<00:55,  1.94it/s]
Epoch 3 Iter 118: loss 0.18494. :  52%|██████████████████████▉                     | 117/224 [00:58<00:55,  1.94it/s]
Epoch 3 Iter 118: loss 0.18494. :  53%|███████████████████████▏                    | 118/224 [00:58<00:53,  1.96it/s]
Epoch 3 Iter 119: loss 0.17216. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.96it/s]
Epoch 3 Iter 119: loss 0.17216. :  53%|███████████████████████▍                    | 119/224 [00:59<00:53,  1.97it/s]
Epoch 3 Iter 120: loss 0.18022. :  53%|███████████████████████▍                    | 119/224 [00:59<00:53,  1.97it/s]
Epoch 3 Iter 120: loss 0.18022. :  54%|███████████████████████▌                    | 120/224 [00:59<00:52,  1.98it/s]
Epoch 3 Iter 121: loss 0.19164. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 3 Iter 121: loss 0.19164. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.00it/s]
Epoch 3 Iter 122: loss 0.20044. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.00it/s]
Epoch 3 Iter 122: loss 0.20044. :  54%|███████████████████████▉                    | 122/224 [01:00<00:51,  1.99it/s]
Epoch 3 Iter 123: loss 0.19898. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.99it/s]
Epoch 3 Iter 123: loss 0.19898. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  1.99it/s]
Epoch 3 Iter 124: loss 0.16787. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  1.99it/s]
Epoch 3 Iter 124: loss 0.16787. :  55%|████████████████████████▎                   | 124/224 [01:01<00:50,  1.99it/s]
Epoch 3 Iter 125: loss 0.18092. :  55%|████████████████████████▎                   | 124/224 [01:02<00:50,  1.99it/s]
Epoch 3 Iter 125: loss 0.18092. :  56%|████████████████████████▌                   | 125/224 [01:02<00:50,  1.97it/s]
Epoch 3 Iter 126: loss 0.17350. :  56%|████████████████████████▌                   | 125/224 [01:02<00:50,  1.97it/s]
Epoch 3 Iter 126: loss 0.17350. :  56%|████████████████████████▊                   | 126/224 [01:02<00:49,  1.98it/s]
Epoch 3 Iter 127: loss 0.15892. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.98it/s]
Epoch 3 Iter 127: loss 0.15892. :  57%|████████████████████████▉                   | 127/224 [01:03<00:49,  1.98it/s]
Epoch 3 Iter 128: loss 0.18382. :  57%|████████████████████████▉                   | 127/224 [01:03<00:49,  1.98it/s]
Epoch 3 Iter 128: loss 0.18382. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:48,  1.97it/s]
Epoch 3 Iter 129: loss 0.19520. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:48,  1.97it/s]
Epoch 3 Iter 129: loss 0.19520. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:48,  1.98it/s]
Epoch 3 Iter 130: loss 0.20187. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:48,  1.98it/s]
Epoch 3 Iter 130: loss 0.20187. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:47,  2.00it/s]
Epoch 3 Iter 131: loss 0.18416. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  2.00it/s]
Epoch 3 Iter 131: loss 0.18416. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.00it/s]
Epoch 3 Iter 132: loss 0.17138. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.00it/s]
Epoch 3 Iter 132: loss 0.17138. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.00it/s]
Epoch 3 Iter 133: loss 0.17964. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.00it/s]
Epoch 3 Iter 133: loss 0.17964. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 3 Iter 134: loss 0.18802. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 3 Iter 134: loss 0.18802. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:44,  2.01it/s]
Epoch 3 Iter 135: loss 0.18836. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.01it/s]
Epoch 3 Iter 135: loss 0.18836. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 3 Iter 136: loss 0.18812. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 3 Iter 136: loss 0.18812. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:44,  2.00it/s]
Epoch 3 Iter 137: loss 0.18646. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  2.00it/s]
Epoch 3 Iter 137: loss 0.18646. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.01it/s]
Epoch 3 Iter 138: loss 0.18719. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.01it/s]
Epoch 3 Iter 138: loss 0.18719. :  62%|███████████████████████████                 | 138/224 [01:08<00:43,  2.00it/s]
Epoch 3 Iter 139: loss 0.19601. :  62%|███████████████████████████                 | 138/224 [01:09<00:43,  2.00it/s]
Epoch 3 Iter 139: loss 0.19601. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  1.99it/s]
Epoch 3 Iter 140: loss 0.20917. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  1.99it/s]
Epoch 3 Iter 140: loss 0.20917. :  62%|███████████████████████████▌                | 140/224 [01:09<00:43,  1.95it/s]
Epoch 3 Iter 141: loss 0.20263. :  62%|███████████████████████████▌                | 140/224 [01:10<00:43,  1.95it/s]
Epoch 3 Iter 141: loss 0.20263. :  63%|███████████████████████████▋                | 141/224 [01:10<00:43,  1.93it/s]
Epoch 3 Iter 142: loss 0.19844. :  63%|███████████████████████████▋                | 141/224 [01:10<00:43,  1.93it/s]
Epoch 3 Iter 142: loss 0.19844. :  63%|███████████████████████████▉                | 142/224 [01:10<00:41,  1.96it/s]
Epoch 3 Iter 143: loss 0.17955. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  1.96it/s]
Epoch 3 Iter 143: loss 0.17955. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  1.99it/s]
Epoch 3 Iter 144: loss 0.18063. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  1.99it/s]
Epoch 3 Iter 144: loss 0.18063. :  64%|████████████████████████████▎               | 144/224 [01:11<00:40,  1.99it/s]
Epoch 3 Iter 145: loss 0.17289. :  64%|████████████████████████████▎               | 144/224 [01:12<00:40,  1.99it/s]
Epoch 3 Iter 145: loss 0.17289. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.00it/s]
Epoch 3 Iter 146: loss 0.18206. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.00it/s]
Epoch 3 Iter 146: loss 0.18206. :  65%|████████████████████████████▋               | 146/224 [01:12<00:38,  2.01it/s]
Epoch 3 Iter 147: loss 0.19525. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 3 Iter 147: loss 0.19525. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 3 Iter 148: loss 0.18709. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 3 Iter 148: loss 0.18709. :  66%|█████████████████████████████               | 148/224 [01:13<00:37,  2.01it/s]
Epoch 3 Iter 149: loss 0.19083. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.01it/s]
Epoch 3 Iter 149: loss 0.19083. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 3 Iter 150: loss 0.20877. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 3 Iter 150: loss 0.20877. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:36,  2.01it/s]
Epoch 3 Iter 151: loss 0.18125. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.01it/s]
Epoch 3 Iter 151: loss 0.18125. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:35,  2.03it/s]
Epoch 3 Iter 152: loss 0.18674. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:35,  2.03it/s]
Epoch 3 Iter 152: loss 0.18674. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:35,  2.03it/s]
Epoch 3 Iter 153: loss 0.21395. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.03it/s]
Epoch 3 Iter 153: loss 0.21395. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.02it/s]
Epoch 3 Iter 154: loss 0.18165. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.02it/s]
Epoch 3 Iter 154: loss 0.18165. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:34,  2.03it/s]
Epoch 3 Iter 155: loss 0.16834. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.03it/s]
Epoch 3 Iter 155: loss 0.16834. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.03it/s]
Epoch 3 Iter 156: loss 0.16310. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.03it/s]
Epoch 3 Iter 156: loss 0.16310. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:33,  2.04it/s]
Epoch 3 Iter 157: loss 0.18082. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.04it/s]
Epoch 3 Iter 157: loss 0.18082. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:32,  2.03it/s]
Epoch 3 Iter 158: loss 0.17863. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:32,  2.03it/s]
Epoch 3 Iter 158: loss 0.17863. :  71%|███████████████████████████████             | 158/224 [01:18<00:32,  2.03it/s]
Epoch 3 Iter 159: loss 0.16625. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.03it/s]
Epoch 3 Iter 159: loss 0.16625. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.03it/s]
Epoch 3 Iter 160: loss 0.18204. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.03it/s]
Epoch 3 Iter 160: loss 0.18204. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:31,  2.02it/s]
Epoch 3 Iter 161: loss 0.17894. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.02it/s]
Epoch 3 Iter 161: loss 0.17894. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.02it/s]
Epoch 3 Iter 162: loss 0.19357. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.02it/s]
Epoch 3 Iter 162: loss 0.19357. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:30,  2.00it/s]
Epoch 3 Iter 163: loss 0.18838. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.00it/s]
Epoch 3 Iter 163: loss 0.18838. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.00it/s]
Epoch 3 Iter 164: loss 0.19255. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.00it/s]
Epoch 3 Iter 164: loss 0.19255. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:30,  1.99it/s]
Epoch 3 Iter 165: loss 0.17174. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.99it/s]
Epoch 3 Iter 165: loss 0.17174. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.99it/s]
Epoch 3 Iter 166: loss 0.15637. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  1.99it/s]
Epoch 3 Iter 166: loss 0.15637. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:29,  1.96it/s]
Epoch 3 Iter 167: loss 0.19679. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:29,  1.96it/s]
Epoch 3 Iter 167: loss 0.19679. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  1.97it/s]
Epoch 3 Iter 168: loss 0.18109. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  1.97it/s]
Epoch 3 Iter 168: loss 0.18109. :  75%|█████████████████████████████████           | 168/224 [01:23<00:28,  1.97it/s]
Epoch 3 Iter 169: loss 0.18796. :  75%|█████████████████████████████████           | 168/224 [01:24<00:28,  1.97it/s]
Epoch 3 Iter 169: loss 0.18796. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.97it/s]
Epoch 3 Iter 170: loss 0.20290. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  1.97it/s]
Epoch 3 Iter 170: loss 0.20290. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:27,  1.97it/s]
Epoch 3 Iter 171: loss 0.17704. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:27,  1.97it/s]
Epoch 3 Iter 171: loss 0.17704. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.17697. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  1.99it/s]
Epoch 3 Iter 172: loss 0.17697. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.00it/s]
Epoch 3 Iter 173: loss 0.17495. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.00it/s]
Epoch 3 Iter 173: loss 0.17495. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  1.99it/s]
Epoch 3 Iter 174: loss 0.17693. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  1.99it/s]
Epoch 3 Iter 174: loss 0.17693. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:25,  1.99it/s]
Epoch 3 Iter 175: loss 0.16930. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:25,  1.99it/s]
Epoch 3 Iter 175: loss 0.16930. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  1.99it/s]
Epoch 3 Iter 176: loss 0.17210. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  1.99it/s]
Epoch 3 Iter 176: loss 0.17210. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.00it/s]
Epoch 3 Iter 177: loss 0.20658. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.00it/s]
Epoch 3 Iter 177: loss 0.20658. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 3 Iter 178: loss 0.19332. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.02it/s]
Epoch 3 Iter 178: loss 0.19332. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.02it/s]
Epoch 3 Iter 179: loss 0.18954. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.02it/s]
Epoch 3 Iter 179: loss 0.18954. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 3 Iter 180: loss 0.19439. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 3 Iter 180: loss 0.19439. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:21,  2.03it/s]
Epoch 3 Iter 181: loss 0.19505. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.03it/s]
Epoch 3 Iter 181: loss 0.19505. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 3 Iter 182: loss 0.17572. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.03it/s]
Epoch 3 Iter 182: loss 0.17572. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.04it/s]
Epoch 3 Iter 183: loss 0.16586. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.04it/s]
Epoch 3 Iter 183: loss 0.16586. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.03it/s]
Epoch 3 Iter 184: loss 0.17844. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.03it/s]
Epoch 3 Iter 184: loss 0.17844. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 3 Iter 185: loss 0.17978. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.03it/s]
Epoch 3 Iter 185: loss 0.17978. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 3 Iter 186: loss 0.18937. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 3 Iter 186: loss 0.18937. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 3 Iter 187: loss 0.21474. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.02it/s]
Epoch 3 Iter 187: loss 0.21474. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 3 Iter 188: loss 0.17628. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 3 Iter 188: loss 0.17628. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:17,  2.02it/s]
Epoch 3 Iter 189: loss 0.17270. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:17,  2.02it/s]
Epoch 3 Iter 189: loss 0.17270. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.01it/s]
Epoch 3 Iter 190: loss 0.17744. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.01it/s]
Epoch 3 Iter 190: loss 0.17744. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:16,  2.00it/s]
Epoch 3 Iter 191: loss 0.18918. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:16,  2.00it/s]
Epoch 3 Iter 191: loss 0.18918. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.00it/s]
Epoch 3 Iter 192: loss 0.19487. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.00it/s]
Epoch 3 Iter 192: loss 0.19487. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:16,  2.00it/s]
Epoch 3 Iter 193: loss 0.17915. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  2.00it/s]
Epoch 3 Iter 193: loss 0.17915. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.17465. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.00it/s]
Epoch 3 Iter 194: loss 0.17465. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:15,  1.99it/s]
Epoch 3 Iter 195: loss 0.17766. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:15,  1.99it/s]
Epoch 3 Iter 195: loss 0.17766. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  1.99it/s]
Epoch 3 Iter 196: loss 0.18091. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  1.99it/s]
Epoch 3 Iter 196: loss 0.18091. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:14,  2.00it/s]
Epoch 3 Iter 197: loss 0.18595. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:14,  2.00it/s]
Epoch 3 Iter 197: loss 0.18595. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 3 Iter 198: loss 0.18497. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.00it/s]
Epoch 3 Iter 198: loss 0.18497. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:13,  2.00it/s]
Epoch 3 Iter 199: loss 0.19494. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:13,  2.00it/s]
Epoch 3 Iter 199: loss 0.19494. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 3 Iter 200: loss 0.18403. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.00it/s]
Epoch 3 Iter 200: loss 0.18403. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:11,  2.00it/s]
Epoch 3 Iter 201: loss 0.17100. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.00it/s]
Epoch 3 Iter 201: loss 0.17100. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.02it/s]
Epoch 3 Iter 202: loss 0.18326. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.02it/s]
Epoch 3 Iter 202: loss 0.18326. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:10,  2.01it/s]
Epoch 3 Iter 203: loss 0.20296. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.01it/s]
Epoch 3 Iter 203: loss 0.20296. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.20517. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.00it/s]
Epoch 3 Iter 204: loss 0.20517. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:09,  2.01it/s]
Epoch 3 Iter 205: loss 0.17854. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.01it/s]
Epoch 3 Iter 205: loss 0.17854. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.02it/s]
Epoch 3 Iter 206: loss 0.17635. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.02it/s]
Epoch 3 Iter 206: loss 0.17635. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.02it/s]
Epoch 3 Iter 207: loss 0.18237. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.02it/s]
Epoch 3 Iter 207: loss 0.18237. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.01it/s]
Epoch 3 Iter 208: loss 0.18650. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.01it/s]
Epoch 3 Iter 208: loss 0.18650. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.01it/s]
Epoch 3 Iter 209: loss 0.18177. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:07,  2.01it/s]
Epoch 3 Iter 209: loss 0.18177. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.02it/s]
Epoch 3 Iter 210: loss 0.19769. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.02it/s]
Epoch 3 Iter 210: loss 0.19769. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.01it/s]
Epoch 3 Iter 211: loss 0.17842. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:06,  2.01it/s]
Epoch 3 Iter 211: loss 0.17842. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.01it/s]
Epoch 3 Iter 212: loss 0.17053. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.01it/s]
Epoch 3 Iter 212: loss 0.17053. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.00it/s]
Epoch 3 Iter 213: loss 0.16738. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:05,  2.00it/s]
Epoch 3 Iter 213: loss 0.16738. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.01it/s]
Epoch 3 Iter 214: loss 0.19341. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.01it/s]
Epoch 3 Iter 214: loss 0.19341. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:05,  1.97it/s]
Epoch 3 Iter 215: loss 0.18318. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.97it/s]
Epoch 3 Iter 215: loss 0.18318. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.85it/s]
Epoch 3 Iter 216: loss 0.20139. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.85it/s]
Epoch 3 Iter 216: loss 0.20139. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:04,  1.90it/s]
Epoch 3 Iter 217: loss 0.16467. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.90it/s]
Epoch 3 Iter 217: loss 0.16467. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  1.93it/s]
Epoch 3 Iter 218: loss 0.17517. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  1.93it/s]
Epoch 3 Iter 218: loss 0.17517. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:03,  1.96it/s]
Epoch 3 Iter 219: loss 0.16461. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.96it/s]
Epoch 3 Iter 219: loss 0.16461. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.98it/s]
Epoch 3 Iter 220: loss 0.16856. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.98it/s]
Epoch 3 Iter 220: loss 0.16856. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:02,  1.99it/s]
Epoch 3 Iter 221: loss 0.20051. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 3 Iter 221: loss 0.20051. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.01it/s]
Epoch 3 Iter 222: loss 0.18852. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  2.01it/s]
Epoch 3 Iter 222: loss 0.18852. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:00,  2.01it/s]
Epoch 3 Iter 223: loss 0.19297. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.01it/s]
Epoch 3 Iter 223: loss 0.19297. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 3 Iter 224: loss 0.17466. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 3 Iter 224: loss 0.17466. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]
Epoch 3 Iter 224: loss 0.17466. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

    Train loss: 0.18548
    Valid loss: 0.18874
       Valid loss recons: 0.18382
       Valid loss KL-D:   49.15737
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.18173. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 4 Iter 1: loss 0.18173. :   0%|▏                                               | 1/224 [00:00<02:04,  1.79it/s]
Epoch 4 Iter 2: loss 0.18208. :   0%|▏                                               | 1/224 [00:01<02:04,  1.79it/s]
Epoch 4 Iter 2: loss 0.18208. :   1%|▍                                               | 2/224 [00:01<01:56,  1.91it/s]
Epoch 4 Iter 3: loss 0.20428. :   1%|▍                                               | 2/224 [00:01<01:56,  1.91it/s]
Epoch 4 Iter 3: loss 0.20428. :   1%|▋                                               | 3/224 [00:01<01:53,  1.94it/s]
Epoch 4 Iter 4: loss 0.16328. :   1%|▋                                               | 3/224 [00:02<01:53,  1.94it/s]
Epoch 4 Iter 4: loss 0.16328. :   2%|▊                                               | 4/224 [00:02<01:52,  1.96it/s]
Epoch 4 Iter 5: loss 0.19716. :   2%|▊                                               | 4/224 [00:02<01:52,  1.96it/s]
Epoch 4 Iter 5: loss 0.19716. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 4 Iter 6: loss 0.19453. :   2%|█                                               | 5/224 [00:03<01:49,  2.00it/s]
Epoch 4 Iter 6: loss 0.19453. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 4 Iter 7: loss 0.16984. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 4 Iter 7: loss 0.16984. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.01it/s]
Epoch 4 Iter 8: loss 0.19386. :   3%|█▌                                              | 7/224 [00:04<01:47,  2.01it/s]
Epoch 4 Iter 8: loss 0.19386. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 4 Iter 9: loss 0.19266. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 4 Iter 9: loss 0.19266. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.01it/s]
Epoch 4 Iter 10: loss 0.20140. :   4%|█▉                                             | 9/224 [00:05<01:46,  2.01it/s]
Epoch 4 Iter 10: loss 0.20140. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 4 Iter 11: loss 0.18401. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 4 Iter 11: loss 0.18401. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 4 Iter 12: loss 0.18419. :   5%|██▎                                           | 11/224 [00:06<01:46,  2.00it/s]
Epoch 4 Iter 12: loss 0.18419. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.01it/s]
Epoch 4 Iter 13: loss 0.16515. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.01it/s]
Epoch 4 Iter 13: loss 0.16515. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.01it/s]
Epoch 4 Iter 14: loss 0.18773. :   6%|██▋                                           | 13/224 [00:07<01:44,  2.01it/s]
Epoch 4 Iter 14: loss 0.18773. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.02it/s]
Epoch 4 Iter 15: loss 0.16719. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.02it/s]
Epoch 4 Iter 15: loss 0.16719. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 4 Iter 16: loss 0.18399. :   7%|███                                           | 15/224 [00:08<01:44,  2.00it/s]
Epoch 4 Iter 16: loss 0.18399. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.01it/s]
Epoch 4 Iter 17: loss 0.18615. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.01it/s]
Epoch 4 Iter 17: loss 0.18615. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.01it/s]
Epoch 4 Iter 18: loss 0.18947. :   8%|███▍                                          | 17/224 [00:09<01:42,  2.01it/s]
Epoch 4 Iter 18: loss 0.18947. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 4 Iter 19: loss 0.19024. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 4 Iter 19: loss 0.19024. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 4 Iter 20: loss 0.16538. :   8%|███▉                                          | 19/224 [00:10<01:41,  2.02it/s]
Epoch 4 Iter 20: loss 0.16538. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 4 Iter 21: loss 0.16767. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 4 Iter 21: loss 0.16767. :   9%|████▎                                         | 21/224 [00:10<01:41,  2.00it/s]
Epoch 4 Iter 22: loss 0.19328. :   9%|████▎                                         | 21/224 [00:11<01:41,  2.00it/s]
Epoch 4 Iter 22: loss 0.19328. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.01it/s]
Epoch 4 Iter 23: loss 0.20583. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.01it/s]
Epoch 4 Iter 23: loss 0.20583. :  10%|████▋                                         | 23/224 [00:11<01:40,  2.00it/s]
Epoch 4 Iter 24: loss 0.18677. :  10%|████▋                                         | 23/224 [00:12<01:40,  2.00it/s]
Epoch 4 Iter 24: loss 0.18677. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 4 Iter 25: loss 0.17790. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 4 Iter 25: loss 0.17790. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 4 Iter 26: loss 0.18380. :  11%|█████▏                                        | 25/224 [00:13<01:39,  2.00it/s]
Epoch 4 Iter 26: loss 0.18380. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 4 Iter 27: loss 0.16390. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 4 Iter 27: loss 0.16390. :  12%|█████▌                                        | 27/224 [00:13<01:38,  1.99it/s]
Epoch 4 Iter 28: loss 0.18056. :  12%|█████▌                                        | 27/224 [00:14<01:38,  1.99it/s]
Epoch 4 Iter 28: loss 0.18056. :  12%|█████▊                                        | 28/224 [00:14<01:38,  1.99it/s]
Epoch 4 Iter 29: loss 0.19151. :  12%|█████▊                                        | 28/224 [00:14<01:38,  1.99it/s]
Epoch 4 Iter 29: loss 0.19151. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 4 Iter 30: loss 0.17527. :  13%|█████▉                                        | 29/224 [00:15<01:37,  1.99it/s]
Epoch 4 Iter 30: loss 0.17527. :  13%|██████▏                                       | 30/224 [00:15<01:37,  2.00it/s]
Epoch 4 Iter 31: loss 0.19869. :  13%|██████▏                                       | 30/224 [00:15<01:37,  2.00it/s]
Epoch 4 Iter 31: loss 0.19869. :  14%|██████▎                                       | 31/224 [00:15<01:36,  2.00it/s]
Epoch 4 Iter 32: loss 0.19236. :  14%|██████▎                                       | 31/224 [00:16<01:36,  2.00it/s]
Epoch 4 Iter 32: loss 0.19236. :  14%|██████▌                                       | 32/224 [00:16<01:39,  1.93it/s]
Epoch 4 Iter 33: loss 0.19390. :  14%|██████▌                                       | 32/224 [00:16<01:39,  1.93it/s]
Epoch 4 Iter 33: loss 0.19390. :  15%|██████▊                                       | 33/224 [00:16<01:38,  1.94it/s]
Epoch 4 Iter 34: loss 0.17955. :  15%|██████▊                                       | 33/224 [00:17<01:38,  1.94it/s]
Epoch 4 Iter 34: loss 0.17955. :  15%|██████▉                                       | 34/224 [00:17<01:37,  1.95it/s]
Epoch 4 Iter 35: loss 0.17134. :  15%|██████▉                                       | 34/224 [00:17<01:37,  1.95it/s]
Epoch 4 Iter 35: loss 0.17134. :  16%|███████▏                                      | 35/224 [00:17<01:36,  1.96it/s]
Epoch 4 Iter 36: loss 0.18934. :  16%|███████▏                                      | 35/224 [00:18<01:36,  1.96it/s]
Epoch 4 Iter 36: loss 0.18934. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.98it/s]
Epoch 4 Iter 37: loss 0.17872. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.98it/s]
Epoch 4 Iter 37: loss 0.17872. :  17%|███████▌                                      | 37/224 [00:18<01:33,  2.00it/s]
Epoch 4 Iter 38: loss 0.17952. :  17%|███████▌                                      | 37/224 [00:19<01:33,  2.00it/s]
Epoch 4 Iter 38: loss 0.17952. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 39: loss 0.17437. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 39: loss 0.17437. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 4 Iter 40: loss 0.16003. :  17%|████████                                      | 39/224 [00:20<01:32,  2.00it/s]
Epoch 4 Iter 40: loss 0.16003. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 4 Iter 41: loss 0.20003. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.99it/s]
Epoch 4 Iter 41: loss 0.20003. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 4 Iter 42: loss 0.18604. :  18%|████████▍                                     | 41/224 [00:21<01:31,  2.01it/s]
Epoch 4 Iter 42: loss 0.18604. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.00it/s]
Epoch 4 Iter 43: loss 0.18256. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.00it/s]
Epoch 4 Iter 43: loss 0.18256. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 4 Iter 44: loss 0.16918. :  19%|████████▊                                     | 43/224 [00:22<01:29,  2.02it/s]
Epoch 4 Iter 44: loss 0.16918. :  20%|█████████                                     | 44/224 [00:22<01:28,  2.03it/s]
Epoch 4 Iter 45: loss 0.15462. :  20%|█████████                                     | 44/224 [00:22<01:28,  2.03it/s]
Epoch 4 Iter 45: loss 0.15462. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 4 Iter 46: loss 0.18104. :  20%|█████████▏                                    | 45/224 [00:23<01:28,  2.02it/s]
Epoch 4 Iter 46: loss 0.18104. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 4 Iter 47: loss 0.18631. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 4 Iter 47: loss 0.18631. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.01it/s]
Epoch 4 Iter 48: loss 0.20383. :  21%|█████████▋                                    | 47/224 [00:24<01:27,  2.01it/s]
Epoch 4 Iter 48: loss 0.20383. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 4 Iter 49: loss 0.16742. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.00it/s]
Epoch 4 Iter 49: loss 0.16742. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 4 Iter 50: loss 0.18901. :  22%|██████████                                    | 49/224 [00:25<01:27,  2.00it/s]
Epoch 4 Iter 50: loss 0.18901. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.98it/s]
Epoch 4 Iter 51: loss 0.18181. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.98it/s]
Epoch 4 Iter 51: loss 0.18181. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 4 Iter 52: loss 0.18706. :  23%|██████████▍                                   | 51/224 [00:26<01:26,  2.00it/s]
Epoch 4 Iter 52: loss 0.18706. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  2.00it/s]
Epoch 4 Iter 53: loss 0.18871. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  2.00it/s]
Epoch 4 Iter 53: loss 0.18871. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.00it/s]
Epoch 4 Iter 54: loss 0.17505. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  2.00it/s]
Epoch 4 Iter 54: loss 0.17505. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.00it/s]
Epoch 4 Iter 55: loss 0.18709. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.00it/s]
Epoch 4 Iter 55: loss 0.18709. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.01it/s]
Epoch 4 Iter 56: loss 0.17424. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  2.01it/s]
Epoch 4 Iter 56: loss 0.17424. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.00it/s]
Epoch 4 Iter 57: loss 0.18872. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.00it/s]
Epoch 4 Iter 57: loss 0.18872. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  1.99it/s]
Epoch 4 Iter 58: loss 0.19873. :  25%|███████████▋                                  | 57/224 [00:29<01:23,  1.99it/s]
Epoch 4 Iter 58: loss 0.19873. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 4 Iter 59: loss 0.16948. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 4 Iter 59: loss 0.16948. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 4 Iter 60: loss 0.18463. :  26%|████████████                                  | 59/224 [00:30<01:22,  2.01it/s]
Epoch 4 Iter 60: loss 0.18463. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 4 Iter 61: loss 0.18755. :  27%|████████████▎                                 | 60/224 [00:30<01:22,  1.99it/s]
Epoch 4 Iter 61: loss 0.18755. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 4 Iter 62: loss 0.18788. :  27%|████████████▌                                 | 61/224 [00:31<01:21,  2.00it/s]
Epoch 4 Iter 62: loss 0.18788. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 4 Iter 63: loss 0.17419. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 4 Iter 63: loss 0.17419. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.98it/s]
Epoch 4 Iter 64: loss 0.17910. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.98it/s]
Epoch 4 Iter 64: loss 0.17910. :  29%|█████████████▏                                | 64/224 [00:32<01:23,  1.91it/s]
Epoch 4 Iter 65: loss 0.18373. :  29%|█████████████▏                                | 64/224 [00:32<01:23,  1.91it/s]
Epoch 4 Iter 65: loss 0.18373. :  29%|█████████████▎                                | 65/224 [00:32<01:22,  1.93it/s]
Epoch 4 Iter 66: loss 0.18697. :  29%|█████████████▎                                | 65/224 [00:33<01:22,  1.93it/s]
Epoch 4 Iter 66: loss 0.18697. :  29%|█████████████▌                                | 66/224 [00:33<01:21,  1.95it/s]
Epoch 4 Iter 67: loss 0.17583. :  29%|█████████████▌                                | 66/224 [00:33<01:21,  1.95it/s]
Epoch 4 Iter 67: loss 0.17583. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.96it/s]
Epoch 4 Iter 68: loss 0.18936. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.96it/s]
Epoch 4 Iter 68: loss 0.18936. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.98it/s]
Epoch 4 Iter 69: loss 0.17506. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.98it/s]
Epoch 4 Iter 69: loss 0.17506. :  31%|██████████████▏                               | 69/224 [00:34<01:18,  1.97it/s]
Epoch 4 Iter 70: loss 0.18652. :  31%|██████████████▏                               | 69/224 [00:35<01:18,  1.97it/s]
Epoch 4 Iter 70: loss 0.18652. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 4 Iter 71: loss 0.17846. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.98it/s]
Epoch 4 Iter 71: loss 0.17846. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.97it/s]
Epoch 4 Iter 72: loss 0.18246. :  32%|██████████████▌                               | 71/224 [00:36<01:17,  1.97it/s]
Epoch 4 Iter 72: loss 0.18246. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  1.98it/s]
Epoch 4 Iter 73: loss 0.17166. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  1.98it/s]
Epoch 4 Iter 73: loss 0.17166. :  33%|██████████████▉                               | 73/224 [00:36<01:16,  1.98it/s]
Epoch 4 Iter 74: loss 0.19647. :  33%|██████████████▉                               | 73/224 [00:37<01:16,  1.98it/s]
Epoch 4 Iter 74: loss 0.19647. :  33%|███████████████▏                              | 74/224 [00:37<01:15,  1.99it/s]
Epoch 4 Iter 75: loss 0.17861. :  33%|███████████████▏                              | 74/224 [00:37<01:15,  1.99it/s]
Epoch 4 Iter 75: loss 0.17861. :  33%|███████████████▍                              | 75/224 [00:37<01:14,  1.99it/s]
Epoch 4 Iter 76: loss 0.19234. :  33%|███████████████▍                              | 75/224 [00:38<01:14,  1.99it/s]
Epoch 4 Iter 76: loss 0.19234. :  34%|███████████████▌                              | 76/224 [00:38<01:14,  1.98it/s]
Epoch 4 Iter 77: loss 0.17596. :  34%|███████████████▌                              | 76/224 [00:38<01:14,  1.98it/s]
Epoch 4 Iter 77: loss 0.17596. :  34%|███████████████▊                              | 77/224 [00:38<01:13,  1.99it/s]
Epoch 4 Iter 78: loss 0.17751. :  34%|███████████████▊                              | 77/224 [00:39<01:13,  1.99it/s]
Epoch 4 Iter 78: loss 0.17751. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.99it/s]
Epoch 4 Iter 79: loss 0.18930. :  35%|████████████████                              | 78/224 [00:39<01:13,  1.99it/s]
Epoch 4 Iter 79: loss 0.18930. :  35%|████████████████▏                             | 79/224 [00:39<01:12,  1.99it/s]
Epoch 4 Iter 80: loss 0.17746. :  35%|████████████████▏                             | 79/224 [00:40<01:12,  1.99it/s]
Epoch 4 Iter 80: loss 0.17746. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.00it/s]
Epoch 4 Iter 81: loss 0.16908. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.00it/s]
Epoch 4 Iter 81: loss 0.16908. :  36%|████████████████▋                             | 81/224 [00:40<01:11,  2.01it/s]
Epoch 4 Iter 82: loss 0.17792. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  2.01it/s]
Epoch 4 Iter 82: loss 0.17792. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.01it/s]
Epoch 4 Iter 83: loss 0.18578. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.01it/s]
Epoch 4 Iter 83: loss 0.18578. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.01it/s]
Epoch 4 Iter 84: loss 0.18483. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.01it/s]
Epoch 4 Iter 84: loss 0.18483. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  2.00it/s]
Epoch 4 Iter 85: loss 0.18300. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  2.00it/s]
Epoch 4 Iter 85: loss 0.18300. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 4 Iter 86: loss 0.19655. :  38%|█████████████████▍                            | 85/224 [00:43<01:08,  2.02it/s]
Epoch 4 Iter 86: loss 0.19655. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.01it/s]
Epoch 4 Iter 87: loss 0.18854. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.01it/s]
Epoch 4 Iter 87: loss 0.18854. :  39%|█████████████████▊                            | 87/224 [00:43<01:08,  2.00it/s]
Epoch 4 Iter 88: loss 0.18957. :  39%|█████████████████▊                            | 87/224 [00:44<01:08,  2.00it/s]
Epoch 4 Iter 88: loss 0.18957. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.00it/s]
Epoch 4 Iter 89: loss 0.17963. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.00it/s]
Epoch 4 Iter 89: loss 0.17963. :  40%|██████████████████▎                           | 89/224 [00:44<01:07,  2.01it/s]
Epoch 4 Iter 90: loss 0.17752. :  40%|██████████████████▎                           | 89/224 [00:45<01:07,  2.01it/s]
Epoch 4 Iter 90: loss 0.17752. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 4 Iter 91: loss 0.18965. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 4 Iter 91: loss 0.18965. :  41%|██████████████████▋                           | 91/224 [00:45<01:05,  2.02it/s]
Epoch 4 Iter 92: loss 0.19806. :  41%|██████████████████▋                           | 91/224 [00:46<01:05,  2.02it/s]
Epoch 4 Iter 92: loss 0.19806. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.02it/s]
Epoch 4 Iter 93: loss 0.18372. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.02it/s]
Epoch 4 Iter 93: loss 0.18372. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.01it/s]
Epoch 4 Iter 94: loss 0.20031. :  42%|███████████████████                           | 93/224 [00:47<01:05,  2.01it/s]
Epoch 4 Iter 94: loss 0.20031. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.01it/s]
Epoch 4 Iter 95: loss 0.18767. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.01it/s]
Epoch 4 Iter 95: loss 0.18767. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.01it/s]
Epoch 4 Iter 96: loss 0.21469. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  2.01it/s]
Epoch 4 Iter 96: loss 0.21469. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  2.00it/s]
Epoch 4 Iter 97: loss 0.17668. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  2.00it/s]
Epoch 4 Iter 97: loss 0.17668. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 4 Iter 98: loss 0.18913. :  43%|███████████████████▉                          | 97/224 [00:49<01:03,  2.00it/s]
Epoch 4 Iter 98: loss 0.18913. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  2.00it/s]
Epoch 4 Iter 99: loss 0.17785. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  2.00it/s]
Epoch 4 Iter 99: loss 0.17785. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.00it/s]
Epoch 4 Iter 100: loss 0.17762. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  2.00it/s]
Epoch 4 Iter 100: loss 0.17762. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.01it/s]
Epoch 4 Iter 101: loss 0.21070. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.01it/s]
Epoch 4 Iter 101: loss 0.21070. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.01it/s]
Epoch 4 Iter 102: loss 0.21029. :  45%|███████████████████▊                        | 101/224 [00:51<01:01,  2.01it/s]
Epoch 4 Iter 102: loss 0.21029. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.00it/s]
Epoch 4 Iter 103: loss 0.15731. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.00it/s]
Epoch 4 Iter 103: loss 0.15731. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.02it/s]
Epoch 4 Iter 104: loss 0.18591. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  2.02it/s]
Epoch 4 Iter 104: loss 0.18591. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 4 Iter 105: loss 0.19243. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 4 Iter 105: loss 0.19243. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.00it/s]
Epoch 4 Iter 106: loss 0.19175. :  47%|████████████████████▋                       | 105/224 [00:53<00:59,  2.00it/s]
Epoch 4 Iter 106: loss 0.19175. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.02it/s]
Epoch 4 Iter 107: loss 0.20165. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.02it/s]
Epoch 4 Iter 107: loss 0.20165. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.02it/s]
Epoch 4 Iter 108: loss 0.18168. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  2.02it/s]
Epoch 4 Iter 108: loss 0.18168. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 4 Iter 109: loss 0.20220. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 4 Iter 109: loss 0.20220. :  49%|█████████████████████▍                      | 109/224 [00:54<00:57,  2.00it/s]
Epoch 4 Iter 110: loss 0.16817. :  49%|█████████████████████▍                      | 109/224 [00:55<00:57,  2.00it/s]
Epoch 4 Iter 110: loss 0.16817. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.99it/s]
Epoch 4 Iter 111: loss 0.18482. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.99it/s]
Epoch 4 Iter 111: loss 0.18482. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  1.99it/s]
Epoch 4 Iter 112: loss 0.19227. :  50%|█████████████████████▊                      | 111/224 [00:56<00:56,  1.99it/s]
Epoch 4 Iter 112: loss 0.19227. :  50%|██████████████████████                      | 112/224 [00:56<00:57,  1.96it/s]
Epoch 4 Iter 113: loss 0.17681. :  50%|██████████████████████                      | 112/224 [00:56<00:57,  1.96it/s]
Epoch 4 Iter 113: loss 0.17681. :  50%|██████████████████████▏                     | 113/224 [00:56<00:56,  1.97it/s]
Epoch 4 Iter 114: loss 0.17076. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.97it/s]
Epoch 4 Iter 114: loss 0.17076. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.98it/s]
Epoch 4 Iter 115: loss 0.16808. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.98it/s]
Epoch 4 Iter 115: loss 0.16808. :  51%|██████████████████████▌                     | 115/224 [00:57<00:55,  1.98it/s]
Epoch 4 Iter 116: loss 0.17970. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.98it/s]
Epoch 4 Iter 116: loss 0.17970. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.99it/s]
Epoch 4 Iter 117: loss 0.19702. :  52%|██████████████████████▊                     | 116/224 [00:58<00:54,  1.99it/s]
Epoch 4 Iter 117: loss 0.19702. :  52%|██████████████████████▉                     | 117/224 [00:58<00:53,  2.00it/s]
Epoch 4 Iter 118: loss 0.19234. :  52%|██████████████████████▉                     | 117/224 [00:59<00:53,  2.00it/s]
Epoch 4 Iter 118: loss 0.19234. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.98it/s]
Epoch 4 Iter 119: loss 0.15554. :  53%|███████████████████████▏                    | 118/224 [00:59<00:53,  1.98it/s]
Epoch 4 Iter 119: loss 0.15554. :  53%|███████████████████████▍                    | 119/224 [00:59<00:52,  1.99it/s]
Epoch 4 Iter 120: loss 0.17543. :  53%|███████████████████████▍                    | 119/224 [01:00<00:52,  1.99it/s]
Epoch 4 Iter 120: loss 0.17543. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.00it/s]
Epoch 4 Iter 121: loss 0.17912. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.00it/s]
Epoch 4 Iter 121: loss 0.17912. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 4 Iter 122: loss 0.18488. :  54%|███████████████████████▊                    | 121/224 [01:01<00:51,  2.01it/s]
Epoch 4 Iter 122: loss 0.18488. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.00it/s]
Epoch 4 Iter 123: loss 0.17728. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.00it/s]
Epoch 4 Iter 123: loss 0.17728. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 4 Iter 124: loss 0.19883. :  55%|████████████████████████▏                   | 123/224 [01:02<00:50,  2.01it/s]
Epoch 4 Iter 124: loss 0.19883. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 4 Iter 125: loss 0.18222. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 4 Iter 125: loss 0.18222. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.00it/s]
Epoch 4 Iter 126: loss 0.18700. :  56%|████████████████████████▌                   | 125/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 126: loss 0.18700. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 127: loss 0.16984. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  2.00it/s]
Epoch 4 Iter 127: loss 0.16984. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.00it/s]
Epoch 4 Iter 128: loss 0.16705. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  2.00it/s]
Epoch 4 Iter 128: loss 0.16705. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 4 Iter 129: loss 0.19183. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 4 Iter 129: loss 0.19183. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 4 Iter 130: loss 0.20658. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  2.02it/s]
Epoch 4 Iter 130: loss 0.20658. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 131: loss 0.20221. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 131: loss 0.20221. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 4 Iter 132: loss 0.18768. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.01it/s]
Epoch 4 Iter 132: loss 0.18768. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:47,  1.95it/s]
Epoch 4 Iter 133: loss 0.16916. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:47,  1.95it/s]
Epoch 4 Iter 133: loss 0.16916. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:46,  1.96it/s]
Epoch 4 Iter 134: loss 0.19279. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.96it/s]
Epoch 4 Iter 134: loss 0.19279. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.99it/s]
Epoch 4 Iter 135: loss 0.19303. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.99it/s]
Epoch 4 Iter 135: loss 0.19303. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  1.99it/s]
Epoch 4 Iter 136: loss 0.18681. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.99it/s]
Epoch 4 Iter 136: loss 0.18681. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.99it/s]
Epoch 4 Iter 137: loss 0.17377. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  1.99it/s]
Epoch 4 Iter 137: loss 0.17377. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.00it/s]
Epoch 4 Iter 138: loss 0.19865. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  2.00it/s]
Epoch 4 Iter 138: loss 0.19865. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.01it/s]
Epoch 4 Iter 139: loss 0.16436. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.01it/s]
Epoch 4 Iter 139: loss 0.16436. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.00it/s]
Epoch 4 Iter 140: loss 0.17917. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  2.00it/s]
Epoch 4 Iter 140: loss 0.17917. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 4 Iter 141: loss 0.17916. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.01it/s]
Epoch 4 Iter 141: loss 0.17916. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.02it/s]
Epoch 4 Iter 142: loss 0.16837. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.02it/s]
Epoch 4 Iter 142: loss 0.16837. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 4 Iter 143: loss 0.17166. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 4 Iter 143: loss 0.17166. :  64%|████████████████████████████                | 143/224 [01:11<00:39,  2.03it/s]
Epoch 4 Iter 144: loss 0.19254. :  64%|████████████████████████████                | 143/224 [01:12<00:39,  2.03it/s]
Epoch 4 Iter 144: loss 0.19254. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.02it/s]
Epoch 4 Iter 145: loss 0.17821. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.02it/s]
Epoch 4 Iter 145: loss 0.17821. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.02it/s]
Epoch 4 Iter 146: loss 0.17963. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.02it/s]
Epoch 4 Iter 146: loss 0.17963. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 4 Iter 147: loss 0.18750. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.01it/s]
Epoch 4 Iter 147: loss 0.18750. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  1.98it/s]
Epoch 4 Iter 148: loss 0.17634. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  1.98it/s]
Epoch 4 Iter 148: loss 0.17634. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.98it/s]
Epoch 4 Iter 149: loss 0.19607. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.98it/s]
Epoch 4 Iter 149: loss 0.19607. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:41,  1.82it/s]
Epoch 4 Iter 150: loss 0.17952. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:41,  1.82it/s]
Epoch 4 Iter 150: loss 0.17952. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:41,  1.80it/s]
Epoch 4 Iter 151: loss 0.19682. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:41,  1.80it/s]
Epoch 4 Iter 151: loss 0.19682. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:39,  1.84it/s]
Epoch 4 Iter 152: loss 0.17936. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:39,  1.84it/s]
Epoch 4 Iter 152: loss 0.17936. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:39,  1.84it/s]
Epoch 4 Iter 153: loss 0.18444. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:39,  1.84it/s]
Epoch 4 Iter 153: loss 0.18444. :  68%|██████████████████████████████              | 153/224 [01:16<00:37,  1.87it/s]
Epoch 4 Iter 154: loss 0.18673. :  68%|██████████████████████████████              | 153/224 [01:17<00:37,  1.87it/s]
Epoch 4 Iter 154: loss 0.18673. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:36,  1.91it/s]
Epoch 4 Iter 155: loss 0.18565. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:36,  1.91it/s]
Epoch 4 Iter 155: loss 0.18565. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:36,  1.91it/s]
Epoch 4 Iter 156: loss 0.19344. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:36,  1.91it/s]
Epoch 4 Iter 156: loss 0.19344. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:35,  1.94it/s]
Epoch 4 Iter 157: loss 0.20053. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:35,  1.94it/s]
Epoch 4 Iter 157: loss 0.20053. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:34,  1.96it/s]
Epoch 4 Iter 158: loss 0.17514. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:34,  1.96it/s]
Epoch 4 Iter 158: loss 0.17514. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  1.98it/s]
Epoch 4 Iter 159: loss 0.16382. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  1.98it/s]
Epoch 4 Iter 159: loss 0.16382. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  1.99it/s]
Epoch 4 Iter 160: loss 0.18798. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  1.99it/s]
Epoch 4 Iter 160: loss 0.18798. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  2.00it/s]
Epoch 4 Iter 161: loss 0.18073. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  2.00it/s]
Epoch 4 Iter 161: loss 0.18073. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.00it/s]
Epoch 4 Iter 162: loss 0.19479. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.00it/s]
Epoch 4 Iter 162: loss 0.19479. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 4 Iter 163: loss 0.18447. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 4 Iter 163: loss 0.18447. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.01it/s]
Epoch 4 Iter 164: loss 0.17803. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.01it/s]
Epoch 4 Iter 164: loss 0.17803. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.01it/s]
Epoch 4 Iter 165: loss 0.20611. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:29,  2.01it/s]
Epoch 4 Iter 165: loss 0.20611. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.92it/s]
Epoch 4 Iter 166: loss 0.18272. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.92it/s]
Epoch 4 Iter 166: loss 0.18272. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:30,  1.90it/s]
Epoch 4 Iter 167: loss 0.18801. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:30,  1.90it/s]
Epoch 4 Iter 167: loss 0.18801. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.95it/s]
Epoch 4 Iter 168: loss 0.20516. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.95it/s]
Epoch 4 Iter 168: loss 0.20516. :  75%|█████████████████████████████████           | 168/224 [01:24<00:28,  1.96it/s]
Epoch 4 Iter 169: loss 0.16536. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.96it/s]
Epoch 4 Iter 169: loss 0.16536. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  1.97it/s]
Epoch 4 Iter 170: loss 0.18616. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  1.97it/s]
Epoch 4 Iter 170: loss 0.18616. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:27,  1.98it/s]
Epoch 4 Iter 171: loss 0.15789. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.98it/s]
Epoch 4 Iter 171: loss 0.15789. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.98it/s]
Epoch 4 Iter 172: loss 0.18539. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  1.98it/s]
Epoch 4 Iter 172: loss 0.18539. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:26,  1.97it/s]
Epoch 4 Iter 173: loss 0.18070. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.97it/s]
Epoch 4 Iter 173: loss 0.18070. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  1.99it/s]
Epoch 4 Iter 174: loss 0.19856. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:25,  1.99it/s]
Epoch 4 Iter 174: loss 0.19856. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:25,  1.99it/s]
Epoch 4 Iter 175: loss 0.16811. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.99it/s]
Epoch 4 Iter 175: loss 0.16811. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  1.99it/s]
Epoch 4 Iter 176: loss 0.16156. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  1.99it/s]
Epoch 4 Iter 176: loss 0.16156. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:24,  1.99it/s]
Epoch 4 Iter 177: loss 0.20066. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.99it/s]
Epoch 4 Iter 177: loss 0.20066. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  1.98it/s]
Epoch 4 Iter 178: loss 0.20471. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:23,  1.98it/s]
Epoch 4 Iter 178: loss 0.20471. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:23,  2.00it/s]
Epoch 4 Iter 179: loss 0.19381. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  2.00it/s]
Epoch 4 Iter 179: loss 0.19381. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.00it/s]
Epoch 4 Iter 180: loss 0.18304. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  2.00it/s]
Epoch 4 Iter 180: loss 0.18304. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.01it/s]
Epoch 4 Iter 181: loss 0.19438. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:21,  2.01it/s]
Epoch 4 Iter 181: loss 0.19438. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.00it/s]
Epoch 4 Iter 182: loss 0.16936. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  2.00it/s]
Epoch 4 Iter 182: loss 0.16936. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.02it/s]
Epoch 4 Iter 183: loss 0.19631. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:20,  2.02it/s]
Epoch 4 Iter 183: loss 0.19631. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.00it/s]
Epoch 4 Iter 184: loss 0.17893. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  2.00it/s]
Epoch 4 Iter 184: loss 0.17893. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.00it/s]
Epoch 4 Iter 185: loss 0.17806. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:19,  2.00it/s]
Epoch 4 Iter 185: loss 0.17806. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.97it/s]
Epoch 4 Iter 186: loss 0.17799. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.97it/s]
Epoch 4 Iter 186: loss 0.17799. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:19,  1.94it/s]
Epoch 4 Iter 187: loss 0.16700. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.94it/s]
Epoch 4 Iter 187: loss 0.16700. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:19,  1.94it/s]
Epoch 4 Iter 188: loss 0.18313. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:19,  1.94it/s]
Epoch 4 Iter 188: loss 0.18313. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.94it/s]
Epoch 4 Iter 189: loss 0.19563. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.94it/s]
Epoch 4 Iter 189: loss 0.19563. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.96it/s]
Epoch 4 Iter 190: loss 0.17765. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.96it/s]
Epoch 4 Iter 190: loss 0.17765. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  1.97it/s]
Epoch 4 Iter 191: loss 0.16412. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.97it/s]
Epoch 4 Iter 191: loss 0.16412. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  1.98it/s]
Epoch 4 Iter 192: loss 0.19514. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  1.98it/s]
Epoch 4 Iter 192: loss 0.19514. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:15,  2.00it/s]
Epoch 4 Iter 193: loss 0.17283. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:15,  2.00it/s]
Epoch 4 Iter 193: loss 0.17283. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.00it/s]
Epoch 4 Iter 194: loss 0.18924. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  2.00it/s]
Epoch 4 Iter 194: loss 0.18924. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.01it/s]
Epoch 4 Iter 195: loss 0.17313. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:14,  2.01it/s]
Epoch 4 Iter 195: loss 0.17313. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.02it/s]
Epoch 4 Iter 196: loss 0.17586. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  2.02it/s]
Epoch 4 Iter 196: loss 0.17586. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.02it/s]
Epoch 4 Iter 197: loss 0.17913. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:13,  2.02it/s]
Epoch 4 Iter 197: loss 0.17913. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.01it/s]
Epoch 4 Iter 198: loss 0.16602. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  2.01it/s]
Epoch 4 Iter 198: loss 0.16602. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.02it/s]
Epoch 4 Iter 199: loss 0.19556. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:12,  2.02it/s]
Epoch 4 Iter 199: loss 0.19556. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.01it/s]
Epoch 4 Iter 200: loss 0.19925. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.01it/s]
Epoch 4 Iter 200: loss 0.19925. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.02it/s]
Epoch 4 Iter 201: loss 0.17356. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.02it/s]
Epoch 4 Iter 201: loss 0.17356. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  2.01it/s]
Epoch 4 Iter 202: loss 0.18123. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  2.01it/s]
Epoch 4 Iter 202: loss 0.18123. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.01it/s]
Epoch 4 Iter 203: loss 0.17531. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:10,  2.01it/s]
Epoch 4 Iter 203: loss 0.17531. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.01it/s]
Epoch 4 Iter 204: loss 0.17105. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  2.01it/s]
Epoch 4 Iter 204: loss 0.17105. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.01it/s]
Epoch 4 Iter 205: loss 0.18926. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:09,  2.01it/s]
Epoch 4 Iter 205: loss 0.18926. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.01it/s]
Epoch 4 Iter 206: loss 0.18064. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  2.01it/s]
Epoch 4 Iter 206: loss 0.18064. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:08,  2.02it/s]
Epoch 4 Iter 207: loss 0.15342. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:08,  2.02it/s]
Epoch 4 Iter 207: loss 0.15342. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  1.99it/s]
Epoch 4 Iter 208: loss 0.18358. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  1.99it/s]
Epoch 4 Iter 208: loss 0.18358. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.99it/s]
Epoch 4 Iter 209: loss 0.20777. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:08,  1.99it/s]
Epoch 4 Iter 209: loss 0.20777. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  1.99it/s]
Epoch 4 Iter 210: loss 0.17359. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  1.99it/s]
Epoch 4 Iter 210: loss 0.17359. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:07,  1.99it/s]
Epoch 4 Iter 211: loss 0.18774. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:07,  1.99it/s]
Epoch 4 Iter 211: loss 0.18774. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  1.91it/s]
Epoch 4 Iter 212: loss 0.17131. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  1.91it/s]
Epoch 4 Iter 212: loss 0.17131. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:06,  1.91it/s]
Epoch 4 Iter 213: loss 0.20524. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.91it/s]
Epoch 4 Iter 213: loss 0.20524. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  1.95it/s]
Epoch 4 Iter 214: loss 0.17676. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  1.95it/s]
Epoch 4 Iter 214: loss 0.17676. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.96it/s]
Epoch 4 Iter 215: loss 0.18425. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:05,  1.96it/s]
Epoch 4 Iter 215: loss 0.18425. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  1.98it/s]
Epoch 4 Iter 216: loss 0.18056. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  1.98it/s]
Epoch 4 Iter 216: loss 0.18056. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.99it/s]
Epoch 4 Iter 217: loss 0.16944. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.99it/s]
Epoch 4 Iter 217: loss 0.16944. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.00it/s]
Epoch 4 Iter 218: loss 0.18787. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.00it/s]
Epoch 4 Iter 218: loss 0.18787. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:03,  1.99it/s]
Epoch 4 Iter 219: loss 0.18033. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.99it/s]
Epoch 4 Iter 219: loss 0.18033. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.00it/s]
Epoch 4 Iter 220: loss 0.17569. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.00it/s]
Epoch 4 Iter 220: loss 0.17569. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  2.00it/s]
Epoch 4 Iter 221: loss 0.18107. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  2.00it/s]
Epoch 4 Iter 221: loss 0.18107. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.02it/s]
Epoch 4 Iter 222: loss 0.18533. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.02it/s]
Epoch 4 Iter 222: loss 0.18533. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:00,  2.02it/s]
Epoch 4 Iter 223: loss 0.18335. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.02it/s]
Epoch 4 Iter 223: loss 0.18335. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.01it/s]
Epoch 4 Iter 224: loss 0.17787. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.01it/s]
Epoch 4 Iter 224: loss 0.17787. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  2.00it/s]
Epoch 4 Iter 224: loss 0.17787. : 100%|████████████████████████████████████████████| 224/224 [01:52<00:00,  1.99it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.16988. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 5 Iter 1: loss 0.16988. :   0%|▏                                               | 1/224 [00:00<01:50,  2.02it/s]
Epoch 5 Iter 2: loss 0.19376. :   0%|▏                                               | 1/224 [00:00<01:50,  2.02it/s]
Epoch 5 Iter 2: loss 0.19376. :   1%|▍                                               | 2/224 [00:00<01:51,  2.00it/s]
Epoch 5 Iter 3: loss 0.19901. :   1%|▍                                               | 2/224 [00:01<01:51,  2.00it/s]
Epoch 5 Iter 3: loss 0.19901. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 5 Iter 4: loss 0.17695. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 5 Iter 4: loss 0.17695. :   2%|▊                                               | 4/224 [00:01<01:50,  2.00it/s]
Epoch 5 Iter 5: loss 0.17209. :   2%|▊                                               | 4/224 [00:02<01:50,  2.00it/s]
Epoch 5 Iter 5: loss 0.17209. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 5 Iter 6: loss 0.18382. :   2%|█                                               | 5/224 [00:02<01:49,  2.00it/s]
Epoch 5 Iter 6: loss 0.18382. :   3%|█▎                                              | 6/224 [00:02<01:48,  2.01it/s]
Epoch 5 Iter 7: loss 0.17249. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 5 Iter 7: loss 0.17249. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 5 Iter 8: loss 0.17986. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 5 Iter 8: loss 0.17986. :   4%|█▋                                              | 8/224 [00:03<01:46,  2.02it/s]
Epoch 5 Iter 9: loss 0.19200. :   4%|█▋                                              | 8/224 [00:04<01:46,  2.02it/s]
Epoch 5 Iter 9: loss 0.19200. :   4%|█▉                                              | 9/224 [00:04<01:46,  2.02it/s]
Epoch 5 Iter 10: loss 0.19529. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 5 Iter 10: loss 0.19529. :   4%|██                                            | 10/224 [00:04<01:47,  2.00it/s]
Epoch 5 Iter 11: loss 0.16828. :   4%|██                                            | 10/224 [00:05<01:47,  2.00it/s]
Epoch 5 Iter 11: loss 0.16828. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.01it/s]
Epoch 5 Iter 12: loss 0.16839. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.01it/s]
Epoch 5 Iter 12: loss 0.16839. :   5%|██▍                                           | 12/224 [00:05<01:45,  2.01it/s]
Epoch 5 Iter 13: loss 0.18752. :   5%|██▍                                           | 12/224 [00:06<01:45,  2.01it/s]
Epoch 5 Iter 13: loss 0.18752. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.02it/s]
Epoch 5 Iter 14: loss 0.16231. :   6%|██▋                                           | 13/224 [00:06<01:44,  2.02it/s]
Epoch 5 Iter 14: loss 0.16231. :   6%|██▉                                           | 14/224 [00:06<01:44,  2.02it/s]
Epoch 5 Iter 15: loss 0.18071. :   6%|██▉                                           | 14/224 [00:07<01:44,  2.02it/s]
Epoch 5 Iter 15: loss 0.18071. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 5 Iter 16: loss 0.19292. :   7%|███                                           | 15/224 [00:07<01:43,  2.03it/s]
Epoch 5 Iter 16: loss 0.19292. :   7%|███▎                                          | 16/224 [00:07<01:42,  2.02it/s]
Epoch 5 Iter 17: loss 0.18759. :   7%|███▎                                          | 16/224 [00:08<01:42,  2.02it/s]
Epoch 5 Iter 17: loss 0.18759. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 5 Iter 18: loss 0.17553. :   8%|███▍                                          | 17/224 [00:08<01:42,  2.02it/s]
Epoch 5 Iter 18: loss 0.17553. :   8%|███▋                                          | 18/224 [00:08<01:41,  2.03it/s]
Epoch 5 Iter 19: loss 0.18169. :   8%|███▋                                          | 18/224 [00:09<01:41,  2.03it/s]
Epoch 5 Iter 19: loss 0.18169. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 5 Iter 20: loss 0.17629. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 5 Iter 20: loss 0.17629. :   9%|████                                          | 20/224 [00:09<01:41,  2.02it/s]
Epoch 5 Iter 21: loss 0.18967. :   9%|████                                          | 20/224 [00:10<01:41,  2.02it/s]
Epoch 5 Iter 21: loss 0.18967. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 22: loss 0.19094. :   9%|████▎                                         | 21/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 22: loss 0.19094. :  10%|████▌                                         | 22/224 [00:10<01:40,  2.02it/s]
Epoch 5 Iter 23: loss 0.19582. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.02it/s]
Epoch 5 Iter 23: loss 0.19582. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 24: loss 0.18834. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.03it/s]
Epoch 5 Iter 24: loss 0.18834. :  11%|████▉                                         | 24/224 [00:11<01:39,  2.02it/s]
Epoch 5 Iter 25: loss 0.18753. :  11%|████▉                                         | 24/224 [00:12<01:39,  2.02it/s]
Epoch 5 Iter 25: loss 0.18753. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 5 Iter 26: loss 0.17564. :  11%|█████▏                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 5 Iter 26: loss 0.17564. :  12%|█████▎                                        | 26/224 [00:12<01:38,  2.02it/s]
Epoch 5 Iter 27: loss 0.17209. :  12%|█████▎                                        | 26/224 [00:13<01:38,  2.02it/s]
Epoch 5 Iter 27: loss 0.17209. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 5 Iter 28: loss 0.18901. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 5 Iter 28: loss 0.18901. :  12%|█████▊                                        | 28/224 [00:13<01:36,  2.03it/s]
Epoch 5 Iter 29: loss 0.17996. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.03it/s]
Epoch 5 Iter 29: loss 0.17996. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 5 Iter 30: loss 0.18442. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.02it/s]
Epoch 5 Iter 30: loss 0.18442. :  13%|██████▏                                       | 30/224 [00:14<01:35,  2.03it/s]
Epoch 5 Iter 31: loss 0.18035. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 5 Iter 31: loss 0.18035. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 5 Iter 32: loss 0.17869. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.02it/s]
Epoch 5 Iter 32: loss 0.17869. :  14%|██████▌                                       | 32/224 [00:15<01:34,  2.02it/s]
Epoch 5 Iter 33: loss 0.19457. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.02it/s]
Epoch 5 Iter 33: loss 0.19457. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 5 Iter 34: loss 0.17592. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.03it/s]
Epoch 5 Iter 34: loss 0.17592. :  15%|██████▉                                       | 34/224 [00:16<01:35,  1.99it/s]
Epoch 5 Iter 35: loss 0.18392. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 5 Iter 35: loss 0.18392. :  16%|███████▏                                      | 35/224 [00:17<01:34,  1.99it/s]
Epoch 5 Iter 36: loss 0.19258. :  16%|███████▏                                      | 35/224 [00:17<01:34,  1.99it/s]
Epoch 5 Iter 36: loss 0.19258. :  16%|███████▍                                      | 36/224 [00:17<01:33,  2.00it/s]
Epoch 5 Iter 37: loss 0.17042. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.00it/s]
Epoch 5 Iter 37: loss 0.17042. :  17%|███████▌                                      | 37/224 [00:18<01:33,  2.00it/s]
Epoch 5 Iter 38: loss 0.17730. :  17%|███████▌                                      | 37/224 [00:18<01:33,  2.00it/s]
Epoch 5 Iter 38: loss 0.17730. :  17%|███████▊                                      | 38/224 [00:18<01:33,  2.00it/s]
Epoch 5 Iter 39: loss 0.19133. :  17%|███████▊                                      | 38/224 [00:19<01:33,  2.00it/s]
Epoch 5 Iter 39: loss 0.19133. :  17%|████████                                      | 39/224 [00:19<01:33,  1.99it/s]
Epoch 5 Iter 40: loss 0.17211. :  17%|████████                                      | 39/224 [00:19<01:33,  1.99it/s]
Epoch 5 Iter 40: loss 0.17211. :  18%|████████▏                                     | 40/224 [00:19<01:32,  1.98it/s]
Epoch 5 Iter 41: loss 0.19254. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.98it/s]
Epoch 5 Iter 41: loss 0.19254. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 5 Iter 42: loss 0.17530. :  18%|████████▍                                     | 41/224 [00:20<01:31,  1.99it/s]
Epoch 5 Iter 42: loss 0.17530. :  19%|████████▋                                     | 42/224 [00:20<01:31,  1.99it/s]
Epoch 5 Iter 43: loss 0.17586. :  19%|████████▋                                     | 42/224 [00:21<01:31,  1.99it/s]
Epoch 5 Iter 43: loss 0.17586. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.00it/s]
Epoch 5 Iter 44: loss 0.16626. :  19%|████████▊                                     | 43/224 [00:21<01:30,  2.00it/s]
Epoch 5 Iter 44: loss 0.16626. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.01it/s]
Epoch 5 Iter 45: loss 0.16571. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.01it/s]
Epoch 5 Iter 45: loss 0.16571. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.01it/s]
Epoch 5 Iter 46: loss 0.17462. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.01it/s]
Epoch 5 Iter 46: loss 0.17462. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.01it/s]
Epoch 5 Iter 47: loss 0.17735. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 5 Iter 47: loss 0.17735. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.01it/s]
Epoch 5 Iter 48: loss 0.19060. :  21%|█████████▋                                    | 47/224 [00:23<01:27,  2.01it/s]
Epoch 5 Iter 48: loss 0.19060. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.01it/s]
Epoch 5 Iter 49: loss 0.18057. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.01it/s]
Epoch 5 Iter 49: loss 0.18057. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 5 Iter 50: loss 0.16787. :  22%|██████████                                    | 49/224 [00:24<01:26,  2.02it/s]
Epoch 5 Iter 50: loss 0.16787. :  22%|██████████▎                                   | 50/224 [00:24<01:25,  2.03it/s]
Epoch 5 Iter 51: loss 0.18970. :  22%|██████████▎                                   | 50/224 [00:25<01:25,  2.03it/s]
Epoch 5 Iter 51: loss 0.18970. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 5 Iter 52: loss 0.18619. :  23%|██████████▍                                   | 51/224 [00:25<01:25,  2.02it/s]
Epoch 5 Iter 52: loss 0.18619. :  23%|██████████▋                                   | 52/224 [00:25<01:26,  1.99it/s]
Epoch 5 Iter 53: loss 0.18673. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.99it/s]
Epoch 5 Iter 53: loss 0.18673. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.00it/s]
Epoch 5 Iter 54: loss 0.17009. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.00it/s]
Epoch 5 Iter 54: loss 0.17009. :  24%|███████████                                   | 54/224 [00:26<01:24,  2.00it/s]
Epoch 5 Iter 55: loss 0.16610. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.00it/s]
Epoch 5 Iter 55: loss 0.16610. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 5 Iter 56: loss 0.17194. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 5 Iter 56: loss 0.17194. :  25%|███████████▌                                  | 56/224 [00:27<01:23,  2.01it/s]
Epoch 5 Iter 57: loss 0.17746. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.01it/s]
Epoch 5 Iter 57: loss 0.17746. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.01it/s]
Epoch 5 Iter 58: loss 0.18621. :  25%|███████████▋                                  | 57/224 [00:28<01:22,  2.01it/s]
Epoch 5 Iter 58: loss 0.18621. :  26%|███████████▉                                  | 58/224 [00:28<01:22,  2.02it/s]
Epoch 5 Iter 59: loss 0.16156. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.02it/s]
Epoch 5 Iter 59: loss 0.16156. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 5 Iter 60: loss 0.17687. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 5 Iter 60: loss 0.17687. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.02it/s]
Epoch 5 Iter 61: loss 0.17958. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.02it/s]
Epoch 5 Iter 61: loss 0.17958. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 5 Iter 62: loss 0.19842. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.00it/s]
Epoch 5 Iter 62: loss 0.19842. :  28%|████████████▋                                 | 62/224 [00:30<01:20,  2.01it/s]
Epoch 5 Iter 63: loss 0.20462. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.01it/s]
Epoch 5 Iter 63: loss 0.20462. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 5 Iter 64: loss 0.15302. :  28%|████████████▉                                 | 63/224 [00:31<01:19,  2.02it/s]
Epoch 5 Iter 64: loss 0.15302. :  29%|█████████████▏                                | 64/224 [00:31<01:19,  2.01it/s]
Epoch 5 Iter 65: loss 0.18849. :  29%|█████████████▏                                | 64/224 [00:32<01:19,  2.01it/s]
Epoch 5 Iter 65: loss 0.18849. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 5 Iter 66: loss 0.19617. :  29%|█████████████▎                                | 65/224 [00:32<01:19,  2.00it/s]
Epoch 5 Iter 66: loss 0.19617. :  29%|█████████████▌                                | 66/224 [00:32<01:18,  2.00it/s]
Epoch 5 Iter 67: loss 0.16229. :  29%|█████████████▌                                | 66/224 [00:33<01:18,  2.00it/s]
Epoch 5 Iter 67: loss 0.16229. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.99it/s]
Epoch 5 Iter 68: loss 0.20147. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.99it/s]
Epoch 5 Iter 68: loss 0.20147. :  30%|█████████████▉                                | 68/224 [00:33<01:19,  1.96it/s]
Epoch 5 Iter 69: loss 0.16947. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.96it/s]
Epoch 5 Iter 69: loss 0.16947. :  31%|██████████████▏                               | 69/224 [00:34<01:19,  1.94it/s]
Epoch 5 Iter 70: loss 0.19634. :  31%|██████████████▏                               | 69/224 [00:34<01:19,  1.94it/s]
Epoch 5 Iter 70: loss 0.19634. :  31%|██████████████▍                               | 70/224 [00:34<01:18,  1.97it/s]
Epoch 5 Iter 71: loss 0.18238. :  31%|██████████████▍                               | 70/224 [00:35<01:18,  1.97it/s]
Epoch 5 Iter 71: loss 0.18238. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  1.99it/s]
Epoch 5 Iter 72: loss 0.18302. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  1.99it/s]
Epoch 5 Iter 72: loss 0.18302. :  32%|██████████████▊                               | 72/224 [00:35<01:15,  2.02it/s]
Epoch 5 Iter 73: loss 0.19165. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.02it/s]
Epoch 5 Iter 73: loss 0.19165. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 74: loss 0.17932. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.03it/s]
Epoch 5 Iter 74: loss 0.17932. :  33%|███████████████▏                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 5 Iter 75: loss 0.19760. :  33%|███████████████▏                              | 74/224 [00:37<01:13,  2.03it/s]
Epoch 5 Iter 75: loss 0.19760. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 5 Iter 76: loss 0.17291. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 5 Iter 76: loss 0.17291. :  34%|███████████████▌                              | 76/224 [00:37<01:13,  2.02it/s]
Epoch 5 Iter 77: loss 0.18364. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 5 Iter 77: loss 0.18364. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.03it/s]
Epoch 5 Iter 78: loss 0.20103. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.03it/s]
Epoch 5 Iter 78: loss 0.20103. :  35%|████████████████                              | 78/224 [00:38<01:12,  2.02it/s]
Epoch 5 Iter 79: loss 0.18359. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.02it/s]
Epoch 5 Iter 79: loss 0.18359. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 5 Iter 80: loss 0.18010. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 5 Iter 80: loss 0.18010. :  36%|████████████████▍                             | 80/224 [00:39<01:11,  2.02it/s]
Epoch 5 Iter 81: loss 0.17327. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 5 Iter 81: loss 0.17327. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.02it/s]
Epoch 5 Iter 82: loss 0.18954. :  36%|████████████████▋                             | 81/224 [00:40<01:10,  2.02it/s]
Epoch 5 Iter 82: loss 0.18954. :  37%|████████████████▊                             | 82/224 [00:40<01:10,  2.02it/s]
Epoch 5 Iter 83: loss 0.16618. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.02it/s]
Epoch 5 Iter 83: loss 0.16618. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 5 Iter 84: loss 0.19457. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 5 Iter 84: loss 0.19457. :  38%|█████████████████▎                            | 84/224 [00:41<01:08,  2.03it/s]
Epoch 5 Iter 85: loss 0.17540. :  38%|█████████████████▎                            | 84/224 [00:42<01:08,  2.03it/s]
Epoch 5 Iter 85: loss 0.17540. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 5 Iter 86: loss 0.17398. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 5 Iter 86: loss 0.17398. :  38%|█████████████████▋                            | 86/224 [00:42<01:08,  2.02it/s]
Epoch 5 Iter 87: loss 0.17924. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 5 Iter 87: loss 0.17924. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.03it/s]
Epoch 5 Iter 88: loss 0.16761. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.03it/s]
Epoch 5 Iter 88: loss 0.16761. :  39%|██████████████████                            | 88/224 [00:43<01:07,  2.03it/s]
Epoch 5 Iter 89: loss 0.17602. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.03it/s]
Epoch 5 Iter 89: loss 0.17602. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 5 Iter 90: loss 0.17375. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.03it/s]
Epoch 5 Iter 90: loss 0.17375. :  40%|██████████████████▍                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 5 Iter 91: loss 0.17730. :  40%|██████████████████▍                           | 90/224 [00:45<01:06,  2.01it/s]
Epoch 5 Iter 91: loss 0.17730. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.97it/s]
Epoch 5 Iter 92: loss 0.18197. :  41%|██████████████████▋                           | 91/224 [00:45<01:07,  1.97it/s]
Epoch 5 Iter 92: loss 0.18197. :  41%|██████████████████▉                           | 92/224 [00:45<01:06,  1.99it/s]
Epoch 5 Iter 93: loss 0.16821. :  41%|██████████████████▉                           | 92/224 [00:46<01:06,  1.99it/s]
Epoch 5 Iter 93: loss 0.16821. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.00it/s]
Epoch 5 Iter 94: loss 0.20820. :  42%|███████████████████                           | 93/224 [00:46<01:05,  2.00it/s]
Epoch 5 Iter 94: loss 0.20820. :  42%|███████████████████▎                          | 94/224 [00:46<01:05,  2.00it/s]
Epoch 5 Iter 95: loss 0.18843. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  2.00it/s]
Epoch 5 Iter 95: loss 0.18843. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  1.99it/s]
Epoch 5 Iter 96: loss 0.18671. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  1.99it/s]
Epoch 5 Iter 96: loss 0.18671. :  43%|███████████████████▋                          | 96/224 [00:47<01:04,  2.00it/s]
Epoch 5 Iter 97: loss 0.19739. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  2.00it/s]
Epoch 5 Iter 97: loss 0.19739. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 5 Iter 98: loss 0.17287. :  43%|███████████████████▉                          | 97/224 [00:48<01:03,  2.00it/s]
Epoch 5 Iter 98: loss 0.17287. :  44%|████████████████████▏                         | 98/224 [00:48<01:02,  2.01it/s]
Epoch 5 Iter 99: loss 0.18924. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.01it/s]
Epoch 5 Iter 99: loss 0.18924. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 5 Iter 100: loss 0.16916. :  44%|███████████████████▉                         | 99/224 [00:49<01:02,  2.01it/s]
Epoch 5 Iter 100: loss 0.16916. :  45%|███████████████████▋                        | 100/224 [00:49<01:01,  2.02it/s]
Epoch 5 Iter 101: loss 0.16511. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.02it/s]
Epoch 5 Iter 101: loss 0.16511. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.01it/s]
Epoch 5 Iter 102: loss 0.18350. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.01it/s]
Epoch 5 Iter 102: loss 0.18350. :  46%|████████████████████                        | 102/224 [00:50<01:00,  2.00it/s]
Epoch 5 Iter 103: loss 0.17577. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.00it/s]
Epoch 5 Iter 103: loss 0.17577. :  46%|████████████████████▏                       | 103/224 [00:51<01:01,  1.97it/s]
Epoch 5 Iter 104: loss 0.19958. :  46%|████████████████████▏                       | 103/224 [00:51<01:01,  1.97it/s]
Epoch 5 Iter 104: loss 0.19958. :  46%|████████████████████▍                       | 104/224 [00:51<01:00,  1.99it/s]
Epoch 5 Iter 105: loss 0.18561. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.99it/s]
Epoch 5 Iter 105: loss 0.18561. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.01it/s]
Epoch 5 Iter 106: loss 0.17096. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  2.01it/s]
Epoch 5 Iter 106: loss 0.17096. :  47%|████████████████████▊                       | 106/224 [00:52<00:58,  2.01it/s]
Epoch 5 Iter 107: loss 0.17670. :  47%|████████████████████▊                       | 106/224 [00:53<00:58,  2.01it/s]
Epoch 5 Iter 107: loss 0.17670. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 5 Iter 108: loss 0.21510. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  2.01it/s]
Epoch 5 Iter 108: loss 0.21510. :  48%|█████████████████████▏                      | 108/224 [00:53<00:57,  2.02it/s]
Epoch 5 Iter 109: loss 0.19832. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.02it/s]
Epoch 5 Iter 109: loss 0.19832. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 5 Iter 110: loss 0.20043. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 5 Iter 110: loss 0.20043. :  49%|█████████████████████▌                      | 110/224 [00:54<00:56,  2.01it/s]
Epoch 5 Iter 111: loss 0.18096. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.01it/s]
Epoch 5 Iter 111: loss 0.18096. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.02it/s]
Epoch 5 Iter 112: loss 0.20834. :  50%|█████████████████████▊                      | 111/224 [00:55<00:56,  2.02it/s]
Epoch 5 Iter 112: loss 0.20834. :  50%|██████████████████████                      | 112/224 [00:55<00:55,  2.02it/s]
Epoch 5 Iter 113: loss 0.15791. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.02it/s]
Epoch 5 Iter 113: loss 0.15791. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 5 Iter 114: loss 0.17945. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.02it/s]
Epoch 5 Iter 114: loss 0.17945. :  51%|██████████████████████▍                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 5 Iter 115: loss 0.18441. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.03it/s]
Epoch 5 Iter 115: loss 0.18441. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 5 Iter 116: loss 0.18811. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.02it/s]
Epoch 5 Iter 116: loss 0.18811. :  52%|██████████████████████▊                     | 116/224 [00:57<00:53,  2.02it/s]
Epoch 5 Iter 117: loss 0.17976. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.02it/s]
Epoch 5 Iter 117: loss 0.17976. :  52%|██████████████████████▉                     | 117/224 [00:58<00:52,  2.02it/s]
Epoch 5 Iter 118: loss 0.16129. :  52%|██████████████████████▉                     | 117/224 [00:58<00:52,  2.02it/s]
Epoch 5 Iter 118: loss 0.16129. :  53%|███████████████████████▏                    | 118/224 [00:58<00:52,  2.02it/s]
Epoch 5 Iter 119: loss 0.19103. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.02it/s]
Epoch 5 Iter 119: loss 0.19103. :  53%|███████████████████████▍                    | 119/224 [00:59<00:51,  2.02it/s]
Epoch 5 Iter 120: loss 0.19619. :  53%|███████████████████████▍                    | 119/224 [00:59<00:51,  2.02it/s]
Epoch 5 Iter 120: loss 0.19619. :  54%|███████████████████████▌                    | 120/224 [00:59<00:51,  2.02it/s]
Epoch 5 Iter 121: loss 0.17798. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 5 Iter 121: loss 0.17798. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 5 Iter 122: loss 0.17677. :  54%|███████████████████████▊                    | 121/224 [01:00<00:51,  2.01it/s]
Epoch 5 Iter 122: loss 0.17677. :  54%|███████████████████████▉                    | 122/224 [01:00<00:50,  2.01it/s]
Epoch 5 Iter 123: loss 0.17344. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.01it/s]
Epoch 5 Iter 123: loss 0.17344. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 5 Iter 124: loss 0.19109. :  55%|████████████████████████▏                   | 123/224 [01:01<00:50,  2.01it/s]
Epoch 5 Iter 124: loss 0.19109. :  55%|████████████████████████▎                   | 124/224 [01:01<00:49,  2.01it/s]
Epoch 5 Iter 125: loss 0.18391. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.01it/s]
Epoch 5 Iter 125: loss 0.18391. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.01it/s]
Epoch 5 Iter 126: loss 0.19084. :  56%|████████████████████████▌                   | 125/224 [01:02<00:49,  2.01it/s]
Epoch 5 Iter 126: loss 0.19084. :  56%|████████████████████████▊                   | 126/224 [01:02<00:48,  2.01it/s]
Epoch 5 Iter 127: loss 0.17044. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.01it/s]
Epoch 5 Iter 127: loss 0.17044. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.02it/s]
Epoch 5 Iter 128: loss 0.18845. :  57%|████████████████████████▉                   | 127/224 [01:03<00:48,  2.02it/s]
Epoch 5 Iter 128: loss 0.18845. :  57%|█████████████████████████▏                  | 128/224 [01:03<00:47,  2.01it/s]
Epoch 5 Iter 129: loss 0.17778. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.01it/s]
Epoch 5 Iter 129: loss 0.17778. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.19965. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:47,  2.02it/s]
Epoch 5 Iter 130: loss 0.19965. :  58%|█████████████████████████▌                  | 130/224 [01:04<00:46,  2.01it/s]
Epoch 5 Iter 131: loss 0.17221. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:46,  2.01it/s]
Epoch 5 Iter 131: loss 0.17221. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.17481. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.02it/s]
Epoch 5 Iter 132: loss 0.17481. :  59%|█████████████████████████▉                  | 132/224 [01:05<00:45,  2.02it/s]
Epoch 5 Iter 133: loss 0.17933. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.02it/s]
Epoch 5 Iter 133: loss 0.17933. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.00it/s]
Epoch 5 Iter 134: loss 0.19386. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.00it/s]
Epoch 5 Iter 134: loss 0.19386. :  60%|██████████████████████████▎                 | 134/224 [01:06<00:45,  2.00it/s]
Epoch 5 Iter 135: loss 0.18712. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  2.00it/s]
Epoch 5 Iter 135: loss 0.18712. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 5 Iter 136: loss 0.18305. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.01it/s]
Epoch 5 Iter 136: loss 0.18305. :  61%|██████████████████████████▋                 | 136/224 [01:07<00:43,  2.02it/s]
Epoch 5 Iter 137: loss 0.18930. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 137: loss 0.18930. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 138: loss 0.19876. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:43,  2.02it/s]
Epoch 5 Iter 138: loss 0.19876. :  62%|███████████████████████████                 | 138/224 [01:08<00:42,  2.02it/s]
Epoch 5 Iter 139: loss 0.17957. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 5 Iter 139: loss 0.17957. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.02it/s]
Epoch 5 Iter 140: loss 0.16881. :  62%|███████████████████████████▎                | 139/224 [01:09<00:42,  2.02it/s]
Epoch 5 Iter 140: loss 0.16881. :  62%|███████████████████████████▌                | 140/224 [01:09<00:41,  2.02it/s]
Epoch 5 Iter 141: loss 0.18692. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.02it/s]
Epoch 5 Iter 141: loss 0.18692. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 142: loss 0.16603. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 5 Iter 142: loss 0.16603. :  63%|███████████████████████████▉                | 142/224 [01:10<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.19007. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 143: loss 0.19007. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 144: loss 0.16998. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.01it/s]
Epoch 5 Iter 144: loss 0.16998. :  64%|████████████████████████████▎               | 144/224 [01:11<00:39,  2.03it/s]
Epoch 5 Iter 145: loss 0.18740. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.03it/s]
Epoch 5 Iter 145: loss 0.18740. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.02it/s]
Epoch 5 Iter 146: loss 0.19019. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.02it/s]
Epoch 5 Iter 146: loss 0.19019. :  65%|████████████████████████████▋               | 146/224 [01:12<00:38,  2.02it/s]
Epoch 5 Iter 147: loss 0.18592. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.02it/s]
Epoch 5 Iter 147: loss 0.18592. :  66%|████████████████████████████▉               | 147/224 [01:13<00:39,  1.97it/s]
Epoch 5 Iter 148: loss 0.19414. :  66%|████████████████████████████▉               | 147/224 [01:13<00:39,  1.97it/s]
Epoch 5 Iter 148: loss 0.19414. :  66%|█████████████████████████████               | 148/224 [01:13<00:38,  1.99it/s]
Epoch 5 Iter 149: loss 0.20420. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.99it/s]
Epoch 5 Iter 149: loss 0.20420. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 5 Iter 150: loss 0.18573. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.00it/s]
Epoch 5 Iter 150: loss 0.18573. :  67%|█████████████████████████████▍              | 150/224 [01:14<00:36,  2.00it/s]
Epoch 5 Iter 151: loss 0.18381. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 151: loss 0.18381. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 152: loss 0.17954. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:36,  2.00it/s]
Epoch 5 Iter 152: loss 0.17954. :  68%|█████████████████████████████▊              | 152/224 [01:15<00:35,  2.01it/s]
Epoch 5 Iter 153: loss 0.18665. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.01it/s]
Epoch 5 Iter 153: loss 0.18665. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.00it/s]
Epoch 5 Iter 154: loss 0.15695. :  68%|██████████████████████████████              | 153/224 [01:16<00:35,  2.00it/s]
Epoch 5 Iter 154: loss 0.15695. :  69%|██████████████████████████████▎             | 154/224 [01:16<00:34,  2.00it/s]
Epoch 5 Iter 155: loss 0.18665. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.00it/s]
Epoch 5 Iter 155: loss 0.18665. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 5 Iter 156: loss 0.18970. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  1.98it/s]
Epoch 5 Iter 156: loss 0.18970. :  70%|██████████████████████████████▋             | 156/224 [01:17<00:34,  1.98it/s]
Epoch 5 Iter 157: loss 0.19645. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  1.98it/s]
Epoch 5 Iter 157: loss 0.19645. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  1.99it/s]
Epoch 5 Iter 158: loss 0.18683. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  1.99it/s]
Epoch 5 Iter 158: loss 0.18683. :  71%|███████████████████████████████             | 158/224 [01:18<00:33,  1.99it/s]
Epoch 5 Iter 159: loss 0.18940. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  1.99it/s]
Epoch 5 Iter 159: loss 0.18940. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  1.99it/s]
Epoch 5 Iter 160: loss 0.18427. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  1.99it/s]
Epoch 5 Iter 160: loss 0.18427. :  71%|███████████████████████████████▍            | 160/224 [01:19<00:32,  1.99it/s]
Epoch 5 Iter 161: loss 0.16219. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  1.99it/s]
Epoch 5 Iter 161: loss 0.16219. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.00it/s]
Epoch 5 Iter 162: loss 0.17035. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.00it/s]
Epoch 5 Iter 162: loss 0.17035. :  72%|███████████████████████████████▊            | 162/224 [01:20<00:30,  2.01it/s]
Epoch 5 Iter 163: loss 0.18065. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.01it/s]
Epoch 5 Iter 163: loss 0.18065. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 5 Iter 164: loss 0.17336. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.02it/s]
Epoch 5 Iter 164: loss 0.17336. :  73%|████████████████████████████████▏           | 164/224 [01:21<00:29,  2.02it/s]
Epoch 5 Iter 165: loss 0.15603. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:29,  2.02it/s]
Epoch 5 Iter 165: loss 0.15603. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.02it/s]
Epoch 5 Iter 166: loss 0.17521. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.02it/s]
Epoch 5 Iter 166: loss 0.17521. :  74%|████████████████████████████████▌           | 166/224 [01:22<00:28,  2.02it/s]
Epoch 5 Iter 167: loss 0.16338. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.02it/s]
Epoch 5 Iter 167: loss 0.16338. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 5 Iter 168: loss 0.18301. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.01it/s]
Epoch 5 Iter 168: loss 0.18301. :  75%|█████████████████████████████████           | 168/224 [01:23<00:27,  2.01it/s]
Epoch 5 Iter 169: loss 0.18257. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.01it/s]
Epoch 5 Iter 169: loss 0.18257. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.01it/s]
Epoch 5 Iter 170: loss 0.17780. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.01it/s]
Epoch 5 Iter 170: loss 0.17780. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:26,  2.02it/s]
Epoch 5 Iter 171: loss 0.18627. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.02it/s]
Epoch 5 Iter 171: loss 0.18627. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  1.99it/s]
Epoch 5 Iter 172: loss 0.18298. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  1.99it/s]
Epoch 5 Iter 172: loss 0.18298. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:26,  2.00it/s]
Epoch 5 Iter 173: loss 0.19203. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:26,  2.00it/s]
Epoch 5 Iter 173: loss 0.19203. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 5 Iter 174: loss 0.20023. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.01it/s]
Epoch 5 Iter 174: loss 0.20023. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.00it/s]
Epoch 5 Iter 175: loss 0.20795. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.00it/s]
Epoch 5 Iter 175: loss 0.20795. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 5 Iter 176: loss 0.19880. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 5 Iter 176: loss 0.19880. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.02it/s]
Epoch 5 Iter 177: loss 0.17725. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.02it/s]
Epoch 5 Iter 177: loss 0.17725. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 5 Iter 178: loss 0.19208. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 5 Iter 178: loss 0.19208. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.02it/s]
Epoch 5 Iter 179: loss 0.17617. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 179: loss 0.17617. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 180: loss 0.18561. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.02it/s]
Epoch 5 Iter 180: loss 0.18561. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:21,  2.02it/s]
Epoch 5 Iter 181: loss 0.18086. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.02it/s]
Epoch 5 Iter 181: loss 0.18086. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.02it/s]
Epoch 5 Iter 182: loss 0.18462. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.02it/s]
Epoch 5 Iter 182: loss 0.18462. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.02it/s]
Epoch 5 Iter 183: loss 0.18201. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.02it/s]
Epoch 5 Iter 183: loss 0.18201. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.01it/s]
Epoch 5 Iter 184: loss 0.17862. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.01it/s]
Epoch 5 Iter 184: loss 0.17862. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.02it/s]
Epoch 5 Iter 185: loss 0.18728. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.02it/s]
Epoch 5 Iter 185: loss 0.18728. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 5 Iter 186: loss 0.18219. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.02it/s]
Epoch 5 Iter 186: loss 0.18219. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.02it/s]
Epoch 5 Iter 187: loss 0.16151. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 187: loss 0.16151. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 188: loss 0.17768. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 5 Iter 188: loss 0.17768. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:18,  1.96it/s]
Epoch 5 Iter 189: loss 0.20118. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:18,  1.96it/s]
Epoch 5 Iter 189: loss 0.20118. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.97it/s]
Epoch 5 Iter 190: loss 0.19258. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  1.97it/s]
Epoch 5 Iter 190: loss 0.19258. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:17,  1.97it/s]
Epoch 5 Iter 191: loss 0.19889. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:17,  1.97it/s]
Epoch 5 Iter 191: loss 0.19889. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.98it/s]
Epoch 5 Iter 192: loss 0.16013. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  1.98it/s]
Epoch 5 Iter 192: loss 0.16013. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:16,  1.97it/s]
Epoch 5 Iter 193: loss 0.17222. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:16,  1.97it/s]
Epoch 5 Iter 193: loss 0.17222. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 5 Iter 194: loss 0.18150. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  1.99it/s]
Epoch 5 Iter 194: loss 0.18150. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:15,  2.00it/s]
Epoch 5 Iter 195: loss 0.18166. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:15,  2.00it/s]
Epoch 5 Iter 195: loss 0.18166. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.01it/s]
Epoch 5 Iter 196: loss 0.17654. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.01it/s]
Epoch 5 Iter 196: loss 0.17654. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:13,  2.01it/s]
Epoch 5 Iter 197: loss 0.16334. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 197: loss 0.16334. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 198: loss 0.17416. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.01it/s]
Epoch 5 Iter 198: loss 0.17416. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.02it/s]
Epoch 5 Iter 199: loss 0.18657. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.02it/s]
Epoch 5 Iter 199: loss 0.18657. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.03it/s]
Epoch 5 Iter 200: loss 0.18020. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.03it/s]
Epoch 5 Iter 200: loss 0.18020. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:11,  2.03it/s]
Epoch 5 Iter 201: loss 0.17912. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.03it/s]
Epoch 5 Iter 201: loss 0.17912. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 5 Iter 202: loss 0.19124. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 5 Iter 202: loss 0.19124. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:10,  2.02it/s]
Epoch 5 Iter 203: loss 0.16445. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.02it/s]
Epoch 5 Iter 203: loss 0.16445. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.01it/s]
Epoch 5 Iter 204: loss 0.16269. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.01it/s]
Epoch 5 Iter 204: loss 0.16269. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.18779. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:09,  2.02it/s]
Epoch 5 Iter 205: loss 0.18779. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.15818. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  2.00it/s]
Epoch 5 Iter 206: loss 0.15818. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.18386. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:08,  2.00it/s]
Epoch 5 Iter 207: loss 0.18386. :  92%|████████████████████████████████████████▋   | 207/224 [01:42<00:08,  2.02it/s]
Epoch 5 Iter 208: loss 0.20858. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  2.02it/s]
Epoch 5 Iter 208: loss 0.20858. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:07,  2.01it/s]
Epoch 5 Iter 209: loss 0.19013. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:07,  2.01it/s]
Epoch 5 Iter 209: loss 0.19013. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 5 Iter 210: loss 0.17900. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 5 Iter 210: loss 0.17900. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.01it/s]
Epoch 5 Iter 211: loss 0.19775. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:06,  2.01it/s]
Epoch 5 Iter 211: loss 0.19775. :  94%|█████████████████████████████████████████▍  | 211/224 [01:44<00:06,  2.02it/s]
Epoch 5 Iter 212: loss 0.18889. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  2.02it/s]
Epoch 5 Iter 212: loss 0.18889. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.02it/s]
Epoch 5 Iter 213: loss 0.16762. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:05,  2.02it/s]
Epoch 5 Iter 213: loss 0.16762. :  95%|█████████████████████████████████████████▊  | 213/224 [01:45<00:05,  2.01it/s]
Epoch 5 Iter 214: loss 0.18023. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  2.01it/s]
Epoch 5 Iter 214: loss 0.18023. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:04,  2.01it/s]
Epoch 5 Iter 215: loss 0.19109. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:04,  2.01it/s]
Epoch 5 Iter 215: loss 0.19109. :  96%|██████████████████████████████████████████▏ | 215/224 [01:46<00:04,  2.00it/s]
Epoch 5 Iter 216: loss 0.19673. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  2.00it/s]
Epoch 5 Iter 216: loss 0.19673. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.01it/s]
Epoch 5 Iter 217: loss 0.16369. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:03,  2.01it/s]
Epoch 5 Iter 217: loss 0.16369. :  97%|██████████████████████████████████████████▋ | 217/224 [01:47<00:03,  2.00it/s]
Epoch 5 Iter 218: loss 0.18185. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  2.00it/s]
Epoch 5 Iter 218: loss 0.18185. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:03,  2.00it/s]
Epoch 5 Iter 219: loss 0.18034. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:03,  2.00it/s]
Epoch 5 Iter 219: loss 0.18034. :  98%|███████████████████████████████████████████ | 219/224 [01:48<00:02,  1.99it/s]
Epoch 5 Iter 220: loss 0.19119. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.99it/s]
Epoch 5 Iter 220: loss 0.19119. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:02,  1.99it/s]
Epoch 5 Iter 221: loss 0.18819. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 5 Iter 221: loss 0.18819. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.99it/s]
Epoch 5 Iter 222: loss 0.19618. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.99it/s]
Epoch 5 Iter 222: loss 0.19618. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:01,  1.96it/s]
Epoch 5 Iter 223: loss 0.16658. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:01,  1.96it/s]
Epoch 5 Iter 223: loss 0.16658. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  1.97it/s]
Epoch 5 Iter 224: loss 0.18047. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  1.97it/s]
Epoch 5 Iter 224: loss 0.18047. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  1.97it/s]
Epoch 5 Iter 224: loss 0.18047. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.01it/s]

    Train loss: 0.18215
    Valid loss: 0.18411
       Valid loss recons: 0.17847
       Valid loss KL-D:   56.40962
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.18192. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 6 Iter 1: loss 0.18192. :   0%|▏                                               | 1/224 [00:00<01:52,  1.99it/s]
Epoch 6 Iter 2: loss 0.18746. :   0%|▏                                               | 1/224 [00:00<01:52,  1.99it/s]
Epoch 6 Iter 2: loss 0.18746. :   1%|▍                                               | 2/224 [00:00<01:49,  2.03it/s]
Epoch 6 Iter 3: loss 0.20163. :   1%|▍                                               | 2/224 [00:01<01:49,  2.03it/s]
Epoch 6 Iter 3: loss 0.20163. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 6 Iter 4: loss 0.18062. :   1%|▋                                               | 3/224 [00:01<01:49,  2.02it/s]
Epoch 6 Iter 4: loss 0.18062. :   2%|▊                                               | 4/224 [00:01<01:47,  2.04it/s]
Epoch 6 Iter 5: loss 0.16590. :   2%|▊                                               | 4/224 [00:02<01:47,  2.04it/s]
Epoch 6 Iter 5: loss 0.16590. :   2%|█                                               | 5/224 [00:02<01:47,  2.04it/s]
Epoch 6 Iter 6: loss 0.17670. :   2%|█                                               | 5/224 [00:02<01:47,  2.04it/s]
Epoch 6 Iter 6: loss 0.17670. :   3%|█▎                                              | 6/224 [00:02<01:47,  2.03it/s]
Epoch 6 Iter 7: loss 0.18210. :   3%|█▎                                              | 6/224 [00:03<01:47,  2.03it/s]
Epoch 6 Iter 7: loss 0.18210. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 6 Iter 8: loss 0.16895. :   3%|█▌                                              | 7/224 [00:03<01:47,  2.02it/s]
Epoch 6 Iter 8: loss 0.16895. :   4%|█▋                                              | 8/224 [00:03<01:47,  2.02it/s]
Epoch 6 Iter 9: loss 0.18137. :   4%|█▋                                              | 8/224 [00:04<01:47,  2.02it/s]
Epoch 6 Iter 9: loss 0.18137. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.01it/s]
Epoch 6 Iter 10: loss 0.17391. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.01it/s]
Epoch 6 Iter 10: loss 0.17391. :   4%|██                                            | 10/224 [00:04<01:47,  1.99it/s]
Epoch 6 Iter 11: loss 0.19828. :   4%|██                                            | 10/224 [00:05<01:47,  1.99it/s]
Epoch 6 Iter 11: loss 0.19828. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 6 Iter 12: loss 0.17319. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.00it/s]
Epoch 6 Iter 12: loss 0.17319. :   5%|██▍                                           | 12/224 [00:05<01:46,  1.99it/s]
Epoch 6 Iter 13: loss 0.19899. :   5%|██▍                                           | 12/224 [00:06<01:46,  1.99it/s]
Epoch 6 Iter 13: loss 0.19899. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 6 Iter 14: loss 0.17539. :   6%|██▋                                           | 13/224 [00:06<01:45,  2.00it/s]
Epoch 6 Iter 14: loss 0.17539. :   6%|██▉                                           | 14/224 [00:06<01:45,  1.99it/s]
Epoch 6 Iter 15: loss 0.16018. :   6%|██▉                                           | 14/224 [00:07<01:45,  1.99it/s]
Epoch 6 Iter 15: loss 0.16018. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 6 Iter 16: loss 0.17909. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 6 Iter 16: loss 0.17909. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.00it/s]
Epoch 6 Iter 17: loss 0.18478. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.00it/s]
Epoch 6 Iter 17: loss 0.18478. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 6 Iter 18: loss 0.16492. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.01it/s]
Epoch 6 Iter 18: loss 0.16492. :   8%|███▋                                          | 18/224 [00:08<01:42,  2.02it/s]
Epoch 6 Iter 19: loss 0.17548. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.02it/s]
Epoch 6 Iter 19: loss 0.17548. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.17549. :   8%|███▉                                          | 19/224 [00:09<01:41,  2.02it/s]
Epoch 6 Iter 20: loss 0.17549. :   9%|████                                          | 20/224 [00:09<01:40,  2.03it/s]
Epoch 6 Iter 21: loss 0.18085. :   9%|████                                          | 20/224 [00:10<01:40,  2.03it/s]
Epoch 6 Iter 21: loss 0.18085. :   9%|████▎                                         | 21/224 [00:10<01:39,  2.03it/s]
Epoch 6 Iter 22: loss 0.17844. :   9%|████▎                                         | 21/224 [00:10<01:39,  2.03it/s]
Epoch 6 Iter 22: loss 0.17844. :  10%|████▌                                         | 22/224 [00:10<01:40,  2.02it/s]
Epoch 6 Iter 23: loss 0.18637. :  10%|████▌                                         | 22/224 [00:11<01:40,  2.02it/s]
Epoch 6 Iter 23: loss 0.18637. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.18012. :  10%|████▋                                         | 23/224 [00:11<01:39,  2.02it/s]
Epoch 6 Iter 24: loss 0.18012. :  11%|████▉                                         | 24/224 [00:11<01:38,  2.03it/s]
Epoch 6 Iter 25: loss 0.16485. :  11%|████▉                                         | 24/224 [00:12<01:38,  2.03it/s]
Epoch 6 Iter 25: loss 0.16485. :  11%|█████▏                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 6 Iter 26: loss 0.17710. :  11%|█████▏                                        | 25/224 [00:12<01:37,  2.03it/s]
Epoch 6 Iter 26: loss 0.17710. :  12%|█████▎                                        | 26/224 [00:12<01:37,  2.02it/s]
Epoch 6 Iter 27: loss 0.17829. :  12%|█████▎                                        | 26/224 [00:13<01:37,  2.02it/s]
Epoch 6 Iter 27: loss 0.17829. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 6 Iter 28: loss 0.18542. :  12%|█████▌                                        | 27/224 [00:13<01:37,  2.03it/s]
Epoch 6 Iter 28: loss 0.18542. :  12%|█████▊                                        | 28/224 [00:13<01:36,  2.03it/s]
Epoch 6 Iter 29: loss 0.16305. :  12%|█████▊                                        | 28/224 [00:14<01:36,  2.03it/s]
Epoch 6 Iter 29: loss 0.16305. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 6 Iter 30: loss 0.17867. :  13%|█████▉                                        | 29/224 [00:14<01:36,  2.03it/s]
Epoch 6 Iter 30: loss 0.17867. :  13%|██████▏                                       | 30/224 [00:14<01:35,  2.03it/s]
Epoch 6 Iter 31: loss 0.19528. :  13%|██████▏                                       | 30/224 [00:15<01:35,  2.03it/s]
Epoch 6 Iter 31: loss 0.19528. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.03it/s]
Epoch 6 Iter 32: loss 0.18676. :  14%|██████▎                                       | 31/224 [00:15<01:35,  2.03it/s]
Epoch 6 Iter 32: loss 0.18676. :  14%|██████▌                                       | 32/224 [00:15<01:34,  2.02it/s]
Epoch 6 Iter 33: loss 0.20031. :  14%|██████▌                                       | 32/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 33: loss 0.20031. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 34: loss 0.17994. :  15%|██████▊                                       | 33/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 34: loss 0.17994. :  15%|██████▉                                       | 34/224 [00:16<01:34,  2.02it/s]
Epoch 6 Iter 35: loss 0.17196. :  15%|██████▉                                       | 34/224 [00:17<01:34,  2.02it/s]
Epoch 6 Iter 35: loss 0.17196. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.01it/s]
Epoch 6 Iter 36: loss 0.18592. :  16%|███████▏                                      | 35/224 [00:17<01:33,  2.01it/s]
Epoch 6 Iter 36: loss 0.18592. :  16%|███████▍                                      | 36/224 [00:17<01:33,  2.01it/s]
Epoch 6 Iter 37: loss 0.18220. :  16%|███████▍                                      | 36/224 [00:18<01:33,  2.01it/s]
Epoch 6 Iter 37: loss 0.18220. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.02it/s]
Epoch 6 Iter 38: loss 0.18414. :  17%|███████▌                                      | 37/224 [00:18<01:32,  2.02it/s]
Epoch 6 Iter 38: loss 0.18414. :  17%|███████▊                                      | 38/224 [00:18<01:32,  2.01it/s]
Epoch 6 Iter 39: loss 0.19373. :  17%|███████▊                                      | 38/224 [00:19<01:32,  2.01it/s]
Epoch 6 Iter 39: loss 0.19373. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 6 Iter 40: loss 0.17074. :  17%|████████                                      | 39/224 [00:19<01:32,  2.00it/s]
Epoch 6 Iter 40: loss 0.17074. :  18%|████████▏                                     | 40/224 [00:19<01:31,  2.01it/s]
Epoch 6 Iter 41: loss 0.17417. :  18%|████████▏                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 6 Iter 41: loss 0.17417. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 6 Iter 42: loss 0.19060. :  18%|████████▍                                     | 41/224 [00:20<01:30,  2.02it/s]
Epoch 6 Iter 42: loss 0.19060. :  19%|████████▋                                     | 42/224 [00:20<01:30,  2.02it/s]
Epoch 6 Iter 43: loss 0.17443. :  19%|████████▋                                     | 42/224 [00:21<01:30,  2.02it/s]
Epoch 6 Iter 43: loss 0.17443. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.19439. :  19%|████████▊                                     | 43/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 44: loss 0.19439. :  20%|█████████                                     | 44/224 [00:21<01:29,  2.02it/s]
Epoch 6 Iter 45: loss 0.16166. :  20%|█████████                                     | 44/224 [00:22<01:29,  2.02it/s]
Epoch 6 Iter 45: loss 0.16166. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 46: loss 0.19887. :  20%|█████████▏                                    | 45/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 46: loss 0.19887. :  21%|█████████▍                                    | 46/224 [00:22<01:28,  2.02it/s]
Epoch 6 Iter 47: loss 0.17722. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.02it/s]
Epoch 6 Iter 47: loss 0.17722. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 6 Iter 48: loss 0.18348. :  21%|█████████▋                                    | 47/224 [00:23<01:28,  2.00it/s]
Epoch 6 Iter 48: loss 0.18348. :  21%|█████████▊                                    | 48/224 [00:23<01:27,  2.01it/s]
Epoch 6 Iter 49: loss 0.18779. :  21%|█████████▊                                    | 48/224 [00:24<01:27,  2.01it/s]
Epoch 6 Iter 49: loss 0.18779. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 6 Iter 50: loss 0.17008. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 6 Iter 50: loss 0.17008. :  22%|██████████▎                                   | 50/224 [00:24<01:28,  1.98it/s]
Epoch 6 Iter 51: loss 0.17145. :  22%|██████████▎                                   | 50/224 [00:25<01:28,  1.98it/s]
Epoch 6 Iter 51: loss 0.17145. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.98it/s]
Epoch 6 Iter 52: loss 0.19672. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.98it/s]
Epoch 6 Iter 52: loss 0.19672. :  23%|██████████▋                                   | 52/224 [00:25<01:26,  1.99it/s]
Epoch 6 Iter 53: loss 0.17532. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.99it/s]
Epoch 6 Iter 53: loss 0.17532. :  24%|██████████▉                                   | 53/224 [00:26<01:26,  1.98it/s]
Epoch 6 Iter 54: loss 0.18436. :  24%|██████████▉                                   | 53/224 [00:26<01:26,  1.98it/s]
Epoch 6 Iter 54: loss 0.18436. :  24%|███████████                                   | 54/224 [00:26<01:25,  1.98it/s]
Epoch 6 Iter 55: loss 0.19355. :  24%|███████████                                   | 54/224 [00:27<01:25,  1.98it/s]
Epoch 6 Iter 55: loss 0.19355. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  1.99it/s]
Epoch 6 Iter 56: loss 0.20228. :  25%|███████████▎                                  | 55/224 [00:27<01:24,  1.99it/s]
Epoch 6 Iter 56: loss 0.20228. :  25%|███████████▌                                  | 56/224 [00:27<01:25,  1.98it/s]
Epoch 6 Iter 57: loss 0.18221. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.98it/s]
Epoch 6 Iter 57: loss 0.18221. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.98it/s]
Epoch 6 Iter 58: loss 0.16452. :  25%|███████████▋                                  | 57/224 [00:28<01:24,  1.98it/s]
Epoch 6 Iter 58: loss 0.16452. :  26%|███████████▉                                  | 58/224 [00:28<01:23,  2.00it/s]
Epoch 6 Iter 59: loss 0.18259. :  26%|███████████▉                                  | 58/224 [00:29<01:23,  2.00it/s]
Epoch 6 Iter 59: loss 0.18259. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 6 Iter 60: loss 0.18386. :  26%|████████████                                  | 59/224 [00:29<01:22,  1.99it/s]
Epoch 6 Iter 60: loss 0.18386. :  27%|████████████▎                                 | 60/224 [00:29<01:21,  2.01it/s]
Epoch 6 Iter 61: loss 0.18134. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 61: loss 0.18134. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 62: loss 0.19282. :  27%|████████████▌                                 | 61/224 [00:30<01:21,  2.01it/s]
Epoch 6 Iter 62: loss 0.19282. :  28%|████████████▋                                 | 62/224 [00:30<01:21,  1.98it/s]
Epoch 6 Iter 63: loss 0.15147. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.98it/s]
Epoch 6 Iter 63: loss 0.15147. :  28%|████████████▉                                 | 63/224 [00:31<01:22,  1.95it/s]
Epoch 6 Iter 64: loss 0.16267. :  28%|████████████▉                                 | 63/224 [00:31<01:22,  1.95it/s]
Epoch 6 Iter 64: loss 0.16267. :  29%|█████████████▏                                | 64/224 [00:31<01:21,  1.96it/s]
Epoch 6 Iter 65: loss 0.17519. :  29%|█████████████▏                                | 64/224 [00:32<01:21,  1.96it/s]
Epoch 6 Iter 65: loss 0.17519. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.97it/s]
Epoch 6 Iter 66: loss 0.17504. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.97it/s]
Epoch 6 Iter 66: loss 0.17504. :  29%|█████████████▌                                | 66/224 [00:32<01:19,  1.99it/s]
Epoch 6 Iter 67: loss 0.19387. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.99it/s]
Epoch 6 Iter 67: loss 0.19387. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.00it/s]
Epoch 6 Iter 68: loss 0.17425. :  30%|█████████████▊                                | 67/224 [00:33<01:18,  2.00it/s]
Epoch 6 Iter 68: loss 0.17425. :  30%|█████████████▉                                | 68/224 [00:33<01:18,  1.99it/s]
Epoch 6 Iter 69: loss 0.19258. :  30%|█████████████▉                                | 68/224 [00:34<01:18,  1.99it/s]
Epoch 6 Iter 69: loss 0.19258. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 6 Iter 70: loss 0.17737. :  31%|██████████████▏                               | 69/224 [00:34<01:17,  2.00it/s]
Epoch 6 Iter 70: loss 0.17737. :  31%|██████████████▍                               | 70/224 [00:34<01:17,  2.00it/s]
Epoch 6 Iter 71: loss 0.16545. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  2.00it/s]
Epoch 6 Iter 71: loss 0.16545. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.98it/s]
Epoch 6 Iter 72: loss 0.18031. :  32%|██████████████▌                               | 71/224 [00:35<01:17,  1.98it/s]
Epoch 6 Iter 72: loss 0.18031. :  32%|██████████████▊                               | 72/224 [00:35<01:16,  1.98it/s]
Epoch 6 Iter 73: loss 0.19272. :  32%|██████████████▊                               | 72/224 [00:36<01:16,  1.98it/s]
Epoch 6 Iter 73: loss 0.19272. :  33%|██████████████▉                               | 73/224 [00:36<01:16,  1.97it/s]
Epoch 6 Iter 74: loss 0.19023. :  33%|██████████████▉                               | 73/224 [00:36<01:16,  1.97it/s]
Epoch 6 Iter 74: loss 0.19023. :  33%|███████████████▏                              | 74/224 [00:36<01:16,  1.96it/s]
Epoch 6 Iter 75: loss 0.19977. :  33%|███████████████▏                              | 74/224 [00:37<01:16,  1.96it/s]
Epoch 6 Iter 75: loss 0.19977. :  33%|███████████████▍                              | 75/224 [00:37<01:15,  1.98it/s]
Epoch 6 Iter 76: loss 0.17120. :  33%|███████████████▍                              | 75/224 [00:37<01:15,  1.98it/s]
Epoch 6 Iter 76: loss 0.17120. :  34%|███████████████▌                              | 76/224 [00:37<01:14,  1.98it/s]
Epoch 6 Iter 77: loss 0.21239. :  34%|███████████████▌                              | 76/224 [00:38<01:14,  1.98it/s]
Epoch 6 Iter 77: loss 0.21239. :  34%|███████████████▊                              | 77/224 [00:38<01:14,  1.99it/s]
Epoch 6 Iter 78: loss 0.18119. :  34%|███████████████▊                              | 77/224 [00:38<01:14,  1.99it/s]
Epoch 6 Iter 78: loss 0.18119. :  35%|████████████████                              | 78/224 [00:38<01:13,  2.00it/s]
Epoch 6 Iter 79: loss 0.18513. :  35%|████████████████                              | 78/224 [00:39<01:13,  2.00it/s]
Epoch 6 Iter 79: loss 0.18513. :  35%|████████████████▏                             | 79/224 [00:39<01:17,  1.88it/s]
Epoch 6 Iter 80: loss 0.17396. :  35%|████████████████▏                             | 79/224 [00:40<01:17,  1.88it/s]
Epoch 6 Iter 80: loss 0.17396. :  36%|████████████████▍                             | 80/224 [00:40<01:15,  1.90it/s]
Epoch 6 Iter 81: loss 0.18512. :  36%|████████████████▍                             | 80/224 [00:40<01:15,  1.90it/s]
Epoch 6 Iter 81: loss 0.18512. :  36%|████████████████▋                             | 81/224 [00:40<01:14,  1.92it/s]
Epoch 6 Iter 82: loss 0.18973. :  36%|████████████████▋                             | 81/224 [00:41<01:14,  1.92it/s]
Epoch 6 Iter 82: loss 0.18973. :  37%|████████████████▊                             | 82/224 [00:41<01:12,  1.95it/s]
Epoch 6 Iter 83: loss 0.19039. :  37%|████████████████▊                             | 82/224 [00:41<01:12,  1.95it/s]
Epoch 6 Iter 83: loss 0.19039. :  37%|█████████████████                             | 83/224 [00:41<01:11,  1.98it/s]
Epoch 6 Iter 84: loss 0.19760. :  37%|█████████████████                             | 83/224 [00:42<01:11,  1.98it/s]
Epoch 6 Iter 84: loss 0.19760. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 6 Iter 85: loss 0.19270. :  38%|█████████████████▎                            | 84/224 [00:42<01:10,  1.98it/s]
Epoch 6 Iter 85: loss 0.19270. :  38%|█████████████████▍                            | 85/224 [00:42<01:09,  1.99it/s]
Epoch 6 Iter 86: loss 0.18079. :  38%|█████████████████▍                            | 85/224 [00:43<01:09,  1.99it/s]
Epoch 6 Iter 86: loss 0.18079. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  2.00it/s]
Epoch 6 Iter 87: loss 0.17537. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  2.00it/s]
Epoch 6 Iter 87: loss 0.17537. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.01it/s]
Epoch 6 Iter 88: loss 0.17161. :  39%|█████████████████▊                            | 87/224 [00:44<01:07,  2.01it/s]
Epoch 6 Iter 88: loss 0.17161. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.02it/s]
Epoch 6 Iter 89: loss 0.18262. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.02it/s]
Epoch 6 Iter 89: loss 0.18262. :  40%|██████████████████▎                           | 89/224 [00:44<01:06,  2.02it/s]
Epoch 6 Iter 90: loss 0.18689. :  40%|██████████████████▎                           | 89/224 [00:45<01:06,  2.02it/s]
Epoch 6 Iter 90: loss 0.18689. :  40%|██████████████████▍                           | 90/224 [00:45<01:08,  1.95it/s]
Epoch 6 Iter 91: loss 0.17427. :  40%|██████████████████▍                           | 90/224 [00:45<01:08,  1.95it/s]
Epoch 6 Iter 91: loss 0.17427. :  41%|██████████████████▋                           | 91/224 [00:45<01:09,  1.90it/s]
Epoch 6 Iter 92: loss 0.17720. :  41%|██████████████████▋                           | 91/224 [00:46<01:09,  1.90it/s]
Epoch 6 Iter 92: loss 0.17720. :  41%|██████████████████▉                           | 92/224 [00:46<01:08,  1.92it/s]
Epoch 6 Iter 93: loss 0.17718. :  41%|██████████████████▉                           | 92/224 [00:46<01:08,  1.92it/s]
Epoch 6 Iter 93: loss 0.17718. :  42%|███████████████████                           | 93/224 [00:46<01:07,  1.94it/s]
Epoch 6 Iter 94: loss 0.17711. :  42%|███████████████████                           | 93/224 [00:47<01:07,  1.94it/s]
Epoch 6 Iter 94: loss 0.17711. :  42%|███████████████████▎                          | 94/224 [00:47<01:07,  1.92it/s]
Epoch 6 Iter 95: loss 0.17853. :  42%|███████████████████▎                          | 94/224 [00:47<01:07,  1.92it/s]
Epoch 6 Iter 95: loss 0.17853. :  42%|███████████████████▌                          | 95/224 [00:47<01:06,  1.94it/s]
Epoch 6 Iter 96: loss 0.20279. :  42%|███████████████████▌                          | 95/224 [00:48<01:06,  1.94it/s]
Epoch 6 Iter 96: loss 0.20279. :  43%|███████████████████▋                          | 96/224 [00:48<01:05,  1.96it/s]
Epoch 6 Iter 97: loss 0.16660. :  43%|███████████████████▋                          | 96/224 [00:48<01:05,  1.96it/s]
Epoch 6 Iter 97: loss 0.16660. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.97it/s]
Epoch 6 Iter 98: loss 0.18769. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.97it/s]
Epoch 6 Iter 98: loss 0.18769. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.96it/s]
Epoch 6 Iter 99: loss 0.18701. :  44%|████████████████████▏                         | 98/224 [00:49<01:04,  1.96it/s]
Epoch 6 Iter 99: loss 0.18701. :  44%|████████████████████▎                         | 99/224 [00:49<01:03,  1.96it/s]
Epoch 6 Iter 100: loss 0.17216. :  44%|███████████████████▉                         | 99/224 [00:50<01:03,  1.96it/s]
Epoch 6 Iter 100: loss 0.17216. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.96it/s]
Epoch 6 Iter 101: loss 0.18487. :  45%|███████████████████▋                        | 100/224 [00:50<01:03,  1.96it/s]
Epoch 6 Iter 101: loss 0.18487. :  45%|███████████████████▊                        | 101/224 [00:50<01:02,  1.96it/s]
Epoch 6 Iter 102: loss 0.19421. :  45%|███████████████████▊                        | 101/224 [00:51<01:02,  1.96it/s]
Epoch 6 Iter 102: loss 0.19421. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.97it/s]
Epoch 6 Iter 103: loss 0.18772. :  46%|████████████████████                        | 102/224 [00:51<01:01,  1.97it/s]
Epoch 6 Iter 103: loss 0.18772. :  46%|████████████████████▏                       | 103/224 [00:51<01:01,  1.97it/s]
Epoch 6 Iter 104: loss 0.17969. :  46%|████████████████████▏                       | 103/224 [00:52<01:01,  1.97it/s]
Epoch 6 Iter 104: loss 0.17969. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.97it/s]
Epoch 6 Iter 105: loss 0.17754. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.97it/s]
Epoch 6 Iter 105: loss 0.17754. :  47%|████████████████████▋                       | 105/224 [00:52<01:02,  1.90it/s]
Epoch 6 Iter 106: loss 0.18172. :  47%|████████████████████▋                       | 105/224 [00:53<01:02,  1.90it/s]
Epoch 6 Iter 106: loss 0.18172. :  47%|████████████████████▊                       | 106/224 [00:53<01:03,  1.87it/s]
Epoch 6 Iter 107: loss 0.18799. :  47%|████████████████████▊                       | 106/224 [00:53<01:03,  1.87it/s]
Epoch 6 Iter 107: loss 0.18799. :  48%|█████████████████████                       | 107/224 [00:53<01:02,  1.89it/s]
Epoch 6 Iter 108: loss 0.19982. :  48%|█████████████████████                       | 107/224 [00:54<01:02,  1.89it/s]
Epoch 6 Iter 108: loss 0.19982. :  48%|█████████████████████▏                      | 108/224 [00:54<01:00,  1.91it/s]
Epoch 6 Iter 109: loss 0.18349. :  48%|█████████████████████▏                      | 108/224 [00:54<01:00,  1.91it/s]
Epoch 6 Iter 109: loss 0.18349. :  49%|█████████████████████▍                      | 109/224 [00:54<00:59,  1.94it/s]
Epoch 6 Iter 110: loss 0.18025. :  49%|█████████████████████▍                      | 109/224 [00:55<00:59,  1.94it/s]
Epoch 6 Iter 110: loss 0.18025. :  49%|█████████████████████▌                      | 110/224 [00:55<00:58,  1.95it/s]
Epoch 6 Iter 111: loss 0.16618. :  49%|█████████████████████▌                      | 110/224 [00:55<00:58,  1.95it/s]
Epoch 6 Iter 111: loss 0.16618. :  50%|█████████████████████▊                      | 111/224 [00:55<00:57,  1.96it/s]
Epoch 6 Iter 112: loss 0.19190. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.96it/s]
Epoch 6 Iter 112: loss 0.19190. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.97it/s]
Epoch 6 Iter 113: loss 0.18655. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.97it/s]
Epoch 6 Iter 113: loss 0.18655. :  50%|██████████████████████▏                     | 113/224 [00:56<00:58,  1.89it/s]
Epoch 6 Iter 114: loss 0.18423. :  50%|██████████████████████▏                     | 113/224 [00:57<00:58,  1.89it/s]
Epoch 6 Iter 114: loss 0.18423. :  51%|██████████████████████▍                     | 114/224 [00:57<00:57,  1.92it/s]
Epoch 6 Iter 115: loss 0.19713. :  51%|██████████████████████▍                     | 114/224 [00:57<00:57,  1.92it/s]
Epoch 6 Iter 115: loss 0.19713. :  51%|██████████████████████▌                     | 115/224 [00:57<00:56,  1.94it/s]
Epoch 6 Iter 116: loss 0.18332. :  51%|██████████████████████▌                     | 115/224 [00:58<00:56,  1.94it/s]
Epoch 6 Iter 116: loss 0.18332. :  52%|██████████████████████▊                     | 116/224 [00:58<00:56,  1.91it/s]
Epoch 6 Iter 117: loss 0.18075. :  52%|██████████████████████▊                     | 116/224 [00:59<00:56,  1.91it/s]
Epoch 6 Iter 117: loss 0.18075. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.94it/s]
Epoch 6 Iter 118: loss 0.18418. :  52%|██████████████████████▉                     | 117/224 [00:59<00:55,  1.94it/s]
Epoch 6 Iter 118: loss 0.18418. :  53%|███████████████████████▏                    | 118/224 [00:59<00:54,  1.94it/s]
Epoch 6 Iter 119: loss 0.17554. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.94it/s]
Epoch 6 Iter 119: loss 0.17554. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.96it/s]
Epoch 6 Iter 120: loss 0.17564. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.96it/s]
Epoch 6 Iter 120: loss 0.17564. :  54%|███████████████████████▌                    | 120/224 [01:00<00:55,  1.89it/s]
Epoch 6 Iter 121: loss 0.17245. :  54%|███████████████████████▌                    | 120/224 [01:01<00:55,  1.89it/s]
Epoch 6 Iter 121: loss 0.17245. :  54%|███████████████████████▊                    | 121/224 [01:01<00:53,  1.92it/s]
Epoch 6 Iter 122: loss 0.18125. :  54%|███████████████████████▊                    | 121/224 [01:01<00:53,  1.92it/s]
Epoch 6 Iter 122: loss 0.18125. :  54%|███████████████████████▉                    | 122/224 [01:01<00:53,  1.92it/s]
Epoch 6 Iter 123: loss 0.18084. :  54%|███████████████████████▉                    | 122/224 [01:02<00:53,  1.92it/s]
Epoch 6 Iter 123: loss 0.18084. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.95it/s]
Epoch 6 Iter 124: loss 0.18942. :  55%|████████████████████████▏                   | 123/224 [01:02<00:51,  1.95it/s]
Epoch 6 Iter 124: loss 0.18942. :  55%|████████████████████████▎                   | 124/224 [01:02<00:51,  1.96it/s]
Epoch 6 Iter 125: loss 0.17317. :  55%|████████████████████████▎                   | 124/224 [01:03<00:51,  1.96it/s]
Epoch 6 Iter 125: loss 0.17317. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.97it/s]
Epoch 6 Iter 126: loss 0.18159. :  56%|████████████████████████▌                   | 125/224 [01:03<00:50,  1.97it/s]
Epoch 6 Iter 126: loss 0.18159. :  56%|████████████████████████▊                   | 126/224 [01:03<00:49,  1.97it/s]
Epoch 6 Iter 127: loss 0.18396. :  56%|████████████████████████▊                   | 126/224 [01:04<00:49,  1.97it/s]
Epoch 6 Iter 127: loss 0.18396. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  1.98it/s]
Epoch 6 Iter 128: loss 0.19422. :  57%|████████████████████████▉                   | 127/224 [01:04<00:48,  1.98it/s]
Epoch 6 Iter 128: loss 0.19422. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:49,  1.95it/s]
Epoch 6 Iter 129: loss 0.19333. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:49,  1.95it/s]
Epoch 6 Iter 129: loss 0.19333. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:49,  1.92it/s]
Epoch 6 Iter 130: loss 0.18130. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:49,  1.92it/s]
Epoch 6 Iter 130: loss 0.18130. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:48,  1.95it/s]
Epoch 6 Iter 131: loss 0.20395. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:48,  1.95it/s]
Epoch 6 Iter 131: loss 0.20395. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:47,  1.96it/s]
Epoch 6 Iter 132: loss 0.17383. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:47,  1.96it/s]
Epoch 6 Iter 132: loss 0.17383. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:46,  1.97it/s]
Epoch 6 Iter 133: loss 0.18471. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:46,  1.97it/s]
Epoch 6 Iter 133: loss 0.18471. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.97it/s]
Epoch 6 Iter 134: loss 0.18125. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:46,  1.97it/s]
Epoch 6 Iter 134: loss 0.18125. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.98it/s]
Epoch 6 Iter 135: loss 0.18068. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 6 Iter 135: loss 0.18068. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:46,  1.93it/s]
Epoch 6 Iter 136: loss 0.17024. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:46,  1.93it/s]
Epoch 6 Iter 136: loss 0.17024. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:46,  1.89it/s]
Epoch 6 Iter 137: loss 0.17143. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:46,  1.89it/s]
Epoch 6 Iter 137: loss 0.17143. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:45,  1.93it/s]
Epoch 6 Iter 138: loss 0.15272. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:45,  1.93it/s]
Epoch 6 Iter 138: loss 0.15272. :  62%|███████████████████████████                 | 138/224 [01:09<00:44,  1.95it/s]
Epoch 6 Iter 139: loss 0.21424. :  62%|███████████████████████████                 | 138/224 [01:10<00:44,  1.95it/s]
Epoch 6 Iter 139: loss 0.21424. :  62%|███████████████████████████▎                | 139/224 [01:10<00:43,  1.96it/s]
Epoch 6 Iter 140: loss 0.17931. :  62%|███████████████████████████▎                | 139/224 [01:10<00:43,  1.96it/s]
Epoch 6 Iter 140: loss 0.17931. :  62%|███████████████████████████▌                | 140/224 [01:10<00:42,  1.97it/s]
Epoch 6 Iter 141: loss 0.16380. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.97it/s]
Epoch 6 Iter 141: loss 0.16380. :  63%|███████████████████████████▋                | 141/224 [01:11<00:42,  1.97it/s]
Epoch 6 Iter 142: loss 0.19226. :  63%|███████████████████████████▋                | 141/224 [01:11<00:42,  1.97it/s]
Epoch 6 Iter 142: loss 0.19226. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  1.98it/s]
Epoch 6 Iter 143: loss 0.15181. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.98it/s]
Epoch 6 Iter 143: loss 0.15181. :  64%|████████████████████████████                | 143/224 [01:12<00:42,  1.89it/s]
Epoch 6 Iter 144: loss 0.19872. :  64%|████████████████████████████                | 143/224 [01:12<00:42,  1.89it/s]
Epoch 6 Iter 144: loss 0.19872. :  64%|████████████████████████████▎               | 144/224 [01:12<00:41,  1.92it/s]
Epoch 6 Iter 145: loss 0.16705. :  64%|████████████████████████████▎               | 144/224 [01:13<00:41,  1.92it/s]
Epoch 6 Iter 145: loss 0.16705. :  65%|████████████████████████████▍               | 145/224 [01:13<00:40,  1.94it/s]
Epoch 6 Iter 146: loss 0.17766. :  65%|████████████████████████████▍               | 145/224 [01:13<00:40,  1.94it/s]
Epoch 6 Iter 146: loss 0.17766. :  65%|████████████████████████████▋               | 146/224 [01:13<00:39,  1.97it/s]
Epoch 6 Iter 147: loss 0.18944. :  65%|████████████████████████████▋               | 146/224 [01:14<00:39,  1.97it/s]
Epoch 6 Iter 147: loss 0.18944. :  66%|████████████████████████████▉               | 147/224 [01:14<00:39,  1.97it/s]
Epoch 6 Iter 148: loss 0.17712. :  66%|████████████████████████████▉               | 147/224 [01:14<00:39,  1.97it/s]
Epoch 6 Iter 148: loss 0.17712. :  66%|█████████████████████████████               | 148/224 [01:14<00:38,  1.99it/s]
Epoch 6 Iter 149: loss 0.16913. :  66%|█████████████████████████████               | 148/224 [01:15<00:38,  1.99it/s]
Epoch 6 Iter 149: loss 0.16913. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  1.99it/s]
Epoch 6 Iter 150: loss 0.17858. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  1.99it/s]
Epoch 6 Iter 150: loss 0.17858. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.00it/s]
Epoch 6 Iter 151: loss 0.17401. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:36,  2.00it/s]
Epoch 6 Iter 151: loss 0.17401. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.00it/s]
Epoch 6 Iter 152: loss 0.18651. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:36,  2.00it/s]
Epoch 6 Iter 152: loss 0.18651. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.99it/s]
Epoch 6 Iter 153: loss 0.17987. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.99it/s]
Epoch 6 Iter 153: loss 0.17987. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.98it/s]
Epoch 6 Iter 154: loss 0.18609. :  68%|██████████████████████████████              | 153/224 [01:17<00:35,  1.98it/s]
Epoch 6 Iter 154: loss 0.18609. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:35,  1.99it/s]
Epoch 6 Iter 155: loss 0.18644. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  1.99it/s]
Epoch 6 Iter 155: loss 0.18644. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  1.99it/s]
Epoch 6 Iter 156: loss 0.17557. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  1.99it/s]
Epoch 6 Iter 156: loss 0.17557. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  1.99it/s]
Epoch 6 Iter 157: loss 0.15806. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:34,  1.99it/s]
Epoch 6 Iter 157: loss 0.15806. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.00it/s]
Epoch 6 Iter 158: loss 0.17705. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.00it/s]
Epoch 6 Iter 158: loss 0.17705. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  2.00it/s]
Epoch 6 Iter 159: loss 0.18794. :  71%|███████████████████████████████             | 158/224 [01:20<00:33,  2.00it/s]
Epoch 6 Iter 159: loss 0.18794. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.19735. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.00it/s]
Epoch 6 Iter 160: loss 0.19735. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:33,  1.94it/s]
Epoch 6 Iter 161: loss 0.18902. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:33,  1.94it/s]
Epoch 6 Iter 161: loss 0.18902. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.97it/s]
Epoch 6 Iter 162: loss 0.17678. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.97it/s]
Epoch 6 Iter 162: loss 0.17678. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:31,  1.96it/s]
Epoch 6 Iter 163: loss 0.16196. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.96it/s]
Epoch 6 Iter 163: loss 0.16196. :  73%|████████████████████████████████            | 163/224 [01:22<00:31,  1.91it/s]
Epoch 6 Iter 164: loss 0.18162. :  73%|████████████████████████████████            | 163/224 [01:23<00:31,  1.91it/s]
Epoch 6 Iter 164: loss 0.18162. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.95it/s]
Epoch 6 Iter 165: loss 0.17299. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.95it/s]
Epoch 6 Iter 165: loss 0.17299. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:30,  1.95it/s]
Epoch 6 Iter 166: loss 0.16691. :  74%|████████████████████████████████▍           | 165/224 [01:24<00:30,  1.95it/s]
Epoch 6 Iter 166: loss 0.16691. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.97it/s]
Epoch 6 Iter 167: loss 0.17277. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  1.97it/s]
Epoch 6 Iter 167: loss 0.17277. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  1.99it/s]
Epoch 6 Iter 168: loss 0.17651. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:28,  1.99it/s]
Epoch 6 Iter 168: loss 0.17651. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.99it/s]
Epoch 6 Iter 169: loss 0.17382. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.99it/s]
Epoch 6 Iter 169: loss 0.17382. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:27,  2.00it/s]
Epoch 6 Iter 170: loss 0.17119. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:27,  2.00it/s]
Epoch 6 Iter 170: loss 0.17119. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  2.00it/s]
Epoch 6 Iter 171: loss 0.18377. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  2.00it/s]
Epoch 6 Iter 171: loss 0.18377. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:26,  2.02it/s]
Epoch 6 Iter 172: loss 0.18953. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:26,  2.02it/s]
Epoch 6 Iter 172: loss 0.18953. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.01it/s]
Epoch 6 Iter 173: loss 0.18506. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:25,  2.01it/s]
Epoch 6 Iter 173: loss 0.18506. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:26,  1.93it/s]
Epoch 6 Iter 174: loss 0.18385. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:26,  1.93it/s]
Epoch 6 Iter 174: loss 0.18385. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.96it/s]
Epoch 6 Iter 175: loss 0.18934. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.96it/s]
Epoch 6 Iter 175: loss 0.18934. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:24,  1.98it/s]
Epoch 6 Iter 176: loss 0.19049. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:24,  1.98it/s]
Epoch 6 Iter 176: loss 0.19049. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.95it/s]
Epoch 6 Iter 177: loss 0.18708. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.95it/s]
Epoch 6 Iter 177: loss 0.18708. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:24,  1.96it/s]
Epoch 6 Iter 178: loss 0.18532. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:24,  1.96it/s]
Epoch 6 Iter 178: loss 0.18532. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.98it/s]
Epoch 6 Iter 179: loss 0.18266. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:23,  1.98it/s]
Epoch 6 Iter 179: loss 0.18266. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:22,  1.99it/s]
Epoch 6 Iter 180: loss 0.18058. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:22,  1.99it/s]
Epoch 6 Iter 180: loss 0.18058. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:23,  1.90it/s]
Epoch 6 Iter 181: loss 0.16627. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:23,  1.90it/s]
Epoch 6 Iter 181: loss 0.16627. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:22,  1.91it/s]
Epoch 6 Iter 182: loss 0.17456. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:22,  1.91it/s]
Epoch 6 Iter 182: loss 0.17456. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.93it/s]
Epoch 6 Iter 183: loss 0.19162. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.93it/s]
Epoch 6 Iter 183: loss 0.19162. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:21,  1.95it/s]
Epoch 6 Iter 184: loss 0.19013. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:21,  1.95it/s]
Epoch 6 Iter 184: loss 0.19013. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.95it/s]
Epoch 6 Iter 185: loss 0.19197. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.95it/s]
Epoch 6 Iter 185: loss 0.19197. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.96it/s]
Epoch 6 Iter 186: loss 0.17984. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  1.96it/s]
Epoch 6 Iter 186: loss 0.17984. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.97it/s]
Epoch 6 Iter 187: loss 0.18570. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.97it/s]
Epoch 6 Iter 187: loss 0.18570. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:19,  1.91it/s]
Epoch 6 Iter 188: loss 0.18940. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:19,  1.91it/s]
Epoch 6 Iter 188: loss 0.18940. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.91it/s]
Epoch 6 Iter 189: loss 0.18240. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.91it/s]
Epoch 6 Iter 189: loss 0.18240. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:18,  1.92it/s]
Epoch 6 Iter 190: loss 0.17407. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:18,  1.92it/s]
Epoch 6 Iter 190: loss 0.17407. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.94it/s]
Epoch 6 Iter 191: loss 0.18691. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.94it/s]
Epoch 6 Iter 191: loss 0.18691. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  1.94it/s]
Epoch 6 Iter 192: loss 0.17499. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.94it/s]
Epoch 6 Iter 192: loss 0.17499. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.97it/s]
Epoch 6 Iter 193: loss 0.20850. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.97it/s]
Epoch 6 Iter 193: loss 0.20850. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.96it/s]
Epoch 6 Iter 194: loss 0.17138. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.96it/s]
Epoch 6 Iter 194: loss 0.17138. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.96it/s]
Epoch 6 Iter 195: loss 0.15409. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.96it/s]
Epoch 6 Iter 195: loss 0.15409. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:15,  1.90it/s]
Epoch 6 Iter 196: loss 0.16416. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:15,  1.90it/s]
Epoch 6 Iter 196: loss 0.16416. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.92it/s]
Epoch 6 Iter 197: loss 0.17639. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.92it/s]
Epoch 6 Iter 197: loss 0.17639. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  1.94it/s]
Epoch 6 Iter 198: loss 0.19545. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.94it/s]
Epoch 6 Iter 198: loss 0.19545. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.96it/s]
Epoch 6 Iter 199: loss 0.16889. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  1.96it/s]
Epoch 6 Iter 199: loss 0.16889. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  1.94it/s]
Epoch 6 Iter 200: loss 0.18452. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  1.94it/s]
Epoch 6 Iter 200: loss 0.18452. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.95it/s]
Epoch 6 Iter 201: loss 0.17711. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:12,  1.95it/s]
Epoch 6 Iter 201: loss 0.17711. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.92it/s]
Epoch 6 Iter 202: loss 0.18226. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.92it/s]
Epoch 6 Iter 202: loss 0.18226. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  1.93it/s]
Epoch 6 Iter 203: loss 0.17245. :  90%|███████████████████████████████████████▋    | 202/224 [01:43<00:11,  1.93it/s]
Epoch 6 Iter 203: loss 0.17245. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:11,  1.86it/s]
Epoch 6 Iter 204: loss 0.20080. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:11,  1.86it/s]
Epoch 6 Iter 204: loss 0.20080. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.87it/s]
Epoch 6 Iter 205: loss 0.18139. :  91%|████████████████████████████████████████    | 204/224 [01:44<00:10,  1.87it/s]
Epoch 6 Iter 205: loss 0.18139. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:10,  1.89it/s]
Epoch 6 Iter 206: loss 0.17951. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:10,  1.89it/s]
Epoch 6 Iter 206: loss 0.17951. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  1.91it/s]
Epoch 6 Iter 207: loss 0.16171. :  92%|████████████████████████████████████████▍   | 206/224 [01:45<00:09,  1.91it/s]
Epoch 6 Iter 207: loss 0.16171. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  1.93it/s]
Epoch 6 Iter 208: loss 0.16437. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  1.93it/s]
Epoch 6 Iter 208: loss 0.16437. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:08,  1.94it/s]
Epoch 6 Iter 209: loss 0.18204. :  93%|████████████████████████████████████████▊   | 208/224 [01:46<00:08,  1.94it/s]
Epoch 6 Iter 209: loss 0.18204. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  1.96it/s]
Epoch 6 Iter 210: loss 0.19960. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  1.96it/s]
Epoch 6 Iter 210: loss 0.19960. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:07,  1.95it/s]
Epoch 6 Iter 211: loss 0.17037. :  94%|█████████████████████████████████████████▎  | 210/224 [01:47<00:07,  1.95it/s]
Epoch 6 Iter 211: loss 0.17037. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  1.96it/s]
Epoch 6 Iter 212: loss 0.16830. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  1.96it/s]
Epoch 6 Iter 212: loss 0.16830. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:06,  1.97it/s]
Epoch 6 Iter 213: loss 0.17537. :  95%|█████████████████████████████████████████▋  | 212/224 [01:48<00:06,  1.97it/s]
Epoch 6 Iter 213: loss 0.17537. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  1.97it/s]
Epoch 6 Iter 214: loss 0.19021. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  1.97it/s]
Epoch 6 Iter 214: loss 0.19021. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:05,  1.94it/s]
Epoch 6 Iter 215: loss 0.18830. :  96%|██████████████████████████████████████████  | 214/224 [01:49<00:05,  1.94it/s]
Epoch 6 Iter 215: loss 0.18830. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.96it/s]
Epoch 6 Iter 216: loss 0.17601. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  1.96it/s]
Epoch 6 Iter 216: loss 0.17601. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:04,  1.96it/s]
Epoch 6 Iter 217: loss 0.19234. :  96%|██████████████████████████████████████████▍ | 216/224 [01:50<00:04,  1.96it/s]
Epoch 6 Iter 217: loss 0.19234. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.98it/s]
Epoch 6 Iter 218: loss 0.17291. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  1.98it/s]
Epoch 6 Iter 218: loss 0.17291. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:03,  1.96it/s]
Epoch 6 Iter 219: loss 0.18109. :  97%|██████████████████████████████████████████▊ | 218/224 [01:51<00:03,  1.96it/s]
Epoch 6 Iter 219: loss 0.18109. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.97it/s]
Epoch 6 Iter 220: loss 0.19863. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  1.97it/s]
Epoch 6 Iter 220: loss 0.19863. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:02,  1.98it/s]
Epoch 6 Iter 221: loss 0.17692. :  98%|███████████████████████████████████████████▏| 220/224 [01:52<00:02,  1.98it/s]
Epoch 6 Iter 221: loss 0.17692. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.98it/s]
Epoch 6 Iter 222: loss 0.17955. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  1.98it/s]
Epoch 6 Iter 222: loss 0.17955. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:01,  1.98it/s]
Epoch 6 Iter 223: loss 0.19435. :  99%|███████████████████████████████████████████▌| 222/224 [01:53<00:01,  1.98it/s]
Epoch 6 Iter 223: loss 0.19435. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.98it/s]
Epoch 6 Iter 224: loss 0.18873. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  1.98it/s]
Epoch 6 Iter 224: loss 0.18873. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]
Epoch 6 Iter 224: loss 0.18873. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.97it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.17429. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 7 Iter 1: loss 0.17429. :   0%|▏                                               | 1/224 [00:00<01:50,  2.02it/s]
Epoch 7 Iter 2: loss 0.17993. :   0%|▏                                               | 1/224 [00:00<01:50,  2.02it/s]
Epoch 7 Iter 2: loss 0.17993. :   1%|▍                                               | 2/224 [00:00<01:50,  2.01it/s]
Epoch 7 Iter 3: loss 0.19108. :   1%|▍                                               | 2/224 [00:01<01:50,  2.01it/s]
Epoch 7 Iter 3: loss 0.19108. :   1%|▋                                               | 3/224 [00:01<01:55,  1.91it/s]
Epoch 7 Iter 4: loss 0.19428. :   1%|▋                                               | 3/224 [00:02<01:55,  1.91it/s]
Epoch 7 Iter 4: loss 0.19428. :   2%|▊                                               | 4/224 [00:02<01:53,  1.93it/s]
Epoch 7 Iter 5: loss 0.18663. :   2%|▊                                               | 4/224 [00:02<01:53,  1.93it/s]
Epoch 7 Iter 5: loss 0.18663. :   2%|█                                               | 5/224 [00:02<01:55,  1.90it/s]
Epoch 7 Iter 6: loss 0.18041. :   2%|█                                               | 5/224 [00:03<01:55,  1.90it/s]
Epoch 7 Iter 6: loss 0.18041. :   3%|█▎                                              | 6/224 [00:03<01:52,  1.95it/s]
Epoch 7 Iter 7: loss 0.17964. :   3%|█▎                                              | 6/224 [00:03<01:52,  1.95it/s]
Epoch 7 Iter 7: loss 0.17964. :   3%|█▌                                              | 7/224 [00:03<01:50,  1.96it/s]
Epoch 7 Iter 8: loss 0.19154. :   3%|█▌                                              | 7/224 [00:04<01:50,  1.96it/s]
Epoch 7 Iter 8: loss 0.19154. :   4%|█▋                                              | 8/224 [00:04<01:50,  1.96it/s]
Epoch 7 Iter 9: loss 0.17127. :   4%|█▋                                              | 8/224 [00:04<01:50,  1.96it/s]
Epoch 7 Iter 9: loss 0.17127. :   4%|█▉                                              | 9/224 [00:04<01:48,  1.97it/s]
Epoch 7 Iter 10: loss 0.19643. :   4%|█▉                                             | 9/224 [00:05<01:48,  1.97it/s]
Epoch 7 Iter 10: loss 0.19643. :   4%|██                                            | 10/224 [00:05<01:48,  1.96it/s]
Epoch 7 Iter 11: loss 0.20345. :   4%|██                                            | 10/224 [00:05<01:48,  1.96it/s]
Epoch 7 Iter 11: loss 0.20345. :   5%|██▎                                           | 11/224 [00:05<01:49,  1.94it/s]
Epoch 7 Iter 12: loss 0.17367. :   5%|██▎                                           | 11/224 [00:06<01:49,  1.94it/s]
Epoch 7 Iter 12: loss 0.17367. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.95it/s]
Epoch 7 Iter 13: loss 0.17599. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.95it/s]
Epoch 7 Iter 13: loss 0.17599. :   6%|██▋                                           | 13/224 [00:06<01:47,  1.96it/s]
Epoch 7 Iter 14: loss 0.16631. :   6%|██▋                                           | 13/224 [00:07<01:47,  1.96it/s]
Epoch 7 Iter 14: loss 0.16631. :   6%|██▉                                           | 14/224 [00:07<01:48,  1.93it/s]
Epoch 7 Iter 15: loss 0.18541. :   6%|██▉                                           | 14/224 [00:07<01:48,  1.93it/s]
Epoch 7 Iter 15: loss 0.18541. :   7%|███                                           | 15/224 [00:07<01:46,  1.96it/s]
Epoch 7 Iter 16: loss 0.17446. :   7%|███                                           | 15/224 [00:08<01:46,  1.96it/s]
Epoch 7 Iter 16: loss 0.17446. :   7%|███▎                                          | 16/224 [00:08<01:45,  1.97it/s]
Epoch 7 Iter 17: loss 0.16777. :   7%|███▎                                          | 16/224 [00:08<01:45,  1.97it/s]
Epoch 7 Iter 17: loss 0.16777. :   8%|███▍                                          | 17/224 [00:08<01:44,  1.98it/s]
Epoch 7 Iter 18: loss 0.18126. :   8%|███▍                                          | 17/224 [00:09<01:44,  1.98it/s]
Epoch 7 Iter 18: loss 0.18126. :   8%|███▋                                          | 18/224 [00:09<01:46,  1.93it/s]
Epoch 7 Iter 19: loss 0.16495. :   8%|███▋                                          | 18/224 [00:09<01:46,  1.93it/s]
Epoch 7 Iter 19: loss 0.16495. :   8%|███▉                                          | 19/224 [00:09<01:45,  1.95it/s]
Epoch 7 Iter 20: loss 0.15833. :   8%|███▉                                          | 19/224 [00:10<01:45,  1.95it/s]
Epoch 7 Iter 20: loss 0.15833. :   9%|████                                          | 20/224 [00:10<01:43,  1.96it/s]
Epoch 7 Iter 21: loss 0.20120. :   9%|████                                          | 20/224 [00:10<01:43,  1.96it/s]
Epoch 7 Iter 21: loss 0.20120. :   9%|████▎                                         | 21/224 [00:10<01:43,  1.96it/s]
Epoch 7 Iter 22: loss 0.19134. :   9%|████▎                                         | 21/224 [00:11<01:43,  1.96it/s]
Epoch 7 Iter 22: loss 0.19134. :  10%|████▌                                         | 22/224 [00:11<01:43,  1.95it/s]
Epoch 7 Iter 23: loss 0.19738. :  10%|████▌                                         | 22/224 [00:11<01:43,  1.95it/s]
Epoch 7 Iter 23: loss 0.19738. :  10%|████▋                                         | 23/224 [00:11<01:42,  1.97it/s]
Epoch 7 Iter 24: loss 0.18247. :  10%|████▋                                         | 23/224 [00:12<01:42,  1.97it/s]
Epoch 7 Iter 24: loss 0.18247. :  11%|████▉                                         | 24/224 [00:12<01:41,  1.97it/s]
Epoch 7 Iter 25: loss 0.18588. :  11%|████▉                                         | 24/224 [00:12<01:41,  1.97it/s]
Epoch 7 Iter 25: loss 0.18588. :  11%|█████▏                                        | 25/224 [00:12<01:40,  1.98it/s]
Epoch 7 Iter 26: loss 0.16597. :  11%|█████▏                                        | 25/224 [00:13<01:40,  1.98it/s]
Epoch 7 Iter 26: loss 0.16597. :  12%|█████▎                                        | 26/224 [00:13<01:43,  1.91it/s]
Epoch 7 Iter 27: loss 0.17491. :  12%|█████▎                                        | 26/224 [00:13<01:43,  1.91it/s]
Epoch 7 Iter 27: loss 0.17491. :  12%|█████▌                                        | 27/224 [00:13<01:41,  1.94it/s]
Epoch 7 Iter 28: loss 0.18639. :  12%|█████▌                                        | 27/224 [00:14<01:41,  1.94it/s]
Epoch 7 Iter 28: loss 0.18639. :  12%|█████▊                                        | 28/224 [00:14<01:39,  1.96it/s]
Epoch 7 Iter 29: loss 0.18628. :  12%|█████▊                                        | 28/224 [00:14<01:39,  1.96it/s]
Epoch 7 Iter 29: loss 0.18628. :  13%|█████▉                                        | 29/224 [00:14<01:39,  1.97it/s]
Epoch 7 Iter 30: loss 0.17809. :  13%|█████▉                                        | 29/224 [00:15<01:39,  1.97it/s]
Epoch 7 Iter 30: loss 0.17809. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 7 Iter 31: loss 0.19594. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 7 Iter 31: loss 0.19594. :  14%|██████▎                                       | 31/224 [00:15<01:37,  1.97it/s]
Epoch 7 Iter 32: loss 0.17956. :  14%|██████▎                                       | 31/224 [00:16<01:37,  1.97it/s]
Epoch 7 Iter 32: loss 0.17956. :  14%|██████▌                                       | 32/224 [00:16<01:37,  1.98it/s]
Epoch 7 Iter 33: loss 0.18475. :  14%|██████▌                                       | 32/224 [00:16<01:37,  1.98it/s]
Epoch 7 Iter 33: loss 0.18475. :  15%|██████▊                                       | 33/224 [00:16<01:35,  1.99it/s]
Epoch 7 Iter 34: loss 0.17353. :  15%|██████▊                                       | 33/224 [00:17<01:35,  1.99it/s]
Epoch 7 Iter 34: loss 0.17353. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 7 Iter 35: loss 0.18799. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 7 Iter 35: loss 0.18799. :  16%|███████▏                                      | 35/224 [00:17<01:35,  1.98it/s]
Epoch 7 Iter 36: loss 0.17285. :  16%|███████▏                                      | 35/224 [00:18<01:35,  1.98it/s]
Epoch 7 Iter 36: loss 0.17285. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.99it/s]
Epoch 7 Iter 37: loss 0.19054. :  16%|███████▍                                      | 36/224 [00:18<01:34,  1.99it/s]
Epoch 7 Iter 37: loss 0.19054. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.98it/s]
Epoch 7 Iter 38: loss 0.17465. :  17%|███████▌                                      | 37/224 [00:19<01:34,  1.98it/s]
Epoch 7 Iter 38: loss 0.17465. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.98it/s]
Epoch 7 Iter 39: loss 0.18304. :  17%|███████▊                                      | 38/224 [00:19<01:34,  1.98it/s]
Epoch 7 Iter 39: loss 0.18304. :  17%|████████                                      | 39/224 [00:19<01:33,  1.99it/s]
Epoch 7 Iter 40: loss 0.17577. :  17%|████████                                      | 39/224 [00:20<01:33,  1.99it/s]
Epoch 7 Iter 40: loss 0.17577. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.98it/s]
Epoch 7 Iter 41: loss 0.16370. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.98it/s]
Epoch 7 Iter 41: loss 0.16370. :  18%|████████▍                                     | 41/224 [00:20<01:35,  1.92it/s]
Epoch 7 Iter 42: loss 0.16968. :  18%|████████▍                                     | 41/224 [00:21<01:35,  1.92it/s]
Epoch 7 Iter 42: loss 0.16968. :  19%|████████▋                                     | 42/224 [00:21<01:34,  1.93it/s]
Epoch 7 Iter 43: loss 0.18751. :  19%|████████▋                                     | 42/224 [00:21<01:34,  1.93it/s]
Epoch 7 Iter 43: loss 0.18751. :  19%|████████▊                                     | 43/224 [00:21<01:32,  1.95it/s]
Epoch 7 Iter 44: loss 0.16788. :  19%|████████▊                                     | 43/224 [00:22<01:32,  1.95it/s]
Epoch 7 Iter 44: loss 0.16788. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.97it/s]
Epoch 7 Iter 45: loss 0.17462. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.97it/s]
Epoch 7 Iter 45: loss 0.17462. :  20%|█████████▏                                    | 45/224 [00:22<01:32,  1.93it/s]
Epoch 7 Iter 46: loss 0.17637. :  20%|█████████▏                                    | 45/224 [00:23<01:32,  1.93it/s]
Epoch 7 Iter 46: loss 0.17637. :  21%|█████████▍                                    | 46/224 [00:23<01:31,  1.94it/s]
Epoch 7 Iter 47: loss 0.17208. :  21%|█████████▍                                    | 46/224 [00:23<01:31,  1.94it/s]
Epoch 7 Iter 47: loss 0.17208. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 7 Iter 48: loss 0.17521. :  21%|█████████▋                                    | 47/224 [00:24<01:31,  1.94it/s]
Epoch 7 Iter 48: loss 0.17521. :  21%|█████████▊                                    | 48/224 [00:24<01:31,  1.93it/s]
Epoch 7 Iter 49: loss 0.16245. :  21%|█████████▊                                    | 48/224 [00:25<01:31,  1.93it/s]
Epoch 7 Iter 49: loss 0.16245. :  22%|██████████                                    | 49/224 [00:25<01:29,  1.95it/s]
Epoch 7 Iter 50: loss 0.17450. :  22%|██████████                                    | 49/224 [00:25<01:29,  1.95it/s]
Epoch 7 Iter 50: loss 0.17450. :  22%|██████████▎                                   | 50/224 [00:25<01:28,  1.96it/s]
Epoch 7 Iter 51: loss 0.17771. :  22%|██████████▎                                   | 50/224 [00:26<01:28,  1.96it/s]
Epoch 7 Iter 51: loss 0.17771. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.97it/s]
Epoch 7 Iter 52: loss 0.17311. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.97it/s]
Epoch 7 Iter 52: loss 0.17311. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  2.00it/s]
Epoch 7 Iter 53: loss 0.20843. :  23%|██████████▋                                   | 52/224 [00:27<01:26,  2.00it/s]
Epoch 7 Iter 53: loss 0.20843. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  2.00it/s]
Epoch 7 Iter 54: loss 0.18941. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  2.00it/s]
Epoch 7 Iter 54: loss 0.18941. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 7 Iter 55: loss 0.20425. :  24%|███████████                                   | 54/224 [00:28<01:24,  2.01it/s]
Epoch 7 Iter 55: loss 0.20425. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  2.01it/s]
Epoch 7 Iter 56: loss 0.18751. :  25%|███████████▎                                  | 55/224 [00:28<01:24,  2.01it/s]
Epoch 7 Iter 56: loss 0.18751. :  25%|███████████▌                                  | 56/224 [00:28<01:27,  1.91it/s]
Epoch 7 Iter 57: loss 0.18980. :  25%|███████████▌                                  | 56/224 [00:29<01:27,  1.91it/s]
Epoch 7 Iter 57: loss 0.18980. :  25%|███████████▋                                  | 57/224 [00:29<01:26,  1.92it/s]
Epoch 7 Iter 58: loss 0.17531. :  25%|███████████▋                                  | 57/224 [00:29<01:26,  1.92it/s]
Epoch 7 Iter 58: loss 0.17531. :  26%|███████████▉                                  | 58/224 [00:29<01:25,  1.94it/s]
Epoch 7 Iter 59: loss 0.16814. :  26%|███████████▉                                  | 58/224 [00:30<01:25,  1.94it/s]
Epoch 7 Iter 59: loss 0.16814. :  26%|████████████                                  | 59/224 [00:30<01:24,  1.96it/s]
Epoch 7 Iter 60: loss 0.16751. :  26%|████████████                                  | 59/224 [00:30<01:24,  1.96it/s]
Epoch 7 Iter 60: loss 0.16751. :  27%|████████████▎                                 | 60/224 [00:30<01:23,  1.97it/s]
Epoch 7 Iter 61: loss 0.19148. :  27%|████████████▎                                 | 60/224 [00:31<01:23,  1.97it/s]
Epoch 7 Iter 61: loss 0.19148. :  27%|████████████▌                                 | 61/224 [00:31<01:22,  1.98it/s]
Epoch 7 Iter 62: loss 0.16826. :  27%|████████████▌                                 | 61/224 [00:31<01:22,  1.98it/s]
Epoch 7 Iter 62: loss 0.16826. :  28%|████████████▋                                 | 62/224 [00:31<01:21,  1.99it/s]
Epoch 7 Iter 63: loss 0.20678. :  28%|████████████▋                                 | 62/224 [00:32<01:21,  1.99it/s]
Epoch 7 Iter 63: loss 0.20678. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.97it/s]
Epoch 7 Iter 64: loss 0.16725. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.97it/s]
Epoch 7 Iter 64: loss 0.16725. :  29%|█████████████▏                                | 64/224 [00:32<01:21,  1.96it/s]
Epoch 7 Iter 65: loss 0.17690. :  29%|█████████████▏                                | 64/224 [00:33<01:21,  1.96it/s]
Epoch 7 Iter 65: loss 0.17690. :  29%|█████████████▎                                | 65/224 [00:33<01:20,  1.96it/s]
Epoch 7 Iter 66: loss 0.17443. :  29%|█████████████▎                                | 65/224 [00:33<01:20,  1.96it/s]
Epoch 7 Iter 66: loss 0.17443. :  29%|█████████████▌                                | 66/224 [00:33<01:20,  1.97it/s]
Epoch 7 Iter 67: loss 0.19115. :  29%|█████████████▌                                | 66/224 [00:34<01:20,  1.97it/s]
Epoch 7 Iter 67: loss 0.19115. :  30%|█████████████▊                                | 67/224 [00:34<01:21,  1.93it/s]
Epoch 7 Iter 68: loss 0.18595. :  30%|█████████████▊                                | 67/224 [00:34<01:21,  1.93it/s]
Epoch 7 Iter 68: loss 0.18595. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.96it/s]
Epoch 7 Iter 69: loss 0.18375. :  30%|█████████████▉                                | 68/224 [00:35<01:19,  1.96it/s]
Epoch 7 Iter 69: loss 0.18375. :  31%|██████████████▏                               | 69/224 [00:35<01:19,  1.96it/s]
Epoch 7 Iter 70: loss 0.17547. :  31%|██████████████▏                               | 69/224 [00:35<01:19,  1.96it/s]
Epoch 7 Iter 70: loss 0.17547. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.94it/s]
Epoch 7 Iter 71: loss 0.17979. :  31%|██████████████▍                               | 70/224 [00:36<01:19,  1.94it/s]
Epoch 7 Iter 71: loss 0.17979. :  32%|██████████████▌                               | 71/224 [00:36<01:20,  1.90it/s]
Epoch 7 Iter 72: loss 0.18958. :  32%|██████████████▌                               | 71/224 [00:36<01:20,  1.90it/s]
Epoch 7 Iter 72: loss 0.18958. :  32%|██████████████▊                               | 72/224 [00:36<01:24,  1.79it/s]
Epoch 7 Iter 73: loss 0.19176. :  32%|██████████████▊                               | 72/224 [00:38<01:24,  1.79it/s]
Epoch 7 Iter 73: loss 0.19176. :  33%|██████████████▉                               | 73/224 [00:38<02:07,  1.19it/s]
Epoch 7 Iter 74: loss 0.19556. :  33%|██████████████▉                               | 73/224 [00:39<02:07,  1.19it/s]
Epoch 7 Iter 74: loss 0.19556. :  33%|███████████████▏                              | 74/224 [00:39<02:28,  1.01it/s]
Epoch 7 Iter 75: loss 0.14830. :  33%|███████████████▏                              | 74/224 [00:40<02:28,  1.01it/s]
Epoch 7 Iter 75: loss 0.14830. :  33%|███████████████▍                              | 75/224 [00:40<02:35,  1.04s/it]
Epoch 7 Iter 76: loss 0.19000. :  33%|███████████████▍                              | 75/224 [00:41<02:35,  1.04s/it]
Epoch 7 Iter 76: loss 0.19000. :  34%|███████████████▌                              | 76/224 [00:41<02:29,  1.01s/it]
Epoch 7 Iter 77: loss 0.17906. :  34%|███████████████▌                              | 76/224 [00:43<02:29,  1.01s/it]
Epoch 7 Iter 77: loss 0.17906. :  34%|███████████████▊                              | 77/224 [00:43<02:37,  1.07s/it]
Epoch 7 Iter 78: loss 0.16552. :  34%|███████████████▊                              | 77/224 [00:44<02:37,  1.07s/it]
Epoch 7 Iter 78: loss 0.16552. :  35%|████████████████                              | 78/224 [00:44<02:34,  1.06s/it]
Epoch 7 Iter 79: loss 0.18177. :  35%|████████████████                              | 78/224 [00:45<02:34,  1.06s/it]
Epoch 7 Iter 79: loss 0.18177. :  35%|████████████████▏                             | 79/224 [00:45<02:51,  1.19s/it]
Epoch 7 Iter 80: loss 0.17559. :  35%|████████████████▏                             | 79/224 [00:47<02:51,  1.19s/it]
Epoch 7 Iter 80: loss 0.17559. :  36%|████████████████▍                             | 80/224 [00:47<03:11,  1.33s/it]
Epoch 7 Iter 81: loss 0.15152. :  36%|████████████████▍                             | 80/224 [00:48<03:11,  1.33s/it]
Epoch 7 Iter 81: loss 0.15152. :  36%|████████████████▋                             | 81/224 [00:48<02:57,  1.24s/it]
Epoch 7 Iter 82: loss 0.18141. :  36%|████████████████▋                             | 81/224 [00:49<02:57,  1.24s/it]
Epoch 7 Iter 82: loss 0.18141. :  37%|████████████████▊                             | 82/224 [00:49<03:04,  1.30s/it]
Epoch 7 Iter 83: loss 0.16592. :  37%|████████████████▊                             | 82/224 [00:50<03:04,  1.30s/it]
Epoch 7 Iter 83: loss 0.16592. :  37%|█████████████████                             | 83/224 [00:50<03:00,  1.28s/it]
Epoch 7 Iter 84: loss 0.19392. :  37%|█████████████████                             | 83/224 [00:51<03:00,  1.28s/it]
Epoch 7 Iter 84: loss 0.19392. :  38%|█████████████████▎                            | 84/224 [00:51<02:39,  1.14s/it]
Epoch 7 Iter 85: loss 0.18044. :  38%|█████████████████▎                            | 84/224 [00:52<02:39,  1.14s/it]
Epoch 7 Iter 85: loss 0.18044. :  38%|█████████████████▍                            | 85/224 [00:52<02:14,  1.03it/s]
Epoch 7 Iter 86: loss 0.16553. :  38%|█████████████████▍                            | 85/224 [00:53<02:14,  1.03it/s]
Epoch 7 Iter 86: loss 0.16553. :  38%|█████████████████▋                            | 86/224 [00:53<02:10,  1.06it/s]
Epoch 7 Iter 87: loss 0.16272. :  38%|█████████████████▋                            | 86/224 [00:54<02:10,  1.06it/s]
Epoch 7 Iter 87: loss 0.16272. :  39%|█████████████████▊                            | 87/224 [00:54<02:19,  1.02s/it]
Epoch 7 Iter 88: loss 0.18225. :  39%|█████████████████▊                            | 87/224 [00:55<02:19,  1.02s/it]
Epoch 7 Iter 88: loss 0.18225. :  39%|██████████████████                            | 88/224 [00:55<02:22,  1.05s/it]
Epoch 7 Iter 89: loss 0.18029. :  39%|██████████████████                            | 88/224 [00:56<02:22,  1.05s/it]
Epoch 7 Iter 89: loss 0.18029. :  40%|██████████████████▎                           | 89/224 [00:56<02:26,  1.08s/it]
Epoch 7 Iter 90: loss 0.17601. :  40%|██████████████████▎                           | 89/224 [00:57<02:26,  1.08s/it]
Epoch 7 Iter 90: loss 0.17601. :  40%|██████████████████▍                           | 90/224 [00:57<02:26,  1.09s/it]
Epoch 7 Iter 91: loss 0.17570. :  40%|██████████████████▍                           | 90/224 [00:58<02:26,  1.09s/it]
Epoch 7 Iter 91: loss 0.17570. :  41%|██████████████████▋                           | 91/224 [00:58<02:17,  1.03s/it]
Epoch 7 Iter 92: loss 0.17918. :  41%|██████████████████▋                           | 91/224 [00:59<02:17,  1.03s/it]
Epoch 7 Iter 92: loss 0.17918. :  41%|██████████████████▉                           | 92/224 [00:59<02:25,  1.10s/it]
Epoch 7 Iter 93: loss 0.17252. :  41%|██████████████████▉                           | 92/224 [01:00<02:25,  1.10s/it]
Epoch 7 Iter 93: loss 0.17252. :  42%|███████████████████                           | 93/224 [01:00<02:14,  1.03s/it]
Epoch 7 Iter 94: loss 0.18041. :  42%|███████████████████                           | 93/224 [01:02<02:14,  1.03s/it]
Epoch 7 Iter 94: loss 0.18041. :  42%|███████████████████▎                          | 94/224 [01:02<02:38,  1.22s/it]
Epoch 7 Iter 95: loss 0.18111. :  42%|███████████████████▎                          | 94/224 [01:03<02:38,  1.22s/it]
Epoch 7 Iter 95: loss 0.18111. :  42%|███████████████████▌                          | 95/224 [01:03<02:35,  1.20s/it]
Epoch 7 Iter 96: loss 0.15931. :  42%|███████████████████▌                          | 95/224 [01:04<02:35,  1.20s/it]
Epoch 7 Iter 96: loss 0.15931. :  43%|███████████████████▋                          | 96/224 [01:04<02:35,  1.21s/it]
Epoch 7 Iter 97: loss 0.18600. :  43%|███████████████████▋                          | 96/224 [01:05<02:35,  1.21s/it]
Epoch 7 Iter 97: loss 0.18600. :  43%|███████████████████▉                          | 97/224 [01:05<02:08,  1.01s/it]
Epoch 7 Iter 98: loss 0.19541. :  43%|███████████████████▉                          | 97/224 [01:06<02:08,  1.01s/it]
Epoch 7 Iter 98: loss 0.19541. :  44%|████████████████████▏                         | 98/224 [01:06<01:53,  1.11it/s]
Epoch 7 Iter 99: loss 0.17530. :  44%|████████████████████▏                         | 98/224 [01:07<01:53,  1.11it/s]
Epoch 7 Iter 99: loss 0.17530. :  44%|████████████████████▎                         | 99/224 [01:07<02:03,  1.01it/s]
Epoch 7 Iter 100: loss 0.17253. :  44%|███████████████████▉                         | 99/224 [01:08<02:03,  1.01it/s]
Epoch 7 Iter 100: loss 0.17253. :  45%|███████████████████▋                        | 100/224 [01:08<02:27,  1.19s/it]
Epoch 7 Iter 101: loss 0.16952. :  45%|███████████████████▋                        | 100/224 [01:10<02:27,  1.19s/it]
Epoch 7 Iter 101: loss 0.16952. :  45%|███████████████████▊                        | 101/224 [01:10<02:44,  1.34s/it]
Epoch 7 Iter 102: loss 0.19833. :  45%|███████████████████▊                        | 101/224 [01:12<02:44,  1.34s/it]
Epoch 7 Iter 102: loss 0.19833. :  46%|████████████████████                        | 102/224 [01:12<03:02,  1.49s/it]
Epoch 7 Iter 103: loss 0.17047. :  46%|████████████████████                        | 102/224 [01:13<03:02,  1.49s/it]
Epoch 7 Iter 103: loss 0.17047. :  46%|████████████████████▏                       | 103/224 [01:13<02:59,  1.48s/it]
Epoch 7 Iter 104: loss 0.18342. :  46%|████████████████████▏                       | 103/224 [01:15<02:59,  1.48s/it]
Epoch 7 Iter 104: loss 0.18342. :  46%|████████████████████▍                       | 104/224 [01:15<02:57,  1.48s/it]
Epoch 7 Iter 105: loss 0.19053. :  46%|████████████████████▍                       | 104/224 [01:16<02:57,  1.48s/it]
Epoch 7 Iter 105: loss 0.19053. :  47%|████████████████████▋                       | 105/224 [01:16<02:47,  1.41s/it]
Epoch 7 Iter 106: loss 0.18723. :  47%|████████████████████▋                       | 105/224 [01:18<02:47,  1.41s/it]
Epoch 7 Iter 106: loss 0.18723. :  47%|████████████████████▊                       | 106/224 [01:18<02:47,  1.42s/it]
Epoch 7 Iter 107: loss 0.19854. :  47%|████████████████████▊                       | 106/224 [01:19<02:47,  1.42s/it]
Epoch 7 Iter 107: loss 0.19854. :  48%|█████████████████████                       | 107/224 [01:19<02:34,  1.32s/it]
Epoch 7 Iter 108: loss 0.19193. :  48%|█████████████████████                       | 107/224 [01:20<02:34,  1.32s/it]
Epoch 7 Iter 108: loss 0.19193. :  48%|█████████████████████▏                      | 108/224 [01:20<02:17,  1.19s/it]
Epoch 7 Iter 109: loss 0.18859. :  48%|█████████████████████▏                      | 108/224 [01:21<02:17,  1.19s/it]
Epoch 7 Iter 109: loss 0.18859. :  49%|█████████████████████▍                      | 109/224 [01:21<02:25,  1.27s/it]
Epoch 7 Iter 110: loss 0.17233. :  49%|█████████████████████▍                      | 109/224 [01:22<02:25,  1.27s/it]
Epoch 7 Iter 110: loss 0.17233. :  49%|█████████████████████▌                      | 110/224 [01:22<02:16,  1.20s/it]
Epoch 7 Iter 111: loss 0.19888. :  49%|█████████████████████▌                      | 110/224 [01:23<02:16,  1.20s/it]
Epoch 7 Iter 111: loss 0.19888. :  50%|█████████████████████▊                      | 111/224 [01:23<02:00,  1.07s/it]
Epoch 7 Iter 112: loss 0.17614. :  50%|█████████████████████▊                      | 111/224 [01:23<02:00,  1.07s/it]
Epoch 7 Iter 112: loss 0.17614. :  50%|██████████████████████                      | 112/224 [01:23<01:43,  1.09it/s]
Epoch 7 Iter 113: loss 0.15557. :  50%|██████████████████████                      | 112/224 [01:24<01:43,  1.09it/s]
Epoch 7 Iter 113: loss 0.15557. :  50%|██████████████████████▏                     | 113/224 [01:24<01:41,  1.09it/s]
Epoch 7 Iter 114: loss 0.16231. :  50%|██████████████████████▏                     | 113/224 [01:25<01:41,  1.09it/s]
Epoch 7 Iter 114: loss 0.16231. :  51%|██████████████████████▍                     | 114/224 [01:25<01:45,  1.04it/s]
Epoch 7 Iter 115: loss 0.17758. :  51%|██████████████████████▍                     | 114/224 [01:26<01:45,  1.04it/s]
Epoch 7 Iter 115: loss 0.17758. :  51%|██████████████████████▌                     | 115/224 [01:26<01:41,  1.08it/s]
Epoch 7 Iter 116: loss 0.17948. :  51%|██████████████████████▌                     | 115/224 [01:28<01:41,  1.08it/s]
Epoch 7 Iter 116: loss 0.17948. :  52%|██████████████████████▊                     | 116/224 [01:28<01:53,  1.05s/it]
Epoch 7 Iter 117: loss 0.18499. :  52%|██████████████████████▊                     | 116/224 [01:29<01:53,  1.05s/it]
Epoch 7 Iter 117: loss 0.18499. :  52%|██████████████████████▉                     | 117/224 [01:29<01:49,  1.03s/it]
Epoch 7 Iter 118: loss 0.18520. :  52%|██████████████████████▉                     | 117/224 [01:30<01:49,  1.03s/it]
Epoch 7 Iter 118: loss 0.18520. :  53%|███████████████████████▏                    | 118/224 [01:30<01:59,  1.13s/it]
Epoch 7 Iter 119: loss 0.17090. :  53%|███████████████████████▏                    | 118/224 [01:31<01:59,  1.13s/it]
Epoch 7 Iter 119: loss 0.17090. :  53%|███████████████████████▍                    | 119/224 [01:31<01:53,  1.08s/it]
Epoch 7 Iter 120: loss 0.18384. :  53%|███████████████████████▍                    | 119/224 [01:32<01:53,  1.08s/it]
Epoch 7 Iter 120: loss 0.18384. :  54%|███████████████████████▌                    | 120/224 [01:32<01:59,  1.15s/it]
Epoch 7 Iter 121: loss 0.18862. :  54%|███████████████████████▌                    | 120/224 [01:33<01:59,  1.15s/it]
Epoch 7 Iter 121: loss 0.18862. :  54%|███████████████████████▊                    | 121/224 [01:33<01:56,  1.13s/it]
Epoch 7 Iter 122: loss 0.19528. :  54%|███████████████████████▊                    | 121/224 [01:34<01:56,  1.13s/it]
Epoch 7 Iter 122: loss 0.19528. :  54%|███████████████████████▉                    | 122/224 [01:34<01:55,  1.14s/it]
Epoch 7 Iter 123: loss 0.19532. :  54%|███████████████████████▉                    | 122/224 [01:36<01:55,  1.14s/it]
Epoch 7 Iter 123: loss 0.19532. :  55%|████████████████████████▏                   | 123/224 [01:36<01:57,  1.16s/it]
Epoch 7 Iter 124: loss 0.18706. :  55%|████████████████████████▏                   | 123/224 [01:37<01:57,  1.16s/it]
Epoch 7 Iter 124: loss 0.18706. :  55%|████████████████████████▎                   | 124/224 [01:37<02:02,  1.23s/it]
Epoch 7 Iter 125: loss 0.17722. :  55%|████████████████████████▎                   | 124/224 [01:38<02:02,  1.23s/it]
Epoch 7 Iter 125: loss 0.17722. :  56%|████████████████████████▌                   | 125/224 [01:38<01:52,  1.13s/it]
Epoch 7 Iter 126: loss 0.16209. :  56%|████████████████████████▌                   | 125/224 [01:39<01:52,  1.13s/it]
Epoch 7 Iter 126: loss 0.16209. :  56%|████████████████████████▊                   | 126/224 [01:39<01:36,  1.02it/s]
Epoch 7 Iter 127: loss 0.18070. :  56%|████████████████████████▊                   | 126/224 [01:39<01:36,  1.02it/s]
Epoch 7 Iter 127: loss 0.18070. :  57%|████████████████████████▉                   | 127/224 [01:39<01:31,  1.06it/s]
Epoch 7 Iter 128: loss 0.17719. :  57%|████████████████████████▉                   | 127/224 [01:40<01:31,  1.06it/s]
Epoch 7 Iter 128: loss 0.17719. :  57%|█████████████████████████▏                  | 128/224 [01:40<01:35,  1.00it/s]
Epoch 7 Iter 129: loss 0.17418. :  57%|█████████████████████████▏                  | 128/224 [01:42<01:35,  1.00it/s]
Epoch 7 Iter 129: loss 0.17418. :  58%|█████████████████████████▎                  | 129/224 [01:42<01:48,  1.15s/it]
Epoch 7 Iter 130: loss 0.17852. :  58%|█████████████████████████▎                  | 129/224 [01:43<01:48,  1.15s/it]
Epoch 7 Iter 130: loss 0.17852. :  58%|█████████████████████████▌                  | 130/224 [01:43<01:53,  1.21s/it]
Epoch 7 Iter 131: loss 0.18116. :  58%|█████████████████████████▌                  | 130/224 [01:45<01:53,  1.21s/it]
Epoch 7 Iter 131: loss 0.18116. :  58%|█████████████████████████▋                  | 131/224 [01:45<01:54,  1.23s/it]
Epoch 7 Iter 132: loss 0.18897. :  58%|█████████████████████████▋                  | 131/224 [01:46<01:54,  1.23s/it]
Epoch 7 Iter 132: loss 0.18897. :  59%|█████████████████████████▉                  | 132/224 [01:46<01:53,  1.23s/it]
Epoch 7 Iter 133: loss 0.15236. :  59%|█████████████████████████▉                  | 132/224 [01:47<01:53,  1.23s/it]
Epoch 7 Iter 133: loss 0.15236. :  59%|██████████████████████████▏                 | 133/224 [01:47<01:45,  1.16s/it]
Epoch 7 Iter 134: loss 0.19408. :  59%|██████████████████████████▏                 | 133/224 [01:48<01:45,  1.16s/it]
Epoch 7 Iter 134: loss 0.19408. :  60%|██████████████████████████▎                 | 134/224 [01:48<01:46,  1.18s/it]
Epoch 7 Iter 135: loss 0.17678. :  60%|██████████████████████████▎                 | 134/224 [01:49<01:46,  1.18s/it]
Epoch 7 Iter 135: loss 0.17678. :  60%|██████████████████████████▌                 | 135/224 [01:49<01:38,  1.11s/it]
Epoch 7 Iter 136: loss 0.18666. :  60%|██████████████████████████▌                 | 135/224 [01:50<01:38,  1.11s/it]
Epoch 7 Iter 136: loss 0.18666. :  61%|██████████████████████████▋                 | 136/224 [01:50<01:37,  1.11s/it]
Epoch 7 Iter 137: loss 0.17411. :  61%|██████████████████████████▋                 | 136/224 [01:51<01:37,  1.11s/it]
Epoch 7 Iter 137: loss 0.17411. :  61%|██████████████████████████▉                 | 137/224 [01:51<01:34,  1.09s/it]
Epoch 7 Iter 138: loss 0.19432. :  61%|██████████████████████████▉                 | 137/224 [01:53<01:34,  1.09s/it]
Epoch 7 Iter 138: loss 0.19432. :  62%|███████████████████████████                 | 138/224 [01:53<01:41,  1.18s/it]
Epoch 7 Iter 139: loss 0.19065. :  62%|███████████████████████████                 | 138/224 [01:54<01:41,  1.18s/it]
Epoch 7 Iter 139: loss 0.19065. :  62%|███████████████████████████▎                | 139/224 [01:54<01:44,  1.23s/it]
Epoch 7 Iter 140: loss 0.17716. :  62%|███████████████████████████▎                | 139/224 [01:55<01:44,  1.23s/it]
Epoch 7 Iter 140: loss 0.17716. :  62%|███████████████████████████▌                | 140/224 [01:55<01:33,  1.12s/it]
Epoch 7 Iter 141: loss 0.19469. :  62%|███████████████████████████▌                | 140/224 [01:55<01:33,  1.12s/it]
Epoch 7 Iter 141: loss 0.19469. :  63%|███████████████████████████▋                | 141/224 [01:55<01:17,  1.07it/s]
Epoch 7 Iter 142: loss 0.17934. :  63%|███████████████████████████▋                | 141/224 [01:56<01:17,  1.07it/s]
Epoch 7 Iter 142: loss 0.17934. :  63%|███████████████████████████▉                | 142/224 [01:56<01:05,  1.25it/s]
Epoch 7 Iter 143: loss 0.19237. :  63%|███████████████████████████▉                | 142/224 [01:56<01:05,  1.25it/s]
Epoch 7 Iter 143: loss 0.19237. :  64%|████████████████████████████                | 143/224 [01:56<00:57,  1.42it/s]
Epoch 7 Iter 144: loss 0.17140. :  64%|████████████████████████████                | 143/224 [01:57<00:57,  1.42it/s]
Epoch 7 Iter 144: loss 0.17140. :  64%|████████████████████████████▎               | 144/224 [01:57<00:51,  1.56it/s]
Epoch 7 Iter 145: loss 0.15060. :  64%|████████████████████████████▎               | 144/224 [01:57<00:51,  1.56it/s]
Epoch 7 Iter 145: loss 0.15060. :  65%|████████████████████████████▍               | 145/224 [01:57<00:47,  1.67it/s]
Epoch 7 Iter 146: loss 0.18678. :  65%|████████████████████████████▍               | 145/224 [01:58<00:47,  1.67it/s]
Epoch 7 Iter 146: loss 0.18678. :  65%|████████████████████████████▋               | 146/224 [01:58<00:44,  1.76it/s]
Epoch 7 Iter 147: loss 0.21718. :  65%|████████████████████████████▋               | 146/224 [01:58<00:44,  1.76it/s]
Epoch 7 Iter 147: loss 0.21718. :  66%|████████████████████████████▉               | 147/224 [01:58<00:42,  1.82it/s]
Epoch 7 Iter 148: loss 0.16895. :  66%|████████████████████████████▉               | 147/224 [01:59<00:42,  1.82it/s]
Epoch 7 Iter 148: loss 0.16895. :  66%|█████████████████████████████               | 148/224 [01:59<00:40,  1.87it/s]
Epoch 7 Iter 149: loss 0.19005. :  66%|█████████████████████████████               | 148/224 [01:59<00:40,  1.87it/s]
Epoch 7 Iter 149: loss 0.19005. :  67%|█████████████████████████████▎              | 149/224 [01:59<00:39,  1.90it/s]
Epoch 7 Iter 150: loss 0.18603. :  67%|█████████████████████████████▎              | 149/224 [02:00<00:39,  1.90it/s]
Epoch 7 Iter 150: loss 0.18603. :  67%|█████████████████████████████▍              | 150/224 [02:00<00:38,  1.91it/s]
Epoch 7 Iter 151: loss 0.18607. :  67%|█████████████████████████████▍              | 150/224 [02:00<00:38,  1.91it/s]
Epoch 7 Iter 151: loss 0.18607. :  67%|█████████████████████████████▋              | 151/224 [02:00<00:38,  1.88it/s]
Epoch 7 Iter 152: loss 0.18360. :  67%|█████████████████████████████▋              | 151/224 [02:01<00:38,  1.88it/s]
Epoch 7 Iter 152: loss 0.18360. :  68%|█████████████████████████████▊              | 152/224 [02:01<00:38,  1.88it/s]
Epoch 7 Iter 153: loss 0.16873. :  68%|█████████████████████████████▊              | 152/224 [02:01<00:38,  1.88it/s]
Epoch 7 Iter 153: loss 0.16873. :  68%|██████████████████████████████              | 153/224 [02:01<00:37,  1.91it/s]
Epoch 7 Iter 154: loss 0.19624. :  68%|██████████████████████████████              | 153/224 [02:02<00:37,  1.91it/s]
Epoch 7 Iter 154: loss 0.19624. :  69%|██████████████████████████████▎             | 154/224 [02:02<00:36,  1.93it/s]
Epoch 7 Iter 155: loss 0.20638. :  69%|██████████████████████████████▎             | 154/224 [02:02<00:36,  1.93it/s]
Epoch 7 Iter 155: loss 0.20638. :  69%|██████████████████████████████▍             | 155/224 [02:02<00:35,  1.94it/s]
Epoch 7 Iter 156: loss 0.19074. :  69%|██████████████████████████████▍             | 155/224 [02:03<00:35,  1.94it/s]
Epoch 7 Iter 156: loss 0.19074. :  70%|██████████████████████████████▋             | 156/224 [02:03<00:35,  1.94it/s]
Epoch 7 Iter 157: loss 0.18464. :  70%|██████████████████████████████▋             | 156/224 [02:03<00:35,  1.94it/s]
Epoch 7 Iter 157: loss 0.18464. :  70%|██████████████████████████████▊             | 157/224 [02:03<00:34,  1.94it/s]
Epoch 7 Iter 158: loss 0.17230. :  70%|██████████████████████████████▊             | 157/224 [02:04<00:34,  1.94it/s]
Epoch 7 Iter 158: loss 0.17230. :  71%|███████████████████████████████             | 158/224 [02:04<00:33,  1.95it/s]
Epoch 7 Iter 159: loss 0.18811. :  71%|███████████████████████████████             | 158/224 [02:04<00:33,  1.95it/s]
Epoch 7 Iter 159: loss 0.18811. :  71%|███████████████████████████████▏            | 159/224 [02:04<00:33,  1.92it/s]
Epoch 7 Iter 160: loss 0.17404. :  71%|███████████████████████████████▏            | 159/224 [02:05<00:33,  1.92it/s]
Epoch 7 Iter 160: loss 0.17404. :  71%|███████████████████████████████▍            | 160/224 [02:05<00:32,  1.94it/s]
Epoch 7 Iter 161: loss 0.19718. :  71%|███████████████████████████████▍            | 160/224 [02:05<00:32,  1.94it/s]
Epoch 7 Iter 161: loss 0.19718. :  72%|███████████████████████████████▋            | 161/224 [02:05<00:32,  1.95it/s]
Epoch 7 Iter 162: loss 0.19281. :  72%|███████████████████████████████▋            | 161/224 [02:06<00:32,  1.95it/s]
Epoch 7 Iter 162: loss 0.19281. :  72%|███████████████████████████████▊            | 162/224 [02:06<00:31,  1.96it/s]
Epoch 7 Iter 163: loss 0.19977. :  72%|███████████████████████████████▊            | 162/224 [02:06<00:31,  1.96it/s]
Epoch 7 Iter 163: loss 0.19977. :  73%|████████████████████████████████            | 163/224 [02:06<00:30,  1.97it/s]
Epoch 7 Iter 164: loss 0.18869. :  73%|████████████████████████████████            | 163/224 [02:07<00:30,  1.97it/s]
Epoch 7 Iter 164: loss 0.18869. :  73%|████████████████████████████████▏           | 164/224 [02:07<00:30,  1.96it/s]
Epoch 7 Iter 165: loss 0.18781. :  73%|████████████████████████████████▏           | 164/224 [02:07<00:30,  1.96it/s]
Epoch 7 Iter 165: loss 0.18781. :  74%|████████████████████████████████▍           | 165/224 [02:07<00:29,  1.97it/s]
Epoch 7 Iter 166: loss 0.18635. :  74%|████████████████████████████████▍           | 165/224 [02:08<00:29,  1.97it/s]
Epoch 7 Iter 166: loss 0.18635. :  74%|████████████████████████████████▌           | 166/224 [02:08<00:29,  1.97it/s]
Epoch 7 Iter 167: loss 0.18121. :  74%|████████████████████████████████▌           | 166/224 [02:08<00:29,  1.97it/s]
Epoch 7 Iter 167: loss 0.18121. :  75%|████████████████████████████████▊           | 167/224 [02:08<00:28,  1.97it/s]
Epoch 7 Iter 168: loss 0.17392. :  75%|████████████████████████████████▊           | 167/224 [02:09<00:28,  1.97it/s]
Epoch 7 Iter 168: loss 0.17392. :  75%|█████████████████████████████████           | 168/224 [02:09<00:28,  1.98it/s]
Epoch 7 Iter 169: loss 0.20133. :  75%|█████████████████████████████████           | 168/224 [02:10<00:28,  1.98it/s]
Epoch 7 Iter 169: loss 0.20133. :  75%|█████████████████████████████████▏          | 169/224 [02:10<00:27,  1.97it/s]
Epoch 7 Iter 170: loss 0.17462. :  75%|█████████████████████████████████▏          | 169/224 [02:10<00:27,  1.97it/s]
Epoch 7 Iter 170: loss 0.17462. :  76%|█████████████████████████████████▍          | 170/224 [02:10<00:27,  1.98it/s]
Epoch 7 Iter 171: loss 0.18244. :  76%|█████████████████████████████████▍          | 170/224 [02:11<00:27,  1.98it/s]
Epoch 7 Iter 171: loss 0.18244. :  76%|█████████████████████████████████▌          | 171/224 [02:11<00:26,  1.99it/s]
Epoch 7 Iter 172: loss 0.17528. :  76%|█████████████████████████████████▌          | 171/224 [02:11<00:26,  1.99it/s]
Epoch 7 Iter 172: loss 0.17528. :  77%|█████████████████████████████████▊          | 172/224 [02:11<00:25,  2.00it/s]
Epoch 7 Iter 173: loss 0.17893. :  77%|█████████████████████████████████▊          | 172/224 [02:11<00:25,  2.00it/s]
Epoch 7 Iter 173: loss 0.17893. :  77%|█████████████████████████████████▉          | 173/224 [02:11<00:25,  2.00it/s]
Epoch 7 Iter 174: loss 0.19819. :  77%|█████████████████████████████████▉          | 173/224 [02:12<00:25,  2.00it/s]
Epoch 7 Iter 174: loss 0.19819. :  78%|██████████████████████████████████▏         | 174/224 [02:12<00:25,  1.99it/s]
Epoch 7 Iter 175: loss 0.16054. :  78%|██████████████████████████████████▏         | 174/224 [02:13<00:25,  1.99it/s]
Epoch 7 Iter 175: loss 0.16054. :  78%|██████████████████████████████████▍         | 175/224 [02:13<00:24,  1.99it/s]
Epoch 7 Iter 176: loss 0.16170. :  78%|██████████████████████████████████▍         | 175/224 [02:13<00:24,  1.99it/s]
Epoch 7 Iter 176: loss 0.16170. :  79%|██████████████████████████████████▌         | 176/224 [02:13<00:24,  2.00it/s]
Epoch 7 Iter 177: loss 0.17999. :  79%|██████████████████████████████████▌         | 176/224 [02:13<00:24,  2.00it/s]
Epoch 7 Iter 177: loss 0.17999. :  79%|██████████████████████████████████▊         | 177/224 [02:13<00:23,  2.01it/s]
Epoch 7 Iter 178: loss 0.17330. :  79%|██████████████████████████████████▊         | 177/224 [02:14<00:23,  2.01it/s]
Epoch 7 Iter 178: loss 0.17330. :  79%|██████████████████████████████████▉         | 178/224 [02:14<00:22,  2.02it/s]
Epoch 7 Iter 179: loss 0.17775. :  79%|██████████████████████████████████▉         | 178/224 [02:14<00:22,  2.02it/s]
Epoch 7 Iter 179: loss 0.17775. :  80%|███████████████████████████████████▏        | 179/224 [02:14<00:22,  2.01it/s]
Epoch 7 Iter 180: loss 0.20000. :  80%|███████████████████████████████████▏        | 179/224 [02:15<00:22,  2.01it/s]
Epoch 7 Iter 180: loss 0.20000. :  80%|███████████████████████████████████▎        | 180/224 [02:15<00:21,  2.02it/s]
Epoch 7 Iter 181: loss 0.19619. :  80%|███████████████████████████████████▎        | 180/224 [02:15<00:21,  2.02it/s]
Epoch 7 Iter 181: loss 0.19619. :  81%|███████████████████████████████████▌        | 181/224 [02:15<00:21,  2.01it/s]
Epoch 7 Iter 182: loss 0.16546. :  81%|███████████████████████████████████▌        | 181/224 [02:16<00:21,  2.01it/s]
Epoch 7 Iter 182: loss 0.16546. :  81%|███████████████████████████████████▊        | 182/224 [02:16<00:20,  2.02it/s]
Epoch 7 Iter 183: loss 0.19230. :  81%|███████████████████████████████████▊        | 182/224 [02:16<00:20,  2.02it/s]
Epoch 7 Iter 183: loss 0.19230. :  82%|███████████████████████████████████▉        | 183/224 [02:16<00:20,  2.01it/s]
Epoch 7 Iter 184: loss 0.17954. :  82%|███████████████████████████████████▉        | 183/224 [02:17<00:20,  2.01it/s]
Epoch 7 Iter 184: loss 0.17954. :  82%|████████████████████████████████████▏       | 184/224 [02:17<00:19,  2.03it/s]
Epoch 7 Iter 185: loss 0.17965. :  82%|████████████████████████████████████▏       | 184/224 [02:17<00:19,  2.03it/s]
Epoch 7 Iter 185: loss 0.17965. :  83%|████████████████████████████████████▎       | 185/224 [02:17<00:19,  2.03it/s]
Epoch 7 Iter 186: loss 0.18180. :  83%|████████████████████████████████████▎       | 185/224 [02:18<00:19,  2.03it/s]
Epoch 7 Iter 186: loss 0.18180. :  83%|████████████████████████████████████▌       | 186/224 [02:18<00:18,  2.02it/s]
Epoch 7 Iter 187: loss 0.16164. :  83%|████████████████████████████████████▌       | 186/224 [02:18<00:18,  2.02it/s]
Epoch 7 Iter 187: loss 0.16164. :  83%|████████████████████████████████████▋       | 187/224 [02:18<00:18,  2.00it/s]
Epoch 7 Iter 188: loss 0.18119. :  83%|████████████████████████████████████▋       | 187/224 [02:19<00:18,  2.00it/s]
Epoch 7 Iter 188: loss 0.18119. :  84%|████████████████████████████████████▉       | 188/224 [02:19<00:17,  2.01it/s]
Epoch 7 Iter 189: loss 0.16614. :  84%|████████████████████████████████████▉       | 188/224 [02:19<00:17,  2.01it/s]
Epoch 7 Iter 189: loss 0.16614. :  84%|█████████████████████████████████████▏      | 189/224 [02:19<00:17,  2.01it/s]
Epoch 7 Iter 190: loss 0.18769. :  84%|█████████████████████████████████████▏      | 189/224 [02:20<00:17,  2.01it/s]
Epoch 7 Iter 190: loss 0.18769. :  85%|█████████████████████████████████████▎      | 190/224 [02:20<00:16,  2.01it/s]
Epoch 7 Iter 191: loss 0.16030. :  85%|█████████████████████████████████████▎      | 190/224 [02:20<00:16,  2.01it/s]
Epoch 7 Iter 191: loss 0.16030. :  85%|█████████████████████████████████████▌      | 191/224 [02:20<00:16,  2.00it/s]
Epoch 7 Iter 192: loss 0.19658. :  85%|█████████████████████████████████████▌      | 191/224 [02:21<00:16,  2.00it/s]
Epoch 7 Iter 192: loss 0.19658. :  86%|█████████████████████████████████████▋      | 192/224 [02:21<00:16,  2.00it/s]
Epoch 7 Iter 193: loss 0.18082. :  86%|█████████████████████████████████████▋      | 192/224 [02:21<00:16,  2.00it/s]
Epoch 7 Iter 193: loss 0.18082. :  86%|█████████████████████████████████████▉      | 193/224 [02:21<00:15,  1.99it/s]
Epoch 7 Iter 194: loss 0.17702. :  86%|█████████████████████████████████████▉      | 193/224 [02:22<00:15,  1.99it/s]
Epoch 7 Iter 194: loss 0.17702. :  87%|██████████████████████████████████████      | 194/224 [02:22<00:15,  1.94it/s]
Epoch 7 Iter 195: loss 0.16851. :  87%|██████████████████████████████████████      | 194/224 [02:23<00:15,  1.94it/s]
Epoch 7 Iter 195: loss 0.16851. :  87%|██████████████████████████████████████▎     | 195/224 [02:23<00:14,  1.96it/s]
Epoch 7 Iter 196: loss 0.17087. :  87%|██████████████████████████████████████▎     | 195/224 [02:23<00:14,  1.96it/s]
Epoch 7 Iter 196: loss 0.17087. :  88%|██████████████████████████████████████▌     | 196/224 [02:23<00:14,  1.97it/s]
Epoch 7 Iter 197: loss 0.16331. :  88%|██████████████████████████████████████▌     | 196/224 [02:24<00:14,  1.97it/s]
Epoch 7 Iter 197: loss 0.16331. :  88%|██████████████████████████████████████▋     | 197/224 [02:24<00:13,  1.98it/s]
Epoch 7 Iter 198: loss 0.16772. :  88%|██████████████████████████████████████▋     | 197/224 [02:24<00:13,  1.98it/s]
Epoch 7 Iter 198: loss 0.16772. :  88%|██████████████████████████████████████▉     | 198/224 [02:24<00:13,  2.00it/s]
Epoch 7 Iter 199: loss 0.18567. :  88%|██████████████████████████████████████▉     | 198/224 [02:24<00:13,  2.00it/s]
Epoch 7 Iter 199: loss 0.18567. :  89%|███████████████████████████████████████     | 199/224 [02:24<00:12,  1.99it/s]
Epoch 7 Iter 200: loss 0.16514. :  89%|███████████████████████████████████████     | 199/224 [02:25<00:12,  1.99it/s]
Epoch 7 Iter 200: loss 0.16514. :  89%|███████████████████████████████████████▎    | 200/224 [02:25<00:12,  2.00it/s]
Epoch 7 Iter 201: loss 0.18839. :  89%|███████████████████████████████████████▎    | 200/224 [02:25<00:12,  2.00it/s]
Epoch 7 Iter 201: loss 0.18839. :  90%|███████████████████████████████████████▍    | 201/224 [02:25<00:11,  2.00it/s]
Epoch 7 Iter 202: loss 0.17383. :  90%|███████████████████████████████████████▍    | 201/224 [02:26<00:11,  2.00it/s]
Epoch 7 Iter 202: loss 0.17383. :  90%|███████████████████████████████████████▋    | 202/224 [02:26<00:10,  2.01it/s]
Epoch 7 Iter 203: loss 0.17865. :  90%|███████████████████████████████████████▋    | 202/224 [02:26<00:10,  2.01it/s]
Epoch 7 Iter 203: loss 0.17865. :  91%|███████████████████████████████████████▉    | 203/224 [02:26<00:10,  2.00it/s]
Epoch 7 Iter 204: loss 0.18554. :  91%|███████████████████████████████████████▉    | 203/224 [02:27<00:10,  2.00it/s]
Epoch 7 Iter 204: loss 0.18554. :  91%|████████████████████████████████████████    | 204/224 [02:27<00:10,  2.00it/s]
Epoch 7 Iter 205: loss 0.19231. :  91%|████████████████████████████████████████    | 204/224 [02:27<00:10,  2.00it/s]
Epoch 7 Iter 205: loss 0.19231. :  92%|████████████████████████████████████████▎   | 205/224 [02:27<00:09,  2.00it/s]
Epoch 7 Iter 206: loss 0.18053. :  92%|████████████████████████████████████████▎   | 205/224 [02:28<00:09,  2.00it/s]
Epoch 7 Iter 206: loss 0.18053. :  92%|████████████████████████████████████████▍   | 206/224 [02:28<00:08,  2.00it/s]
Epoch 7 Iter 207: loss 0.17644. :  92%|████████████████████████████████████████▍   | 206/224 [02:28<00:08,  2.00it/s]
Epoch 7 Iter 207: loss 0.17644. :  92%|████████████████████████████████████████▋   | 207/224 [02:28<00:08,  2.01it/s]
Epoch 7 Iter 208: loss 0.18593. :  92%|████████████████████████████████████████▋   | 207/224 [02:29<00:08,  2.01it/s]
Epoch 7 Iter 208: loss 0.18593. :  93%|████████████████████████████████████████▊   | 208/224 [02:29<00:07,  2.01it/s]
Epoch 7 Iter 209: loss 0.17098. :  93%|████████████████████████████████████████▊   | 208/224 [02:29<00:07,  2.01it/s]
Epoch 7 Iter 209: loss 0.17098. :  93%|█████████████████████████████████████████   | 209/224 [02:29<00:07,  1.99it/s]
Epoch 7 Iter 210: loss 0.14771. :  93%|█████████████████████████████████████████   | 209/224 [02:30<00:07,  1.99it/s]
Epoch 7 Iter 210: loss 0.14771. :  94%|█████████████████████████████████████████▎  | 210/224 [02:30<00:06,  2.01it/s]
Epoch 7 Iter 211: loss 0.17226. :  94%|█████████████████████████████████████████▎  | 210/224 [02:30<00:06,  2.01it/s]
Epoch 7 Iter 211: loss 0.17226. :  94%|█████████████████████████████████████████▍  | 211/224 [02:30<00:06,  2.01it/s]
Epoch 7 Iter 212: loss 0.19257. :  94%|█████████████████████████████████████████▍  | 211/224 [02:31<00:06,  2.01it/s]
Epoch 7 Iter 212: loss 0.19257. :  95%|█████████████████████████████████████████▋  | 212/224 [02:31<00:05,  2.01it/s]
Epoch 7 Iter 213: loss 0.17814. :  95%|█████████████████████████████████████████▋  | 212/224 [02:31<00:05,  2.01it/s]
Epoch 7 Iter 213: loss 0.17814. :  95%|█████████████████████████████████████████▊  | 213/224 [02:31<00:05,  2.00it/s]
Epoch 7 Iter 214: loss 0.17772. :  95%|█████████████████████████████████████████▊  | 213/224 [02:32<00:05,  2.00it/s]
Epoch 7 Iter 214: loss 0.17772. :  96%|██████████████████████████████████████████  | 214/224 [02:32<00:05,  2.00it/s]
Epoch 7 Iter 215: loss 0.18952. :  96%|██████████████████████████████████████████  | 214/224 [02:32<00:05,  2.00it/s]
Epoch 7 Iter 215: loss 0.18952. :  96%|██████████████████████████████████████████▏ | 215/224 [02:32<00:04,  2.01it/s]
Epoch 7 Iter 216: loss 0.18947. :  96%|██████████████████████████████████████████▏ | 215/224 [02:33<00:04,  2.01it/s]
Epoch 7 Iter 216: loss 0.18947. :  96%|██████████████████████████████████████████▍ | 216/224 [02:33<00:03,  2.02it/s]
Epoch 7 Iter 217: loss 0.17464. :  96%|██████████████████████████████████████████▍ | 216/224 [02:33<00:03,  2.02it/s]
Epoch 7 Iter 217: loss 0.17464. :  97%|██████████████████████████████████████████▋ | 217/224 [02:33<00:03,  2.02it/s]
Epoch 7 Iter 218: loss 0.18940. :  97%|██████████████████████████████████████████▋ | 217/224 [02:34<00:03,  2.02it/s]
Epoch 7 Iter 218: loss 0.18940. :  97%|██████████████████████████████████████████▊ | 218/224 [02:34<00:02,  2.02it/s]
Epoch 7 Iter 219: loss 0.18185. :  97%|██████████████████████████████████████████▊ | 218/224 [02:34<00:02,  2.02it/s]
Epoch 7 Iter 219: loss 0.18185. :  98%|███████████████████████████████████████████ | 219/224 [02:34<00:02,  2.01it/s]
Epoch 7 Iter 220: loss 0.17413. :  98%|███████████████████████████████████████████ | 219/224 [02:35<00:02,  2.01it/s]
Epoch 7 Iter 220: loss 0.17413. :  98%|███████████████████████████████████████████▏| 220/224 [02:35<00:01,  2.02it/s]
Epoch 7 Iter 221: loss 0.19000. :  98%|███████████████████████████████████████████▏| 220/224 [02:35<00:01,  2.02it/s]
Epoch 7 Iter 221: loss 0.19000. :  99%|███████████████████████████████████████████▍| 221/224 [02:35<00:01,  2.01it/s]
Epoch 7 Iter 222: loss 0.19319. :  99%|███████████████████████████████████████████▍| 221/224 [02:36<00:01,  2.01it/s]
Epoch 7 Iter 222: loss 0.19319. :  99%|███████████████████████████████████████████▌| 222/224 [02:36<00:01,  2.00it/s]
Epoch 7 Iter 223: loss 0.18573. :  99%|███████████████████████████████████████████▌| 222/224 [02:36<00:01,  2.00it/s]
Epoch 7 Iter 223: loss 0.18573. : 100%|███████████████████████████████████████████▊| 223/224 [02:36<00:00,  1.99it/s]
Epoch 7 Iter 224: loss 0.18961. : 100%|███████████████████████████████████████████▊| 223/224 [02:37<00:00,  1.99it/s]
Epoch 7 Iter 224: loss 0.18961. : 100%|████████████████████████████████████████████| 224/224 [02:37<00:00,  1.99it/s]
Epoch 7 Iter 224: loss 0.18961. : 100%|████████████████████████████████████████████| 224/224 [02:37<00:00,  1.42it/s]

    Train loss: 0.18067
    Valid loss: 0.18278
       Valid loss recons: 0.17714
       Valid loss KL-D:   56.43869
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.18750. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 8 Iter 1: loss 0.18750. :   0%|▏                                               | 1/224 [00:00<01:48,  2.06it/s]
Epoch 8 Iter 2: loss 0.16182. :   0%|▏                                               | 1/224 [00:00<01:48,  2.06it/s]
Epoch 8 Iter 2: loss 0.16182. :   1%|▍                                               | 2/224 [00:00<01:50,  2.01it/s]
Epoch 8 Iter 3: loss 0.18108. :   1%|▍                                               | 2/224 [00:01<01:50,  2.01it/s]
Epoch 8 Iter 3: loss 0.18108. :   1%|▋                                               | 3/224 [00:01<01:49,  2.01it/s]
Epoch 8 Iter 4: loss 0.17254. :   1%|▋                                               | 3/224 [00:01<01:49,  2.01it/s]
Epoch 8 Iter 4: loss 0.17254. :   2%|▊                                               | 4/224 [00:01<01:49,  2.00it/s]
Epoch 8 Iter 5: loss 0.18022. :   2%|▊                                               | 4/224 [00:02<01:49,  2.00it/s]
Epoch 8 Iter 5: loss 0.18022. :   2%|█                                               | 5/224 [00:02<01:50,  1.99it/s]
Epoch 8 Iter 6: loss 0.16563. :   2%|█                                               | 5/224 [00:03<01:50,  1.99it/s]
Epoch 8 Iter 6: loss 0.16563. :   3%|█▎                                              | 6/224 [00:03<01:50,  1.98it/s]
Epoch 8 Iter 7: loss 0.20315. :   3%|█▎                                              | 6/224 [00:03<01:50,  1.98it/s]
Epoch 8 Iter 7: loss 0.20315. :   3%|█▌                                              | 7/224 [00:03<01:49,  1.98it/s]
Epoch 8 Iter 8: loss 0.17559. :   3%|█▌                                              | 7/224 [00:04<01:49,  1.98it/s]
Epoch 8 Iter 8: loss 0.17559. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 8 Iter 9: loss 0.17303. :   4%|█▋                                              | 8/224 [00:04<01:48,  1.99it/s]
Epoch 8 Iter 9: loss 0.17303. :   4%|█▉                                              | 9/224 [00:04<01:48,  1.98it/s]
Epoch 8 Iter 10: loss 0.16364. :   4%|█▉                                             | 9/224 [00:05<01:48,  1.98it/s]
Epoch 8 Iter 10: loss 0.16364. :   4%|██                                            | 10/224 [00:05<01:49,  1.96it/s]
Epoch 8 Iter 11: loss 0.17613. :   4%|██                                            | 10/224 [00:05<01:49,  1.96it/s]
Epoch 8 Iter 11: loss 0.17613. :   5%|██▎                                           | 11/224 [00:05<01:50,  1.93it/s]
Epoch 8 Iter 12: loss 0.18182. :   5%|██▎                                           | 11/224 [00:06<01:50,  1.93it/s]
Epoch 8 Iter 12: loss 0.18182. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.96it/s]
Epoch 8 Iter 13: loss 0.18351. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.96it/s]
Epoch 8 Iter 13: loss 0.18351. :   6%|██▋                                           | 13/224 [00:06<01:46,  1.98it/s]
Epoch 8 Iter 14: loss 0.17757. :   6%|██▋                                           | 13/224 [00:07<01:46,  1.98it/s]
Epoch 8 Iter 14: loss 0.17757. :   6%|██▉                                           | 14/224 [00:07<01:45,  2.00it/s]
Epoch 8 Iter 15: loss 0.18628. :   6%|██▉                                           | 14/224 [00:07<01:45,  2.00it/s]
Epoch 8 Iter 15: loss 0.18628. :   7%|███                                           | 15/224 [00:07<01:44,  2.00it/s]
Epoch 8 Iter 16: loss 0.18940. :   7%|███                                           | 15/224 [00:08<01:44,  2.00it/s]
Epoch 8 Iter 16: loss 0.18940. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.00it/s]
Epoch 8 Iter 17: loss 0.18455. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.00it/s]
Epoch 8 Iter 17: loss 0.18455. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.00it/s]
Epoch 8 Iter 18: loss 0.18152. :   8%|███▍                                          | 17/224 [00:09<01:43,  2.00it/s]
Epoch 8 Iter 18: loss 0.18152. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.00it/s]
Epoch 8 Iter 19: loss 0.17933. :   8%|███▋                                          | 18/224 [00:09<01:42,  2.00it/s]
Epoch 8 Iter 19: loss 0.17933. :   8%|███▉                                          | 19/224 [00:09<01:42,  1.99it/s]
Epoch 8 Iter 20: loss 0.19294. :   8%|███▉                                          | 19/224 [00:10<01:42,  1.99it/s]
Epoch 8 Iter 20: loss 0.19294. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 8 Iter 21: loss 0.18372. :   9%|████                                          | 20/224 [00:10<01:41,  2.00it/s]
Epoch 8 Iter 21: loss 0.18372. :   9%|████▎                                         | 21/224 [00:10<01:41,  2.00it/s]
Epoch 8 Iter 22: loss 0.17720. :   9%|████▎                                         | 21/224 [00:11<01:41,  2.00it/s]
Epoch 8 Iter 22: loss 0.17720. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.99it/s]
Epoch 8 Iter 23: loss 0.18354. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.99it/s]
Epoch 8 Iter 23: loss 0.18354. :  10%|████▋                                         | 23/224 [00:11<01:41,  1.99it/s]
Epoch 8 Iter 24: loss 0.16300. :  10%|████▋                                         | 23/224 [00:12<01:41,  1.99it/s]
Epoch 8 Iter 24: loss 0.16300. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 8 Iter 25: loss 0.17973. :  11%|████▉                                         | 24/224 [00:12<01:40,  1.99it/s]
Epoch 8 Iter 25: loss 0.17973. :  11%|█████▏                                        | 25/224 [00:12<01:39,  2.00it/s]
Epoch 8 Iter 26: loss 0.17556. :  11%|█████▏                                        | 25/224 [00:13<01:39,  2.00it/s]
Epoch 8 Iter 26: loss 0.17556. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 8 Iter 27: loss 0.17992. :  12%|█████▎                                        | 26/224 [00:13<01:39,  1.99it/s]
Epoch 8 Iter 27: loss 0.17992. :  12%|█████▌                                        | 27/224 [00:13<01:39,  1.98it/s]
Epoch 8 Iter 28: loss 0.18300. :  12%|█████▌                                        | 27/224 [00:14<01:39,  1.98it/s]
Epoch 8 Iter 28: loss 0.18300. :  12%|█████▊                                        | 28/224 [00:14<01:38,  1.99it/s]
Epoch 8 Iter 29: loss 0.17602. :  12%|█████▊                                        | 28/224 [00:14<01:38,  1.99it/s]
Epoch 8 Iter 29: loss 0.17602. :  13%|█████▉                                        | 29/224 [00:14<01:37,  1.99it/s]
Epoch 8 Iter 30: loss 0.16640. :  13%|█████▉                                        | 29/224 [00:15<01:37,  1.99it/s]
Epoch 8 Iter 30: loss 0.16640. :  13%|██████▏                                       | 30/224 [00:15<01:37,  1.98it/s]
Epoch 8 Iter 31: loss 0.18294. :  13%|██████▏                                       | 30/224 [00:15<01:37,  1.98it/s]
Epoch 8 Iter 31: loss 0.18294. :  14%|██████▎                                       | 31/224 [00:15<01:37,  1.98it/s]
Epoch 8 Iter 32: loss 0.17224. :  14%|██████▎                                       | 31/224 [00:16<01:37,  1.98it/s]
Epoch 8 Iter 32: loss 0.17224. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 8 Iter 33: loss 0.20476. :  14%|██████▌                                       | 32/224 [00:16<01:36,  1.99it/s]
Epoch 8 Iter 33: loss 0.20476. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.98it/s]
Epoch 8 Iter 34: loss 0.20316. :  15%|██████▊                                       | 33/224 [00:17<01:36,  1.98it/s]
Epoch 8 Iter 34: loss 0.20316. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 8 Iter 35: loss 0.17931. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.99it/s]
Epoch 8 Iter 35: loss 0.17931. :  16%|███████▏                                      | 35/224 [00:17<01:35,  1.98it/s]
Epoch 8 Iter 36: loss 0.16067. :  16%|███████▏                                      | 35/224 [00:18<01:35,  1.98it/s]
Epoch 8 Iter 36: loss 0.16067. :  16%|███████▍                                      | 36/224 [00:18<01:35,  1.98it/s]
Epoch 8 Iter 37: loss 0.18039. :  16%|███████▍                                      | 36/224 [00:18<01:35,  1.98it/s]
Epoch 8 Iter 37: loss 0.18039. :  17%|███████▌                                      | 37/224 [00:18<01:34,  1.98it/s]
Epoch 8 Iter 38: loss 0.16176. :  17%|███████▌                                      | 37/224 [00:19<01:34,  1.98it/s]
Epoch 8 Iter 38: loss 0.16176. :  17%|███████▊                                      | 38/224 [00:19<01:33,  1.99it/s]
Epoch 8 Iter 39: loss 0.17100. :  17%|███████▊                                      | 38/224 [00:19<01:33,  1.99it/s]
Epoch 8 Iter 39: loss 0.17100. :  17%|████████                                      | 39/224 [00:19<01:33,  1.98it/s]
Epoch 8 Iter 40: loss 0.15990. :  17%|████████                                      | 39/224 [00:20<01:33,  1.98it/s]
Epoch 8 Iter 40: loss 0.15990. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.98it/s]
Epoch 8 Iter 41: loss 0.17335. :  18%|████████▏                                     | 40/224 [00:20<01:32,  1.98it/s]
Epoch 8 Iter 41: loss 0.17335. :  18%|████████▍                                     | 41/224 [00:20<01:31,  2.01it/s]
Epoch 8 Iter 42: loss 0.18095. :  18%|████████▍                                     | 41/224 [00:21<01:31,  2.01it/s]
Epoch 8 Iter 42: loss 0.18095. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.98it/s]
Epoch 8 Iter 43: loss 0.18443. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.98it/s]
Epoch 8 Iter 43: loss 0.18443. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.98it/s]
Epoch 8 Iter 44: loss 0.16242. :  19%|████████▊                                     | 43/224 [00:22<01:31,  1.98it/s]
Epoch 8 Iter 44: loss 0.16242. :  20%|█████████                                     | 44/224 [00:22<01:30,  1.99it/s]
Epoch 8 Iter 45: loss 0.18514. :  20%|█████████                                     | 44/224 [00:22<01:30,  1.99it/s]
Epoch 8 Iter 45: loss 0.18514. :  20%|█████████▏                                    | 45/224 [00:22<01:29,  2.01it/s]
Epoch 8 Iter 46: loss 0.18800. :  20%|█████████▏                                    | 45/224 [00:23<01:29,  2.01it/s]
Epoch 8 Iter 46: loss 0.18800. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 8 Iter 47: loss 0.19433. :  21%|█████████▍                                    | 46/224 [00:23<01:28,  2.01it/s]
Epoch 8 Iter 47: loss 0.19433. :  21%|█████████▋                                    | 47/224 [00:23<01:29,  1.98it/s]
Epoch 8 Iter 48: loss 0.19030. :  21%|█████████▋                                    | 47/224 [00:24<01:29,  1.98it/s]
Epoch 8 Iter 48: loss 0.19030. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.99it/s]
Epoch 8 Iter 49: loss 0.19496. :  21%|█████████▊                                    | 48/224 [00:24<01:28,  1.99it/s]
Epoch 8 Iter 49: loss 0.19496. :  22%|██████████                                    | 49/224 [00:24<01:27,  2.00it/s]
Epoch 8 Iter 50: loss 0.17841. :  22%|██████████                                    | 49/224 [00:25<01:27,  2.00it/s]
Epoch 8 Iter 50: loss 0.17841. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.99it/s]
Epoch 8 Iter 51: loss 0.18001. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.99it/s]
Epoch 8 Iter 51: loss 0.18001. :  23%|██████████▍                                   | 51/224 [00:25<01:27,  1.98it/s]
Epoch 8 Iter 52: loss 0.16476. :  23%|██████████▍                                   | 51/224 [00:26<01:27,  1.98it/s]
Epoch 8 Iter 52: loss 0.16476. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.99it/s]
Epoch 8 Iter 53: loss 0.18190. :  23%|██████████▋                                   | 52/224 [00:26<01:26,  1.99it/s]
Epoch 8 Iter 53: loss 0.18190. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  1.99it/s]
Epoch 8 Iter 54: loss 0.18472. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  1.99it/s]
Epoch 8 Iter 54: loss 0.18472. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 8 Iter 55: loss 0.18081. :  24%|███████████                                   | 54/224 [00:27<01:24,  2.01it/s]
Epoch 8 Iter 55: loss 0.18081. :  25%|███████████▎                                  | 55/224 [00:27<01:23,  2.01it/s]
Epoch 8 Iter 56: loss 0.18827. :  25%|███████████▎                                  | 55/224 [00:28<01:23,  2.01it/s]
Epoch 8 Iter 56: loss 0.18827. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.01it/s]
Epoch 8 Iter 57: loss 0.17926. :  25%|███████████▌                                  | 56/224 [00:28<01:23,  2.01it/s]
Epoch 8 Iter 57: loss 0.17926. :  25%|███████████▋                                  | 57/224 [00:28<01:23,  2.01it/s]
Epoch 8 Iter 58: loss 0.18774. :  25%|███████████▋                                  | 57/224 [00:29<01:23,  2.01it/s]
Epoch 8 Iter 58: loss 0.18774. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 8 Iter 59: loss 0.19383. :  26%|███████████▉                                  | 58/224 [00:29<01:22,  2.01it/s]
Epoch 8 Iter 59: loss 0.19383. :  26%|████████████                                  | 59/224 [00:29<01:22,  2.01it/s]
Epoch 8 Iter 60: loss 0.18726. :  26%|████████████                                  | 59/224 [00:30<01:22,  2.01it/s]
Epoch 8 Iter 60: loss 0.18726. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.02it/s]
Epoch 8 Iter 61: loss 0.18717. :  27%|████████████▎                                 | 60/224 [00:30<01:21,  2.02it/s]
Epoch 8 Iter 61: loss 0.18717. :  27%|████████████▌                                 | 61/224 [00:30<01:20,  2.02it/s]
Epoch 8 Iter 62: loss 0.17411. :  27%|████████████▌                                 | 61/224 [00:31<01:20,  2.02it/s]
Epoch 8 Iter 62: loss 0.17411. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.00it/s]
Epoch 8 Iter 63: loss 0.19606. :  28%|████████████▋                                 | 62/224 [00:31<01:20,  2.00it/s]
Epoch 8 Iter 63: loss 0.19606. :  28%|████████████▉                                 | 63/224 [00:31<01:20,  2.01it/s]
Epoch 8 Iter 64: loss 0.18654. :  28%|████████████▉                                 | 63/224 [00:32<01:20,  2.01it/s]
Epoch 8 Iter 64: loss 0.18654. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  2.00it/s]
Epoch 8 Iter 65: loss 0.18339. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  2.00it/s]
Epoch 8 Iter 65: loss 0.18339. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.97it/s]
Epoch 8 Iter 66: loss 0.16422. :  29%|█████████████▎                                | 65/224 [00:33<01:20,  1.97it/s]
Epoch 8 Iter 66: loss 0.16422. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.98it/s]
Epoch 8 Iter 67: loss 0.16790. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.98it/s]
Epoch 8 Iter 67: loss 0.16790. :  30%|█████████████▊                                | 67/224 [00:33<01:19,  1.97it/s]
Epoch 8 Iter 68: loss 0.18550. :  30%|█████████████▊                                | 67/224 [00:34<01:19,  1.97it/s]
Epoch 8 Iter 68: loss 0.18550. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.97it/s]
Epoch 8 Iter 69: loss 0.17837. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.97it/s]
Epoch 8 Iter 69: loss 0.17837. :  31%|██████████████▏                               | 69/224 [00:34<01:20,  1.94it/s]
Epoch 8 Iter 70: loss 0.17961. :  31%|██████████████▏                               | 69/224 [00:35<01:20,  1.94it/s]
Epoch 8 Iter 70: loss 0.17961. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.95it/s]
Epoch 8 Iter 71: loss 0.17822. :  31%|██████████████▍                               | 70/224 [00:35<01:19,  1.95it/s]
Epoch 8 Iter 71: loss 0.17822. :  32%|██████████████▌                               | 71/224 [00:35<01:18,  1.94it/s]
Epoch 8 Iter 72: loss 0.17930. :  32%|██████████████▌                               | 71/224 [00:36<01:18,  1.94it/s]
Epoch 8 Iter 72: loss 0.17930. :  32%|██████████████▊                               | 72/224 [00:36<01:18,  1.95it/s]
Epoch 8 Iter 73: loss 0.17528. :  32%|██████████████▊                               | 72/224 [00:36<01:18,  1.95it/s]
Epoch 8 Iter 73: loss 0.17528. :  33%|██████████████▉                               | 73/224 [00:36<01:17,  1.95it/s]
Epoch 8 Iter 74: loss 0.18071. :  33%|██████████████▉                               | 73/224 [00:37<01:17,  1.95it/s]
Epoch 8 Iter 74: loss 0.18071. :  33%|███████████████▏                              | 74/224 [00:37<01:16,  1.96it/s]
Epoch 8 Iter 75: loss 0.17045. :  33%|███████████████▏                              | 74/224 [00:37<01:16,  1.96it/s]
Epoch 8 Iter 75: loss 0.17045. :  33%|███████████████▍                              | 75/224 [00:37<01:16,  1.95it/s]
Epoch 8 Iter 76: loss 0.17655. :  33%|███████████████▍                              | 75/224 [00:38<01:16,  1.95it/s]
Epoch 8 Iter 76: loss 0.17655. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.95it/s]
Epoch 8 Iter 77: loss 0.18034. :  34%|███████████████▌                              | 76/224 [00:38<01:16,  1.95it/s]
Epoch 8 Iter 77: loss 0.18034. :  34%|███████████████▊                              | 77/224 [00:38<01:15,  1.94it/s]
Epoch 8 Iter 78: loss 0.18910. :  34%|███████████████▊                              | 77/224 [00:39<01:15,  1.94it/s]
Epoch 8 Iter 78: loss 0.18910. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.97it/s]
Epoch 8 Iter 79: loss 0.17019. :  35%|████████████████                              | 78/224 [00:39<01:14,  1.97it/s]
Epoch 8 Iter 79: loss 0.17019. :  35%|████████████████▏                             | 79/224 [00:39<01:13,  1.98it/s]
Epoch 8 Iter 80: loss 0.16897. :  35%|████████████████▏                             | 79/224 [00:40<01:13,  1.98it/s]
Epoch 8 Iter 80: loss 0.16897. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  1.98it/s]
Epoch 8 Iter 81: loss 0.18958. :  36%|████████████████▍                             | 80/224 [00:40<01:12,  1.98it/s]
Epoch 8 Iter 81: loss 0.18958. :  36%|████████████████▋                             | 81/224 [00:40<01:11,  1.99it/s]
Epoch 8 Iter 82: loss 0.17646. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  1.99it/s]
Epoch 8 Iter 82: loss 0.17646. :  37%|████████████████▊                             | 82/224 [00:41<01:13,  1.93it/s]
Epoch 8 Iter 83: loss 0.17196. :  37%|████████████████▊                             | 82/224 [00:41<01:13,  1.93it/s]
Epoch 8 Iter 83: loss 0.17196. :  37%|█████████████████                             | 83/224 [00:41<01:12,  1.95it/s]
Epoch 8 Iter 84: loss 0.18770. :  37%|█████████████████                             | 83/224 [00:42<01:12,  1.95it/s]
Epoch 8 Iter 84: loss 0.18770. :  38%|█████████████████▎                            | 84/224 [00:42<01:11,  1.96it/s]
Epoch 8 Iter 85: loss 0.18264. :  38%|█████████████████▎                            | 84/224 [00:42<01:11,  1.96it/s]
Epoch 8 Iter 85: loss 0.18264. :  38%|█████████████████▍                            | 85/224 [00:42<01:10,  1.98it/s]
Epoch 8 Iter 86: loss 0.18286. :  38%|█████████████████▍                            | 85/224 [00:43<01:10,  1.98it/s]
Epoch 8 Iter 86: loss 0.18286. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  1.98it/s]
Epoch 8 Iter 87: loss 0.17497. :  38%|█████████████████▋                            | 86/224 [00:43<01:09,  1.98it/s]
Epoch 8 Iter 87: loss 0.17497. :  39%|█████████████████▊                            | 87/224 [00:43<01:11,  1.90it/s]
Epoch 8 Iter 88: loss 0.18678. :  39%|█████████████████▊                            | 87/224 [00:44<01:11,  1.90it/s]
Epoch 8 Iter 88: loss 0.18678. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.93it/s]
Epoch 8 Iter 89: loss 0.17796. :  39%|██████████████████                            | 88/224 [00:44<01:10,  1.93it/s]
Epoch 8 Iter 89: loss 0.17796. :  40%|██████████████████▎                           | 89/224 [00:44<01:11,  1.89it/s]
Epoch 8 Iter 90: loss 0.19029. :  40%|██████████████████▎                           | 89/224 [00:45<01:11,  1.89it/s]
Epoch 8 Iter 90: loss 0.19029. :  40%|██████████████████▍                           | 90/224 [00:45<01:09,  1.93it/s]
Epoch 8 Iter 91: loss 0.17745. :  40%|██████████████████▍                           | 90/224 [00:45<01:09,  1.93it/s]
Epoch 8 Iter 91: loss 0.17745. :  41%|██████████████████▋                           | 91/224 [00:45<01:08,  1.95it/s]
Epoch 8 Iter 92: loss 0.17473. :  41%|██████████████████▋                           | 91/224 [00:46<01:08,  1.95it/s]
Epoch 8 Iter 92: loss 0.17473. :  41%|██████████████████▉                           | 92/224 [00:46<01:07,  1.96it/s]
Epoch 8 Iter 93: loss 0.17506. :  41%|██████████████████▉                           | 92/224 [00:46<01:07,  1.96it/s]
Epoch 8 Iter 93: loss 0.17506. :  42%|███████████████████                           | 93/224 [00:46<01:06,  1.98it/s]
Epoch 8 Iter 94: loss 0.17803. :  42%|███████████████████                           | 93/224 [00:47<01:06,  1.98it/s]
Epoch 8 Iter 94: loss 0.17803. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.99it/s]
Epoch 8 Iter 95: loss 0.16556. :  42%|███████████████████▎                          | 94/224 [00:47<01:05,  1.99it/s]
Epoch 8 Iter 95: loss 0.16556. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.00it/s]
Epoch 8 Iter 96: loss 0.17219. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  2.00it/s]
Epoch 8 Iter 96: loss 0.17219. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.99it/s]
Epoch 8 Iter 97: loss 0.18625. :  43%|███████████████████▋                          | 96/224 [00:48<01:04,  1.99it/s]
Epoch 8 Iter 97: loss 0.18625. :  43%|███████████████████▉                          | 97/224 [00:48<01:04,  1.97it/s]
Epoch 8 Iter 98: loss 0.16772. :  43%|███████████████████▉                          | 97/224 [00:49<01:04,  1.97it/s]
Epoch 8 Iter 98: loss 0.16772. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.98it/s]
Epoch 8 Iter 99: loss 0.16799. :  44%|████████████████████▏                         | 98/224 [00:49<01:03,  1.98it/s]
Epoch 8 Iter 99: loss 0.16799. :  44%|████████████████████▎                         | 99/224 [00:49<01:02,  2.00it/s]
Epoch 8 Iter 100: loss 0.17977. :  44%|███████████████████▉                         | 99/224 [00:50<01:02,  2.00it/s]
Epoch 8 Iter 100: loss 0.17977. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.00it/s]
Epoch 8 Iter 101: loss 0.16699. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.00it/s]
Epoch 8 Iter 101: loss 0.16699. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.00it/s]
Epoch 8 Iter 102: loss 0.16800. :  45%|███████████████████▊                        | 101/224 [00:51<01:01,  2.00it/s]
Epoch 8 Iter 102: loss 0.16800. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.00it/s]
Epoch 8 Iter 103: loss 0.18861. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.00it/s]
Epoch 8 Iter 103: loss 0.18861. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.00it/s]
Epoch 8 Iter 104: loss 0.18631. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  2.00it/s]
Epoch 8 Iter 104: loss 0.18631. :  46%|████████████████████▍                       | 104/224 [00:52<01:00,  1.98it/s]
Epoch 8 Iter 105: loss 0.18002. :  46%|████████████████████▍                       | 104/224 [00:53<01:00,  1.98it/s]
Epoch 8 Iter 105: loss 0.18002. :  47%|████████████████████▋                       | 105/224 [00:53<01:02,  1.91it/s]
Epoch 8 Iter 106: loss 0.20333. :  47%|████████████████████▋                       | 105/224 [00:53<01:02,  1.91it/s]
Epoch 8 Iter 106: loss 0.20333. :  47%|████████████████████▊                       | 106/224 [00:53<01:00,  1.94it/s]
Epoch 8 Iter 107: loss 0.19437. :  47%|████████████████████▊                       | 106/224 [00:54<01:00,  1.94it/s]
Epoch 8 Iter 107: loss 0.19437. :  48%|█████████████████████                       | 107/224 [00:54<00:59,  1.95it/s]
Epoch 8 Iter 108: loss 0.18398. :  48%|█████████████████████                       | 107/224 [00:54<00:59,  1.95it/s]
Epoch 8 Iter 108: loss 0.18398. :  48%|█████████████████████▏                      | 108/224 [00:54<00:58,  1.98it/s]
Epoch 8 Iter 109: loss 0.20428. :  48%|█████████████████████▏                      | 108/224 [00:55<00:58,  1.98it/s]
Epoch 8 Iter 109: loss 0.20428. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.98it/s]
Epoch 8 Iter 110: loss 0.16443. :  49%|█████████████████████▍                      | 109/224 [00:55<00:58,  1.98it/s]
Epoch 8 Iter 110: loss 0.16443. :  49%|█████████████████████▌                      | 110/224 [00:55<00:57,  1.97it/s]
Epoch 8 Iter 111: loss 0.18700. :  49%|█████████████████████▌                      | 110/224 [00:56<00:57,  1.97it/s]
Epoch 8 Iter 111: loss 0.18700. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.95it/s]
Epoch 8 Iter 112: loss 0.17669. :  50%|█████████████████████▊                      | 111/224 [00:56<00:57,  1.95it/s]
Epoch 8 Iter 112: loss 0.17669. :  50%|██████████████████████                      | 112/224 [00:56<00:56,  1.97it/s]
Epoch 8 Iter 113: loss 0.18258. :  50%|██████████████████████                      | 112/224 [00:57<00:56,  1.97it/s]
Epoch 8 Iter 113: loss 0.18258. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.96it/s]
Epoch 8 Iter 114: loss 0.18754. :  50%|██████████████████████▏                     | 113/224 [00:57<00:56,  1.96it/s]
Epoch 8 Iter 114: loss 0.18754. :  51%|██████████████████████▍                     | 114/224 [00:57<00:55,  1.97it/s]
Epoch 8 Iter 115: loss 0.16055. :  51%|██████████████████████▍                     | 114/224 [00:58<00:55,  1.97it/s]
Epoch 8 Iter 115: loss 0.16055. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.95it/s]
Epoch 8 Iter 116: loss 0.17230. :  51%|██████████████████████▌                     | 115/224 [00:58<00:55,  1.95it/s]
Epoch 8 Iter 116: loss 0.17230. :  52%|██████████████████████▊                     | 116/224 [00:58<00:55,  1.95it/s]
Epoch 8 Iter 117: loss 0.18215. :  52%|██████████████████████▊                     | 116/224 [00:59<00:55,  1.95it/s]
Epoch 8 Iter 117: loss 0.18215. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.95it/s]
Epoch 8 Iter 118: loss 0.17893. :  52%|██████████████████████▉                     | 117/224 [00:59<00:54,  1.95it/s]
Epoch 8 Iter 118: loss 0.17893. :  53%|███████████████████████▏                    | 118/224 [00:59<00:54,  1.96it/s]
Epoch 8 Iter 119: loss 0.16720. :  53%|███████████████████████▏                    | 118/224 [01:00<00:54,  1.96it/s]
Epoch 8 Iter 119: loss 0.16720. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.97it/s]
Epoch 8 Iter 120: loss 0.17913. :  53%|███████████████████████▍                    | 119/224 [01:00<00:53,  1.97it/s]
Epoch 8 Iter 120: loss 0.17913. :  54%|███████████████████████▌                    | 120/224 [01:00<00:52,  1.98it/s]
Epoch 8 Iter 121: loss 0.18948. :  54%|███████████████████████▌                    | 120/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 121: loss 0.18948. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 122: loss 0.17765. :  54%|███████████████████████▊                    | 121/224 [01:01<00:52,  1.98it/s]
Epoch 8 Iter 122: loss 0.17765. :  54%|███████████████████████▉                    | 122/224 [01:01<00:51,  1.97it/s]
Epoch 8 Iter 123: loss 0.18766. :  54%|███████████████████████▉                    | 122/224 [01:02<00:51,  1.97it/s]
Epoch 8 Iter 123: loss 0.18766. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.92it/s]
Epoch 8 Iter 124: loss 0.18537. :  55%|████████████████████████▏                   | 123/224 [01:02<00:52,  1.92it/s]
Epoch 8 Iter 124: loss 0.18537. :  55%|████████████████████████▎                   | 124/224 [01:02<00:52,  1.90it/s]
Epoch 8 Iter 125: loss 0.16498. :  55%|████████████████████████▎                   | 124/224 [01:03<00:52,  1.90it/s]
Epoch 8 Iter 125: loss 0.16498. :  56%|████████████████████████▌                   | 125/224 [01:03<00:51,  1.93it/s]
Epoch 8 Iter 126: loss 0.18600. :  56%|████████████████████████▌                   | 125/224 [01:03<00:51,  1.93it/s]
Epoch 8 Iter 126: loss 0.18600. :  56%|████████████████████████▊                   | 126/224 [01:03<00:50,  1.94it/s]
Epoch 8 Iter 127: loss 0.16552. :  56%|████████████████████████▊                   | 126/224 [01:04<00:50,  1.94it/s]
Epoch 8 Iter 127: loss 0.16552. :  57%|████████████████████████▉                   | 127/224 [01:04<00:49,  1.95it/s]
Epoch 8 Iter 128: loss 0.17501. :  57%|████████████████████████▉                   | 127/224 [01:04<00:49,  1.95it/s]
Epoch 8 Iter 128: loss 0.17501. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:48,  1.97it/s]
Epoch 8 Iter 129: loss 0.18426. :  57%|█████████████████████████▏                  | 128/224 [01:05<00:48,  1.97it/s]
Epoch 8 Iter 129: loss 0.18426. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  1.98it/s]
Epoch 8 Iter 130: loss 0.17846. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:47,  1.98it/s]
Epoch 8 Iter 130: loss 0.17846. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:48,  1.96it/s]
Epoch 8 Iter 131: loss 0.17483. :  58%|█████████████████████████▌                  | 130/224 [01:06<00:48,  1.96it/s]
Epoch 8 Iter 131: loss 0.17483. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:47,  1.96it/s]
Epoch 8 Iter 132: loss 0.18543. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:47,  1.96it/s]
Epoch 8 Iter 132: loss 0.18543. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:46,  1.97it/s]
Epoch 8 Iter 133: loss 0.19892. :  59%|█████████████████████████▉                  | 132/224 [01:07<00:46,  1.97it/s]
Epoch 8 Iter 133: loss 0.19892. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.98it/s]
Epoch 8 Iter 134: loss 0.18550. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  1.98it/s]
Epoch 8 Iter 134: loss 0.18550. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:45,  1.98it/s]
Epoch 8 Iter 135: loss 0.18386. :  60%|██████████████████████████▎                 | 134/224 [01:08<00:45,  1.98it/s]
Epoch 8 Iter 135: loss 0.18386. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.99it/s]
Epoch 8 Iter 136: loss 0.18642. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  1.99it/s]
Epoch 8 Iter 136: loss 0.18642. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:44,  2.00it/s]
Epoch 8 Iter 137: loss 0.17184. :  61%|██████████████████████████▋                 | 136/224 [01:09<00:44,  2.00it/s]
Epoch 8 Iter 137: loss 0.17184. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  1.98it/s]
Epoch 8 Iter 138: loss 0.17299. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:43,  1.98it/s]
Epoch 8 Iter 138: loss 0.17299. :  62%|███████████████████████████                 | 138/224 [01:09<00:43,  1.96it/s]
Epoch 8 Iter 139: loss 0.16646. :  62%|███████████████████████████                 | 138/224 [01:10<00:43,  1.96it/s]
Epoch 8 Iter 139: loss 0.16646. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  1.98it/s]
Epoch 8 Iter 140: loss 0.18596. :  62%|███████████████████████████▎                | 139/224 [01:10<00:42,  1.98it/s]
Epoch 8 Iter 140: loss 0.18596. :  62%|███████████████████████████▌                | 140/224 [01:10<00:42,  1.99it/s]
Epoch 8 Iter 141: loss 0.17382. :  62%|███████████████████████████▌                | 140/224 [01:11<00:42,  1.99it/s]
Epoch 8 Iter 141: loss 0.17382. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.00it/s]
Epoch 8 Iter 142: loss 0.18528. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.00it/s]
Epoch 8 Iter 142: loss 0.18528. :  63%|███████████████████████████▉                | 142/224 [01:11<00:41,  1.99it/s]
Epoch 8 Iter 143: loss 0.18664. :  63%|███████████████████████████▉                | 142/224 [01:12<00:41,  1.99it/s]
Epoch 8 Iter 143: loss 0.18664. :  64%|████████████████████████████                | 143/224 [01:12<00:41,  1.97it/s]
Epoch 8 Iter 144: loss 0.18814. :  64%|████████████████████████████                | 143/224 [01:12<00:41,  1.97it/s]
Epoch 8 Iter 144: loss 0.18814. :  64%|████████████████████████████▎               | 144/224 [01:12<00:40,  1.98it/s]
Epoch 8 Iter 145: loss 0.18599. :  64%|████████████████████████████▎               | 144/224 [01:13<00:40,  1.98it/s]
Epoch 8 Iter 145: loss 0.18599. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  1.98it/s]
Epoch 8 Iter 146: loss 0.16631. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  1.98it/s]
Epoch 8 Iter 146: loss 0.16631. :  65%|████████████████████████████▋               | 146/224 [01:13<00:39,  1.99it/s]
Epoch 8 Iter 147: loss 0.19304. :  65%|████████████████████████████▋               | 146/224 [01:14<00:39,  1.99it/s]
Epoch 8 Iter 147: loss 0.19304. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.00it/s]
Epoch 8 Iter 148: loss 0.16394. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.00it/s]
Epoch 8 Iter 148: loss 0.16394. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.00it/s]
Epoch 8 Iter 149: loss 0.19111. :  66%|█████████████████████████████               | 148/224 [01:15<00:37,  2.00it/s]
Epoch 8 Iter 149: loss 0.19111. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.01it/s]
Epoch 8 Iter 150: loss 0.18174. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.01it/s]
Epoch 8 Iter 150: loss 0.18174. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:38,  1.93it/s]
Epoch 8 Iter 151: loss 0.19000. :  67%|█████████████████████████████▍              | 150/224 [01:16<00:38,  1.93it/s]
Epoch 8 Iter 151: loss 0.19000. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:37,  1.95it/s]
Epoch 8 Iter 152: loss 0.17123. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:37,  1.95it/s]
Epoch 8 Iter 152: loss 0.17123. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:36,  1.96it/s]
Epoch 8 Iter 153: loss 0.18123. :  68%|█████████████████████████████▊              | 152/224 [01:17<00:36,  1.96it/s]
Epoch 8 Iter 153: loss 0.18123. :  68%|██████████████████████████████              | 153/224 [01:17<00:36,  1.97it/s]
Epoch 8 Iter 154: loss 0.16988. :  68%|██████████████████████████████              | 153/224 [01:17<00:36,  1.97it/s]
Epoch 8 Iter 154: loss 0.16988. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:35,  1.98it/s]
Epoch 8 Iter 155: loss 0.17538. :  69%|██████████████████████████████▎             | 154/224 [01:18<00:35,  1.98it/s]
Epoch 8 Iter 155: loss 0.17538. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  1.98it/s]
Epoch 8 Iter 156: loss 0.16083. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  1.98it/s]
Epoch 8 Iter 156: loss 0.16083. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:34,  1.99it/s]
Epoch 8 Iter 157: loss 0.18299. :  70%|██████████████████████████████▋             | 156/224 [01:19<00:34,  1.99it/s]
Epoch 8 Iter 157: loss 0.18299. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.00it/s]
Epoch 8 Iter 158: loss 0.18945. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.00it/s]
Epoch 8 Iter 158: loss 0.18945. :  71%|███████████████████████████████             | 158/224 [01:19<00:33,  1.97it/s]
Epoch 8 Iter 159: loss 0.21001. :  71%|███████████████████████████████             | 158/224 [01:20<00:33,  1.97it/s]
Epoch 8 Iter 159: loss 0.21001. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  1.98it/s]
Epoch 8 Iter 160: loss 0.18987. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  1.98it/s]
Epoch 8 Iter 160: loss 0.18987. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:32,  1.98it/s]
Epoch 8 Iter 161: loss 0.17940. :  71%|███████████████████████████████▍            | 160/224 [01:21<00:32,  1.98it/s]
Epoch 8 Iter 161: loss 0.17940. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.99it/s]
Epoch 8 Iter 162: loss 0.17387. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  1.99it/s]
Epoch 8 Iter 162: loss 0.17387. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:31,  1.97it/s]
Epoch 8 Iter 163: loss 0.18762. :  72%|███████████████████████████████▊            | 162/224 [01:22<00:31,  1.97it/s]
Epoch 8 Iter 163: loss 0.18762. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  1.97it/s]
Epoch 8 Iter 164: loss 0.17382. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  1.97it/s]
Epoch 8 Iter 164: loss 0.17382. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.97it/s]
Epoch 8 Iter 165: loss 0.17805. :  73%|████████████████████████████████▏           | 164/224 [01:23<00:30,  1.97it/s]
Epoch 8 Iter 165: loss 0.17805. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  1.99it/s]
Epoch 8 Iter 166: loss 0.17999. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  1.99it/s]
Epoch 8 Iter 166: loss 0.17999. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:29,  2.00it/s]
Epoch 8 Iter 167: loss 0.18845. :  74%|████████████████████████████████▌           | 166/224 [01:24<00:29,  2.00it/s]
Epoch 8 Iter 167: loss 0.18845. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:29,  1.94it/s]
Epoch 8 Iter 168: loss 0.19568. :  75%|████████████████████████████████▊           | 167/224 [01:25<00:29,  1.94it/s]
Epoch 8 Iter 168: loss 0.19568. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.94it/s]
Epoch 8 Iter 169: loss 0.18820. :  75%|█████████████████████████████████           | 168/224 [01:25<00:28,  1.94it/s]
Epoch 8 Iter 169: loss 0.18820. :  75%|█████████████████████████████████▏          | 169/224 [01:25<00:28,  1.95it/s]
Epoch 8 Iter 170: loss 0.18308. :  75%|█████████████████████████████████▏          | 169/224 [01:26<00:28,  1.95it/s]
Epoch 8 Iter 170: loss 0.18308. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.96it/s]
Epoch 8 Iter 171: loss 0.17370. :  76%|█████████████████████████████████▍          | 170/224 [01:26<00:27,  1.96it/s]
Epoch 8 Iter 171: loss 0.17370. :  76%|█████████████████████████████████▌          | 171/224 [01:26<00:27,  1.95it/s]
Epoch 8 Iter 172: loss 0.17024. :  76%|█████████████████████████████████▌          | 171/224 [01:27<00:27,  1.95it/s]
Epoch 8 Iter 172: loss 0.17024. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.94it/s]
Epoch 8 Iter 173: loss 0.17444. :  77%|█████████████████████████████████▊          | 172/224 [01:27<00:26,  1.94it/s]
Epoch 8 Iter 173: loss 0.17444. :  77%|█████████████████████████████████▉          | 173/224 [01:27<00:26,  1.95it/s]
Epoch 8 Iter 174: loss 0.20191. :  77%|█████████████████████████████████▉          | 173/224 [01:28<00:26,  1.95it/s]
Epoch 8 Iter 174: loss 0.20191. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.94it/s]
Epoch 8 Iter 175: loss 0.19039. :  78%|██████████████████████████████████▏         | 174/224 [01:28<00:25,  1.94it/s]
Epoch 8 Iter 175: loss 0.19039. :  78%|██████████████████████████████████▍         | 175/224 [01:28<00:25,  1.94it/s]
Epoch 8 Iter 176: loss 0.15671. :  78%|██████████████████████████████████▍         | 175/224 [01:29<00:25,  1.94it/s]
Epoch 8 Iter 176: loss 0.15671. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.95it/s]
Epoch 8 Iter 177: loss 0.17322. :  79%|██████████████████████████████████▌         | 176/224 [01:29<00:24,  1.95it/s]
Epoch 8 Iter 177: loss 0.17322. :  79%|██████████████████████████████████▊         | 177/224 [01:29<00:24,  1.90it/s]
Epoch 8 Iter 178: loss 0.18040. :  79%|██████████████████████████████████▊         | 177/224 [01:30<00:24,  1.90it/s]
Epoch 8 Iter 178: loss 0.18040. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:24,  1.91it/s]
Epoch 8 Iter 179: loss 0.18004. :  79%|██████████████████████████████████▉         | 178/224 [01:30<00:24,  1.91it/s]
Epoch 8 Iter 179: loss 0.18004. :  80%|███████████████████████████████████▏        | 179/224 [01:30<00:23,  1.93it/s]
Epoch 8 Iter 180: loss 0.16560. :  80%|███████████████████████████████████▏        | 179/224 [01:31<00:23,  1.93it/s]
Epoch 8 Iter 180: loss 0.16560. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.96it/s]
Epoch 8 Iter 181: loss 0.17734. :  80%|███████████████████████████████████▎        | 180/224 [01:31<00:22,  1.96it/s]
Epoch 8 Iter 181: loss 0.17734. :  81%|███████████████████████████████████▌        | 181/224 [01:31<00:21,  1.98it/s]
Epoch 8 Iter 182: loss 0.15442. :  81%|███████████████████████████████████▌        | 181/224 [01:32<00:21,  1.98it/s]
Epoch 8 Iter 182: loss 0.15442. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 8 Iter 183: loss 0.19789. :  81%|███████████████████████████████████▊        | 182/224 [01:32<00:21,  1.98it/s]
Epoch 8 Iter 183: loss 0.19789. :  82%|███████████████████████████████████▉        | 183/224 [01:32<00:20,  1.99it/s]
Epoch 8 Iter 184: loss 0.18525. :  82%|███████████████████████████████████▉        | 183/224 [01:33<00:20,  1.99it/s]
Epoch 8 Iter 184: loss 0.18525. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.98it/s]
Epoch 8 Iter 185: loss 0.20075. :  82%|████████████████████████████████████▏       | 184/224 [01:33<00:20,  1.98it/s]
Epoch 8 Iter 185: loss 0.20075. :  83%|████████████████████████████████████▎       | 185/224 [01:33<00:19,  1.97it/s]
Epoch 8 Iter 186: loss 0.18952. :  83%|████████████████████████████████████▎       | 185/224 [01:34<00:19,  1.97it/s]
Epoch 8 Iter 186: loss 0.18952. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.96it/s]
Epoch 8 Iter 187: loss 0.17503. :  83%|████████████████████████████████████▌       | 186/224 [01:34<00:19,  1.96it/s]
Epoch 8 Iter 187: loss 0.17503. :  83%|████████████████████████████████████▋       | 187/224 [01:34<00:18,  1.97it/s]
Epoch 8 Iter 188: loss 0.18023. :  83%|████████████████████████████████████▋       | 187/224 [01:35<00:18,  1.97it/s]
Epoch 8 Iter 188: loss 0.18023. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.97it/s]
Epoch 8 Iter 189: loss 0.18580. :  84%|████████████████████████████████████▉       | 188/224 [01:35<00:18,  1.97it/s]
Epoch 8 Iter 189: loss 0.18580. :  84%|█████████████████████████████████████▏      | 189/224 [01:35<00:17,  1.98it/s]
Epoch 8 Iter 190: loss 0.18324. :  84%|█████████████████████████████████████▏      | 189/224 [01:36<00:17,  1.98it/s]
Epoch 8 Iter 190: loss 0.18324. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.98it/s]
Epoch 8 Iter 191: loss 0.18444. :  85%|█████████████████████████████████████▎      | 190/224 [01:36<00:17,  1.98it/s]
Epoch 8 Iter 191: loss 0.18444. :  85%|█████████████████████████████████████▌      | 191/224 [01:36<00:16,  1.98it/s]
Epoch 8 Iter 192: loss 0.17196. :  85%|█████████████████████████████████████▌      | 191/224 [01:37<00:16,  1.98it/s]
Epoch 8 Iter 192: loss 0.17196. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.98it/s]
Epoch 8 Iter 193: loss 0.18480. :  86%|█████████████████████████████████████▋      | 192/224 [01:37<00:16,  1.98it/s]
Epoch 8 Iter 193: loss 0.18480. :  86%|█████████████████████████████████████▉      | 193/224 [01:37<00:15,  1.96it/s]
Epoch 8 Iter 194: loss 0.18014. :  86%|█████████████████████████████████████▉      | 193/224 [01:38<00:15,  1.96it/s]
Epoch 8 Iter 194: loss 0.18014. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 8 Iter 195: loss 0.17066. :  87%|██████████████████████████████████████      | 194/224 [01:38<00:15,  1.97it/s]
Epoch 8 Iter 195: loss 0.17066. :  87%|██████████████████████████████████████▎     | 195/224 [01:38<00:14,  1.97it/s]
Epoch 8 Iter 196: loss 0.18226. :  87%|██████████████████████████████████████▎     | 195/224 [01:39<00:14,  1.97it/s]
Epoch 8 Iter 196: loss 0.18226. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.97it/s]
Epoch 8 Iter 197: loss 0.18311. :  88%|██████████████████████████████████████▌     | 196/224 [01:39<00:14,  1.97it/s]
Epoch 8 Iter 197: loss 0.18311. :  88%|██████████████████████████████████████▋     | 197/224 [01:39<00:13,  1.98it/s]
Epoch 8 Iter 198: loss 0.19504. :  88%|██████████████████████████████████████▋     | 197/224 [01:40<00:13,  1.98it/s]
Epoch 8 Iter 198: loss 0.19504. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  2.00it/s]
Epoch 8 Iter 199: loss 0.16937. :  88%|██████████████████████████████████████▉     | 198/224 [01:40<00:13,  2.00it/s]
Epoch 8 Iter 199: loss 0.16937. :  89%|███████████████████████████████████████     | 199/224 [01:40<00:12,  2.01it/s]
Epoch 8 Iter 200: loss 0.18877. :  89%|███████████████████████████████████████     | 199/224 [01:41<00:12,  2.01it/s]
Epoch 8 Iter 200: loss 0.18877. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.00it/s]
Epoch 8 Iter 201: loss 0.17561. :  89%|███████████████████████████████████████▎    | 200/224 [01:41<00:11,  2.00it/s]
Epoch 8 Iter 201: loss 0.17561. :  90%|███████████████████████████████████████▍    | 201/224 [01:41<00:11,  1.99it/s]
Epoch 8 Iter 202: loss 0.18377. :  90%|███████████████████████████████████████▍    | 201/224 [01:42<00:11,  1.99it/s]
Epoch 8 Iter 202: loss 0.18377. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 8 Iter 203: loss 0.19318. :  90%|███████████████████████████████████████▋    | 202/224 [01:42<00:11,  2.00it/s]
Epoch 8 Iter 203: loss 0.19318. :  91%|███████████████████████████████████████▉    | 203/224 [01:42<00:10,  1.97it/s]
Epoch 8 Iter 204: loss 0.20590. :  91%|███████████████████████████████████████▉    | 203/224 [01:43<00:10,  1.97it/s]
Epoch 8 Iter 204: loss 0.20590. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.97it/s]
Epoch 8 Iter 205: loss 0.18850. :  91%|████████████████████████████████████████    | 204/224 [01:43<00:10,  1.97it/s]
Epoch 8 Iter 205: loss 0.18850. :  92%|████████████████████████████████████████▎   | 205/224 [01:43<00:09,  1.99it/s]
Epoch 8 Iter 206: loss 0.18450. :  92%|████████████████████████████████████████▎   | 205/224 [01:44<00:09,  1.99it/s]
Epoch 8 Iter 206: loss 0.18450. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  2.00it/s]
Epoch 8 Iter 207: loss 0.17181. :  92%|████████████████████████████████████████▍   | 206/224 [01:44<00:09,  2.00it/s]
Epoch 8 Iter 207: loss 0.17181. :  92%|████████████████████████████████████████▋   | 207/224 [01:44<00:08,  2.00it/s]
Epoch 8 Iter 208: loss 0.18935. :  92%|████████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.00it/s]
Epoch 8 Iter 208: loss 0.18935. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 8 Iter 209: loss 0.16659. :  93%|████████████████████████████████████████▊   | 208/224 [01:45<00:07,  2.01it/s]
Epoch 8 Iter 209: loss 0.16659. :  93%|█████████████████████████████████████████   | 209/224 [01:45<00:07,  2.01it/s]
Epoch 8 Iter 210: loss 0.15186. :  93%|█████████████████████████████████████████   | 209/224 [01:46<00:07,  2.01it/s]
Epoch 8 Iter 210: loss 0.15186. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 8 Iter 211: loss 0.17992. :  94%|█████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.01it/s]
Epoch 8 Iter 211: loss 0.17992. :  94%|█████████████████████████████████████████▍  | 211/224 [01:46<00:06,  2.01it/s]
Epoch 8 Iter 212: loss 0.16431. :  94%|█████████████████████████████████████████▍  | 211/224 [01:47<00:06,  2.01it/s]
Epoch 8 Iter 212: loss 0.16431. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.01it/s]
Epoch 8 Iter 213: loss 0.17579. :  95%|█████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.01it/s]
Epoch 8 Iter 213: loss 0.17579. :  95%|█████████████████████████████████████████▊  | 213/224 [01:47<00:05,  2.02it/s]
Epoch 8 Iter 214: loss 0.18558. :  95%|█████████████████████████████████████████▊  | 213/224 [01:48<00:05,  2.02it/s]
Epoch 8 Iter 214: loss 0.18558. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 8 Iter 215: loss 0.16994. :  96%|██████████████████████████████████████████  | 214/224 [01:48<00:04,  2.02it/s]
Epoch 8 Iter 215: loss 0.16994. :  96%|██████████████████████████████████████████▏ | 215/224 [01:48<00:04,  2.01it/s]
Epoch 8 Iter 216: loss 0.16980. :  96%|██████████████████████████████████████████▏ | 215/224 [01:49<00:04,  2.01it/s]
Epoch 8 Iter 216: loss 0.16980. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 8 Iter 217: loss 0.17078. :  96%|██████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 8 Iter 217: loss 0.17078. :  97%|██████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.03it/s]
Epoch 8 Iter 218: loss 0.17120. :  97%|██████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.03it/s]
Epoch 8 Iter 218: loss 0.17120. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.01it/s]
Epoch 8 Iter 219: loss 0.17436. :  97%|██████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.01it/s]
Epoch 8 Iter 219: loss 0.17436. :  98%|███████████████████████████████████████████ | 219/224 [01:50<00:02,  2.02it/s]
Epoch 8 Iter 220: loss 0.18250. :  98%|███████████████████████████████████████████ | 219/224 [01:51<00:02,  2.02it/s]
Epoch 8 Iter 220: loss 0.18250. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.02it/s]
Epoch 8 Iter 221: loss 0.17197. :  98%|███████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.02it/s]
Epoch 8 Iter 221: loss 0.17197. :  99%|███████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.00it/s]
Epoch 8 Iter 222: loss 0.20158. :  99%|███████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.00it/s]
Epoch 8 Iter 222: loss 0.20158. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.01it/s]
Epoch 8 Iter 223: loss 0.20756. :  99%|███████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.01it/s]
Epoch 8 Iter 223: loss 0.20756. : 100%|███████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.02it/s]
Epoch 8 Iter 224: loss 0.17012. : 100%|███████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.02it/s]
Epoch 8 Iter 224: loss 0.17012. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  2.04it/s]
Epoch 8 Iter 224: loss 0.17012. : 100%|████████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.16988. :   0%|                                                        | 0/224 [00:00<?, ?it/s]
Epoch 9 Iter 1: loss 0.16988. :   0%|▏                                               | 1/224 [00:00<01:48,  2.05it/s]
Epoch 9 Iter 2: loss 0.18232. :   0%|▏                                               | 1/224 [00:00<01:48,  2.05it/s]
Epoch 9 Iter 2: loss 0.18232. :   1%|▍                                               | 2/224 [00:00<01:48,  2.04it/s]
Epoch 9 Iter 3: loss 0.19034. :   1%|▍                                               | 2/224 [00:01<01:48,  2.04it/s]
Epoch 9 Iter 3: loss 0.19034. :   1%|▋                                               | 3/224 [00:01<01:48,  2.03it/s]
Epoch 9 Iter 4: loss 0.19470. :   1%|▋                                               | 3/224 [00:01<01:48,  2.03it/s]
Epoch 9 Iter 4: loss 0.19470. :   2%|▊                                               | 4/224 [00:01<01:48,  2.04it/s]
Epoch 9 Iter 5: loss 0.17230. :   2%|▊                                               | 4/224 [00:02<01:48,  2.04it/s]
Epoch 9 Iter 5: loss 0.17230. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 9 Iter 6: loss 0.18617. :   2%|█                                               | 5/224 [00:02<01:47,  2.03it/s]
Epoch 9 Iter 6: loss 0.18617. :   3%|█▎                                              | 6/224 [00:02<01:48,  2.01it/s]
Epoch 9 Iter 7: loss 0.17126. :   3%|█▎                                              | 6/224 [00:03<01:48,  2.01it/s]
Epoch 9 Iter 7: loss 0.17126. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 9 Iter 8: loss 0.18714. :   3%|█▌                                              | 7/224 [00:03<01:48,  2.00it/s]
Epoch 9 Iter 8: loss 0.18714. :   4%|█▋                                              | 8/224 [00:03<01:48,  2.00it/s]
Epoch 9 Iter 9: loss 0.17211. :   4%|█▋                                              | 8/224 [00:04<01:48,  2.00it/s]
Epoch 9 Iter 9: loss 0.17211. :   4%|█▉                                              | 9/224 [00:04<01:47,  2.00it/s]
Epoch 9 Iter 10: loss 0.18882. :   4%|█▉                                             | 9/224 [00:04<01:47,  2.00it/s]
Epoch 9 Iter 10: loss 0.18882. :   4%|██                                            | 10/224 [00:04<01:46,  2.00it/s]
Epoch 9 Iter 11: loss 0.18012. :   4%|██                                            | 10/224 [00:05<01:46,  2.00it/s]
Epoch 9 Iter 11: loss 0.18012. :   5%|██▎                                           | 11/224 [00:05<01:46,  2.01it/s]
Epoch 9 Iter 12: loss 0.15970. :   5%|██▎                                           | 11/224 [00:06<01:46,  2.01it/s]
Epoch 9 Iter 12: loss 0.15970. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.96it/s]
Epoch 9 Iter 13: loss 0.17841. :   5%|██▍                                           | 12/224 [00:06<01:48,  1.96it/s]
Epoch 9 Iter 13: loss 0.17841. :   6%|██▋                                           | 13/224 [00:06<01:47,  1.96it/s]
Epoch 9 Iter 14: loss 0.18040. :   6%|██▋                                           | 13/224 [00:07<01:47,  1.96it/s]
Epoch 9 Iter 14: loss 0.18040. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.98it/s]
Epoch 9 Iter 15: loss 0.19459. :   6%|██▉                                           | 14/224 [00:07<01:46,  1.98it/s]
Epoch 9 Iter 15: loss 0.19459. :   7%|███                                           | 15/224 [00:07<01:44,  1.99it/s]
Epoch 9 Iter 16: loss 0.17745. :   7%|███                                           | 15/224 [00:07<01:44,  1.99it/s]
Epoch 9 Iter 16: loss 0.17745. :   7%|███▎                                          | 16/224 [00:07<01:43,  2.00it/s]
Epoch 9 Iter 17: loss 0.18407. :   7%|███▎                                          | 16/224 [00:08<01:43,  2.00it/s]
Epoch 9 Iter 17: loss 0.18407. :   8%|███▍                                          | 17/224 [00:08<01:43,  2.00it/s]
Epoch 9 Iter 18: loss 0.18567. :   8%|███▍                                          | 17/224 [00:09<01:43,  2.00it/s]
Epoch 9 Iter 18: loss 0.18567. :   8%|███▋                                          | 18/224 [00:09<01:44,  1.97it/s]
Epoch 9 Iter 19: loss 0.18739. :   8%|███▋                                          | 18/224 [00:09<01:44,  1.97it/s]
Epoch 9 Iter 19: loss 0.18739. :   8%|███▉                                          | 19/224 [00:09<01:43,  1.98it/s]
Epoch 9 Iter 20: loss 0.19445. :   8%|███▉                                          | 19/224 [00:10<01:43,  1.98it/s]
Epoch 9 Iter 20: loss 0.19445. :   9%|████                                          | 20/224 [00:10<01:43,  1.97it/s]
Epoch 9 Iter 21: loss 0.15538. :   9%|████                                          | 20/224 [00:10<01:43,  1.97it/s]
Epoch 9 Iter 21: loss 0.15538. :   9%|████▎                                         | 21/224 [00:10<01:42,  1.97it/s]
Epoch 9 Iter 22: loss 0.16845. :   9%|████▎                                         | 21/224 [00:11<01:42,  1.97it/s]
Epoch 9 Iter 22: loss 0.16845. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.98it/s]
Epoch 9 Iter 23: loss 0.16513. :  10%|████▌                                         | 22/224 [00:11<01:41,  1.98it/s]
Epoch 9 Iter 23: loss 0.16513. :  10%|████▋                                         | 23/224 [00:11<01:41,  1.98it/s]
Epoch 9 Iter 24: loss 0.17012. :  10%|████▋                                         | 23/224 [00:12<01:41,  1.98it/s]
Epoch 9 Iter 24: loss 0.17012. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.17001. :  11%|████▉                                         | 24/224 [00:12<01:42,  1.95it/s]
Epoch 9 Iter 25: loss 0.17001. :  11%|█████▏                                        | 25/224 [00:12<01:43,  1.91it/s]
Epoch 9 Iter 26: loss 0.18440. :  11%|█████▏                                        | 25/224 [00:13<01:43,  1.91it/s]
Epoch 9 Iter 26: loss 0.18440. :  12%|█████▎                                        | 26/224 [00:13<01:41,  1.94it/s]
Epoch 9 Iter 27: loss 0.16782. :  12%|█████▎                                        | 26/224 [00:13<01:41,  1.94it/s]
Epoch 9 Iter 27: loss 0.16782. :  12%|█████▌                                        | 27/224 [00:13<01:40,  1.96it/s]
Epoch 9 Iter 28: loss 0.18340. :  12%|█████▌                                        | 27/224 [00:14<01:40,  1.96it/s]
Epoch 9 Iter 28: loss 0.18340. :  12%|█████▊                                        | 28/224 [00:14<01:39,  1.98it/s]
Epoch 9 Iter 29: loss 0.16326. :  12%|█████▊                                        | 28/224 [00:14<01:39,  1.98it/s]
Epoch 9 Iter 29: loss 0.16326. :  13%|█████▉                                        | 29/224 [00:14<01:38,  1.99it/s]
Epoch 9 Iter 30: loss 0.19006. :  13%|█████▉                                        | 29/224 [00:15<01:38,  1.99it/s]
Epoch 9 Iter 30: loss 0.19006. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 9 Iter 31: loss 0.18142. :  13%|██████▏                                       | 30/224 [00:15<01:38,  1.97it/s]
Epoch 9 Iter 31: loss 0.18142. :  14%|██████▎                                       | 31/224 [00:15<01:37,  1.98it/s]
Epoch 9 Iter 32: loss 0.19941. :  14%|██████▎                                       | 31/224 [00:16<01:37,  1.98it/s]
Epoch 9 Iter 32: loss 0.19941. :  14%|██████▌                                       | 32/224 [00:16<01:36,  2.00it/s]
Epoch 9 Iter 33: loss 0.19299. :  14%|██████▌                                       | 32/224 [00:16<01:36,  2.00it/s]
Epoch 9 Iter 33: loss 0.19299. :  15%|██████▊                                       | 33/224 [00:16<01:36,  1.99it/s]
Epoch 9 Iter 34: loss 0.16869. :  15%|██████▊                                       | 33/224 [00:17<01:36,  1.99it/s]
Epoch 9 Iter 34: loss 0.16869. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.98it/s]
Epoch 9 Iter 35: loss 0.17664. :  15%|██████▉                                       | 34/224 [00:17<01:35,  1.98it/s]
Epoch 9 Iter 35: loss 0.17664. :  16%|███████▏                                      | 35/224 [00:17<01:37,  1.95it/s]
Epoch 9 Iter 36: loss 0.15950. :  16%|███████▏                                      | 35/224 [00:18<01:37,  1.95it/s]
Epoch 9 Iter 36: loss 0.15950. :  16%|███████▍                                      | 36/224 [00:18<01:38,  1.90it/s]
Epoch 9 Iter 37: loss 0.18251. :  16%|███████▍                                      | 36/224 [00:18<01:38,  1.90it/s]
Epoch 9 Iter 37: loss 0.18251. :  17%|███████▌                                      | 37/224 [00:18<01:36,  1.93it/s]
Epoch 9 Iter 38: loss 0.17933. :  17%|███████▌                                      | 37/224 [00:19<01:36,  1.93it/s]
Epoch 9 Iter 38: loss 0.17933. :  17%|███████▊                                      | 38/224 [00:19<01:35,  1.95it/s]
Epoch 9 Iter 39: loss 0.18999. :  17%|███████▊                                      | 38/224 [00:19<01:35,  1.95it/s]
Epoch 9 Iter 39: loss 0.18999. :  17%|████████                                      | 39/224 [00:19<01:34,  1.96it/s]
Epoch 9 Iter 40: loss 0.17852. :  17%|████████                                      | 39/224 [00:20<01:34,  1.96it/s]
Epoch 9 Iter 40: loss 0.17852. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 9 Iter 41: loss 0.18640. :  18%|████████▏                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 9 Iter 41: loss 0.18640. :  18%|████████▍                                     | 41/224 [00:20<01:33,  1.97it/s]
Epoch 9 Iter 42: loss 0.19451. :  18%|████████▍                                     | 41/224 [00:21<01:33,  1.97it/s]
Epoch 9 Iter 42: loss 0.19451. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.96it/s]
Epoch 9 Iter 43: loss 0.18925. :  19%|████████▋                                     | 42/224 [00:21<01:32,  1.96it/s]
Epoch 9 Iter 43: loss 0.18925. :  19%|████████▊                                     | 43/224 [00:21<01:31,  1.97it/s]
Epoch 9 Iter 44: loss 0.18434. :  19%|████████▊                                     | 43/224 [00:22<01:31,  1.97it/s]
Epoch 9 Iter 44: loss 0.18434. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.97it/s]
Epoch 9 Iter 45: loss 0.20097. :  20%|█████████                                     | 44/224 [00:22<01:31,  1.97it/s]
Epoch 9 Iter 45: loss 0.20097. :  20%|█████████▏                                    | 45/224 [00:22<01:30,  1.98it/s]
Epoch 9 Iter 46: loss 0.18130. :  20%|█████████▏                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 9 Iter 46: loss 0.18130. :  21%|█████████▍                                    | 46/224 [00:23<01:32,  1.93it/s]
Epoch 9 Iter 47: loss 0.19530. :  21%|█████████▍                                    | 46/224 [00:23<01:32,  1.93it/s]
Epoch 9 Iter 47: loss 0.19530. :  21%|█████████▋                                    | 47/224 [00:23<01:31,  1.94it/s]
Epoch 9 Iter 48: loss 0.16013. :  21%|█████████▋                                    | 47/224 [00:24<01:31,  1.94it/s]
Epoch 9 Iter 48: loss 0.16013. :  21%|█████████▊                                    | 48/224 [00:24<01:29,  1.96it/s]
Epoch 9 Iter 49: loss 0.18486. :  21%|█████████▊                                    | 48/224 [00:24<01:29,  1.96it/s]
Epoch 9 Iter 49: loss 0.18486. :  22%|██████████                                    | 49/224 [00:24<01:29,  1.96it/s]
Epoch 9 Iter 50: loss 0.18265. :  22%|██████████                                    | 49/224 [00:25<01:29,  1.96it/s]
Epoch 9 Iter 50: loss 0.18265. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.98it/s]
Epoch 9 Iter 51: loss 0.19358. :  22%|██████████▎                                   | 50/224 [00:25<01:27,  1.98it/s]
Epoch 9 Iter 51: loss 0.19358. :  23%|██████████▍                                   | 51/224 [00:25<01:26,  2.00it/s]
Epoch 9 Iter 52: loss 0.19151. :  23%|██████████▍                                   | 51/224 [00:26<01:26,  2.00it/s]
Epoch 9 Iter 52: loss 0.19151. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 9 Iter 53: loss 0.16318. :  23%|██████████▋                                   | 52/224 [00:26<01:25,  2.01it/s]
Epoch 9 Iter 53: loss 0.16318. :  24%|██████████▉                                   | 53/224 [00:26<01:25,  2.01it/s]
Epoch 9 Iter 54: loss 0.19191. :  24%|██████████▉                                   | 53/224 [00:27<01:25,  2.01it/s]
Epoch 9 Iter 54: loss 0.19191. :  24%|███████████                                   | 54/224 [00:27<01:25,  2.00it/s]
Epoch 9 Iter 55: loss 0.20435. :  24%|███████████                                   | 54/224 [00:27<01:25,  2.00it/s]
Epoch 9 Iter 55: loss 0.20435. :  25%|███████████▎                                  | 55/224 [00:27<01:26,  1.94it/s]
Epoch 9 Iter 56: loss 0.19037. :  25%|███████████▎                                  | 55/224 [00:28<01:26,  1.94it/s]
Epoch 9 Iter 56: loss 0.19037. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.95it/s]
Epoch 9 Iter 57: loss 0.17018. :  25%|███████████▌                                  | 56/224 [00:28<01:25,  1.95it/s]
Epoch 9 Iter 57: loss 0.17018. :  25%|███████████▋                                  | 57/224 [00:28<01:25,  1.96it/s]
Epoch 9 Iter 58: loss 0.17744. :  25%|███████████▋                                  | 57/224 [00:29<01:25,  1.96it/s]
Epoch 9 Iter 58: loss 0.17744. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.96it/s]
Epoch 9 Iter 59: loss 0.16059. :  26%|███████████▉                                  | 58/224 [00:29<01:24,  1.96it/s]
Epoch 9 Iter 59: loss 0.16059. :  26%|████████████                                  | 59/224 [00:29<01:23,  1.97it/s]
Epoch 9 Iter 60: loss 0.17980. :  26%|████████████                                  | 59/224 [00:30<01:23,  1.97it/s]
Epoch 9 Iter 60: loss 0.17980. :  27%|████████████▎                                 | 60/224 [00:30<01:23,  1.97it/s]
Epoch 9 Iter 61: loss 0.16955. :  27%|████████████▎                                 | 60/224 [00:30<01:23,  1.97it/s]
Epoch 9 Iter 61: loss 0.16955. :  27%|████████████▌                                 | 61/224 [00:30<01:22,  1.97it/s]
Epoch 9 Iter 62: loss 0.19759. :  27%|████████████▌                                 | 61/224 [00:31<01:22,  1.97it/s]
Epoch 9 Iter 62: loss 0.19759. :  28%|████████████▋                                 | 62/224 [00:31<01:22,  1.97it/s]
Epoch 9 Iter 63: loss 0.16512. :  28%|████████████▋                                 | 62/224 [00:31<01:22,  1.97it/s]
Epoch 9 Iter 63: loss 0.16512. :  28%|████████████▉                                 | 63/224 [00:31<01:21,  1.97it/s]
Epoch 9 Iter 64: loss 0.17553. :  28%|████████████▉                                 | 63/224 [00:32<01:21,  1.97it/s]
Epoch 9 Iter 64: loss 0.17553. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 9 Iter 65: loss 0.17786. :  29%|█████████████▏                                | 64/224 [00:32<01:20,  1.98it/s]
Epoch 9 Iter 65: loss 0.17786. :  29%|█████████████▎                                | 65/224 [00:32<01:20,  1.98it/s]
Epoch 9 Iter 66: loss 0.18269. :  29%|█████████████▎                                | 65/224 [00:33<01:20,  1.98it/s]
Epoch 9 Iter 66: loss 0.18269. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.99it/s]
Epoch 9 Iter 67: loss 0.17319. :  29%|█████████████▌                                | 66/224 [00:33<01:19,  1.99it/s]
Epoch 9 Iter 67: loss 0.17319. :  30%|█████████████▊                                | 67/224 [00:33<01:20,  1.95it/s]
Epoch 9 Iter 68: loss 0.17800. :  30%|█████████████▊                                | 67/224 [00:34<01:20,  1.95it/s]
Epoch 9 Iter 68: loss 0.17800. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.95it/s]
Epoch 9 Iter 69: loss 0.16528. :  30%|█████████████▉                                | 68/224 [00:34<01:19,  1.95it/s]
Epoch 9 Iter 69: loss 0.16528. :  31%|██████████████▏                               | 69/224 [00:34<01:18,  1.97it/s]
Epoch 9 Iter 70: loss 0.17636. :  31%|██████████████▏                               | 69/224 [00:35<01:18,  1.97it/s]
Epoch 9 Iter 70: loss 0.17636. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.99it/s]
Epoch 9 Iter 71: loss 0.18977. :  31%|██████████████▍                               | 70/224 [00:35<01:17,  1.99it/s]
Epoch 9 Iter 71: loss 0.18977. :  32%|██████████████▌                               | 71/224 [00:35<01:16,  2.00it/s]
Epoch 9 Iter 72: loss 0.17617. :  32%|██████████████▌                               | 71/224 [00:36<01:16,  2.00it/s]
Epoch 9 Iter 72: loss 0.17617. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 9 Iter 73: loss 0.16275. :  32%|██████████████▊                               | 72/224 [00:36<01:15,  2.01it/s]
Epoch 9 Iter 73: loss 0.16275. :  33%|██████████████▉                               | 73/224 [00:36<01:14,  2.01it/s]
Epoch 9 Iter 74: loss 0.16925. :  33%|██████████████▉                               | 73/224 [00:37<01:14,  2.01it/s]
Epoch 9 Iter 74: loss 0.16925. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 9 Iter 75: loss 0.18331. :  33%|███████████████▏                              | 74/224 [00:37<01:14,  2.02it/s]
Epoch 9 Iter 75: loss 0.18331. :  33%|███████████████▍                              | 75/224 [00:37<01:13,  2.02it/s]
Epoch 9 Iter 76: loss 0.20204. :  33%|███████████████▍                              | 75/224 [00:38<01:13,  2.02it/s]
Epoch 9 Iter 76: loss 0.20204. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 9 Iter 77: loss 0.17402. :  34%|███████████████▌                              | 76/224 [00:38<01:13,  2.02it/s]
Epoch 9 Iter 77: loss 0.17402. :  34%|███████████████▊                              | 77/224 [00:38<01:12,  2.03it/s]
Epoch 9 Iter 78: loss 0.18443. :  34%|███████████████▊                              | 77/224 [00:39<01:12,  2.03it/s]
Epoch 9 Iter 78: loss 0.18443. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.03it/s]
Epoch 9 Iter 79: loss 0.16046. :  35%|████████████████                              | 78/224 [00:39<01:12,  2.03it/s]
Epoch 9 Iter 79: loss 0.16046. :  35%|████████████████▏                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 9 Iter 80: loss 0.19646. :  35%|████████████████▏                             | 79/224 [00:40<01:11,  2.02it/s]
Epoch 9 Iter 80: loss 0.19646. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 9 Iter 81: loss 0.16185. :  36%|████████████████▍                             | 80/224 [00:40<01:11,  2.02it/s]
Epoch 9 Iter 81: loss 0.16185. :  36%|████████████████▋                             | 81/224 [00:40<01:11,  2.01it/s]
Epoch 9 Iter 82: loss 0.16937. :  36%|████████████████▋                             | 81/224 [00:41<01:11,  2.01it/s]
Epoch 9 Iter 82: loss 0.16937. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.01it/s]
Epoch 9 Iter 83: loss 0.16184. :  37%|████████████████▊                             | 82/224 [00:41<01:10,  2.01it/s]
Epoch 9 Iter 83: loss 0.16184. :  37%|█████████████████                             | 83/224 [00:41<01:09,  2.02it/s]
Epoch 9 Iter 84: loss 0.17429. :  37%|█████████████████                             | 83/224 [00:42<01:09,  2.02it/s]
Epoch 9 Iter 84: loss 0.17429. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.02it/s]
Epoch 9 Iter 85: loss 0.17178. :  38%|█████████████████▎                            | 84/224 [00:42<01:09,  2.02it/s]
Epoch 9 Iter 85: loss 0.17178. :  38%|█████████████████▍                            | 85/224 [00:42<01:08,  2.02it/s]
Epoch 9 Iter 86: loss 0.19014. :  38%|█████████████████▍                            | 85/224 [00:43<01:08,  2.02it/s]
Epoch 9 Iter 86: loss 0.19014. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 9 Iter 87: loss 0.18162. :  38%|█████████████████▋                            | 86/224 [00:43<01:08,  2.02it/s]
Epoch 9 Iter 87: loss 0.18162. :  39%|█████████████████▊                            | 87/224 [00:43<01:07,  2.02it/s]
Epoch 9 Iter 88: loss 0.17556. :  39%|█████████████████▊                            | 87/224 [00:44<01:07,  2.02it/s]
Epoch 9 Iter 88: loss 0.17556. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.01it/s]
Epoch 9 Iter 89: loss 0.17313. :  39%|██████████████████                            | 88/224 [00:44<01:07,  2.01it/s]
Epoch 9 Iter 89: loss 0.17313. :  40%|██████████████████▎                           | 89/224 [00:44<01:08,  1.97it/s]
Epoch 9 Iter 90: loss 0.16805. :  40%|██████████████████▎                           | 89/224 [00:45<01:08,  1.97it/s]
Epoch 9 Iter 90: loss 0.16805. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  2.00it/s]
Epoch 9 Iter 91: loss 0.16493. :  40%|██████████████████▍                           | 90/224 [00:45<01:07,  2.00it/s]
Epoch 9 Iter 91: loss 0.16493. :  41%|██████████████████▋                           | 91/224 [00:45<01:06,  1.99it/s]
Epoch 9 Iter 92: loss 0.18117. :  41%|██████████████████▋                           | 91/224 [00:46<01:06,  1.99it/s]
Epoch 9 Iter 92: loss 0.18117. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.01it/s]
Epoch 9 Iter 93: loss 0.19430. :  41%|██████████████████▉                           | 92/224 [00:46<01:05,  2.01it/s]
Epoch 9 Iter 93: loss 0.19430. :  42%|███████████████████                           | 93/224 [00:46<01:04,  2.02it/s]
Epoch 9 Iter 94: loss 0.17322. :  42%|███████████████████                           | 93/224 [00:47<01:04,  2.02it/s]
Epoch 9 Iter 94: loss 0.17322. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.00it/s]
Epoch 9 Iter 95: loss 0.17030. :  42%|███████████████████▎                          | 94/224 [00:47<01:04,  2.00it/s]
Epoch 9 Iter 95: loss 0.17030. :  42%|███████████████████▌                          | 95/224 [00:47<01:04,  2.01it/s]
Epoch 9 Iter 96: loss 0.18112. :  42%|███████████████████▌                          | 95/224 [00:48<01:04,  2.01it/s]
Epoch 9 Iter 96: loss 0.18112. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.01it/s]
Epoch 9 Iter 97: loss 0.16873. :  43%|███████████████████▋                          | 96/224 [00:48<01:03,  2.01it/s]
Epoch 9 Iter 97: loss 0.16873. :  43%|███████████████████▉                          | 97/224 [00:48<01:02,  2.03it/s]
Epoch 9 Iter 98: loss 0.16683. :  43%|███████████████████▉                          | 97/224 [00:49<01:02,  2.03it/s]
Epoch 9 Iter 98: loss 0.16683. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.02it/s]
Epoch 9 Iter 99: loss 0.16877. :  44%|████████████████████▏                         | 98/224 [00:49<01:02,  2.02it/s]
Epoch 9 Iter 99: loss 0.16877. :  44%|████████████████████▎                         | 99/224 [00:49<01:01,  2.02it/s]
Epoch 9 Iter 100: loss 0.18199. :  44%|███████████████████▉                         | 99/224 [00:50<01:01,  2.02it/s]
Epoch 9 Iter 100: loss 0.18199. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.02it/s]
Epoch 9 Iter 101: loss 0.20889. :  45%|███████████████████▋                        | 100/224 [00:50<01:01,  2.02it/s]
Epoch 9 Iter 101: loss 0.20889. :  45%|███████████████████▊                        | 101/224 [00:50<01:01,  2.01it/s]
Epoch 9 Iter 102: loss 0.17883. :  45%|███████████████████▊                        | 101/224 [00:51<01:01,  2.01it/s]
Epoch 9 Iter 102: loss 0.17883. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.01it/s]
Epoch 9 Iter 103: loss 0.19177. :  46%|████████████████████                        | 102/224 [00:51<01:00,  2.01it/s]
Epoch 9 Iter 103: loss 0.19177. :  46%|████████████████████▏                       | 103/224 [00:51<01:00,  2.01it/s]
Epoch 9 Iter 104: loss 0.17528. :  46%|████████████████████▏                       | 103/224 [00:52<01:00,  2.01it/s]
Epoch 9 Iter 104: loss 0.17528. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 9 Iter 105: loss 0.16858. :  46%|████████████████████▍                       | 104/224 [00:52<00:59,  2.02it/s]
Epoch 9 Iter 105: loss 0.16858. :  47%|████████████████████▋                       | 105/224 [00:52<00:59,  1.99it/s]
Epoch 9 Iter 106: loss 0.18423. :  47%|████████████████████▋                       | 105/224 [00:53<00:59,  1.99it/s]
Epoch 9 Iter 106: loss 0.18423. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  2.00it/s]
Epoch 9 Iter 107: loss 0.19406. :  47%|████████████████████▊                       | 106/224 [00:53<00:59,  2.00it/s]
Epoch 9 Iter 107: loss 0.19406. :  48%|█████████████████████                       | 107/224 [00:53<00:58,  1.99it/s]
Epoch 9 Iter 108: loss 0.17937. :  48%|█████████████████████                       | 107/224 [00:54<00:58,  1.99it/s]
Epoch 9 Iter 108: loss 0.17937. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 9 Iter 109: loss 0.18679. :  48%|█████████████████████▏                      | 108/224 [00:54<00:57,  2.01it/s]
Epoch 9 Iter 109: loss 0.18679. :  49%|█████████████████████▍                      | 109/224 [00:54<00:56,  2.02it/s]
Epoch 9 Iter 110: loss 0.18783. :  49%|█████████████████████▍                      | 109/224 [00:55<00:56,  2.02it/s]
Epoch 9 Iter 110: loss 0.18783. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 9 Iter 111: loss 0.16573. :  49%|█████████████████████▌                      | 110/224 [00:55<00:56,  2.03it/s]
Epoch 9 Iter 111: loss 0.16573. :  50%|█████████████████████▊                      | 111/224 [00:55<00:55,  2.04it/s]
Epoch 9 Iter 112: loss 0.18753. :  50%|█████████████████████▊                      | 111/224 [00:56<00:55,  2.04it/s]
Epoch 9 Iter 112: loss 0.18753. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.03it/s]
Epoch 9 Iter 113: loss 0.18423. :  50%|██████████████████████                      | 112/224 [00:56<00:55,  2.03it/s]
Epoch 9 Iter 113: loss 0.18423. :  50%|██████████████████████▏                     | 113/224 [00:56<00:54,  2.03it/s]
Epoch 9 Iter 114: loss 0.19875. :  50%|██████████████████████▏                     | 113/224 [00:57<00:54,  2.03it/s]
Epoch 9 Iter 114: loss 0.19875. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.02it/s]
Epoch 9 Iter 115: loss 0.17684. :  51%|██████████████████████▍                     | 114/224 [00:57<00:54,  2.02it/s]
Epoch 9 Iter 115: loss 0.17684. :  51%|██████████████████████▌                     | 115/224 [00:57<00:54,  2.01it/s]
Epoch 9 Iter 116: loss 0.17964. :  51%|██████████████████████▌                     | 115/224 [00:58<00:54,  2.01it/s]
Epoch 9 Iter 116: loss 0.17964. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.01it/s]
Epoch 9 Iter 117: loss 0.17581. :  52%|██████████████████████▊                     | 116/224 [00:58<00:53,  2.01it/s]
Epoch 9 Iter 117: loss 0.17581. :  52%|██████████████████████▉                     | 117/224 [00:58<00:52,  2.02it/s]
Epoch 9 Iter 118: loss 0.19256. :  52%|██████████████████████▉                     | 117/224 [00:59<00:52,  2.02it/s]
Epoch 9 Iter 118: loss 0.19256. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.02it/s]
Epoch 9 Iter 119: loss 0.19350. :  53%|███████████████████████▏                    | 118/224 [00:59<00:52,  2.02it/s]
Epoch 9 Iter 119: loss 0.19350. :  53%|███████████████████████▍                    | 119/224 [00:59<00:51,  2.02it/s]
Epoch 9 Iter 120: loss 0.17544. :  53%|███████████████████████▍                    | 119/224 [01:00<00:51,  2.02it/s]
Epoch 9 Iter 120: loss 0.17544. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 9 Iter 121: loss 0.18334. :  54%|███████████████████████▌                    | 120/224 [01:00<00:51,  2.02it/s]
Epoch 9 Iter 121: loss 0.18334. :  54%|███████████████████████▊                    | 121/224 [01:00<00:50,  2.02it/s]
Epoch 9 Iter 122: loss 0.18204. :  54%|███████████████████████▊                    | 121/224 [01:01<00:50,  2.02it/s]
Epoch 9 Iter 122: loss 0.18204. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.03it/s]
Epoch 9 Iter 123: loss 0.16555. :  54%|███████████████████████▉                    | 122/224 [01:01<00:50,  2.03it/s]
Epoch 9 Iter 123: loss 0.16555. :  55%|████████████████████████▏                   | 123/224 [01:01<00:49,  2.03it/s]
Epoch 9 Iter 124: loss 0.17657. :  55%|████████████████████████▏                   | 123/224 [01:02<00:49,  2.03it/s]
Epoch 9 Iter 124: loss 0.17657. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.02it/s]
Epoch 9 Iter 125: loss 0.17321. :  55%|████████████████████████▎                   | 124/224 [01:02<00:49,  2.02it/s]
Epoch 9 Iter 125: loss 0.17321. :  56%|████████████████████████▌                   | 125/224 [01:02<00:48,  2.02it/s]
Epoch 9 Iter 126: loss 0.18059. :  56%|████████████████████████▌                   | 125/224 [01:03<00:48,  2.02it/s]
Epoch 9 Iter 126: loss 0.18059. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.03it/s]
Epoch 9 Iter 127: loss 0.17713. :  56%|████████████████████████▊                   | 126/224 [01:03<00:48,  2.03it/s]
Epoch 9 Iter 127: loss 0.17713. :  57%|████████████████████████▉                   | 127/224 [01:03<00:47,  2.03it/s]
Epoch 9 Iter 128: loss 0.17663. :  57%|████████████████████████▉                   | 127/224 [01:04<00:47,  2.03it/s]
Epoch 9 Iter 128: loss 0.17663. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.02it/s]
Epoch 9 Iter 129: loss 0.18051. :  57%|█████████████████████████▏                  | 128/224 [01:04<00:47,  2.02it/s]
Epoch 9 Iter 129: loss 0.18051. :  58%|█████████████████████████▎                  | 129/224 [01:04<00:46,  2.03it/s]
Epoch 9 Iter 130: loss 0.18621. :  58%|█████████████████████████▎                  | 129/224 [01:05<00:46,  2.03it/s]
Epoch 9 Iter 130: loss 0.18621. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  1.99it/s]
Epoch 9 Iter 131: loss 0.18505. :  58%|█████████████████████████▌                  | 130/224 [01:05<00:47,  1.99it/s]
Epoch 9 Iter 131: loss 0.18505. :  58%|█████████████████████████▋                  | 131/224 [01:05<00:46,  2.01it/s]
Epoch 9 Iter 132: loss 0.18009. :  58%|█████████████████████████▋                  | 131/224 [01:06<00:46,  2.01it/s]
Epoch 9 Iter 132: loss 0.18009. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.01it/s]
Epoch 9 Iter 133: loss 0.19898. :  59%|█████████████████████████▉                  | 132/224 [01:06<00:45,  2.01it/s]
Epoch 9 Iter 133: loss 0.19898. :  59%|██████████████████████████▏                 | 133/224 [01:06<00:45,  2.01it/s]
Epoch 9 Iter 134: loss 0.18667. :  59%|██████████████████████████▏                 | 133/224 [01:07<00:45,  2.01it/s]
Epoch 9 Iter 134: loss 0.18667. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.02it/s]
Epoch 9 Iter 135: loss 0.17800. :  60%|██████████████████████████▎                 | 134/224 [01:07<00:44,  2.02it/s]
Epoch 9 Iter 135: loss 0.17800. :  60%|██████████████████████████▌                 | 135/224 [01:07<00:44,  2.02it/s]
Epoch 9 Iter 136: loss 0.18194. :  60%|██████████████████████████▌                 | 135/224 [01:08<00:44,  2.02it/s]
Epoch 9 Iter 136: loss 0.18194. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.03it/s]
Epoch 9 Iter 137: loss 0.17452. :  61%|██████████████████████████▋                 | 136/224 [01:08<00:43,  2.03it/s]
Epoch 9 Iter 137: loss 0.17452. :  61%|██████████████████████████▉                 | 137/224 [01:08<00:42,  2.02it/s]
Epoch 9 Iter 138: loss 0.17600. :  61%|██████████████████████████▉                 | 137/224 [01:09<00:42,  2.02it/s]
Epoch 9 Iter 138: loss 0.17600. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 9 Iter 139: loss 0.18850. :  62%|███████████████████████████                 | 138/224 [01:09<00:42,  2.02it/s]
Epoch 9 Iter 139: loss 0.18850. :  62%|███████████████████████████▎                | 139/224 [01:09<00:41,  2.03it/s]
Epoch 9 Iter 140: loss 0.16953. :  62%|███████████████████████████▎                | 139/224 [01:10<00:41,  2.03it/s]
Epoch 9 Iter 140: loss 0.16953. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.02it/s]
Epoch 9 Iter 141: loss 0.17903. :  62%|███████████████████████████▌                | 140/224 [01:10<00:41,  2.02it/s]
Epoch 9 Iter 141: loss 0.17903. :  63%|███████████████████████████▋                | 141/224 [01:10<00:41,  2.01it/s]
Epoch 9 Iter 142: loss 0.17648. :  63%|███████████████████████████▋                | 141/224 [01:11<00:41,  2.01it/s]
Epoch 9 Iter 142: loss 0.17648. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 9 Iter 143: loss 0.16929. :  63%|███████████████████████████▉                | 142/224 [01:11<00:40,  2.02it/s]
Epoch 9 Iter 143: loss 0.16929. :  64%|████████████████████████████                | 143/224 [01:11<00:40,  2.02it/s]
Epoch 9 Iter 144: loss 0.17513. :  64%|████████████████████████████                | 143/224 [01:12<00:40,  2.02it/s]
Epoch 9 Iter 144: loss 0.17513. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.01it/s]
Epoch 9 Iter 145: loss 0.17746. :  64%|████████████████████████████▎               | 144/224 [01:12<00:39,  2.01it/s]
Epoch 9 Iter 145: loss 0.17746. :  65%|████████████████████████████▍               | 145/224 [01:12<00:39,  2.01it/s]
Epoch 9 Iter 146: loss 0.17598. :  65%|████████████████████████████▍               | 145/224 [01:13<00:39,  2.01it/s]
Epoch 9 Iter 146: loss 0.17598. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.03it/s]
Epoch 9 Iter 147: loss 0.17129. :  65%|████████████████████████████▋               | 146/224 [01:13<00:38,  2.03it/s]
Epoch 9 Iter 147: loss 0.17129. :  66%|████████████████████████████▉               | 147/224 [01:13<00:38,  2.02it/s]
Epoch 9 Iter 148: loss 0.18149. :  66%|████████████████████████████▉               | 147/224 [01:14<00:38,  2.02it/s]
Epoch 9 Iter 148: loss 0.18149. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.03it/s]
Epoch 9 Iter 149: loss 0.18880. :  66%|█████████████████████████████               | 148/224 [01:14<00:37,  2.03it/s]
Epoch 9 Iter 149: loss 0.18880. :  67%|█████████████████████████████▎              | 149/224 [01:14<00:37,  2.03it/s]
Epoch 9 Iter 150: loss 0.18869. :  67%|█████████████████████████████▎              | 149/224 [01:15<00:37,  2.03it/s]
Epoch 9 Iter 150: loss 0.18869. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.03it/s]
Epoch 9 Iter 151: loss 0.17665. :  67%|█████████████████████████████▍              | 150/224 [01:15<00:36,  2.03it/s]
Epoch 9 Iter 151: loss 0.17665. :  67%|█████████████████████████████▋              | 151/224 [01:15<00:35,  2.03it/s]
Epoch 9 Iter 152: loss 0.17021. :  67%|█████████████████████████████▋              | 151/224 [01:16<00:35,  2.03it/s]
Epoch 9 Iter 152: loss 0.17021. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.03it/s]
Epoch 9 Iter 153: loss 0.17331. :  68%|█████████████████████████████▊              | 152/224 [01:16<00:35,  2.03it/s]
Epoch 9 Iter 153: loss 0.17331. :  68%|██████████████████████████████              | 153/224 [01:16<00:34,  2.04it/s]
Epoch 9 Iter 154: loss 0.18070. :  68%|██████████████████████████████              | 153/224 [01:17<00:34,  2.04it/s]
Epoch 9 Iter 154: loss 0.18070. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.01it/s]
Epoch 9 Iter 155: loss 0.18798. :  69%|██████████████████████████████▎             | 154/224 [01:17<00:34,  2.01it/s]
Epoch 9 Iter 155: loss 0.18798. :  69%|██████████████████████████████▍             | 155/224 [01:17<00:34,  2.02it/s]
Epoch 9 Iter 156: loss 0.18659. :  69%|██████████████████████████████▍             | 155/224 [01:18<00:34,  2.02it/s]
Epoch 9 Iter 156: loss 0.18659. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.03it/s]
Epoch 9 Iter 157: loss 0.17611. :  70%|██████████████████████████████▋             | 156/224 [01:18<00:33,  2.03it/s]
Epoch 9 Iter 157: loss 0.17611. :  70%|██████████████████████████████▊             | 157/224 [01:18<00:33,  2.03it/s]
Epoch 9 Iter 158: loss 0.16059. :  70%|██████████████████████████████▊             | 157/224 [01:19<00:33,  2.03it/s]
Epoch 9 Iter 158: loss 0.16059. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.02it/s]
Epoch 9 Iter 159: loss 0.18602. :  71%|███████████████████████████████             | 158/224 [01:19<00:32,  2.02it/s]
Epoch 9 Iter 159: loss 0.18602. :  71%|███████████████████████████████▏            | 159/224 [01:19<00:32,  2.02it/s]
Epoch 9 Iter 160: loss 0.18693. :  71%|███████████████████████████████▏            | 159/224 [01:20<00:32,  2.02it/s]
Epoch 9 Iter 160: loss 0.18693. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.02it/s]
Epoch 9 Iter 161: loss 0.17705. :  71%|███████████████████████████████▍            | 160/224 [01:20<00:31,  2.02it/s]
Epoch 9 Iter 161: loss 0.17705. :  72%|███████████████████████████████▋            | 161/224 [01:20<00:31,  2.02it/s]
Epoch 9 Iter 162: loss 0.17824. :  72%|███████████████████████████████▋            | 161/224 [01:21<00:31,  2.02it/s]
Epoch 9 Iter 162: loss 0.17824. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.03it/s]
Epoch 9 Iter 163: loss 0.17430. :  72%|███████████████████████████████▊            | 162/224 [01:21<00:30,  2.03it/s]
Epoch 9 Iter 163: loss 0.17430. :  73%|████████████████████████████████            | 163/224 [01:21<00:30,  2.01it/s]
Epoch 9 Iter 164: loss 0.16945. :  73%|████████████████████████████████            | 163/224 [01:22<00:30,  2.01it/s]
Epoch 9 Iter 164: loss 0.16945. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.99it/s]
Epoch 9 Iter 165: loss 0.18036. :  73%|████████████████████████████████▏           | 164/224 [01:22<00:30,  1.99it/s]
Epoch 9 Iter 165: loss 0.18036. :  74%|████████████████████████████████▍           | 165/224 [01:22<00:29,  2.00it/s]
Epoch 9 Iter 166: loss 0.20839. :  74%|████████████████████████████████▍           | 165/224 [01:23<00:29,  2.00it/s]
Epoch 9 Iter 166: loss 0.20839. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.01it/s]
Epoch 9 Iter 167: loss 0.17415. :  74%|████████████████████████████████▌           | 166/224 [01:23<00:28,  2.01it/s]
Epoch 9 Iter 167: loss 0.17415. :  75%|████████████████████████████████▊           | 167/224 [01:23<00:28,  2.02it/s]
Epoch 9 Iter 168: loss 0.17073. :  75%|████████████████████████████████▊           | 167/224 [01:24<00:28,  2.02it/s]
Epoch 9 Iter 168: loss 0.17073. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.02it/s]
Epoch 9 Iter 169: loss 0.18329. :  75%|█████████████████████████████████           | 168/224 [01:24<00:27,  2.02it/s]
Epoch 9 Iter 169: loss 0.18329. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.03it/s]
Epoch 9 Iter 170: loss 0.19407. :  75%|█████████████████████████████████▏          | 169/224 [01:24<00:27,  2.03it/s]
Epoch 9 Iter 170: loss 0.19407. :  76%|█████████████████████████████████▍          | 170/224 [01:24<00:26,  2.03it/s]
Epoch 9 Iter 171: loss 0.18460. :  76%|█████████████████████████████████▍          | 170/224 [01:25<00:26,  2.03it/s]
Epoch 9 Iter 171: loss 0.18460. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 9 Iter 172: loss 0.16239. :  76%|█████████████████████████████████▌          | 171/224 [01:25<00:26,  2.02it/s]
Epoch 9 Iter 172: loss 0.16239. :  77%|█████████████████████████████████▊          | 172/224 [01:25<00:25,  2.02it/s]
Epoch 9 Iter 173: loss 0.18222. :  77%|█████████████████████████████████▊          | 172/224 [01:26<00:25,  2.02it/s]
Epoch 9 Iter 173: loss 0.18222. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.02it/s]
Epoch 9 Iter 174: loss 0.16042. :  77%|█████████████████████████████████▉          | 173/224 [01:26<00:25,  2.02it/s]
Epoch 9 Iter 174: loss 0.16042. :  78%|██████████████████████████████████▏         | 174/224 [01:26<00:24,  2.01it/s]
Epoch 9 Iter 175: loss 0.18678. :  78%|██████████████████████████████████▏         | 174/224 [01:27<00:24,  2.01it/s]
Epoch 9 Iter 175: loss 0.18678. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 9 Iter 176: loss 0.18001. :  78%|██████████████████████████████████▍         | 175/224 [01:27<00:24,  2.01it/s]
Epoch 9 Iter 176: loss 0.18001. :  79%|██████████████████████████████████▌         | 176/224 [01:27<00:23,  2.02it/s]
Epoch 9 Iter 177: loss 0.19043. :  79%|██████████████████████████████████▌         | 176/224 [01:28<00:23,  2.02it/s]
Epoch 9 Iter 177: loss 0.19043. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 9 Iter 178: loss 0.20157. :  79%|██████████████████████████████████▊         | 177/224 [01:28<00:23,  2.03it/s]
Epoch 9 Iter 178: loss 0.20157. :  79%|██████████████████████████████████▉         | 178/224 [01:28<00:22,  2.03it/s]
Epoch 9 Iter 179: loss 0.18720. :  79%|██████████████████████████████████▉         | 178/224 [01:29<00:22,  2.03it/s]
Epoch 9 Iter 179: loss 0.18720. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 9 Iter 180: loss 0.17184. :  80%|███████████████████████████████████▏        | 179/224 [01:29<00:22,  2.03it/s]
Epoch 9 Iter 180: loss 0.17184. :  80%|███████████████████████████████████▎        | 180/224 [01:29<00:21,  2.02it/s]
Epoch 9 Iter 181: loss 0.18344. :  80%|███████████████████████████████████▎        | 180/224 [01:30<00:21,  2.02it/s]
Epoch 9 Iter 181: loss 0.18344. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.02it/s]
Epoch 9 Iter 182: loss 0.17215. :  81%|███████████████████████████████████▌        | 181/224 [01:30<00:21,  2.02it/s]
Epoch 9 Iter 182: loss 0.17215. :  81%|███████████████████████████████████▊        | 182/224 [01:30<00:20,  2.03it/s]
Epoch 9 Iter 183: loss 0.17210. :  81%|███████████████████████████████████▊        | 182/224 [01:31<00:20,  2.03it/s]
Epoch 9 Iter 183: loss 0.17210. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.03it/s]
Epoch 9 Iter 184: loss 0.18761. :  82%|███████████████████████████████████▉        | 183/224 [01:31<00:20,  2.03it/s]
Epoch 9 Iter 184: loss 0.18761. :  82%|████████████████████████████████████▏       | 184/224 [01:31<00:19,  2.03it/s]
Epoch 9 Iter 185: loss 0.18403. :  82%|████████████████████████████████████▏       | 184/224 [01:32<00:19,  2.03it/s]
Epoch 9 Iter 185: loss 0.18403. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.03it/s]
Epoch 9 Iter 186: loss 0.18784. :  83%|████████████████████████████████████▎       | 185/224 [01:32<00:19,  2.03it/s]
Epoch 9 Iter 186: loss 0.18784. :  83%|████████████████████████████████████▌       | 186/224 [01:32<00:18,  2.03it/s]
Epoch 9 Iter 187: loss 0.17058. :  83%|████████████████████████████████████▌       | 186/224 [01:33<00:18,  2.03it/s]
Epoch 9 Iter 187: loss 0.17058. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 9 Iter 188: loss 0.18076. :  83%|████████████████████████████████████▋       | 187/224 [01:33<00:18,  2.02it/s]
Epoch 9 Iter 188: loss 0.18076. :  84%|████████████████████████████████████▉       | 188/224 [01:33<00:17,  2.02it/s]
Epoch 9 Iter 189: loss 0.16691. :  84%|████████████████████████████████████▉       | 188/224 [01:34<00:17,  2.02it/s]
Epoch 9 Iter 189: loss 0.16691. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.03it/s]
Epoch 9 Iter 190: loss 0.15825. :  84%|█████████████████████████████████████▏      | 189/224 [01:34<00:17,  2.03it/s]
Epoch 9 Iter 190: loss 0.15825. :  85%|█████████████████████████████████████▎      | 190/224 [01:34<00:16,  2.02it/s]
Epoch 9 Iter 191: loss 0.18715. :  85%|█████████████████████████████████████▎      | 190/224 [01:35<00:16,  2.02it/s]
Epoch 9 Iter 191: loss 0.18715. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.02it/s]
Epoch 9 Iter 192: loss 0.16859. :  85%|█████████████████████████████████████▌      | 191/224 [01:35<00:16,  2.02it/s]
Epoch 9 Iter 192: loss 0.16859. :  86%|█████████████████████████████████████▋      | 192/224 [01:35<00:15,  2.02it/s]
Epoch 9 Iter 193: loss 0.17978. :  86%|█████████████████████████████████████▋      | 192/224 [01:36<00:15,  2.02it/s]
Epoch 9 Iter 193: loss 0.17978. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.03it/s]
Epoch 9 Iter 194: loss 0.18308. :  86%|█████████████████████████████████████▉      | 193/224 [01:36<00:15,  2.03it/s]
Epoch 9 Iter 194: loss 0.18308. :  87%|██████████████████████████████████████      | 194/224 [01:36<00:14,  2.02it/s]
Epoch 9 Iter 195: loss 0.18500. :  87%|██████████████████████████████████████      | 194/224 [01:37<00:14,  2.02it/s]
Epoch 9 Iter 195: loss 0.18500. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.01it/s]
Epoch 9 Iter 196: loss 0.19459. :  87%|██████████████████████████████████████▎     | 195/224 [01:37<00:14,  2.01it/s]
Epoch 9 Iter 196: loss 0.19459. :  88%|██████████████████████████████████████▌     | 196/224 [01:37<00:13,  2.01it/s]
Epoch 9 Iter 197: loss 0.19006. :  88%|██████████████████████████████████████▌     | 196/224 [01:38<00:13,  2.01it/s]
Epoch 9 Iter 197: loss 0.19006. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.02it/s]
Epoch 9 Iter 198: loss 0.18339. :  88%|██████████████████████████████████████▋     | 197/224 [01:38<00:13,  2.02it/s]
Epoch 9 Iter 198: loss 0.18339. :  88%|██████████████████████████████████████▉     | 198/224 [01:38<00:12,  2.03it/s]
Epoch 9 Iter 199: loss 0.17675. :  88%|██████████████████████████████████████▉     | 198/224 [01:39<00:12,  2.03it/s]
Epoch 9 Iter 199: loss 0.17675. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.03it/s]
Epoch 9 Iter 200: loss 0.19808. :  89%|███████████████████████████████████████     | 199/224 [01:39<00:12,  2.03it/s]
Epoch 9 Iter 200: loss 0.19808. :  89%|███████████████████████████████████████▎    | 200/224 [01:39<00:11,  2.02it/s]
Epoch 9 Iter 201: loss 0.18660. :  89%|███████████████████████████████████████▎    | 200/224 [01:40<00:11,  2.02it/s]
Epoch 9 Iter 201: loss 0.18660. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 9 Iter 202: loss 0.16964. :  90%|███████████████████████████████████████▍    | 201/224 [01:40<00:11,  2.01it/s]
Epoch 9 Iter 202: loss 0.16964. :  90%|███████████████████████████████████████▋    | 202/224 [01:40<00:10,  2.01it/s]
Epoch 9 Iter 203: loss 0.16896. :  90%|███████████████████████████████████████▋    | 202/224 [01:41<00:10,  2.01it/s]
Epoch 9 Iter 203: loss 0.16896. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.00it/s]
Epoch 9 Iter 204: loss 0.16455. :  91%|███████████████████████████████████████▉    | 203/224 [01:41<00:10,  2.00it/s]
Epoch 9 Iter 204: loss 0.16455. :  91%|████████████████████████████████████████    | 204/224 [01:41<00:10,  1.96it/s]
Epoch 9 Iter 205: loss 0.16699. :  91%|████████████████████████████████████████    | 204/224 [01:42<00:10,  1.96it/s]
Epoch 9 Iter 205: loss 0.16699. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.95it/s]
Epoch 9 Iter 206: loss 0.17144. :  92%|████████████████████████████████████████▎   | 205/224 [01:42<00:09,  1.95it/s]
Epoch 9 Iter 206: loss 0.17144. :  92%|████████████████████████████████████████▍   | 206/224 [01:42<00:09,  1.95it/s]
Epoch 9 Iter 207: loss 0.18549. :  92%|████████████████████████████████████████▍   | 206/224 [01:43<00:09,  1.95it/s]
Epoch 9 Iter 207: loss 0.18549. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.98it/s]
Epoch 9 Iter 208: loss 0.15696. :  92%|████████████████████████████████████████▋   | 207/224 [01:43<00:08,  1.98it/s]
Epoch 9 Iter 208: loss 0.15696. :  93%|████████████████████████████████████████▊   | 208/224 [01:43<00:08,  1.99it/s]
Epoch 9 Iter 209: loss 0.19510. :  93%|████████████████████████████████████████▊   | 208/224 [01:44<00:08,  1.99it/s]
Epoch 9 Iter 209: loss 0.19510. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 9 Iter 210: loss 0.16740. :  93%|█████████████████████████████████████████   | 209/224 [01:44<00:07,  2.00it/s]
Epoch 9 Iter 210: loss 0.16740. :  94%|█████████████████████████████████████████▎  | 210/224 [01:44<00:07,  2.00it/s]
Epoch 9 Iter 211: loss 0.18362. :  94%|█████████████████████████████████████████▎  | 210/224 [01:45<00:07,  2.00it/s]
Epoch 9 Iter 211: loss 0.18362. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.99it/s]
Epoch 9 Iter 212: loss 0.18043. :  94%|█████████████████████████████████████████▍  | 211/224 [01:45<00:06,  1.99it/s]
Epoch 9 Iter 212: loss 0.18043. :  95%|█████████████████████████████████████████▋  | 212/224 [01:45<00:06,  2.00it/s]
Epoch 9 Iter 213: loss 0.16310. :  95%|█████████████████████████████████████████▋  | 212/224 [01:46<00:06,  2.00it/s]
Epoch 9 Iter 213: loss 0.16310. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.18876. :  95%|█████████████████████████████████████████▊  | 213/224 [01:46<00:05,  1.98it/s]
Epoch 9 Iter 214: loss 0.18876. :  96%|██████████████████████████████████████████  | 214/224 [01:46<00:05,  1.98it/s]
Epoch 9 Iter 215: loss 0.21132. :  96%|██████████████████████████████████████████  | 214/224 [01:47<00:05,  1.98it/s]
Epoch 9 Iter 215: loss 0.21132. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.97it/s]
Epoch 9 Iter 216: loss 0.18153. :  96%|██████████████████████████████████████████▏ | 215/224 [01:47<00:04,  1.97it/s]
Epoch 9 Iter 216: loss 0.18153. :  96%|██████████████████████████████████████████▍ | 216/224 [01:47<00:04,  1.98it/s]
Epoch 9 Iter 217: loss 0.17474. :  96%|██████████████████████████████████████████▍ | 216/224 [01:48<00:04,  1.98it/s]
Epoch 9 Iter 217: loss 0.17474. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  1.99it/s]
Epoch 9 Iter 218: loss 0.17793. :  97%|██████████████████████████████████████████▋ | 217/224 [01:48<00:03,  1.99it/s]
Epoch 9 Iter 218: loss 0.17793. :  97%|██████████████████████████████████████████▊ | 218/224 [01:48<00:02,  2.01it/s]
Epoch 9 Iter 219: loss 0.19362. :  97%|██████████████████████████████████████████▊ | 218/224 [01:49<00:02,  2.01it/s]
Epoch 9 Iter 219: loss 0.19362. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.99it/s]
Epoch 9 Iter 220: loss 0.20131. :  98%|███████████████████████████████████████████ | 219/224 [01:49<00:02,  1.99it/s]
Epoch 9 Iter 220: loss 0.20131. :  98%|███████████████████████████████████████████▏| 220/224 [01:49<00:02,  1.99it/s]
Epoch 9 Iter 221: loss 0.16475. :  98%|███████████████████████████████████████████▏| 220/224 [01:50<00:02,  1.99it/s]
Epoch 9 Iter 221: loss 0.16475. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.99it/s]
Epoch 9 Iter 222: loss 0.17020. :  99%|███████████████████████████████████████████▍| 221/224 [01:50<00:01,  1.99it/s]
Epoch 9 Iter 222: loss 0.17020. :  99%|███████████████████████████████████████████▌| 222/224 [01:50<00:01,  1.99it/s]
Epoch 9 Iter 223: loss 0.18945. :  99%|███████████████████████████████████████████▌| 222/224 [01:51<00:01,  1.99it/s]
Epoch 9 Iter 223: loss 0.18945. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 9 Iter 224: loss 0.17726. : 100%|███████████████████████████████████████████▊| 223/224 [01:51<00:00,  2.00it/s]
Epoch 9 Iter 224: loss 0.17726. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  1.99it/s]
Epoch 9 Iter 224: loss 0.17726. : 100%|████████████████████████████████████████████| 224/224 [01:51<00:00,  2.00it/s]

    Train loss: 0.17973
    Valid loss: 0.18155
       Valid loss recons: 0.17586
       Valid loss KL-D:   56.97651
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.17048. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 10 Iter 1: loss 0.17048. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 10 Iter 2: loss 0.19101. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 10 Iter 2: loss 0.19101. :   1%|▍                                              | 2/224 [00:00<01:49,  2.02it/s]
Epoch 10 Iter 3: loss 0.17472. :   1%|▍                                              | 2/224 [00:01<01:49,  2.02it/s]
Epoch 10 Iter 3: loss 0.17472. :   1%|▋                                              | 3/224 [00:01<01:49,  2.02it/s]
Epoch 10 Iter 4: loss 0.18037. :   1%|▋                                              | 3/224 [00:01<01:49,  2.02it/s]
Epoch 10 Iter 4: loss 0.18037. :   2%|▊                                              | 4/224 [00:01<01:48,  2.03it/s]
Epoch 10 Iter 5: loss 0.17988. :   2%|▊                                              | 4/224 [00:02<01:48,  2.03it/s]
Epoch 10 Iter 5: loss 0.17988. :   2%|█                                              | 5/224 [00:02<01:48,  2.03it/s]
Epoch 10 Iter 6: loss 0.18412. :   2%|█                                              | 5/224 [00:02<01:48,  2.03it/s]
Epoch 10 Iter 6: loss 0.18412. :   3%|█▎                                             | 6/224 [00:02<01:48,  2.01it/s]
Epoch 10 Iter 7: loss 0.18201. :   3%|█▎                                             | 6/224 [00:03<01:48,  2.01it/s]
Epoch 10 Iter 7: loss 0.18201. :   3%|█▍                                             | 7/224 [00:03<01:47,  2.02it/s]
Epoch 10 Iter 8: loss 0.16769. :   3%|█▍                                             | 7/224 [00:03<01:47,  2.02it/s]
Epoch 10 Iter 8: loss 0.16769. :   4%|█▋                                             | 8/224 [00:03<01:48,  1.99it/s]
Epoch 10 Iter 9: loss 0.16568. :   4%|█▋                                             | 8/224 [00:04<01:48,  1.99it/s]
Epoch 10 Iter 9: loss 0.16568. :   4%|█▉                                             | 9/224 [00:04<01:49,  1.97it/s]
Epoch 10 Iter 10: loss 0.17551. :   4%|█▊                                            | 9/224 [00:05<01:49,  1.97it/s]
Epoch 10 Iter 10: loss 0.17551. :   4%|██                                           | 10/224 [00:05<01:48,  1.97it/s]
Epoch 10 Iter 11: loss 0.19234. :   4%|██                                           | 10/224 [00:05<01:48,  1.97it/s]
Epoch 10 Iter 11: loss 0.19234. :   5%|██▏                                          | 11/224 [00:05<01:47,  1.98it/s]
Epoch 10 Iter 12: loss 0.20822. :   5%|██▏                                          | 11/224 [00:06<01:47,  1.98it/s]
Epoch 10 Iter 12: loss 0.20822. :   5%|██▍                                          | 12/224 [00:06<01:46,  1.98it/s]
Epoch 10 Iter 13: loss 0.18838. :   5%|██▍                                          | 12/224 [00:06<01:46,  1.98it/s]
Epoch 10 Iter 13: loss 0.18838. :   6%|██▌                                          | 13/224 [00:06<01:45,  1.99it/s]
Epoch 10 Iter 14: loss 0.17599. :   6%|██▌                                          | 13/224 [00:07<01:45,  1.99it/s]
Epoch 10 Iter 14: loss 0.17599. :   6%|██▊                                          | 14/224 [00:07<01:44,  2.00it/s]
Epoch 10 Iter 15: loss 0.16695. :   6%|██▊                                          | 14/224 [00:07<01:44,  2.00it/s]
Epoch 10 Iter 15: loss 0.16695. :   7%|███                                          | 15/224 [00:07<01:44,  2.00it/s]
Epoch 10 Iter 16: loss 0.19185. :   7%|███                                          | 15/224 [00:08<01:44,  2.00it/s]
Epoch 10 Iter 16: loss 0.19185. :   7%|███▏                                         | 16/224 [00:08<01:44,  2.00it/s]
Epoch 10 Iter 17: loss 0.18627. :   7%|███▏                                         | 16/224 [00:08<01:44,  2.00it/s]
Epoch 10 Iter 17: loss 0.18627. :   8%|███▍                                         | 17/224 [00:08<01:45,  1.97it/s]
Epoch 10 Iter 18: loss 0.17616. :   8%|███▍                                         | 17/224 [00:09<01:45,  1.97it/s]
Epoch 10 Iter 18: loss 0.17616. :   8%|███▌                                         | 18/224 [00:09<01:46,  1.94it/s]
Epoch 10 Iter 19: loss 0.17339. :   8%|███▌                                         | 18/224 [00:09<01:46,  1.94it/s]
Epoch 10 Iter 19: loss 0.17339. :   8%|███▊                                         | 19/224 [00:09<01:45,  1.93it/s]
Epoch 10 Iter 20: loss 0.19570. :   8%|███▊                                         | 19/224 [00:10<01:45,  1.93it/s]
Epoch 10 Iter 20: loss 0.19570. :   9%|████                                         | 20/224 [00:10<01:45,  1.93it/s]
Epoch 10 Iter 21: loss 0.19438. :   9%|████                                         | 20/224 [00:10<01:45,  1.93it/s]
Epoch 10 Iter 21: loss 0.19438. :   9%|████▏                                        | 21/224 [00:10<01:46,  1.91it/s]
Epoch 10 Iter 22: loss 0.17314. :   9%|████▏                                        | 21/224 [00:11<01:46,  1.91it/s]
Epoch 10 Iter 22: loss 0.17314. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.93it/s]
Epoch 10 Iter 23: loss 0.18629. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.93it/s]
Epoch 10 Iter 23: loss 0.18629. :  10%|████▌                                        | 23/224 [00:11<01:42,  1.95it/s]
Epoch 10 Iter 24: loss 0.17777. :  10%|████▌                                        | 23/224 [00:12<01:42,  1.95it/s]
Epoch 10 Iter 24: loss 0.17777. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.96it/s]
Epoch 10 Iter 25: loss 0.17590. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.96it/s]
Epoch 10 Iter 25: loss 0.17590. :  11%|█████                                        | 25/224 [00:12<01:40,  1.99it/s]
Epoch 10 Iter 26: loss 0.15423. :  11%|█████                                        | 25/224 [00:13<01:40,  1.99it/s]
Epoch 10 Iter 26: loss 0.15423. :  12%|█████▏                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 10 Iter 27: loss 0.18573. :  12%|█████▏                                       | 26/224 [00:13<01:39,  1.99it/s]
Epoch 10 Iter 27: loss 0.18573. :  12%|█████▍                                       | 27/224 [00:13<01:38,  2.00it/s]
Epoch 10 Iter 28: loss 0.15657. :  12%|█████▍                                       | 27/224 [00:14<01:38,  2.00it/s]
Epoch 10 Iter 28: loss 0.15657. :  12%|█████▋                                       | 28/224 [00:14<01:38,  1.99it/s]
Epoch 10 Iter 29: loss 0.18041. :  12%|█████▋                                       | 28/224 [00:14<01:38,  1.99it/s]
Epoch 10 Iter 29: loss 0.18041. :  13%|█████▊                                       | 29/224 [00:14<01:41,  1.92it/s]
Epoch 10 Iter 30: loss 0.16500. :  13%|█████▊                                       | 29/224 [00:15<01:41,  1.92it/s]
Epoch 10 Iter 30: loss 0.16500. :  13%|██████                                       | 30/224 [00:15<01:39,  1.94it/s]
Epoch 10 Iter 31: loss 0.17693. :  13%|██████                                       | 30/224 [00:15<01:39,  1.94it/s]
Epoch 10 Iter 31: loss 0.17693. :  14%|██████▏                                      | 31/224 [00:15<01:39,  1.94it/s]
Epoch 10 Iter 32: loss 0.17556. :  14%|██████▏                                      | 31/224 [00:16<01:39,  1.94it/s]
Epoch 10 Iter 32: loss 0.17556. :  14%|██████▍                                      | 32/224 [00:16<01:38,  1.94it/s]
Epoch 10 Iter 33: loss 0.17492. :  14%|██████▍                                      | 32/224 [00:16<01:38,  1.94it/s]
Epoch 10 Iter 33: loss 0.17492. :  15%|██████▋                                      | 33/224 [00:16<01:38,  1.94it/s]
Epoch 10 Iter 34: loss 0.17734. :  15%|██████▋                                      | 33/224 [00:17<01:38,  1.94it/s]
Epoch 10 Iter 34: loss 0.17734. :  15%|██████▊                                      | 34/224 [00:17<01:36,  1.97it/s]
Epoch 10 Iter 35: loss 0.15679. :  15%|██████▊                                      | 34/224 [00:17<01:36,  1.97it/s]
Epoch 10 Iter 35: loss 0.15679. :  16%|███████                                      | 35/224 [00:17<01:36,  1.97it/s]
Epoch 10 Iter 36: loss 0.17802. :  16%|███████                                      | 35/224 [00:18<01:36,  1.97it/s]
Epoch 10 Iter 36: loss 0.17802. :  16%|███████▏                                     | 36/224 [00:18<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.17470. :  16%|███████▏                                     | 36/224 [00:18<01:34,  1.99it/s]
Epoch 10 Iter 37: loss 0.17470. :  17%|███████▍                                     | 37/224 [00:18<01:33,  2.00it/s]
Epoch 10 Iter 38: loss 0.19256. :  17%|███████▍                                     | 37/224 [00:19<01:33,  2.00it/s]
Epoch 10 Iter 38: loss 0.19256. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 10 Iter 39: loss 0.17491. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 10 Iter 39: loss 0.17491. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.01it/s]
Epoch 10 Iter 40: loss 0.16576. :  17%|███████▊                                     | 39/224 [00:20<01:31,  2.01it/s]
Epoch 10 Iter 40: loss 0.16576. :  18%|████████                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 10 Iter 41: loss 0.19374. :  18%|████████                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 10 Iter 41: loss 0.19374. :  18%|████████▏                                    | 41/224 [00:20<01:30,  2.01it/s]
Epoch 10 Iter 42: loss 0.19009. :  18%|████████▏                                    | 41/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 42: loss 0.19009. :  19%|████████▍                                    | 42/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 43: loss 0.19504. :  19%|████████▍                                    | 42/224 [00:21<01:30,  2.01it/s]
Epoch 10 Iter 43: loss 0.19504. :  19%|████████▋                                    | 43/224 [00:21<01:29,  2.01it/s]
Epoch 10 Iter 44: loss 0.18272. :  19%|████████▋                                    | 43/224 [00:22<01:29,  2.01it/s]
Epoch 10 Iter 44: loss 0.18272. :  20%|████████▊                                    | 44/224 [00:22<01:29,  2.00it/s]
Epoch 10 Iter 45: loss 0.18638. :  20%|████████▊                                    | 44/224 [00:22<01:29,  2.00it/s]
Epoch 10 Iter 45: loss 0.18638. :  20%|█████████                                    | 45/224 [00:22<01:29,  2.00it/s]
Epoch 10 Iter 46: loss 0.16378. :  20%|█████████                                    | 45/224 [00:23<01:29,  2.00it/s]
Epoch 10 Iter 46: loss 0.16378. :  21%|█████████▏                                   | 46/224 [00:23<01:28,  2.02it/s]
Epoch 10 Iter 47: loss 0.21485. :  21%|█████████▏                                   | 46/224 [00:23<01:28,  2.02it/s]
Epoch 10 Iter 47: loss 0.21485. :  21%|█████████▍                                   | 47/224 [00:23<01:27,  2.02it/s]
Epoch 10 Iter 48: loss 0.16224. :  21%|█████████▍                                   | 47/224 [00:24<01:27,  2.02it/s]
Epoch 10 Iter 48: loss 0.16224. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 10 Iter 49: loss 0.19838. :  21%|█████████▋                                   | 48/224 [00:24<01:27,  2.02it/s]
Epoch 10 Iter 49: loss 0.19838. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.03it/s]
Epoch 10 Iter 50: loss 0.17274. :  22%|█████████▊                                   | 49/224 [00:25<01:26,  2.03it/s]
Epoch 10 Iter 50: loss 0.17274. :  22%|██████████                                   | 50/224 [00:25<01:25,  2.04it/s]
Epoch 10 Iter 51: loss 0.18303. :  22%|██████████                                   | 50/224 [00:25<01:25,  2.04it/s]
Epoch 10 Iter 51: loss 0.18303. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 10 Iter 52: loss 0.17356. :  23%|██████████▏                                  | 51/224 [00:26<01:24,  2.04it/s]
Epoch 10 Iter 52: loss 0.17356. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 53: loss 0.18203. :  23%|██████████▍                                  | 52/224 [00:26<01:24,  2.03it/s]
Epoch 10 Iter 53: loss 0.18203. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.02it/s]
Epoch 10 Iter 54: loss 0.16872. :  24%|██████████▋                                  | 53/224 [00:27<01:24,  2.02it/s]
Epoch 10 Iter 54: loss 0.16872. :  24%|██████████▊                                  | 54/224 [00:27<01:37,  1.75it/s]
Epoch 10 Iter 55: loss 0.17827. :  24%|██████████▊                                  | 54/224 [00:28<01:37,  1.75it/s]
Epoch 10 Iter 55: loss 0.17827. :  25%|███████████                                  | 55/224 [00:28<01:46,  1.58it/s]
Epoch 10 Iter 56: loss 0.19328. :  25%|███████████                                  | 55/224 [00:28<01:46,  1.58it/s]
Epoch 10 Iter 56: loss 0.19328. :  25%|███████████▎                                 | 56/224 [00:28<01:46,  1.58it/s]
Epoch 10 Iter 57: loss 0.18413. :  25%|███████████▎                                 | 56/224 [00:29<01:46,  1.58it/s]
Epoch 10 Iter 57: loss 0.18413. :  25%|███████████▍                                 | 57/224 [00:29<01:41,  1.64it/s]
Epoch 10 Iter 58: loss 0.18112. :  25%|███████████▍                                 | 57/224 [00:29<01:41,  1.64it/s]
Epoch 10 Iter 58: loss 0.18112. :  26%|███████████▋                                 | 58/224 [00:29<01:38,  1.69it/s]
Epoch 10 Iter 59: loss 0.19676. :  26%|███████████▋                                 | 58/224 [00:30<01:38,  1.69it/s]
Epoch 10 Iter 59: loss 0.19676. :  26%|███████████▊                                 | 59/224 [00:30<01:45,  1.56it/s]
Epoch 10 Iter 60: loss 0.17555. :  26%|███████████▊                                 | 59/224 [00:31<01:45,  1.56it/s]
Epoch 10 Iter 60: loss 0.17555. :  27%|████████████                                 | 60/224 [00:31<01:51,  1.47it/s]
Epoch 10 Iter 61: loss 0.19375. :  27%|████████████                                 | 60/224 [00:31<01:51,  1.47it/s]
Epoch 10 Iter 61: loss 0.19375. :  27%|████████████▎                                | 61/224 [00:31<01:43,  1.57it/s]
Epoch 10 Iter 62: loss 0.19651. :  27%|████████████▎                                | 61/224 [00:32<01:43,  1.57it/s]
Epoch 10 Iter 62: loss 0.19651. :  28%|████████████▍                                | 62/224 [00:32<01:50,  1.47it/s]
Epoch 10 Iter 63: loss 0.20235. :  28%|████████████▍                                | 62/224 [00:33<01:50,  1.47it/s]
Epoch 10 Iter 63: loss 0.20235. :  28%|████████████▋                                | 63/224 [00:33<01:46,  1.52it/s]
Epoch 10 Iter 64: loss 0.15644. :  28%|████████████▋                                | 63/224 [00:33<01:46,  1.52it/s]
Epoch 10 Iter 64: loss 0.15644. :  29%|████████████▊                                | 64/224 [00:33<01:40,  1.59it/s]
Epoch 10 Iter 65: loss 0.18502. :  29%|████████████▊                                | 64/224 [00:34<01:40,  1.59it/s]
Epoch 10 Iter 65: loss 0.18502. :  29%|█████████████                                | 65/224 [00:34<01:35,  1.66it/s]
Epoch 10 Iter 66: loss 0.18745. :  29%|█████████████                                | 65/224 [00:35<01:35,  1.66it/s]
Epoch 10 Iter 66: loss 0.18745. :  29%|█████████████▎                               | 66/224 [00:35<01:44,  1.51it/s]
Epoch 10 Iter 67: loss 0.18498. :  29%|█████████████▎                               | 66/224 [00:36<01:44,  1.51it/s]
Epoch 10 Iter 67: loss 0.18498. :  30%|█████████████▍                               | 67/224 [00:36<01:48,  1.44it/s]
Epoch 10 Iter 68: loss 0.17837. :  30%|█████████████▍                               | 67/224 [00:36<01:48,  1.44it/s]
Epoch 10 Iter 68: loss 0.17837. :  30%|█████████████▋                               | 68/224 [00:36<01:44,  1.49it/s]
Epoch 10 Iter 69: loss 0.18939. :  30%|█████████████▋                               | 68/224 [00:37<01:44,  1.49it/s]
Epoch 10 Iter 69: loss 0.18939. :  31%|█████████████▊                               | 69/224 [00:37<01:37,  1.59it/s]
Epoch 10 Iter 70: loss 0.17756. :  31%|█████████████▊                               | 69/224 [00:37<01:37,  1.59it/s]
Epoch 10 Iter 70: loss 0.17756. :  31%|██████████████                               | 70/224 [00:37<01:41,  1.51it/s]
Epoch 10 Iter 71: loss 0.17772. :  31%|██████████████                               | 70/224 [00:38<01:41,  1.51it/s]
Epoch 10 Iter 71: loss 0.17772. :  32%|██████████████▎                              | 71/224 [00:38<01:45,  1.45it/s]
Epoch 10 Iter 72: loss 0.16466. :  32%|██████████████▎                              | 71/224 [00:39<01:45,  1.45it/s]
Epoch 10 Iter 72: loss 0.16466. :  32%|██████████████▍                              | 72/224 [00:39<01:46,  1.43it/s]
Epoch 10 Iter 73: loss 0.17575. :  32%|██████████████▍                              | 72/224 [00:39<01:46,  1.43it/s]
Epoch 10 Iter 73: loss 0.17575. :  33%|██████████████▋                              | 73/224 [00:39<01:37,  1.55it/s]
Epoch 10 Iter 74: loss 0.16996. :  33%|██████████████▋                              | 73/224 [00:40<01:37,  1.55it/s]
Epoch 10 Iter 74: loss 0.16996. :  33%|██████████████▊                              | 74/224 [00:40<01:31,  1.64it/s]
Epoch 10 Iter 75: loss 0.17834. :  33%|██████████████▊                              | 74/224 [00:40<01:31,  1.64it/s]
Epoch 10 Iter 75: loss 0.17834. :  33%|███████████████                              | 75/224 [00:40<01:27,  1.70it/s]
Epoch 10 Iter 76: loss 0.18295. :  33%|███████████████                              | 75/224 [00:41<01:27,  1.70it/s]
Epoch 10 Iter 76: loss 0.18295. :  34%|███████████████▎                             | 76/224 [00:41<01:26,  1.71it/s]
Epoch 10 Iter 77: loss 0.18853. :  34%|███████████████▎                             | 76/224 [00:42<01:26,  1.71it/s]
Epoch 10 Iter 77: loss 0.18853. :  34%|███████████████▍                             | 77/224 [00:42<01:34,  1.56it/s]
Epoch 10 Iter 78: loss 0.17010. :  34%|███████████████▍                             | 77/224 [00:42<01:34,  1.56it/s]
Epoch 10 Iter 78: loss 0.17010. :  35%|███████████████▋                             | 78/224 [00:42<01:31,  1.59it/s]
Epoch 10 Iter 79: loss 0.17578. :  35%|███████████████▋                             | 78/224 [00:43<01:31,  1.59it/s]
Epoch 10 Iter 79: loss 0.17578. :  35%|███████████████▊                             | 79/224 [00:43<01:38,  1.48it/s]
Epoch 10 Iter 80: loss 0.18042. :  35%|███████████████▊                             | 79/224 [00:44<01:38,  1.48it/s]
Epoch 10 Iter 80: loss 0.18042. :  36%|████████████████                             | 80/224 [00:44<01:41,  1.42it/s]
Epoch 10 Iter 81: loss 0.16282. :  36%|████████████████                             | 80/224 [00:45<01:41,  1.42it/s]
Epoch 10 Iter 81: loss 0.16282. :  36%|████████████████▎                            | 81/224 [00:45<01:39,  1.44it/s]
Epoch 10 Iter 82: loss 0.18202. :  36%|████████████████▎                            | 81/224 [00:45<01:39,  1.44it/s]
Epoch 10 Iter 82: loss 0.18202. :  37%|████████████████▍                            | 82/224 [00:45<01:41,  1.40it/s]
Epoch 10 Iter 83: loss 0.17154. :  37%|████████████████▍                            | 82/224 [00:46<01:41,  1.40it/s]
Epoch 10 Iter 83: loss 0.17154. :  37%|████████████████▋                            | 83/224 [00:46<01:42,  1.37it/s]
Epoch 10 Iter 84: loss 0.17550. :  37%|████████████████▋                            | 83/224 [00:47<01:42,  1.37it/s]
Epoch 10 Iter 84: loss 0.17550. :  38%|████████████████▉                            | 84/224 [00:47<01:43,  1.35it/s]
Epoch 10 Iter 85: loss 0.19054. :  38%|████████████████▉                            | 84/224 [00:48<01:43,  1.35it/s]
Epoch 10 Iter 85: loss 0.19054. :  38%|█████████████████                            | 85/224 [00:48<01:43,  1.34it/s]
Epoch 10 Iter 86: loss 0.16838. :  38%|█████████████████                            | 85/224 [00:48<01:43,  1.34it/s]
Epoch 10 Iter 86: loss 0.16838. :  38%|█████████████████▎                           | 86/224 [00:48<01:38,  1.40it/s]
Epoch 10 Iter 87: loss 0.17709. :  38%|█████████████████▎                           | 86/224 [00:49<01:38,  1.40it/s]
Epoch 10 Iter 87: loss 0.17709. :  39%|█████████████████▍                           | 87/224 [00:49<01:31,  1.50it/s]
Epoch 10 Iter 88: loss 0.17261. :  39%|█████████████████▍                           | 87/224 [00:49<01:31,  1.50it/s]
Epoch 10 Iter 88: loss 0.17261. :  39%|█████████████████▋                           | 88/224 [00:49<01:27,  1.55it/s]
Epoch 10 Iter 89: loss 0.18191. :  39%|█████████████████▋                           | 88/224 [00:50<01:27,  1.55it/s]
Epoch 10 Iter 89: loss 0.18191. :  40%|█████████████████▉                           | 89/224 [00:50<01:31,  1.48it/s]
Epoch 10 Iter 90: loss 0.19090. :  40%|█████████████████▉                           | 89/224 [00:51<01:31,  1.48it/s]
Epoch 10 Iter 90: loss 0.19090. :  40%|██████████████████                           | 90/224 [00:51<01:24,  1.58it/s]
Epoch 10 Iter 91: loss 0.17226. :  40%|██████████████████                           | 90/224 [00:51<01:24,  1.58it/s]
Epoch 10 Iter 91: loss 0.17226. :  41%|██████████████████▎                          | 91/224 [00:51<01:25,  1.56it/s]
Epoch 10 Iter 92: loss 0.18716. :  41%|██████████████████▎                          | 91/224 [00:52<01:25,  1.56it/s]
Epoch 10 Iter 92: loss 0.18716. :  41%|██████████████████▍                          | 92/224 [00:52<01:19,  1.67it/s]
Epoch 10 Iter 93: loss 0.17028. :  41%|██████████████████▍                          | 92/224 [00:52<01:19,  1.67it/s]
Epoch 10 Iter 93: loss 0.17028. :  42%|██████████████████▋                          | 93/224 [00:52<01:14,  1.76it/s]
Epoch 10 Iter 94: loss 0.18932. :  42%|██████████████████▋                          | 93/224 [00:53<01:14,  1.76it/s]
Epoch 10 Iter 94: loss 0.18932. :  42%|██████████████████▉                          | 94/224 [00:53<01:11,  1.82it/s]
Epoch 10 Iter 95: loss 0.18033. :  42%|██████████████████▉                          | 94/224 [00:53<01:11,  1.82it/s]
Epoch 10 Iter 95: loss 0.18033. :  42%|███████████████████                          | 95/224 [00:53<01:08,  1.88it/s]
Epoch 10 Iter 96: loss 0.16062. :  42%|███████████████████                          | 95/224 [00:54<01:08,  1.88it/s]
Epoch 10 Iter 96: loss 0.16062. :  43%|███████████████████▎                         | 96/224 [00:54<01:06,  1.92it/s]
Epoch 10 Iter 97: loss 0.17882. :  43%|███████████████████▎                         | 96/224 [00:54<01:06,  1.92it/s]
Epoch 10 Iter 97: loss 0.17882. :  43%|███████████████████▍                         | 97/224 [00:54<01:05,  1.94it/s]
Epoch 10 Iter 98: loss 0.18102. :  43%|███████████████████▍                         | 97/224 [00:55<01:05,  1.94it/s]
Epoch 10 Iter 98: loss 0.18102. :  44%|███████████████████▋                         | 98/224 [00:55<01:04,  1.94it/s]
Epoch 10 Iter 99: loss 0.19821. :  44%|███████████████████▋                         | 98/224 [00:55<01:04,  1.94it/s]
Epoch 10 Iter 99: loss 0.19821. :  44%|███████████████████▉                         | 99/224 [00:55<01:04,  1.94it/s]
Epoch 10 Iter 100: loss 0.17190. :  44%|███████████████████▍                        | 99/224 [00:56<01:04,  1.94it/s]
Epoch 10 Iter 100: loss 0.17190. :  45%|███████████████████▏                       | 100/224 [00:56<01:03,  1.96it/s]
Epoch 10 Iter 101: loss 0.17983. :  45%|███████████████████▏                       | 100/224 [00:56<01:03,  1.96it/s]
Epoch 10 Iter 101: loss 0.17983. :  45%|███████████████████▍                       | 101/224 [00:56<01:02,  1.98it/s]
Epoch 10 Iter 102: loss 0.17580. :  45%|███████████████████▍                       | 101/224 [00:57<01:02,  1.98it/s]
Epoch 10 Iter 102: loss 0.17580. :  46%|███████████████████▌                       | 102/224 [00:57<01:01,  1.99it/s]
Epoch 10 Iter 103: loss 0.17363. :  46%|███████████████████▌                       | 102/224 [00:57<01:01,  1.99it/s]
Epoch 10 Iter 103: loss 0.17363. :  46%|███████████████████▊                       | 103/224 [00:57<01:00,  1.99it/s]
Epoch 10 Iter 104: loss 0.19049. :  46%|███████████████████▊                       | 103/224 [00:58<01:00,  1.99it/s]
Epoch 10 Iter 104: loss 0.19049. :  46%|███████████████████▉                       | 104/224 [00:58<01:00,  2.00it/s]
Epoch 10 Iter 105: loss 0.17138. :  46%|███████████████████▉                       | 104/224 [00:58<01:00,  2.00it/s]
Epoch 10 Iter 105: loss 0.17138. :  47%|████████████████████▏                      | 105/224 [00:58<00:59,  2.00it/s]
Epoch 10 Iter 106: loss 0.17802. :  47%|████████████████████▏                      | 105/224 [00:59<00:59,  2.00it/s]
Epoch 10 Iter 106: loss 0.17802. :  47%|████████████████████▎                      | 106/224 [00:59<01:03,  1.86it/s]
Epoch 10 Iter 107: loss 0.16763. :  47%|████████████████████▎                      | 106/224 [01:00<01:03,  1.86it/s]
Epoch 10 Iter 107: loss 0.16763. :  48%|████████████████████▌                      | 107/224 [01:00<01:06,  1.76it/s]
Epoch 10 Iter 108: loss 0.17765. :  48%|████████████████████▌                      | 107/224 [01:00<01:06,  1.76it/s]
Epoch 10 Iter 108: loss 0.17765. :  48%|████████████████████▋                      | 108/224 [01:00<01:04,  1.79it/s]
Epoch 10 Iter 109: loss 0.18858. :  48%|████████████████████▋                      | 108/224 [01:01<01:04,  1.79it/s]
Epoch 10 Iter 109: loss 0.18858. :  49%|████████████████████▉                      | 109/224 [01:01<01:04,  1.79it/s]
Epoch 10 Iter 110: loss 0.16013. :  49%|████████████████████▉                      | 109/224 [01:01<01:04,  1.79it/s]
Epoch 10 Iter 110: loss 0.16013. :  49%|█████████████████████                      | 110/224 [01:01<01:03,  1.81it/s]
Epoch 10 Iter 111: loss 0.17910. :  49%|█████████████████████                      | 110/224 [01:02<01:03,  1.81it/s]
Epoch 10 Iter 111: loss 0.17910. :  50%|█████████████████████▎                     | 111/224 [01:02<01:02,  1.81it/s]
Epoch 10 Iter 112: loss 0.16596. :  50%|█████████████████████▎                     | 111/224 [01:02<01:02,  1.81it/s]
Epoch 10 Iter 112: loss 0.16596. :  50%|█████████████████████▌                     | 112/224 [01:02<01:02,  1.81it/s]
Epoch 10 Iter 113: loss 0.15787. :  50%|█████████████████████▌                     | 112/224 [01:03<01:02,  1.81it/s]
Epoch 10 Iter 113: loss 0.15787. :  50%|█████████████████████▋                     | 113/224 [01:03<01:03,  1.74it/s]
Epoch 10 Iter 114: loss 0.18845. :  50%|█████████████████████▋                     | 113/224 [01:04<01:03,  1.74it/s]
Epoch 10 Iter 114: loss 0.18845. :  51%|█████████████████████▉                     | 114/224 [01:04<01:00,  1.81it/s]
Epoch 10 Iter 115: loss 0.16897. :  51%|█████████████████████▉                     | 114/224 [01:04<01:00,  1.81it/s]
Epoch 10 Iter 115: loss 0.16897. :  51%|██████████████████████                     | 115/224 [01:04<00:58,  1.86it/s]
Epoch 10 Iter 116: loss 0.18174. :  51%|██████████████████████                     | 115/224 [01:05<00:58,  1.86it/s]
Epoch 10 Iter 116: loss 0.18174. :  52%|██████████████████████▎                    | 116/224 [01:05<00:56,  1.91it/s]
Epoch 10 Iter 117: loss 0.17810. :  52%|██████████████████████▎                    | 116/224 [01:05<00:56,  1.91it/s]
Epoch 10 Iter 117: loss 0.17810. :  52%|██████████████████████▍                    | 117/224 [01:05<00:55,  1.94it/s]
Epoch 10 Iter 118: loss 0.16358. :  52%|██████████████████████▍                    | 117/224 [01:06<00:55,  1.94it/s]
Epoch 10 Iter 118: loss 0.16358. :  53%|██████████████████████▋                    | 118/224 [01:06<00:53,  1.96it/s]
Epoch 10 Iter 119: loss 0.18329. :  53%|██████████████████████▋                    | 118/224 [01:06<00:53,  1.96it/s]
Epoch 10 Iter 119: loss 0.18329. :  53%|██████████████████████▊                    | 119/224 [01:06<00:53,  1.96it/s]
Epoch 10 Iter 120: loss 0.18327. :  53%|██████████████████████▊                    | 119/224 [01:07<00:53,  1.96it/s]
Epoch 10 Iter 120: loss 0.18327. :  54%|███████████████████████                    | 120/224 [01:07<00:52,  1.97it/s]
Epoch 10 Iter 121: loss 0.18409. :  54%|███████████████████████                    | 120/224 [01:07<00:52,  1.97it/s]
Epoch 10 Iter 121: loss 0.18409. :  54%|███████████████████████▏                   | 121/224 [01:07<00:52,  1.94it/s]
Epoch 10 Iter 122: loss 0.17843. :  54%|███████████████████████▏                   | 121/224 [01:08<00:52,  1.94it/s]
Epoch 10 Iter 122: loss 0.17843. :  54%|███████████████████████▍                   | 122/224 [01:08<00:52,  1.96it/s]
Epoch 10 Iter 123: loss 0.16962. :  54%|███████████████████████▍                   | 122/224 [01:08<00:52,  1.96it/s]
Epoch 10 Iter 123: loss 0.16962. :  55%|███████████████████████▌                   | 123/224 [01:08<00:51,  1.97it/s]
Epoch 10 Iter 124: loss 0.17375. :  55%|███████████████████████▌                   | 123/224 [01:09<00:51,  1.97it/s]
Epoch 10 Iter 124: loss 0.17375. :  55%|███████████████████████▊                   | 124/224 [01:09<00:51,  1.95it/s]
Epoch 10 Iter 125: loss 0.17925. :  55%|███████████████████████▊                   | 124/224 [01:09<00:51,  1.95it/s]
Epoch 10 Iter 125: loss 0.17925. :  56%|███████████████████████▉                   | 125/224 [01:09<00:50,  1.96it/s]
Epoch 10 Iter 126: loss 0.15815. :  56%|███████████████████████▉                   | 125/224 [01:10<00:50,  1.96it/s]
Epoch 10 Iter 126: loss 0.15815. :  56%|████████████████████████▏                  | 126/224 [01:10<00:49,  1.97it/s]
Epoch 10 Iter 127: loss 0.18148. :  56%|████████████████████████▏                  | 126/224 [01:10<00:49,  1.97it/s]
Epoch 10 Iter 127: loss 0.18148. :  57%|████████████████████████▍                  | 127/224 [01:10<00:48,  1.98it/s]
Epoch 10 Iter 128: loss 0.17941. :  57%|████████████████████████▍                  | 127/224 [01:11<00:48,  1.98it/s]
Epoch 10 Iter 128: loss 0.17941. :  57%|████████████████████████▌                  | 128/224 [01:11<00:49,  1.93it/s]
Epoch 10 Iter 129: loss 0.18256. :  57%|████████████████████████▌                  | 128/224 [01:11<00:49,  1.93it/s]
Epoch 10 Iter 129: loss 0.18256. :  58%|████████████████████████▊                  | 129/224 [01:11<00:51,  1.85it/s]
Epoch 10 Iter 130: loss 0.16077. :  58%|████████████████████████▊                  | 129/224 [01:12<00:51,  1.85it/s]
Epoch 10 Iter 130: loss 0.16077. :  58%|████████████████████████▉                  | 130/224 [01:12<00:50,  1.88it/s]
Epoch 10 Iter 131: loss 0.15431. :  58%|████████████████████████▉                  | 130/224 [01:12<00:50,  1.88it/s]
Epoch 10 Iter 131: loss 0.15431. :  58%|█████████████████████████▏                 | 131/224 [01:12<00:49,  1.88it/s]
Epoch 10 Iter 132: loss 0.19377. :  58%|█████████████████████████▏                 | 131/224 [01:13<00:49,  1.88it/s]
Epoch 10 Iter 132: loss 0.19377. :  59%|█████████████████████████▎                 | 132/224 [01:13<00:48,  1.90it/s]
Epoch 10 Iter 133: loss 0.19672. :  59%|█████████████████████████▎                 | 132/224 [01:13<00:48,  1.90it/s]
Epoch 10 Iter 133: loss 0.19672. :  59%|█████████████████████████▌                 | 133/224 [01:13<00:47,  1.94it/s]
Epoch 10 Iter 134: loss 0.18014. :  59%|█████████████████████████▌                 | 133/224 [01:14<00:47,  1.94it/s]
Epoch 10 Iter 134: loss 0.18014. :  60%|█████████████████████████▋                 | 134/224 [01:14<00:45,  1.96it/s]
Epoch 10 Iter 135: loss 0.19290. :  60%|█████████████████████████▋                 | 134/224 [01:14<00:45,  1.96it/s]
Epoch 10 Iter 135: loss 0.19290. :  60%|█████████████████████████▉                 | 135/224 [01:14<00:45,  1.95it/s]
Epoch 10 Iter 136: loss 0.18227. :  60%|█████████████████████████▉                 | 135/224 [01:15<00:45,  1.95it/s]
Epoch 10 Iter 136: loss 0.18227. :  61%|██████████████████████████                 | 136/224 [01:15<00:46,  1.91it/s]
Epoch 10 Iter 137: loss 0.16241. :  61%|██████████████████████████                 | 136/224 [01:15<00:46,  1.91it/s]
Epoch 10 Iter 137: loss 0.16241. :  61%|██████████████████████████▎                | 137/224 [01:15<00:45,  1.92it/s]
Epoch 10 Iter 138: loss 0.17641. :  61%|██████████████████████████▎                | 137/224 [01:16<00:45,  1.92it/s]
Epoch 10 Iter 138: loss 0.17641. :  62%|██████████████████████████▍                | 138/224 [01:16<00:44,  1.93it/s]
Epoch 10 Iter 139: loss 0.18392. :  62%|██████████████████████████▍                | 138/224 [01:16<00:44,  1.93it/s]
Epoch 10 Iter 139: loss 0.18392. :  62%|██████████████████████████▋                | 139/224 [01:16<00:43,  1.93it/s]
Epoch 10 Iter 140: loss 0.17317. :  62%|██████████████████████████▋                | 139/224 [01:17<00:43,  1.93it/s]
Epoch 10 Iter 140: loss 0.17317. :  62%|██████████████████████████▉                | 140/224 [01:17<00:43,  1.95it/s]
Epoch 10 Iter 141: loss 0.18917. :  62%|██████████████████████████▉                | 140/224 [01:17<00:43,  1.95it/s]
Epoch 10 Iter 141: loss 0.18917. :  63%|███████████████████████████                | 141/224 [01:17<00:42,  1.94it/s]
Epoch 10 Iter 142: loss 0.19056. :  63%|███████████████████████████                | 141/224 [01:18<00:42,  1.94it/s]
Epoch 10 Iter 142: loss 0.19056. :  63%|███████████████████████████▎               | 142/224 [01:18<00:44,  1.86it/s]
Epoch 10 Iter 143: loss 0.18144. :  63%|███████████████████████████▎               | 142/224 [01:19<00:44,  1.86it/s]
Epoch 10 Iter 143: loss 0.18144. :  64%|███████████████████████████▍               | 143/224 [01:19<00:45,  1.79it/s]
Epoch 10 Iter 144: loss 0.20048. :  64%|███████████████████████████▍               | 143/224 [01:19<00:45,  1.79it/s]
Epoch 10 Iter 144: loss 0.20048. :  64%|███████████████████████████▋               | 144/224 [01:19<00:44,  1.78it/s]
Epoch 10 Iter 145: loss 0.18336. :  64%|███████████████████████████▋               | 144/224 [01:20<00:44,  1.78it/s]
Epoch 10 Iter 145: loss 0.18336. :  65%|███████████████████████████▊               | 145/224 [01:20<00:45,  1.73it/s]
Epoch 10 Iter 146: loss 0.19254. :  65%|███████████████████████████▊               | 145/224 [01:20<00:45,  1.73it/s]
Epoch 10 Iter 146: loss 0.19254. :  65%|████████████████████████████               | 146/224 [01:20<00:44,  1.74it/s]
Epoch 10 Iter 147: loss 0.19698. :  65%|████████████████████████████               | 146/224 [01:21<00:44,  1.74it/s]
Epoch 10 Iter 147: loss 0.19698. :  66%|████████████████████████████▏              | 147/224 [01:21<00:42,  1.79it/s]
Epoch 10 Iter 148: loss 0.18229. :  66%|████████████████████████████▏              | 147/224 [01:21<00:42,  1.79it/s]
Epoch 10 Iter 148: loss 0.18229. :  66%|████████████████████████████▍              | 148/224 [01:21<00:41,  1.84it/s]
Epoch 10 Iter 149: loss 0.18592. :  66%|████████████████████████████▍              | 148/224 [01:22<00:41,  1.84it/s]
Epoch 10 Iter 149: loss 0.18592. :  67%|████████████████████████████▌              | 149/224 [01:22<00:39,  1.88it/s]
Epoch 10 Iter 150: loss 0.17591. :  67%|████████████████████████████▌              | 149/224 [01:22<00:39,  1.88it/s]
Epoch 10 Iter 150: loss 0.17591. :  67%|████████████████████████████▊              | 150/224 [01:22<00:38,  1.92it/s]
Epoch 10 Iter 151: loss 0.16530. :  67%|████████████████████████████▊              | 150/224 [01:23<00:38,  1.92it/s]
Epoch 10 Iter 151: loss 0.16530. :  67%|████████████████████████████▉              | 151/224 [01:23<00:37,  1.94it/s]
Epoch 10 Iter 152: loss 0.15968. :  67%|████████████████████████████▉              | 151/224 [01:23<00:37,  1.94it/s]
Epoch 10 Iter 152: loss 0.15968. :  68%|█████████████████████████████▏             | 152/224 [01:23<00:36,  1.96it/s]
Epoch 10 Iter 153: loss 0.17759. :  68%|█████████████████████████████▏             | 152/224 [01:24<00:36,  1.96it/s]
Epoch 10 Iter 153: loss 0.17759. :  68%|█████████████████████████████▎             | 153/224 [01:24<00:35,  1.97it/s]
Epoch 10 Iter 154: loss 0.16827. :  68%|█████████████████████████████▎             | 153/224 [01:24<00:35,  1.97it/s]
Epoch 10 Iter 154: loss 0.16827. :  69%|█████████████████████████████▌             | 154/224 [01:24<00:35,  1.98it/s]
Epoch 10 Iter 155: loss 0.19218. :  69%|█████████████████████████████▌             | 154/224 [01:25<00:35,  1.98it/s]
Epoch 10 Iter 155: loss 0.19218. :  69%|█████████████████████████████▊             | 155/224 [01:25<00:35,  1.96it/s]
Epoch 10 Iter 156: loss 0.17236. :  69%|█████████████████████████████▊             | 155/224 [01:25<00:35,  1.96it/s]
Epoch 10 Iter 156: loss 0.17236. :  70%|█████████████████████████████▉             | 156/224 [01:25<00:34,  1.96it/s]
Epoch 10 Iter 157: loss 0.19139. :  70%|█████████████████████████████▉             | 156/224 [01:26<00:34,  1.96it/s]
Epoch 10 Iter 157: loss 0.19139. :  70%|██████████████████████████████▏            | 157/224 [01:26<00:34,  1.96it/s]
Epoch 10 Iter 158: loss 0.17360. :  70%|██████████████████████████████▏            | 157/224 [01:26<00:34,  1.96it/s]
Epoch 10 Iter 158: loss 0.17360. :  71%|██████████████████████████████▎            | 158/224 [01:26<00:33,  1.98it/s]
Epoch 10 Iter 159: loss 0.18533. :  71%|██████████████████████████████▎            | 158/224 [01:27<00:33,  1.98it/s]
Epoch 10 Iter 159: loss 0.18533. :  71%|██████████████████████████████▌            | 159/224 [01:27<00:32,  1.97it/s]
Epoch 10 Iter 160: loss 0.19366. :  71%|██████████████████████████████▌            | 159/224 [01:27<00:32,  1.97it/s]
Epoch 10 Iter 160: loss 0.19366. :  71%|██████████████████████████████▋            | 160/224 [01:27<00:32,  1.98it/s]
Epoch 10 Iter 161: loss 0.18333. :  71%|██████████████████████████████▋            | 160/224 [01:28<00:32,  1.98it/s]
Epoch 10 Iter 161: loss 0.18333. :  72%|██████████████████████████████▉            | 161/224 [01:28<00:32,  1.92it/s]
Epoch 10 Iter 162: loss 0.17125. :  72%|██████████████████████████████▉            | 161/224 [01:29<00:32,  1.92it/s]
Epoch 10 Iter 162: loss 0.17125. :  72%|███████████████████████████████            | 162/224 [01:29<00:36,  1.68it/s]
Epoch 10 Iter 163: loss 0.17829. :  72%|███████████████████████████████            | 162/224 [01:29<00:36,  1.68it/s]
Epoch 10 Iter 163: loss 0.17829. :  73%|███████████████████████████████▎           | 163/224 [01:29<00:36,  1.67it/s]
Epoch 10 Iter 164: loss 0.18220. :  73%|███████████████████████████████▎           | 163/224 [01:30<00:36,  1.67it/s]
Epoch 10 Iter 164: loss 0.18220. :  73%|███████████████████████████████▍           | 164/224 [01:30<00:36,  1.65it/s]
Epoch 10 Iter 165: loss 0.18154. :  73%|███████████████████████████████▍           | 164/224 [01:31<00:36,  1.65it/s]
Epoch 10 Iter 165: loss 0.18154. :  74%|███████████████████████████████▋           | 165/224 [01:31<00:34,  1.71it/s]
Epoch 10 Iter 166: loss 0.18074. :  74%|███████████████████████████████▋           | 165/224 [01:31<00:34,  1.71it/s]
Epoch 10 Iter 166: loss 0.18074. :  74%|███████████████████████████████▊           | 166/224 [01:31<00:33,  1.73it/s]
Epoch 10 Iter 167: loss 0.20126. :  74%|███████████████████████████████▊           | 166/224 [01:32<00:33,  1.73it/s]
Epoch 10 Iter 167: loss 0.20126. :  75%|████████████████████████████████           | 167/224 [01:32<00:32,  1.76it/s]
Epoch 10 Iter 168: loss 0.17632. :  75%|████████████████████████████████           | 167/224 [01:32<00:32,  1.76it/s]
Epoch 10 Iter 168: loss 0.17632. :  75%|████████████████████████████████▎          | 168/224 [01:32<00:31,  1.75it/s]
Epoch 10 Iter 169: loss 0.18632. :  75%|████████████████████████████████▎          | 168/224 [01:33<00:31,  1.75it/s]
Epoch 10 Iter 169: loss 0.18632. :  75%|████████████████████████████████▍          | 169/224 [01:33<00:34,  1.59it/s]
Epoch 10 Iter 170: loss 0.18165. :  75%|████████████████████████████████▍          | 169/224 [01:34<00:34,  1.59it/s]
Epoch 10 Iter 170: loss 0.18165. :  76%|████████████████████████████████▋          | 170/224 [01:34<00:33,  1.63it/s]
Epoch 10 Iter 171: loss 0.18892. :  76%|████████████████████████████████▋          | 170/224 [01:34<00:33,  1.63it/s]
Epoch 10 Iter 171: loss 0.18892. :  76%|████████████████████████████████▊          | 171/224 [01:34<00:35,  1.51it/s]
Epoch 10 Iter 172: loss 0.19141. :  76%|████████████████████████████████▊          | 171/224 [01:35<00:35,  1.51it/s]
Epoch 10 Iter 172: loss 0.19141. :  77%|█████████████████████████████████          | 172/224 [01:35<00:36,  1.44it/s]
Epoch 10 Iter 173: loss 0.17077. :  77%|█████████████████████████████████          | 172/224 [01:36<00:36,  1.44it/s]
Epoch 10 Iter 173: loss 0.17077. :  77%|█████████████████████████████████▏         | 173/224 [01:36<00:36,  1.39it/s]
Epoch 10 Iter 174: loss 0.18089. :  77%|█████████████████████████████████▏         | 173/224 [01:37<00:36,  1.39it/s]
Epoch 10 Iter 174: loss 0.18089. :  78%|█████████████████████████████████▍         | 174/224 [01:37<00:36,  1.36it/s]
Epoch 10 Iter 175: loss 0.18884. :  78%|█████████████████████████████████▍         | 174/224 [01:37<00:36,  1.36it/s]
Epoch 10 Iter 175: loss 0.18884. :  78%|█████████████████████████████████▌         | 175/224 [01:37<00:36,  1.34it/s]
Epoch 10 Iter 176: loss 0.17046. :  78%|█████████████████████████████████▌         | 175/224 [01:38<00:36,  1.34it/s]
Epoch 10 Iter 176: loss 0.17046. :  79%|█████████████████████████████████▊         | 176/224 [01:38<00:33,  1.43it/s]
Epoch 10 Iter 177: loss 0.18207. :  79%|█████████████████████████████████▊         | 176/224 [01:39<00:33,  1.43it/s]
Epoch 10 Iter 177: loss 0.18207. :  79%|█████████████████████████████████▉         | 177/224 [01:39<00:30,  1.55it/s]
Epoch 10 Iter 178: loss 0.18253. :  79%|█████████████████████████████████▉         | 177/224 [01:39<00:30,  1.55it/s]
Epoch 10 Iter 178: loss 0.18253. :  79%|██████████████████████████████████▏        | 178/224 [01:39<00:28,  1.63it/s]
Epoch 10 Iter 179: loss 0.18005. :  79%|██████████████████████████████████▏        | 178/224 [01:40<00:28,  1.63it/s]
Epoch 10 Iter 179: loss 0.18005. :  80%|██████████████████████████████████▎        | 179/224 [01:40<00:28,  1.60it/s]
Epoch 10 Iter 180: loss 0.18256. :  80%|██████████████████████████████████▎        | 179/224 [01:40<00:28,  1.60it/s]
Epoch 10 Iter 180: loss 0.18256. :  80%|██████████████████████████████████▌        | 180/224 [01:40<00:28,  1.53it/s]
Epoch 10 Iter 181: loss 0.18160. :  80%|██████████████████████████████████▌        | 180/224 [01:41<00:28,  1.53it/s]
Epoch 10 Iter 181: loss 0.18160. :  81%|██████████████████████████████████▋        | 181/224 [01:41<00:28,  1.53it/s]
Epoch 10 Iter 182: loss 0.15821. :  81%|██████████████████████████████████▋        | 181/224 [01:42<00:28,  1.53it/s]
Epoch 10 Iter 182: loss 0.15821. :  81%|██████████████████████████████████▉        | 182/224 [01:42<00:25,  1.64it/s]
Epoch 10 Iter 183: loss 0.17951. :  81%|██████████████████████████████████▉        | 182/224 [01:42<00:25,  1.64it/s]
Epoch 10 Iter 183: loss 0.17951. :  82%|███████████████████████████████████▏       | 183/224 [01:42<00:24,  1.70it/s]
Epoch 10 Iter 184: loss 0.17098. :  82%|███████████████████████████████████▏       | 183/224 [01:43<00:24,  1.70it/s]
Epoch 10 Iter 184: loss 0.17098. :  82%|███████████████████████████████████▎       | 184/224 [01:43<00:23,  1.67it/s]
Epoch 10 Iter 185: loss 0.17450. :  82%|███████████████████████████████████▎       | 184/224 [01:43<00:23,  1.67it/s]
Epoch 10 Iter 185: loss 0.17450. :  83%|███████████████████████████████████▌       | 185/224 [01:43<00:23,  1.65it/s]
Epoch 10 Iter 186: loss 0.16881. :  83%|███████████████████████████████████▌       | 185/224 [01:44<00:23,  1.65it/s]
Epoch 10 Iter 186: loss 0.16881. :  83%|███████████████████████████████████▋       | 186/224 [01:44<00:24,  1.52it/s]
Epoch 10 Iter 187: loss 0.16883. :  83%|███████████████████████████████████▋       | 186/224 [01:45<00:24,  1.52it/s]
Epoch 10 Iter 187: loss 0.16883. :  83%|███████████████████████████████████▉       | 187/224 [01:45<00:25,  1.46it/s]
Epoch 10 Iter 188: loss 0.17621. :  83%|███████████████████████████████████▉       | 187/224 [01:46<00:25,  1.46it/s]
Epoch 10 Iter 188: loss 0.17621. :  84%|████████████████████████████████████       | 188/224 [01:46<00:23,  1.55it/s]
Epoch 10 Iter 189: loss 0.17928. :  84%|████████████████████████████████████       | 188/224 [01:46<00:23,  1.55it/s]
Epoch 10 Iter 189: loss 0.17928. :  84%|████████████████████████████████████▎      | 189/224 [01:46<00:21,  1.62it/s]
Epoch 10 Iter 190: loss 0.18986. :  84%|████████████████████████████████████▎      | 189/224 [01:47<00:21,  1.62it/s]
Epoch 10 Iter 190: loss 0.18986. :  85%|████████████████████████████████████▍      | 190/224 [01:47<00:21,  1.55it/s]
Epoch 10 Iter 191: loss 0.16100. :  85%|████████████████████████████████████▍      | 190/224 [01:47<00:21,  1.55it/s]
Epoch 10 Iter 191: loss 0.16100. :  85%|████████████████████████████████████▋      | 191/224 [01:47<00:20,  1.59it/s]
Epoch 10 Iter 192: loss 0.16608. :  85%|████████████████████████████████████▋      | 191/224 [01:48<00:20,  1.59it/s]
Epoch 10 Iter 192: loss 0.16608. :  86%|████████████████████████████████████▊      | 192/224 [01:48<00:20,  1.57it/s]
Epoch 10 Iter 193: loss 0.17989. :  86%|████████████████████████████████████▊      | 192/224 [01:49<00:20,  1.57it/s]
Epoch 10 Iter 193: loss 0.17989. :  86%|█████████████████████████████████████      | 193/224 [01:49<00:19,  1.57it/s]
Epoch 10 Iter 194: loss 0.18110. :  86%|█████████████████████████████████████      | 193/224 [01:49<00:19,  1.57it/s]
Epoch 10 Iter 194: loss 0.18110. :  87%|█████████████████████████████████████▏     | 194/224 [01:49<00:20,  1.48it/s]
Epoch 10 Iter 195: loss 0.17157. :  87%|█████████████████████████████████████▏     | 194/224 [01:50<00:20,  1.48it/s]
Epoch 10 Iter 195: loss 0.17157. :  87%|█████████████████████████████████████▍     | 195/224 [01:50<00:19,  1.50it/s]
Epoch 10 Iter 196: loss 0.17810. :  87%|█████████████████████████████████████▍     | 195/224 [01:51<00:19,  1.50it/s]
Epoch 10 Iter 196: loss 0.17810. :  88%|█████████████████████████████████████▋     | 196/224 [01:51<00:19,  1.44it/s]
Epoch 10 Iter 197: loss 0.19287. :  88%|█████████████████████████████████████▋     | 196/224 [01:52<00:19,  1.44it/s]
Epoch 10 Iter 197: loss 0.19287. :  88%|█████████████████████████████████████▊     | 197/224 [01:52<00:19,  1.41it/s]
Epoch 10 Iter 198: loss 0.18910. :  88%|█████████████████████████████████████▊     | 197/224 [01:52<00:19,  1.41it/s]
Epoch 10 Iter 198: loss 0.18910. :  88%|██████████████████████████████████████     | 198/224 [01:52<00:18,  1.38it/s]
Epoch 10 Iter 199: loss 0.19129. :  88%|██████████████████████████████████████     | 198/224 [01:53<00:18,  1.38it/s]
Epoch 10 Iter 199: loss 0.19129. :  89%|██████████████████████████████████████▏    | 199/224 [01:53<00:18,  1.36it/s]
Epoch 10 Iter 200: loss 0.18620. :  89%|██████████████████████████████████████▏    | 199/224 [01:54<00:18,  1.36it/s]
Epoch 10 Iter 200: loss 0.18620. :  89%|██████████████████████████████████████▍    | 200/224 [01:54<00:16,  1.46it/s]
Epoch 10 Iter 201: loss 0.16558. :  89%|██████████████████████████████████████▍    | 200/224 [01:54<00:16,  1.46it/s]
Epoch 10 Iter 201: loss 0.16558. :  90%|██████████████████████████████████████▌    | 201/224 [01:54<00:15,  1.53it/s]
Epoch 10 Iter 202: loss 0.17860. :  90%|██████████████████████████████████████▌    | 201/224 [01:55<00:15,  1.53it/s]
Epoch 10 Iter 202: loss 0.17860. :  90%|██████████████████████████████████████▊    | 202/224 [01:55<00:13,  1.61it/s]
Epoch 10 Iter 203: loss 0.18351. :  90%|██████████████████████████████████████▊    | 202/224 [01:55<00:13,  1.61it/s]
Epoch 10 Iter 203: loss 0.18351. :  91%|██████████████████████████████████████▉    | 203/224 [01:55<00:12,  1.68it/s]
Epoch 10 Iter 204: loss 0.17587. :  91%|██████████████████████████████████████▉    | 203/224 [01:56<00:12,  1.68it/s]
Epoch 10 Iter 204: loss 0.17587. :  91%|███████████████████████████████████████▏   | 204/224 [01:56<00:11,  1.70it/s]
Epoch 10 Iter 205: loss 0.18806. :  91%|███████████████████████████████████████▏   | 204/224 [01:57<00:11,  1.70it/s]
Epoch 10 Iter 205: loss 0.18806. :  92%|███████████████████████████████████████▎   | 205/224 [01:57<00:11,  1.65it/s]
Epoch 10 Iter 206: loss 0.16713. :  92%|███████████████████████████████████████▎   | 205/224 [01:57<00:11,  1.65it/s]
Epoch 10 Iter 206: loss 0.16713. :  92%|███████████████████████████████████████▌   | 206/224 [01:57<00:10,  1.68it/s]
Epoch 10 Iter 207: loss 0.17597. :  92%|███████████████████████████████████████▌   | 206/224 [01:58<00:10,  1.68it/s]
Epoch 10 Iter 207: loss 0.17597. :  92%|███████████████████████████████████████▋   | 207/224 [01:58<00:10,  1.67it/s]
Epoch 10 Iter 208: loss 0.19210. :  92%|███████████████████████████████████████▋   | 207/224 [01:58<00:10,  1.67it/s]
Epoch 10 Iter 208: loss 0.19210. :  93%|███████████████████████████████████████▉   | 208/224 [01:58<00:10,  1.54it/s]
Epoch 10 Iter 209: loss 0.18653. :  93%|███████████████████████████████████████▉   | 208/224 [01:59<00:10,  1.54it/s]
Epoch 10 Iter 209: loss 0.18653. :  93%|████████████████████████████████████████   | 209/224 [01:59<00:10,  1.46it/s]
Epoch 10 Iter 210: loss 0.16021. :  93%|████████████████████████████████████████   | 209/224 [02:00<00:10,  1.46it/s]
Epoch 10 Iter 210: loss 0.16021. :  94%|████████████████████████████████████████▎  | 210/224 [02:00<00:09,  1.49it/s]
Epoch 10 Iter 211: loss 0.17755. :  94%|████████████████████████████████████████▎  | 210/224 [02:01<00:09,  1.49it/s]
Epoch 10 Iter 211: loss 0.17755. :  94%|████████████████████████████████████████▌  | 211/224 [02:01<00:09,  1.43it/s]
Epoch 10 Iter 212: loss 0.16127. :  94%|████████████████████████████████████████▌  | 211/224 [02:01<00:09,  1.43it/s]
Epoch 10 Iter 212: loss 0.16127. :  95%|████████████████████████████████████████▋  | 212/224 [02:01<00:08,  1.39it/s]
Epoch 10 Iter 213: loss 0.18172. :  95%|████████████████████████████████████████▋  | 212/224 [02:02<00:08,  1.39it/s]
Epoch 10 Iter 213: loss 0.18172. :  95%|████████████████████████████████████████▉  | 213/224 [02:02<00:07,  1.42it/s]
Epoch 10 Iter 214: loss 0.17294. :  95%|████████████████████████████████████████▉  | 213/224 [02:03<00:07,  1.42it/s]
Epoch 10 Iter 214: loss 0.17294. :  96%|█████████████████████████████████████████  | 214/224 [02:03<00:07,  1.38it/s]
Epoch 10 Iter 215: loss 0.18573. :  96%|█████████████████████████████████████████  | 214/224 [02:04<00:07,  1.38it/s]
Epoch 10 Iter 215: loss 0.18573. :  96%|█████████████████████████████████████████▎ | 215/224 [02:04<00:06,  1.36it/s]
Epoch 10 Iter 216: loss 0.17586. :  96%|█████████████████████████████████████████▎ | 215/224 [02:04<00:06,  1.36it/s]
Epoch 10 Iter 216: loss 0.17586. :  96%|█████████████████████████████████████████▍ | 216/224 [02:04<00:05,  1.45it/s]
Epoch 10 Iter 217: loss 0.18130. :  96%|█████████████████████████████████████████▍ | 216/224 [02:05<00:05,  1.45it/s]
Epoch 10 Iter 217: loss 0.18130. :  97%|█████████████████████████████████████████▋ | 217/224 [02:05<00:04,  1.53it/s]
Epoch 10 Iter 218: loss 0.19853. :  97%|█████████████████████████████████████████▋ | 217/224 [02:05<00:04,  1.53it/s]
Epoch 10 Iter 218: loss 0.19853. :  97%|█████████████████████████████████████████▊ | 218/224 [02:05<00:03,  1.61it/s]
Epoch 10 Iter 219: loss 0.18929. :  97%|█████████████████████████████████████████▊ | 218/224 [02:06<00:03,  1.61it/s]
Epoch 10 Iter 219: loss 0.18929. :  98%|██████████████████████████████████████████ | 219/224 [02:06<00:03,  1.60it/s]
Epoch 10 Iter 220: loss 0.18338. :  98%|██████████████████████████████████████████ | 219/224 [02:07<00:03,  1.60it/s]
Epoch 10 Iter 220: loss 0.18338. :  98%|██████████████████████████████████████████▏| 220/224 [02:07<00:02,  1.64it/s]
Epoch 10 Iter 221: loss 0.18004. :  98%|██████████████████████████████████████████▏| 220/224 [02:07<00:02,  1.64it/s]
Epoch 10 Iter 221: loss 0.18004. :  99%|██████████████████████████████████████████▍| 221/224 [02:07<00:01,  1.51it/s]
Epoch 10 Iter 222: loss 0.17908. :  99%|██████████████████████████████████████████▍| 221/224 [02:08<00:01,  1.51it/s]
Epoch 10 Iter 222: loss 0.17908. :  99%|██████████████████████████████████████████▌| 222/224 [02:08<00:01,  1.44it/s]
Epoch 10 Iter 223: loss 0.18610. :  99%|██████████████████████████████████████████▌| 222/224 [02:09<00:01,  1.44it/s]
Epoch 10 Iter 223: loss 0.18610. : 100%|██████████████████████████████████████████▊| 223/224 [02:09<00:00,  1.47it/s]
Epoch 10 Iter 224: loss 0.19719. : 100%|██████████████████████████████████████████▊| 223/224 [02:09<00:00,  1.47it/s]
Epoch 10 Iter 224: loss 0.19719. : 100%|███████████████████████████████████████████| 224/224 [02:09<00:00,  1.44it/s]
Epoch 10 Iter 224: loss 0.19719. : 100%|███████████████████████████████████████████| 224/224 [02:09<00:00,  1.72it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.18427. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 11 Iter 1: loss 0.18427. :   0%|▏                                              | 1/224 [00:00<02:31,  1.47it/s]
Epoch 11 Iter 2: loss 0.17899. :   0%|▏                                              | 1/224 [00:01<02:31,  1.47it/s]
Epoch 11 Iter 2: loss 0.17899. :   1%|▍                                              | 2/224 [00:01<02:41,  1.37it/s]
Epoch 11 Iter 3: loss 0.17357. :   1%|▍                                              | 2/224 [00:02<02:41,  1.37it/s]
Epoch 11 Iter 3: loss 0.17357. :   1%|▋                                              | 3/224 [00:02<02:30,  1.47it/s]
Epoch 11 Iter 4: loss 0.17935. :   1%|▋                                              | 3/224 [00:02<02:30,  1.47it/s]
Epoch 11 Iter 4: loss 0.17935. :   2%|▊                                              | 4/224 [00:02<02:17,  1.60it/s]
Epoch 11 Iter 5: loss 0.14862. :   2%|▊                                              | 4/224 [00:03<02:17,  1.60it/s]
Epoch 11 Iter 5: loss 0.14862. :   2%|█                                              | 5/224 [00:03<02:24,  1.52it/s]
Epoch 11 Iter 6: loss 0.16513. :   2%|█                                              | 5/224 [00:04<02:24,  1.52it/s]
Epoch 11 Iter 6: loss 0.16513. :   3%|█▎                                             | 6/224 [00:04<02:26,  1.49it/s]
Epoch 11 Iter 7: loss 0.18261. :   3%|█▎                                             | 6/224 [00:04<02:26,  1.49it/s]
Epoch 11 Iter 7: loss 0.18261. :   3%|█▍                                             | 7/224 [00:04<02:32,  1.42it/s]
Epoch 11 Iter 8: loss 0.17948. :   3%|█▍                                             | 7/224 [00:05<02:32,  1.42it/s]
Epoch 11 Iter 8: loss 0.17948. :   4%|█▋                                             | 8/224 [00:05<02:24,  1.49it/s]
Epoch 11 Iter 9: loss 0.18256. :   4%|█▋                                             | 8/224 [00:05<02:24,  1.49it/s]
Epoch 11 Iter 9: loss 0.18256. :   4%|█▉                                             | 9/224 [00:05<02:15,  1.58it/s]
Epoch 11 Iter 10: loss 0.18086. :   4%|█▊                                            | 9/224 [00:06<02:15,  1.58it/s]
Epoch 11 Iter 10: loss 0.18086. :   4%|██                                           | 10/224 [00:06<02:12,  1.62it/s]
Epoch 11 Iter 11: loss 0.17573. :   4%|██                                           | 10/224 [00:07<02:12,  1.62it/s]
Epoch 11 Iter 11: loss 0.17573. :   5%|██▏                                          | 11/224 [00:07<02:22,  1.50it/s]
Epoch 11 Iter 12: loss 0.19431. :   5%|██▏                                          | 11/224 [00:08<02:22,  1.50it/s]
Epoch 11 Iter 12: loss 0.19431. :   5%|██▍                                          | 12/224 [00:08<02:28,  1.43it/s]
Epoch 11 Iter 13: loss 0.18186. :   5%|██▍                                          | 12/224 [00:08<02:28,  1.43it/s]
Epoch 11 Iter 13: loss 0.18186. :   6%|██▌                                          | 13/224 [00:08<02:33,  1.38it/s]
Epoch 11 Iter 14: loss 0.17908. :   6%|██▌                                          | 13/224 [00:09<02:33,  1.38it/s]
Epoch 11 Iter 14: loss 0.17908. :   6%|██▊                                          | 14/224 [00:09<02:31,  1.38it/s]
Epoch 11 Iter 15: loss 0.18810. :   6%|██▊                                          | 14/224 [00:10<02:31,  1.38it/s]
Epoch 11 Iter 15: loss 0.18810. :   7%|███                                          | 15/224 [00:10<02:36,  1.33it/s]
Epoch 11 Iter 16: loss 0.19589. :   7%|███                                          | 15/224 [00:11<02:36,  1.33it/s]
Epoch 11 Iter 16: loss 0.19589. :   7%|███▏                                         | 16/224 [00:11<02:39,  1.30it/s]
Epoch 11 Iter 17: loss 0.17272. :   7%|███▏                                         | 16/224 [00:11<02:39,  1.30it/s]
Epoch 11 Iter 17: loss 0.17272. :   8%|███▍                                         | 17/224 [00:11<02:26,  1.41it/s]
Epoch 11 Iter 18: loss 0.17169. :   8%|███▍                                         | 17/224 [00:12<02:26,  1.41it/s]
Epoch 11 Iter 18: loss 0.17169. :   8%|███▌                                         | 18/224 [00:12<02:30,  1.37it/s]
Epoch 11 Iter 19: loss 0.17703. :   8%|███▌                                         | 18/224 [00:13<02:30,  1.37it/s]
Epoch 11 Iter 19: loss 0.17703. :   8%|███▊                                         | 19/224 [00:13<02:28,  1.38it/s]
Epoch 11 Iter 20: loss 0.18216. :   8%|███▊                                         | 19/224 [00:13<02:28,  1.38it/s]
Epoch 11 Iter 20: loss 0.18216. :   9%|████                                         | 20/224 [00:13<02:16,  1.50it/s]
Epoch 11 Iter 21: loss 0.16998. :   9%|████                                         | 20/224 [00:14<02:16,  1.50it/s]
Epoch 11 Iter 21: loss 0.16998. :   9%|████▏                                        | 21/224 [00:14<02:15,  1.49it/s]
Epoch 11 Iter 22: loss 0.17555. :   9%|████▏                                        | 21/224 [00:15<02:15,  1.49it/s]
Epoch 11 Iter 22: loss 0.17555. :  10%|████▍                                        | 22/224 [00:15<02:20,  1.44it/s]
Epoch 11 Iter 23: loss 0.16874. :  10%|████▍                                        | 22/224 [00:15<02:20,  1.44it/s]
Epoch 11 Iter 23: loss 0.16874. :  10%|████▌                                        | 23/224 [00:15<02:23,  1.40it/s]
Epoch 11 Iter 24: loss 0.17574. :  10%|████▌                                        | 23/224 [00:16<02:23,  1.40it/s]
Epoch 11 Iter 24: loss 0.17574. :  11%|████▊                                        | 24/224 [00:16<02:12,  1.51it/s]
Epoch 11 Iter 25: loss 0.19720. :  11%|████▊                                        | 24/224 [00:17<02:12,  1.51it/s]
Epoch 11 Iter 25: loss 0.19720. :  11%|█████                                        | 25/224 [00:17<02:11,  1.51it/s]
Epoch 11 Iter 26: loss 0.16785. :  11%|█████                                        | 25/224 [00:17<02:11,  1.51it/s]
Epoch 11 Iter 26: loss 0.16785. :  12%|█████▏                                       | 26/224 [00:17<02:14,  1.47it/s]
Epoch 11 Iter 27: loss 0.15859. :  12%|█████▏                                       | 26/224 [00:18<02:14,  1.47it/s]
Epoch 11 Iter 27: loss 0.15859. :  12%|█████▍                                       | 27/224 [00:18<02:10,  1.51it/s]
Epoch 11 Iter 28: loss 0.16453. :  12%|█████▍                                       | 27/224 [00:19<02:10,  1.51it/s]
Epoch 11 Iter 28: loss 0.16453. :  12%|█████▋                                       | 28/224 [00:19<02:08,  1.52it/s]
Epoch 11 Iter 29: loss 0.16649. :  12%|█████▋                                       | 28/224 [00:19<02:08,  1.52it/s]
Epoch 11 Iter 29: loss 0.16649. :  13%|█████▊                                       | 29/224 [00:19<02:11,  1.49it/s]
Epoch 11 Iter 30: loss 0.16962. :  13%|█████▊                                       | 29/224 [00:20<02:11,  1.49it/s]
Epoch 11 Iter 30: loss 0.16962. :  13%|██████                                       | 30/224 [00:20<02:15,  1.43it/s]
Epoch 11 Iter 31: loss 0.17275. :  13%|██████                                       | 30/224 [00:21<02:15,  1.43it/s]
Epoch 11 Iter 31: loss 0.17275. :  14%|██████▏                                      | 31/224 [00:21<02:18,  1.40it/s]
Epoch 11 Iter 32: loss 0.18430. :  14%|██████▏                                      | 31/224 [00:22<02:18,  1.40it/s]
Epoch 11 Iter 32: loss 0.18430. :  14%|██████▍                                      | 32/224 [00:22<02:18,  1.39it/s]
Epoch 11 Iter 33: loss 0.17449. :  14%|██████▍                                      | 32/224 [00:22<02:18,  1.39it/s]
Epoch 11 Iter 33: loss 0.17449. :  15%|██████▋                                      | 33/224 [00:22<02:12,  1.45it/s]
Epoch 11 Iter 34: loss 0.17159. :  15%|██████▋                                      | 33/224 [00:23<02:12,  1.45it/s]
Epoch 11 Iter 34: loss 0.17159. :  15%|██████▊                                      | 34/224 [00:23<02:02,  1.55it/s]
Epoch 11 Iter 35: loss 0.17479. :  15%|██████▊                                      | 34/224 [00:23<02:02,  1.55it/s]
Epoch 11 Iter 35: loss 0.17479. :  16%|███████                                      | 35/224 [00:23<01:56,  1.62it/s]
Epoch 11 Iter 36: loss 0.18469. :  16%|███████                                      | 35/224 [00:24<01:56,  1.62it/s]
Epoch 11 Iter 36: loss 0.18469. :  16%|███████▏                                     | 36/224 [00:24<01:55,  1.63it/s]
Epoch 11 Iter 37: loss 0.19188. :  16%|███████▏                                     | 36/224 [00:24<01:55,  1.63it/s]
Epoch 11 Iter 37: loss 0.19188. :  17%|███████▍                                     | 37/224 [00:24<01:50,  1.69it/s]
Epoch 11 Iter 38: loss 0.16512. :  17%|███████▍                                     | 37/224 [00:25<01:50,  1.69it/s]
Epoch 11 Iter 38: loss 0.16512. :  17%|███████▋                                     | 38/224 [00:25<01:48,  1.72it/s]
Epoch 11 Iter 39: loss 0.17458. :  17%|███████▋                                     | 38/224 [00:26<01:48,  1.72it/s]
Epoch 11 Iter 39: loss 0.17458. :  17%|███████▊                                     | 39/224 [00:26<01:43,  1.78it/s]
Epoch 11 Iter 40: loss 0.18748. :  17%|███████▊                                     | 39/224 [00:26<01:43,  1.78it/s]
Epoch 11 Iter 40: loss 0.18748. :  18%|████████                                     | 40/224 [00:26<01:54,  1.61it/s]
Epoch 11 Iter 41: loss 0.18296. :  18%|████████                                     | 40/224 [00:27<01:54,  1.61it/s]
Epoch 11 Iter 41: loss 0.18296. :  18%|████████▏                                    | 41/224 [00:27<01:59,  1.53it/s]
Epoch 11 Iter 42: loss 0.16979. :  18%|████████▏                                    | 41/224 [00:28<01:59,  1.53it/s]
Epoch 11 Iter 42: loss 0.16979. :  19%|████████▍                                    | 42/224 [00:28<02:01,  1.50it/s]
Epoch 11 Iter 43: loss 0.18808. :  19%|████████▍                                    | 42/224 [00:29<02:01,  1.50it/s]
Epoch 11 Iter 43: loss 0.18808. :  19%|████████▋                                    | 43/224 [00:29<02:06,  1.43it/s]
Epoch 11 Iter 44: loss 0.19311. :  19%|████████▋                                    | 43/224 [00:29<02:06,  1.43it/s]
Epoch 11 Iter 44: loss 0.19311. :  20%|████████▊                                    | 44/224 [00:29<02:08,  1.40it/s]
Epoch 11 Iter 45: loss 0.16772. :  20%|████████▊                                    | 44/224 [00:30<02:08,  1.40it/s]
Epoch 11 Iter 45: loss 0.16772. :  20%|█████████                                    | 45/224 [00:30<02:10,  1.37it/s]
Epoch 11 Iter 46: loss 0.17743. :  20%|█████████                                    | 45/224 [00:31<02:10,  1.37it/s]
Epoch 11 Iter 46: loss 0.17743. :  21%|█████████▏                                   | 46/224 [00:31<02:11,  1.35it/s]
Epoch 11 Iter 47: loss 0.17568. :  21%|█████████▏                                   | 46/224 [00:31<02:11,  1.35it/s]
Epoch 11 Iter 47: loss 0.17568. :  21%|█████████▍                                   | 47/224 [00:31<02:06,  1.40it/s]
Epoch 11 Iter 48: loss 0.15602. :  21%|█████████▍                                   | 47/224 [00:32<02:06,  1.40it/s]
Epoch 11 Iter 48: loss 0.15602. :  21%|█████████▋                                   | 48/224 [00:32<02:02,  1.43it/s]
Epoch 11 Iter 49: loss 0.20013. :  21%|█████████▋                                   | 48/224 [00:33<02:02,  1.43it/s]
Epoch 11 Iter 49: loss 0.20013. :  22%|█████████▊                                   | 49/224 [00:33<02:05,  1.39it/s]
Epoch 11 Iter 50: loss 0.17454. :  22%|█████████▊                                   | 49/224 [00:34<02:05,  1.39it/s]
Epoch 11 Iter 50: loss 0.17454. :  22%|██████████                                   | 50/224 [00:34<02:01,  1.43it/s]
Epoch 11 Iter 51: loss 0.17341. :  22%|██████████                                   | 50/224 [00:34<02:01,  1.43it/s]
Epoch 11 Iter 51: loss 0.17341. :  23%|██████████▏                                  | 51/224 [00:34<01:52,  1.54it/s]
Epoch 11 Iter 52: loss 0.17734. :  23%|██████████▏                                  | 51/224 [00:35<01:52,  1.54it/s]
Epoch 11 Iter 52: loss 0.17734. :  23%|██████████▍                                  | 52/224 [00:35<01:49,  1.57it/s]
Epoch 11 Iter 53: loss 0.18035. :  23%|██████████▍                                  | 52/224 [00:35<01:49,  1.57it/s]
Epoch 11 Iter 53: loss 0.18035. :  24%|██████████▋                                  | 53/224 [00:35<01:47,  1.59it/s]
Epoch 11 Iter 54: loss 0.15996. :  24%|██████████▋                                  | 53/224 [00:36<01:47,  1.59it/s]
Epoch 11 Iter 54: loss 0.15996. :  24%|██████████▊                                  | 54/224 [00:36<01:43,  1.65it/s]
Epoch 11 Iter 55: loss 0.15721. :  24%|██████████▊                                  | 54/224 [00:36<01:43,  1.65it/s]
Epoch 11 Iter 55: loss 0.15721. :  25%|███████████                                  | 55/224 [00:36<01:39,  1.71it/s]
Epoch 11 Iter 56: loss 0.17454. :  25%|███████████                                  | 55/224 [00:37<01:39,  1.71it/s]
Epoch 11 Iter 56: loss 0.17454. :  25%|███████████▎                                 | 56/224 [00:37<01:36,  1.74it/s]
Epoch 11 Iter 57: loss 0.17489. :  25%|███████████▎                                 | 56/224 [00:37<01:36,  1.74it/s]
Epoch 11 Iter 57: loss 0.17489. :  25%|███████████▍                                 | 57/224 [00:37<01:35,  1.76it/s]
Epoch 11 Iter 58: loss 0.19381. :  25%|███████████▍                                 | 57/224 [00:38<01:35,  1.76it/s]
Epoch 11 Iter 58: loss 0.19381. :  26%|███████████▋                                 | 58/224 [00:38<01:34,  1.76it/s]
Epoch 11 Iter 59: loss 0.17931. :  26%|███████████▋                                 | 58/224 [00:39<01:34,  1.76it/s]
Epoch 11 Iter 59: loss 0.17931. :  26%|███████████▊                                 | 59/224 [00:39<01:33,  1.76it/s]
Epoch 11 Iter 60: loss 0.19080. :  26%|███████████▊                                 | 59/224 [00:39<01:33,  1.76it/s]
Epoch 11 Iter 60: loss 0.19080. :  27%|████████████                                 | 60/224 [00:39<01:41,  1.62it/s]
Epoch 11 Iter 61: loss 0.19122. :  27%|████████████                                 | 60/224 [00:40<01:41,  1.62it/s]
Epoch 11 Iter 61: loss 0.19122. :  27%|████████████▎                                | 61/224 [00:40<01:48,  1.51it/s]
Epoch 11 Iter 62: loss 0.18159. :  27%|████████████▎                                | 61/224 [00:41<01:48,  1.51it/s]
Epoch 11 Iter 62: loss 0.18159. :  28%|████████████▍                                | 62/224 [00:41<01:43,  1.57it/s]
Epoch 11 Iter 63: loss 0.17331. :  28%|████████████▍                                | 62/224 [00:41<01:43,  1.57it/s]
Epoch 11 Iter 63: loss 0.17331. :  28%|████████████▋                                | 63/224 [00:41<01:38,  1.64it/s]
Epoch 11 Iter 64: loss 0.17798. :  28%|████████████▋                                | 63/224 [00:42<01:38,  1.64it/s]
Epoch 11 Iter 64: loss 0.17798. :  29%|████████████▊                                | 64/224 [00:42<01:34,  1.69it/s]
Epoch 11 Iter 65: loss 0.17480. :  29%|████████████▊                                | 64/224 [00:42<01:34,  1.69it/s]
Epoch 11 Iter 65: loss 0.17480. :  29%|█████████████                                | 65/224 [00:42<01:34,  1.69it/s]
Epoch 11 Iter 66: loss 0.19823. :  29%|█████████████                                | 65/224 [00:43<01:34,  1.69it/s]
Epoch 11 Iter 66: loss 0.19823. :  29%|█████████████▎                               | 66/224 [00:43<01:39,  1.60it/s]
Epoch 11 Iter 67: loss 0.16775. :  29%|█████████████▎                               | 66/224 [00:44<01:39,  1.60it/s]
Epoch 11 Iter 67: loss 0.16775. :  30%|█████████████▍                               | 67/224 [00:44<01:39,  1.58it/s]
Epoch 11 Iter 68: loss 0.17729. :  30%|█████████████▍                               | 67/224 [00:44<01:39,  1.58it/s]
Epoch 11 Iter 68: loss 0.17729. :  30%|█████████████▋                               | 68/224 [00:44<01:35,  1.64it/s]
Epoch 11 Iter 69: loss 0.17100. :  30%|█████████████▋                               | 68/224 [00:45<01:35,  1.64it/s]
Epoch 11 Iter 69: loss 0.17100. :  31%|█████████████▊                               | 69/224 [00:45<01:34,  1.64it/s]
Epoch 11 Iter 70: loss 0.17373. :  31%|█████████████▊                               | 69/224 [00:46<01:34,  1.64it/s]
Epoch 11 Iter 70: loss 0.17373. :  31%|██████████████                               | 70/224 [00:46<01:42,  1.51it/s]
Epoch 11 Iter 71: loss 0.18392. :  31%|██████████████                               | 70/224 [00:46<01:42,  1.51it/s]
Epoch 11 Iter 71: loss 0.18392. :  32%|██████████████▎                              | 71/224 [00:46<01:36,  1.58it/s]
Epoch 11 Iter 72: loss 0.17007. :  32%|██████████████▎                              | 71/224 [00:47<01:36,  1.58it/s]
Epoch 11 Iter 72: loss 0.17007. :  32%|██████████████▍                              | 72/224 [00:47<01:34,  1.61it/s]
Epoch 11 Iter 73: loss 0.17781. :  32%|██████████████▍                              | 72/224 [00:47<01:34,  1.61it/s]
Epoch 11 Iter 73: loss 0.17781. :  33%|██████████████▋                              | 73/224 [00:47<01:29,  1.68it/s]
Epoch 11 Iter 74: loss 0.18897. :  33%|██████████████▋                              | 73/224 [00:48<01:29,  1.68it/s]
Epoch 11 Iter 74: loss 0.18897. :  33%|██████████████▊                              | 74/224 [00:48<01:26,  1.72it/s]
Epoch 11 Iter 75: loss 0.18335. :  33%|██████████████▊                              | 74/224 [00:48<01:26,  1.72it/s]
Epoch 11 Iter 75: loss 0.18335. :  33%|███████████████                              | 75/224 [00:48<01:24,  1.76it/s]
Epoch 11 Iter 76: loss 0.19303. :  33%|███████████████                              | 75/224 [00:49<01:24,  1.76it/s]
Epoch 11 Iter 76: loss 0.19303. :  34%|███████████████▎                             | 76/224 [00:49<01:25,  1.74it/s]
Epoch 11 Iter 77: loss 0.18604. :  34%|███████████████▎                             | 76/224 [00:50<01:25,  1.74it/s]
Epoch 11 Iter 77: loss 0.18604. :  34%|███████████████▍                             | 77/224 [00:50<01:22,  1.77it/s]
Epoch 11 Iter 78: loss 0.18563. :  34%|███████████████▍                             | 77/224 [00:50<01:22,  1.77it/s]
Epoch 11 Iter 78: loss 0.18563. :  35%|███████████████▋                             | 78/224 [00:50<01:23,  1.76it/s]
Epoch 11 Iter 79: loss 0.18152. :  35%|███████████████▋                             | 78/224 [00:51<01:23,  1.76it/s]
Epoch 11 Iter 79: loss 0.18152. :  35%|███████████████▊                             | 79/224 [00:51<01:28,  1.65it/s]
Epoch 11 Iter 80: loss 0.17022. :  35%|███████████████▊                             | 79/224 [00:51<01:28,  1.65it/s]
Epoch 11 Iter 80: loss 0.17022. :  36%|████████████████                             | 80/224 [00:51<01:27,  1.65it/s]
Epoch 11 Iter 81: loss 0.18126. :  36%|████████████████                             | 80/224 [00:52<01:27,  1.65it/s]
Epoch 11 Iter 81: loss 0.18126. :  36%|████████████████▎                            | 81/224 [00:52<01:26,  1.66it/s]
Epoch 11 Iter 82: loss 0.16306. :  36%|████████████████▎                            | 81/224 [00:53<01:26,  1.66it/s]
Epoch 11 Iter 82: loss 0.16306. :  37%|████████████████▍                            | 82/224 [00:53<01:22,  1.73it/s]
Epoch 11 Iter 83: loss 0.19083. :  37%|████████████████▍                            | 82/224 [00:53<01:22,  1.73it/s]
Epoch 11 Iter 83: loss 0.19083. :  37%|████████████████▋                            | 83/224 [00:53<01:21,  1.72it/s]
Epoch 11 Iter 84: loss 0.21344. :  37%|████████████████▋                            | 83/224 [00:54<01:21,  1.72it/s]
Epoch 11 Iter 84: loss 0.21344. :  38%|████████████████▉                            | 84/224 [00:54<01:29,  1.57it/s]
Epoch 11 Iter 85: loss 0.18157. :  38%|████████████████▉                            | 84/224 [00:55<01:29,  1.57it/s]
Epoch 11 Iter 85: loss 0.18157. :  38%|█████████████████                            | 85/224 [00:55<01:33,  1.48it/s]
Epoch 11 Iter 86: loss 0.18188. :  38%|█████████████████                            | 85/224 [00:55<01:33,  1.48it/s]
Epoch 11 Iter 86: loss 0.18188. :  38%|█████████████████▎                           | 86/224 [00:55<01:33,  1.48it/s]
Epoch 11 Iter 87: loss 0.16495. :  38%|█████████████████▎                           | 86/224 [00:56<01:33,  1.48it/s]
Epoch 11 Iter 87: loss 0.16495. :  39%|█████████████████▍                           | 87/224 [00:56<01:31,  1.50it/s]
Epoch 11 Iter 88: loss 0.17438. :  39%|█████████████████▍                           | 87/224 [00:57<01:31,  1.50it/s]
Epoch 11 Iter 88: loss 0.17438. :  39%|█████████████████▋                           | 88/224 [00:57<01:34,  1.43it/s]
Epoch 11 Iter 89: loss 0.17947. :  39%|█████████████████▋                           | 88/224 [00:58<01:34,  1.43it/s]
Epoch 11 Iter 89: loss 0.17947. :  40%|█████████████████▉                           | 89/224 [00:58<01:35,  1.42it/s]
Epoch 11 Iter 90: loss 0.18671. :  40%|█████████████████▉                           | 89/224 [00:58<01:35,  1.42it/s]
Epoch 11 Iter 90: loss 0.18671. :  40%|██████████████████                           | 90/224 [00:58<01:27,  1.53it/s]
Epoch 11 Iter 91: loss 0.19391. :  40%|██████████████████                           | 90/224 [00:59<01:27,  1.53it/s]
Epoch 11 Iter 91: loss 0.19391. :  41%|██████████████████▎                          | 91/224 [00:59<01:26,  1.54it/s]
Epoch 11 Iter 92: loss 0.17856. :  41%|██████████████████▎                          | 91/224 [00:59<01:26,  1.54it/s]
Epoch 11 Iter 92: loss 0.17856. :  41%|██████████████████▍                          | 92/224 [00:59<01:28,  1.49it/s]
Epoch 11 Iter 93: loss 0.17832. :  41%|██████████████████▍                          | 92/224 [01:00<01:28,  1.49it/s]
Epoch 11 Iter 93: loss 0.17832. :  42%|██████████████████▋                          | 93/224 [01:00<01:28,  1.49it/s]
Epoch 11 Iter 94: loss 0.19062. :  42%|██████████████████▋                          | 93/224 [01:01<01:28,  1.49it/s]
Epoch 11 Iter 94: loss 0.19062. :  42%|██████████████████▉                          | 94/224 [01:01<01:23,  1.56it/s]
Epoch 11 Iter 95: loss 0.19328. :  42%|██████████████████▉                          | 94/224 [01:01<01:23,  1.56it/s]
Epoch 11 Iter 95: loss 0.19328. :  42%|███████████████████                          | 95/224 [01:01<01:19,  1.63it/s]
Epoch 11 Iter 96: loss 0.17763. :  42%|███████████████████                          | 95/224 [01:02<01:19,  1.63it/s]
Epoch 11 Iter 96: loss 0.17763. :  43%|███████████████████▎                         | 96/224 [01:02<01:17,  1.66it/s]
Epoch 11 Iter 97: loss 0.16879. :  43%|███████████████████▎                         | 96/224 [01:03<01:17,  1.66it/s]
Epoch 11 Iter 97: loss 0.16879. :  43%|███████████████████▍                         | 97/224 [01:03<01:22,  1.55it/s]
Epoch 11 Iter 98: loss 0.20303. :  43%|███████████████████▍                         | 97/224 [01:03<01:22,  1.55it/s]
Epoch 11 Iter 98: loss 0.20303. :  44%|███████████████████▋                         | 98/224 [01:03<01:25,  1.47it/s]
Epoch 11 Iter 99: loss 0.16043. :  44%|███████████████████▋                         | 98/224 [01:04<01:25,  1.47it/s]
Epoch 11 Iter 99: loss 0.16043. :  44%|███████████████████▉                         | 99/224 [01:04<01:28,  1.42it/s]
Epoch 11 Iter 100: loss 0.18401. :  44%|███████████████████▍                        | 99/224 [01:05<01:28,  1.42it/s]
Epoch 11 Iter 100: loss 0.18401. :  45%|███████████████████▏                       | 100/224 [01:05<01:29,  1.38it/s]
Epoch 11 Iter 101: loss 0.15889. :  45%|███████████████████▏                       | 100/224 [01:06<01:29,  1.38it/s]
Epoch 11 Iter 101: loss 0.15889. :  45%|███████████████████▍                       | 101/224 [01:06<01:28,  1.39it/s]
Epoch 11 Iter 102: loss 0.16042. :  45%|███████████████████▍                       | 101/224 [01:06<01:28,  1.39it/s]
Epoch 11 Iter 102: loss 0.16042. :  46%|███████████████████▌                       | 102/224 [01:06<01:23,  1.47it/s]
Epoch 11 Iter 103: loss 0.19103. :  46%|███████████████████▌                       | 102/224 [01:07<01:23,  1.47it/s]
Epoch 11 Iter 103: loss 0.19103. :  46%|███████████████████▊                       | 103/224 [01:07<01:17,  1.55it/s]
Epoch 11 Iter 104: loss 0.16536. :  46%|███████████████████▊                       | 103/224 [01:07<01:17,  1.55it/s]
Epoch 11 Iter 104: loss 0.16536. :  46%|███████████████████▉                       | 104/224 [01:07<01:14,  1.62it/s]
Epoch 11 Iter 105: loss 0.20117. :  46%|███████████████████▉                       | 104/224 [01:08<01:14,  1.62it/s]
Epoch 11 Iter 105: loss 0.20117. :  47%|████████████████████▏                      | 105/224 [01:08<01:11,  1.66it/s]
Epoch 11 Iter 106: loss 0.18808. :  47%|████████████████████▏                      | 105/224 [01:08<01:11,  1.66it/s]
Epoch 11 Iter 106: loss 0.18808. :  47%|████████████████████▎                      | 106/224 [01:08<01:13,  1.60it/s]
Epoch 11 Iter 107: loss 0.18110. :  47%|████████████████████▎                      | 106/224 [01:09<01:13,  1.60it/s]
Epoch 11 Iter 107: loss 0.18110. :  48%|████████████████████▌                      | 107/224 [01:09<01:10,  1.66it/s]
Epoch 11 Iter 108: loss 0.18933. :  48%|████████████████████▌                      | 107/224 [01:10<01:10,  1.66it/s]
Epoch 11 Iter 108: loss 0.18933. :  48%|████████████████████▋                      | 108/224 [01:10<01:08,  1.71it/s]
Epoch 11 Iter 109: loss 0.19998. :  48%|████████████████████▋                      | 108/224 [01:10<01:08,  1.71it/s]
Epoch 11 Iter 109: loss 0.19998. :  49%|████████████████████▉                      | 109/224 [01:10<01:07,  1.71it/s]
Epoch 11 Iter 110: loss 0.17856. :  49%|████████████████████▉                      | 109/224 [01:11<01:07,  1.71it/s]
Epoch 11 Iter 110: loss 0.17856. :  49%|█████████████████████                      | 110/224 [01:11<01:12,  1.58it/s]
Epoch 11 Iter 111: loss 0.18661. :  49%|█████████████████████                      | 110/224 [01:12<01:12,  1.58it/s]
Epoch 11 Iter 111: loss 0.18661. :  50%|█████████████████████▎                     | 111/224 [01:12<01:12,  1.57it/s]
Epoch 11 Iter 112: loss 0.16525. :  50%|█████████████████████▎                     | 111/224 [01:12<01:12,  1.57it/s]
Epoch 11 Iter 112: loss 0.16525. :  50%|█████████████████████▌                     | 112/224 [01:12<01:08,  1.63it/s]
Epoch 11 Iter 113: loss 0.19396. :  50%|█████████████████████▌                     | 112/224 [01:13<01:08,  1.63it/s]
Epoch 11 Iter 113: loss 0.19396. :  50%|█████████████████████▋                     | 113/224 [01:13<01:12,  1.53it/s]
Epoch 11 Iter 114: loss 0.19008. :  50%|█████████████████████▋                     | 113/224 [01:13<01:12,  1.53it/s]
Epoch 11 Iter 114: loss 0.19008. :  51%|█████████████████████▉                     | 114/224 [01:13<01:07,  1.62it/s]
Epoch 11 Iter 115: loss 0.18271. :  51%|█████████████████████▉                     | 114/224 [01:14<01:07,  1.62it/s]
Epoch 11 Iter 115: loss 0.18271. :  51%|██████████████████████                     | 115/224 [01:14<01:05,  1.65it/s]
Epoch 11 Iter 116: loss 0.19155. :  51%|██████████████████████                     | 115/224 [01:15<01:05,  1.65it/s]
Epoch 11 Iter 116: loss 0.19155. :  52%|██████████████████████▎                    | 116/224 [01:15<01:05,  1.65it/s]
Epoch 11 Iter 117: loss 0.19967. :  52%|██████████████████████▎                    | 116/224 [01:15<01:05,  1.65it/s]
Epoch 11 Iter 117: loss 0.19967. :  52%|██████████████████████▍                    | 117/224 [01:15<01:08,  1.57it/s]
Epoch 11 Iter 118: loss 0.18794. :  52%|██████████████████████▍                    | 117/224 [01:16<01:08,  1.57it/s]
Epoch 11 Iter 118: loss 0.18794. :  53%|██████████████████████▋                    | 118/224 [01:16<01:04,  1.64it/s]
Epoch 11 Iter 119: loss 0.17262. :  53%|██████████████████████▋                    | 118/224 [01:16<01:04,  1.64it/s]
Epoch 11 Iter 119: loss 0.17262. :  53%|██████████████████████▊                    | 119/224 [01:16<01:01,  1.70it/s]
Epoch 11 Iter 120: loss 0.20041. :  53%|██████████████████████▊                    | 119/224 [01:17<01:01,  1.70it/s]
Epoch 11 Iter 120: loss 0.20041. :  54%|███████████████████████                    | 120/224 [01:17<01:00,  1.72it/s]
Epoch 11 Iter 121: loss 0.18475. :  54%|███████████████████████                    | 120/224 [01:17<01:00,  1.72it/s]
Epoch 11 Iter 121: loss 0.18475. :  54%|███████████████████████▏                   | 121/224 [01:17<00:59,  1.74it/s]
Epoch 11 Iter 122: loss 0.18725. :  54%|███████████████████████▏                   | 121/224 [01:18<00:59,  1.74it/s]
Epoch 11 Iter 122: loss 0.18725. :  54%|███████████████████████▍                   | 122/224 [01:18<01:00,  1.69it/s]
Epoch 11 Iter 123: loss 0.15726. :  54%|███████████████████████▍                   | 122/224 [01:19<01:00,  1.69it/s]
Epoch 11 Iter 123: loss 0.15726. :  55%|███████████████████████▌                   | 123/224 [01:19<01:05,  1.55it/s]
Epoch 11 Iter 124: loss 0.17813. :  55%|███████████████████████▌                   | 123/224 [01:20<01:05,  1.55it/s]
Epoch 11 Iter 124: loss 0.17813. :  55%|███████████████████████▊                   | 124/224 [01:20<01:08,  1.47it/s]
Epoch 11 Iter 125: loss 0.17193. :  55%|███████████████████████▊                   | 124/224 [01:20<01:08,  1.47it/s]
Epoch 11 Iter 125: loss 0.17193. :  56%|███████████████████████▉                   | 125/224 [01:20<01:02,  1.58it/s]
Epoch 11 Iter 126: loss 0.18210. :  56%|███████████████████████▉                   | 125/224 [01:21<01:02,  1.58it/s]
Epoch 11 Iter 126: loss 0.18210. :  56%|████████████████████████▏                  | 126/224 [01:21<00:58,  1.68it/s]
Epoch 11 Iter 127: loss 0.18220. :  56%|████████████████████████▏                  | 126/224 [01:21<00:58,  1.68it/s]
Epoch 11 Iter 127: loss 0.18220. :  57%|████████████████████████▍                  | 127/224 [01:21<00:54,  1.77it/s]
Epoch 11 Iter 128: loss 0.18605. :  57%|████████████████████████▍                  | 127/224 [01:22<00:54,  1.77it/s]
Epoch 11 Iter 128: loss 0.18605. :  57%|████████████████████████▌                  | 128/224 [01:22<00:53,  1.81it/s]
Epoch 11 Iter 129: loss 0.16999. :  57%|████████████████████████▌                  | 128/224 [01:22<00:53,  1.81it/s]
Epoch 11 Iter 129: loss 0.16999. :  58%|████████████████████████▊                  | 129/224 [01:22<00:51,  1.86it/s]
Epoch 11 Iter 130: loss 0.18380. :  58%|████████████████████████▊                  | 129/224 [01:23<00:51,  1.86it/s]
Epoch 11 Iter 130: loss 0.18380. :  58%|████████████████████████▉                  | 130/224 [01:23<00:49,  1.89it/s]
Epoch 11 Iter 131: loss 0.15312. :  58%|████████████████████████▉                  | 130/224 [01:23<00:49,  1.89it/s]
Epoch 11 Iter 131: loss 0.15312. :  58%|█████████████████████████▏                 | 131/224 [01:23<00:48,  1.91it/s]
Epoch 11 Iter 132: loss 0.18634. :  58%|█████████████████████████▏                 | 131/224 [01:24<00:48,  1.91it/s]
Epoch 11 Iter 132: loss 0.18634. :  59%|█████████████████████████▎                 | 132/224 [01:24<00:47,  1.93it/s]
Epoch 11 Iter 133: loss 0.19789. :  59%|█████████████████████████▎                 | 132/224 [01:24<00:47,  1.93it/s]
Epoch 11 Iter 133: loss 0.19789. :  59%|█████████████████████████▌                 | 133/224 [01:24<00:46,  1.94it/s]
Epoch 11 Iter 134: loss 0.18622. :  59%|█████████████████████████▌                 | 133/224 [01:25<00:46,  1.94it/s]
Epoch 11 Iter 134: loss 0.18622. :  60%|█████████████████████████▋                 | 134/224 [01:25<00:46,  1.95it/s]
Epoch 11 Iter 135: loss 0.18110. :  60%|█████████████████████████▋                 | 134/224 [01:25<00:46,  1.95it/s]
Epoch 11 Iter 135: loss 0.18110. :  60%|█████████████████████████▉                 | 135/224 [01:25<00:46,  1.93it/s]
Epoch 11 Iter 136: loss 0.20427. :  60%|█████████████████████████▉                 | 135/224 [01:26<00:46,  1.93it/s]
Epoch 11 Iter 136: loss 0.20427. :  61%|██████████████████████████                 | 136/224 [01:26<00:45,  1.94it/s]
Epoch 11 Iter 137: loss 0.16702. :  61%|██████████████████████████                 | 136/224 [01:26<00:45,  1.94it/s]
Epoch 11 Iter 137: loss 0.16702. :  61%|██████████████████████████▎                | 137/224 [01:26<00:44,  1.96it/s]
Epoch 11 Iter 138: loss 0.17300. :  61%|██████████████████████████▎                | 137/224 [01:27<00:44,  1.96it/s]
Epoch 11 Iter 138: loss 0.17300. :  62%|██████████████████████████▍                | 138/224 [01:27<00:43,  1.97it/s]
Epoch 11 Iter 139: loss 0.17539. :  62%|██████████████████████████▍                | 138/224 [01:27<00:43,  1.97it/s]
Epoch 11 Iter 139: loss 0.17539. :  62%|██████████████████████████▋                | 139/224 [01:27<00:43,  1.97it/s]
Epoch 11 Iter 140: loss 0.19887. :  62%|██████████████████████████▋                | 139/224 [01:28<00:43,  1.97it/s]
Epoch 11 Iter 140: loss 0.19887. :  62%|██████████████████████████▉                | 140/224 [01:28<00:42,  1.96it/s]
Epoch 11 Iter 141: loss 0.18307. :  62%|██████████████████████████▉                | 140/224 [01:28<00:42,  1.96it/s]
Epoch 11 Iter 141: loss 0.18307. :  63%|███████████████████████████                | 141/224 [01:28<00:42,  1.97it/s]
Epoch 11 Iter 142: loss 0.16328. :  63%|███████████████████████████                | 141/224 [01:29<00:42,  1.97it/s]
Epoch 11 Iter 142: loss 0.16328. :  63%|███████████████████████████▎               | 142/224 [01:29<00:41,  1.96it/s]
Epoch 11 Iter 143: loss 0.17213. :  63%|███████████████████████████▎               | 142/224 [01:29<00:41,  1.96it/s]
Epoch 11 Iter 143: loss 0.17213. :  64%|███████████████████████████▍               | 143/224 [01:29<00:43,  1.86it/s]
Epoch 11 Iter 144: loss 0.16855. :  64%|███████████████████████████▍               | 143/224 [01:30<00:43,  1.86it/s]
Epoch 11 Iter 144: loss 0.16855. :  64%|███████████████████████████▋               | 144/224 [01:30<00:43,  1.84it/s]
Epoch 11 Iter 145: loss 0.18368. :  64%|███████████████████████████▋               | 144/224 [01:31<00:43,  1.84it/s]
Epoch 11 Iter 145: loss 0.18368. :  65%|███████████████████████████▊               | 145/224 [01:31<00:42,  1.87it/s]
Epoch 11 Iter 146: loss 0.16335. :  65%|███████████████████████████▊               | 145/224 [01:31<00:42,  1.87it/s]
Epoch 11 Iter 146: loss 0.16335. :  65%|████████████████████████████               | 146/224 [01:31<00:40,  1.90it/s]
Epoch 11 Iter 147: loss 0.20681. :  65%|████████████████████████████               | 146/224 [01:32<00:40,  1.90it/s]
Epoch 11 Iter 147: loss 0.20681. :  66%|████████████████████████████▏              | 147/224 [01:32<00:39,  1.93it/s]
Epoch 11 Iter 148: loss 0.18784. :  66%|████████████████████████████▏              | 147/224 [01:32<00:39,  1.93it/s]
Epoch 11 Iter 148: loss 0.18784. :  66%|████████████████████████████▍              | 148/224 [01:32<00:39,  1.95it/s]
Epoch 11 Iter 149: loss 0.17176. :  66%|████████████████████████████▍              | 148/224 [01:33<00:39,  1.95it/s]
Epoch 11 Iter 149: loss 0.17176. :  67%|████████████████████████████▌              | 149/224 [01:33<00:38,  1.96it/s]
Epoch 11 Iter 150: loss 0.18150. :  67%|████████████████████████████▌              | 149/224 [01:33<00:38,  1.96it/s]
Epoch 11 Iter 150: loss 0.18150. :  67%|████████████████████████████▊              | 150/224 [01:33<00:38,  1.94it/s]
Epoch 11 Iter 151: loss 0.18688. :  67%|████████████████████████████▊              | 150/224 [01:34<00:38,  1.94it/s]
Epoch 11 Iter 151: loss 0.18688. :  67%|████████████████████████████▉              | 151/224 [01:34<00:37,  1.93it/s]
Epoch 11 Iter 152: loss 0.16548. :  67%|████████████████████████████▉              | 151/224 [01:34<00:37,  1.93it/s]
Epoch 11 Iter 152: loss 0.16548. :  68%|█████████████████████████████▏             | 152/224 [01:34<00:36,  1.95it/s]
Epoch 11 Iter 153: loss 0.18437. :  68%|█████████████████████████████▏             | 152/224 [01:35<00:36,  1.95it/s]
Epoch 11 Iter 153: loss 0.18437. :  68%|█████████████████████████████▎             | 153/224 [01:35<00:36,  1.97it/s]
Epoch 11 Iter 154: loss 0.19463. :  68%|█████████████████████████████▎             | 153/224 [01:35<00:36,  1.97it/s]
Epoch 11 Iter 154: loss 0.19463. :  69%|█████████████████████████████▌             | 154/224 [01:35<00:35,  1.97it/s]
Epoch 11 Iter 155: loss 0.18585. :  69%|█████████████████████████████▌             | 154/224 [01:36<00:35,  1.97it/s]
Epoch 11 Iter 155: loss 0.18585. :  69%|█████████████████████████████▊             | 155/224 [01:36<00:35,  1.96it/s]
Epoch 11 Iter 156: loss 0.17252. :  69%|█████████████████████████████▊             | 155/224 [01:36<00:35,  1.96it/s]
Epoch 11 Iter 156: loss 0.17252. :  70%|█████████████████████████████▉             | 156/224 [01:36<00:34,  1.96it/s]
Epoch 11 Iter 157: loss 0.17654. :  70%|█████████████████████████████▉             | 156/224 [01:37<00:34,  1.96it/s]
Epoch 11 Iter 157: loss 0.17654. :  70%|██████████████████████████████▏            | 157/224 [01:37<00:34,  1.94it/s]
Epoch 11 Iter 158: loss 0.17698. :  70%|██████████████████████████████▏            | 157/224 [01:37<00:34,  1.94it/s]
Epoch 11 Iter 158: loss 0.17698. :  71%|██████████████████████████████▎            | 158/224 [01:37<00:34,  1.94it/s]
Epoch 11 Iter 159: loss 0.15634. :  71%|██████████████████████████████▎            | 158/224 [01:38<00:34,  1.94it/s]
Epoch 11 Iter 159: loss 0.15634. :  71%|██████████████████████████████▌            | 159/224 [01:38<00:33,  1.96it/s]
Epoch 11 Iter 160: loss 0.19094. :  71%|██████████████████████████████▌            | 159/224 [01:38<00:33,  1.96it/s]
Epoch 11 Iter 160: loss 0.19094. :  71%|██████████████████████████████▋            | 160/224 [01:38<00:32,  1.97it/s]
Epoch 11 Iter 161: loss 0.17519. :  71%|██████████████████████████████▋            | 160/224 [01:39<00:32,  1.97it/s]
Epoch 11 Iter 161: loss 0.17519. :  72%|██████████████████████████████▉            | 161/224 [01:39<00:31,  1.98it/s]
Epoch 11 Iter 162: loss 0.18212. :  72%|██████████████████████████████▉            | 161/224 [01:39<00:31,  1.98it/s]
Epoch 11 Iter 162: loss 0.18212. :  72%|███████████████████████████████            | 162/224 [01:39<00:31,  1.99it/s]
Epoch 11 Iter 163: loss 0.17004. :  72%|███████████████████████████████            | 162/224 [01:40<00:31,  1.99it/s]
Epoch 11 Iter 163: loss 0.17004. :  73%|███████████████████████████████▎           | 163/224 [01:40<00:30,  1.99it/s]
Epoch 11 Iter 164: loss 0.19406. :  73%|███████████████████████████████▎           | 163/224 [01:40<00:30,  1.99it/s]
Epoch 11 Iter 164: loss 0.19406. :  73%|███████████████████████████████▍           | 164/224 [01:40<00:30,  1.97it/s]
Epoch 11 Iter 165: loss 0.19240. :  73%|███████████████████████████████▍           | 164/224 [01:41<00:30,  1.97it/s]
Epoch 11 Iter 165: loss 0.19240. :  74%|███████████████████████████████▋           | 165/224 [01:41<00:29,  1.98it/s]
Epoch 11 Iter 166: loss 0.16148. :  74%|███████████████████████████████▋           | 165/224 [01:41<00:29,  1.98it/s]
Epoch 11 Iter 166: loss 0.16148. :  74%|███████████████████████████████▊           | 166/224 [01:41<00:30,  1.91it/s]
Epoch 11 Iter 167: loss 0.19407. :  74%|███████████████████████████████▊           | 166/224 [01:42<00:30,  1.91it/s]
Epoch 11 Iter 167: loss 0.19407. :  75%|████████████████████████████████           | 167/224 [01:42<00:29,  1.90it/s]
Epoch 11 Iter 168: loss 0.16743. :  75%|████████████████████████████████           | 167/224 [01:42<00:29,  1.90it/s]
Epoch 11 Iter 168: loss 0.16743. :  75%|████████████████████████████████▎          | 168/224 [01:42<00:29,  1.90it/s]
Epoch 11 Iter 169: loss 0.18069. :  75%|████████████████████████████████▎          | 168/224 [01:43<00:29,  1.90it/s]
Epoch 11 Iter 169: loss 0.18069. :  75%|████████████████████████████████▍          | 169/224 [01:43<00:28,  1.94it/s]
Epoch 11 Iter 170: loss 0.17468. :  75%|████████████████████████████████▍          | 169/224 [01:43<00:28,  1.94it/s]
Epoch 11 Iter 170: loss 0.17468. :  76%|████████████████████████████████▋          | 170/224 [01:43<00:27,  1.95it/s]
Epoch 11 Iter 171: loss 0.17785. :  76%|████████████████████████████████▋          | 170/224 [01:44<00:27,  1.95it/s]
Epoch 11 Iter 171: loss 0.17785. :  76%|████████████████████████████████▊          | 171/224 [01:44<00:27,  1.94it/s]
Epoch 11 Iter 172: loss 0.17984. :  76%|████████████████████████████████▊          | 171/224 [01:44<00:27,  1.94it/s]
Epoch 11 Iter 172: loss 0.17984. :  77%|█████████████████████████████████          | 172/224 [01:44<00:26,  1.95it/s]
Epoch 11 Iter 173: loss 0.17363. :  77%|█████████████████████████████████          | 172/224 [01:45<00:26,  1.95it/s]
Epoch 11 Iter 173: loss 0.17363. :  77%|█████████████████████████████████▏         | 173/224 [01:45<00:26,  1.90it/s]
Epoch 11 Iter 174: loss 0.18113. :  77%|█████████████████████████████████▏         | 173/224 [01:45<00:26,  1.90it/s]
Epoch 11 Iter 174: loss 0.18113. :  78%|█████████████████████████████████▍         | 174/224 [01:45<00:26,  1.87it/s]
Epoch 11 Iter 175: loss 0.16478. :  78%|█████████████████████████████████▍         | 174/224 [01:46<00:26,  1.87it/s]
Epoch 11 Iter 175: loss 0.16478. :  78%|█████████████████████████████████▌         | 175/224 [01:46<00:27,  1.76it/s]
Epoch 11 Iter 176: loss 0.15657. :  78%|█████████████████████████████████▌         | 175/224 [01:47<00:27,  1.76it/s]
Epoch 11 Iter 176: loss 0.15657. :  79%|█████████████████████████████████▊         | 176/224 [01:47<00:28,  1.69it/s]
Epoch 11 Iter 177: loss 0.18343. :  79%|█████████████████████████████████▊         | 176/224 [01:47<00:28,  1.69it/s]
Epoch 11 Iter 177: loss 0.18343. :  79%|█████████████████████████████████▉         | 177/224 [01:47<00:27,  1.73it/s]
Epoch 11 Iter 178: loss 0.18834. :  79%|█████████████████████████████████▉         | 177/224 [01:48<00:27,  1.73it/s]
Epoch 11 Iter 178: loss 0.18834. :  79%|██████████████████████████████████▏        | 178/224 [01:48<00:25,  1.78it/s]
Epoch 11 Iter 179: loss 0.19341. :  79%|██████████████████████████████████▏        | 178/224 [01:48<00:25,  1.78it/s]
Epoch 11 Iter 179: loss 0.19341. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:25,  1.77it/s]
Epoch 11 Iter 180: loss 0.16608. :  80%|██████████████████████████████████▎        | 179/224 [01:49<00:25,  1.77it/s]
Epoch 11 Iter 180: loss 0.16608. :  80%|██████████████████████████████████▌        | 180/224 [01:49<00:27,  1.60it/s]
Epoch 11 Iter 181: loss 0.17439. :  80%|██████████████████████████████████▌        | 180/224 [01:50<00:27,  1.60it/s]
Epoch 11 Iter 181: loss 0.17439. :  81%|██████████████████████████████████▋        | 181/224 [01:50<00:28,  1.50it/s]
Epoch 11 Iter 182: loss 0.17214. :  81%|██████████████████████████████████▋        | 181/224 [01:51<00:28,  1.50it/s]
Epoch 11 Iter 182: loss 0.17214. :  81%|██████████████████████████████████▉        | 182/224 [01:51<00:29,  1.44it/s]
Epoch 11 Iter 183: loss 0.18828. :  81%|██████████████████████████████████▉        | 182/224 [01:51<00:29,  1.44it/s]
Epoch 11 Iter 183: loss 0.18828. :  82%|███████████████████████████████████▏       | 183/224 [01:51<00:27,  1.49it/s]
Epoch 11 Iter 184: loss 0.18104. :  82%|███████████████████████████████████▏       | 183/224 [01:52<00:27,  1.49it/s]
Epoch 11 Iter 184: loss 0.18104. :  82%|███████████████████████████████████▎       | 184/224 [01:52<00:25,  1.59it/s]
Epoch 11 Iter 185: loss 0.17437. :  82%|███████████████████████████████████▎       | 184/224 [01:52<00:25,  1.59it/s]
Epoch 11 Iter 185: loss 0.17437. :  83%|███████████████████████████████████▌       | 185/224 [01:52<00:24,  1.62it/s]
Epoch 11 Iter 186: loss 0.17858. :  83%|███████████████████████████████████▌       | 185/224 [01:53<00:24,  1.62it/s]
Epoch 11 Iter 186: loss 0.17858. :  83%|███████████████████████████████████▋       | 186/224 [01:53<00:25,  1.51it/s]
Epoch 11 Iter 187: loss 0.19249. :  83%|███████████████████████████████████▋       | 186/224 [01:54<00:25,  1.51it/s]
Epoch 11 Iter 187: loss 0.19249. :  83%|███████████████████████████████████▉       | 187/224 [01:54<00:25,  1.44it/s]
Epoch 11 Iter 188: loss 0.18219. :  83%|███████████████████████████████████▉       | 187/224 [01:55<00:25,  1.44it/s]
Epoch 11 Iter 188: loss 0.18219. :  84%|████████████████████████████████████       | 188/224 [01:55<00:25,  1.41it/s]
Epoch 11 Iter 189: loss 0.18077. :  84%|████████████████████████████████████       | 188/224 [01:55<00:25,  1.41it/s]
Epoch 11 Iter 189: loss 0.18077. :  84%|████████████████████████████████████▎      | 189/224 [01:55<00:25,  1.37it/s]
Epoch 11 Iter 190: loss 0.19389. :  84%|████████████████████████████████████▎      | 189/224 [01:56<00:25,  1.37it/s]
Epoch 11 Iter 190: loss 0.19389. :  85%|████████████████████████████████████▍      | 190/224 [01:56<00:25,  1.35it/s]
Epoch 11 Iter 191: loss 0.17403. :  85%|████████████████████████████████████▍      | 190/224 [01:57<00:25,  1.35it/s]
Epoch 11 Iter 191: loss 0.17403. :  85%|████████████████████████████████████▋      | 191/224 [01:57<00:23,  1.38it/s]
Epoch 11 Iter 192: loss 0.20110. :  85%|████████████████████████████████████▋      | 191/224 [01:58<00:23,  1.38it/s]
Epoch 11 Iter 192: loss 0.20110. :  86%|████████████████████████████████████▊      | 192/224 [01:58<00:22,  1.43it/s]
Epoch 11 Iter 193: loss 0.17127. :  86%|████████████████████████████████████▊      | 192/224 [01:58<00:22,  1.43it/s]
Epoch 11 Iter 193: loss 0.17127. :  86%|█████████████████████████████████████      | 193/224 [01:58<00:20,  1.53it/s]
Epoch 11 Iter 194: loss 0.16005. :  86%|█████████████████████████████████████      | 193/224 [01:59<00:20,  1.53it/s]
Epoch 11 Iter 194: loss 0.16005. :  87%|█████████████████████████████████████▏     | 194/224 [01:59<00:20,  1.45it/s]
Epoch 11 Iter 195: loss 0.16773. :  87%|█████████████████████████████████████▏     | 194/224 [01:59<00:20,  1.45it/s]
Epoch 11 Iter 195: loss 0.16773. :  87%|█████████████████████████████████████▍     | 195/224 [01:59<00:18,  1.53it/s]
Epoch 11 Iter 196: loss 0.17367. :  87%|█████████████████████████████████████▍     | 195/224 [02:00<00:18,  1.53it/s]
Epoch 11 Iter 196: loss 0.17367. :  88%|█████████████████████████████████████▋     | 196/224 [02:00<00:17,  1.60it/s]
Epoch 11 Iter 197: loss 0.18614. :  88%|█████████████████████████████████████▋     | 196/224 [02:01<00:17,  1.60it/s]
Epoch 11 Iter 197: loss 0.18614. :  88%|█████████████████████████████████████▊     | 197/224 [02:01<00:16,  1.68it/s]
Epoch 11 Iter 198: loss 0.19020. :  88%|█████████████████████████████████████▊     | 197/224 [02:01<00:16,  1.68it/s]
Epoch 11 Iter 198: loss 0.19020. :  88%|██████████████████████████████████████     | 198/224 [02:01<00:16,  1.54it/s]
Epoch 11 Iter 199: loss 0.18401. :  88%|██████████████████████████████████████     | 198/224 [02:02<00:16,  1.54it/s]
Epoch 11 Iter 199: loss 0.18401. :  89%|██████████████████████████████████████▏    | 199/224 [02:02<00:17,  1.46it/s]
Epoch 11 Iter 200: loss 0.17377. :  89%|██████████████████████████████████████▏    | 199/224 [02:03<00:17,  1.46it/s]
Epoch 11 Iter 200: loss 0.17377. :  89%|██████████████████████████████████████▍    | 200/224 [02:03<00:16,  1.41it/s]
Epoch 11 Iter 201: loss 0.18984. :  89%|██████████████████████████████████████▍    | 200/224 [02:04<00:16,  1.41it/s]
Epoch 11 Iter 201: loss 0.18984. :  90%|██████████████████████████████████████▌    | 201/224 [02:04<00:16,  1.39it/s]
Epoch 11 Iter 202: loss 0.17839. :  90%|██████████████████████████████████████▌    | 201/224 [02:04<00:16,  1.39it/s]
Epoch 11 Iter 202: loss 0.17839. :  90%|██████████████████████████████████████▊    | 202/224 [02:04<00:15,  1.46it/s]
Epoch 11 Iter 203: loss 0.17837. :  90%|██████████████████████████████████████▊    | 202/224 [02:05<00:15,  1.46it/s]
Epoch 11 Iter 203: loss 0.17837. :  91%|██████████████████████████████████████▉    | 203/224 [02:05<00:13,  1.52it/s]
Epoch 11 Iter 204: loss 0.16930. :  91%|██████████████████████████████████████▉    | 203/224 [02:05<00:13,  1.52it/s]
Epoch 11 Iter 204: loss 0.16930. :  91%|███████████████████████████████████████▏   | 204/224 [02:05<00:12,  1.61it/s]
Epoch 11 Iter 205: loss 0.17885. :  91%|███████████████████████████████████████▏   | 204/224 [02:06<00:12,  1.61it/s]
Epoch 11 Iter 205: loss 0.17885. :  92%|███████████████████████████████████████▎   | 205/224 [02:06<00:12,  1.49it/s]
Epoch 11 Iter 206: loss 0.16988. :  92%|███████████████████████████████████████▎   | 205/224 [02:07<00:12,  1.49it/s]
Epoch 11 Iter 206: loss 0.16988. :  92%|███████████████████████████████████████▌   | 206/224 [02:07<00:11,  1.55it/s]
Epoch 11 Iter 207: loss 0.18079. :  92%|███████████████████████████████████████▌   | 206/224 [02:07<00:11,  1.55it/s]
Epoch 11 Iter 207: loss 0.18079. :  92%|███████████████████████████████████████▋   | 207/224 [02:07<00:10,  1.63it/s]
Epoch 11 Iter 208: loss 0.16669. :  92%|███████████████████████████████████████▋   | 207/224 [02:08<00:10,  1.63it/s]
Epoch 11 Iter 208: loss 0.16669. :  93%|███████████████████████████████████████▉   | 208/224 [02:08<00:09,  1.68it/s]
Epoch 11 Iter 209: loss 0.17755. :  93%|███████████████████████████████████████▉   | 208/224 [02:09<00:09,  1.68it/s]
Epoch 11 Iter 209: loss 0.17755. :  93%|████████████████████████████████████████   | 209/224 [02:09<00:09,  1.56it/s]
Epoch 11 Iter 210: loss 0.17389. :  93%|████████████████████████████████████████   | 209/224 [02:09<00:09,  1.56it/s]
Epoch 11 Iter 210: loss 0.17389. :  94%|████████████████████████████████████████▎  | 210/224 [02:09<00:09,  1.47it/s]
Epoch 11 Iter 211: loss 0.17750. :  94%|████████████████████████████████████████▎  | 210/224 [02:10<00:09,  1.47it/s]
Epoch 11 Iter 211: loss 0.17750. :  94%|████████████████████████████████████████▌  | 211/224 [02:10<00:09,  1.41it/s]
Epoch 11 Iter 212: loss 0.16470. :  94%|████████████████████████████████████████▌  | 211/224 [02:11<00:09,  1.41it/s]
Epoch 11 Iter 212: loss 0.16470. :  95%|████████████████████████████████████████▋  | 212/224 [02:11<00:07,  1.51it/s]
Epoch 11 Iter 213: loss 0.18197. :  95%|████████████████████████████████████████▋  | 212/224 [02:11<00:07,  1.51it/s]
Epoch 11 Iter 213: loss 0.18197. :  95%|████████████████████████████████████████▉  | 213/224 [02:11<00:07,  1.47it/s]
Epoch 11 Iter 214: loss 0.20419. :  95%|████████████████████████████████████████▉  | 213/224 [02:12<00:07,  1.47it/s]
Epoch 11 Iter 214: loss 0.20419. :  96%|█████████████████████████████████████████  | 214/224 [02:12<00:06,  1.50it/s]
Epoch 11 Iter 215: loss 0.16591. :  96%|█████████████████████████████████████████  | 214/224 [02:13<00:06,  1.50it/s]
Epoch 11 Iter 215: loss 0.16591. :  96%|█████████████████████████████████████████▎ | 215/224 [02:13<00:05,  1.52it/s]
Epoch 11 Iter 216: loss 0.16150. :  96%|█████████████████████████████████████████▎ | 215/224 [02:13<00:05,  1.52it/s]
Epoch 11 Iter 216: loss 0.16150. :  96%|█████████████████████████████████████████▍ | 216/224 [02:13<00:05,  1.52it/s]
Epoch 11 Iter 217: loss 0.18524. :  96%|█████████████████████████████████████████▍ | 216/224 [02:14<00:05,  1.52it/s]
Epoch 11 Iter 217: loss 0.18524. :  97%|█████████████████████████████████████████▋ | 217/224 [02:14<00:04,  1.53it/s]
Epoch 11 Iter 218: loss 0.16991. :  97%|█████████████████████████████████████████▋ | 217/224 [02:14<00:04,  1.53it/s]
Epoch 11 Iter 218: loss 0.16991. :  97%|█████████████████████████████████████████▊ | 218/224 [02:14<00:03,  1.61it/s]
Epoch 11 Iter 219: loss 0.16466. :  97%|█████████████████████████████████████████▊ | 218/224 [02:15<00:03,  1.61it/s]
Epoch 11 Iter 219: loss 0.16466. :  98%|██████████████████████████████████████████ | 219/224 [02:15<00:02,  1.68it/s]
Epoch 11 Iter 220: loss 0.18837. :  98%|██████████████████████████████████████████ | 219/224 [02:16<00:02,  1.68it/s]
Epoch 11 Iter 220: loss 0.18837. :  98%|██████████████████████████████████████████▏| 220/224 [02:16<00:02,  1.74it/s]
Epoch 11 Iter 221: loss 0.18193. :  98%|██████████████████████████████████████████▏| 220/224 [02:16<00:02,  1.74it/s]
Epoch 11 Iter 221: loss 0.18193. :  99%|██████████████████████████████████████████▍| 221/224 [02:16<00:01,  1.74it/s]
Epoch 11 Iter 222: loss 0.16629. :  99%|██████████████████████████████████████████▍| 221/224 [02:17<00:01,  1.74it/s]
Epoch 11 Iter 222: loss 0.16629. :  99%|██████████████████████████████████████████▌| 222/224 [02:17<00:01,  1.56it/s]
Epoch 11 Iter 223: loss 0.16203. :  99%|██████████████████████████████████████████▌| 222/224 [02:18<00:01,  1.56it/s]
Epoch 11 Iter 223: loss 0.16203. : 100%|██████████████████████████████████████████▊| 223/224 [02:18<00:00,  1.55it/s]
Epoch 11 Iter 224: loss 0.17851. : 100%|██████████████████████████████████████████▊| 223/224 [02:18<00:00,  1.55it/s]
Epoch 11 Iter 224: loss 0.17851. : 100%|███████████████████████████████████████████| 224/224 [02:18<00:00,  1.49it/s]
Epoch 11 Iter 224: loss 0.17851. : 100%|███████████████████████████████████████████| 224/224 [02:18<00:00,  1.61it/s]

    Train loss: 0.17905
    Valid loss: 0.18246
       Valid loss recons: 0.17598
       Valid loss KL-D:   64.86799
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.16215. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 12 Iter 1: loss 0.16215. :   0%|▏                                              | 1/224 [00:00<02:01,  1.84it/s]
Epoch 12 Iter 2: loss 0.16842. :   0%|▏                                              | 1/224 [00:01<02:01,  1.84it/s]
Epoch 12 Iter 2: loss 0.16842. :   1%|▍                                              | 2/224 [00:01<01:59,  1.86it/s]
Epoch 12 Iter 3: loss 0.18746. :   1%|▍                                              | 2/224 [00:01<01:59,  1.86it/s]
Epoch 12 Iter 3: loss 0.18746. :   1%|▋                                              | 3/224 [00:01<02:22,  1.55it/s]
Epoch 12 Iter 4: loss 0.19337. :   1%|▋                                              | 3/224 [00:02<02:22,  1.55it/s]
Epoch 12 Iter 4: loss 0.19337. :   2%|▊                                              | 4/224 [00:02<02:17,  1.60it/s]
Epoch 12 Iter 5: loss 0.17128. :   2%|▊                                              | 4/224 [00:02<02:17,  1.60it/s]
Epoch 12 Iter 5: loss 0.17128. :   2%|█                                              | 5/224 [00:02<02:09,  1.69it/s]
Epoch 12 Iter 6: loss 0.16947. :   2%|█                                              | 5/224 [00:03<02:09,  1.69it/s]
Epoch 12 Iter 6: loss 0.16947. :   3%|█▎                                             | 6/224 [00:03<02:05,  1.73it/s]
Epoch 12 Iter 7: loss 0.15374. :   3%|█▎                                             | 6/224 [00:04<02:05,  1.73it/s]
Epoch 12 Iter 7: loss 0.15374. :   3%|█▍                                             | 7/224 [00:04<02:10,  1.66it/s]
Epoch 12 Iter 8: loss 0.17613. :   3%|█▍                                             | 7/224 [00:04<02:10,  1.66it/s]
Epoch 12 Iter 8: loss 0.17613. :   4%|█▋                                             | 8/224 [00:04<02:16,  1.58it/s]
Epoch 12 Iter 9: loss 0.17663. :   4%|█▋                                             | 8/224 [00:05<02:16,  1.58it/s]
Epoch 12 Iter 9: loss 0.17663. :   4%|█▉                                             | 9/224 [00:05<02:22,  1.51it/s]
Epoch 12 Iter 10: loss 0.19465. :   4%|█▊                                            | 9/224 [00:06<02:22,  1.51it/s]
Epoch 12 Iter 10: loss 0.19465. :   4%|██                                           | 10/224 [00:06<02:27,  1.45it/s]
Epoch 12 Iter 11: loss 0.16422. :   4%|██                                           | 10/224 [00:06<02:27,  1.45it/s]
Epoch 12 Iter 11: loss 0.16422. :   5%|██▏                                          | 11/224 [00:06<02:20,  1.51it/s]
Epoch 12 Iter 12: loss 0.19783. :   5%|██▏                                          | 11/224 [00:07<02:20,  1.51it/s]
Epoch 12 Iter 12: loss 0.19783. :   5%|██▍                                          | 12/224 [00:07<02:18,  1.53it/s]
Epoch 12 Iter 13: loss 0.18933. :   5%|██▍                                          | 12/224 [00:08<02:18,  1.53it/s]
Epoch 12 Iter 13: loss 0.18933. :   6%|██▌                                          | 13/224 [00:08<02:26,  1.44it/s]
Epoch 12 Iter 14: loss 0.18661. :   6%|██▌                                          | 13/224 [00:09<02:26,  1.44it/s]
Epoch 12 Iter 14: loss 0.18661. :   6%|██▊                                          | 14/224 [00:09<02:31,  1.39it/s]
Epoch 12 Iter 15: loss 0.18568. :   6%|██▊                                          | 14/224 [00:09<02:31,  1.39it/s]
Epoch 12 Iter 15: loss 0.18568. :   7%|███                                          | 15/224 [00:09<02:35,  1.35it/s]
Epoch 12 Iter 16: loss 0.16379. :   7%|███                                          | 15/224 [00:10<02:35,  1.35it/s]
Epoch 12 Iter 16: loss 0.16379. :   7%|███▏                                         | 16/224 [00:10<02:25,  1.43it/s]
Epoch 12 Iter 17: loss 0.18818. :   7%|███▏                                         | 16/224 [00:11<02:25,  1.43it/s]
Epoch 12 Iter 17: loss 0.18818. :   8%|███▍                                         | 17/224 [00:11<02:17,  1.51it/s]
Epoch 12 Iter 18: loss 0.18050. :   8%|███▍                                         | 17/224 [00:11<02:17,  1.51it/s]
Epoch 12 Iter 18: loss 0.18050. :   8%|███▌                                         | 18/224 [00:11<02:09,  1.60it/s]
Epoch 12 Iter 19: loss 0.20847. :   8%|███▌                                         | 18/224 [00:12<02:09,  1.60it/s]
Epoch 12 Iter 19: loss 0.20847. :   8%|███▊                                         | 19/224 [00:12<02:04,  1.64it/s]
Epoch 12 Iter 20: loss 0.16841. :   8%|███▊                                         | 19/224 [00:12<02:04,  1.64it/s]
Epoch 12 Iter 20: loss 0.16841. :   9%|████                                         | 20/224 [00:12<02:00,  1.70it/s]
Epoch 12 Iter 21: loss 0.18376. :   9%|████                                         | 20/224 [00:13<02:00,  1.70it/s]
Epoch 12 Iter 21: loss 0.18376. :   9%|████▏                                        | 21/224 [00:13<02:08,  1.59it/s]
Epoch 12 Iter 22: loss 0.19462. :   9%|████▏                                        | 21/224 [00:14<02:08,  1.59it/s]
Epoch 12 Iter 22: loss 0.19462. :  10%|████▍                                        | 22/224 [00:14<02:13,  1.52it/s]
Epoch 12 Iter 23: loss 0.17185. :  10%|████▍                                        | 22/224 [00:14<02:13,  1.52it/s]
Epoch 12 Iter 23: loss 0.17185. :  10%|████▌                                        | 23/224 [00:14<02:04,  1.61it/s]
Epoch 12 Iter 24: loss 0.17134. :  10%|████▌                                        | 23/224 [00:15<02:04,  1.61it/s]
Epoch 12 Iter 24: loss 0.17134. :  11%|████▊                                        | 24/224 [00:15<02:13,  1.49it/s]
Epoch 12 Iter 25: loss 0.16687. :  11%|████▊                                        | 24/224 [00:16<02:13,  1.49it/s]
Epoch 12 Iter 25: loss 0.16687. :  11%|█████                                        | 25/224 [00:16<02:20,  1.42it/s]
Epoch 12 Iter 26: loss 0.17745. :  11%|█████                                        | 25/224 [00:16<02:20,  1.42it/s]
Epoch 12 Iter 26: loss 0.17745. :  12%|█████▏                                       | 26/224 [00:16<02:12,  1.50it/s]
Epoch 12 Iter 27: loss 0.17176. :  12%|█████▏                                       | 26/224 [00:17<02:12,  1.50it/s]
Epoch 12 Iter 27: loss 0.17176. :  12%|█████▍                                       | 27/224 [00:17<02:05,  1.57it/s]
Epoch 12 Iter 28: loss 0.15910. :  12%|█████▍                                       | 27/224 [00:18<02:05,  1.57it/s]
Epoch 12 Iter 28: loss 0.15910. :  12%|█████▋                                       | 28/224 [00:18<02:01,  1.62it/s]
Epoch 12 Iter 29: loss 0.16467. :  12%|█████▋                                       | 28/224 [00:18<02:01,  1.62it/s]
Epoch 12 Iter 29: loss 0.16467. :  13%|█████▊                                       | 29/224 [00:18<01:58,  1.64it/s]
Epoch 12 Iter 30: loss 0.17754. :  13%|█████▊                                       | 29/224 [00:19<01:58,  1.64it/s]
Epoch 12 Iter 30: loss 0.17754. :  13%|██████                                       | 30/224 [00:19<02:02,  1.59it/s]
Epoch 12 Iter 31: loss 0.18210. :  13%|██████                                       | 30/224 [00:19<02:02,  1.59it/s]
Epoch 12 Iter 31: loss 0.18210. :  14%|██████▏                                      | 31/224 [00:19<01:58,  1.62it/s]
Epoch 12 Iter 32: loss 0.18498. :  14%|██████▏                                      | 31/224 [00:20<01:58,  1.62it/s]
Epoch 12 Iter 32: loss 0.18498. :  14%|██████▍                                      | 32/224 [00:20<02:07,  1.51it/s]
Epoch 12 Iter 33: loss 0.16202. :  14%|██████▍                                      | 32/224 [00:21<02:07,  1.51it/s]
Epoch 12 Iter 33: loss 0.16202. :  15%|██████▋                                      | 33/224 [00:21<02:13,  1.43it/s]
Epoch 12 Iter 34: loss 0.19584. :  15%|██████▋                                      | 33/224 [00:22<02:13,  1.43it/s]
Epoch 12 Iter 34: loss 0.19584. :  15%|██████▊                                      | 34/224 [00:22<02:17,  1.38it/s]
Epoch 12 Iter 35: loss 0.20084. :  15%|██████▊                                      | 34/224 [00:22<02:17,  1.38it/s]
Epoch 12 Iter 35: loss 0.20084. :  16%|███████                                      | 35/224 [00:22<02:17,  1.37it/s]
Epoch 12 Iter 36: loss 0.20617. :  16%|███████                                      | 35/224 [00:23<02:17,  1.37it/s]
Epoch 12 Iter 36: loss 0.20617. :  16%|███████▏                                     | 36/224 [00:23<02:06,  1.48it/s]
Epoch 12 Iter 37: loss 0.17445. :  16%|███████▏                                     | 36/224 [00:24<02:06,  1.48it/s]
Epoch 12 Iter 37: loss 0.17445. :  17%|███████▍                                     | 37/224 [00:24<02:10,  1.43it/s]
Epoch 12 Iter 38: loss 0.17969. :  17%|███████▍                                     | 37/224 [00:25<02:10,  1.43it/s]
Epoch 12 Iter 38: loss 0.17969. :  17%|███████▋                                     | 38/224 [00:25<02:14,  1.39it/s]
Epoch 12 Iter 39: loss 0.17003. :  17%|███████▋                                     | 38/224 [00:25<02:14,  1.39it/s]
Epoch 12 Iter 39: loss 0.17003. :  17%|███████▊                                     | 39/224 [00:25<02:16,  1.36it/s]
Epoch 12 Iter 40: loss 0.19590. :  17%|███████▊                                     | 39/224 [00:26<02:16,  1.36it/s]
Epoch 12 Iter 40: loss 0.19590. :  18%|████████                                     | 40/224 [00:26<02:13,  1.38it/s]
Epoch 12 Iter 41: loss 0.20967. :  18%|████████                                     | 40/224 [00:27<02:13,  1.38it/s]
Epoch 12 Iter 41: loss 0.20967. :  18%|████████▏                                    | 41/224 [00:27<02:10,  1.40it/s]
Epoch 12 Iter 42: loss 0.17174. :  18%|████████▏                                    | 41/224 [00:27<02:10,  1.40it/s]
Epoch 12 Iter 42: loss 0.17174. :  19%|████████▍                                    | 42/224 [00:27<02:00,  1.52it/s]
Epoch 12 Iter 43: loss 0.18399. :  19%|████████▍                                    | 42/224 [00:28<02:00,  1.52it/s]
Epoch 12 Iter 43: loss 0.18399. :  19%|████████▋                                    | 43/224 [00:28<01:54,  1.59it/s]
Epoch 12 Iter 44: loss 0.18074. :  19%|████████▋                                    | 43/224 [00:28<01:54,  1.59it/s]
Epoch 12 Iter 44: loss 0.18074. :  20%|████████▊                                    | 44/224 [00:28<01:48,  1.65it/s]
Epoch 12 Iter 45: loss 0.16990. :  20%|████████▊                                    | 44/224 [00:29<01:48,  1.65it/s]
Epoch 12 Iter 45: loss 0.16990. :  20%|█████████                                    | 45/224 [00:29<01:45,  1.69it/s]
Epoch 12 Iter 46: loss 0.17719. :  20%|█████████                                    | 45/224 [00:30<01:45,  1.69it/s]
Epoch 12 Iter 46: loss 0.17719. :  21%|█████████▏                                   | 46/224 [00:30<01:48,  1.64it/s]
Epoch 12 Iter 47: loss 0.18844. :  21%|█████████▏                                   | 46/224 [00:30<01:48,  1.64it/s]
Epoch 12 Iter 47: loss 0.18844. :  21%|█████████▍                                   | 47/224 [00:30<01:46,  1.66it/s]
Epoch 12 Iter 48: loss 0.18656. :  21%|█████████▍                                   | 47/224 [00:31<01:46,  1.66it/s]
Epoch 12 Iter 48: loss 0.18656. :  21%|█████████▋                                   | 48/224 [00:31<01:42,  1.72it/s]
Epoch 12 Iter 49: loss 0.19097. :  21%|█████████▋                                   | 48/224 [00:31<01:42,  1.72it/s]
Epoch 12 Iter 49: loss 0.19097. :  22%|█████████▊                                   | 49/224 [00:31<01:39,  1.75it/s]
Epoch 12 Iter 50: loss 0.15852. :  22%|█████████▊                                   | 49/224 [00:32<01:39,  1.75it/s]
Epoch 12 Iter 50: loss 0.15852. :  22%|██████████                                   | 50/224 [00:32<01:42,  1.70it/s]
Epoch 12 Iter 51: loss 0.16896. :  22%|██████████                                   | 50/224 [00:32<01:42,  1.70it/s]
Epoch 12 Iter 51: loss 0.16896. :  23%|██████████▏                                  | 51/224 [00:32<01:39,  1.74it/s]
Epoch 12 Iter 52: loss 0.19080. :  23%|██████████▏                                  | 51/224 [00:33<01:39,  1.74it/s]
Epoch 12 Iter 52: loss 0.19080. :  23%|██████████▍                                  | 52/224 [00:33<01:38,  1.75it/s]
Epoch 12 Iter 53: loss 0.16649. :  23%|██████████▍                                  | 52/224 [00:34<01:38,  1.75it/s]
Epoch 12 Iter 53: loss 0.16649. :  24%|██████████▋                                  | 53/224 [00:34<01:47,  1.59it/s]
Epoch 12 Iter 54: loss 0.18308. :  24%|██████████▋                                  | 53/224 [00:34<01:47,  1.59it/s]
Epoch 12 Iter 54: loss 0.18308. :  24%|██████████▊                                  | 54/224 [00:35<01:54,  1.49it/s]
Epoch 12 Iter 55: loss 0.18340. :  24%|██████████▊                                  | 54/224 [00:35<01:54,  1.49it/s]
Epoch 12 Iter 55: loss 0.18340. :  25%|███████████                                  | 55/224 [00:35<01:57,  1.43it/s]
Epoch 12 Iter 56: loss 0.16900. :  25%|███████████                                  | 55/224 [00:36<01:57,  1.43it/s]
Epoch 12 Iter 56: loss 0.16900. :  25%|███████████▎                                 | 56/224 [00:36<02:00,  1.40it/s]
Epoch 12 Iter 57: loss 0.17201. :  25%|███████████▎                                 | 56/224 [00:37<02:00,  1.40it/s]
Epoch 12 Iter 57: loss 0.17201. :  25%|███████████▍                                 | 57/224 [00:37<02:02,  1.36it/s]
Epoch 12 Iter 58: loss 0.16933. :  25%|███████████▍                                 | 57/224 [00:38<02:02,  1.36it/s]
Epoch 12 Iter 58: loss 0.16933. :  26%|███████████▋                                 | 58/224 [00:38<02:04,  1.33it/s]
Epoch 12 Iter 59: loss 0.18934. :  26%|███████████▋                                 | 58/224 [00:38<02:04,  1.33it/s]
Epoch 12 Iter 59: loss 0.18934. :  26%|███████████▊                                 | 59/224 [00:38<02:01,  1.36it/s]
Epoch 12 Iter 60: loss 0.18204. :  26%|███████████▊                                 | 59/224 [00:39<02:01,  1.36it/s]
Epoch 12 Iter 60: loss 0.18204. :  27%|████████████                                 | 60/224 [00:39<01:52,  1.46it/s]
Epoch 12 Iter 61: loss 0.17956. :  27%|████████████                                 | 60/224 [00:40<01:52,  1.46it/s]
Epoch 12 Iter 61: loss 0.17956. :  27%|████████████▎                                | 61/224 [00:40<01:54,  1.43it/s]
Epoch 12 Iter 62: loss 0.18007. :  27%|████████████▎                                | 61/224 [00:40<01:54,  1.43it/s]
Epoch 12 Iter 62: loss 0.18007. :  28%|████████████▍                                | 62/224 [00:40<01:55,  1.41it/s]
Epoch 12 Iter 63: loss 0.16115. :  28%|████████████▍                                | 62/224 [00:41<01:55,  1.41it/s]
Epoch 12 Iter 63: loss 0.16115. :  28%|████████████▋                                | 63/224 [00:41<01:57,  1.38it/s]
Epoch 12 Iter 64: loss 0.17595. :  28%|████████████▋                                | 63/224 [00:42<01:57,  1.38it/s]
Epoch 12 Iter 64: loss 0.17595. :  29%|████████████▊                                | 64/224 [00:42<01:57,  1.36it/s]
Epoch 12 Iter 65: loss 0.18134. :  29%|████████████▊                                | 64/224 [00:43<01:57,  1.36it/s]
Epoch 12 Iter 65: loss 0.18134. :  29%|█████████████                                | 65/224 [00:43<01:56,  1.37it/s]
Epoch 12 Iter 66: loss 0.17179. :  29%|█████████████                                | 65/224 [00:43<01:56,  1.37it/s]
Epoch 12 Iter 66: loss 0.17179. :  29%|█████████████▎                               | 66/224 [00:43<01:56,  1.35it/s]
Epoch 12 Iter 67: loss 0.17648. :  29%|█████████████▎                               | 66/224 [00:44<01:56,  1.35it/s]
Epoch 12 Iter 67: loss 0.17648. :  30%|█████████████▍                               | 67/224 [00:44<01:48,  1.45it/s]
Epoch 12 Iter 68: loss 0.18634. :  30%|█████████████▍                               | 67/224 [00:45<01:48,  1.45it/s]
Epoch 12 Iter 68: loss 0.18634. :  30%|█████████████▋                               | 68/224 [00:45<01:53,  1.37it/s]
Epoch 12 Iter 69: loss 0.17604. :  30%|█████████████▋                               | 68/224 [00:45<01:53,  1.37it/s]
Epoch 12 Iter 69: loss 0.17604. :  31%|█████████████▊                               | 69/224 [00:45<01:47,  1.44it/s]
Epoch 12 Iter 70: loss 0.17243. :  31%|█████████████▊                               | 69/224 [00:46<01:47,  1.44it/s]
Epoch 12 Iter 70: loss 0.17243. :  31%|██████████████                               | 70/224 [00:46<01:39,  1.55it/s]
Epoch 12 Iter 71: loss 0.19904. :  31%|██████████████                               | 70/224 [00:46<01:39,  1.55it/s]
Epoch 12 Iter 71: loss 0.19904. :  32%|██████████████▎                              | 71/224 [00:46<01:34,  1.62it/s]
Epoch 12 Iter 72: loss 0.17580. :  32%|██████████████▎                              | 71/224 [00:47<01:34,  1.62it/s]
Epoch 12 Iter 72: loss 0.17580. :  32%|██████████████▍                              | 72/224 [00:47<01:30,  1.68it/s]
Epoch 12 Iter 73: loss 0.18029. :  32%|██████████████▍                              | 72/224 [00:48<01:30,  1.68it/s]
Epoch 12 Iter 73: loss 0.18029. :  33%|██████████████▋                              | 73/224 [00:48<01:37,  1.54it/s]
Epoch 12 Iter 74: loss 0.18574. :  33%|██████████████▋                              | 73/224 [00:48<01:37,  1.54it/s]
Epoch 12 Iter 74: loss 0.18574. :  33%|██████████████▊                              | 74/224 [00:48<01:40,  1.50it/s]
Epoch 12 Iter 75: loss 0.17815. :  33%|██████████████▊                              | 74/224 [00:49<01:40,  1.50it/s]
Epoch 12 Iter 75: loss 0.17815. :  33%|███████████████                              | 75/224 [00:49<01:38,  1.52it/s]
Epoch 12 Iter 76: loss 0.16894. :  33%|███████████████                              | 75/224 [00:50<01:38,  1.52it/s]
Epoch 12 Iter 76: loss 0.16894. :  34%|███████████████▎                             | 76/224 [00:50<01:32,  1.61it/s]
Epoch 12 Iter 77: loss 0.18702. :  34%|███████████████▎                             | 76/224 [00:50<01:32,  1.61it/s]
Epoch 12 Iter 77: loss 0.18702. :  34%|███████████████▍                             | 77/224 [00:50<01:32,  1.58it/s]
Epoch 12 Iter 78: loss 0.19411. :  34%|███████████████▍                             | 77/224 [00:51<01:32,  1.58it/s]
Epoch 12 Iter 78: loss 0.19411. :  35%|███████████████▋                             | 78/224 [00:51<01:29,  1.63it/s]
Epoch 12 Iter 79: loss 0.19106. :  35%|███████████████▋                             | 78/224 [00:51<01:29,  1.63it/s]
Epoch 12 Iter 79: loss 0.19106. :  35%|███████████████▊                             | 79/224 [00:51<01:25,  1.70it/s]
Epoch 12 Iter 80: loss 0.17548. :  35%|███████████████▊                             | 79/224 [00:52<01:25,  1.70it/s]
Epoch 12 Iter 80: loss 0.17548. :  36%|████████████████                             | 80/224 [00:52<01:25,  1.68it/s]
Epoch 12 Iter 81: loss 0.17180. :  36%|████████████████                             | 80/224 [00:53<01:25,  1.68it/s]
Epoch 12 Iter 81: loss 0.17180. :  36%|████████████████▎                            | 81/224 [00:53<01:23,  1.71it/s]
Epoch 12 Iter 82: loss 0.17759. :  36%|████████████████▎                            | 81/224 [00:53<01:23,  1.71it/s]
Epoch 12 Iter 82: loss 0.17759. :  37%|████████████████▍                            | 82/224 [00:53<01:21,  1.74it/s]
Epoch 12 Iter 83: loss 0.17608. :  37%|████████████████▍                            | 82/224 [00:54<01:21,  1.74it/s]
Epoch 12 Iter 83: loss 0.17608. :  37%|████████████████▋                            | 83/224 [00:54<01:22,  1.70it/s]
Epoch 12 Iter 84: loss 0.17817. :  37%|████████████████▋                            | 83/224 [00:54<01:22,  1.70it/s]
Epoch 12 Iter 84: loss 0.17817. :  38%|████████████████▉                            | 84/224 [00:54<01:30,  1.55it/s]
Epoch 12 Iter 85: loss 0.16771. :  38%|████████████████▉                            | 84/224 [00:55<01:30,  1.55it/s]
Epoch 12 Iter 85: loss 0.16771. :  38%|█████████████████                            | 85/224 [00:55<01:35,  1.46it/s]
Epoch 12 Iter 86: loss 0.17302. :  38%|█████████████████                            | 85/224 [00:56<01:35,  1.46it/s]
Epoch 12 Iter 86: loss 0.17302. :  38%|█████████████████▎                           | 86/224 [00:56<01:37,  1.42it/s]
Epoch 12 Iter 87: loss 0.16436. :  38%|█████████████████▎                           | 86/224 [00:57<01:37,  1.42it/s]
Epoch 12 Iter 87: loss 0.16436. :  39%|█████████████████▍                           | 87/224 [00:57<01:32,  1.49it/s]
Epoch 12 Iter 88: loss 0.19792. :  39%|█████████████████▍                           | 87/224 [00:57<01:32,  1.49it/s]
Epoch 12 Iter 88: loss 0.19792. :  39%|█████████████████▋                           | 88/224 [00:57<01:35,  1.42it/s]
Epoch 12 Iter 89: loss 0.16436. :  39%|█████████████████▋                           | 88/224 [00:58<01:35,  1.42it/s]
Epoch 12 Iter 89: loss 0.16436. :  40%|█████████████████▉                           | 89/224 [00:58<01:29,  1.51it/s]
Epoch 12 Iter 90: loss 0.18532. :  40%|█████████████████▉                           | 89/224 [00:59<01:29,  1.51it/s]
Epoch 12 Iter 90: loss 0.18532. :  40%|██████████████████                           | 90/224 [00:59<01:31,  1.47it/s]
Epoch 12 Iter 91: loss 0.19694. :  40%|██████████████████                           | 90/224 [00:59<01:31,  1.47it/s]
Epoch 12 Iter 91: loss 0.19694. :  41%|██████████████████▎                          | 91/224 [00:59<01:31,  1.45it/s]
Epoch 12 Iter 92: loss 0.18963. :  41%|██████████████████▎                          | 91/224 [01:00<01:31,  1.45it/s]
Epoch 12 Iter 92: loss 0.18963. :  41%|██████████████████▍                          | 92/224 [01:00<01:31,  1.44it/s]
Epoch 12 Iter 93: loss 0.16774. :  41%|██████████████████▍                          | 92/224 [01:01<01:31,  1.44it/s]
Epoch 12 Iter 93: loss 0.16774. :  42%|██████████████████▋                          | 93/224 [01:01<01:33,  1.39it/s]
Epoch 12 Iter 94: loss 0.20972. :  42%|██████████████████▋                          | 93/224 [01:02<01:33,  1.39it/s]
Epoch 12 Iter 94: loss 0.20972. :  42%|██████████████████▉                          | 94/224 [01:02<01:34,  1.37it/s]
Epoch 12 Iter 95: loss 0.19625. :  42%|██████████████████▉                          | 94/224 [01:02<01:34,  1.37it/s]
Epoch 12 Iter 95: loss 0.19625. :  42%|███████████████████                          | 95/224 [01:02<01:35,  1.35it/s]
Epoch 12 Iter 96: loss 0.18089. :  42%|███████████████████                          | 95/224 [01:03<01:35,  1.35it/s]
Epoch 12 Iter 96: loss 0.18089. :  43%|███████████████████▎                         | 96/224 [01:03<01:35,  1.33it/s]
Epoch 12 Iter 97: loss 0.16849. :  43%|███████████████████▎                         | 96/224 [01:04<01:35,  1.33it/s]
Epoch 12 Iter 97: loss 0.16849. :  43%|███████████████████▍                         | 97/224 [01:04<01:32,  1.37it/s]
Epoch 12 Iter 98: loss 0.17108. :  43%|███████████████████▍                         | 97/224 [01:04<01:32,  1.37it/s]
Epoch 12 Iter 98: loss 0.17108. :  44%|███████████████████▋                         | 98/224 [01:04<01:28,  1.42it/s]
Epoch 12 Iter 99: loss 0.18646. :  44%|███████████████████▋                         | 98/224 [01:05<01:28,  1.42it/s]
Epoch 12 Iter 99: loss 0.18646. :  44%|███████████████████▉                         | 99/224 [01:05<01:30,  1.38it/s]
Epoch 12 Iter 100: loss 0.18010. :  44%|███████████████████▍                        | 99/224 [01:06<01:30,  1.38it/s]
Epoch 12 Iter 100: loss 0.18010. :  45%|███████████████████▏                       | 100/224 [01:06<01:27,  1.42it/s]
Epoch 12 Iter 101: loss 0.17399. :  45%|███████████████████▏                       | 100/224 [01:06<01:27,  1.42it/s]
Epoch 12 Iter 101: loss 0.17399. :  45%|███████████████████▍                       | 101/224 [01:06<01:20,  1.53it/s]
Epoch 12 Iter 102: loss 0.17659. :  45%|███████████████████▍                       | 101/224 [01:07<01:20,  1.53it/s]
Epoch 12 Iter 102: loss 0.17659. :  46%|███████████████████▌                       | 102/224 [01:07<01:21,  1.49it/s]
Epoch 12 Iter 103: loss 0.17254. :  46%|███████████████████▌                       | 102/224 [01:08<01:21,  1.49it/s]
Epoch 12 Iter 103: loss 0.17254. :  46%|███████████████████▊                       | 103/224 [01:08<01:16,  1.57it/s]
Epoch 12 Iter 104: loss 0.17420. :  46%|███████████████████▊                       | 103/224 [01:08<01:16,  1.57it/s]
Epoch 12 Iter 104: loss 0.17420. :  46%|███████████████████▉                       | 104/224 [01:08<01:13,  1.64it/s]
Epoch 12 Iter 105: loss 0.16614. :  46%|███████████████████▉                       | 104/224 [01:09<01:13,  1.64it/s]
Epoch 12 Iter 105: loss 0.16614. :  47%|████████████████████▏                      | 105/224 [01:09<01:14,  1.60it/s]
Epoch 12 Iter 106: loss 0.15872. :  47%|████████████████████▏                      | 105/224 [01:09<01:14,  1.60it/s]
Epoch 12 Iter 106: loss 0.15872. :  47%|████████████████████▎                      | 106/224 [01:09<01:11,  1.66it/s]
Epoch 12 Iter 107: loss 0.17483. :  47%|████████████████████▎                      | 106/224 [01:10<01:11,  1.66it/s]
Epoch 12 Iter 107: loss 0.17483. :  48%|████████████████████▌                      | 107/224 [01:10<01:14,  1.57it/s]
Epoch 12 Iter 108: loss 0.18211. :  48%|████████████████████▌                      | 107/224 [01:11<01:14,  1.57it/s]
Epoch 12 Iter 108: loss 0.18211. :  48%|████████████████████▋                      | 108/224 [01:11<01:12,  1.61it/s]
Epoch 12 Iter 109: loss 0.15903. :  48%|████████████████████▋                      | 108/224 [01:11<01:12,  1.61it/s]
Epoch 12 Iter 109: loss 0.15903. :  49%|████████████████████▉                      | 109/224 [01:11<01:09,  1.65it/s]
Epoch 12 Iter 110: loss 0.18046. :  49%|████████████████████▉                      | 109/224 [01:12<01:09,  1.65it/s]
Epoch 12 Iter 110: loss 0.18046. :  49%|█████████████████████                      | 110/224 [01:12<01:14,  1.53it/s]
Epoch 12 Iter 111: loss 0.20102. :  49%|█████████████████████                      | 110/224 [01:13<01:14,  1.53it/s]
Epoch 12 Iter 111: loss 0.20102. :  50%|█████████████████████▎                     | 111/224 [01:13<01:15,  1.50it/s]
Epoch 12 Iter 112: loss 0.16487. :  50%|█████████████████████▎                     | 111/224 [01:13<01:15,  1.50it/s]
Epoch 12 Iter 112: loss 0.16487. :  50%|█████████████████████▌                     | 112/224 [01:13<01:10,  1.60it/s]
Epoch 12 Iter 113: loss 0.17595. :  50%|█████████████████████▌                     | 112/224 [01:14<01:10,  1.60it/s]
Epoch 12 Iter 113: loss 0.17595. :  50%|█████████████████████▋                     | 113/224 [01:14<01:07,  1.66it/s]
Epoch 12 Iter 114: loss 0.17052. :  50%|█████████████████████▋                     | 113/224 [01:15<01:07,  1.66it/s]
Epoch 12 Iter 114: loss 0.17052. :  51%|█████████████████████▉                     | 114/224 [01:15<01:09,  1.58it/s]
Epoch 12 Iter 115: loss 0.19011. :  51%|█████████████████████▉                     | 114/224 [01:15<01:09,  1.58it/s]
Epoch 12 Iter 115: loss 0.19011. :  51%|██████████████████████                     | 115/224 [01:15<01:12,  1.51it/s]
Epoch 12 Iter 116: loss 0.17133. :  51%|██████████████████████                     | 115/224 [01:16<01:12,  1.51it/s]
Epoch 12 Iter 116: loss 0.17133. :  52%|██████████████████████▎                    | 116/224 [01:16<01:08,  1.57it/s]
Epoch 12 Iter 117: loss 0.17032. :  52%|██████████████████████▎                    | 116/224 [01:17<01:08,  1.57it/s]
Epoch 12 Iter 117: loss 0.17032. :  52%|██████████████████████▍                    | 117/224 [01:17<01:12,  1.48it/s]
Epoch 12 Iter 118: loss 0.16739. :  52%|██████████████████████▍                    | 117/224 [01:17<01:12,  1.48it/s]
Epoch 12 Iter 118: loss 0.16739. :  53%|██████████████████████▋                    | 118/224 [01:17<01:14,  1.42it/s]
Epoch 12 Iter 119: loss 0.16735. :  53%|██████████████████████▋                    | 118/224 [01:18<01:14,  1.42it/s]
Epoch 12 Iter 119: loss 0.16735. :  53%|██████████████████████▊                    | 119/224 [01:18<01:16,  1.38it/s]
Epoch 12 Iter 120: loss 0.18454. :  53%|██████████████████████▊                    | 119/224 [01:19<01:16,  1.38it/s]
Epoch 12 Iter 120: loss 0.18454. :  54%|███████████████████████                    | 120/224 [01:19<01:16,  1.36it/s]
Epoch 12 Iter 121: loss 0.16988. :  54%|███████████████████████                    | 120/224 [01:20<01:16,  1.36it/s]
Epoch 12 Iter 121: loss 0.16988. :  54%|███████████████████████▏                   | 121/224 [01:20<01:16,  1.35it/s]
Epoch 12 Iter 122: loss 0.19869. :  54%|███████████████████████▏                   | 121/224 [01:20<01:16,  1.35it/s]
Epoch 12 Iter 122: loss 0.19869. :  54%|███████████████████████▍                   | 122/224 [01:20<01:10,  1.44it/s]
Epoch 12 Iter 123: loss 0.19414. :  54%|███████████████████████▍                   | 122/224 [01:21<01:10,  1.44it/s]
Epoch 12 Iter 123: loss 0.19414. :  55%|███████████████████████▌                   | 123/224 [01:21<01:05,  1.54it/s]
Epoch 12 Iter 124: loss 0.17430. :  55%|███████████████████████▌                   | 123/224 [01:21<01:05,  1.54it/s]
Epoch 12 Iter 124: loss 0.17430. :  55%|███████████████████████▊                   | 124/224 [01:21<01:01,  1.63it/s]
Epoch 12 Iter 125: loss 0.17948. :  55%|███████████████████████▊                   | 124/224 [01:22<01:01,  1.63it/s]
Epoch 12 Iter 125: loss 0.17948. :  56%|███████████████████████▉                   | 125/224 [01:22<00:58,  1.70it/s]
Epoch 12 Iter 126: loss 0.17287. :  56%|███████████████████████▉                   | 125/224 [01:22<00:58,  1.70it/s]
Epoch 12 Iter 126: loss 0.17287. :  56%|████████████████████████▏                  | 126/224 [01:22<00:56,  1.73it/s]
Epoch 12 Iter 127: loss 0.19590. :  56%|████████████████████████▏                  | 126/224 [01:23<00:56,  1.73it/s]
Epoch 12 Iter 127: loss 0.19590. :  57%|████████████████████████▍                  | 127/224 [01:23<00:58,  1.66it/s]
Epoch 12 Iter 128: loss 0.19369. :  57%|████████████████████████▍                  | 127/224 [01:24<00:58,  1.66it/s]
Epoch 12 Iter 128: loss 0.19369. :  57%|████████████████████████▌                  | 128/224 [01:24<00:54,  1.75it/s]
Epoch 12 Iter 129: loss 0.16998. :  57%|████████████████████████▌                  | 128/224 [01:24<00:54,  1.75it/s]
Epoch 12 Iter 129: loss 0.16998. :  58%|████████████████████████▊                  | 129/224 [01:24<00:52,  1.82it/s]
Epoch 12 Iter 130: loss 0.16232. :  58%|████████████████████████▊                  | 129/224 [01:25<00:52,  1.82it/s]
Epoch 12 Iter 130: loss 0.16232. :  58%|████████████████████████▉                  | 130/224 [01:25<00:50,  1.87it/s]
Epoch 12 Iter 131: loss 0.16266. :  58%|████████████████████████▉                  | 130/224 [01:25<00:50,  1.87it/s]
Epoch 12 Iter 131: loss 0.16266. :  58%|█████████████████████████▏                 | 131/224 [01:25<00:49,  1.90it/s]
Epoch 12 Iter 132: loss 0.16305. :  58%|█████████████████████████▏                 | 131/224 [01:26<00:49,  1.90it/s]
Epoch 12 Iter 132: loss 0.16305. :  59%|█████████████████████████▎                 | 132/224 [01:26<00:48,  1.91it/s]
Epoch 12 Iter 133: loss 0.22243. :  59%|█████████████████████████▎                 | 132/224 [01:26<00:48,  1.91it/s]
Epoch 12 Iter 133: loss 0.22243. :  59%|█████████████████████████▌                 | 133/224 [01:26<00:47,  1.92it/s]
Epoch 12 Iter 134: loss 0.20498. :  59%|█████████████████████████▌                 | 133/224 [01:27<00:47,  1.92it/s]
Epoch 12 Iter 134: loss 0.20498. :  60%|█████████████████████████▋                 | 134/224 [01:27<00:46,  1.95it/s]
Epoch 12 Iter 135: loss 0.19712. :  60%|█████████████████████████▋                 | 134/224 [01:27<00:46,  1.95it/s]
Epoch 12 Iter 135: loss 0.19712. :  60%|█████████████████████████▉                 | 135/224 [01:27<00:45,  1.97it/s]
Epoch 12 Iter 136: loss 0.17743. :  60%|█████████████████████████▉                 | 135/224 [01:28<00:45,  1.97it/s]
Epoch 12 Iter 136: loss 0.17743. :  61%|██████████████████████████                 | 136/224 [01:28<00:44,  1.98it/s]
Epoch 12 Iter 137: loss 0.18327. :  61%|██████████████████████████                 | 136/224 [01:28<00:44,  1.98it/s]
Epoch 12 Iter 137: loss 0.18327. :  61%|██████████████████████████▎                | 137/224 [01:28<00:43,  1.99it/s]
Epoch 12 Iter 138: loss 0.18852. :  61%|██████████████████████████▎                | 137/224 [01:29<00:43,  1.99it/s]
Epoch 12 Iter 138: loss 0.18852. :  62%|██████████████████████████▍                | 138/224 [01:29<00:43,  1.99it/s]
Epoch 12 Iter 139: loss 0.17607. :  62%|██████████████████████████▍                | 138/224 [01:29<00:43,  1.99it/s]
Epoch 12 Iter 139: loss 0.17607. :  62%|██████████████████████████▋                | 139/224 [01:29<00:42,  1.99it/s]
Epoch 12 Iter 140: loss 0.17308. :  62%|██████████████████████████▋                | 139/224 [01:30<00:42,  1.99it/s]
Epoch 12 Iter 140: loss 0.17308. :  62%|██████████████████████████▉                | 140/224 [01:30<00:42,  2.00it/s]
Epoch 12 Iter 141: loss 0.17606. :  62%|██████████████████████████▉                | 140/224 [01:30<00:42,  2.00it/s]
Epoch 12 Iter 141: loss 0.17606. :  63%|███████████████████████████                | 141/224 [01:30<00:41,  2.00it/s]
Epoch 12 Iter 142: loss 0.18549. :  63%|███████████████████████████                | 141/224 [01:31<00:41,  2.00it/s]
Epoch 12 Iter 142: loss 0.18549. :  63%|███████████████████████████▎               | 142/224 [01:31<00:41,  2.00it/s]
Epoch 12 Iter 143: loss 0.17221. :  63%|███████████████████████████▎               | 142/224 [01:31<00:41,  2.00it/s]
Epoch 12 Iter 143: loss 0.17221. :  64%|███████████████████████████▍               | 143/224 [01:31<00:41,  1.94it/s]
Epoch 12 Iter 144: loss 0.18093. :  64%|███████████████████████████▍               | 143/224 [01:32<00:41,  1.94it/s]
Epoch 12 Iter 144: loss 0.18093. :  64%|███████████████████████████▋               | 144/224 [01:32<00:41,  1.95it/s]
Epoch 12 Iter 145: loss 0.18870. :  64%|███████████████████████████▋               | 144/224 [01:32<00:41,  1.95it/s]
Epoch 12 Iter 145: loss 0.18870. :  65%|███████████████████████████▊               | 145/224 [01:32<00:40,  1.97it/s]
Epoch 12 Iter 146: loss 0.14898. :  65%|███████████████████████████▊               | 145/224 [01:33<00:40,  1.97it/s]
Epoch 12 Iter 146: loss 0.14898. :  65%|████████████████████████████               | 146/224 [01:33<00:41,  1.90it/s]
Epoch 12 Iter 147: loss 0.18055. :  65%|████████████████████████████               | 146/224 [01:33<00:41,  1.90it/s]
Epoch 12 Iter 147: loss 0.18055. :  66%|████████████████████████████▏              | 147/224 [01:33<00:40,  1.92it/s]
Epoch 12 Iter 148: loss 0.17951. :  66%|████████████████████████████▏              | 147/224 [01:34<00:40,  1.92it/s]
Epoch 12 Iter 148: loss 0.17951. :  66%|████████████████████████████▍              | 148/224 [01:34<00:39,  1.92it/s]
Epoch 12 Iter 149: loss 0.17729. :  66%|████████████████████████████▍              | 148/224 [01:34<00:39,  1.92it/s]
Epoch 12 Iter 149: loss 0.17729. :  67%|████████████████████████████▌              | 149/224 [01:34<00:38,  1.94it/s]
Epoch 12 Iter 150: loss 0.17148. :  67%|████████████████████████████▌              | 149/224 [01:35<00:38,  1.94it/s]
Epoch 12 Iter 150: loss 0.17148. :  67%|████████████████████████████▊              | 150/224 [01:35<00:38,  1.95it/s]
Epoch 12 Iter 151: loss 0.17316. :  67%|████████████████████████████▊              | 150/224 [01:35<00:38,  1.95it/s]
Epoch 12 Iter 151: loss 0.17316. :  67%|████████████████████████████▉              | 151/224 [01:35<00:37,  1.95it/s]
Epoch 12 Iter 152: loss 0.18539. :  67%|████████████████████████████▉              | 151/224 [01:36<00:37,  1.95it/s]
Epoch 12 Iter 152: loss 0.18539. :  68%|█████████████████████████████▏             | 152/224 [01:36<00:36,  1.96it/s]
Epoch 12 Iter 153: loss 0.17771. :  68%|█████████████████████████████▏             | 152/224 [01:36<00:36,  1.96it/s]
Epoch 12 Iter 153: loss 0.17771. :  68%|█████████████████████████████▎             | 153/224 [01:36<00:36,  1.96it/s]
Epoch 12 Iter 154: loss 0.18254. :  68%|█████████████████████████████▎             | 153/224 [01:37<00:36,  1.96it/s]
Epoch 12 Iter 154: loss 0.18254. :  69%|█████████████████████████████▌             | 154/224 [01:37<00:35,  1.96it/s]
Epoch 12 Iter 155: loss 0.18907. :  69%|█████████████████████████████▌             | 154/224 [01:37<00:35,  1.96it/s]
Epoch 12 Iter 155: loss 0.18907. :  69%|█████████████████████████████▊             | 155/224 [01:37<00:35,  1.96it/s]
Epoch 12 Iter 156: loss 0.18712. :  69%|█████████████████████████████▊             | 155/224 [01:38<00:35,  1.96it/s]
Epoch 12 Iter 156: loss 0.18712. :  70%|█████████████████████████████▉             | 156/224 [01:38<00:34,  1.96it/s]
Epoch 12 Iter 157: loss 0.18395. :  70%|█████████████████████████████▉             | 156/224 [01:38<00:34,  1.96it/s]
Epoch 12 Iter 157: loss 0.18395. :  70%|██████████████████████████████▏            | 157/224 [01:38<00:35,  1.88it/s]
Epoch 12 Iter 158: loss 0.17598. :  70%|██████████████████████████████▏            | 157/224 [01:39<00:35,  1.88it/s]
Epoch 12 Iter 158: loss 0.17598. :  71%|██████████████████████████████▎            | 158/224 [01:39<00:34,  1.91it/s]
Epoch 12 Iter 159: loss 0.16925. :  71%|██████████████████████████████▎            | 158/224 [01:39<00:34,  1.91it/s]
Epoch 12 Iter 159: loss 0.16925. :  71%|██████████████████████████████▌            | 159/224 [01:39<00:33,  1.94it/s]
Epoch 12 Iter 160: loss 0.18913. :  71%|██████████████████████████████▌            | 159/224 [01:40<00:33,  1.94it/s]
Epoch 12 Iter 160: loss 0.18913. :  71%|██████████████████████████████▋            | 160/224 [01:40<00:32,  1.94it/s]
Epoch 12 Iter 161: loss 0.17888. :  71%|██████████████████████████████▋            | 160/224 [01:40<00:32,  1.94it/s]
Epoch 12 Iter 161: loss 0.17888. :  72%|██████████████████████████████▉            | 161/224 [01:40<00:32,  1.95it/s]
Epoch 12 Iter 162: loss 0.18442. :  72%|██████████████████████████████▉            | 161/224 [01:41<00:32,  1.95it/s]
Epoch 12 Iter 162: loss 0.18442. :  72%|███████████████████████████████            | 162/224 [01:41<00:31,  1.96it/s]
Epoch 12 Iter 163: loss 0.19699. :  72%|███████████████████████████████            | 162/224 [01:41<00:31,  1.96it/s]
Epoch 12 Iter 163: loss 0.19699. :  73%|███████████████████████████████▎           | 163/224 [01:41<00:30,  1.98it/s]
Epoch 12 Iter 164: loss 0.18562. :  73%|███████████████████████████████▎           | 163/224 [01:42<00:30,  1.98it/s]
Epoch 12 Iter 164: loss 0.18562. :  73%|███████████████████████████████▍           | 164/224 [01:42<00:30,  1.99it/s]
Epoch 12 Iter 165: loss 0.19370. :  73%|███████████████████████████████▍           | 164/224 [01:42<00:30,  1.99it/s]
Epoch 12 Iter 165: loss 0.19370. :  74%|███████████████████████████████▋           | 165/224 [01:42<00:29,  1.98it/s]
Epoch 12 Iter 166: loss 0.18759. :  74%|███████████████████████████████▋           | 165/224 [01:43<00:29,  1.98it/s]
Epoch 12 Iter 166: loss 0.18759. :  74%|███████████████████████████████▊           | 166/224 [01:43<00:29,  1.99it/s]
Epoch 12 Iter 167: loss 0.17159. :  74%|███████████████████████████████▊           | 166/224 [01:43<00:29,  1.99it/s]
Epoch 12 Iter 167: loss 0.17159. :  75%|████████████████████████████████           | 167/224 [01:43<00:28,  2.00it/s]
Epoch 12 Iter 168: loss 0.16078. :  75%|████████████████████████████████           | 167/224 [01:44<00:28,  2.00it/s]
Epoch 12 Iter 168: loss 0.16078. :  75%|████████████████████████████████▎          | 168/224 [01:44<00:28,  2.00it/s]
Epoch 12 Iter 169: loss 0.16863. :  75%|████████████████████████████████▎          | 168/224 [01:44<00:28,  2.00it/s]
Epoch 12 Iter 169: loss 0.16863. :  75%|████████████████████████████████▍          | 169/224 [01:44<00:27,  1.99it/s]
Epoch 12 Iter 170: loss 0.16402. :  75%|████████████████████████████████▍          | 169/224 [01:45<00:27,  1.99it/s]
Epoch 12 Iter 170: loss 0.16402. :  76%|████████████████████████████████▋          | 170/224 [01:45<00:27,  1.99it/s]
Epoch 12 Iter 171: loss 0.16290. :  76%|████████████████████████████████▋          | 170/224 [01:45<00:27,  1.99it/s]
Epoch 12 Iter 171: loss 0.16290. :  76%|████████████████████████████████▊          | 171/224 [01:45<00:26,  1.99it/s]
Epoch 12 Iter 172: loss 0.15948. :  76%|████████████████████████████████▊          | 171/224 [01:46<00:26,  1.99it/s]
Epoch 12 Iter 172: loss 0.15948. :  77%|█████████████████████████████████          | 172/224 [01:46<00:26,  1.98it/s]
Epoch 12 Iter 173: loss 0.16991. :  77%|█████████████████████████████████          | 172/224 [01:46<00:26,  1.98it/s]
Epoch 12 Iter 173: loss 0.16991. :  77%|█████████████████████████████████▏         | 173/224 [01:46<00:25,  1.99it/s]
Epoch 12 Iter 174: loss 0.17447. :  77%|█████████████████████████████████▏         | 173/224 [01:47<00:25,  1.99it/s]
Epoch 12 Iter 174: loss 0.17447. :  78%|█████████████████████████████████▍         | 174/224 [01:47<00:25,  2.00it/s]
Epoch 12 Iter 175: loss 0.16394. :  78%|█████████████████████████████████▍         | 174/224 [01:48<00:25,  2.00it/s]
Epoch 12 Iter 175: loss 0.16394. :  78%|█████████████████████████████████▌         | 175/224 [01:48<00:24,  1.97it/s]
Epoch 12 Iter 176: loss 0.19366. :  78%|█████████████████████████████████▌         | 175/224 [01:48<00:24,  1.97it/s]
Epoch 12 Iter 176: loss 0.19366. :  79%|█████████████████████████████████▊         | 176/224 [01:48<00:24,  1.97it/s]
Epoch 12 Iter 177: loss 0.16402. :  79%|█████████████████████████████████▊         | 176/224 [01:49<00:24,  1.97it/s]
Epoch 12 Iter 177: loss 0.16402. :  79%|█████████████████████████████████▉         | 177/224 [01:49<00:23,  1.98it/s]
Epoch 12 Iter 178: loss 0.18407. :  79%|█████████████████████████████████▉         | 177/224 [01:49<00:23,  1.98it/s]
Epoch 12 Iter 178: loss 0.18407. :  79%|██████████████████████████████████▏        | 178/224 [01:49<00:23,  1.99it/s]
Epoch 12 Iter 179: loss 0.19706. :  79%|██████████████████████████████████▏        | 178/224 [01:50<00:23,  1.99it/s]
Epoch 12 Iter 179: loss 0.19706. :  80%|██████████████████████████████████▎        | 179/224 [01:50<00:22,  2.00it/s]
Epoch 12 Iter 180: loss 0.17520. :  80%|██████████████████████████████████▎        | 179/224 [01:50<00:22,  2.00it/s]
Epoch 12 Iter 180: loss 0.17520. :  80%|██████████████████████████████████▌        | 180/224 [01:50<00:21,  2.01it/s]
Epoch 12 Iter 181: loss 0.17676. :  80%|██████████████████████████████████▌        | 180/224 [01:50<00:21,  2.01it/s]
Epoch 12 Iter 181: loss 0.17676. :  81%|██████████████████████████████████▋        | 181/224 [01:50<00:21,  2.01it/s]
Epoch 12 Iter 182: loss 0.19648. :  81%|██████████████████████████████████▋        | 181/224 [01:51<00:21,  2.01it/s]
Epoch 12 Iter 182: loss 0.19648. :  81%|██████████████████████████████████▉        | 182/224 [01:51<00:21,  1.99it/s]
Epoch 12 Iter 183: loss 0.15036. :  81%|██████████████████████████████████▉        | 182/224 [01:52<00:21,  1.99it/s]
Epoch 12 Iter 183: loss 0.15036. :  82%|███████████████████████████████████▏       | 183/224 [01:52<00:20,  1.98it/s]
Epoch 12 Iter 184: loss 0.16479. :  82%|███████████████████████████████████▏       | 183/224 [01:52<00:20,  1.98it/s]
Epoch 12 Iter 184: loss 0.16479. :  82%|███████████████████████████████████▎       | 184/224 [01:52<00:20,  1.98it/s]
Epoch 12 Iter 185: loss 0.18840. :  82%|███████████████████████████████████▎       | 184/224 [01:53<00:20,  1.98it/s]
Epoch 12 Iter 185: loss 0.18840. :  83%|███████████████████████████████████▌       | 185/224 [01:53<00:19,  1.99it/s]
Epoch 12 Iter 186: loss 0.19454. :  83%|███████████████████████████████████▌       | 185/224 [01:53<00:19,  1.99it/s]
Epoch 12 Iter 186: loss 0.19454. :  83%|███████████████████████████████████▋       | 186/224 [01:53<00:19,  1.99it/s]
Epoch 12 Iter 187: loss 0.18696. :  83%|███████████████████████████████████▋       | 186/224 [01:54<00:19,  1.99it/s]
Epoch 12 Iter 187: loss 0.18696. :  83%|███████████████████████████████████▉       | 187/224 [01:54<00:18,  1.99it/s]
Epoch 12 Iter 188: loss 0.16813. :  83%|███████████████████████████████████▉       | 187/224 [01:54<00:18,  1.99it/s]
Epoch 12 Iter 188: loss 0.16813. :  84%|████████████████████████████████████       | 188/224 [01:54<00:18,  1.99it/s]
Epoch 12 Iter 189: loss 0.18233. :  84%|████████████████████████████████████       | 188/224 [01:55<00:18,  1.99it/s]
Epoch 12 Iter 189: loss 0.18233. :  84%|████████████████████████████████████▎      | 189/224 [01:55<00:17,  2.00it/s]
Epoch 12 Iter 190: loss 0.19911. :  84%|████████████████████████████████████▎      | 189/224 [01:55<00:17,  2.00it/s]
Epoch 12 Iter 190: loss 0.19911. :  85%|████████████████████████████████████▍      | 190/224 [01:55<00:17,  1.99it/s]
Epoch 12 Iter 191: loss 0.19482. :  85%|████████████████████████████████████▍      | 190/224 [01:56<00:17,  1.99it/s]
Epoch 12 Iter 191: loss 0.19482. :  85%|████████████████████████████████████▋      | 191/224 [01:56<00:16,  1.99it/s]
Epoch 12 Iter 192: loss 0.17512. :  85%|████████████████████████████████████▋      | 191/224 [01:56<00:16,  1.99it/s]
Epoch 12 Iter 192: loss 0.17512. :  86%|████████████████████████████████████▊      | 192/224 [01:56<00:16,  2.00it/s]
Epoch 12 Iter 193: loss 0.18582. :  86%|████████████████████████████████████▊      | 192/224 [01:57<00:16,  2.00it/s]
Epoch 12 Iter 193: loss 0.18582. :  86%|█████████████████████████████████████      | 193/224 [01:57<00:15,  2.01it/s]
Epoch 12 Iter 194: loss 0.16931. :  86%|█████████████████████████████████████      | 193/224 [01:57<00:15,  2.01it/s]
Epoch 12 Iter 194: loss 0.16931. :  87%|█████████████████████████████████████▏     | 194/224 [01:57<00:15,  1.97it/s]
Epoch 12 Iter 195: loss 0.16795. :  87%|█████████████████████████████████████▏     | 194/224 [01:58<00:15,  1.97it/s]
Epoch 12 Iter 195: loss 0.16795. :  87%|█████████████████████████████████████▍     | 195/224 [01:58<00:14,  1.95it/s]
Epoch 12 Iter 196: loss 0.18563. :  87%|█████████████████████████████████████▍     | 195/224 [01:58<00:14,  1.95it/s]
Epoch 12 Iter 196: loss 0.18563. :  88%|█████████████████████████████████████▋     | 196/224 [01:58<00:14,  1.97it/s]
Epoch 12 Iter 197: loss 0.14308. :  88%|█████████████████████████████████████▋     | 196/224 [01:59<00:14,  1.97it/s]
Epoch 12 Iter 197: loss 0.14308. :  88%|█████████████████████████████████████▊     | 197/224 [01:59<00:13,  1.98it/s]
Epoch 12 Iter 198: loss 0.16408. :  88%|█████████████████████████████████████▊     | 197/224 [01:59<00:13,  1.98it/s]
Epoch 12 Iter 198: loss 0.16408. :  88%|██████████████████████████████████████     | 198/224 [01:59<00:13,  1.98it/s]
Epoch 12 Iter 199: loss 0.15038. :  88%|██████████████████████████████████████     | 198/224 [02:00<00:13,  1.98it/s]
Epoch 12 Iter 199: loss 0.15038. :  89%|██████████████████████████████████████▏    | 199/224 [02:00<00:13,  1.90it/s]
Epoch 12 Iter 200: loss 0.19248. :  89%|██████████████████████████████████████▏    | 199/224 [02:00<00:13,  1.90it/s]
Epoch 12 Iter 200: loss 0.19248. :  89%|██████████████████████████████████████▍    | 200/224 [02:00<00:12,  1.91it/s]
Epoch 12 Iter 201: loss 0.15666. :  89%|██████████████████████████████████████▍    | 200/224 [02:01<00:12,  1.91it/s]
Epoch 12 Iter 201: loss 0.15666. :  90%|██████████████████████████████████████▌    | 201/224 [02:01<00:11,  1.94it/s]
Epoch 12 Iter 202: loss 0.18513. :  90%|██████████████████████████████████████▌    | 201/224 [02:01<00:11,  1.94it/s]
Epoch 12 Iter 202: loss 0.18513. :  90%|██████████████████████████████████████▊    | 202/224 [02:01<00:11,  1.94it/s]
Epoch 12 Iter 203: loss 0.16884. :  90%|██████████████████████████████████████▊    | 202/224 [02:02<00:11,  1.94it/s]
Epoch 12 Iter 203: loss 0.16884. :  91%|██████████████████████████████████████▉    | 203/224 [02:02<00:10,  1.95it/s]
Epoch 12 Iter 204: loss 0.18585. :  91%|██████████████████████████████████████▉    | 203/224 [02:02<00:10,  1.95it/s]
Epoch 12 Iter 204: loss 0.18585. :  91%|███████████████████████████████████████▏   | 204/224 [02:02<00:10,  1.97it/s]
Epoch 12 Iter 205: loss 0.16477. :  91%|███████████████████████████████████████▏   | 204/224 [02:03<00:10,  1.97it/s]
Epoch 12 Iter 205: loss 0.16477. :  92%|███████████████████████████████████████▎   | 205/224 [02:03<00:09,  1.96it/s]
Epoch 12 Iter 206: loss 0.20011. :  92%|███████████████████████████████████████▎   | 205/224 [02:03<00:09,  1.96it/s]
Epoch 12 Iter 206: loss 0.20011. :  92%|███████████████████████████████████████▌   | 206/224 [02:03<00:09,  1.98it/s]
Epoch 12 Iter 207: loss 0.19801. :  92%|███████████████████████████████████████▌   | 206/224 [02:04<00:09,  1.98it/s]
Epoch 12 Iter 207: loss 0.19801. :  92%|███████████████████████████████████████▋   | 207/224 [02:04<00:08,  1.97it/s]
Epoch 12 Iter 208: loss 0.16591. :  92%|███████████████████████████████████████▋   | 207/224 [02:04<00:08,  1.97it/s]
Epoch 12 Iter 208: loss 0.16591. :  93%|███████████████████████████████████████▉   | 208/224 [02:04<00:08,  1.92it/s]
Epoch 12 Iter 209: loss 0.16801. :  93%|███████████████████████████████████████▉   | 208/224 [02:05<00:08,  1.92it/s]
Epoch 12 Iter 209: loss 0.16801. :  93%|████████████████████████████████████████   | 209/224 [02:05<00:07,  1.92it/s]
Epoch 12 Iter 210: loss 0.17359. :  93%|████████████████████████████████████████   | 209/224 [02:05<00:07,  1.92it/s]
Epoch 12 Iter 210: loss 0.17359. :  94%|████████████████████████████████████████▎  | 210/224 [02:05<00:07,  1.95it/s]
Epoch 12 Iter 211: loss 0.16511. :  94%|████████████████████████████████████████▎  | 210/224 [02:06<00:07,  1.95it/s]
Epoch 12 Iter 211: loss 0.16511. :  94%|████████████████████████████████████████▌  | 211/224 [02:06<00:06,  1.96it/s]
Epoch 12 Iter 212: loss 0.18060. :  94%|████████████████████████████████████████▌  | 211/224 [02:06<00:06,  1.96it/s]
Epoch 12 Iter 212: loss 0.18060. :  95%|████████████████████████████████████████▋  | 212/224 [02:06<00:06,  1.95it/s]
Epoch 12 Iter 213: loss 0.17159. :  95%|████████████████████████████████████████▋  | 212/224 [02:07<00:06,  1.95it/s]
Epoch 12 Iter 213: loss 0.17159. :  95%|████████████████████████████████████████▉  | 213/224 [02:07<00:05,  1.96it/s]
Epoch 12 Iter 214: loss 0.16499. :  95%|████████████████████████████████████████▉  | 213/224 [02:07<00:05,  1.96it/s]
Epoch 12 Iter 214: loss 0.16499. :  96%|█████████████████████████████████████████  | 214/224 [02:07<00:05,  1.97it/s]
Epoch 12 Iter 215: loss 0.17196. :  96%|█████████████████████████████████████████  | 214/224 [02:08<00:05,  1.97it/s]
Epoch 12 Iter 215: loss 0.17196. :  96%|█████████████████████████████████████████▎ | 215/224 [02:08<00:04,  1.97it/s]
Epoch 12 Iter 216: loss 0.19687. :  96%|█████████████████████████████████████████▎ | 215/224 [02:08<00:04,  1.97it/s]
Epoch 12 Iter 216: loss 0.19687. :  96%|█████████████████████████████████████████▍ | 216/224 [02:08<00:04,  1.97it/s]
Epoch 12 Iter 217: loss 0.19622. :  96%|█████████████████████████████████████████▍ | 216/224 [02:09<00:04,  1.97it/s]
Epoch 12 Iter 217: loss 0.19622. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:03,  1.96it/s]
Epoch 12 Iter 218: loss 0.17590. :  97%|█████████████████████████████████████████▋ | 217/224 [02:09<00:03,  1.96it/s]
Epoch 12 Iter 218: loss 0.17590. :  97%|█████████████████████████████████████████▊ | 218/224 [02:09<00:03,  1.97it/s]
Epoch 12 Iter 219: loss 0.18150. :  97%|█████████████████████████████████████████▊ | 218/224 [02:10<00:03,  1.97it/s]
Epoch 12 Iter 219: loss 0.18150. :  98%|██████████████████████████████████████████ | 219/224 [02:10<00:02,  1.96it/s]
Epoch 12 Iter 220: loss 0.20126. :  98%|██████████████████████████████████████████ | 219/224 [02:10<00:02,  1.96it/s]
Epoch 12 Iter 220: loss 0.20126. :  98%|██████████████████████████████████████████▏| 220/224 [02:10<00:02,  1.96it/s]
Epoch 12 Iter 221: loss 0.16634. :  98%|██████████████████████████████████████████▏| 220/224 [02:11<00:02,  1.96it/s]
Epoch 12 Iter 221: loss 0.16634. :  99%|██████████████████████████████████████████▍| 221/224 [02:11<00:01,  1.92it/s]
Epoch 12 Iter 222: loss 0.19477. :  99%|██████████████████████████████████████████▍| 221/224 [02:12<00:01,  1.92it/s]
Epoch 12 Iter 222: loss 0.19477. :  99%|██████████████████████████████████████████▌| 222/224 [02:12<00:01,  1.78it/s]
Epoch 12 Iter 223: loss 0.19461. :  99%|██████████████████████████████████████████▌| 222/224 [02:12<00:01,  1.78it/s]
Epoch 12 Iter 223: loss 0.19461. : 100%|██████████████████████████████████████████▊| 223/224 [02:12<00:00,  1.81it/s]
Epoch 12 Iter 224: loss 0.17036. : 100%|██████████████████████████████████████████▊| 223/224 [02:13<00:00,  1.81it/s]
Epoch 12 Iter 224: loss 0.17036. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.85it/s]
Epoch 12 Iter 224: loss 0.17036. : 100%|███████████████████████████████████████████| 224/224 [02:13<00:00,  1.68it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.17947. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 13 Iter 1: loss 0.17947. :   0%|▏                                              | 1/224 [00:00<01:57,  1.90it/s]
Epoch 13 Iter 2: loss 0.17097. :   0%|▏                                              | 1/224 [00:01<01:57,  1.90it/s]
Epoch 13 Iter 2: loss 0.17097. :   1%|▍                                              | 2/224 [00:01<01:56,  1.91it/s]
Epoch 13 Iter 3: loss 0.15938. :   1%|▍                                              | 2/224 [00:01<01:56,  1.91it/s]
Epoch 13 Iter 3: loss 0.15938. :   1%|▋                                              | 3/224 [00:01<01:54,  1.93it/s]
Epoch 13 Iter 4: loss 0.19381. :   1%|▋                                              | 3/224 [00:02<01:54,  1.93it/s]
Epoch 13 Iter 4: loss 0.19381. :   2%|▊                                              | 4/224 [00:02<01:53,  1.94it/s]
Epoch 13 Iter 5: loss 0.18243. :   2%|▊                                              | 4/224 [00:02<01:53,  1.94it/s]
Epoch 13 Iter 5: loss 0.18243. :   2%|█                                              | 5/224 [00:02<01:52,  1.95it/s]
Epoch 13 Iter 6: loss 0.17653. :   2%|█                                              | 5/224 [00:03<01:52,  1.95it/s]
Epoch 13 Iter 6: loss 0.17653. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 13 Iter 7: loss 0.19974. :   3%|█▎                                             | 6/224 [00:03<01:52,  1.94it/s]
Epoch 13 Iter 7: loss 0.19974. :   3%|█▍                                             | 7/224 [00:03<01:51,  1.95it/s]
Epoch 13 Iter 8: loss 0.15952. :   3%|█▍                                             | 7/224 [00:04<01:51,  1.95it/s]
Epoch 13 Iter 8: loss 0.15952. :   4%|█▋                                             | 8/224 [00:04<01:58,  1.82it/s]
Epoch 13 Iter 9: loss 0.19359. :   4%|█▋                                             | 8/224 [00:04<01:58,  1.82it/s]
Epoch 13 Iter 9: loss 0.19359. :   4%|█▉                                             | 9/224 [00:04<01:56,  1.85it/s]
Epoch 13 Iter 10: loss 0.16294. :   4%|█▊                                            | 9/224 [00:05<01:56,  1.85it/s]
Epoch 13 Iter 10: loss 0.16294. :   4%|██                                           | 10/224 [00:05<01:57,  1.81it/s]
Epoch 13 Iter 11: loss 0.17010. :   4%|██                                           | 10/224 [00:05<01:57,  1.81it/s]
Epoch 13 Iter 11: loss 0.17010. :   5%|██▏                                          | 11/224 [00:05<01:54,  1.86it/s]
Epoch 13 Iter 12: loss 0.17467. :   5%|██▏                                          | 11/224 [00:06<01:54,  1.86it/s]
Epoch 13 Iter 12: loss 0.17467. :   5%|██▍                                          | 12/224 [00:06<01:51,  1.90it/s]
Epoch 13 Iter 13: loss 0.16253. :   5%|██▍                                          | 12/224 [00:06<01:51,  1.90it/s]
Epoch 13 Iter 13: loss 0.16253. :   6%|██▌                                          | 13/224 [00:06<01:49,  1.92it/s]
Epoch 13 Iter 14: loss 0.16271. :   6%|██▌                                          | 13/224 [00:07<01:49,  1.92it/s]
Epoch 13 Iter 14: loss 0.16271. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 13 Iter 15: loss 0.18922. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 13 Iter 15: loss 0.18922. :   7%|███                                          | 15/224 [00:07<01:46,  1.95it/s]
Epoch 13 Iter 16: loss 0.18541. :   7%|███                                          | 15/224 [00:08<01:46,  1.95it/s]
Epoch 13 Iter 16: loss 0.18541. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 13 Iter 17: loss 0.17767. :   7%|███▏                                         | 16/224 [00:08<01:46,  1.95it/s]
Epoch 13 Iter 17: loss 0.17767. :   8%|███▍                                         | 17/224 [00:08<01:45,  1.97it/s]
Epoch 13 Iter 18: loss 0.18954. :   8%|███▍                                         | 17/224 [00:09<01:45,  1.97it/s]
Epoch 13 Iter 18: loss 0.18954. :   8%|███▌                                         | 18/224 [00:09<01:45,  1.96it/s]
Epoch 13 Iter 19: loss 0.17673. :   8%|███▌                                         | 18/224 [00:09<01:45,  1.96it/s]
Epoch 13 Iter 19: loss 0.17673. :   8%|███▊                                         | 19/224 [00:09<01:44,  1.97it/s]
Epoch 13 Iter 20: loss 0.18850. :   8%|███▊                                         | 19/224 [00:10<01:44,  1.97it/s]
Epoch 13 Iter 20: loss 0.18850. :   9%|████                                         | 20/224 [00:10<01:42,  1.99it/s]
Epoch 13 Iter 21: loss 0.16849. :   9%|████                                         | 20/224 [00:10<01:42,  1.99it/s]
Epoch 13 Iter 21: loss 0.16849. :   9%|████▏                                        | 21/224 [00:10<01:42,  1.98it/s]
Epoch 13 Iter 22: loss 0.18616. :   9%|████▏                                        | 21/224 [00:11<01:42,  1.98it/s]
Epoch 13 Iter 22: loss 0.18616. :  10%|████▍                                        | 22/224 [00:11<01:43,  1.96it/s]
Epoch 13 Iter 23: loss 0.16212. :  10%|████▍                                        | 22/224 [00:11<01:43,  1.96it/s]
Epoch 13 Iter 23: loss 0.16212. :  10%|████▌                                        | 23/224 [00:11<01:41,  1.98it/s]
Epoch 13 Iter 24: loss 0.16158. :  10%|████▌                                        | 23/224 [00:12<01:41,  1.98it/s]
Epoch 13 Iter 24: loss 0.16158. :  11%|████▊                                        | 24/224 [00:12<01:40,  1.99it/s]
Epoch 13 Iter 25: loss 0.16088. :  11%|████▊                                        | 24/224 [00:12<01:40,  1.99it/s]
Epoch 13 Iter 25: loss 0.16088. :  11%|█████                                        | 25/224 [00:12<01:39,  2.01it/s]
Epoch 13 Iter 26: loss 0.15490. :  11%|█████                                        | 25/224 [00:13<01:39,  2.01it/s]
Epoch 13 Iter 26: loss 0.15490. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.00it/s]
Epoch 13 Iter 27: loss 0.17267. :  12%|█████▏                                       | 26/224 [00:13<01:38,  2.00it/s]
Epoch 13 Iter 27: loss 0.17267. :  12%|█████▍                                       | 27/224 [00:13<01:38,  2.01it/s]
Epoch 13 Iter 28: loss 0.17883. :  12%|█████▍                                       | 27/224 [00:14<01:38,  2.01it/s]
Epoch 13 Iter 28: loss 0.17883. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.02it/s]
Epoch 13 Iter 29: loss 0.18048. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.02it/s]
Epoch 13 Iter 29: loss 0.18048. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.03it/s]
Epoch 13 Iter 30: loss 0.15579. :  13%|█████▊                                       | 29/224 [00:15<01:35,  2.03it/s]
Epoch 13 Iter 30: loss 0.15579. :  13%|██████                                       | 30/224 [00:15<01:35,  2.02it/s]
Epoch 13 Iter 31: loss 0.16975. :  13%|██████                                       | 30/224 [00:15<01:35,  2.02it/s]
Epoch 13 Iter 31: loss 0.16975. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.02it/s]
Epoch 13 Iter 32: loss 0.16762. :  14%|██████▏                                      | 31/224 [00:16<01:35,  2.02it/s]
Epoch 13 Iter 32: loss 0.16762. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.02it/s]
Epoch 13 Iter 33: loss 0.17226. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.02it/s]
Epoch 13 Iter 33: loss 0.17226. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.02it/s]
Epoch 13 Iter 34: loss 0.18584. :  15%|██████▋                                      | 33/224 [00:17<01:34,  2.02it/s]
Epoch 13 Iter 34: loss 0.18584. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.02it/s]
Epoch 13 Iter 35: loss 0.17367. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.02it/s]
Epoch 13 Iter 35: loss 0.17367. :  16%|███████                                      | 35/224 [00:17<01:34,  2.01it/s]
Epoch 13 Iter 36: loss 0.19786. :  16%|███████                                      | 35/224 [00:18<01:34,  2.01it/s]
Epoch 13 Iter 36: loss 0.19786. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.02it/s]
Epoch 13 Iter 37: loss 0.17897. :  16%|███████▏                                     | 36/224 [00:18<01:33,  2.02it/s]
Epoch 13 Iter 37: loss 0.17897. :  17%|███████▍                                     | 37/224 [00:18<01:32,  2.01it/s]
Epoch 13 Iter 38: loss 0.16918. :  17%|███████▍                                     | 37/224 [00:19<01:32,  2.01it/s]
Epoch 13 Iter 38: loss 0.16918. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 13 Iter 39: loss 0.18061. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.01it/s]
Epoch 13 Iter 39: loss 0.18061. :  17%|███████▊                                     | 39/224 [00:19<01:31,  2.01it/s]
Epoch 13 Iter 40: loss 0.19139. :  17%|███████▊                                     | 39/224 [00:20<01:31,  2.01it/s]
Epoch 13 Iter 40: loss 0.19139. :  18%|████████                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 13 Iter 41: loss 0.16458. :  18%|████████                                     | 40/224 [00:20<01:31,  2.01it/s]
Epoch 13 Iter 41: loss 0.16458. :  18%|████████▏                                    | 41/224 [00:20<01:30,  2.03it/s]
Epoch 13 Iter 42: loss 0.17692. :  18%|████████▏                                    | 41/224 [00:21<01:30,  2.03it/s]
Epoch 13 Iter 42: loss 0.17692. :  19%|████████▍                                    | 42/224 [00:21<01:29,  2.03it/s]
Epoch 13 Iter 43: loss 0.19186. :  19%|████████▍                                    | 42/224 [00:21<01:29,  2.03it/s]
Epoch 13 Iter 43: loss 0.19186. :  19%|████████▋                                    | 43/224 [00:21<01:29,  2.01it/s]
Epoch 13 Iter 44: loss 0.17612. :  19%|████████▋                                    | 43/224 [00:22<01:29,  2.01it/s]
Epoch 13 Iter 44: loss 0.17612. :  20%|████████▊                                    | 44/224 [00:22<01:30,  2.00it/s]
Epoch 13 Iter 45: loss 0.15853. :  20%|████████▊                                    | 44/224 [00:22<01:30,  2.00it/s]
Epoch 13 Iter 45: loss 0.15853. :  20%|█████████                                    | 45/224 [00:22<01:30,  1.98it/s]
Epoch 13 Iter 46: loss 0.19546. :  20%|█████████                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 13 Iter 46: loss 0.19546. :  21%|█████████▏                                   | 46/224 [00:23<01:32,  1.92it/s]
Epoch 13 Iter 47: loss 0.18141. :  21%|█████████▏                                   | 46/224 [00:23<01:32,  1.92it/s]
Epoch 13 Iter 47: loss 0.18141. :  21%|█████████▍                                   | 47/224 [00:23<01:31,  1.92it/s]
Epoch 13 Iter 48: loss 0.17386. :  21%|█████████▍                                   | 47/224 [00:24<01:31,  1.92it/s]
Epoch 13 Iter 48: loss 0.17386. :  21%|█████████▋                                   | 48/224 [00:24<01:30,  1.94it/s]
Epoch 13 Iter 49: loss 0.16956. :  21%|█████████▋                                   | 48/224 [00:24<01:30,  1.94it/s]
Epoch 13 Iter 49: loss 0.16956. :  22%|█████████▊                                   | 49/224 [00:24<01:29,  1.96it/s]
Epoch 13 Iter 50: loss 0.18299. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.96it/s]
Epoch 13 Iter 50: loss 0.18299. :  22%|██████████                                   | 50/224 [00:25<01:28,  1.97it/s]
Epoch 13 Iter 51: loss 0.15633. :  22%|██████████                                   | 50/224 [00:25<01:28,  1.97it/s]
Epoch 13 Iter 51: loss 0.15633. :  23%|██████████▏                                  | 51/224 [00:25<01:27,  1.97it/s]
Epoch 13 Iter 52: loss 0.15767. :  23%|██████████▏                                  | 51/224 [00:26<01:27,  1.97it/s]
Epoch 13 Iter 52: loss 0.15767. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.96it/s]
Epoch 13 Iter 53: loss 0.18846. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.96it/s]
Epoch 13 Iter 53: loss 0.18846. :  24%|██████████▋                                  | 53/224 [00:26<01:29,  1.91it/s]
Epoch 13 Iter 54: loss 0.18563. :  24%|██████████▋                                  | 53/224 [00:27<01:29,  1.91it/s]
Epoch 13 Iter 54: loss 0.18563. :  24%|██████████▊                                  | 54/224 [00:27<01:27,  1.94it/s]
Epoch 13 Iter 55: loss 0.16623. :  24%|██████████▊                                  | 54/224 [00:27<01:27,  1.94it/s]
Epoch 13 Iter 55: loss 0.16623. :  25%|███████████                                  | 55/224 [00:27<01:26,  1.95it/s]
Epoch 13 Iter 56: loss 0.17266. :  25%|███████████                                  | 55/224 [00:28<01:26,  1.95it/s]
Epoch 13 Iter 56: loss 0.17266. :  25%|███████████▎                                 | 56/224 [00:28<01:25,  1.97it/s]
Epoch 13 Iter 57: loss 0.16371. :  25%|███████████▎                                 | 56/224 [00:28<01:25,  1.97it/s]
Epoch 13 Iter 57: loss 0.16371. :  25%|███████████▍                                 | 57/224 [00:28<01:25,  1.96it/s]
Epoch 13 Iter 58: loss 0.17185. :  25%|███████████▍                                 | 57/224 [00:29<01:25,  1.96it/s]
Epoch 13 Iter 58: loss 0.17185. :  26%|███████████▋                                 | 58/224 [00:29<01:24,  1.98it/s]
Epoch 13 Iter 59: loss 0.17427. :  26%|███████████▋                                 | 58/224 [00:30<01:24,  1.98it/s]
Epoch 13 Iter 59: loss 0.17427. :  26%|███████████▊                                 | 59/224 [00:30<01:23,  1.96it/s]
Epoch 13 Iter 60: loss 0.19321. :  26%|███████████▊                                 | 59/224 [00:30<01:23,  1.96it/s]
Epoch 13 Iter 60: loss 0.19321. :  27%|████████████                                 | 60/224 [00:30<01:23,  1.96it/s]
Epoch 13 Iter 61: loss 0.17930. :  27%|████████████                                 | 60/224 [00:31<01:23,  1.96it/s]
Epoch 13 Iter 61: loss 0.17930. :  27%|████████████▎                                | 61/224 [00:31<01:22,  1.96it/s]
Epoch 13 Iter 62: loss 0.19053. :  27%|████████████▎                                | 61/224 [00:31<01:22,  1.96it/s]
Epoch 13 Iter 62: loss 0.19053. :  28%|████████████▍                                | 62/224 [00:31<01:22,  1.97it/s]
Epoch 13 Iter 63: loss 0.17847. :  28%|████████████▍                                | 62/224 [00:32<01:22,  1.97it/s]
Epoch 13 Iter 63: loss 0.17847. :  28%|████████████▋                                | 63/224 [00:32<01:21,  1.97it/s]
Epoch 13 Iter 64: loss 0.17665. :  28%|████████████▋                                | 63/224 [00:32<01:21,  1.97it/s]
Epoch 13 Iter 64: loss 0.17665. :  29%|████████████▊                                | 64/224 [00:32<01:22,  1.93it/s]
Epoch 13 Iter 65: loss 0.16860. :  29%|████████████▊                                | 64/224 [00:33<01:22,  1.93it/s]
Epoch 13 Iter 65: loss 0.16860. :  29%|█████████████                                | 65/224 [00:33<01:26,  1.83it/s]
Epoch 13 Iter 66: loss 0.16299. :  29%|█████████████                                | 65/224 [00:33<01:26,  1.83it/s]
Epoch 13 Iter 66: loss 0.16299. :  29%|█████████████▎                               | 66/224 [00:33<01:31,  1.73it/s]
Epoch 13 Iter 67: loss 0.17714. :  29%|█████████████▎                               | 66/224 [00:34<01:31,  1.73it/s]
Epoch 13 Iter 67: loss 0.17714. :  30%|█████████████▍                               | 67/224 [00:34<01:30,  1.73it/s]
Epoch 13 Iter 68: loss 0.15556. :  30%|█████████████▍                               | 67/224 [00:35<01:30,  1.73it/s]
Epoch 13 Iter 68: loss 0.15556. :  30%|█████████████▋                               | 68/224 [00:35<01:38,  1.58it/s]
Epoch 13 Iter 69: loss 0.18318. :  30%|█████████████▋                               | 68/224 [00:35<01:38,  1.58it/s]
Epoch 13 Iter 69: loss 0.18318. :  31%|█████████████▊                               | 69/224 [00:35<01:40,  1.54it/s]
Epoch 13 Iter 70: loss 0.14886. :  31%|█████████████▊                               | 69/224 [00:36<01:40,  1.54it/s]
Epoch 13 Iter 70: loss 0.14886. :  31%|██████████████                               | 70/224 [00:36<01:43,  1.49it/s]
Epoch 13 Iter 71: loss 0.19502. :  31%|██████████████                               | 70/224 [00:37<01:43,  1.49it/s]
Epoch 13 Iter 71: loss 0.19502. :  32%|██████████████▎                              | 71/224 [00:37<01:46,  1.44it/s]
Epoch 13 Iter 72: loss 0.16662. :  32%|██████████████▎                              | 71/224 [00:38<01:46,  1.44it/s]
Epoch 13 Iter 72: loss 0.16662. :  32%|██████████████▍                              | 72/224 [00:38<01:49,  1.39it/s]
Epoch 13 Iter 73: loss 0.18631. :  32%|██████████████▍                              | 72/224 [00:38<01:49,  1.39it/s]
Epoch 13 Iter 73: loss 0.18631. :  33%|██████████████▋                              | 73/224 [00:38<01:49,  1.38it/s]
Epoch 13 Iter 74: loss 0.19592. :  33%|██████████████▋                              | 73/224 [00:39<01:49,  1.38it/s]
Epoch 13 Iter 74: loss 0.19592. :  33%|██████████████▊                              | 74/224 [00:39<01:50,  1.36it/s]
Epoch 13 Iter 75: loss 0.18209. :  33%|██████████████▊                              | 74/224 [00:40<01:50,  1.36it/s]
Epoch 13 Iter 75: loss 0.18209. :  33%|███████████████                              | 75/224 [00:40<01:43,  1.44it/s]
Epoch 13 Iter 76: loss 0.17012. :  33%|███████████████                              | 75/224 [00:40<01:43,  1.44it/s]
Epoch 13 Iter 76: loss 0.17012. :  34%|███████████████▎                             | 76/224 [00:40<01:40,  1.47it/s]
Epoch 13 Iter 77: loss 0.17899. :  34%|███████████████▎                             | 76/224 [00:41<01:40,  1.47it/s]
Epoch 13 Iter 77: loss 0.17899. :  34%|███████████████▍                             | 77/224 [00:41<01:34,  1.55it/s]
Epoch 13 Iter 78: loss 0.18665. :  34%|███████████████▍                             | 77/224 [00:42<01:34,  1.55it/s]
Epoch 13 Iter 78: loss 0.18665. :  35%|███████████████▋                             | 78/224 [00:42<01:39,  1.47it/s]
Epoch 13 Iter 79: loss 0.17660. :  35%|███████████████▋                             | 78/224 [00:42<01:39,  1.47it/s]
Epoch 13 Iter 79: loss 0.17660. :  35%|███████████████▊                             | 79/224 [00:42<01:39,  1.46it/s]
Epoch 13 Iter 80: loss 0.18340. :  35%|███████████████▊                             | 79/224 [00:43<01:39,  1.46it/s]
Epoch 13 Iter 80: loss 0.18340. :  36%|████████████████                             | 80/224 [00:43<01:32,  1.55it/s]
Epoch 13 Iter 81: loss 0.19225. :  36%|████████████████                             | 80/224 [00:43<01:32,  1.55it/s]
Epoch 13 Iter 81: loss 0.19225. :  36%|████████████████▎                            | 81/224 [00:43<01:28,  1.62it/s]
Epoch 13 Iter 82: loss 0.17239. :  36%|████████████████▎                            | 81/224 [00:44<01:28,  1.62it/s]
Epoch 13 Iter 82: loss 0.17239. :  37%|████████████████▍                            | 82/224 [00:44<01:24,  1.68it/s]
Epoch 13 Iter 83: loss 0.17315. :  37%|████████████████▍                            | 82/224 [00:45<01:24,  1.68it/s]
Epoch 13 Iter 83: loss 0.17315. :  37%|████████████████▋                            | 83/224 [00:45<01:21,  1.73it/s]
Epoch 13 Iter 84: loss 0.19077. :  37%|████████████████▋                            | 83/224 [00:45<01:21,  1.73it/s]
Epoch 13 Iter 84: loss 0.19077. :  38%|████████████████▉                            | 84/224 [00:45<01:20,  1.75it/s]
Epoch 13 Iter 85: loss 0.18348. :  38%|████████████████▉                            | 84/224 [00:46<01:20,  1.75it/s]
Epoch 13 Iter 85: loss 0.18348. :  38%|█████████████████                            | 85/224 [00:46<01:23,  1.66it/s]
Epoch 13 Iter 86: loss 0.17308. :  38%|█████████████████                            | 85/224 [00:47<01:23,  1.66it/s]
Epoch 13 Iter 86: loss 0.17308. :  38%|█████████████████▎                           | 86/224 [00:47<01:29,  1.54it/s]
Epoch 13 Iter 87: loss 0.17519. :  38%|█████████████████▎                           | 86/224 [00:47<01:29,  1.54it/s]
Epoch 13 Iter 87: loss 0.17519. :  39%|█████████████████▍                           | 87/224 [00:47<01:25,  1.60it/s]
Epoch 13 Iter 88: loss 0.17802. :  39%|█████████████████▍                           | 87/224 [00:48<01:25,  1.60it/s]
Epoch 13 Iter 88: loss 0.17802. :  39%|█████████████████▋                           | 88/224 [00:48<01:28,  1.54it/s]
Epoch 13 Iter 89: loss 0.18548. :  39%|█████████████████▋                           | 88/224 [00:49<01:28,  1.54it/s]
Epoch 13 Iter 89: loss 0.18548. :  40%|█████████████████▉                           | 89/224 [00:49<01:32,  1.46it/s]
Epoch 13 Iter 90: loss 0.17411. :  40%|█████████████████▉                           | 89/224 [00:49<01:32,  1.46it/s]
Epoch 13 Iter 90: loss 0.17411. :  40%|██████████████████                           | 90/224 [00:49<01:33,  1.43it/s]
Epoch 13 Iter 91: loss 0.16701. :  40%|██████████████████                           | 90/224 [00:50<01:33,  1.43it/s]
Epoch 13 Iter 91: loss 0.16701. :  41%|██████████████████▎                          | 91/224 [00:50<01:26,  1.53it/s]
Epoch 13 Iter 92: loss 0.18098. :  41%|██████████████████▎                          | 91/224 [00:50<01:26,  1.53it/s]
Epoch 13 Iter 92: loss 0.18098. :  41%|██████████████████▍                          | 92/224 [00:50<01:22,  1.60it/s]
Epoch 13 Iter 93: loss 0.18918. :  41%|██████████████████▍                          | 92/224 [00:51<01:22,  1.60it/s]
Epoch 13 Iter 93: loss 0.18918. :  42%|██████████████████▋                          | 93/224 [00:51<01:26,  1.51it/s]
Epoch 13 Iter 94: loss 0.18081. :  42%|██████████████████▋                          | 93/224 [00:52<01:26,  1.51it/s]
Epoch 13 Iter 94: loss 0.18081. :  42%|██████████████████▉                          | 94/224 [00:52<01:30,  1.44it/s]
Epoch 13 Iter 95: loss 0.18751. :  42%|██████████████████▉                          | 94/224 [00:53<01:30,  1.44it/s]
Epoch 13 Iter 95: loss 0.18751. :  42%|███████████████████                          | 95/224 [00:53<01:29,  1.45it/s]
Epoch 13 Iter 96: loss 0.18486. :  42%|███████████████████                          | 95/224 [00:53<01:29,  1.45it/s]
Epoch 13 Iter 96: loss 0.18486. :  43%|███████████████████▎                         | 96/224 [00:53<01:25,  1.49it/s]
Epoch 13 Iter 97: loss 0.18063. :  43%|███████████████████▎                         | 96/224 [00:54<01:25,  1.49it/s]
Epoch 13 Iter 97: loss 0.18063. :  43%|███████████████████▍                         | 97/224 [00:54<01:21,  1.56it/s]
Epoch 13 Iter 98: loss 0.19962. :  43%|███████████████████▍                         | 97/224 [00:54<01:21,  1.56it/s]
Epoch 13 Iter 98: loss 0.19962. :  44%|███████████████████▋                         | 98/224 [00:54<01:16,  1.64it/s]
Epoch 13 Iter 99: loss 0.17027. :  44%|███████████████████▋                         | 98/224 [00:55<01:16,  1.64it/s]
Epoch 13 Iter 99: loss 0.17027. :  44%|███████████████████▉                         | 99/224 [00:55<01:14,  1.68it/s]
Epoch 13 Iter 100: loss 0.18339. :  44%|███████████████████▍                        | 99/224 [00:56<01:14,  1.68it/s]
Epoch 13 Iter 100: loss 0.18339. :  45%|███████████████████▏                       | 100/224 [00:56<01:21,  1.52it/s]
Epoch 13 Iter 101: loss 0.17743. :  45%|███████████████████▏                       | 100/224 [00:56<01:21,  1.52it/s]
Epoch 13 Iter 101: loss 0.17743. :  45%|███████████████████▍                       | 101/224 [00:56<01:20,  1.53it/s]
Epoch 13 Iter 102: loss 0.17961. :  45%|███████████████████▍                       | 101/224 [00:57<01:20,  1.53it/s]
Epoch 13 Iter 102: loss 0.17961. :  46%|███████████████████▌                       | 102/224 [00:57<01:15,  1.62it/s]
Epoch 13 Iter 103: loss 0.17246. :  46%|███████████████████▌                       | 102/224 [00:57<01:15,  1.62it/s]
Epoch 13 Iter 103: loss 0.17246. :  46%|███████████████████▊                       | 103/224 [00:57<01:11,  1.69it/s]
Epoch 13 Iter 104: loss 0.19488. :  46%|███████████████████▊                       | 103/224 [00:58<01:11,  1.69it/s]
Epoch 13 Iter 104: loss 0.19488. :  46%|███████████████████▉                       | 104/224 [00:58<01:08,  1.74it/s]
Epoch 13 Iter 105: loss 0.17355. :  46%|███████████████████▉                       | 104/224 [00:58<01:08,  1.74it/s]
Epoch 13 Iter 105: loss 0.17355. :  47%|████████████████████▏                      | 105/224 [00:58<01:06,  1.79it/s]
Epoch 13 Iter 106: loss 0.16694. :  47%|████████████████████▏                      | 105/224 [00:59<01:06,  1.79it/s]
Epoch 13 Iter 106: loss 0.16694. :  47%|████████████████████▎                      | 106/224 [00:59<01:10,  1.66it/s]
Epoch 13 Iter 107: loss 0.17545. :  47%|████████████████████▎                      | 106/224 [01:00<01:10,  1.66it/s]
Epoch 13 Iter 107: loss 0.17545. :  48%|████████████████████▌                      | 107/224 [01:00<01:16,  1.52it/s]
Epoch 13 Iter 108: loss 0.16170. :  48%|████████████████████▌                      | 107/224 [01:01<01:16,  1.52it/s]
Epoch 13 Iter 108: loss 0.16170. :  48%|████████████████████▋                      | 108/224 [01:01<01:19,  1.45it/s]
Epoch 13 Iter 109: loss 0.17858. :  48%|████████████████████▋                      | 108/224 [01:01<01:19,  1.45it/s]
Epoch 13 Iter 109: loss 0.17858. :  49%|████████████████████▉                      | 109/224 [01:01<01:13,  1.56it/s]
Epoch 13 Iter 110: loss 0.17261. :  49%|████████████████████▉                      | 109/224 [01:02<01:13,  1.56it/s]
Epoch 13 Iter 110: loss 0.17261. :  49%|█████████████████████                      | 110/224 [01:02<01:09,  1.64it/s]
Epoch 13 Iter 111: loss 0.17648. :  49%|█████████████████████                      | 110/224 [01:02<01:09,  1.64it/s]
Epoch 13 Iter 111: loss 0.17648. :  50%|█████████████████████▎                     | 111/224 [01:02<01:06,  1.70it/s]
Epoch 13 Iter 112: loss 0.16729. :  50%|█████████████████████▎                     | 111/224 [01:03<01:06,  1.70it/s]
Epoch 13 Iter 112: loss 0.16729. :  50%|█████████████████████▌                     | 112/224 [01:03<01:05,  1.72it/s]
Epoch 13 Iter 113: loss 0.16433. :  50%|█████████████████████▌                     | 112/224 [01:04<01:05,  1.72it/s]
Epoch 13 Iter 113: loss 0.16433. :  50%|█████████████████████▋                     | 113/224 [01:04<01:09,  1.61it/s]
Epoch 13 Iter 114: loss 0.19336. :  50%|█████████████████████▋                     | 113/224 [01:04<01:09,  1.61it/s]
Epoch 13 Iter 114: loss 0.19336. :  51%|█████████████████████▉                     | 114/224 [01:04<01:13,  1.50it/s]
Epoch 13 Iter 115: loss 0.18320. :  51%|█████████████████████▉                     | 114/224 [01:05<01:13,  1.50it/s]
Epoch 13 Iter 115: loss 0.18320. :  51%|██████████████████████                     | 115/224 [01:05<01:15,  1.44it/s]
Epoch 13 Iter 116: loss 0.17199. :  51%|██████████████████████                     | 115/224 [01:06<01:15,  1.44it/s]
Epoch 13 Iter 116: loss 0.17199. :  52%|██████████████████████▎                    | 116/224 [01:06<01:16,  1.40it/s]
Epoch 13 Iter 117: loss 0.17947. :  52%|██████████████████████▎                    | 116/224 [01:07<01:16,  1.40it/s]
Epoch 13 Iter 117: loss 0.17947. :  52%|██████████████████████▍                    | 117/224 [01:07<01:13,  1.46it/s]
Epoch 13 Iter 118: loss 0.17755. :  52%|██████████████████████▍                    | 117/224 [01:07<01:13,  1.46it/s]
Epoch 13 Iter 118: loss 0.17755. :  53%|██████████████████████▋                    | 118/224 [01:07<01:13,  1.44it/s]
Epoch 13 Iter 119: loss 0.19752. :  53%|██████████████████████▋                    | 118/224 [01:08<01:13,  1.44it/s]
Epoch 13 Iter 119: loss 0.19752. :  53%|██████████████████████▊                    | 119/224 [01:08<01:14,  1.41it/s]
Epoch 13 Iter 120: loss 0.18901. :  53%|██████████████████████▊                    | 119/224 [01:09<01:14,  1.41it/s]
Epoch 13 Iter 120: loss 0.18901. :  54%|███████████████████████                    | 120/224 [01:09<01:11,  1.46it/s]
Epoch 13 Iter 121: loss 0.17523. :  54%|███████████████████████                    | 120/224 [01:09<01:11,  1.46it/s]
Epoch 13 Iter 121: loss 0.17523. :  54%|███████████████████████▏                   | 121/224 [01:09<01:11,  1.45it/s]
Epoch 13 Iter 122: loss 0.16958. :  54%|███████████████████████▏                   | 121/224 [01:10<01:11,  1.45it/s]
Epoch 13 Iter 122: loss 0.16958. :  54%|███████████████████████▍                   | 122/224 [01:10<01:12,  1.40it/s]
Epoch 13 Iter 123: loss 0.17714. :  54%|███████████████████████▍                   | 122/224 [01:11<01:12,  1.40it/s]
Epoch 13 Iter 123: loss 0.17714. :  55%|███████████████████████▌                   | 123/224 [01:11<01:13,  1.37it/s]
Epoch 13 Iter 124: loss 0.17460. :  55%|███████████████████████▌                   | 123/224 [01:12<01:13,  1.37it/s]
Epoch 13 Iter 124: loss 0.17460. :  55%|███████████████████████▊                   | 124/224 [01:12<01:14,  1.35it/s]
Epoch 13 Iter 125: loss 0.17686. :  55%|███████████████████████▊                   | 124/224 [01:12<01:14,  1.35it/s]
Epoch 13 Iter 125: loss 0.17686. :  56%|███████████████████████▉                   | 125/224 [01:12<01:10,  1.41it/s]
Epoch 13 Iter 126: loss 0.18640. :  56%|███████████████████████▉                   | 125/224 [01:13<01:10,  1.41it/s]
Epoch 13 Iter 126: loss 0.18640. :  56%|████████████████████████▏                  | 126/224 [01:13<01:09,  1.41it/s]
Epoch 13 Iter 127: loss 0.16883. :  56%|████████████████████████▏                  | 126/224 [01:14<01:09,  1.41it/s]
Epoch 13 Iter 127: loss 0.16883. :  57%|████████████████████████▍                  | 127/224 [01:14<01:09,  1.40it/s]
Epoch 13 Iter 128: loss 0.19444. :  57%|████████████████████████▍                  | 127/224 [01:14<01:09,  1.40it/s]
Epoch 13 Iter 128: loss 0.19444. :  57%|████████████████████████▌                  | 128/224 [01:14<01:03,  1.51it/s]
Epoch 13 Iter 129: loss 0.17775. :  57%|████████████████████████▌                  | 128/224 [01:15<01:03,  1.51it/s]
Epoch 13 Iter 129: loss 0.17775. :  58%|████████████████████████▊                  | 129/224 [01:15<00:59,  1.60it/s]
Epoch 13 Iter 130: loss 0.17578. :  58%|████████████████████████▊                  | 129/224 [01:15<00:59,  1.60it/s]
Epoch 13 Iter 130: loss 0.17578. :  58%|████████████████████████▉                  | 130/224 [01:15<00:58,  1.61it/s]
Epoch 13 Iter 131: loss 0.17515. :  58%|████████████████████████▉                  | 130/224 [01:16<00:58,  1.61it/s]
Epoch 13 Iter 131: loss 0.17515. :  58%|█████████████████████████▏                 | 131/224 [01:16<00:57,  1.62it/s]
Epoch 13 Iter 132: loss 0.19035. :  58%|█████████████████████████▏                 | 131/224 [01:17<00:57,  1.62it/s]
Epoch 13 Iter 132: loss 0.19035. :  59%|█████████████████████████▎                 | 132/224 [01:17<01:00,  1.51it/s]
Epoch 13 Iter 133: loss 0.17257. :  59%|█████████████████████████▎                 | 132/224 [01:18<01:00,  1.51it/s]
Epoch 13 Iter 133: loss 0.17257. :  59%|█████████████████████████▌                 | 133/224 [01:18<01:03,  1.44it/s]
Epoch 13 Iter 134: loss 0.16454. :  59%|█████████████████████████▌                 | 133/224 [01:18<01:03,  1.44it/s]
Epoch 13 Iter 134: loss 0.16454. :  60%|█████████████████████████▋                 | 134/224 [01:18<01:01,  1.46it/s]
Epoch 13 Iter 135: loss 0.18129. :  60%|█████████████████████████▋                 | 134/224 [01:19<01:01,  1.46it/s]
Epoch 13 Iter 135: loss 0.18129. :  60%|█████████████████████████▉                 | 135/224 [01:19<00:58,  1.53it/s]
Epoch 13 Iter 136: loss 0.16765. :  60%|█████████████████████████▉                 | 135/224 [01:20<00:58,  1.53it/s]
Epoch 13 Iter 136: loss 0.16765. :  61%|██████████████████████████                 | 136/224 [01:20<01:00,  1.45it/s]
Epoch 13 Iter 137: loss 0.18465. :  61%|██████████████████████████                 | 136/224 [01:20<01:00,  1.45it/s]
Epoch 13 Iter 137: loss 0.18465. :  61%|██████████████████████████▎                | 137/224 [01:20<00:56,  1.54it/s]
Epoch 13 Iter 138: loss 0.19825. :  61%|██████████████████████████▎                | 137/224 [01:21<00:56,  1.54it/s]
Epoch 13 Iter 138: loss 0.19825. :  62%|██████████████████████████▍                | 138/224 [01:21<00:58,  1.47it/s]
Epoch 13 Iter 139: loss 0.16991. :  62%|██████████████████████████▍                | 138/224 [01:22<00:58,  1.47it/s]
Epoch 13 Iter 139: loss 0.16991. :  62%|██████████████████████████▋                | 139/224 [01:22<00:57,  1.48it/s]
Epoch 13 Iter 140: loss 0.15934. :  62%|██████████████████████████▋                | 139/224 [01:22<00:57,  1.48it/s]
Epoch 13 Iter 140: loss 0.15934. :  62%|██████████████████████████▉                | 140/224 [01:22<00:56,  1.49it/s]
Epoch 13 Iter 141: loss 0.16764. :  62%|██████████████████████████▉                | 140/224 [01:23<00:56,  1.49it/s]
Epoch 13 Iter 141: loss 0.16764. :  63%|███████████████████████████                | 141/224 [01:23<00:54,  1.54it/s]
Epoch 13 Iter 142: loss 0.19090. :  63%|███████████████████████████                | 141/224 [01:23<00:54,  1.54it/s]
Epoch 13 Iter 142: loss 0.19090. :  63%|███████████████████████████▎               | 142/224 [01:23<00:51,  1.61it/s]
Epoch 13 Iter 143: loss 0.16673. :  63%|███████████████████████████▎               | 142/224 [01:24<00:51,  1.61it/s]
Epoch 13 Iter 143: loss 0.16673. :  64%|███████████████████████████▍               | 143/224 [01:24<00:49,  1.64it/s]
Epoch 13 Iter 144: loss 0.20439. :  64%|███████████████████████████▍               | 143/224 [01:24<00:49,  1.64it/s]
Epoch 13 Iter 144: loss 0.20439. :  64%|███████████████████████████▋               | 144/224 [01:24<00:46,  1.71it/s]
Epoch 13 Iter 145: loss 0.18436. :  64%|███████████████████████████▋               | 144/224 [01:25<00:46,  1.71it/s]
Epoch 13 Iter 145: loss 0.18436. :  65%|███████████████████████████▊               | 145/224 [01:25<00:45,  1.75it/s]
Epoch 13 Iter 146: loss 0.18713. :  65%|███████████████████████████▊               | 145/224 [01:26<00:45,  1.75it/s]
Epoch 13 Iter 146: loss 0.18713. :  65%|████████████████████████████               | 146/224 [01:26<00:48,  1.60it/s]
Epoch 13 Iter 147: loss 0.16469. :  65%|████████████████████████████               | 146/224 [01:26<00:48,  1.60it/s]
Epoch 13 Iter 147: loss 0.16469. :  66%|████████████████████████████▏              | 147/224 [01:26<00:47,  1.62it/s]
Epoch 13 Iter 148: loss 0.16671. :  66%|████████████████████████████▏              | 147/224 [01:27<00:47,  1.62it/s]
Epoch 13 Iter 148: loss 0.16671. :  66%|████████████████████████████▍              | 148/224 [01:27<00:47,  1.59it/s]
Epoch 13 Iter 149: loss 0.17717. :  66%|████████████████████████████▍              | 148/224 [01:28<00:47,  1.59it/s]
Epoch 13 Iter 149: loss 0.17717. :  67%|████████████████████████████▌              | 149/224 [01:28<00:50,  1.49it/s]
Epoch 13 Iter 150: loss 0.19343. :  67%|████████████████████████████▌              | 149/224 [01:28<00:50,  1.49it/s]
Epoch 13 Iter 150: loss 0.19343. :  67%|████████████████████████████▊              | 150/224 [01:28<00:49,  1.49it/s]
Epoch 13 Iter 151: loss 0.18093. :  67%|████████████████████████████▊              | 150/224 [01:29<00:49,  1.49it/s]
Epoch 13 Iter 151: loss 0.18093. :  67%|████████████████████████████▉              | 151/224 [01:29<00:45,  1.59it/s]
Epoch 13 Iter 152: loss 0.16577. :  67%|████████████████████████████▉              | 151/224 [01:30<00:45,  1.59it/s]
Epoch 13 Iter 152: loss 0.16577. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:45,  1.59it/s]
Epoch 13 Iter 153: loss 0.18923. :  68%|█████████████████████████████▏             | 152/224 [01:30<00:45,  1.59it/s]
Epoch 13 Iter 153: loss 0.18923. :  68%|█████████████████████████████▎             | 153/224 [01:30<00:46,  1.52it/s]
Epoch 13 Iter 154: loss 0.18883. :  68%|█████████████████████████████▎             | 153/224 [01:31<00:46,  1.52it/s]
Epoch 13 Iter 154: loss 0.18883. :  69%|█████████████████████████████▌             | 154/224 [01:31<00:49,  1.43it/s]
Epoch 13 Iter 155: loss 0.18615. :  69%|█████████████████████████████▌             | 154/224 [01:32<00:49,  1.43it/s]
Epoch 13 Iter 155: loss 0.18615. :  69%|█████████████████████████████▊             | 155/224 [01:32<00:47,  1.44it/s]
Epoch 13 Iter 156: loss 0.16208. :  69%|█████████████████████████████▊             | 155/224 [01:33<00:47,  1.44it/s]
Epoch 13 Iter 156: loss 0.16208. :  70%|█████████████████████████████▉             | 156/224 [01:33<00:48,  1.40it/s]
Epoch 13 Iter 157: loss 0.17737. :  70%|█████████████████████████████▉             | 156/224 [01:33<00:48,  1.40it/s]
Epoch 13 Iter 157: loss 0.17737. :  70%|██████████████████████████████▏            | 157/224 [01:33<00:48,  1.37it/s]
Epoch 13 Iter 158: loss 0.17216. :  70%|██████████████████████████████▏            | 157/224 [01:34<00:48,  1.37it/s]
Epoch 13 Iter 158: loss 0.17216. :  71%|██████████████████████████████▎            | 158/224 [01:34<00:48,  1.35it/s]
Epoch 13 Iter 159: loss 0.17341. :  71%|██████████████████████████████▎            | 158/224 [01:35<00:48,  1.35it/s]
Epoch 13 Iter 159: loss 0.17341. :  71%|██████████████████████████████▌            | 159/224 [01:35<00:48,  1.33it/s]
Epoch 13 Iter 160: loss 0.18156. :  71%|██████████████████████████████▌            | 159/224 [01:36<00:48,  1.33it/s]
Epoch 13 Iter 160: loss 0.18156. :  71%|██████████████████████████████▋            | 160/224 [01:36<00:48,  1.32it/s]
Epoch 13 Iter 161: loss 0.17977. :  71%|██████████████████████████████▋            | 160/224 [01:36<00:48,  1.32it/s]
Epoch 13 Iter 161: loss 0.17977. :  72%|██████████████████████████████▉            | 161/224 [01:36<00:44,  1.41it/s]
Epoch 13 Iter 162: loss 0.18882. :  72%|██████████████████████████████▉            | 161/224 [01:37<00:44,  1.41it/s]
Epoch 13 Iter 162: loss 0.18882. :  72%|███████████████████████████████            | 162/224 [01:37<00:41,  1.51it/s]
Epoch 13 Iter 163: loss 0.16713. :  72%|███████████████████████████████            | 162/224 [01:37<00:41,  1.51it/s]
Epoch 13 Iter 163: loss 0.16713. :  73%|███████████████████████████████▎           | 163/224 [01:37<00:37,  1.61it/s]
Epoch 13 Iter 164: loss 0.19763. :  73%|███████████████████████████████▎           | 163/224 [01:38<00:37,  1.61it/s]
Epoch 13 Iter 164: loss 0.19763. :  73%|███████████████████████████████▍           | 164/224 [01:38<00:39,  1.51it/s]
Epoch 13 Iter 165: loss 0.19371. :  73%|███████████████████████████████▍           | 164/224 [01:39<00:39,  1.51it/s]
Epoch 13 Iter 165: loss 0.19371. :  74%|███████████████████████████████▋           | 165/224 [01:39<00:38,  1.54it/s]
Epoch 13 Iter 166: loss 0.16897. :  74%|███████████████████████████████▋           | 165/224 [01:39<00:38,  1.54it/s]
Epoch 13 Iter 166: loss 0.16897. :  74%|███████████████████████████████▊           | 166/224 [01:39<00:36,  1.60it/s]
Epoch 13 Iter 167: loss 0.17941. :  74%|███████████████████████████████▊           | 166/224 [01:40<00:36,  1.60it/s]
Epoch 13 Iter 167: loss 0.17941. :  75%|████████████████████████████████           | 167/224 [01:40<00:34,  1.67it/s]
Epoch 13 Iter 168: loss 0.18353. :  75%|████████████████████████████████           | 167/224 [01:40<00:34,  1.67it/s]
Epoch 13 Iter 168: loss 0.18353. :  75%|████████████████████████████████▎          | 168/224 [01:40<00:32,  1.72it/s]
Epoch 13 Iter 169: loss 0.18810. :  75%|████████████████████████████████▎          | 168/224 [01:41<00:32,  1.72it/s]
Epoch 13 Iter 169: loss 0.18810. :  75%|████████████████████████████████▍          | 169/224 [01:41<00:31,  1.75it/s]
Epoch 13 Iter 170: loss 0.18406. :  75%|████████████████████████████████▍          | 169/224 [01:42<00:31,  1.75it/s]
Epoch 13 Iter 170: loss 0.18406. :  76%|████████████████████████████████▋          | 170/224 [01:42<00:32,  1.67it/s]
Epoch 13 Iter 171: loss 0.18000. :  76%|████████████████████████████████▋          | 170/224 [01:42<00:32,  1.67it/s]
Epoch 13 Iter 171: loss 0.18000. :  76%|████████████████████████████████▊          | 171/224 [01:42<00:31,  1.71it/s]
Epoch 13 Iter 172: loss 0.17549. :  76%|████████████████████████████████▊          | 171/224 [01:43<00:31,  1.71it/s]
Epoch 13 Iter 172: loss 0.17549. :  77%|█████████████████████████████████          | 172/224 [01:43<00:33,  1.56it/s]
Epoch 13 Iter 173: loss 0.18726. :  77%|█████████████████████████████████          | 172/224 [01:44<00:33,  1.56it/s]
Epoch 13 Iter 173: loss 0.18726. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:32,  1.56it/s]
Epoch 13 Iter 174: loss 0.18207. :  77%|█████████████████████████████████▏         | 173/224 [01:44<00:32,  1.56it/s]
Epoch 13 Iter 174: loss 0.18207. :  78%|█████████████████████████████████▍         | 174/224 [01:44<00:30,  1.64it/s]
Epoch 13 Iter 175: loss 0.20062. :  78%|█████████████████████████████████▍         | 174/224 [01:45<00:30,  1.64it/s]
Epoch 13 Iter 175: loss 0.20062. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:30,  1.58it/s]
Epoch 13 Iter 176: loss 0.16756. :  78%|█████████████████████████████████▌         | 175/224 [01:45<00:30,  1.58it/s]
Epoch 13 Iter 176: loss 0.16756. :  79%|█████████████████████████████████▊         | 176/224 [01:45<00:29,  1.61it/s]
Epoch 13 Iter 177: loss 0.17571. :  79%|█████████████████████████████████▊         | 176/224 [01:46<00:29,  1.61it/s]
Epoch 13 Iter 177: loss 0.17571. :  79%|█████████████████████████████████▉         | 177/224 [01:46<00:31,  1.50it/s]
Epoch 13 Iter 178: loss 0.18467. :  79%|█████████████████████████████████▉         | 177/224 [01:47<00:31,  1.50it/s]
Epoch 13 Iter 178: loss 0.18467. :  79%|██████████████████████████████████▏        | 178/224 [01:47<00:32,  1.42it/s]
Epoch 13 Iter 179: loss 0.17147. :  79%|██████████████████████████████████▏        | 178/224 [01:48<00:32,  1.42it/s]
Epoch 13 Iter 179: loss 0.17147. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:32,  1.39it/s]
Epoch 13 Iter 180: loss 0.19008. :  80%|██████████████████████████████████▎        | 179/224 [01:48<00:32,  1.39it/s]
Epoch 13 Iter 180: loss 0.19008. :  80%|██████████████████████████████████▌        | 180/224 [01:48<00:32,  1.36it/s]
Epoch 13 Iter 181: loss 0.17645. :  80%|██████████████████████████████████▌        | 180/224 [01:49<00:32,  1.36it/s]
Epoch 13 Iter 181: loss 0.17645. :  81%|██████████████████████████████████▋        | 181/224 [01:49<00:31,  1.34it/s]
Epoch 13 Iter 182: loss 0.18356. :  81%|██████████████████████████████████▋        | 181/224 [01:50<00:31,  1.34it/s]
Epoch 13 Iter 182: loss 0.18356. :  81%|██████████████████████████████████▉        | 182/224 [01:50<00:28,  1.45it/s]
Epoch 13 Iter 183: loss 0.18495. :  81%|██████████████████████████████████▉        | 182/224 [01:50<00:28,  1.45it/s]
Epoch 13 Iter 183: loss 0.18495. :  82%|███████████████████████████████████▏       | 183/224 [01:50<00:26,  1.53it/s]
Epoch 13 Iter 184: loss 0.17716. :  82%|███████████████████████████████████▏       | 183/224 [01:51<00:26,  1.53it/s]
Epoch 13 Iter 184: loss 0.17716. :  82%|███████████████████████████████████▎       | 184/224 [01:51<00:25,  1.60it/s]
Epoch 13 Iter 185: loss 0.18780. :  82%|███████████████████████████████████▎       | 184/224 [01:52<00:25,  1.60it/s]
Epoch 13 Iter 185: loss 0.18780. :  83%|███████████████████████████████████▌       | 185/224 [01:52<00:26,  1.49it/s]
Epoch 13 Iter 186: loss 0.20886. :  83%|███████████████████████████████████▌       | 185/224 [01:52<00:26,  1.49it/s]
Epoch 13 Iter 186: loss 0.20886. :  83%|███████████████████████████████████▋       | 186/224 [01:52<00:24,  1.54it/s]
Epoch 13 Iter 187: loss 0.17478. :  83%|███████████████████████████████████▋       | 186/224 [01:53<00:24,  1.54it/s]
Epoch 13 Iter 187: loss 0.17478. :  83%|███████████████████████████████████▉       | 187/224 [01:53<00:22,  1.63it/s]
Epoch 13 Iter 188: loss 0.18352. :  83%|███████████████████████████████████▉       | 187/224 [01:53<00:22,  1.63it/s]
Epoch 13 Iter 188: loss 0.18352. :  84%|████████████████████████████████████       | 188/224 [01:53<00:22,  1.63it/s]
Epoch 13 Iter 189: loss 0.19957. :  84%|████████████████████████████████████       | 188/224 [01:54<00:22,  1.63it/s]
Epoch 13 Iter 189: loss 0.19957. :  84%|████████████████████████████████████▎      | 189/224 [01:54<00:20,  1.68it/s]
Epoch 13 Iter 190: loss 0.17910. :  84%|████████████████████████████████████▎      | 189/224 [01:55<00:20,  1.68it/s]
Epoch 13 Iter 190: loss 0.17910. :  85%|████████████████████████████████████▍      | 190/224 [01:55<00:20,  1.63it/s]
Epoch 13 Iter 191: loss 0.18500. :  85%|████████████████████████████████████▍      | 190/224 [01:55<00:20,  1.63it/s]
Epoch 13 Iter 191: loss 0.18500. :  85%|████████████████████████████████████▋      | 191/224 [01:55<00:20,  1.64it/s]
Epoch 13 Iter 192: loss 0.17281. :  85%|████████████████████████████████████▋      | 191/224 [01:56<00:20,  1.64it/s]
Epoch 13 Iter 192: loss 0.17281. :  86%|████████████████████████████████████▊      | 192/224 [01:56<00:21,  1.52it/s]
Epoch 13 Iter 193: loss 0.16641. :  86%|████████████████████████████████████▊      | 192/224 [01:57<00:21,  1.52it/s]
Epoch 13 Iter 193: loss 0.16641. :  86%|█████████████████████████████████████      | 193/224 [01:57<00:21,  1.44it/s]
Epoch 13 Iter 194: loss 0.18691. :  86%|█████████████████████████████████████      | 193/224 [01:58<00:21,  1.44it/s]
Epoch 13 Iter 194: loss 0.18691. :  87%|█████████████████████████████████████▏     | 194/224 [01:58<00:21,  1.39it/s]
Epoch 13 Iter 195: loss 0.17101. :  87%|█████████████████████████████████████▏     | 194/224 [01:58<00:21,  1.39it/s]
Epoch 13 Iter 195: loss 0.17101. :  87%|█████████████████████████████████████▍     | 195/224 [01:58<00:21,  1.35it/s]
Epoch 13 Iter 196: loss 0.18941. :  87%|█████████████████████████████████████▍     | 195/224 [01:59<00:21,  1.35it/s]
Epoch 13 Iter 196: loss 0.18941. :  88%|█████████████████████████████████████▋     | 196/224 [01:59<00:21,  1.33it/s]
Epoch 13 Iter 197: loss 0.18156. :  88%|█████████████████████████████████████▋     | 196/224 [02:00<00:21,  1.33it/s]
Epoch 13 Iter 197: loss 0.18156. :  88%|█████████████████████████████████████▊     | 197/224 [02:00<00:20,  1.32it/s]
Epoch 13 Iter 198: loss 0.19347. :  88%|█████████████████████████████████████▊     | 197/224 [02:01<00:20,  1.32it/s]
Epoch 13 Iter 198: loss 0.19347. :  88%|██████████████████████████████████████     | 198/224 [02:01<00:19,  1.30it/s]
Epoch 13 Iter 199: loss 0.18180. :  88%|██████████████████████████████████████     | 198/224 [02:01<00:19,  1.30it/s]
Epoch 13 Iter 199: loss 0.18180. :  89%|██████████████████████████████████████▏    | 199/224 [02:01<00:19,  1.30it/s]
Epoch 13 Iter 200: loss 0.18417. :  89%|██████████████████████████████████████▏    | 199/224 [02:02<00:19,  1.30it/s]
Epoch 13 Iter 200: loss 0.18417. :  89%|██████████████████████████████████████▍    | 200/224 [02:02<00:18,  1.31it/s]
Epoch 13 Iter 201: loss 0.15739. :  89%|██████████████████████████████████████▍    | 200/224 [02:03<00:18,  1.31it/s]
Epoch 13 Iter 201: loss 0.15739. :  90%|██████████████████████████████████████▌    | 201/224 [02:03<00:16,  1.42it/s]
Epoch 13 Iter 202: loss 0.17676. :  90%|██████████████████████████████████████▌    | 201/224 [02:03<00:16,  1.42it/s]
Epoch 13 Iter 202: loss 0.17676. :  90%|██████████████████████████████████████▊    | 202/224 [02:03<00:15,  1.46it/s]
Epoch 13 Iter 203: loss 0.16208. :  90%|██████████████████████████████████████▊    | 202/224 [02:04<00:15,  1.46it/s]
Epoch 13 Iter 203: loss 0.16208. :  91%|██████████████████████████████████████▉    | 203/224 [02:04<00:13,  1.56it/s]
Epoch 13 Iter 204: loss 0.19713. :  91%|██████████████████████████████████████▉    | 203/224 [02:05<00:13,  1.56it/s]
Epoch 13 Iter 204: loss 0.19713. :  91%|███████████████████████████████████████▏   | 204/224 [02:05<00:12,  1.60it/s]
Epoch 13 Iter 205: loss 0.19331. :  91%|███████████████████████████████████████▏   | 204/224 [02:05<00:12,  1.60it/s]
Epoch 13 Iter 205: loss 0.19331. :  92%|███████████████████████████████████████▎   | 205/224 [02:05<00:11,  1.66it/s]
Epoch 13 Iter 206: loss 0.20284. :  92%|███████████████████████████████████████▎   | 205/224 [02:06<00:11,  1.66it/s]
Epoch 13 Iter 206: loss 0.20284. :  92%|███████████████████████████████████████▌   | 206/224 [02:06<00:11,  1.64it/s]
Epoch 13 Iter 207: loss 0.18033. :  92%|███████████████████████████████████████▌   | 206/224 [02:06<00:11,  1.64it/s]
Epoch 13 Iter 207: loss 0.18033. :  92%|███████████████████████████████████████▋   | 207/224 [02:06<00:10,  1.67it/s]
Epoch 13 Iter 208: loss 0.16825. :  92%|███████████████████████████████████████▋   | 207/224 [02:07<00:10,  1.67it/s]
Epoch 13 Iter 208: loss 0.16825. :  93%|███████████████████████████████████████▉   | 208/224 [02:07<00:09,  1.67it/s]
Epoch 13 Iter 209: loss 0.17494. :  93%|███████████████████████████████████████▉   | 208/224 [02:08<00:09,  1.67it/s]
Epoch 13 Iter 209: loss 0.17494. :  93%|████████████████████████████████████████   | 209/224 [02:08<00:09,  1.63it/s]
Epoch 13 Iter 210: loss 0.17848. :  93%|████████████████████████████████████████   | 209/224 [02:08<00:09,  1.63it/s]
Epoch 13 Iter 210: loss 0.17848. :  94%|████████████████████████████████████████▎  | 210/224 [02:08<00:09,  1.52it/s]
Epoch 13 Iter 211: loss 0.18566. :  94%|████████████████████████████████████████▎  | 210/224 [02:09<00:09,  1.52it/s]
Epoch 13 Iter 211: loss 0.18566. :  94%|████████████████████████████████████████▌  | 211/224 [02:09<00:09,  1.44it/s]
Epoch 13 Iter 212: loss 0.20227. :  94%|████████████████████████████████████████▌  | 211/224 [02:10<00:09,  1.44it/s]
Epoch 13 Iter 212: loss 0.20227. :  95%|████████████████████████████████████████▋  | 212/224 [02:10<00:08,  1.36it/s]
Epoch 13 Iter 213: loss 0.18228. :  95%|████████████████████████████████████████▋  | 212/224 [02:10<00:08,  1.36it/s]
Epoch 13 Iter 213: loss 0.18228. :  95%|████████████████████████████████████████▉  | 213/224 [02:10<00:07,  1.47it/s]
Epoch 13 Iter 214: loss 0.18082. :  95%|████████████████████████████████████████▉  | 213/224 [02:11<00:07,  1.47it/s]
Epoch 13 Iter 214: loss 0.18082. :  96%|█████████████████████████████████████████  | 214/224 [02:11<00:06,  1.56it/s]
Epoch 13 Iter 215: loss 0.17754. :  96%|█████████████████████████████████████████  | 214/224 [02:12<00:06,  1.56it/s]
Epoch 13 Iter 215: loss 0.17754. :  96%|█████████████████████████████████████████▎ | 215/224 [02:12<00:05,  1.64it/s]
Epoch 13 Iter 216: loss 0.15869. :  96%|█████████████████████████████████████████▎ | 215/224 [02:12<00:05,  1.64it/s]
Epoch 13 Iter 216: loss 0.15869. :  96%|█████████████████████████████████████████▍ | 216/224 [02:12<00:04,  1.70it/s]
Epoch 13 Iter 217: loss 0.18148. :  96%|█████████████████████████████████████████▍ | 216/224 [02:13<00:04,  1.70it/s]
Epoch 13 Iter 217: loss 0.18148. :  97%|█████████████████████████████████████████▋ | 217/224 [02:13<00:03,  1.76it/s]
Epoch 13 Iter 218: loss 0.18472. :  97%|█████████████████████████████████████████▋ | 217/224 [02:13<00:03,  1.76it/s]
Epoch 13 Iter 218: loss 0.18472. :  97%|█████████████████████████████████████████▊ | 218/224 [02:13<00:03,  1.75it/s]
Epoch 13 Iter 219: loss 0.18928. :  97%|█████████████████████████████████████████▊ | 218/224 [02:14<00:03,  1.75it/s]
Epoch 13 Iter 219: loss 0.18928. :  98%|██████████████████████████████████████████ | 219/224 [02:14<00:02,  1.78it/s]
Epoch 13 Iter 220: loss 0.17082. :  98%|██████████████████████████████████████████ | 219/224 [02:14<00:02,  1.78it/s]
Epoch 13 Iter 220: loss 0.17082. :  98%|██████████████████████████████████████████▏| 220/224 [02:14<00:02,  1.59it/s]
Epoch 13 Iter 221: loss 0.17107. :  98%|██████████████████████████████████████████▏| 220/224 [02:15<00:02,  1.59it/s]
Epoch 13 Iter 221: loss 0.17107. :  99%|██████████████████████████████████████████▍| 221/224 [02:15<00:02,  1.48it/s]
Epoch 13 Iter 222: loss 0.18018. :  99%|██████████████████████████████████████████▍| 221/224 [02:16<00:02,  1.48it/s]
Epoch 13 Iter 222: loss 0.18018. :  99%|██████████████████████████████████████████▌| 222/224 [02:16<00:01,  1.56it/s]
Epoch 13 Iter 223: loss 0.17002. :  99%|██████████████████████████████████████████▌| 222/224 [02:16<00:01,  1.56it/s]
Epoch 13 Iter 223: loss 0.17002. : 100%|██████████████████████████████████████████▊| 223/224 [02:16<00:00,  1.56it/s]
Epoch 13 Iter 224: loss 0.17539. : 100%|██████████████████████████████████████████▊| 223/224 [02:17<00:00,  1.56it/s]
Epoch 13 Iter 224: loss 0.17539. : 100%|███████████████████████████████████████████| 224/224 [02:17<00:00,  1.53it/s]
Epoch 13 Iter 224: loss 0.17539. : 100%|███████████████████████████████████████████| 224/224 [02:17<00:00,  1.63it/s]

    Train loss: 0.17849
    Valid loss: 0.1807
       Valid loss recons: 0.17456
       Valid loss KL-D:   61.34498
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.16791. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 14 Iter 1: loss 0.16791. :   0%|▏                                              | 1/224 [00:00<03:00,  1.23it/s]
Epoch 14 Iter 2: loss 0.17212. :   0%|▏                                              | 1/224 [00:01<03:00,  1.23it/s]
Epoch 14 Iter 2: loss 0.17212. :   1%|▍                                              | 2/224 [00:01<02:52,  1.28it/s]
Epoch 14 Iter 3: loss 0.16536. :   1%|▍                                              | 2/224 [00:02<02:52,  1.28it/s]
Epoch 14 Iter 3: loss 0.16536. :   1%|▋                                              | 3/224 [00:02<02:43,  1.35it/s]
Epoch 14 Iter 4: loss 0.17494. :   1%|▋                                              | 3/224 [00:02<02:43,  1.35it/s]
Epoch 14 Iter 4: loss 0.17494. :   2%|▊                                              | 4/224 [00:02<02:38,  1.38it/s]
Epoch 14 Iter 5: loss 0.21136. :   2%|▊                                              | 4/224 [00:03<02:38,  1.38it/s]
Epoch 14 Iter 5: loss 0.21136. :   2%|█                                              | 5/224 [00:03<02:25,  1.51it/s]
Epoch 14 Iter 6: loss 0.17778. :   2%|█                                              | 5/224 [00:04<02:25,  1.51it/s]
Epoch 14 Iter 6: loss 0.17778. :   3%|█▎                                             | 6/224 [00:04<02:14,  1.62it/s]
Epoch 14 Iter 7: loss 0.19741. :   3%|█▎                                             | 6/224 [00:04<02:14,  1.62it/s]
Epoch 14 Iter 7: loss 0.19741. :   3%|█▍                                             | 7/224 [00:04<02:10,  1.66it/s]
Epoch 14 Iter 8: loss 0.17806. :   3%|█▍                                             | 7/224 [00:05<02:10,  1.66it/s]
Epoch 14 Iter 8: loss 0.17806. :   4%|█▋                                             | 8/224 [00:05<02:19,  1.55it/s]
Epoch 14 Iter 9: loss 0.17123. :   4%|█▋                                             | 8/224 [00:05<02:19,  1.55it/s]
Epoch 14 Iter 9: loss 0.17123. :   4%|█▉                                             | 9/224 [00:05<02:11,  1.63it/s]
Epoch 14 Iter 10: loss 0.18952. :   4%|█▊                                            | 9/224 [00:06<02:11,  1.63it/s]
Epoch 14 Iter 10: loss 0.18952. :   4%|██                                           | 10/224 [00:06<02:07,  1.67it/s]
Epoch 14 Iter 11: loss 0.17053. :   4%|██                                           | 10/224 [00:06<02:07,  1.67it/s]
Epoch 14 Iter 11: loss 0.17053. :   5%|██▏                                          | 11/224 [00:06<02:03,  1.73it/s]
Epoch 14 Iter 12: loss 0.17066. :   5%|██▏                                          | 11/224 [00:07<02:03,  1.73it/s]
Epoch 14 Iter 12: loss 0.17066. :   5%|██▍                                          | 12/224 [00:07<02:04,  1.71it/s]
Epoch 14 Iter 13: loss 0.17605. :   5%|██▍                                          | 12/224 [00:08<02:04,  1.71it/s]
Epoch 14 Iter 13: loss 0.17605. :   6%|██▌                                          | 13/224 [00:08<02:01,  1.74it/s]
Epoch 14 Iter 14: loss 0.17695. :   6%|██▌                                          | 13/224 [00:08<02:01,  1.74it/s]
Epoch 14 Iter 14: loss 0.17695. :   6%|██▊                                          | 14/224 [00:08<02:04,  1.69it/s]
Epoch 14 Iter 15: loss 0.17451. :   6%|██▊                                          | 14/224 [00:09<02:04,  1.69it/s]
Epoch 14 Iter 15: loss 0.17451. :   7%|███                                          | 15/224 [00:09<02:10,  1.61it/s]
Epoch 14 Iter 16: loss 0.20112. :   7%|███                                          | 15/224 [00:10<02:10,  1.61it/s]
Epoch 14 Iter 16: loss 0.20112. :   7%|███▏                                         | 16/224 [00:10<02:17,  1.51it/s]
Epoch 14 Iter 17: loss 0.17676. :   7%|███▏                                         | 16/224 [00:10<02:17,  1.51it/s]
Epoch 14 Iter 17: loss 0.17676. :   8%|███▍                                         | 17/224 [00:10<02:09,  1.60it/s]
Epoch 14 Iter 18: loss 0.18779. :   8%|███▍                                         | 17/224 [00:11<02:09,  1.60it/s]
Epoch 14 Iter 18: loss 0.18779. :   8%|███▌                                         | 18/224 [00:11<02:13,  1.54it/s]
Epoch 14 Iter 19: loss 0.17710. :   8%|███▌                                         | 18/224 [00:12<02:13,  1.54it/s]
Epoch 14 Iter 19: loss 0.17710. :   8%|███▊                                         | 19/224 [00:12<02:09,  1.58it/s]
Epoch 14 Iter 20: loss 0.18307. :   8%|███▊                                         | 19/224 [00:12<02:09,  1.58it/s]
Epoch 14 Iter 20: loss 0.18307. :   9%|████                                         | 20/224 [00:12<02:02,  1.66it/s]
Epoch 14 Iter 21: loss 0.17385. :   9%|████                                         | 20/224 [00:13<02:02,  1.66it/s]
Epoch 14 Iter 21: loss 0.17385. :   9%|████▏                                        | 21/224 [00:13<02:08,  1.58it/s]
Epoch 14 Iter 22: loss 0.17023. :   9%|████▏                                        | 21/224 [00:14<02:08,  1.58it/s]
Epoch 14 Iter 22: loss 0.17023. :  10%|████▍                                        | 22/224 [00:14<02:17,  1.47it/s]
Epoch 14 Iter 23: loss 0.18031. :  10%|████▍                                        | 22/224 [00:14<02:17,  1.47it/s]
Epoch 14 Iter 23: loss 0.18031. :  10%|████▌                                        | 23/224 [00:14<02:08,  1.57it/s]
Epoch 14 Iter 24: loss 0.16768. :  10%|████▌                                        | 23/224 [00:15<02:08,  1.57it/s]
Epoch 14 Iter 24: loss 0.16768. :  11%|████▊                                        | 24/224 [00:15<01:59,  1.67it/s]
Epoch 14 Iter 25: loss 0.19305. :  11%|████▊                                        | 24/224 [00:15<01:59,  1.67it/s]
Epoch 14 Iter 25: loss 0.19305. :  11%|█████                                        | 25/224 [00:15<01:55,  1.73it/s]
Epoch 14 Iter 26: loss 0.15690. :  11%|█████                                        | 25/224 [00:16<01:55,  1.73it/s]
Epoch 14 Iter 26: loss 0.15690. :  12%|█████▏                                       | 26/224 [00:16<01:51,  1.77it/s]
Epoch 14 Iter 27: loss 0.16589. :  12%|█████▏                                       | 26/224 [00:16<01:51,  1.77it/s]
Epoch 14 Iter 27: loss 0.16589. :  12%|█████▍                                       | 27/224 [00:16<01:47,  1.84it/s]
Epoch 14 Iter 28: loss 0.19398. :  12%|█████▍                                       | 27/224 [00:17<01:47,  1.84it/s]
Epoch 14 Iter 28: loss 0.19398. :  12%|█████▋                                       | 28/224 [00:17<01:43,  1.89it/s]
Epoch 14 Iter 29: loss 0.18278. :  12%|█████▋                                       | 28/224 [00:17<01:43,  1.89it/s]
Epoch 14 Iter 29: loss 0.18278. :  13%|█████▊                                       | 29/224 [00:17<01:41,  1.92it/s]
Epoch 14 Iter 30: loss 0.18376. :  13%|█████▊                                       | 29/224 [00:18<01:41,  1.92it/s]
Epoch 14 Iter 30: loss 0.18376. :  13%|██████                                       | 30/224 [00:18<01:39,  1.94it/s]
Epoch 14 Iter 31: loss 0.17664. :  13%|██████                                       | 30/224 [00:18<01:39,  1.94it/s]
Epoch 14 Iter 31: loss 0.17664. :  14%|██████▏                                      | 31/224 [00:18<01:38,  1.96it/s]
Epoch 14 Iter 32: loss 0.17858. :  14%|██████▏                                      | 31/224 [00:19<01:38,  1.96it/s]
Epoch 14 Iter 32: loss 0.17858. :  14%|██████▍                                      | 32/224 [00:19<01:37,  1.97it/s]
Epoch 14 Iter 33: loss 0.18347. :  14%|██████▍                                      | 32/224 [00:19<01:37,  1.97it/s]
Epoch 14 Iter 33: loss 0.18347. :  15%|██████▋                                      | 33/224 [00:19<01:36,  1.98it/s]
Epoch 14 Iter 34: loss 0.19148. :  15%|██████▋                                      | 33/224 [00:20<01:36,  1.98it/s]
Epoch 14 Iter 34: loss 0.19148. :  15%|██████▊                                      | 34/224 [00:20<01:35,  1.99it/s]
Epoch 14 Iter 35: loss 0.17973. :  15%|██████▊                                      | 34/224 [00:20<01:35,  1.99it/s]
Epoch 14 Iter 35: loss 0.17973. :  16%|███████                                      | 35/224 [00:20<01:36,  1.96it/s]
Epoch 14 Iter 36: loss 0.16464. :  16%|███████                                      | 35/224 [00:21<01:36,  1.96it/s]
Epoch 14 Iter 36: loss 0.16464. :  16%|███████▏                                     | 36/224 [00:21<01:35,  1.97it/s]
Epoch 14 Iter 37: loss 0.18011. :  16%|███████▏                                     | 36/224 [00:21<01:35,  1.97it/s]
Epoch 14 Iter 37: loss 0.18011. :  17%|███████▍                                     | 37/224 [00:21<01:34,  1.98it/s]
Epoch 14 Iter 38: loss 0.18481. :  17%|███████▍                                     | 37/224 [00:22<01:34,  1.98it/s]
Epoch 14 Iter 38: loss 0.18481. :  17%|███████▋                                     | 38/224 [00:22<01:34,  1.98it/s]
Epoch 14 Iter 39: loss 0.16267. :  17%|███████▋                                     | 38/224 [00:22<01:34,  1.98it/s]
Epoch 14 Iter 39: loss 0.16267. :  17%|███████▊                                     | 39/224 [00:22<01:33,  1.99it/s]
Epoch 14 Iter 40: loss 0.15973. :  17%|███████▊                                     | 39/224 [00:23<01:33,  1.99it/s]
Epoch 14 Iter 40: loss 0.15973. :  18%|████████                                     | 40/224 [00:23<01:32,  1.99it/s]
Epoch 14 Iter 41: loss 0.14496. :  18%|████████                                     | 40/224 [00:23<01:32,  1.99it/s]
Epoch 14 Iter 41: loss 0.14496. :  18%|████████▏                                    | 41/224 [00:23<01:32,  1.99it/s]
Epoch 14 Iter 42: loss 0.17997. :  18%|████████▏                                    | 41/224 [00:24<01:32,  1.99it/s]
Epoch 14 Iter 42: loss 0.17997. :  19%|████████▍                                    | 42/224 [00:24<01:34,  1.92it/s]
Epoch 14 Iter 43: loss 0.17774. :  19%|████████▍                                    | 42/224 [00:24<01:34,  1.92it/s]
Epoch 14 Iter 43: loss 0.17774. :  19%|████████▋                                    | 43/224 [00:24<01:36,  1.87it/s]
Epoch 14 Iter 44: loss 0.16997. :  19%|████████▋                                    | 43/224 [00:25<01:36,  1.87it/s]
Epoch 14 Iter 44: loss 0.16997. :  20%|████████▊                                    | 44/224 [00:25<01:35,  1.88it/s]
Epoch 14 Iter 45: loss 0.17361. :  20%|████████▊                                    | 44/224 [00:25<01:35,  1.88it/s]
Epoch 14 Iter 45: loss 0.17361. :  20%|█████████                                    | 45/224 [00:25<01:33,  1.92it/s]
Epoch 14 Iter 46: loss 0.16723. :  20%|█████████                                    | 45/224 [00:26<01:33,  1.92it/s]
Epoch 14 Iter 46: loss 0.16723. :  21%|█████████▏                                   | 46/224 [00:26<01:31,  1.94it/s]
Epoch 14 Iter 47: loss 0.18273. :  21%|█████████▏                                   | 46/224 [00:26<01:31,  1.94it/s]
Epoch 14 Iter 47: loss 0.18273. :  21%|█████████▍                                   | 47/224 [00:26<01:31,  1.94it/s]
Epoch 14 Iter 48: loss 0.16251. :  21%|█████████▍                                   | 47/224 [00:27<01:31,  1.94it/s]
Epoch 14 Iter 48: loss 0.16251. :  21%|█████████▋                                   | 48/224 [00:27<01:29,  1.96it/s]
Epoch 14 Iter 49: loss 0.17646. :  21%|█████████▋                                   | 48/224 [00:27<01:29,  1.96it/s]
Epoch 14 Iter 49: loss 0.17646. :  22%|█████████▊                                   | 49/224 [00:27<01:28,  1.97it/s]
Epoch 14 Iter 50: loss 0.18142. :  22%|█████████▊                                   | 49/224 [00:28<01:28,  1.97it/s]
Epoch 14 Iter 50: loss 0.18142. :  22%|██████████                                   | 50/224 [00:28<01:28,  1.97it/s]
Epoch 14 Iter 51: loss 0.17341. :  22%|██████████                                   | 50/224 [00:28<01:28,  1.97it/s]
Epoch 14 Iter 51: loss 0.17341. :  23%|██████████▏                                  | 51/224 [00:28<01:27,  1.97it/s]
Epoch 14 Iter 52: loss 0.16977. :  23%|██████████▏                                  | 51/224 [00:29<01:27,  1.97it/s]
Epoch 14 Iter 52: loss 0.16977. :  23%|██████████▍                                  | 52/224 [00:29<01:26,  1.98it/s]
Epoch 14 Iter 53: loss 0.17851. :  23%|██████████▍                                  | 52/224 [00:29<01:26,  1.98it/s]
Epoch 14 Iter 53: loss 0.17851. :  24%|██████████▋                                  | 53/224 [00:29<01:25,  1.99it/s]
Epoch 14 Iter 54: loss 0.18730. :  24%|██████████▋                                  | 53/224 [00:30<01:25,  1.99it/s]
Epoch 14 Iter 54: loss 0.18730. :  24%|██████████▊                                  | 54/224 [00:30<01:25,  1.98it/s]
Epoch 14 Iter 55: loss 0.18962. :  24%|██████████▊                                  | 54/224 [00:30<01:25,  1.98it/s]
Epoch 14 Iter 55: loss 0.18962. :  25%|███████████                                  | 55/224 [00:30<01:25,  1.97it/s]
Epoch 14 Iter 56: loss 0.18624. :  25%|███████████                                  | 55/224 [00:31<01:25,  1.97it/s]
Epoch 14 Iter 56: loss 0.18624. :  25%|███████████▎                                 | 56/224 [00:31<01:24,  1.99it/s]
Epoch 14 Iter 57: loss 0.19075. :  25%|███████████▎                                 | 56/224 [00:31<01:24,  1.99it/s]
Epoch 14 Iter 57: loss 0.19075. :  25%|███████████▍                                 | 57/224 [00:31<01:26,  1.93it/s]
Epoch 14 Iter 58: loss 0.19479. :  25%|███████████▍                                 | 57/224 [00:32<01:26,  1.93it/s]
Epoch 14 Iter 58: loss 0.19479. :  26%|███████████▋                                 | 58/224 [00:32<01:24,  1.95it/s]
Epoch 14 Iter 59: loss 0.16447. :  26%|███████████▋                                 | 58/224 [00:32<01:24,  1.95it/s]
Epoch 14 Iter 59: loss 0.16447. :  26%|███████████▊                                 | 59/224 [00:32<01:23,  1.97it/s]
Epoch 14 Iter 60: loss 0.17465. :  26%|███████████▊                                 | 59/224 [00:33<01:23,  1.97it/s]
Epoch 14 Iter 60: loss 0.17465. :  27%|████████████                                 | 60/224 [00:33<01:23,  1.97it/s]
Epoch 14 Iter 61: loss 0.17957. :  27%|████████████                                 | 60/224 [00:33<01:23,  1.97it/s]
Epoch 14 Iter 61: loss 0.17957. :  27%|████████████▎                                | 61/224 [00:33<01:22,  1.98it/s]
Epoch 14 Iter 62: loss 0.17041. :  27%|████████████▎                                | 61/224 [00:34<01:22,  1.98it/s]
Epoch 14 Iter 62: loss 0.17041. :  28%|████████████▍                                | 62/224 [00:34<01:21,  1.98it/s]
Epoch 14 Iter 63: loss 0.18612. :  28%|████████████▍                                | 62/224 [00:34<01:21,  1.98it/s]
Epoch 14 Iter 63: loss 0.18612. :  28%|████████████▋                                | 63/224 [00:34<01:21,  1.98it/s]
Epoch 14 Iter 64: loss 0.18524. :  28%|████████████▋                                | 63/224 [00:35<01:21,  1.98it/s]
Epoch 14 Iter 64: loss 0.18524. :  29%|████████████▊                                | 64/224 [00:35<01:22,  1.95it/s]
Epoch 14 Iter 65: loss 0.17983. :  29%|████████████▊                                | 64/224 [00:36<01:22,  1.95it/s]
Epoch 14 Iter 65: loss 0.17983. :  29%|█████████████                                | 65/224 [00:36<01:23,  1.90it/s]
Epoch 14 Iter 66: loss 0.16744. :  29%|█████████████                                | 65/224 [00:36<01:23,  1.90it/s]
Epoch 14 Iter 66: loss 0.16744. :  29%|█████████████▎                               | 66/224 [00:36<01:23,  1.90it/s]
Epoch 14 Iter 67: loss 0.17385. :  29%|█████████████▎                               | 66/224 [00:37<01:23,  1.90it/s]
Epoch 14 Iter 67: loss 0.17385. :  30%|█████████████▍                               | 67/224 [00:37<01:22,  1.91it/s]
Epoch 14 Iter 68: loss 0.16733. :  30%|█████████████▍                               | 67/224 [00:37<01:22,  1.91it/s]
Epoch 14 Iter 68: loss 0.16733. :  30%|█████████████▋                               | 68/224 [00:37<01:20,  1.94it/s]
Epoch 14 Iter 69: loss 0.16859. :  30%|█████████████▋                               | 68/224 [00:38<01:20,  1.94it/s]
Epoch 14 Iter 69: loss 0.16859. :  31%|█████████████▊                               | 69/224 [00:38<01:19,  1.95it/s]
Epoch 14 Iter 70: loss 0.16540. :  31%|█████████████▊                               | 69/224 [00:38<01:19,  1.95it/s]
Epoch 14 Iter 70: loss 0.16540. :  31%|██████████████                               | 70/224 [00:38<01:18,  1.96it/s]
Epoch 14 Iter 71: loss 0.16952. :  31%|██████████████                               | 70/224 [00:39<01:18,  1.96it/s]
Epoch 14 Iter 71: loss 0.16952. :  32%|██████████████▎                              | 71/224 [00:39<01:18,  1.95it/s]
Epoch 14 Iter 72: loss 0.19665. :  32%|██████████████▎                              | 71/224 [00:39<01:18,  1.95it/s]
Epoch 14 Iter 72: loss 0.19665. :  32%|██████████████▍                              | 72/224 [00:39<01:20,  1.90it/s]
Epoch 14 Iter 73: loss 0.16953. :  32%|██████████████▍                              | 72/224 [00:40<01:20,  1.90it/s]
Epoch 14 Iter 73: loss 0.16953. :  33%|██████████████▋                              | 73/224 [00:40<01:20,  1.88it/s]
Epoch 14 Iter 74: loss 0.15444. :  33%|██████████████▋                              | 73/224 [00:40<01:20,  1.88it/s]
Epoch 14 Iter 74: loss 0.15444. :  33%|██████████████▊                              | 74/224 [00:40<01:20,  1.86it/s]
Epoch 14 Iter 75: loss 0.17185. :  33%|██████████████▊                              | 74/224 [00:41<01:20,  1.86it/s]
Epoch 14 Iter 75: loss 0.17185. :  33%|███████████████                              | 75/224 [00:41<01:19,  1.87it/s]
Epoch 14 Iter 76: loss 0.19428. :  33%|███████████████                              | 75/224 [00:41<01:19,  1.87it/s]
Epoch 14 Iter 76: loss 0.19428. :  34%|███████████████▎                             | 76/224 [00:41<01:18,  1.90it/s]
Epoch 14 Iter 77: loss 0.15446. :  34%|███████████████▎                             | 76/224 [00:42<01:18,  1.90it/s]
Epoch 14 Iter 77: loss 0.15446. :  34%|███████████████▍                             | 77/224 [00:42<01:16,  1.91it/s]
Epoch 14 Iter 78: loss 0.18017. :  34%|███████████████▍                             | 77/224 [00:42<01:16,  1.91it/s]
Epoch 14 Iter 78: loss 0.18017. :  35%|███████████████▋                             | 78/224 [00:42<01:17,  1.88it/s]
Epoch 14 Iter 79: loss 0.17705. :  35%|███████████████▋                             | 78/224 [00:43<01:17,  1.88it/s]
Epoch 14 Iter 79: loss 0.17705. :  35%|███████████████▊                             | 79/224 [00:43<01:16,  1.90it/s]
Epoch 14 Iter 80: loss 0.16730. :  35%|███████████████▊                             | 79/224 [00:43<01:16,  1.90it/s]
Epoch 14 Iter 80: loss 0.16730. :  36%|████████████████                             | 80/224 [00:43<01:14,  1.93it/s]
Epoch 14 Iter 81: loss 0.19122. :  36%|████████████████                             | 80/224 [00:44<01:14,  1.93it/s]
Epoch 14 Iter 81: loss 0.19122. :  36%|████████████████▎                            | 81/224 [00:44<01:12,  1.96it/s]
Epoch 14 Iter 82: loss 0.18594. :  36%|████████████████▎                            | 81/224 [00:44<01:12,  1.96it/s]
Epoch 14 Iter 82: loss 0.18594. :  37%|████████████████▍                            | 82/224 [00:44<01:12,  1.95it/s]
Epoch 14 Iter 83: loss 0.18835. :  37%|████████████████▍                            | 82/224 [00:45<01:12,  1.95it/s]
Epoch 14 Iter 83: loss 0.18835. :  37%|████████████████▋                            | 83/224 [00:45<01:11,  1.96it/s]
Epoch 14 Iter 84: loss 0.17540. :  37%|████████████████▋                            | 83/224 [00:45<01:11,  1.96it/s]
Epoch 14 Iter 84: loss 0.17540. :  38%|████████████████▉                            | 84/224 [00:45<01:11,  1.97it/s]
Epoch 14 Iter 85: loss 0.19265. :  38%|████████████████▉                            | 84/224 [00:46<01:11,  1.97it/s]
Epoch 14 Iter 85: loss 0.19265. :  38%|█████████████████                            | 85/224 [00:46<01:10,  1.98it/s]
Epoch 14 Iter 86: loss 0.20471. :  38%|█████████████████                            | 85/224 [00:46<01:10,  1.98it/s]
Epoch 14 Iter 86: loss 0.20471. :  38%|█████████████████▎                           | 86/224 [00:46<01:11,  1.92it/s]
Epoch 14 Iter 87: loss 0.18642. :  38%|█████████████████▎                           | 86/224 [00:47<01:11,  1.92it/s]
Epoch 14 Iter 87: loss 0.18642. :  39%|█████████████████▍                           | 87/224 [00:47<01:11,  1.91it/s]
Epoch 14 Iter 88: loss 0.15684. :  39%|█████████████████▍                           | 87/224 [00:47<01:11,  1.91it/s]
Epoch 14 Iter 88: loss 0.15684. :  39%|█████████████████▋                           | 88/224 [00:47<01:09,  1.95it/s]
Epoch 14 Iter 89: loss 0.16837. :  39%|█████████████████▋                           | 88/224 [00:48<01:09,  1.95it/s]
Epoch 14 Iter 89: loss 0.16837. :  40%|█████████████████▉                           | 89/224 [00:48<01:08,  1.96it/s]
Epoch 14 Iter 90: loss 0.18092. :  40%|█████████████████▉                           | 89/224 [00:48<01:08,  1.96it/s]
Epoch 14 Iter 90: loss 0.18092. :  40%|██████████████████                           | 90/224 [00:48<01:07,  1.98it/s]
Epoch 14 Iter 91: loss 0.19748. :  40%|██████████████████                           | 90/224 [00:49<01:07,  1.98it/s]
Epoch 14 Iter 91: loss 0.19748. :  41%|██████████████████▎                          | 91/224 [00:49<01:06,  1.99it/s]
Epoch 14 Iter 92: loss 0.17960. :  41%|██████████████████▎                          | 91/224 [00:49<01:06,  1.99it/s]
Epoch 14 Iter 92: loss 0.17960. :  41%|██████████████████▍                          | 92/224 [00:49<01:06,  1.99it/s]
Epoch 14 Iter 93: loss 0.17151. :  41%|██████████████████▍                          | 92/224 [00:50<01:06,  1.99it/s]
Epoch 14 Iter 93: loss 0.17151. :  42%|██████████████████▋                          | 93/224 [00:50<01:06,  1.98it/s]
Epoch 14 Iter 94: loss 0.18125. :  42%|██████████████████▋                          | 93/224 [00:51<01:06,  1.98it/s]
Epoch 14 Iter 94: loss 0.18125. :  42%|██████████████████▉                          | 94/224 [00:51<01:05,  1.99it/s]
Epoch 14 Iter 95: loss 0.17899. :  42%|██████████████████▉                          | 94/224 [00:51<01:05,  1.99it/s]
Epoch 14 Iter 95: loss 0.17899. :  42%|███████████████████                          | 95/224 [00:51<01:04,  1.99it/s]
Epoch 14 Iter 96: loss 0.18149. :  42%|███████████████████                          | 95/224 [00:52<01:04,  1.99it/s]
Epoch 14 Iter 96: loss 0.18149. :  43%|███████████████████▎                         | 96/224 [00:52<01:04,  2.00it/s]
Epoch 14 Iter 97: loss 0.18348. :  43%|███████████████████▎                         | 96/224 [00:52<01:04,  2.00it/s]
Epoch 14 Iter 97: loss 0.18348. :  43%|███████████████████▍                         | 97/224 [00:52<01:04,  1.97it/s]
Epoch 14 Iter 98: loss 0.19527. :  43%|███████████████████▍                         | 97/224 [00:53<01:04,  1.97it/s]
Epoch 14 Iter 98: loss 0.19527. :  44%|███████████████████▋                         | 98/224 [00:53<01:03,  1.97it/s]
Epoch 14 Iter 99: loss 0.16632. :  44%|███████████████████▋                         | 98/224 [00:53<01:03,  1.97it/s]
Epoch 14 Iter 99: loss 0.16632. :  44%|███████████████████▉                         | 99/224 [00:53<01:03,  1.98it/s]
Epoch 14 Iter 100: loss 0.20299. :  44%|███████████████████▍                        | 99/224 [00:54<01:03,  1.98it/s]
Epoch 14 Iter 100: loss 0.20299. :  45%|███████████████████▏                       | 100/224 [00:54<01:02,  2.00it/s]
Epoch 14 Iter 101: loss 0.19402. :  45%|███████████████████▏                       | 100/224 [00:54<01:02,  2.00it/s]
Epoch 14 Iter 101: loss 0.19402. :  45%|███████████████████▍                       | 101/224 [00:54<01:02,  1.97it/s]
Epoch 14 Iter 102: loss 0.19575. :  45%|███████████████████▍                       | 101/224 [00:55<01:02,  1.97it/s]
Epoch 14 Iter 102: loss 0.19575. :  46%|███████████████████▌                       | 102/224 [00:55<01:01,  1.97it/s]
Epoch 14 Iter 103: loss 0.17045. :  46%|███████████████████▌                       | 102/224 [00:55<01:01,  1.97it/s]
Epoch 14 Iter 103: loss 0.17045. :  46%|███████████████████▊                       | 103/224 [00:55<01:01,  1.98it/s]
Epoch 14 Iter 104: loss 0.17781. :  46%|███████████████████▊                       | 103/224 [00:56<01:01,  1.98it/s]
Epoch 14 Iter 104: loss 0.17781. :  46%|███████████████████▉                       | 104/224 [00:56<01:00,  1.99it/s]
Epoch 14 Iter 105: loss 0.17149. :  46%|███████████████████▉                       | 104/224 [00:56<01:00,  1.99it/s]
Epoch 14 Iter 105: loss 0.17149. :  47%|████████████████████▏                      | 105/224 [00:56<01:00,  1.98it/s]
Epoch 14 Iter 106: loss 0.16748. :  47%|████████████████████▏                      | 105/224 [00:57<01:00,  1.98it/s]
Epoch 14 Iter 106: loss 0.16748. :  47%|████████████████████▎                      | 106/224 [00:57<00:59,  1.99it/s]
Epoch 14 Iter 107: loss 0.15705. :  47%|████████████████████▎                      | 106/224 [00:57<00:59,  1.99it/s]
Epoch 14 Iter 107: loss 0.15705. :  48%|████████████████████▌                      | 107/224 [00:57<00:58,  1.99it/s]
Epoch 14 Iter 108: loss 0.17332. :  48%|████████████████████▌                      | 107/224 [00:58<00:58,  1.99it/s]
Epoch 14 Iter 108: loss 0.17332. :  48%|████████████████████▋                      | 108/224 [00:58<00:58,  1.99it/s]
Epoch 14 Iter 109: loss 0.18305. :  48%|████████████████████▋                      | 108/224 [00:58<00:58,  1.99it/s]
Epoch 14 Iter 109: loss 0.18305. :  49%|████████████████████▉                      | 109/224 [00:58<00:57,  1.99it/s]
Epoch 14 Iter 110: loss 0.18364. :  49%|████████████████████▉                      | 109/224 [00:59<00:57,  1.99it/s]
Epoch 14 Iter 110: loss 0.18364. :  49%|█████████████████████                      | 110/224 [00:59<00:57,  2.00it/s]
Epoch 14 Iter 111: loss 0.19963. :  49%|█████████████████████                      | 110/224 [00:59<00:57,  2.00it/s]
Epoch 14 Iter 111: loss 0.19963. :  50%|█████████████████████▎                     | 111/224 [00:59<00:56,  2.01it/s]
Epoch 14 Iter 112: loss 0.21389. :  50%|█████████████████████▎                     | 111/224 [01:00<00:56,  2.01it/s]
Epoch 14 Iter 112: loss 0.21389. :  50%|█████████████████████▌                     | 112/224 [01:00<00:55,  2.02it/s]
Epoch 14 Iter 113: loss 0.17942. :  50%|█████████████████████▌                     | 112/224 [01:00<00:55,  2.02it/s]
Epoch 14 Iter 113: loss 0.17942. :  50%|█████████████████████▋                     | 113/224 [01:00<00:55,  2.01it/s]
Epoch 14 Iter 114: loss 0.16068. :  50%|█████████████████████▋                     | 113/224 [01:01<00:55,  2.01it/s]
Epoch 14 Iter 114: loss 0.16068. :  51%|█████████████████████▉                     | 114/224 [01:01<00:54,  2.01it/s]
Epoch 14 Iter 115: loss 0.18351. :  51%|█████████████████████▉                     | 114/224 [01:01<00:54,  2.01it/s]
Epoch 14 Iter 115: loss 0.18351. :  51%|██████████████████████                     | 115/224 [01:01<00:53,  2.02it/s]
Epoch 14 Iter 116: loss 0.16729. :  51%|██████████████████████                     | 115/224 [01:02<00:53,  2.02it/s]
Epoch 14 Iter 116: loss 0.16729. :  52%|██████████████████████▎                    | 116/224 [01:02<00:53,  2.02it/s]
Epoch 14 Iter 117: loss 0.18741. :  52%|██████████████████████▎                    | 116/224 [01:02<00:53,  2.02it/s]
Epoch 14 Iter 117: loss 0.18741. :  52%|██████████████████████▍                    | 117/224 [01:02<00:53,  2.01it/s]
Epoch 14 Iter 118: loss 0.19527. :  52%|██████████████████████▍                    | 117/224 [01:03<00:53,  2.01it/s]
Epoch 14 Iter 118: loss 0.19527. :  53%|██████████████████████▋                    | 118/224 [01:03<00:52,  2.01it/s]
Epoch 14 Iter 119: loss 0.17658. :  53%|██████████████████████▋                    | 118/224 [01:03<00:52,  2.01it/s]
Epoch 14 Iter 119: loss 0.17658. :  53%|██████████████████████▊                    | 119/224 [01:03<00:52,  2.02it/s]
Epoch 14 Iter 120: loss 0.20903. :  53%|██████████████████████▊                    | 119/224 [01:04<00:52,  2.02it/s]
Epoch 14 Iter 120: loss 0.20903. :  54%|███████████████████████                    | 120/224 [01:04<00:51,  2.01it/s]
Epoch 14 Iter 121: loss 0.17245. :  54%|███████████████████████                    | 120/224 [01:04<00:51,  2.01it/s]
Epoch 14 Iter 121: loss 0.17245. :  54%|███████████████████████▏                   | 121/224 [01:04<00:51,  2.01it/s]
Epoch 14 Iter 122: loss 0.18041. :  54%|███████████████████████▏                   | 121/224 [01:05<00:51,  2.01it/s]
Epoch 14 Iter 122: loss 0.18041. :  54%|███████████████████████▍                   | 122/224 [01:05<00:54,  1.87it/s]
Epoch 14 Iter 123: loss 0.16644. :  54%|███████████████████████▍                   | 122/224 [01:05<00:54,  1.87it/s]
Epoch 14 Iter 123: loss 0.16644. :  55%|███████████████████████▌                   | 123/224 [01:05<01:00,  1.67it/s]
Epoch 14 Iter 124: loss 0.19665. :  55%|███████████████████████▌                   | 123/224 [01:06<01:00,  1.67it/s]
Epoch 14 Iter 124: loss 0.19665. :  55%|███████████████████████▊                   | 124/224 [01:06<00:58,  1.71it/s]
Epoch 14 Iter 125: loss 0.17392. :  55%|███████████████████████▊                   | 124/224 [01:06<00:58,  1.71it/s]
Epoch 14 Iter 125: loss 0.17392. :  56%|███████████████████████▉                   | 125/224 [01:06<00:55,  1.80it/s]
Epoch 14 Iter 126: loss 0.16752. :  56%|███████████████████████▉                   | 125/224 [01:07<00:55,  1.80it/s]
Epoch 14 Iter 126: loss 0.16752. :  56%|████████████████████████▏                  | 126/224 [01:07<00:52,  1.87it/s]
Epoch 14 Iter 127: loss 0.16727. :  56%|████████████████████████▏                  | 126/224 [01:07<00:52,  1.87it/s]
Epoch 14 Iter 127: loss 0.16727. :  57%|████████████████████████▍                  | 127/224 [01:07<00:50,  1.92it/s]
Epoch 14 Iter 128: loss 0.17688. :  57%|████████████████████████▍                  | 127/224 [01:08<00:50,  1.92it/s]
Epoch 14 Iter 128: loss 0.17688. :  57%|████████████████████████▌                  | 128/224 [01:08<00:49,  1.95it/s]
Epoch 14 Iter 129: loss 0.17029. :  57%|████████████████████████▌                  | 128/224 [01:08<00:49,  1.95it/s]
Epoch 14 Iter 129: loss 0.17029. :  58%|████████████████████████▊                  | 129/224 [01:08<00:48,  1.97it/s]
Epoch 14 Iter 130: loss 0.16015. :  58%|████████████████████████▊                  | 129/224 [01:09<00:48,  1.97it/s]
Epoch 14 Iter 130: loss 0.16015. :  58%|████████████████████████▉                  | 130/224 [01:09<00:47,  1.98it/s]
Epoch 14 Iter 131: loss 0.15772. :  58%|████████████████████████▉                  | 130/224 [01:09<00:47,  1.98it/s]
Epoch 14 Iter 131: loss 0.15772. :  58%|█████████████████████████▏                 | 131/224 [01:09<00:46,  1.99it/s]
Epoch 14 Iter 132: loss 0.20714. :  58%|█████████████████████████▏                 | 131/224 [01:10<00:46,  1.99it/s]
Epoch 14 Iter 132: loss 0.20714. :  59%|█████████████████████████▎                 | 132/224 [01:10<00:46,  1.99it/s]
Epoch 14 Iter 133: loss 0.17074. :  59%|█████████████████████████▎                 | 132/224 [01:10<00:46,  1.99it/s]
Epoch 14 Iter 133: loss 0.17074. :  59%|█████████████████████████▌                 | 133/224 [01:10<00:47,  1.92it/s]
Epoch 14 Iter 134: loss 0.16378. :  59%|█████████████████████████▌                 | 133/224 [01:12<00:47,  1.92it/s]
Epoch 14 Iter 134: loss 0.16378. :  60%|█████████████████████████▋                 | 134/224 [01:12<01:09,  1.29it/s]
Epoch 14 Iter 135: loss 0.17384. :  60%|█████████████████████████▋                 | 134/224 [01:12<01:09,  1.29it/s]
Epoch 14 Iter 135: loss 0.17384. :  60%|█████████████████████████▉                 | 135/224 [01:12<01:02,  1.43it/s]
Epoch 14 Iter 136: loss 0.20013. :  60%|█████████████████████████▉                 | 135/224 [01:13<01:02,  1.43it/s]
Epoch 14 Iter 136: loss 0.20013. :  61%|██████████████████████████                 | 136/224 [01:13<00:56,  1.55it/s]
Epoch 14 Iter 137: loss 0.18095. :  61%|██████████████████████████                 | 136/224 [01:13<00:56,  1.55it/s]
Epoch 14 Iter 137: loss 0.18095. :  61%|██████████████████████████▎                | 137/224 [01:13<00:52,  1.65it/s]
Epoch 14 Iter 138: loss 0.17853. :  61%|██████████████████████████▎                | 137/224 [01:14<00:52,  1.65it/s]
Epoch 14 Iter 138: loss 0.17853. :  62%|██████████████████████████▍                | 138/224 [01:14<00:49,  1.74it/s]
Epoch 14 Iter 139: loss 0.17469. :  62%|██████████████████████████▍                | 138/224 [01:14<00:49,  1.74it/s]
Epoch 14 Iter 139: loss 0.17469. :  62%|██████████████████████████▋                | 139/224 [01:14<00:47,  1.79it/s]
Epoch 14 Iter 140: loss 0.18152. :  62%|██████████████████████████▋                | 139/224 [01:15<00:47,  1.79it/s]
Epoch 14 Iter 140: loss 0.18152. :  62%|██████████████████████████▉                | 140/224 [01:15<00:45,  1.83it/s]
Epoch 14 Iter 141: loss 0.19090. :  62%|██████████████████████████▉                | 140/224 [01:15<00:45,  1.83it/s]
Epoch 14 Iter 141: loss 0.19090. :  63%|███████████████████████████                | 141/224 [01:15<00:44,  1.87it/s]
Epoch 14 Iter 142: loss 0.18705. :  63%|███████████████████████████                | 141/224 [01:16<00:44,  1.87it/s]
Epoch 14 Iter 142: loss 0.18705. :  63%|███████████████████████████▎               | 142/224 [01:16<00:43,  1.89it/s]
Epoch 14 Iter 143: loss 0.15261. :  63%|███████████████████████████▎               | 142/224 [01:16<00:43,  1.89it/s]
Epoch 14 Iter 143: loss 0.15261. :  64%|███████████████████████████▍               | 143/224 [01:16<00:42,  1.91it/s]
Epoch 14 Iter 144: loss 0.16776. :  64%|███████████████████████████▍               | 143/224 [01:17<00:42,  1.91it/s]
Epoch 14 Iter 144: loss 0.16776. :  64%|███████████████████████████▋               | 144/224 [01:17<00:41,  1.94it/s]
Epoch 14 Iter 145: loss 0.18026. :  64%|███████████████████████████▋               | 144/224 [01:17<00:41,  1.94it/s]
Epoch 14 Iter 145: loss 0.18026. :  65%|███████████████████████████▊               | 145/224 [01:17<00:40,  1.94it/s]
Epoch 14 Iter 146: loss 0.18605. :  65%|███████████████████████████▊               | 145/224 [01:18<00:40,  1.94it/s]
Epoch 14 Iter 146: loss 0.18605. :  65%|████████████████████████████               | 146/224 [01:18<00:40,  1.95it/s]
Epoch 14 Iter 147: loss 0.18301. :  65%|████████████████████████████               | 146/224 [01:18<00:40,  1.95it/s]
Epoch 14 Iter 147: loss 0.18301. :  66%|████████████████████████████▏              | 147/224 [01:18<00:39,  1.95it/s]
Epoch 14 Iter 148: loss 0.16531. :  66%|████████████████████████████▏              | 147/224 [01:19<00:39,  1.95it/s]
Epoch 14 Iter 148: loss 0.16531. :  66%|████████████████████████████▍              | 148/224 [01:19<00:38,  1.97it/s]
Epoch 14 Iter 149: loss 0.18858. :  66%|████████████████████████████▍              | 148/224 [01:19<00:38,  1.97it/s]
Epoch 14 Iter 149: loss 0.18858. :  67%|████████████████████████████▌              | 149/224 [01:19<00:37,  1.98it/s]
Epoch 14 Iter 150: loss 0.17340. :  67%|████████████████████████████▌              | 149/224 [01:20<00:37,  1.98it/s]
Epoch 14 Iter 150: loss 0.17340. :  67%|████████████████████████████▊              | 150/224 [01:20<00:37,  1.98it/s]
Epoch 14 Iter 151: loss 0.17808. :  67%|████████████████████████████▊              | 150/224 [01:21<00:37,  1.98it/s]
Epoch 14 Iter 151: loss 0.17808. :  67%|████████████████████████████▉              | 151/224 [01:21<00:38,  1.90it/s]
Epoch 14 Iter 152: loss 0.18704. :  67%|████████████████████████████▉              | 151/224 [01:21<00:38,  1.90it/s]
Epoch 14 Iter 152: loss 0.18704. :  68%|█████████████████████████████▏             | 152/224 [01:21<00:37,  1.93it/s]
Epoch 14 Iter 153: loss 0.16491. :  68%|█████████████████████████████▏             | 152/224 [01:22<00:37,  1.93it/s]
Epoch 14 Iter 153: loss 0.16491. :  68%|█████████████████████████████▎             | 153/224 [01:22<00:36,  1.95it/s]
Epoch 14 Iter 154: loss 0.18727. :  68%|█████████████████████████████▎             | 153/224 [01:22<00:36,  1.95it/s]
Epoch 14 Iter 154: loss 0.18727. :  69%|█████████████████████████████▌             | 154/224 [01:22<00:35,  1.97it/s]
Epoch 14 Iter 155: loss 0.21431. :  69%|█████████████████████████████▌             | 154/224 [01:23<00:35,  1.97it/s]
Epoch 14 Iter 155: loss 0.21431. :  69%|█████████████████████████████▊             | 155/224 [01:23<00:34,  1.99it/s]
Epoch 14 Iter 156: loss 0.18688. :  69%|█████████████████████████████▊             | 155/224 [01:23<00:34,  1.99it/s]
Epoch 14 Iter 156: loss 0.18688. :  70%|█████████████████████████████▉             | 156/224 [01:23<00:34,  2.00it/s]
Epoch 14 Iter 157: loss 0.19262. :  70%|█████████████████████████████▉             | 156/224 [01:24<00:34,  2.00it/s]
Epoch 14 Iter 157: loss 0.19262. :  70%|██████████████████████████████▏            | 157/224 [01:24<00:33,  2.00it/s]
Epoch 14 Iter 158: loss 0.17570. :  70%|██████████████████████████████▏            | 157/224 [01:24<00:33,  2.00it/s]
Epoch 14 Iter 158: loss 0.17570. :  71%|██████████████████████████████▎            | 158/224 [01:24<00:33,  2.00it/s]
Epoch 14 Iter 159: loss 0.15271. :  71%|██████████████████████████████▎            | 158/224 [01:25<00:33,  2.00it/s]
Epoch 14 Iter 159: loss 0.15271. :  71%|██████████████████████████████▌            | 159/224 [01:25<00:32,  2.00it/s]
Epoch 14 Iter 160: loss 0.16298. :  71%|██████████████████████████████▌            | 159/224 [01:25<00:32,  2.00it/s]
Epoch 14 Iter 160: loss 0.16298. :  71%|██████████████████████████████▋            | 160/224 [01:25<00:31,  2.01it/s]
Epoch 14 Iter 161: loss 0.18214. :  71%|██████████████████████████████▋            | 160/224 [01:26<00:31,  2.01it/s]
Epoch 14 Iter 161: loss 0.18214. :  72%|██████████████████████████████▉            | 161/224 [01:26<00:31,  2.03it/s]
Epoch 14 Iter 162: loss 0.18044. :  72%|██████████████████████████████▉            | 161/224 [01:26<00:31,  2.03it/s]
Epoch 14 Iter 162: loss 0.18044. :  72%|███████████████████████████████            | 162/224 [01:26<00:30,  2.01it/s]
Epoch 14 Iter 163: loss 0.17654. :  72%|███████████████████████████████            | 162/224 [01:27<00:30,  2.01it/s]
Epoch 14 Iter 163: loss 0.17654. :  73%|███████████████████████████████▎           | 163/224 [01:27<00:30,  2.02it/s]
Epoch 14 Iter 164: loss 0.18875. :  73%|███████████████████████████████▎           | 163/224 [01:27<00:30,  2.02it/s]
Epoch 14 Iter 164: loss 0.18875. :  73%|███████████████████████████████▍           | 164/224 [01:27<00:29,  2.02it/s]
Epoch 14 Iter 165: loss 0.16500. :  73%|███████████████████████████████▍           | 164/224 [01:28<00:29,  2.02it/s]
Epoch 14 Iter 165: loss 0.16500. :  74%|███████████████████████████████▋           | 165/224 [01:28<00:29,  1.98it/s]
Epoch 14 Iter 166: loss 0.17873. :  74%|███████████████████████████████▋           | 165/224 [01:28<00:29,  1.98it/s]
Epoch 14 Iter 166: loss 0.17873. :  74%|███████████████████████████████▊           | 166/224 [01:28<00:29,  1.98it/s]
Epoch 14 Iter 167: loss 0.17776. :  74%|███████████████████████████████▊           | 166/224 [01:29<00:29,  1.98it/s]
Epoch 14 Iter 167: loss 0.17776. :  75%|████████████████████████████████           | 167/224 [01:29<00:28,  1.99it/s]
Epoch 14 Iter 168: loss 0.17687. :  75%|████████████████████████████████           | 167/224 [01:29<00:28,  1.99it/s]
Epoch 14 Iter 168: loss 0.17687. :  75%|████████████████████████████████▎          | 168/224 [01:29<00:27,  2.00it/s]
Epoch 14 Iter 169: loss 0.17219. :  75%|████████████████████████████████▎          | 168/224 [01:30<00:27,  2.00it/s]
Epoch 14 Iter 169: loss 0.17219. :  75%|████████████████████████████████▍          | 169/224 [01:30<00:27,  2.01it/s]
Epoch 14 Iter 170: loss 0.19858. :  75%|████████████████████████████████▍          | 169/224 [01:30<00:27,  2.01it/s]
Epoch 14 Iter 170: loss 0.19858. :  76%|████████████████████████████████▋          | 170/224 [01:30<00:26,  2.01it/s]
Epoch 14 Iter 171: loss 0.16899. :  76%|████████████████████████████████▋          | 170/224 [01:31<00:26,  2.01it/s]
Epoch 14 Iter 171: loss 0.16899. :  76%|████████████████████████████████▊          | 171/224 [01:31<00:26,  2.02it/s]
Epoch 14 Iter 172: loss 0.16258. :  76%|████████████████████████████████▊          | 171/224 [01:31<00:26,  2.02it/s]
Epoch 14 Iter 172: loss 0.16258. :  77%|█████████████████████████████████          | 172/224 [01:31<00:25,  2.02it/s]
Epoch 14 Iter 173: loss 0.17691. :  77%|█████████████████████████████████          | 172/224 [01:31<00:25,  2.02it/s]
Epoch 14 Iter 173: loss 0.17691. :  77%|█████████████████████████████████▏         | 173/224 [01:31<00:25,  2.03it/s]
Epoch 14 Iter 174: loss 0.17513. :  77%|█████████████████████████████████▏         | 173/224 [01:32<00:25,  2.03it/s]
Epoch 14 Iter 174: loss 0.17513. :  78%|█████████████████████████████████▍         | 174/224 [01:32<00:24,  2.03it/s]
Epoch 14 Iter 175: loss 0.17478. :  78%|█████████████████████████████████▍         | 174/224 [01:32<00:24,  2.03it/s]
Epoch 14 Iter 175: loss 0.17478. :  78%|█████████████████████████████████▌         | 175/224 [01:32<00:24,  2.03it/s]
Epoch 14 Iter 176: loss 0.18754. :  78%|█████████████████████████████████▌         | 175/224 [01:33<00:24,  2.03it/s]
Epoch 14 Iter 176: loss 0.18754. :  79%|█████████████████████████████████▊         | 176/224 [01:33<00:23,  2.03it/s]
Epoch 14 Iter 177: loss 0.18452. :  79%|█████████████████████████████████▊         | 176/224 [01:33<00:23,  2.03it/s]
Epoch 14 Iter 177: loss 0.18452. :  79%|█████████████████████████████████▉         | 177/224 [01:33<00:23,  2.03it/s]
Epoch 14 Iter 178: loss 0.16234. :  79%|█████████████████████████████████▉         | 177/224 [01:34<00:23,  2.03it/s]
Epoch 14 Iter 178: loss 0.16234. :  79%|██████████████████████████████████▏        | 178/224 [01:34<00:22,  2.03it/s]
Epoch 14 Iter 179: loss 0.19620. :  79%|██████████████████████████████████▏        | 178/224 [01:34<00:22,  2.03it/s]
Epoch 14 Iter 179: loss 0.19620. :  80%|██████████████████████████████████▎        | 179/224 [01:34<00:22,  2.03it/s]
Epoch 14 Iter 180: loss 0.18417. :  80%|██████████████████████████████████▎        | 179/224 [01:35<00:22,  2.03it/s]
Epoch 14 Iter 180: loss 0.18417. :  80%|██████████████████████████████████▌        | 180/224 [01:35<00:21,  2.03it/s]
Epoch 14 Iter 181: loss 0.19218. :  80%|██████████████████████████████████▌        | 180/224 [01:35<00:21,  2.03it/s]
Epoch 14 Iter 181: loss 0.19218. :  81%|██████████████████████████████████▋        | 181/224 [01:35<00:21,  2.03it/s]
Epoch 14 Iter 182: loss 0.16550. :  81%|██████████████████████████████████▋        | 181/224 [01:36<00:21,  2.03it/s]
Epoch 14 Iter 182: loss 0.16550. :  81%|██████████████████████████████████▉        | 182/224 [01:36<00:20,  2.03it/s]
Epoch 14 Iter 183: loss 0.18763. :  81%|██████████████████████████████████▉        | 182/224 [01:36<00:20,  2.03it/s]
Epoch 14 Iter 183: loss 0.18763. :  82%|███████████████████████████████████▏       | 183/224 [01:36<00:20,  2.02it/s]
Epoch 14 Iter 184: loss 0.18941. :  82%|███████████████████████████████████▏       | 183/224 [01:37<00:20,  2.02it/s]
Epoch 14 Iter 184: loss 0.18941. :  82%|███████████████████████████████████▎       | 184/224 [01:37<00:19,  2.01it/s]
Epoch 14 Iter 185: loss 0.18708. :  82%|███████████████████████████████████▎       | 184/224 [01:37<00:19,  2.01it/s]
Epoch 14 Iter 185: loss 0.18708. :  83%|███████████████████████████████████▌       | 185/224 [01:37<00:19,  2.00it/s]
Epoch 14 Iter 186: loss 0.15909. :  83%|███████████████████████████████████▌       | 185/224 [01:38<00:19,  2.00it/s]
Epoch 14 Iter 186: loss 0.15909. :  83%|███████████████████████████████████▋       | 186/224 [01:38<00:18,  2.01it/s]
Epoch 14 Iter 187: loss 0.15906. :  83%|███████████████████████████████████▋       | 186/224 [01:38<00:18,  2.01it/s]
Epoch 14 Iter 187: loss 0.15906. :  83%|███████████████████████████████████▉       | 187/224 [01:38<00:18,  2.01it/s]
Epoch 14 Iter 188: loss 0.17400. :  83%|███████████████████████████████████▉       | 187/224 [01:39<00:18,  2.01it/s]
Epoch 14 Iter 188: loss 0.17400. :  84%|████████████████████████████████████       | 188/224 [01:39<00:17,  2.01it/s]
Epoch 14 Iter 189: loss 0.19063. :  84%|████████████████████████████████████       | 188/224 [01:39<00:17,  2.01it/s]
Epoch 14 Iter 189: loss 0.19063. :  84%|████████████████████████████████████▎      | 189/224 [01:39<00:17,  2.02it/s]
Epoch 14 Iter 190: loss 0.18088. :  84%|████████████████████████████████████▎      | 189/224 [01:40<00:17,  2.02it/s]
Epoch 14 Iter 190: loss 0.18088. :  85%|████████████████████████████████████▍      | 190/224 [01:40<00:16,  2.03it/s]
Epoch 14 Iter 191: loss 0.17152. :  85%|████████████████████████████████████▍      | 190/224 [01:40<00:16,  2.03it/s]
Epoch 14 Iter 191: loss 0.17152. :  85%|████████████████████████████████████▋      | 191/224 [01:40<00:16,  2.02it/s]
Epoch 14 Iter 192: loss 0.18096. :  85%|████████████████████████████████████▋      | 191/224 [01:41<00:16,  2.02it/s]
Epoch 14 Iter 192: loss 0.18096. :  86%|████████████████████████████████████▊      | 192/224 [01:41<00:15,  2.01it/s]
Epoch 14 Iter 193: loss 0.15717. :  86%|████████████████████████████████████▊      | 192/224 [01:41<00:15,  2.01it/s]
Epoch 14 Iter 193: loss 0.15717. :  86%|█████████████████████████████████████      | 193/224 [01:41<00:15,  2.01it/s]
Epoch 14 Iter 194: loss 0.18703. :  86%|█████████████████████████████████████      | 193/224 [01:42<00:15,  2.01it/s]
Epoch 14 Iter 194: loss 0.18703. :  87%|█████████████████████████████████████▏     | 194/224 [01:42<00:14,  2.02it/s]
Epoch 14 Iter 195: loss 0.18260. :  87%|█████████████████████████████████████▏     | 194/224 [01:42<00:14,  2.02it/s]
Epoch 14 Iter 195: loss 0.18260. :  87%|█████████████████████████████████████▍     | 195/224 [01:42<00:14,  2.02it/s]
Epoch 14 Iter 196: loss 0.19137. :  87%|█████████████████████████████████████▍     | 195/224 [01:43<00:14,  2.02it/s]
Epoch 14 Iter 196: loss 0.19137. :  88%|█████████████████████████████████████▋     | 196/224 [01:43<00:13,  2.01it/s]
Epoch 14 Iter 197: loss 0.16435. :  88%|█████████████████████████████████████▋     | 196/224 [01:43<00:13,  2.01it/s]
Epoch 14 Iter 197: loss 0.16435. :  88%|█████████████████████████████████████▊     | 197/224 [01:43<00:13,  2.02it/s]
Epoch 14 Iter 198: loss 0.16425. :  88%|█████████████████████████████████████▊     | 197/224 [01:44<00:13,  2.02it/s]
Epoch 14 Iter 198: loss 0.16425. :  88%|██████████████████████████████████████     | 198/224 [01:44<00:12,  2.02it/s]
Epoch 14 Iter 199: loss 0.17547. :  88%|██████████████████████████████████████     | 198/224 [01:44<00:12,  2.02it/s]
Epoch 14 Iter 199: loss 0.17547. :  89%|██████████████████████████████████████▏    | 199/224 [01:44<00:12,  2.03it/s]
Epoch 14 Iter 200: loss 0.18321. :  89%|██████████████████████████████████████▏    | 199/224 [01:45<00:12,  2.03it/s]
Epoch 14 Iter 200: loss 0.18321. :  89%|██████████████████████████████████████▍    | 200/224 [01:45<00:11,  2.02it/s]
Epoch 14 Iter 201: loss 0.16945. :  89%|██████████████████████████████████████▍    | 200/224 [01:45<00:11,  2.02it/s]
Epoch 14 Iter 201: loss 0.16945. :  90%|██████████████████████████████████████▌    | 201/224 [01:45<00:11,  2.02it/s]
Epoch 14 Iter 202: loss 0.19523. :  90%|██████████████████████████████████████▌    | 201/224 [01:46<00:11,  2.02it/s]
Epoch 14 Iter 202: loss 0.19523. :  90%|██████████████████████████████████████▊    | 202/224 [01:46<00:10,  2.02it/s]
Epoch 14 Iter 203: loss 0.18983. :  90%|██████████████████████████████████████▊    | 202/224 [01:46<00:10,  2.02it/s]
Epoch 14 Iter 203: loss 0.18983. :  91%|██████████████████████████████████████▉    | 203/224 [01:46<00:10,  2.02it/s]
Epoch 14 Iter 204: loss 0.18252. :  91%|██████████████████████████████████████▉    | 203/224 [01:47<00:10,  2.02it/s]
Epoch 14 Iter 204: loss 0.18252. :  91%|███████████████████████████████████████▏   | 204/224 [01:47<00:09,  2.02it/s]
Epoch 14 Iter 205: loss 0.17436. :  91%|███████████████████████████████████████▏   | 204/224 [01:47<00:09,  2.02it/s]
Epoch 14 Iter 205: loss 0.17436. :  92%|███████████████████████████████████████▎   | 205/224 [01:47<00:09,  2.01it/s]
Epoch 14 Iter 206: loss 0.17963. :  92%|███████████████████████████████████████▎   | 205/224 [01:48<00:09,  2.01it/s]
Epoch 14 Iter 206: loss 0.17963. :  92%|███████████████████████████████████████▌   | 206/224 [01:48<00:09,  2.00it/s]
Epoch 14 Iter 207: loss 0.16212. :  92%|███████████████████████████████████████▌   | 206/224 [01:48<00:09,  2.00it/s]
Epoch 14 Iter 207: loss 0.16212. :  92%|███████████████████████████████████████▋   | 207/224 [01:48<00:08,  1.99it/s]
Epoch 14 Iter 208: loss 0.19926. :  92%|███████████████████████████████████████▋   | 207/224 [01:49<00:08,  1.99it/s]
Epoch 14 Iter 208: loss 0.19926. :  93%|███████████████████████████████████████▉   | 208/224 [01:49<00:08,  2.00it/s]
Epoch 14 Iter 209: loss 0.17017. :  93%|███████████████████████████████████████▉   | 208/224 [01:49<00:08,  2.00it/s]
Epoch 14 Iter 209: loss 0.17017. :  93%|████████████████████████████████████████   | 209/224 [01:49<00:07,  2.00it/s]
Epoch 14 Iter 210: loss 0.17414. :  93%|████████████████████████████████████████   | 209/224 [01:50<00:07,  2.00it/s]
Epoch 14 Iter 210: loss 0.17414. :  94%|████████████████████████████████████████▎  | 210/224 [01:50<00:06,  2.00it/s]
Epoch 14 Iter 211: loss 0.16376. :  94%|████████████████████████████████████████▎  | 210/224 [01:50<00:06,  2.00it/s]
Epoch 14 Iter 211: loss 0.16376. :  94%|████████████████████████████████████████▌  | 211/224 [01:50<00:06,  2.01it/s]
Epoch 14 Iter 212: loss 0.19518. :  94%|████████████████████████████████████████▌  | 211/224 [01:51<00:06,  2.01it/s]
Epoch 14 Iter 212: loss 0.19518. :  95%|████████████████████████████████████████▋  | 212/224 [01:51<00:05,  2.01it/s]
Epoch 14 Iter 213: loss 0.16855. :  95%|████████████████████████████████████████▋  | 212/224 [01:51<00:05,  2.01it/s]
Epoch 14 Iter 213: loss 0.16855. :  95%|████████████████████████████████████████▉  | 213/224 [01:51<00:05,  2.00it/s]
Epoch 14 Iter 214: loss 0.16477. :  95%|████████████████████████████████████████▉  | 213/224 [01:53<00:05,  2.00it/s]
Epoch 14 Iter 214: loss 0.16477. :  96%|█████████████████████████████████████████  | 214/224 [01:53<00:07,  1.41it/s]
Epoch 14 Iter 215: loss 0.20423. :  96%|█████████████████████████████████████████  | 214/224 [01:53<00:07,  1.41it/s]
Epoch 14 Iter 215: loss 0.20423. :  96%|█████████████████████████████████████████▎ | 215/224 [01:53<00:06,  1.49it/s]
Epoch 14 Iter 216: loss 0.16708. :  96%|█████████████████████████████████████████▎ | 215/224 [01:54<00:06,  1.49it/s]
Epoch 14 Iter 216: loss 0.16708. :  96%|█████████████████████████████████████████▍ | 216/224 [01:54<00:05,  1.59it/s]
Epoch 14 Iter 217: loss 0.16384. :  96%|█████████████████████████████████████████▍ | 216/224 [01:54<00:05,  1.59it/s]
Epoch 14 Iter 217: loss 0.16384. :  97%|█████████████████████████████████████████▋ | 217/224 [01:54<00:04,  1.69it/s]
Epoch 14 Iter 218: loss 0.20205. :  97%|█████████████████████████████████████████▋ | 217/224 [01:55<00:04,  1.69it/s]
Epoch 14 Iter 218: loss 0.20205. :  97%|█████████████████████████████████████████▊ | 218/224 [01:55<00:03,  1.77it/s]
Epoch 14 Iter 219: loss 0.18446. :  97%|█████████████████████████████████████████▊ | 218/224 [01:55<00:03,  1.77it/s]
Epoch 14 Iter 219: loss 0.18446. :  98%|██████████████████████████████████████████ | 219/224 [01:55<00:02,  1.83it/s]
Epoch 14 Iter 220: loss 0.19341. :  98%|██████████████████████████████████████████ | 219/224 [01:56<00:02,  1.83it/s]
Epoch 14 Iter 220: loss 0.19341. :  98%|██████████████████████████████████████████▏| 220/224 [01:56<00:02,  1.86it/s]
Epoch 14 Iter 221: loss 0.18190. :  98%|██████████████████████████████████████████▏| 220/224 [01:56<00:02,  1.86it/s]
Epoch 14 Iter 221: loss 0.18190. :  99%|██████████████████████████████████████████▍| 221/224 [01:56<00:01,  1.90it/s]
Epoch 14 Iter 222: loss 0.17539. :  99%|██████████████████████████████████████████▍| 221/224 [01:57<00:01,  1.90it/s]
Epoch 14 Iter 222: loss 0.17539. :  99%|██████████████████████████████████████████▌| 222/224 [01:57<00:01,  1.93it/s]
Epoch 14 Iter 223: loss 0.15730. :  99%|██████████████████████████████████████████▌| 222/224 [01:57<00:01,  1.93it/s]
Epoch 14 Iter 223: loss 0.15730. : 100%|██████████████████████████████████████████▊| 223/224 [01:57<00:00,  1.94it/s]
Epoch 14 Iter 224: loss 0.16366. : 100%|██████████████████████████████████████████▊| 223/224 [01:58<00:00,  1.94it/s]
Epoch 14 Iter 224: loss 0.16366. : 100%|███████████████████████████████████████████| 224/224 [01:58<00:00,  1.93it/s]
Epoch 14 Iter 224: loss 0.16366. : 100%|███████████████████████████████████████████| 224/224 [01:58<00:00,  1.89it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.17876. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 15 Iter 1: loss 0.17876. :   0%|▏                                              | 1/224 [00:00<01:50,  2.01it/s]
Epoch 15 Iter 2: loss 0.17275. :   0%|▏                                              | 1/224 [00:01<01:50,  2.01it/s]
Epoch 15 Iter 2: loss 0.17275. :   1%|▍                                              | 2/224 [00:01<01:51,  1.99it/s]
Epoch 15 Iter 3: loss 0.18036. :   1%|▍                                              | 2/224 [00:01<01:51,  1.99it/s]
Epoch 15 Iter 3: loss 0.18036. :   1%|▋                                              | 3/224 [00:01<01:51,  1.97it/s]
Epoch 15 Iter 4: loss 0.16948. :   1%|▋                                              | 3/224 [00:01<01:51,  1.97it/s]
Epoch 15 Iter 4: loss 0.16948. :   2%|▊                                              | 4/224 [00:02<01:49,  2.01it/s]
Epoch 15 Iter 5: loss 0.17974. :   2%|▊                                              | 4/224 [00:02<01:49,  2.01it/s]
Epoch 15 Iter 5: loss 0.17974. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 15 Iter 6: loss 0.17851. :   2%|█                                              | 5/224 [00:03<01:47,  2.03it/s]
Epoch 15 Iter 6: loss 0.17851. :   3%|█▎                                             | 6/224 [00:03<01:49,  1.99it/s]
Epoch 15 Iter 7: loss 0.18133. :   3%|█▎                                             | 6/224 [00:03<01:49,  1.99it/s]
Epoch 15 Iter 7: loss 0.18133. :   3%|█▍                                             | 7/224 [00:03<01:53,  1.91it/s]
Epoch 15 Iter 8: loss 0.18322. :   3%|█▍                                             | 7/224 [00:04<01:53,  1.91it/s]
Epoch 15 Iter 8: loss 0.18322. :   4%|█▋                                             | 8/224 [00:04<01:53,  1.91it/s]
Epoch 15 Iter 9: loss 0.19353. :   4%|█▋                                             | 8/224 [00:04<01:53,  1.91it/s]
Epoch 15 Iter 9: loss 0.19353. :   4%|█▉                                             | 9/224 [00:04<01:51,  1.92it/s]
Epoch 15 Iter 10: loss 0.18919. :   4%|█▊                                            | 9/224 [00:05<01:51,  1.92it/s]
Epoch 15 Iter 10: loss 0.18919. :   4%|██                                           | 10/224 [00:05<01:50,  1.94it/s]
Epoch 15 Iter 11: loss 0.18556. :   4%|██                                           | 10/224 [00:05<01:50,  1.94it/s]
Epoch 15 Iter 11: loss 0.18556. :   5%|██▏                                          | 11/224 [00:05<01:49,  1.95it/s]
Epoch 15 Iter 12: loss 0.18014. :   5%|██▏                                          | 11/224 [00:06<01:49,  1.95it/s]
Epoch 15 Iter 12: loss 0.18014. :   5%|██▍                                          | 12/224 [00:06<01:48,  1.95it/s]
Epoch 15 Iter 13: loss 0.17917. :   5%|██▍                                          | 12/224 [00:06<01:48,  1.95it/s]
Epoch 15 Iter 13: loss 0.17917. :   6%|██▌                                          | 13/224 [00:06<01:48,  1.95it/s]
Epoch 15 Iter 14: loss 0.17110. :   6%|██▌                                          | 13/224 [00:07<01:48,  1.95it/s]
Epoch 15 Iter 14: loss 0.17110. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 15 Iter 15: loss 0.16469. :   6%|██▊                                          | 14/224 [00:07<01:48,  1.94it/s]
Epoch 15 Iter 15: loss 0.16469. :   7%|███                                          | 15/224 [00:07<01:53,  1.84it/s]
Epoch 15 Iter 16: loss 0.17312. :   7%|███                                          | 15/224 [00:08<01:53,  1.84it/s]
Epoch 15 Iter 16: loss 0.17312. :   7%|███▏                                         | 16/224 [00:08<01:52,  1.85it/s]
Epoch 15 Iter 17: loss 0.18311. :   7%|███▏                                         | 16/224 [00:08<01:52,  1.85it/s]
Epoch 15 Iter 17: loss 0.18311. :   8%|███▍                                         | 17/224 [00:08<01:50,  1.87it/s]
Epoch 15 Iter 18: loss 0.20429. :   8%|███▍                                         | 17/224 [00:09<01:50,  1.87it/s]
Epoch 15 Iter 18: loss 0.20429. :   8%|███▌                                         | 18/224 [00:09<01:47,  1.91it/s]
Epoch 15 Iter 19: loss 0.18526. :   8%|███▌                                         | 18/224 [00:09<01:47,  1.91it/s]
Epoch 15 Iter 19: loss 0.18526. :   8%|███▊                                         | 19/224 [00:09<01:46,  1.93it/s]
Epoch 15 Iter 20: loss 0.15735. :   8%|███▊                                         | 19/224 [00:10<01:46,  1.93it/s]
Epoch 15 Iter 20: loss 0.15735. :   9%|████                                         | 20/224 [00:10<01:44,  1.96it/s]
Epoch 15 Iter 21: loss 0.16839. :   9%|████                                         | 20/224 [00:10<01:44,  1.96it/s]
Epoch 15 Iter 21: loss 0.16839. :   9%|████▏                                        | 21/224 [00:10<01:43,  1.97it/s]
Epoch 15 Iter 22: loss 0.18377. :   9%|████▏                                        | 21/224 [00:11<01:43,  1.97it/s]
Epoch 15 Iter 22: loss 0.18377. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.93it/s]
Epoch 15 Iter 23: loss 0.19428. :  10%|████▍                                        | 22/224 [00:11<01:44,  1.93it/s]
Epoch 15 Iter 23: loss 0.19428. :  10%|████▌                                        | 23/224 [00:11<01:43,  1.95it/s]
Epoch 15 Iter 24: loss 0.17044. :  10%|████▌                                        | 23/224 [00:12<01:43,  1.95it/s]
Epoch 15 Iter 24: loss 0.17044. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.97it/s]
Epoch 15 Iter 25: loss 0.18251. :  11%|████▊                                        | 24/224 [00:12<01:41,  1.97it/s]
Epoch 15 Iter 25: loss 0.18251. :  11%|█████                                        | 25/224 [00:12<01:40,  1.98it/s]
Epoch 15 Iter 26: loss 0.17913. :  11%|█████                                        | 25/224 [00:13<01:40,  1.98it/s]
Epoch 15 Iter 26: loss 0.17913. :  12%|█████▏                                       | 26/224 [00:13<01:39,  2.00it/s]
Epoch 15 Iter 27: loss 0.15796. :  12%|█████▏                                       | 26/224 [00:13<01:39,  2.00it/s]
Epoch 15 Iter 27: loss 0.15796. :  12%|█████▍                                       | 27/224 [00:13<01:39,  1.98it/s]
Epoch 15 Iter 28: loss 0.18235. :  12%|█████▍                                       | 27/224 [00:14<01:39,  1.98it/s]
Epoch 15 Iter 28: loss 0.18235. :  12%|█████▋                                       | 28/224 [00:14<01:38,  1.98it/s]
Epoch 15 Iter 29: loss 0.17619. :  12%|█████▋                                       | 28/224 [00:14<01:38,  1.98it/s]
Epoch 15 Iter 29: loss 0.17619. :  13%|█████▊                                       | 29/224 [00:14<01:39,  1.95it/s]
Epoch 15 Iter 30: loss 0.18413. :  13%|█████▊                                       | 29/224 [00:15<01:39,  1.95it/s]
Epoch 15 Iter 30: loss 0.18413. :  13%|██████                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 15 Iter 31: loss 0.16375. :  13%|██████                                       | 30/224 [00:15<01:39,  1.95it/s]
Epoch 15 Iter 31: loss 0.16375. :  14%|██████▏                                      | 31/224 [00:15<01:38,  1.95it/s]
Epoch 15 Iter 32: loss 0.17128. :  14%|██████▏                                      | 31/224 [00:16<01:38,  1.95it/s]
Epoch 15 Iter 32: loss 0.17128. :  14%|██████▍                                      | 32/224 [00:16<01:37,  1.97it/s]
Epoch 15 Iter 33: loss 0.16159. :  14%|██████▍                                      | 32/224 [00:16<01:37,  1.97it/s]
Epoch 15 Iter 33: loss 0.16159. :  15%|██████▋                                      | 33/224 [00:16<01:36,  1.98it/s]
Epoch 15 Iter 34: loss 0.17188. :  15%|██████▋                                      | 33/224 [00:17<01:36,  1.98it/s]
Epoch 15 Iter 34: loss 0.17188. :  15%|██████▊                                      | 34/224 [00:17<01:35,  1.98it/s]
Epoch 15 Iter 35: loss 0.17302. :  15%|██████▊                                      | 34/224 [00:17<01:35,  1.98it/s]
Epoch 15 Iter 35: loss 0.17302. :  16%|███████                                      | 35/224 [00:17<01:37,  1.94it/s]
Epoch 15 Iter 36: loss 0.16203. :  16%|███████                                      | 35/224 [00:18<01:37,  1.94it/s]
Epoch 15 Iter 36: loss 0.16203. :  16%|███████▏                                     | 36/224 [00:18<01:36,  1.95it/s]
Epoch 15 Iter 37: loss 0.18749. :  16%|███████▏                                     | 36/224 [00:18<01:36,  1.95it/s]
Epoch 15 Iter 37: loss 0.18749. :  17%|███████▍                                     | 37/224 [00:18<01:35,  1.96it/s]
Epoch 15 Iter 38: loss 0.18608. :  17%|███████▍                                     | 37/224 [00:19<01:35,  1.96it/s]
Epoch 15 Iter 38: loss 0.18608. :  17%|███████▋                                     | 38/224 [00:19<01:34,  1.97it/s]
Epoch 15 Iter 39: loss 0.17553. :  17%|███████▋                                     | 38/224 [00:19<01:34,  1.97it/s]
Epoch 15 Iter 39: loss 0.17553. :  17%|███████▊                                     | 39/224 [00:19<01:33,  1.97it/s]
Epoch 15 Iter 40: loss 0.17700. :  17%|███████▊                                     | 39/224 [00:20<01:33,  1.97it/s]
Epoch 15 Iter 40: loss 0.17700. :  18%|████████                                     | 40/224 [00:20<01:33,  1.97it/s]
Epoch 15 Iter 41: loss 0.17024. :  18%|████████                                     | 40/224 [00:21<01:33,  1.97it/s]
Epoch 15 Iter 41: loss 0.17024. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.96it/s]
Epoch 15 Iter 42: loss 0.17657. :  18%|████████▏                                    | 41/224 [00:21<01:33,  1.96it/s]
Epoch 15 Iter 42: loss 0.17657. :  19%|████████▍                                    | 42/224 [00:21<01:32,  1.96it/s]
Epoch 15 Iter 43: loss 0.17077. :  19%|████████▍                                    | 42/224 [00:22<01:32,  1.96it/s]
Epoch 15 Iter 43: loss 0.17077. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.97it/s]
Epoch 15 Iter 44: loss 0.18201. :  19%|████████▋                                    | 43/224 [00:22<01:31,  1.97it/s]
Epoch 15 Iter 44: loss 0.18201. :  20%|████████▊                                    | 44/224 [00:22<01:30,  1.98it/s]
Epoch 15 Iter 45: loss 0.17613. :  20%|████████▊                                    | 44/224 [00:23<01:30,  1.98it/s]
Epoch 15 Iter 45: loss 0.17613. :  20%|█████████                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 15 Iter 46: loss 0.19646. :  20%|█████████                                    | 45/224 [00:23<01:30,  1.98it/s]
Epoch 15 Iter 46: loss 0.19646. :  21%|█████████▏                                   | 46/224 [00:23<01:32,  1.93it/s]
Epoch 15 Iter 47: loss 0.17500. :  21%|█████████▏                                   | 46/224 [00:24<01:32,  1.93it/s]
Epoch 15 Iter 47: loss 0.17500. :  21%|█████████▍                                   | 47/224 [00:24<01:31,  1.94it/s]
Epoch 15 Iter 48: loss 0.16843. :  21%|█████████▍                                   | 47/224 [00:24<01:31,  1.94it/s]
Epoch 15 Iter 48: loss 0.16843. :  21%|█████████▋                                   | 48/224 [00:24<01:30,  1.94it/s]
Epoch 15 Iter 49: loss 0.16578. :  21%|█████████▋                                   | 48/224 [00:25<01:30,  1.94it/s]
Epoch 15 Iter 49: loss 0.16578. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.95it/s]
Epoch 15 Iter 50: loss 0.18976. :  22%|█████████▊                                   | 49/224 [00:25<01:29,  1.95it/s]
Epoch 15 Iter 50: loss 0.18976. :  22%|██████████                                   | 50/224 [00:25<01:29,  1.95it/s]
Epoch 15 Iter 51: loss 0.17260. :  22%|██████████                                   | 50/224 [00:26<01:29,  1.95it/s]
Epoch 15 Iter 51: loss 0.17260. :  23%|██████████▏                                  | 51/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 52: loss 0.17352. :  23%|██████████▏                                  | 51/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 52: loss 0.17352. :  23%|██████████▍                                  | 52/224 [00:26<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.18601. :  23%|██████████▍                                  | 52/224 [00:27<01:27,  1.97it/s]
Epoch 15 Iter 53: loss 0.18601. :  24%|██████████▋                                  | 53/224 [00:27<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.17544. :  24%|██████████▋                                  | 53/224 [00:27<01:26,  1.97it/s]
Epoch 15 Iter 54: loss 0.17544. :  24%|██████████▊                                  | 54/224 [00:27<01:25,  1.99it/s]
Epoch 15 Iter 55: loss 0.19477. :  24%|██████████▊                                  | 54/224 [00:28<01:25,  1.99it/s]
Epoch 15 Iter 55: loss 0.19477. :  25%|███████████                                  | 55/224 [00:28<01:23,  2.02it/s]
Epoch 15 Iter 56: loss 0.16065. :  25%|███████████                                  | 55/224 [00:28<01:23,  2.02it/s]
Epoch 15 Iter 56: loss 0.16065. :  25%|███████████▎                                 | 56/224 [00:28<01:22,  2.03it/s]
Epoch 15 Iter 57: loss 0.15882. :  25%|███████████▎                                 | 56/224 [00:29<01:22,  2.03it/s]
Epoch 15 Iter 57: loss 0.15882. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  2.00it/s]
Epoch 15 Iter 58: loss 0.19138. :  25%|███████████▍                                 | 57/224 [00:29<01:23,  2.00it/s]
Epoch 15 Iter 58: loss 0.19138. :  26%|███████████▋                                 | 58/224 [00:29<01:21,  2.02it/s]
Epoch 15 Iter 59: loss 0.18352. :  26%|███████████▋                                 | 58/224 [00:30<01:21,  2.02it/s]
Epoch 15 Iter 59: loss 0.18352. :  26%|███████████▊                                 | 59/224 [00:30<01:25,  1.92it/s]
Epoch 15 Iter 60: loss 0.16250. :  26%|███████████▊                                 | 59/224 [00:30<01:25,  1.92it/s]
Epoch 15 Iter 60: loss 0.16250. :  27%|████████████                                 | 60/224 [00:30<01:27,  1.88it/s]
Epoch 15 Iter 61: loss 0.18327. :  27%|████████████                                 | 60/224 [00:31<01:27,  1.88it/s]
Epoch 15 Iter 61: loss 0.18327. :  27%|████████████▎                                | 61/224 [00:31<01:26,  1.88it/s]
Epoch 15 Iter 62: loss 0.18244. :  27%|████████████▎                                | 61/224 [00:31<01:26,  1.88it/s]
Epoch 15 Iter 62: loss 0.18244. :  28%|████████████▍                                | 62/224 [00:31<01:32,  1.74it/s]
Epoch 15 Iter 63: loss 0.17913. :  28%|████████████▍                                | 62/224 [00:32<01:32,  1.74it/s]
Epoch 15 Iter 63: loss 0.17913. :  28%|████████████▋                                | 63/224 [00:32<01:39,  1.62it/s]
Epoch 15 Iter 64: loss 0.19253. :  28%|████████████▋                                | 63/224 [00:33<01:39,  1.62it/s]
Epoch 15 Iter 64: loss 0.19253. :  29%|████████████▊                                | 64/224 [00:33<01:39,  1.60it/s]
Epoch 15 Iter 65: loss 0.18301. :  29%|████████████▊                                | 64/224 [00:34<01:39,  1.60it/s]
Epoch 15 Iter 65: loss 0.18301. :  29%|█████████████                                | 65/224 [00:34<01:46,  1.49it/s]
Epoch 15 Iter 66: loss 0.18708. :  29%|█████████████                                | 65/224 [00:34<01:46,  1.49it/s]
Epoch 15 Iter 66: loss 0.18708. :  29%|█████████████▎                               | 66/224 [00:34<01:51,  1.42it/s]
Epoch 15 Iter 67: loss 0.15775. :  29%|█████████████▎                               | 66/224 [00:35<01:51,  1.42it/s]
Epoch 15 Iter 67: loss 0.15775. :  30%|█████████████▍                               | 67/224 [00:35<01:53,  1.39it/s]
Epoch 15 Iter 68: loss 0.15614. :  30%|█████████████▍                               | 67/224 [00:36<01:53,  1.39it/s]
Epoch 15 Iter 68: loss 0.15614. :  30%|█████████████▋                               | 68/224 [00:36<01:43,  1.50it/s]
Epoch 15 Iter 69: loss 0.19779. :  30%|█████████████▋                               | 68/224 [00:36<01:43,  1.50it/s]
Epoch 15 Iter 69: loss 0.19779. :  31%|█████████████▊                               | 69/224 [00:36<01:38,  1.58it/s]
Epoch 15 Iter 70: loss 0.19701. :  31%|█████████████▊                               | 69/224 [00:37<01:38,  1.58it/s]
Epoch 15 Iter 70: loss 0.19701. :  31%|██████████████                               | 70/224 [00:37<01:43,  1.48it/s]
Epoch 15 Iter 71: loss 0.17209. :  31%|██████████████                               | 70/224 [00:38<01:43,  1.48it/s]
Epoch 15 Iter 71: loss 0.17209. :  32%|██████████████▎                              | 71/224 [00:38<01:37,  1.57it/s]
Epoch 15 Iter 72: loss 0.18371. :  32%|██████████████▎                              | 71/224 [00:38<01:37,  1.57it/s]
Epoch 15 Iter 72: loss 0.18371. :  32%|██████████████▍                              | 72/224 [00:38<01:32,  1.65it/s]
Epoch 15 Iter 73: loss 0.17108. :  32%|██████████████▍                              | 72/224 [00:39<01:32,  1.65it/s]
Epoch 15 Iter 73: loss 0.17108. :  33%|██████████████▋                              | 73/224 [00:39<01:28,  1.71it/s]
Epoch 15 Iter 74: loss 0.18126. :  33%|██████████████▋                              | 73/224 [00:39<01:28,  1.71it/s]
Epoch 15 Iter 74: loss 0.18126. :  33%|██████████████▊                              | 74/224 [00:39<01:25,  1.75it/s]
Epoch 15 Iter 75: loss 0.18803. :  33%|██████████████▊                              | 74/224 [00:40<01:25,  1.75it/s]
Epoch 15 Iter 75: loss 0.18803. :  33%|███████████████                              | 75/224 [00:40<01:24,  1.77it/s]
Epoch 15 Iter 76: loss 0.19000. :  33%|███████████████                              | 75/224 [00:40<01:24,  1.77it/s]
Epoch 15 Iter 76: loss 0.19000. :  34%|███████████████▎                             | 76/224 [00:40<01:31,  1.61it/s]
Epoch 15 Iter 77: loss 0.17405. :  34%|███████████████▎                             | 76/224 [00:41<01:31,  1.61it/s]
Epoch 15 Iter 77: loss 0.17405. :  34%|███████████████▍                             | 77/224 [00:41<01:27,  1.69it/s]
Epoch 15 Iter 78: loss 0.13834. :  34%|███████████████▍                             | 77/224 [00:41<01:27,  1.69it/s]
Epoch 15 Iter 78: loss 0.13834. :  35%|███████████████▋                             | 78/224 [00:41<01:23,  1.75it/s]
Epoch 15 Iter 79: loss 0.18030. :  35%|███████████████▋                             | 78/224 [00:42<01:23,  1.75it/s]
Epoch 15 Iter 79: loss 0.18030. :  35%|███████████████▊                             | 79/224 [00:42<01:21,  1.78it/s]
Epoch 15 Iter 80: loss 0.18191. :  35%|███████████████▊                             | 79/224 [00:43<01:21,  1.78it/s]
Epoch 15 Iter 80: loss 0.18191. :  36%|████████████████                             | 80/224 [00:43<01:20,  1.79it/s]
Epoch 15 Iter 81: loss 0.17434. :  36%|████████████████                             | 80/224 [00:43<01:20,  1.79it/s]
Epoch 15 Iter 81: loss 0.17434. :  36%|████████████████▎                            | 81/224 [00:43<01:20,  1.77it/s]
Epoch 15 Iter 82: loss 0.18086. :  36%|████████████████▎                            | 81/224 [00:44<01:20,  1.77it/s]
Epoch 15 Iter 82: loss 0.18086. :  37%|████████████████▍                            | 82/224 [00:44<01:28,  1.60it/s]
Epoch 15 Iter 83: loss 0.18016. :  37%|████████████████▍                            | 82/224 [00:45<01:28,  1.60it/s]
Epoch 15 Iter 83: loss 0.18016. :  37%|████████████████▋                            | 83/224 [00:45<01:33,  1.50it/s]
Epoch 15 Iter 84: loss 0.17898. :  37%|████████████████▋                            | 83/224 [00:45<01:33,  1.50it/s]
Epoch 15 Iter 84: loss 0.17898. :  38%|████████████████▉                            | 84/224 [00:45<01:32,  1.52it/s]
Epoch 15 Iter 85: loss 0.19858. :  38%|████████████████▉                            | 84/224 [00:46<01:32,  1.52it/s]
Epoch 15 Iter 85: loss 0.19858. :  38%|█████████████████                            | 85/224 [00:46<01:26,  1.60it/s]
Epoch 15 Iter 86: loss 0.17975. :  38%|█████████████████                            | 85/224 [00:46<01:26,  1.60it/s]
Epoch 15 Iter 86: loss 0.17975. :  38%|█████████████████▎                           | 86/224 [00:46<01:22,  1.67it/s]
Epoch 15 Iter 87: loss 0.18619. :  38%|█████████████████▎                           | 86/224 [00:47<01:22,  1.67it/s]
Epoch 15 Iter 87: loss 0.18619. :  39%|█████████████████▍                           | 87/224 [00:47<01:19,  1.72it/s]
Epoch 15 Iter 88: loss 0.16032. :  39%|█████████████████▍                           | 87/224 [00:48<01:19,  1.72it/s]
Epoch 15 Iter 88: loss 0.16032. :  39%|█████████████████▋                           | 88/224 [00:48<01:22,  1.65it/s]
Epoch 15 Iter 89: loss 0.16208. :  39%|█████████████████▋                           | 88/224 [00:48<01:22,  1.65it/s]
Epoch 15 Iter 89: loss 0.16208. :  40%|█████████████████▉                           | 89/224 [00:48<01:18,  1.71it/s]
Epoch 15 Iter 90: loss 0.18084. :  40%|█████████████████▉                           | 89/224 [00:49<01:18,  1.71it/s]
Epoch 15 Iter 90: loss 0.18084. :  40%|██████████████████                           | 90/224 [00:49<01:17,  1.74it/s]
Epoch 15 Iter 91: loss 0.17196. :  40%|██████████████████                           | 90/224 [00:49<01:17,  1.74it/s]
Epoch 15 Iter 91: loss 0.17196. :  41%|██████████████████▎                          | 91/224 [00:49<01:15,  1.76it/s]
Epoch 15 Iter 92: loss 0.18053. :  41%|██████████████████▎                          | 91/224 [00:50<01:15,  1.76it/s]
Epoch 15 Iter 92: loss 0.18053. :  41%|██████████████████▍                          | 92/224 [00:50<01:15,  1.74it/s]
Epoch 15 Iter 93: loss 0.19280. :  41%|██████████████████▍                          | 92/224 [00:51<01:15,  1.74it/s]
Epoch 15 Iter 93: loss 0.19280. :  42%|██████████████████▋                          | 93/224 [00:51<01:19,  1.65it/s]
Epoch 15 Iter 94: loss 0.18444. :  42%|██████████████████▋                          | 93/224 [00:51<01:19,  1.65it/s]
Epoch 15 Iter 94: loss 0.18444. :  42%|██████████████████▉                          | 94/224 [00:51<01:16,  1.70it/s]
Epoch 15 Iter 95: loss 0.18480. :  42%|██████████████████▉                          | 94/224 [00:52<01:16,  1.70it/s]
Epoch 15 Iter 95: loss 0.18480. :  42%|███████████████████                          | 95/224 [00:52<01:18,  1.65it/s]
Epoch 15 Iter 96: loss 0.17814. :  42%|███████████████████                          | 95/224 [00:52<01:18,  1.65it/s]
Epoch 15 Iter 96: loss 0.17814. :  43%|███████████████████▎                         | 96/224 [00:52<01:15,  1.70it/s]
Epoch 15 Iter 97: loss 0.16693. :  43%|███████████████████▎                         | 96/224 [00:53<01:15,  1.70it/s]
Epoch 15 Iter 97: loss 0.16693. :  43%|███████████████████▍                         | 97/224 [00:53<01:12,  1.74it/s]
Epoch 15 Iter 98: loss 0.18778. :  43%|███████████████████▍                         | 97/224 [00:53<01:12,  1.74it/s]
Epoch 15 Iter 98: loss 0.18778. :  44%|███████████████████▋                         | 98/224 [00:53<01:11,  1.76it/s]
Epoch 15 Iter 99: loss 0.16496. :  44%|███████████████████▋                         | 98/224 [00:54<01:11,  1.76it/s]
Epoch 15 Iter 99: loss 0.16496. :  44%|███████████████████▉                         | 99/224 [00:54<01:09,  1.81it/s]
Epoch 15 Iter 100: loss 0.16100. :  44%|███████████████████▍                        | 99/224 [00:54<01:09,  1.81it/s]
Epoch 15 Iter 100: loss 0.16100. :  45%|███████████████████▏                       | 100/224 [00:54<01:09,  1.78it/s]
Epoch 15 Iter 101: loss 0.17407. :  45%|███████████████████▏                       | 100/224 [00:55<01:09,  1.78it/s]
Epoch 15 Iter 101: loss 0.17407. :  45%|███████████████████▍                       | 101/224 [00:55<01:12,  1.70it/s]
Epoch 15 Iter 102: loss 0.18404. :  45%|███████████████████▍                       | 101/224 [00:56<01:12,  1.70it/s]
Epoch 15 Iter 102: loss 0.18404. :  46%|███████████████████▌                       | 102/224 [00:56<01:13,  1.65it/s]
Epoch 15 Iter 103: loss 0.19052. :  46%|███████████████████▌                       | 102/224 [00:56<01:13,  1.65it/s]
Epoch 15 Iter 103: loss 0.19052. :  46%|███████████████████▊                       | 103/224 [00:56<01:18,  1.54it/s]
Epoch 15 Iter 104: loss 0.17653. :  46%|███████████████████▊                       | 103/224 [00:57<01:18,  1.54it/s]
Epoch 15 Iter 104: loss 0.17653. :  46%|███████████████████▉                       | 104/224 [00:57<01:21,  1.47it/s]
Epoch 15 Iter 105: loss 0.18614. :  46%|███████████████████▉                       | 104/224 [00:58<01:21,  1.47it/s]
Epoch 15 Iter 105: loss 0.18614. :  47%|████████████████████▏                      | 105/224 [00:58<01:24,  1.41it/s]
Epoch 15 Iter 106: loss 0.16822. :  47%|████████████████████▏                      | 105/224 [00:59<01:24,  1.41it/s]
Epoch 15 Iter 106: loss 0.16822. :  47%|████████████████████▎                      | 106/224 [00:59<01:22,  1.42it/s]
Epoch 15 Iter 107: loss 0.16640. :  47%|████████████████████▎                      | 106/224 [00:59<01:22,  1.42it/s]
Epoch 15 Iter 107: loss 0.16640. :  48%|████████████████████▌                      | 107/224 [00:59<01:20,  1.46it/s]
Epoch 15 Iter 108: loss 0.17466. :  48%|████████████████████▌                      | 107/224 [01:00<01:20,  1.46it/s]
Epoch 15 Iter 108: loss 0.17466. :  48%|████████████████████▋                      | 108/224 [01:00<01:22,  1.40it/s]
Epoch 15 Iter 109: loss 0.18749. :  48%|████████████████████▋                      | 108/224 [01:01<01:22,  1.40it/s]
Epoch 15 Iter 109: loss 0.18749. :  49%|████████████████████▉                      | 109/224 [01:01<01:23,  1.37it/s]
Epoch 15 Iter 110: loss 0.18172. :  49%|████████████████████▉                      | 109/224 [01:01<01:23,  1.37it/s]
Epoch 15 Iter 110: loss 0.18172. :  49%|█████████████████████                      | 110/224 [01:01<01:18,  1.46it/s]
Epoch 15 Iter 111: loss 0.16886. :  49%|█████████████████████                      | 110/224 [01:02<01:18,  1.46it/s]
Epoch 15 Iter 111: loss 0.16886. :  50%|█████████████████████▎                     | 111/224 [01:02<01:15,  1.50it/s]
Epoch 15 Iter 112: loss 0.19167. :  50%|█████████████████████▎                     | 111/224 [01:03<01:15,  1.50it/s]
Epoch 15 Iter 112: loss 0.19167. :  50%|█████████████████████▌                     | 112/224 [01:03<01:10,  1.58it/s]
Epoch 15 Iter 113: loss 0.19051. :  50%|█████████████████████▌                     | 112/224 [01:03<01:10,  1.58it/s]
Epoch 15 Iter 113: loss 0.19051. :  50%|█████████████████████▋                     | 113/224 [01:03<01:08,  1.61it/s]
Epoch 15 Iter 114: loss 0.18181. :  50%|█████████████████████▋                     | 113/224 [01:04<01:08,  1.61it/s]
Epoch 15 Iter 114: loss 0.18181. :  51%|█████████████████████▉                     | 114/224 [01:04<01:09,  1.58it/s]
Epoch 15 Iter 115: loss 0.20756. :  51%|█████████████████████▉                     | 114/224 [01:04<01:09,  1.58it/s]
Epoch 15 Iter 115: loss 0.20756. :  51%|██████████████████████                     | 115/224 [01:04<01:06,  1.64it/s]
Epoch 15 Iter 116: loss 0.16292. :  51%|██████████████████████                     | 115/224 [01:05<01:06,  1.64it/s]
Epoch 15 Iter 116: loss 0.16292. :  52%|██████████████████████▎                    | 116/224 [01:05<01:04,  1.68it/s]
Epoch 15 Iter 117: loss 0.18149. :  52%|██████████████████████▎                    | 116/224 [01:06<01:04,  1.68it/s]
Epoch 15 Iter 117: loss 0.18149. :  52%|██████████████████████▍                    | 117/224 [01:06<01:02,  1.72it/s]
Epoch 15 Iter 118: loss 0.19101. :  52%|██████████████████████▍                    | 117/224 [01:06<01:02,  1.72it/s]
Epoch 15 Iter 118: loss 0.19101. :  53%|██████████████████████▋                    | 118/224 [01:06<00:59,  1.77it/s]
Epoch 15 Iter 119: loss 0.17527. :  53%|██████████████████████▋                    | 118/224 [01:07<00:59,  1.77it/s]
Epoch 15 Iter 119: loss 0.17527. :  53%|██████████████████████▊                    | 119/224 [01:07<01:01,  1.70it/s]
Epoch 15 Iter 120: loss 0.17684. :  53%|██████████████████████▊                    | 119/224 [01:07<01:01,  1.70it/s]
Epoch 15 Iter 120: loss 0.17684. :  54%|███████████████████████                    | 120/224 [01:07<01:01,  1.70it/s]
Epoch 15 Iter 121: loss 0.17491. :  54%|███████████████████████                    | 120/224 [01:08<01:01,  1.70it/s]
Epoch 15 Iter 121: loss 0.17491. :  54%|███████████████████████▏                   | 121/224 [01:08<00:59,  1.72it/s]
Epoch 15 Iter 122: loss 0.16386. :  54%|███████████████████████▏                   | 121/224 [01:08<00:59,  1.72it/s]
Epoch 15 Iter 122: loss 0.16386. :  54%|███████████████████████▍                   | 122/224 [01:08<00:58,  1.76it/s]
Epoch 15 Iter 123: loss 0.17477. :  54%|███████████████████████▍                   | 122/224 [01:09<00:58,  1.76it/s]
Epoch 15 Iter 123: loss 0.17477. :  55%|███████████████████████▌                   | 123/224 [01:09<00:57,  1.75it/s]
Epoch 15 Iter 124: loss 0.17889. :  55%|███████████████████████▌                   | 123/224 [01:10<00:57,  1.75it/s]
Epoch 15 Iter 124: loss 0.17889. :  55%|███████████████████████▊                   | 124/224 [01:10<01:02,  1.59it/s]
Epoch 15 Iter 125: loss 0.17852. :  55%|███████████████████████▊                   | 124/224 [01:11<01:02,  1.59it/s]
Epoch 15 Iter 125: loss 0.17852. :  56%|███████████████████████▉                   | 125/224 [01:11<01:06,  1.50it/s]
Epoch 15 Iter 126: loss 0.17701. :  56%|███████████████████████▉                   | 125/224 [01:11<01:06,  1.50it/s]
Epoch 15 Iter 126: loss 0.17701. :  56%|████████████████████████▏                  | 126/224 [01:11<01:03,  1.53it/s]
Epoch 15 Iter 127: loss 0.16458. :  56%|████████████████████████▏                  | 126/224 [01:12<01:03,  1.53it/s]
Epoch 15 Iter 127: loss 0.16458. :  57%|████████████████████████▍                  | 127/224 [01:12<00:59,  1.62it/s]
Epoch 15 Iter 128: loss 0.18317. :  57%|████████████████████████▍                  | 127/224 [01:12<00:59,  1.62it/s]
Epoch 15 Iter 128: loss 0.18317. :  57%|████████████████████████▌                  | 128/224 [01:12<01:02,  1.53it/s]
Epoch 15 Iter 129: loss 0.18742. :  57%|████████████████████████▌                  | 128/224 [01:13<01:02,  1.53it/s]
Epoch 15 Iter 129: loss 0.18742. :  58%|████████████████████████▊                  | 129/224 [01:13<01:05,  1.44it/s]
Epoch 15 Iter 130: loss 0.17279. :  58%|████████████████████████▊                  | 129/224 [01:14<01:05,  1.44it/s]
Epoch 15 Iter 130: loss 0.17279. :  58%|████████████████████████▉                  | 130/224 [01:14<01:07,  1.40it/s]
Epoch 15 Iter 131: loss 0.17168. :  58%|████████████████████████▉                  | 130/224 [01:15<01:07,  1.40it/s]
Epoch 15 Iter 131: loss 0.17168. :  58%|█████████████████████████▏                 | 131/224 [01:15<01:07,  1.39it/s]
Epoch 15 Iter 132: loss 0.17373. :  58%|█████████████████████████▏                 | 131/224 [01:15<01:07,  1.39it/s]
Epoch 15 Iter 132: loss 0.17373. :  59%|█████████████████████████▎                 | 132/224 [01:15<01:08,  1.35it/s]
Epoch 15 Iter 133: loss 0.18657. :  59%|█████████████████████████▎                 | 132/224 [01:16<01:08,  1.35it/s]
Epoch 15 Iter 133: loss 0.18657. :  59%|█████████████████████████▌                 | 133/224 [01:16<01:02,  1.45it/s]
Epoch 15 Iter 134: loss 0.18206. :  59%|█████████████████████████▌                 | 133/224 [01:17<01:02,  1.45it/s]
Epoch 15 Iter 134: loss 0.18206. :  60%|█████████████████████████▋                 | 134/224 [01:17<00:58,  1.55it/s]
Epoch 15 Iter 135: loss 0.18654. :  60%|█████████████████████████▋                 | 134/224 [01:17<00:58,  1.55it/s]
Epoch 15 Iter 135: loss 0.18654. :  60%|█████████████████████████▉                 | 135/224 [01:17<00:54,  1.63it/s]
Epoch 15 Iter 136: loss 0.20100. :  60%|█████████████████████████▉                 | 135/224 [01:18<00:54,  1.63it/s]
Epoch 15 Iter 136: loss 0.20100. :  61%|██████████████████████████                 | 136/224 [01:18<00:52,  1.69it/s]
Epoch 15 Iter 137: loss 0.17635. :  61%|██████████████████████████                 | 136/224 [01:18<00:52,  1.69it/s]
Epoch 15 Iter 137: loss 0.17635. :  61%|██████████████████████████▎                | 137/224 [01:18<00:49,  1.74it/s]
Epoch 15 Iter 138: loss 0.19220. :  61%|██████████████████████████▎                | 137/224 [01:19<00:49,  1.74it/s]
Epoch 15 Iter 138: loss 0.19220. :  62%|██████████████████████████▍                | 138/224 [01:19<00:52,  1.63it/s]
Epoch 15 Iter 139: loss 0.16503. :  62%|██████████████████████████▍                | 138/224 [01:20<00:52,  1.63it/s]
Epoch 15 Iter 139: loss 0.16503. :  62%|██████████████████████████▋                | 139/224 [01:20<00:53,  1.59it/s]
Epoch 15 Iter 140: loss 0.20567. :  62%|██████████████████████████▋                | 139/224 [01:20<00:53,  1.59it/s]
Epoch 15 Iter 140: loss 0.20567. :  62%|██████████████████████████▉                | 140/224 [01:20<00:50,  1.65it/s]
Epoch 15 Iter 141: loss 0.17461. :  62%|██████████████████████████▉                | 140/224 [01:21<00:50,  1.65it/s]
Epoch 15 Iter 141: loss 0.17461. :  63%|███████████████████████████                | 141/224 [01:21<00:48,  1.71it/s]
Epoch 15 Iter 142: loss 0.16677. :  63%|███████████████████████████                | 141/224 [01:21<00:48,  1.71it/s]
Epoch 15 Iter 142: loss 0.16677. :  63%|███████████████████████████▎               | 142/224 [01:21<00:50,  1.61it/s]
Epoch 15 Iter 143: loss 0.19516. :  63%|███████████████████████████▎               | 142/224 [01:22<00:50,  1.61it/s]
Epoch 15 Iter 143: loss 0.19516. :  64%|███████████████████████████▍               | 143/224 [01:22<00:50,  1.61it/s]
Epoch 15 Iter 144: loss 0.18010. :  64%|███████████████████████████▍               | 143/224 [01:23<00:50,  1.61it/s]
Epoch 15 Iter 144: loss 0.18010. :  64%|███████████████████████████▋               | 144/224 [01:23<00:47,  1.67it/s]
Epoch 15 Iter 145: loss 0.17898. :  64%|███████████████████████████▋               | 144/224 [01:23<00:47,  1.67it/s]
Epoch 15 Iter 145: loss 0.17898. :  65%|███████████████████████████▊               | 145/224 [01:23<00:46,  1.72it/s]
Epoch 15 Iter 146: loss 0.17099. :  65%|███████████████████████████▊               | 145/224 [01:24<00:46,  1.72it/s]
Epoch 15 Iter 146: loss 0.17099. :  65%|████████████████████████████               | 146/224 [01:24<00:48,  1.60it/s]
Epoch 15 Iter 147: loss 0.18933. :  65%|████████████████████████████               | 146/224 [01:24<00:48,  1.60it/s]
Epoch 15 Iter 147: loss 0.18933. :  66%|████████████████████████████▏              | 147/224 [01:24<00:46,  1.65it/s]
Epoch 15 Iter 148: loss 0.19032. :  66%|████████████████████████████▏              | 147/224 [01:25<00:46,  1.65it/s]
Epoch 15 Iter 148: loss 0.19032. :  66%|████████████████████████████▍              | 148/224 [01:25<00:44,  1.71it/s]
Epoch 15 Iter 149: loss 0.17761. :  66%|████████████████████████████▍              | 148/224 [01:25<00:44,  1.71it/s]
Epoch 15 Iter 149: loss 0.17761. :  67%|████████████████████████████▌              | 149/224 [01:25<00:43,  1.74it/s]
Epoch 15 Iter 150: loss 0.15654. :  67%|████████████████████████████▌              | 149/224 [01:26<00:43,  1.74it/s]
Epoch 15 Iter 150: loss 0.15654. :  67%|████████████████████████████▊              | 150/224 [01:26<00:41,  1.77it/s]
Epoch 15 Iter 151: loss 0.17897. :  67%|████████████████████████████▊              | 150/224 [01:27<00:41,  1.77it/s]
Epoch 15 Iter 151: loss 0.17897. :  67%|████████████████████████████▉              | 151/224 [01:27<00:40,  1.80it/s]
Epoch 15 Iter 152: loss 0.18704. :  67%|████████████████████████████▉              | 151/224 [01:27<00:40,  1.80it/s]
Epoch 15 Iter 152: loss 0.18704. :  68%|█████████████████████████████▏             | 152/224 [01:27<00:39,  1.83it/s]
Epoch 15 Iter 153: loss 0.17614. :  68%|█████████████████████████████▏             | 152/224 [01:28<00:39,  1.83it/s]
Epoch 15 Iter 153: loss 0.17614. :  68%|█████████████████████████████▎             | 153/224 [01:28<00:38,  1.85it/s]
Epoch 15 Iter 154: loss 0.17908. :  68%|█████████████████████████████▎             | 153/224 [01:28<00:38,  1.85it/s]
Epoch 15 Iter 154: loss 0.17908. :  69%|█████████████████████████████▌             | 154/224 [01:28<00:38,  1.83it/s]
Epoch 15 Iter 155: loss 0.15282. :  69%|█████████████████████████████▌             | 154/224 [01:29<00:38,  1.83it/s]
Epoch 15 Iter 155: loss 0.15282. :  69%|█████████████████████████████▊             | 155/224 [01:29<00:42,  1.62it/s]
Epoch 15 Iter 156: loss 0.18166. :  69%|█████████████████████████████▊             | 155/224 [01:29<00:42,  1.62it/s]
Epoch 15 Iter 156: loss 0.18166. :  70%|█████████████████████████████▉             | 156/224 [01:29<00:40,  1.69it/s]
Epoch 15 Iter 157: loss 0.17796. :  70%|█████████████████████████████▉             | 156/224 [01:30<00:40,  1.69it/s]
Epoch 15 Iter 157: loss 0.17796. :  70%|██████████████████████████████▏            | 157/224 [01:30<00:38,  1.73it/s]
Epoch 15 Iter 158: loss 0.16182. :  70%|██████████████████████████████▏            | 157/224 [01:31<00:38,  1.73it/s]
Epoch 15 Iter 158: loss 0.16182. :  71%|██████████████████████████████▎            | 158/224 [01:31<00:37,  1.76it/s]
Epoch 15 Iter 159: loss 0.18710. :  71%|██████████████████████████████▎            | 158/224 [01:31<00:37,  1.76it/s]
Epoch 15 Iter 159: loss 0.18710. :  71%|██████████████████████████████▌            | 159/224 [01:31<00:37,  1.72it/s]
Epoch 15 Iter 160: loss 0.16757. :  71%|██████████████████████████████▌            | 159/224 [01:32<00:37,  1.72it/s]
Epoch 15 Iter 160: loss 0.16757. :  71%|██████████████████████████████▋            | 160/224 [01:32<00:40,  1.58it/s]
Epoch 15 Iter 161: loss 0.16782. :  71%|██████████████████████████████▋            | 160/224 [01:32<00:40,  1.58it/s]
Epoch 15 Iter 161: loss 0.16782. :  72%|██████████████████████████████▉            | 161/224 [01:32<00:37,  1.67it/s]
Epoch 15 Iter 162: loss 0.17787. :  72%|██████████████████████████████▉            | 161/224 [01:33<00:37,  1.67it/s]
Epoch 15 Iter 162: loss 0.17787. :  72%|███████████████████████████████            | 162/224 [01:33<00:40,  1.54it/s]
Epoch 15 Iter 163: loss 0.19806. :  72%|███████████████████████████████            | 162/224 [01:34<00:40,  1.54it/s]
Epoch 15 Iter 163: loss 0.19806. :  73%|███████████████████████████████▎           | 163/224 [01:34<00:41,  1.46it/s]
Epoch 15 Iter 164: loss 0.18508. :  73%|███████████████████████████████▎           | 163/224 [01:35<00:41,  1.46it/s]
Epoch 15 Iter 164: loss 0.18508. :  73%|███████████████████████████████▍           | 164/224 [01:35<00:42,  1.41it/s]
Epoch 15 Iter 165: loss 0.18324. :  73%|███████████████████████████████▍           | 164/224 [01:35<00:42,  1.41it/s]
Epoch 15 Iter 165: loss 0.18324. :  74%|███████████████████████████████▋           | 165/224 [01:35<00:41,  1.43it/s]
Epoch 15 Iter 166: loss 0.18055. :  74%|███████████████████████████████▋           | 165/224 [01:36<00:41,  1.43it/s]
Epoch 15 Iter 166: loss 0.18055. :  74%|███████████████████████████████▊           | 166/224 [01:36<00:37,  1.53it/s]
Epoch 15 Iter 167: loss 0.18179. :  74%|███████████████████████████████▊           | 166/224 [01:37<00:37,  1.53it/s]
Epoch 15 Iter 167: loss 0.18179. :  75%|████████████████████████████████           | 167/224 [01:37<00:39,  1.46it/s]
Epoch 15 Iter 168: loss 0.18640. :  75%|████████████████████████████████           | 167/224 [01:37<00:39,  1.46it/s]
Epoch 15 Iter 168: loss 0.18640. :  75%|████████████████████████████████▎          | 168/224 [01:37<00:36,  1.52it/s]
Epoch 15 Iter 169: loss 0.18579. :  75%|████████████████████████████████▎          | 168/224 [01:38<00:36,  1.52it/s]
Epoch 15 Iter 169: loss 0.18579. :  75%|████████████████████████████████▍          | 169/224 [01:38<00:36,  1.53it/s]
Epoch 15 Iter 170: loss 0.17957. :  75%|████████████████████████████████▍          | 169/224 [01:39<00:36,  1.53it/s]
Epoch 15 Iter 170: loss 0.17957. :  76%|████████████████████████████████▋          | 170/224 [01:39<00:36,  1.47it/s]
Epoch 15 Iter 171: loss 0.19251. :  76%|████████████████████████████████▋          | 170/224 [01:39<00:36,  1.47it/s]
Epoch 15 Iter 171: loss 0.19251. :  76%|████████████████████████████████▊          | 171/224 [01:39<00:36,  1.46it/s]
Epoch 15 Iter 172: loss 0.17515. :  76%|████████████████████████████████▊          | 171/224 [01:40<00:36,  1.46it/s]
Epoch 15 Iter 172: loss 0.17515. :  77%|█████████████████████████████████          | 172/224 [01:40<00:34,  1.53it/s]
Epoch 15 Iter 173: loss 0.17839. :  77%|█████████████████████████████████          | 172/224 [01:41<00:34,  1.53it/s]
Epoch 15 Iter 173: loss 0.17839. :  77%|█████████████████████████████████▏         | 173/224 [01:41<00:33,  1.54it/s]
Epoch 15 Iter 174: loss 0.21243. :  77%|█████████████████████████████████▏         | 173/224 [01:41<00:33,  1.54it/s]
Epoch 15 Iter 174: loss 0.21243. :  78%|█████████████████████████████████▍         | 174/224 [01:41<00:31,  1.60it/s]
Epoch 15 Iter 175: loss 0.17621. :  78%|█████████████████████████████████▍         | 174/224 [01:42<00:31,  1.60it/s]
Epoch 15 Iter 175: loss 0.17621. :  78%|█████████████████████████████████▌         | 175/224 [01:42<00:31,  1.53it/s]
Epoch 15 Iter 176: loss 0.16931. :  78%|█████████████████████████████████▌         | 175/224 [01:43<00:31,  1.53it/s]
Epoch 15 Iter 176: loss 0.16931. :  79%|█████████████████████████████████▊         | 176/224 [01:43<00:31,  1.53it/s]
Epoch 15 Iter 177: loss 0.17074. :  79%|█████████████████████████████████▊         | 176/224 [01:43<00:31,  1.53it/s]
Epoch 15 Iter 177: loss 0.17074. :  79%|█████████████████████████████████▉         | 177/224 [01:43<00:29,  1.62it/s]
Epoch 15 Iter 178: loss 0.15806. :  79%|█████████████████████████████████▉         | 177/224 [01:44<00:29,  1.62it/s]
Epoch 15 Iter 178: loss 0.15806. :  79%|██████████████████████████████████▏        | 178/224 [01:44<00:26,  1.71it/s]
Epoch 15 Iter 179: loss 0.18862. :  79%|██████████████████████████████████▏        | 178/224 [01:44<00:26,  1.71it/s]
Epoch 15 Iter 179: loss 0.18862. :  80%|██████████████████████████████████▎        | 179/224 [01:44<00:26,  1.69it/s]
Epoch 15 Iter 180: loss 0.18398. :  80%|██████████████████████████████████▎        | 179/224 [01:45<00:26,  1.69it/s]
Epoch 15 Iter 180: loss 0.18398. :  80%|██████████████████████████████████▌        | 180/224 [01:45<00:26,  1.69it/s]
Epoch 15 Iter 181: loss 0.15897. :  80%|██████████████████████████████████▌        | 180/224 [01:45<00:26,  1.69it/s]
Epoch 15 Iter 181: loss 0.15897. :  81%|██████████████████████████████████▋        | 181/224 [01:45<00:25,  1.71it/s]
Epoch 15 Iter 182: loss 0.17540. :  81%|██████████████████████████████████▋        | 181/224 [01:46<00:25,  1.71it/s]
Epoch 15 Iter 182: loss 0.17540. :  81%|██████████████████████████████████▉        | 182/224 [01:46<00:26,  1.56it/s]
Epoch 15 Iter 183: loss 0.18004. :  81%|██████████████████████████████████▉        | 182/224 [01:47<00:26,  1.56it/s]
Epoch 15 Iter 183: loss 0.18004. :  82%|███████████████████████████████████▏       | 183/224 [01:47<00:24,  1.64it/s]
Epoch 15 Iter 184: loss 0.17419. :  82%|███████████████████████████████████▏       | 183/224 [01:47<00:24,  1.64it/s]
Epoch 15 Iter 184: loss 0.17419. :  82%|███████████████████████████████████▎       | 184/224 [01:47<00:23,  1.70it/s]
Epoch 15 Iter 185: loss 0.15664. :  82%|███████████████████████████████████▎       | 184/224 [01:48<00:23,  1.70it/s]
Epoch 15 Iter 185: loss 0.15664. :  83%|███████████████████████████████████▌       | 185/224 [01:48<00:22,  1.73it/s]
Epoch 15 Iter 186: loss 0.20330. :  83%|███████████████████████████████████▌       | 185/224 [01:48<00:22,  1.73it/s]
Epoch 15 Iter 186: loss 0.20330. :  83%|███████████████████████████████████▋       | 186/224 [01:48<00:21,  1.76it/s]
Epoch 15 Iter 187: loss 0.17478. :  83%|███████████████████████████████████▋       | 186/224 [01:49<00:21,  1.76it/s]
Epoch 15 Iter 187: loss 0.17478. :  83%|███████████████████████████████████▉       | 187/224 [01:49<00:20,  1.78it/s]
Epoch 15 Iter 188: loss 0.19416. :  83%|███████████████████████████████████▉       | 187/224 [01:50<00:20,  1.78it/s]
Epoch 15 Iter 188: loss 0.19416. :  84%|████████████████████████████████████       | 188/224 [01:50<00:20,  1.72it/s]
Epoch 15 Iter 189: loss 0.18518. :  84%|████████████████████████████████████       | 188/224 [01:50<00:20,  1.72it/s]
Epoch 15 Iter 189: loss 0.18518. :  84%|████████████████████████████████████▎      | 189/224 [01:50<00:20,  1.74it/s]
Epoch 15 Iter 190: loss 0.17595. :  84%|████████████████████████████████████▎      | 189/224 [01:51<00:20,  1.74it/s]
Epoch 15 Iter 190: loss 0.17595. :  85%|████████████████████████████████████▍      | 190/224 [01:51<00:19,  1.77it/s]
Epoch 15 Iter 191: loss 0.17372. :  85%|████████████████████████████████████▍      | 190/224 [01:51<00:19,  1.77it/s]
Epoch 15 Iter 191: loss 0.17372. :  85%|████████████████████████████████████▋      | 191/224 [01:51<00:18,  1.74it/s]
Epoch 15 Iter 192: loss 0.18181. :  85%|████████████████████████████████████▋      | 191/224 [01:52<00:18,  1.74it/s]
Epoch 15 Iter 192: loss 0.18181. :  86%|████████████████████████████████████▊      | 192/224 [01:52<00:19,  1.66it/s]
Epoch 15 Iter 193: loss 0.17425. :  86%|████████████████████████████████████▊      | 192/224 [01:53<00:19,  1.66it/s]
Epoch 15 Iter 193: loss 0.17425. :  86%|█████████████████████████████████████      | 193/224 [01:53<00:20,  1.52it/s]
Epoch 15 Iter 194: loss 0.19569. :  86%|█████████████████████████████████████      | 193/224 [01:53<00:20,  1.52it/s]
Epoch 15 Iter 194: loss 0.19569. :  87%|█████████████████████████████████████▏     | 194/224 [01:53<00:18,  1.58it/s]
Epoch 15 Iter 195: loss 0.17660. :  87%|█████████████████████████████████████▏     | 194/224 [01:54<00:18,  1.58it/s]
Epoch 15 Iter 195: loss 0.17660. :  87%|█████████████████████████████████████▍     | 195/224 [01:54<00:19,  1.49it/s]
Epoch 15 Iter 196: loss 0.17602. :  87%|█████████████████████████████████████▍     | 195/224 [01:55<00:19,  1.49it/s]
Epoch 15 Iter 196: loss 0.17602. :  88%|█████████████████████████████████████▋     | 196/224 [01:55<00:19,  1.46it/s]
Epoch 15 Iter 197: loss 0.18280. :  88%|█████████████████████████████████████▋     | 196/224 [01:55<00:19,  1.46it/s]
Epoch 15 Iter 197: loss 0.18280. :  88%|█████████████████████████████████████▊     | 197/224 [01:55<00:17,  1.57it/s]
Epoch 15 Iter 198: loss 0.18298. :  88%|█████████████████████████████████████▊     | 197/224 [01:56<00:17,  1.57it/s]
Epoch 15 Iter 198: loss 0.18298. :  88%|██████████████████████████████████████     | 198/224 [01:56<00:15,  1.66it/s]
Epoch 15 Iter 199: loss 0.17331. :  88%|██████████████████████████████████████     | 198/224 [01:56<00:15,  1.66it/s]
Epoch 15 Iter 199: loss 0.17331. :  89%|██████████████████████████████████████▏    | 199/224 [01:56<00:15,  1.60it/s]
Epoch 15 Iter 200: loss 0.17540. :  89%|██████████████████████████████████████▏    | 199/224 [01:57<00:15,  1.60it/s]
Epoch 15 Iter 200: loss 0.17540. :  89%|██████████████████████████████████████▍    | 200/224 [01:57<00:15,  1.54it/s]
Epoch 15 Iter 201: loss 0.16656. :  89%|██████████████████████████████████████▍    | 200/224 [01:58<00:15,  1.54it/s]
Epoch 15 Iter 201: loss 0.16656. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:14,  1.61it/s]
Epoch 15 Iter 202: loss 0.15848. :  90%|██████████████████████████████████████▌    | 201/224 [01:58<00:14,  1.61it/s]
Epoch 15 Iter 202: loss 0.15848. :  90%|██████████████████████████████████████▊    | 202/224 [01:58<00:13,  1.67it/s]
Epoch 15 Iter 203: loss 0.17669. :  90%|██████████████████████████████████████▊    | 202/224 [01:59<00:13,  1.67it/s]
Epoch 15 Iter 203: loss 0.17669. :  91%|██████████████████████████████████████▉    | 203/224 [01:59<00:12,  1.72it/s]
Epoch 15 Iter 204: loss 0.18824. :  91%|██████████████████████████████████████▉    | 203/224 [01:59<00:12,  1.72it/s]
Epoch 15 Iter 204: loss 0.18824. :  91%|███████████████████████████████████████▏   | 204/224 [01:59<00:11,  1.75it/s]
Epoch 15 Iter 205: loss 0.17949. :  91%|███████████████████████████████████████▏   | 204/224 [02:00<00:11,  1.75it/s]
Epoch 15 Iter 205: loss 0.17949. :  92%|███████████████████████████████████████▎   | 205/224 [02:00<00:10,  1.78it/s]
Epoch 15 Iter 206: loss 0.16609. :  92%|███████████████████████████████████████▎   | 205/224 [02:00<00:10,  1.78it/s]
Epoch 15 Iter 206: loss 0.16609. :  92%|███████████████████████████████████████▌   | 206/224 [02:00<00:10,  1.76it/s]
Epoch 15 Iter 207: loss 0.22084. :  92%|███████████████████████████████████████▌   | 206/224 [02:01<00:10,  1.76it/s]
Epoch 15 Iter 207: loss 0.22084. :  92%|███████████████████████████████████████▋   | 207/224 [02:01<00:10,  1.60it/s]
Epoch 15 Iter 208: loss 0.18925. :  92%|███████████████████████████████████████▋   | 207/224 [02:02<00:10,  1.60it/s]
Epoch 15 Iter 208: loss 0.18925. :  93%|███████████████████████████████████████▉   | 208/224 [02:02<00:09,  1.62it/s]
Epoch 15 Iter 209: loss 0.15089. :  93%|███████████████████████████████████████▉   | 208/224 [02:02<00:09,  1.62it/s]
Epoch 15 Iter 209: loss 0.15089. :  93%|████████████████████████████████████████   | 209/224 [02:02<00:08,  1.68it/s]
Epoch 15 Iter 210: loss 0.18905. :  93%|████████████████████████████████████████   | 209/224 [02:03<00:08,  1.68it/s]
Epoch 15 Iter 210: loss 0.18905. :  94%|████████████████████████████████████████▎  | 210/224 [02:03<00:08,  1.67it/s]
Epoch 15 Iter 211: loss 0.15945. :  94%|████████████████████████████████████████▎  | 210/224 [02:04<00:08,  1.67it/s]
Epoch 15 Iter 211: loss 0.15945. :  94%|████████████████████████████████████████▌  | 211/224 [02:04<00:07,  1.72it/s]
Epoch 15 Iter 212: loss 0.16565. :  94%|████████████████████████████████████████▌  | 211/224 [02:04<00:07,  1.72it/s]
Epoch 15 Iter 212: loss 0.16565. :  95%|████████████████████████████████████████▋  | 212/224 [02:04<00:07,  1.61it/s]
Epoch 15 Iter 213: loss 0.16791. :  95%|████████████████████████████████████████▋  | 212/224 [02:05<00:07,  1.61it/s]
Epoch 15 Iter 213: loss 0.16791. :  95%|████████████████████████████████████████▉  | 213/224 [02:05<00:06,  1.61it/s]
Epoch 15 Iter 214: loss 0.17176. :  95%|████████████████████████████████████████▉  | 213/224 [02:06<00:06,  1.61it/s]
Epoch 15 Iter 214: loss 0.17176. :  96%|█████████████████████████████████████████  | 214/224 [02:06<00:06,  1.49it/s]
Epoch 15 Iter 215: loss 0.17258. :  96%|█████████████████████████████████████████  | 214/224 [02:06<00:06,  1.49it/s]
Epoch 15 Iter 215: loss 0.17258. :  96%|█████████████████████████████████████████▎ | 215/224 [02:06<00:05,  1.58it/s]
Epoch 15 Iter 216: loss 0.18470. :  96%|█████████████████████████████████████████▎ | 215/224 [02:07<00:05,  1.58it/s]
Epoch 15 Iter 216: loss 0.18470. :  96%|█████████████████████████████████████████▍ | 216/224 [02:07<00:05,  1.59it/s]
Epoch 15 Iter 217: loss 0.17188. :  96%|█████████████████████████████████████████▍ | 216/224 [02:08<00:05,  1.59it/s]
Epoch 15 Iter 217: loss 0.17188. :  97%|█████████████████████████████████████████▋ | 217/224 [02:08<00:04,  1.51it/s]
Epoch 15 Iter 218: loss 0.17309. :  97%|█████████████████████████████████████████▋ | 217/224 [02:08<00:04,  1.51it/s]
Epoch 15 Iter 218: loss 0.17309. :  97%|█████████████████████████████████████████▊ | 218/224 [02:08<00:03,  1.61it/s]
Epoch 15 Iter 219: loss 0.15502. :  97%|█████████████████████████████████████████▊ | 218/224 [02:09<00:03,  1.61it/s]
Epoch 15 Iter 219: loss 0.15502. :  98%|██████████████████████████████████████████ | 219/224 [02:09<00:03,  1.62it/s]
Epoch 15 Iter 220: loss 0.17619. :  98%|██████████████████████████████████████████ | 219/224 [02:09<00:03,  1.62it/s]
Epoch 15 Iter 220: loss 0.17619. :  98%|██████████████████████████████████████████▏| 220/224 [02:09<00:02,  1.63it/s]
Epoch 15 Iter 221: loss 0.16413. :  98%|██████████████████████████████████████████▏| 220/224 [02:10<00:02,  1.63it/s]
Epoch 15 Iter 221: loss 0.16413. :  99%|██████████████████████████████████████████▍| 221/224 [02:10<00:01,  1.68it/s]
Epoch 15 Iter 222: loss 0.18064. :  99%|██████████████████████████████████████████▍| 221/224 [02:10<00:01,  1.68it/s]
Epoch 15 Iter 222: loss 0.18064. :  99%|██████████████████████████████████████████▌| 222/224 [02:10<00:01,  1.74it/s]
Epoch 15 Iter 223: loss 0.17153. :  99%|██████████████████████████████████████████▌| 222/224 [02:11<00:01,  1.74it/s]
Epoch 15 Iter 223: loss 0.17153. : 100%|██████████████████████████████████████████▊| 223/224 [02:11<00:00,  1.64it/s]
Epoch 15 Iter 224: loss 0.18783. : 100%|██████████████████████████████████████████▊| 223/224 [02:12<00:00,  1.64it/s]
Epoch 15 Iter 224: loss 0.18783. : 100%|███████████████████████████████████████████| 224/224 [02:12<00:00,  1.64it/s]
Epoch 15 Iter 224: loss 0.18783. : 100%|███████████████████████████████████████████| 224/224 [02:12<00:00,  1.69it/s]

    Train loss: 0.17812
    Valid loss: 0.18071
       Valid loss recons: 0.17462
       Valid loss KL-D:   60.8804
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.16793. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 16 Iter 1: loss 0.16793. :   0%|▏                                              | 1/224 [00:00<02:06,  1.77it/s]
Epoch 16 Iter 2: loss 0.19075. :   0%|▏                                              | 1/224 [00:01<02:06,  1.77it/s]
Epoch 16 Iter 2: loss 0.19075. :   1%|▍                                              | 2/224 [00:01<02:00,  1.85it/s]
Epoch 16 Iter 3: loss 0.18662. :   1%|▍                                              | 2/224 [00:01<02:00,  1.85it/s]
Epoch 16 Iter 3: loss 0.18662. :   1%|▋                                              | 3/224 [00:01<02:05,  1.77it/s]
Epoch 16 Iter 4: loss 0.18619. :   1%|▋                                              | 3/224 [00:02<02:05,  1.77it/s]
Epoch 16 Iter 4: loss 0.18619. :   2%|▊                                              | 4/224 [00:02<02:03,  1.79it/s]
Epoch 16 Iter 5: loss 0.18704. :   2%|▊                                              | 4/224 [00:02<02:03,  1.79it/s]
Epoch 16 Iter 5: loss 0.18704. :   2%|█                                              | 5/224 [00:02<01:59,  1.83it/s]
Epoch 16 Iter 6: loss 0.16360. :   2%|█                                              | 5/224 [00:03<01:59,  1.83it/s]
Epoch 16 Iter 6: loss 0.16360. :   3%|█▎                                             | 6/224 [00:03<01:58,  1.84it/s]
Epoch 16 Iter 7: loss 0.18097. :   3%|█▎                                             | 6/224 [00:03<01:58,  1.84it/s]
Epoch 16 Iter 7: loss 0.18097. :   3%|█▍                                             | 7/224 [00:03<02:01,  1.78it/s]
Epoch 16 Iter 8: loss 0.18120. :   3%|█▍                                             | 7/224 [00:04<02:01,  1.78it/s]
Epoch 16 Iter 8: loss 0.18120. :   4%|█▋                                             | 8/224 [00:04<02:09,  1.66it/s]
Epoch 16 Iter 9: loss 0.15973. :   4%|█▋                                             | 8/224 [00:05<02:09,  1.66it/s]
Epoch 16 Iter 9: loss 0.15973. :   4%|█▉                                             | 9/224 [00:05<02:08,  1.68it/s]
Epoch 16 Iter 10: loss 0.17953. :   4%|█▊                                            | 9/224 [00:05<02:08,  1.68it/s]
Epoch 16 Iter 10: loss 0.17953. :   4%|██                                           | 10/224 [00:05<02:19,  1.53it/s]
Epoch 16 Iter 11: loss 0.16470. :   4%|██                                           | 10/224 [00:06<02:19,  1.53it/s]
Epoch 16 Iter 11: loss 0.16470. :   5%|██▏                                          | 11/224 [00:06<02:11,  1.62it/s]
Epoch 16 Iter 12: loss 0.17940. :   5%|██▏                                          | 11/224 [00:07<02:11,  1.62it/s]
Epoch 16 Iter 12: loss 0.17940. :   5%|██▍                                          | 12/224 [00:07<02:08,  1.65it/s]
Epoch 16 Iter 13: loss 0.18077. :   5%|██▍                                          | 12/224 [00:07<02:08,  1.65it/s]
Epoch 16 Iter 13: loss 0.18077. :   6%|██▌                                          | 13/224 [00:07<02:03,  1.70it/s]
Epoch 16 Iter 14: loss 0.19791. :   6%|██▌                                          | 13/224 [00:08<02:03,  1.70it/s]
Epoch 16 Iter 14: loss 0.19791. :   6%|██▊                                          | 14/224 [00:08<01:59,  1.75it/s]
Epoch 16 Iter 15: loss 0.19273. :   6%|██▊                                          | 14/224 [00:08<01:59,  1.75it/s]
Epoch 16 Iter 15: loss 0.19273. :   7%|███                                          | 15/224 [00:08<01:56,  1.79it/s]
Epoch 16 Iter 16: loss 0.19522. :   7%|███                                          | 15/224 [00:09<01:56,  1.79it/s]
Epoch 16 Iter 16: loss 0.19522. :   7%|███▏                                         | 16/224 [00:09<01:53,  1.83it/s]
Epoch 16 Iter 17: loss 0.18427. :   7%|███▏                                         | 16/224 [00:09<01:53,  1.83it/s]
Epoch 16 Iter 17: loss 0.18427. :   8%|███▍                                         | 17/224 [00:09<01:50,  1.87it/s]
Epoch 16 Iter 18: loss 0.18972. :   8%|███▍                                         | 17/224 [00:10<01:50,  1.87it/s]
Epoch 16 Iter 18: loss 0.18972. :   8%|███▌                                         | 18/224 [00:10<01:48,  1.90it/s]
Epoch 16 Iter 19: loss 0.19568. :   8%|███▌                                         | 18/224 [00:10<01:48,  1.90it/s]
Epoch 16 Iter 19: loss 0.19568. :   8%|███▊                                         | 19/224 [00:10<01:46,  1.93it/s]
Epoch 16 Iter 20: loss 0.20206. :   8%|███▊                                         | 19/224 [00:11<01:46,  1.93it/s]
Epoch 16 Iter 20: loss 0.20206. :   9%|████                                         | 20/224 [00:11<01:44,  1.94it/s]
Epoch 16 Iter 21: loss 0.18084. :   9%|████                                         | 20/224 [00:11<01:44,  1.94it/s]
Epoch 16 Iter 21: loss 0.18084. :   9%|████▏                                        | 21/224 [00:11<01:43,  1.96it/s]
Epoch 16 Iter 22: loss 0.18190. :   9%|████▏                                        | 21/224 [00:12<01:43,  1.96it/s]
Epoch 16 Iter 22: loss 0.18190. :  10%|████▍                                        | 22/224 [00:12<01:42,  1.96it/s]
Epoch 16 Iter 23: loss 0.18241. :  10%|████▍                                        | 22/224 [00:12<01:42,  1.96it/s]
Epoch 16 Iter 23: loss 0.18241. :  10%|████▌                                        | 23/224 [00:12<01:48,  1.85it/s]
Epoch 16 Iter 24: loss 0.17640. :  10%|████▌                                        | 23/224 [00:13<01:48,  1.85it/s]
Epoch 16 Iter 24: loss 0.17640. :  11%|████▊                                        | 24/224 [00:13<01:46,  1.88it/s]
Epoch 16 Iter 25: loss 0.17666. :  11%|████▊                                        | 24/224 [00:13<01:46,  1.88it/s]
Epoch 16 Iter 25: loss 0.17666. :  11%|█████                                        | 25/224 [00:13<01:44,  1.91it/s]
Epoch 16 Iter 26: loss 0.16825. :  11%|█████                                        | 25/224 [00:14<01:44,  1.91it/s]
Epoch 16 Iter 26: loss 0.16825. :  12%|█████▏                                       | 26/224 [00:14<01:42,  1.93it/s]
Epoch 16 Iter 27: loss 0.18343. :  12%|█████▏                                       | 26/224 [00:14<01:42,  1.93it/s]
Epoch 16 Iter 27: loss 0.18343. :  12%|█████▍                                       | 27/224 [00:14<01:42,  1.92it/s]
Epoch 16 Iter 28: loss 0.16947. :  12%|█████▍                                       | 27/224 [00:15<01:42,  1.92it/s]
Epoch 16 Iter 28: loss 0.16947. :  12%|█████▋                                       | 28/224 [00:15<01:41,  1.93it/s]
Epoch 16 Iter 29: loss 0.18300. :  12%|█████▋                                       | 28/224 [00:15<01:41,  1.93it/s]
Epoch 16 Iter 29: loss 0.18300. :  13%|█████▊                                       | 29/224 [00:15<01:41,  1.93it/s]
Epoch 16 Iter 30: loss 0.16790. :  13%|█████▊                                       | 29/224 [00:16<01:41,  1.93it/s]
Epoch 16 Iter 30: loss 0.16790. :  13%|██████                                       | 30/224 [00:16<01:41,  1.91it/s]
Epoch 16 Iter 31: loss 0.15902. :  13%|██████                                       | 30/224 [00:16<01:41,  1.91it/s]
Epoch 16 Iter 31: loss 0.15902. :  14%|██████▏                                      | 31/224 [00:16<01:40,  1.92it/s]
Epoch 16 Iter 32: loss 0.16724. :  14%|██████▏                                      | 31/224 [00:17<01:40,  1.92it/s]
Epoch 16 Iter 32: loss 0.16724. :  14%|██████▍                                      | 32/224 [00:17<01:38,  1.94it/s]
Epoch 16 Iter 33: loss 0.18018. :  14%|██████▍                                      | 32/224 [00:17<01:38,  1.94it/s]
Epoch 16 Iter 33: loss 0.18018. :  15%|██████▋                                      | 33/224 [00:17<01:37,  1.96it/s]
Epoch 16 Iter 34: loss 0.16594. :  15%|██████▋                                      | 33/224 [00:18<01:37,  1.96it/s]
Epoch 16 Iter 34: loss 0.16594. :  15%|██████▊                                      | 34/224 [00:18<01:37,  1.96it/s]
Epoch 16 Iter 35: loss 0.18029. :  15%|██████▊                                      | 34/224 [00:18<01:37,  1.96it/s]
Epoch 16 Iter 35: loss 0.18029. :  16%|███████                                      | 35/224 [00:18<01:35,  1.97it/s]
Epoch 16 Iter 36: loss 0.15914. :  16%|███████                                      | 35/224 [00:19<01:35,  1.97it/s]
Epoch 16 Iter 36: loss 0.15914. :  16%|███████▏                                     | 36/224 [00:19<01:34,  1.99it/s]
Epoch 16 Iter 37: loss 0.19151. :  16%|███████▏                                     | 36/224 [00:20<01:34,  1.99it/s]
Epoch 16 Iter 37: loss 0.19151. :  17%|███████▍                                     | 37/224 [00:20<01:36,  1.93it/s]
Epoch 16 Iter 38: loss 0.16832. :  17%|███████▍                                     | 37/224 [00:20<01:36,  1.93it/s]
Epoch 16 Iter 38: loss 0.16832. :  17%|███████▋                                     | 38/224 [00:20<01:35,  1.95it/s]
Epoch 16 Iter 39: loss 0.19006. :  17%|███████▋                                     | 38/224 [00:21<01:35,  1.95it/s]
Epoch 16 Iter 39: loss 0.19006. :  17%|███████▊                                     | 39/224 [00:21<01:33,  1.98it/s]
Epoch 16 Iter 40: loss 0.17171. :  17%|███████▊                                     | 39/224 [00:21<01:33,  1.98it/s]
Epoch 16 Iter 40: loss 0.17171. :  18%|████████                                     | 40/224 [00:21<01:32,  1.98it/s]
Epoch 16 Iter 41: loss 0.17883. :  18%|████████                                     | 40/224 [00:22<01:32,  1.98it/s]
Epoch 16 Iter 41: loss 0.17883. :  18%|████████▏                                    | 41/224 [00:22<01:32,  1.99it/s]
Epoch 16 Iter 42: loss 0.19959. :  18%|████████▏                                    | 41/224 [00:22<01:32,  1.99it/s]
Epoch 16 Iter 42: loss 0.19959. :  19%|████████▍                                    | 42/224 [00:22<01:31,  1.99it/s]
Epoch 16 Iter 43: loss 0.17617. :  19%|████████▍                                    | 42/224 [00:23<01:31,  1.99it/s]
Epoch 16 Iter 43: loss 0.17617. :  19%|████████▋                                    | 43/224 [00:23<01:35,  1.89it/s]
Epoch 16 Iter 44: loss 0.16140. :  19%|████████▋                                    | 43/224 [00:24<01:35,  1.89it/s]
Epoch 16 Iter 44: loss 0.16140. :  20%|████████▊                                    | 44/224 [00:24<02:02,  1.47it/s]
Epoch 16 Iter 45: loss 0.17119. :  20%|████████▊                                    | 44/224 [00:24<02:02,  1.47it/s]
Epoch 16 Iter 45: loss 0.17119. :  20%|█████████                                    | 45/224 [00:24<01:52,  1.59it/s]
Epoch 16 Iter 46: loss 0.17552. :  20%|█████████                                    | 45/224 [00:25<01:52,  1.59it/s]
Epoch 16 Iter 46: loss 0.17552. :  21%|█████████▏                                   | 46/224 [00:25<01:44,  1.70it/s]
Epoch 16 Iter 47: loss 0.17868. :  21%|█████████▏                                   | 46/224 [00:25<01:44,  1.70it/s]
Epoch 16 Iter 47: loss 0.17868. :  21%|█████████▍                                   | 47/224 [00:25<01:38,  1.79it/s]
Epoch 16 Iter 48: loss 0.16781. :  21%|█████████▍                                   | 47/224 [00:26<01:38,  1.79it/s]
Epoch 16 Iter 48: loss 0.16781. :  21%|█████████▋                                   | 48/224 [00:26<01:34,  1.86it/s]
Epoch 16 Iter 49: loss 0.17430. :  21%|█████████▋                                   | 48/224 [00:26<01:34,  1.86it/s]
Epoch 16 Iter 49: loss 0.17430. :  22%|█████████▊                                   | 49/224 [00:26<01:32,  1.90it/s]
Epoch 16 Iter 50: loss 0.17652. :  22%|█████████▊                                   | 49/224 [00:27<01:32,  1.90it/s]
Epoch 16 Iter 50: loss 0.17652. :  22%|██████████                                   | 50/224 [00:27<01:30,  1.92it/s]
Epoch 16 Iter 51: loss 0.17861. :  22%|██████████                                   | 50/224 [00:27<01:30,  1.92it/s]
Epoch 16 Iter 51: loss 0.17861. :  23%|██████████▏                                  | 51/224 [00:27<01:29,  1.94it/s]
Epoch 16 Iter 52: loss 0.17598. :  23%|██████████▏                                  | 51/224 [00:28<01:29,  1.94it/s]
Epoch 16 Iter 52: loss 0.17598. :  23%|██████████▍                                  | 52/224 [00:28<01:31,  1.88it/s]
Epoch 16 Iter 53: loss 0.15159. :  23%|██████████▍                                  | 52/224 [00:28<01:31,  1.88it/s]
Epoch 16 Iter 53: loss 0.15159. :  24%|██████████▋                                  | 53/224 [00:28<01:33,  1.83it/s]
Epoch 16 Iter 54: loss 0.17777. :  24%|██████████▋                                  | 53/224 [00:29<01:33,  1.83it/s]
Epoch 16 Iter 54: loss 0.17777. :  24%|██████████▊                                  | 54/224 [00:29<01:30,  1.89it/s]
Epoch 16 Iter 55: loss 0.17789. :  24%|██████████▊                                  | 54/224 [00:29<01:30,  1.89it/s]
Epoch 16 Iter 55: loss 0.17789. :  25%|███████████                                  | 55/224 [00:29<01:26,  1.95it/s]
Epoch 16 Iter 56: loss 0.17894. :  25%|███████████                                  | 55/224 [00:30<01:26,  1.95it/s]
Epoch 16 Iter 56: loss 0.17894. :  25%|███████████▎                                 | 56/224 [00:30<01:25,  1.97it/s]
Epoch 16 Iter 57: loss 0.16636. :  25%|███████████▎                                 | 56/224 [00:30<01:25,  1.97it/s]
Epoch 16 Iter 57: loss 0.16636. :  25%|███████████▍                                 | 57/224 [00:30<01:24,  1.98it/s]
Epoch 16 Iter 58: loss 0.18837. :  25%|███████████▍                                 | 57/224 [00:31<01:24,  1.98it/s]
Epoch 16 Iter 58: loss 0.18837. :  26%|███████████▋                                 | 58/224 [00:31<01:23,  1.99it/s]
Epoch 16 Iter 59: loss 0.16852. :  26%|███████████▋                                 | 58/224 [00:31<01:23,  1.99it/s]
Epoch 16 Iter 59: loss 0.16852. :  26%|███████████▊                                 | 59/224 [00:31<01:24,  1.95it/s]
Epoch 16 Iter 60: loss 0.19149. :  26%|███████████▊                                 | 59/224 [00:32<01:24,  1.95it/s]
Epoch 16 Iter 60: loss 0.19149. :  27%|████████████                                 | 60/224 [00:32<01:23,  1.96it/s]
Epoch 16 Iter 61: loss 0.17936. :  27%|████████████                                 | 60/224 [00:32<01:23,  1.96it/s]
Epoch 16 Iter 61: loss 0.17936. :  27%|████████████▎                                | 61/224 [00:32<01:22,  1.97it/s]
Epoch 16 Iter 62: loss 0.17613. :  27%|████████████▎                                | 61/224 [00:33<01:22,  1.97it/s]
Epoch 16 Iter 62: loss 0.17613. :  28%|████████████▍                                | 62/224 [00:33<01:21,  1.99it/s]
Epoch 16 Iter 63: loss 0.17258. :  28%|████████████▍                                | 62/224 [00:33<01:21,  1.99it/s]
Epoch 16 Iter 63: loss 0.17258. :  28%|████████████▋                                | 63/224 [00:33<01:22,  1.95it/s]
Epoch 16 Iter 64: loss 0.19199. :  28%|████████████▋                                | 63/224 [00:34<01:22,  1.95it/s]
Epoch 16 Iter 64: loss 0.19199. :  29%|████████████▊                                | 64/224 [00:34<01:32,  1.73it/s]
Epoch 16 Iter 65: loss 0.16603. :  29%|████████████▊                                | 64/224 [00:35<01:32,  1.73it/s]
Epoch 16 Iter 65: loss 0.16603. :  29%|█████████████                                | 65/224 [00:35<01:29,  1.77it/s]
Epoch 16 Iter 66: loss 0.19960. :  29%|█████████████                                | 65/224 [00:35<01:29,  1.77it/s]
Epoch 16 Iter 66: loss 0.19960. :  29%|█████████████▎                               | 66/224 [00:35<01:26,  1.83it/s]
Epoch 16 Iter 67: loss 0.19777. :  29%|█████████████▎                               | 66/224 [00:36<01:26,  1.83it/s]
Epoch 16 Iter 67: loss 0.19777. :  30%|█████████████▍                               | 67/224 [00:36<01:24,  1.87it/s]
Epoch 16 Iter 68: loss 0.17694. :  30%|█████████████▍                               | 67/224 [00:36<01:24,  1.87it/s]
Epoch 16 Iter 68: loss 0.17694. :  30%|█████████████▋                               | 68/224 [00:36<01:21,  1.92it/s]
Epoch 16 Iter 69: loss 0.16425. :  30%|█████████████▋                               | 68/224 [00:37<01:21,  1.92it/s]
Epoch 16 Iter 69: loss 0.16425. :  31%|█████████████▊                               | 69/224 [00:37<01:20,  1.93it/s]
Epoch 16 Iter 70: loss 0.17076. :  31%|█████████████▊                               | 69/224 [00:37<01:20,  1.93it/s]
Epoch 16 Iter 70: loss 0.17076. :  31%|██████████████                               | 70/224 [00:37<01:18,  1.95it/s]
Epoch 16 Iter 71: loss 0.18397. :  31%|██████████████                               | 70/224 [00:38<01:18,  1.95it/s]
Epoch 16 Iter 71: loss 0.18397. :  32%|██████████████▎                              | 71/224 [00:38<01:24,  1.81it/s]
Epoch 16 Iter 72: loss 0.17865. :  32%|██████████████▎                              | 71/224 [00:39<01:24,  1.81it/s]
Epoch 16 Iter 72: loss 0.17865. :  32%|██████████████▍                              | 72/224 [00:39<01:34,  1.60it/s]
Epoch 16 Iter 73: loss 0.19127. :  32%|██████████████▍                              | 72/224 [00:39<01:34,  1.60it/s]
Epoch 16 Iter 73: loss 0.19127. :  33%|██████████████▋                              | 73/224 [00:39<01:28,  1.71it/s]
Epoch 16 Iter 74: loss 0.19180. :  33%|██████████████▋                              | 73/224 [00:39<01:28,  1.71it/s]
Epoch 16 Iter 74: loss 0.19180. :  33%|██████████████▊                              | 74/224 [00:39<01:23,  1.80it/s]
Epoch 16 Iter 75: loss 0.19478. :  33%|██████████████▊                              | 74/224 [00:40<01:23,  1.80it/s]
Epoch 16 Iter 75: loss 0.19478. :  33%|███████████████                              | 75/224 [00:40<01:19,  1.87it/s]
Epoch 16 Iter 76: loss 0.18914. :  33%|███████████████                              | 75/224 [00:40<01:19,  1.87it/s]
Epoch 16 Iter 76: loss 0.18914. :  34%|███████████████▎                             | 76/224 [00:40<01:16,  1.92it/s]
Epoch 16 Iter 77: loss 0.19242. :  34%|███████████████▎                             | 76/224 [00:41<01:16,  1.92it/s]
Epoch 16 Iter 77: loss 0.19242. :  34%|███████████████▍                             | 77/224 [00:41<01:15,  1.95it/s]
Epoch 16 Iter 78: loss 0.17220. :  34%|███████████████▍                             | 77/224 [00:41<01:15,  1.95it/s]
Epoch 16 Iter 78: loss 0.17220. :  35%|███████████████▋                             | 78/224 [00:41<01:14,  1.97it/s]
Epoch 16 Iter 79: loss 0.16774. :  35%|███████████████▋                             | 78/224 [00:42<01:14,  1.97it/s]
Epoch 16 Iter 79: loss 0.16774. :  35%|███████████████▊                             | 79/224 [00:42<01:13,  1.99it/s]
Epoch 16 Iter 80: loss 0.19031. :  35%|███████████████▊                             | 79/224 [00:42<01:13,  1.99it/s]
Epoch 16 Iter 80: loss 0.19031. :  36%|████████████████                             | 80/224 [00:42<01:12,  2.00it/s]
Epoch 16 Iter 81: loss 0.18355. :  36%|████████████████                             | 80/224 [00:43<01:12,  2.00it/s]
Epoch 16 Iter 81: loss 0.18355. :  36%|████████████████▎                            | 81/224 [00:43<01:11,  2.01it/s]
Epoch 16 Iter 82: loss 0.17541. :  36%|████████████████▎                            | 81/224 [00:43<01:11,  2.01it/s]
Epoch 16 Iter 82: loss 0.17541. :  37%|████████████████▍                            | 82/224 [00:43<01:10,  2.00it/s]
Epoch 16 Iter 83: loss 0.19825. :  37%|████████████████▍                            | 82/224 [00:44<01:10,  2.00it/s]
Epoch 16 Iter 83: loss 0.19825. :  37%|████████████████▋                            | 83/224 [00:44<01:10,  2.01it/s]
Epoch 16 Iter 84: loss 0.17790. :  37%|████████████████▋                            | 83/224 [00:44<01:10,  2.01it/s]
Epoch 16 Iter 84: loss 0.17790. :  38%|████████████████▉                            | 84/224 [00:44<01:09,  2.01it/s]
Epoch 16 Iter 85: loss 0.18547. :  38%|████████████████▉                            | 84/224 [00:45<01:09,  2.01it/s]
Epoch 16 Iter 85: loss 0.18547. :  38%|█████████████████                            | 85/224 [00:45<01:09,  2.01it/s]
Epoch 16 Iter 86: loss 0.17249. :  38%|█████████████████                            | 85/224 [00:45<01:09,  2.01it/s]
Epoch 16 Iter 86: loss 0.17249. :  38%|█████████████████▎                           | 86/224 [00:45<01:08,  2.02it/s]
Epoch 16 Iter 87: loss 0.17684. :  38%|█████████████████▎                           | 86/224 [00:46<01:08,  2.02it/s]
Epoch 16 Iter 87: loss 0.17684. :  39%|█████████████████▍                           | 87/224 [00:46<01:08,  2.01it/s]
Epoch 16 Iter 88: loss 0.17246. :  39%|█████████████████▍                           | 87/224 [00:46<01:08,  2.01it/s]
Epoch 16 Iter 88: loss 0.17246. :  39%|█████████████████▋                           | 88/224 [00:46<01:07,  2.01it/s]
Epoch 16 Iter 89: loss 0.15886. :  39%|█████████████████▋                           | 88/224 [00:47<01:07,  2.01it/s]
Epoch 16 Iter 89: loss 0.15886. :  40%|█████████████████▉                           | 89/224 [00:47<01:06,  2.02it/s]
Epoch 16 Iter 90: loss 0.18499. :  40%|█████████████████▉                           | 89/224 [00:47<01:06,  2.02it/s]
Epoch 16 Iter 90: loss 0.18499. :  40%|██████████████████                           | 90/224 [00:47<01:06,  2.02it/s]
Epoch 16 Iter 91: loss 0.19007. :  40%|██████████████████                           | 90/224 [00:48<01:06,  2.02it/s]
Epoch 16 Iter 91: loss 0.19007. :  41%|██████████████████▎                          | 91/224 [00:48<01:05,  2.02it/s]
Epoch 16 Iter 92: loss 0.15979. :  41%|██████████████████▎                          | 91/224 [00:48<01:05,  2.02it/s]
Epoch 16 Iter 92: loss 0.15979. :  41%|██████████████████▍                          | 92/224 [00:48<01:04,  2.03it/s]
Epoch 16 Iter 93: loss 0.16668. :  41%|██████████████████▍                          | 92/224 [00:49<01:04,  2.03it/s]
Epoch 16 Iter 93: loss 0.16668. :  42%|██████████████████▋                          | 93/224 [00:49<01:04,  2.05it/s]
Epoch 16 Iter 94: loss 0.16523. :  42%|██████████████████▋                          | 93/224 [00:49<01:04,  2.05it/s]
Epoch 16 Iter 94: loss 0.16523. :  42%|██████████████████▉                          | 94/224 [00:49<01:03,  2.04it/s]
Epoch 16 Iter 95: loss 0.17773. :  42%|██████████████████▉                          | 94/224 [00:50<01:03,  2.04it/s]
Epoch 16 Iter 95: loss 0.17773. :  42%|███████████████████                          | 95/224 [00:50<01:03,  2.05it/s]
Epoch 16 Iter 96: loss 0.17537. :  42%|███████████████████                          | 95/224 [00:50<01:03,  2.05it/s]
Epoch 16 Iter 96: loss 0.17537. :  43%|███████████████████▎                         | 96/224 [00:50<01:02,  2.04it/s]
Epoch 16 Iter 97: loss 0.17371. :  43%|███████████████████▎                         | 96/224 [00:51<01:02,  2.04it/s]
Epoch 16 Iter 97: loss 0.17371. :  43%|███████████████████▍                         | 97/224 [00:51<01:02,  2.03it/s]
Epoch 16 Iter 98: loss 0.16542. :  43%|███████████████████▍                         | 97/224 [00:51<01:02,  2.03it/s]
Epoch 16 Iter 98: loss 0.16542. :  44%|███████████████████▋                         | 98/224 [00:51<01:02,  2.03it/s]
Epoch 16 Iter 99: loss 0.17026. :  44%|███████████████████▋                         | 98/224 [00:52<01:02,  2.03it/s]
Epoch 16 Iter 99: loss 0.17026. :  44%|███████████████████▉                         | 99/224 [00:52<01:01,  2.03it/s]
Epoch 16 Iter 100: loss 0.17971. :  44%|███████████████████▍                        | 99/224 [00:52<01:01,  2.03it/s]
Epoch 16 Iter 100: loss 0.17971. :  45%|███████████████████▏                       | 100/224 [00:52<01:00,  2.04it/s]
Epoch 16 Iter 101: loss 0.17197. :  45%|███████████████████▏                       | 100/224 [00:53<01:00,  2.04it/s]
Epoch 16 Iter 101: loss 0.17197. :  45%|███████████████████▍                       | 101/224 [00:53<01:00,  2.04it/s]
Epoch 16 Iter 102: loss 0.19536. :  45%|███████████████████▍                       | 101/224 [00:53<01:00,  2.04it/s]
Epoch 16 Iter 102: loss 0.19536. :  46%|███████████████████▌                       | 102/224 [00:53<00:59,  2.04it/s]
Epoch 16 Iter 103: loss 0.18952. :  46%|███████████████████▌                       | 102/224 [00:54<00:59,  2.04it/s]
Epoch 16 Iter 103: loss 0.18952. :  46%|███████████████████▊                       | 103/224 [00:54<00:59,  2.04it/s]
Epoch 16 Iter 104: loss 0.16894. :  46%|███████████████████▊                       | 103/224 [00:54<00:59,  2.04it/s]
Epoch 16 Iter 104: loss 0.16894. :  46%|███████████████████▉                       | 104/224 [00:54<00:58,  2.05it/s]
Epoch 16 Iter 105: loss 0.18758. :  46%|███████████████████▉                       | 104/224 [00:55<00:58,  2.05it/s]
Epoch 16 Iter 105: loss 0.18758. :  47%|████████████████████▏                      | 105/224 [00:55<00:58,  2.04it/s]
Epoch 16 Iter 106: loss 0.19137. :  47%|████████████████████▏                      | 105/224 [00:55<00:58,  2.04it/s]
Epoch 16 Iter 106: loss 0.19137. :  47%|████████████████████▎                      | 106/224 [00:55<00:58,  2.02it/s]
Epoch 16 Iter 107: loss 0.17594. :  47%|████████████████████▎                      | 106/224 [00:56<00:58,  2.02it/s]
Epoch 16 Iter 107: loss 0.17594. :  48%|████████████████████▌                      | 107/224 [00:56<00:59,  1.97it/s]
Epoch 16 Iter 108: loss 0.19024. :  48%|████████████████████▌                      | 107/224 [00:56<00:59,  1.97it/s]
Epoch 16 Iter 108: loss 0.19024. :  48%|████████████████████▋                      | 108/224 [00:56<00:57,  2.00it/s]
Epoch 16 Iter 109: loss 0.19191. :  48%|████████████████████▋                      | 108/224 [00:57<00:57,  2.00it/s]
Epoch 16 Iter 109: loss 0.19191. :  49%|████████████████████▉                      | 109/224 [00:57<00:56,  2.02it/s]
Epoch 16 Iter 110: loss 0.15808. :  49%|████████████████████▉                      | 109/224 [00:57<00:56,  2.02it/s]
Epoch 16 Iter 110: loss 0.15808. :  49%|█████████████████████                      | 110/224 [00:57<00:56,  2.04it/s]
Epoch 16 Iter 111: loss 0.17548. :  49%|█████████████████████                      | 110/224 [00:58<00:56,  2.04it/s]
Epoch 16 Iter 111: loss 0.17548. :  50%|█████████████████████▎                     | 111/224 [00:58<00:55,  2.04it/s]
Epoch 16 Iter 112: loss 0.16321. :  50%|█████████████████████▎                     | 111/224 [00:58<00:55,  2.04it/s]
Epoch 16 Iter 112: loss 0.16321. :  50%|█████████████████████▌                     | 112/224 [00:58<00:54,  2.06it/s]
Epoch 16 Iter 113: loss 0.18603. :  50%|█████████████████████▌                     | 112/224 [00:59<00:54,  2.06it/s]
Epoch 16 Iter 113: loss 0.18603. :  50%|█████████████████████▋                     | 113/224 [00:59<00:53,  2.06it/s]
Epoch 16 Iter 114: loss 0.17412. :  50%|█████████████████████▋                     | 113/224 [00:59<00:53,  2.06it/s]
Epoch 16 Iter 114: loss 0.17412. :  51%|█████████████████████▉                     | 114/224 [00:59<00:53,  2.05it/s]
Epoch 16 Iter 115: loss 0.17621. :  51%|█████████████████████▉                     | 114/224 [01:00<00:53,  2.05it/s]
Epoch 16 Iter 115: loss 0.17621. :  51%|██████████████████████                     | 115/224 [01:00<00:53,  2.05it/s]
Epoch 16 Iter 116: loss 0.18245. :  51%|██████████████████████                     | 115/224 [01:00<00:53,  2.05it/s]
Epoch 16 Iter 116: loss 0.18245. :  52%|██████████████████████▎                    | 116/224 [01:00<00:52,  2.06it/s]
Epoch 16 Iter 117: loss 0.18863. :  52%|██████████████████████▎                    | 116/224 [01:01<00:52,  2.06it/s]
Epoch 16 Iter 117: loss 0.18863. :  52%|██████████████████████▍                    | 117/224 [01:01<00:51,  2.07it/s]
Epoch 16 Iter 118: loss 0.20474. :  52%|██████████████████████▍                    | 117/224 [01:01<00:51,  2.07it/s]
Epoch 16 Iter 118: loss 0.20474. :  53%|██████████████████████▋                    | 118/224 [01:01<00:51,  2.07it/s]
Epoch 16 Iter 119: loss 0.17176. :  53%|██████████████████████▋                    | 118/224 [01:02<00:51,  2.07it/s]
Epoch 16 Iter 119: loss 0.17176. :  53%|██████████████████████▊                    | 119/224 [01:02<00:50,  2.07it/s]
Epoch 16 Iter 120: loss 0.17631. :  53%|██████████████████████▊                    | 119/224 [01:02<00:50,  2.07it/s]
Epoch 16 Iter 120: loss 0.17631. :  54%|███████████████████████                    | 120/224 [01:02<00:50,  2.06it/s]
Epoch 16 Iter 121: loss 0.18327. :  54%|███████████████████████                    | 120/224 [01:03<00:50,  2.06it/s]
Epoch 16 Iter 121: loss 0.18327. :  54%|███████████████████████▏                   | 121/224 [01:03<00:49,  2.07it/s]
Epoch 16 Iter 122: loss 0.17234. :  54%|███████████████████████▏                   | 121/224 [01:03<00:49,  2.07it/s]
Epoch 16 Iter 122: loss 0.17234. :  54%|███████████████████████▍                   | 122/224 [01:03<00:49,  2.07it/s]
Epoch 16 Iter 123: loss 0.18109. :  54%|███████████████████████▍                   | 122/224 [01:04<00:49,  2.07it/s]
Epoch 16 Iter 123: loss 0.18109. :  55%|███████████████████████▌                   | 123/224 [01:04<00:48,  2.06it/s]
Epoch 16 Iter 124: loss 0.16610. :  55%|███████████████████████▌                   | 123/224 [01:04<00:48,  2.06it/s]
Epoch 16 Iter 124: loss 0.16610. :  55%|███████████████████████▊                   | 124/224 [01:04<00:48,  2.05it/s]
Epoch 16 Iter 125: loss 0.18764. :  55%|███████████████████████▊                   | 124/224 [01:05<00:48,  2.05it/s]
Epoch 16 Iter 125: loss 0.18764. :  56%|███████████████████████▉                   | 125/224 [01:05<00:48,  2.03it/s]
Epoch 16 Iter 126: loss 0.15277. :  56%|███████████████████████▉                   | 125/224 [01:05<00:48,  2.03it/s]
Epoch 16 Iter 126: loss 0.15277. :  56%|████████████████████████▏                  | 126/224 [01:05<00:48,  2.03it/s]
Epoch 16 Iter 127: loss 0.16788. :  56%|████████████████████████▏                  | 126/224 [01:06<00:48,  2.03it/s]
Epoch 16 Iter 127: loss 0.16788. :  57%|████████████████████████▍                  | 127/224 [01:06<00:47,  2.04it/s]
Epoch 16 Iter 128: loss 0.15827. :  57%|████████████████████████▍                  | 127/224 [01:06<00:47,  2.04it/s]
Epoch 16 Iter 128: loss 0.15827. :  57%|████████████████████████▌                  | 128/224 [01:06<00:47,  2.03it/s]
Epoch 16 Iter 129: loss 0.18016. :  57%|████████████████████████▌                  | 128/224 [01:07<00:47,  2.03it/s]
Epoch 16 Iter 129: loss 0.18016. :  58%|████████████████████████▊                  | 129/224 [01:07<00:46,  2.03it/s]
Epoch 16 Iter 130: loss 0.18069. :  58%|████████████████████████▊                  | 129/224 [01:07<00:46,  2.03it/s]
Epoch 16 Iter 130: loss 0.18069. :  58%|████████████████████████▉                  | 130/224 [01:07<00:46,  2.03it/s]
Epoch 16 Iter 131: loss 0.17562. :  58%|████████████████████████▉                  | 130/224 [01:07<00:46,  2.03it/s]
Epoch 16 Iter 131: loss 0.17562. :  58%|█████████████████████████▏                 | 131/224 [01:07<00:45,  2.04it/s]
Epoch 16 Iter 132: loss 0.18710. :  58%|█████████████████████████▏                 | 131/224 [01:08<00:45,  2.04it/s]
Epoch 16 Iter 132: loss 0.18710. :  59%|█████████████████████████▎                 | 132/224 [01:08<00:44,  2.05it/s]
Epoch 16 Iter 133: loss 0.17456. :  59%|█████████████████████████▎                 | 132/224 [01:08<00:44,  2.05it/s]
Epoch 16 Iter 133: loss 0.17456. :  59%|█████████████████████████▌                 | 133/224 [01:08<00:44,  2.05it/s]
Epoch 16 Iter 134: loss 0.19555. :  59%|█████████████████████████▌                 | 133/224 [01:09<00:44,  2.05it/s]
Epoch 16 Iter 134: loss 0.19555. :  60%|█████████████████████████▋                 | 134/224 [01:09<00:43,  2.06it/s]
Epoch 16 Iter 135: loss 0.19581. :  60%|█████████████████████████▋                 | 134/224 [01:09<00:43,  2.06it/s]
Epoch 16 Iter 135: loss 0.19581. :  60%|█████████████████████████▉                 | 135/224 [01:09<00:43,  2.07it/s]
Epoch 16 Iter 136: loss 0.18009. :  60%|█████████████████████████▉                 | 135/224 [01:10<00:43,  2.07it/s]
Epoch 16 Iter 136: loss 0.18009. :  61%|██████████████████████████                 | 136/224 [01:10<00:42,  2.07it/s]
Epoch 16 Iter 137: loss 0.18477. :  61%|██████████████████████████                 | 136/224 [01:10<00:42,  2.07it/s]
Epoch 16 Iter 137: loss 0.18477. :  61%|██████████████████████████▎                | 137/224 [01:10<00:42,  2.07it/s]
Epoch 16 Iter 138: loss 0.17335. :  61%|██████████████████████████▎                | 137/224 [01:11<00:42,  2.07it/s]
Epoch 16 Iter 138: loss 0.17335. :  62%|██████████████████████████▍                | 138/224 [01:11<00:41,  2.07it/s]
Epoch 16 Iter 139: loss 0.17163. :  62%|██████████████████████████▍                | 138/224 [01:11<00:41,  2.07it/s]
Epoch 16 Iter 139: loss 0.17163. :  62%|██████████████████████████▋                | 139/224 [01:11<00:41,  2.07it/s]
Epoch 16 Iter 140: loss 0.15938. :  62%|██████████████████████████▋                | 139/224 [01:12<00:41,  2.07it/s]
Epoch 16 Iter 140: loss 0.15938. :  62%|██████████████████████████▉                | 140/224 [01:12<00:40,  2.05it/s]
Epoch 16 Iter 141: loss 0.16549. :  62%|██████████████████████████▉                | 140/224 [01:12<00:40,  2.05it/s]
Epoch 16 Iter 141: loss 0.16549. :  63%|███████████████████████████                | 141/224 [01:12<00:40,  2.04it/s]
Epoch 16 Iter 142: loss 0.18387. :  63%|███████████████████████████                | 141/224 [01:13<00:40,  2.04it/s]
Epoch 16 Iter 142: loss 0.18387. :  63%|███████████████████████████▎               | 142/224 [01:13<00:40,  2.04it/s]
Epoch 16 Iter 143: loss 0.18279. :  63%|███████████████████████████▎               | 142/224 [01:13<00:40,  2.04it/s]
Epoch 16 Iter 143: loss 0.18279. :  64%|███████████████████████████▍               | 143/224 [01:13<00:40,  2.02it/s]
Epoch 16 Iter 144: loss 0.17115. :  64%|███████████████████████████▍               | 143/224 [01:14<00:40,  2.02it/s]
Epoch 16 Iter 144: loss 0.17115. :  64%|███████████████████████████▋               | 144/224 [01:14<00:39,  2.03it/s]
Epoch 16 Iter 145: loss 0.18640. :  64%|███████████████████████████▋               | 144/224 [01:14<00:39,  2.03it/s]
Epoch 16 Iter 145: loss 0.18640. :  65%|███████████████████████████▊               | 145/224 [01:14<00:38,  2.03it/s]
Epoch 16 Iter 146: loss 0.17912. :  65%|███████████████████████████▊               | 145/224 [01:15<00:38,  2.03it/s]
Epoch 16 Iter 146: loss 0.17912. :  65%|████████████████████████████               | 146/224 [01:15<00:38,  2.04it/s]
Epoch 16 Iter 147: loss 0.19009. :  65%|████████████████████████████               | 146/224 [01:15<00:38,  2.04it/s]
Epoch 16 Iter 147: loss 0.19009. :  66%|████████████████████████████▏              | 147/224 [01:15<00:37,  2.04it/s]
Epoch 16 Iter 148: loss 0.17269. :  66%|████████████████████████████▏              | 147/224 [01:16<00:37,  2.04it/s]
Epoch 16 Iter 148: loss 0.17269. :  66%|████████████████████████████▍              | 148/224 [01:16<00:37,  2.05it/s]
Epoch 16 Iter 149: loss 0.15577. :  66%|████████████████████████████▍              | 148/224 [01:16<00:37,  2.05it/s]
Epoch 16 Iter 149: loss 0.15577. :  67%|████████████████████████████▌              | 149/224 [01:16<00:36,  2.05it/s]
Epoch 16 Iter 150: loss 0.17482. :  67%|████████████████████████████▌              | 149/224 [01:17<00:36,  2.05it/s]
Epoch 16 Iter 150: loss 0.17482. :  67%|████████████████████████████▊              | 150/224 [01:17<00:36,  2.05it/s]
Epoch 16 Iter 151: loss 0.16602. :  67%|████████████████████████████▊              | 150/224 [01:17<00:36,  2.05it/s]
Epoch 16 Iter 151: loss 0.16602. :  67%|████████████████████████████▉              | 151/224 [01:17<00:35,  2.05it/s]
Epoch 16 Iter 152: loss 0.18582. :  67%|████████████████████████████▉              | 151/224 [01:18<00:35,  2.05it/s]
Epoch 16 Iter 152: loss 0.18582. :  68%|█████████████████████████████▏             | 152/224 [01:18<00:34,  2.06it/s]
Epoch 16 Iter 153: loss 0.18641. :  68%|█████████████████████████████▏             | 152/224 [01:18<00:34,  2.06it/s]
Epoch 16 Iter 153: loss 0.18641. :  68%|█████████████████████████████▎             | 153/224 [01:18<00:34,  2.07it/s]
Epoch 16 Iter 154: loss 0.18864. :  68%|█████████████████████████████▎             | 153/224 [01:19<00:34,  2.07it/s]
Epoch 16 Iter 154: loss 0.18864. :  69%|█████████████████████████████▌             | 154/224 [01:19<00:33,  2.07it/s]
Epoch 16 Iter 155: loss 0.17513. :  69%|█████████████████████████████▌             | 154/224 [01:19<00:33,  2.07it/s]
Epoch 16 Iter 155: loss 0.17513. :  69%|█████████████████████████████▊             | 155/224 [01:19<00:33,  2.07it/s]
Epoch 16 Iter 156: loss 0.16599. :  69%|█████████████████████████████▊             | 155/224 [01:20<00:33,  2.07it/s]
Epoch 16 Iter 156: loss 0.16599. :  70%|█████████████████████████████▉             | 156/224 [01:20<00:32,  2.08it/s]
Epoch 16 Iter 157: loss 0.18249. :  70%|█████████████████████████████▉             | 156/224 [01:20<00:32,  2.08it/s]
Epoch 16 Iter 157: loss 0.18249. :  70%|██████████████████████████████▏            | 157/224 [01:20<00:32,  2.08it/s]
Epoch 16 Iter 158: loss 0.17342. :  70%|██████████████████████████████▏            | 157/224 [01:21<00:32,  2.08it/s]
Epoch 16 Iter 158: loss 0.17342. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:31,  2.07it/s]
Epoch 16 Iter 159: loss 0.17138. :  71%|██████████████████████████████▎            | 158/224 [01:21<00:31,  2.07it/s]
Epoch 16 Iter 159: loss 0.17138. :  71%|██████████████████████████████▌            | 159/224 [01:21<00:31,  2.04it/s]
Epoch 16 Iter 160: loss 0.16445. :  71%|██████████████████████████████▌            | 159/224 [01:22<00:31,  2.04it/s]
Epoch 16 Iter 160: loss 0.16445. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:31,  2.05it/s]
Epoch 16 Iter 161: loss 0.15282. :  71%|██████████████████████████████▋            | 160/224 [01:22<00:31,  2.05it/s]
Epoch 16 Iter 161: loss 0.15282. :  72%|██████████████████████████████▉            | 161/224 [01:22<00:30,  2.06it/s]
Epoch 16 Iter 162: loss 0.18297. :  72%|██████████████████████████████▉            | 161/224 [01:23<00:30,  2.06it/s]
Epoch 16 Iter 162: loss 0.18297. :  72%|███████████████████████████████            | 162/224 [01:23<00:30,  2.05it/s]
Epoch 16 Iter 163: loss 0.17127. :  72%|███████████████████████████████            | 162/224 [01:23<00:30,  2.05it/s]
Epoch 16 Iter 163: loss 0.17127. :  73%|███████████████████████████████▎           | 163/224 [01:23<00:30,  2.03it/s]
Epoch 16 Iter 164: loss 0.16084. :  73%|███████████████████████████████▎           | 163/224 [01:24<00:30,  2.03it/s]
Epoch 16 Iter 164: loss 0.16084. :  73%|███████████████████████████████▍           | 164/224 [01:24<00:29,  2.04it/s]
Epoch 16 Iter 165: loss 0.17003. :  73%|███████████████████████████████▍           | 164/224 [01:24<00:29,  2.04it/s]
Epoch 16 Iter 165: loss 0.17003. :  74%|███████████████████████████████▋           | 165/224 [01:24<00:28,  2.04it/s]
Epoch 16 Iter 166: loss 0.14807. :  74%|███████████████████████████████▋           | 165/224 [01:25<00:28,  2.04it/s]
Epoch 16 Iter 166: loss 0.14807. :  74%|███████████████████████████████▊           | 166/224 [01:25<00:28,  2.04it/s]
Epoch 16 Iter 167: loss 0.15931. :  74%|███████████████████████████████▊           | 166/224 [01:25<00:28,  2.04it/s]
Epoch 16 Iter 167: loss 0.15931. :  75%|████████████████████████████████           | 167/224 [01:25<00:27,  2.04it/s]
Epoch 16 Iter 168: loss 0.19045. :  75%|████████████████████████████████           | 167/224 [01:26<00:27,  2.04it/s]
Epoch 16 Iter 168: loss 0.19045. :  75%|████████████████████████████████▎          | 168/224 [01:26<00:27,  2.04it/s]
Epoch 16 Iter 169: loss 0.18255. :  75%|████████████████████████████████▎          | 168/224 [01:26<00:27,  2.04it/s]
Epoch 16 Iter 169: loss 0.18255. :  75%|████████████████████████████████▍          | 169/224 [01:26<00:27,  2.04it/s]
Epoch 16 Iter 170: loss 0.18268. :  75%|████████████████████████████████▍          | 169/224 [01:27<00:27,  2.04it/s]
Epoch 16 Iter 170: loss 0.18268. :  76%|████████████████████████████████▋          | 170/224 [01:27<00:26,  2.02it/s]
Epoch 16 Iter 171: loss 0.17281. :  76%|████████████████████████████████▋          | 170/224 [01:27<00:26,  2.02it/s]
Epoch 16 Iter 171: loss 0.17281. :  76%|████████████████████████████████▊          | 171/224 [01:27<00:25,  2.06it/s]
Epoch 16 Iter 172: loss 0.18623. :  76%|████████████████████████████████▊          | 171/224 [01:27<00:25,  2.06it/s]
Epoch 16 Iter 172: loss 0.18623. :  77%|█████████████████████████████████          | 172/224 [01:27<00:25,  2.06it/s]
Epoch 16 Iter 173: loss 0.16560. :  77%|█████████████████████████████████          | 172/224 [01:28<00:25,  2.06it/s]
Epoch 16 Iter 173: loss 0.16560. :  77%|█████████████████████████████████▏         | 173/224 [01:28<00:24,  2.06it/s]
Epoch 16 Iter 174: loss 0.17180. :  77%|█████████████████████████████████▏         | 173/224 [01:28<00:24,  2.06it/s]
Epoch 16 Iter 174: loss 0.17180. :  78%|█████████████████████████████████▍         | 174/224 [01:28<00:24,  2.06it/s]
Epoch 16 Iter 175: loss 0.16493. :  78%|█████████████████████████████████▍         | 174/224 [01:29<00:24,  2.06it/s]
Epoch 16 Iter 175: loss 0.16493. :  78%|█████████████████████████████████▌         | 175/224 [01:29<00:23,  2.06it/s]
Epoch 16 Iter 176: loss 0.17950. :  78%|█████████████████████████████████▌         | 175/224 [01:29<00:23,  2.06it/s]
Epoch 16 Iter 176: loss 0.17950. :  79%|█████████████████████████████████▊         | 176/224 [01:29<00:23,  2.05it/s]
Epoch 16 Iter 177: loss 0.17927. :  79%|█████████████████████████████████▊         | 176/224 [01:30<00:23,  2.05it/s]
Epoch 16 Iter 177: loss 0.17927. :  79%|█████████████████████████████████▉         | 177/224 [01:30<00:22,  2.04it/s]
Epoch 16 Iter 178: loss 0.17681. :  79%|█████████████████████████████████▉         | 177/224 [01:30<00:22,  2.04it/s]
Epoch 16 Iter 178: loss 0.17681. :  79%|██████████████████████████████████▏        | 178/224 [01:30<00:22,  2.03it/s]
Epoch 16 Iter 179: loss 0.17213. :  79%|██████████████████████████████████▏        | 178/224 [01:31<00:22,  2.03it/s]
Epoch 16 Iter 179: loss 0.17213. :  80%|██████████████████████████████████▎        | 179/224 [01:31<00:22,  2.03it/s]
Epoch 16 Iter 180: loss 0.19123. :  80%|██████████████████████████████████▎        | 179/224 [01:31<00:22,  2.03it/s]
Epoch 16 Iter 180: loss 0.19123. :  80%|██████████████████████████████████▌        | 180/224 [01:31<00:21,  2.04it/s]
Epoch 16 Iter 181: loss 0.17859. :  80%|██████████████████████████████████▌        | 180/224 [01:32<00:21,  2.04it/s]
Epoch 16 Iter 181: loss 0.17859. :  81%|██████████████████████████████████▋        | 181/224 [01:32<00:21,  2.04it/s]
Epoch 16 Iter 182: loss 0.17974. :  81%|██████████████████████████████████▋        | 181/224 [01:32<00:21,  2.04it/s]
Epoch 16 Iter 182: loss 0.17974. :  81%|██████████████████████████████████▉        | 182/224 [01:32<00:20,  2.05it/s]
Epoch 16 Iter 183: loss 0.19174. :  81%|██████████████████████████████████▉        | 182/224 [01:33<00:20,  2.05it/s]
Epoch 16 Iter 183: loss 0.19174. :  82%|███████████████████████████████████▏       | 183/224 [01:33<00:19,  2.05it/s]
Epoch 16 Iter 184: loss 0.16226. :  82%|███████████████████████████████████▏       | 183/224 [01:33<00:19,  2.05it/s]
Epoch 16 Iter 184: loss 0.16226. :  82%|███████████████████████████████████▎       | 184/224 [01:33<00:19,  2.05it/s]
Epoch 16 Iter 185: loss 0.20439. :  82%|███████████████████████████████████▎       | 184/224 [01:34<00:19,  2.05it/s]
Epoch 16 Iter 185: loss 0.20439. :  83%|███████████████████████████████████▌       | 185/224 [01:34<00:18,  2.05it/s]
Epoch 16 Iter 186: loss 0.17058. :  83%|███████████████████████████████████▌       | 185/224 [01:34<00:18,  2.05it/s]
Epoch 16 Iter 186: loss 0.17058. :  83%|███████████████████████████████████▋       | 186/224 [01:34<00:18,  2.06it/s]
Epoch 16 Iter 187: loss 0.16291. :  83%|███████████████████████████████████▋       | 186/224 [01:35<00:18,  2.06it/s]
Epoch 16 Iter 187: loss 0.16291. :  83%|███████████████████████████████████▉       | 187/224 [01:35<00:18,  2.05it/s]
Epoch 16 Iter 188: loss 0.18768. :  83%|███████████████████████████████████▉       | 187/224 [01:35<00:18,  2.05it/s]
Epoch 16 Iter 188: loss 0.18768. :  84%|████████████████████████████████████       | 188/224 [01:35<00:17,  2.05it/s]
Epoch 16 Iter 189: loss 0.17083. :  84%|████████████████████████████████████       | 188/224 [01:36<00:17,  2.05it/s]
Epoch 16 Iter 189: loss 0.17083. :  84%|████████████████████████████████████▎      | 189/224 [01:36<00:17,  2.05it/s]
Epoch 16 Iter 190: loss 0.18784. :  84%|████████████████████████████████████▎      | 189/224 [01:36<00:17,  2.05it/s]
Epoch 16 Iter 190: loss 0.18784. :  85%|████████████████████████████████████▍      | 190/224 [01:36<00:16,  2.06it/s]
Epoch 16 Iter 191: loss 0.16339. :  85%|████████████████████████████████████▍      | 190/224 [01:37<00:16,  2.06it/s]
Epoch 16 Iter 191: loss 0.16339. :  85%|████████████████████████████████████▋      | 191/224 [01:37<00:16,  2.05it/s]
Epoch 16 Iter 192: loss 0.18759. :  85%|████████████████████████████████████▋      | 191/224 [01:37<00:16,  2.05it/s]
Epoch 16 Iter 192: loss 0.18759. :  86%|████████████████████████████████████▊      | 192/224 [01:37<00:15,  2.06it/s]
Epoch 16 Iter 193: loss 0.18484. :  86%|████████████████████████████████████▊      | 192/224 [01:38<00:15,  2.06it/s]
Epoch 16 Iter 193: loss 0.18484. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  2.06it/s]
Epoch 16 Iter 194: loss 0.19490. :  86%|█████████████████████████████████████      | 193/224 [01:38<00:15,  2.06it/s]
Epoch 16 Iter 194: loss 0.19490. :  87%|█████████████████████████████████████▏     | 194/224 [01:38<00:14,  2.06it/s]
Epoch 16 Iter 195: loss 0.19379. :  87%|█████████████████████████████████████▏     | 194/224 [01:39<00:14,  2.06it/s]
Epoch 16 Iter 195: loss 0.19379. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  2.07it/s]
Epoch 16 Iter 196: loss 0.16473. :  87%|█████████████████████████████████████▍     | 195/224 [01:39<00:14,  2.07it/s]
Epoch 16 Iter 196: loss 0.16473. :  88%|█████████████████████████████████████▋     | 196/224 [01:39<00:13,  2.06it/s]
Epoch 16 Iter 197: loss 0.16408. :  88%|█████████████████████████████████████▋     | 196/224 [01:40<00:13,  2.06it/s]
Epoch 16 Iter 197: loss 0.16408. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  2.06it/s]
Epoch 16 Iter 198: loss 0.18263. :  88%|█████████████████████████████████████▊     | 197/224 [01:40<00:13,  2.06it/s]
Epoch 16 Iter 198: loss 0.18263. :  88%|██████████████████████████████████████     | 198/224 [01:40<00:12,  2.06it/s]
Epoch 16 Iter 199: loss 0.17043. :  88%|██████████████████████████████████████     | 198/224 [01:41<00:12,  2.06it/s]
Epoch 16 Iter 199: loss 0.17043. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  2.06it/s]
Epoch 16 Iter 200: loss 0.17967. :  89%|██████████████████████████████████████▏    | 199/224 [01:41<00:12,  2.06it/s]
Epoch 16 Iter 200: loss 0.17967. :  89%|██████████████████████████████████████▍    | 200/224 [01:41<00:11,  2.05it/s]
Epoch 16 Iter 201: loss 0.17670. :  89%|██████████████████████████████████████▍    | 200/224 [01:42<00:11,  2.05it/s]
Epoch 16 Iter 201: loss 0.17670. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  2.05it/s]
Epoch 16 Iter 202: loss 0.17487. :  90%|██████████████████████████████████████▌    | 201/224 [01:42<00:11,  2.05it/s]
Epoch 16 Iter 202: loss 0.17487. :  90%|██████████████████████████████████████▊    | 202/224 [01:42<00:10,  2.05it/s]
Epoch 16 Iter 203: loss 0.20815. :  90%|██████████████████████████████████████▊    | 202/224 [01:43<00:10,  2.05it/s]
Epoch 16 Iter 203: loss 0.20815. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.04it/s]
Epoch 16 Iter 204: loss 0.18235. :  91%|██████████████████████████████████████▉    | 203/224 [01:43<00:10,  2.04it/s]
Epoch 16 Iter 204: loss 0.18235. :  91%|███████████████████████████████████████▏   | 204/224 [01:43<00:09,  2.05it/s]
Epoch 16 Iter 205: loss 0.17512. :  91%|███████████████████████████████████████▏   | 204/224 [01:44<00:09,  2.05it/s]
Epoch 16 Iter 205: loss 0.17512. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.06it/s]
Epoch 16 Iter 206: loss 0.18320. :  92%|███████████████████████████████████████▎   | 205/224 [01:44<00:09,  2.06it/s]
Epoch 16 Iter 206: loss 0.18320. :  92%|███████████████████████████████████████▌   | 206/224 [01:44<00:08,  2.03it/s]
Epoch 16 Iter 207: loss 0.17425. :  92%|███████████████████████████████████████▌   | 206/224 [01:45<00:08,  2.03it/s]
Epoch 16 Iter 207: loss 0.17425. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.02it/s]
Epoch 16 Iter 208: loss 0.16972. :  92%|███████████████████████████████████████▋   | 207/224 [01:45<00:08,  2.02it/s]
Epoch 16 Iter 208: loss 0.16972. :  93%|███████████████████████████████████████▉   | 208/224 [01:45<00:07,  2.04it/s]
Epoch 16 Iter 209: loss 0.16851. :  93%|███████████████████████████████████████▉   | 208/224 [01:46<00:07,  2.04it/s]
Epoch 16 Iter 209: loss 0.16851. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.03it/s]
Epoch 16 Iter 210: loss 0.19163. :  93%|████████████████████████████████████████   | 209/224 [01:46<00:07,  2.03it/s]
Epoch 16 Iter 210: loss 0.19163. :  94%|████████████████████████████████████████▎  | 210/224 [01:46<00:06,  2.04it/s]
Epoch 16 Iter 211: loss 0.18671. :  94%|████████████████████████████████████████▎  | 210/224 [01:47<00:06,  2.04it/s]
Epoch 16 Iter 211: loss 0.18671. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.03it/s]
Epoch 16 Iter 212: loss 0.20302. :  94%|████████████████████████████████████████▌  | 211/224 [01:47<00:06,  2.03it/s]
Epoch 16 Iter 212: loss 0.20302. :  95%|████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.03it/s]
Epoch 16 Iter 213: loss 0.18849. :  95%|████████████████████████████████████████▋  | 212/224 [01:47<00:05,  2.03it/s]
Epoch 16 Iter 213: loss 0.18849. :  95%|████████████████████████████████████████▉  | 213/224 [01:47<00:05,  2.03it/s]
Epoch 16 Iter 214: loss 0.15959. :  95%|████████████████████████████████████████▉  | 213/224 [01:48<00:05,  2.03it/s]
Epoch 16 Iter 214: loss 0.15959. :  96%|█████████████████████████████████████████  | 214/224 [01:48<00:04,  2.04it/s]
Epoch 16 Iter 215: loss 0.18695. :  96%|█████████████████████████████████████████  | 214/224 [01:48<00:04,  2.04it/s]
Epoch 16 Iter 215: loss 0.18695. :  96%|█████████████████████████████████████████▎ | 215/224 [01:48<00:04,  2.02it/s]
Epoch 16 Iter 216: loss 0.16999. :  96%|█████████████████████████████████████████▎ | 215/224 [01:49<00:04,  2.02it/s]
Epoch 16 Iter 216: loss 0.16999. :  96%|█████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 16 Iter 217: loss 0.15317. :  96%|█████████████████████████████████████████▍ | 216/224 [01:49<00:03,  2.02it/s]
Epoch 16 Iter 217: loss 0.15317. :  97%|█████████████████████████████████████████▋ | 217/224 [01:49<00:03,  2.03it/s]
Epoch 16 Iter 218: loss 0.17747. :  97%|█████████████████████████████████████████▋ | 217/224 [01:50<00:03,  2.03it/s]
Epoch 16 Iter 218: loss 0.17747. :  97%|█████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.05it/s]
Epoch 16 Iter 219: loss 0.18436. :  97%|█████████████████████████████████████████▊ | 218/224 [01:50<00:02,  2.05it/s]
Epoch 16 Iter 219: loss 0.18436. :  98%|██████████████████████████████████████████ | 219/224 [01:50<00:02,  2.05it/s]
Epoch 16 Iter 220: loss 0.15270. :  98%|██████████████████████████████████████████ | 219/224 [01:51<00:02,  2.05it/s]
Epoch 16 Iter 220: loss 0.15270. :  98%|██████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.06it/s]
Epoch 16 Iter 221: loss 0.18004. :  98%|██████████████████████████████████████████▏| 220/224 [01:51<00:01,  2.06it/s]
Epoch 16 Iter 221: loss 0.18004. :  99%|██████████████████████████████████████████▍| 221/224 [01:51<00:01,  2.05it/s]
Epoch 16 Iter 222: loss 0.18444. :  99%|██████████████████████████████████████████▍| 221/224 [01:52<00:01,  2.05it/s]
Epoch 16 Iter 222: loss 0.18444. :  99%|██████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.05it/s]
Epoch 16 Iter 223: loss 0.16618. :  99%|██████████████████████████████████████████▌| 222/224 [01:52<00:00,  2.05it/s]
Epoch 16 Iter 223: loss 0.16618. : 100%|██████████████████████████████████████████▊| 223/224 [01:52<00:00,  2.05it/s]
Epoch 16 Iter 224: loss 0.18998. : 100%|██████████████████████████████████████████▊| 223/224 [01:53<00:00,  2.05it/s]
Epoch 16 Iter 224: loss 0.18998. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  2.05it/s]
Epoch 16 Iter 224: loss 0.18998. : 100%|███████████████████████████████████████████| 224/224 [01:53<00:00,  1.98it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.17680. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 17 Iter 1: loss 0.17680. :   0%|▏                                              | 1/224 [00:00<01:49,  2.05it/s]
Epoch 17 Iter 2: loss 0.18178. :   0%|▏                                              | 1/224 [00:00<01:49,  2.05it/s]
Epoch 17 Iter 2: loss 0.18178. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 17 Iter 3: loss 0.17099. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 17 Iter 3: loss 0.17099. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 17 Iter 4: loss 0.16392. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 17 Iter 4: loss 0.16392. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 17 Iter 5: loss 0.16745. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 17 Iter 5: loss 0.16745. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 17 Iter 6: loss 0.19514. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 17 Iter 6: loss 0.19514. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 17 Iter 7: loss 0.19087. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 17 Iter 7: loss 0.19087. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 17 Iter 8: loss 0.17682. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 17 Iter 8: loss 0.17682. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 17 Iter 9: loss 0.17343. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 17 Iter 9: loss 0.17343. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 17 Iter 10: loss 0.17841. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 17 Iter 10: loss 0.17841. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 17 Iter 11: loss 0.18700. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 17 Iter 11: loss 0.18700. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 17 Iter 12: loss 0.18655. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 17 Iter 12: loss 0.18655. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 17 Iter 13: loss 0.19438. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 17 Iter 13: loss 0.19438. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 17 Iter 14: loss 0.15699. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 17 Iter 14: loss 0.15699. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.08it/s]
Epoch 17 Iter 15: loss 0.16991. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.08it/s]
Epoch 17 Iter 15: loss 0.16991. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 17 Iter 16: loss 0.18167. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 17 Iter 16: loss 0.18167. :   7%|███▏                                         | 16/224 [00:07<01:39,  2.08it/s]
Epoch 17 Iter 17: loss 0.18782. :   7%|███▏                                         | 16/224 [00:08<01:39,  2.08it/s]
Epoch 17 Iter 17: loss 0.18782. :   8%|███▍                                         | 17/224 [00:08<01:38,  2.09it/s]
Epoch 17 Iter 18: loss 0.17509. :   8%|███▍                                         | 17/224 [00:08<01:38,  2.09it/s]
Epoch 17 Iter 18: loss 0.17509. :   8%|███▌                                         | 18/224 [00:08<01:38,  2.09it/s]
Epoch 17 Iter 19: loss 0.18770. :   8%|███▌                                         | 18/224 [00:09<01:38,  2.09it/s]
Epoch 17 Iter 19: loss 0.18770. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 17 Iter 20: loss 0.18531. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 17 Iter 20: loss 0.18531. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 17 Iter 21: loss 0.18408. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 17 Iter 21: loss 0.18408. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 17 Iter 22: loss 0.18925. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 17 Iter 22: loss 0.18925. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 17 Iter 23: loss 0.20077. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 17 Iter 23: loss 0.20077. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.03it/s]
Epoch 17 Iter 24: loss 0.19187. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.03it/s]
Epoch 17 Iter 24: loss 0.19187. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.04it/s]
Epoch 17 Iter 25: loss 0.18088. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.04it/s]
Epoch 17 Iter 25: loss 0.18088. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 17 Iter 26: loss 0.17504. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 17 Iter 26: loss 0.17504. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 17 Iter 27: loss 0.17330. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 17 Iter 27: loss 0.17330. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 17 Iter 28: loss 0.17242. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 17 Iter 28: loss 0.17242. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 17 Iter 29: loss 0.17244. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 17 Iter 29: loss 0.17244. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 17 Iter 30: loss 0.19253. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 17 Iter 30: loss 0.19253. :  13%|██████                                       | 30/224 [00:14<01:34,  2.04it/s]
Epoch 17 Iter 31: loss 0.19911. :  13%|██████                                       | 30/224 [00:15<01:34,  2.04it/s]
Epoch 17 Iter 31: loss 0.19911. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 17 Iter 32: loss 0.18616. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 17 Iter 32: loss 0.18616. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 17 Iter 33: loss 0.17941. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 17 Iter 33: loss 0.17941. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 17 Iter 34: loss 0.15932. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 17 Iter 34: loss 0.15932. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 17 Iter 35: loss 0.16808. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 17 Iter 35: loss 0.16808. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 17 Iter 36: loss 0.17125. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 17 Iter 36: loss 0.17125. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 17 Iter 37: loss 0.16993. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 17 Iter 37: loss 0.16993. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 17 Iter 38: loss 0.17814. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 17 Iter 38: loss 0.17814. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 17 Iter 39: loss 0.19002. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 17 Iter 39: loss 0.19002. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 17 Iter 40: loss 0.15657. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 17 Iter 40: loss 0.15657. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 17 Iter 41: loss 0.16793. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 17 Iter 41: loss 0.16793. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 17 Iter 42: loss 0.16756. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 17 Iter 42: loss 0.16756. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 17 Iter 43: loss 0.18034. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 17 Iter 43: loss 0.18034. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 17 Iter 44: loss 0.19218. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 17 Iter 44: loss 0.19218. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 17 Iter 45: loss 0.19098. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 17 Iter 45: loss 0.19098. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 17 Iter 46: loss 0.18646. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 17 Iter 46: loss 0.18646. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 17 Iter 47: loss 0.18030. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 17 Iter 47: loss 0.18030. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 17 Iter 48: loss 0.19769. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 17 Iter 48: loss 0.19769. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 17 Iter 49: loss 0.16690. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 17 Iter 49: loss 0.16690. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.08it/s]
Epoch 17 Iter 50: loss 0.17800. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.08it/s]
Epoch 17 Iter 50: loss 0.17800. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 17 Iter 51: loss 0.18371. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 17 Iter 51: loss 0.18371. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 17 Iter 52: loss 0.18482. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 17 Iter 52: loss 0.18482. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 17 Iter 53: loss 0.18594. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 17 Iter 53: loss 0.18594. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 17 Iter 54: loss 0.18067. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 17 Iter 54: loss 0.18067. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 17 Iter 55: loss 0.16815. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 17 Iter 55: loss 0.16815. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.09it/s]
Epoch 17 Iter 56: loss 0.18237. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.09it/s]
Epoch 17 Iter 56: loss 0.18237. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 17 Iter 57: loss 0.19136. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 17 Iter 57: loss 0.19136. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 17 Iter 58: loss 0.17647. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 17 Iter 58: loss 0.17647. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 17 Iter 59: loss 0.19292. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 17 Iter 59: loss 0.19292. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 17 Iter 60: loss 0.18060. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 17 Iter 60: loss 0.18060. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 17 Iter 61: loss 0.16698. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 17 Iter 61: loss 0.16698. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 17 Iter 62: loss 0.15920. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 17 Iter 62: loss 0.15920. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.08it/s]
Epoch 17 Iter 63: loss 0.18246. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.08it/s]
Epoch 17 Iter 63: loss 0.18246. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 17 Iter 64: loss 0.17087. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 17 Iter 64: loss 0.17087. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 17 Iter 65: loss 0.15855. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 17 Iter 65: loss 0.15855. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 17 Iter 66: loss 0.15800. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 17 Iter 66: loss 0.15800. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 17 Iter 67: loss 0.16810. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 17 Iter 67: loss 0.16810. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 17 Iter 68: loss 0.17349. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 17 Iter 68: loss 0.17349. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 17 Iter 69: loss 0.15613. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 17 Iter 69: loss 0.15613. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 17 Iter 70: loss 0.16961. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 17 Iter 70: loss 0.16961. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 17 Iter 71: loss 0.19317. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 17 Iter 71: loss 0.19317. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 17 Iter 72: loss 0.17968. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 17 Iter 72: loss 0.17968. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 17 Iter 73: loss 0.16188. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 17 Iter 73: loss 0.16188. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 17 Iter 74: loss 0.19483. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 17 Iter 74: loss 0.19483. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.03it/s]
Epoch 17 Iter 75: loss 0.16444. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.03it/s]
Epoch 17 Iter 75: loss 0.16444. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 17 Iter 76: loss 0.18748. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 17 Iter 76: loss 0.18748. :  34%|███████████████▎                             | 76/224 [00:36<01:13,  2.02it/s]
Epoch 17 Iter 77: loss 0.18634. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.02it/s]
Epoch 17 Iter 77: loss 0.18634. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.03it/s]
Epoch 17 Iter 78: loss 0.19005. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.03it/s]
Epoch 17 Iter 78: loss 0.19005. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.03it/s]
Epoch 17 Iter 79: loss 0.17865. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.03it/s]
Epoch 17 Iter 79: loss 0.17865. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 17 Iter 80: loss 0.19654. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.03it/s]
Epoch 17 Iter 80: loss 0.19654. :  36%|████████████████                             | 80/224 [00:38<01:11,  2.02it/s]
Epoch 17 Iter 81: loss 0.18450. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.02it/s]
Epoch 17 Iter 81: loss 0.18450. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 17 Iter 82: loss 0.16826. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.04it/s]
Epoch 17 Iter 82: loss 0.16826. :  37%|████████████████▍                            | 82/224 [00:39<01:10,  2.02it/s]
Epoch 17 Iter 83: loss 0.17538. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.02it/s]
Epoch 17 Iter 83: loss 0.17538. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.03it/s]
Epoch 17 Iter 84: loss 0.18759. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.03it/s]
Epoch 17 Iter 84: loss 0.18759. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.04it/s]
Epoch 17 Iter 85: loss 0.16027. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.04it/s]
Epoch 17 Iter 85: loss 0.16027. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.03it/s]
Epoch 17 Iter 86: loss 0.17475. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.03it/s]
Epoch 17 Iter 86: loss 0.17475. :  38%|█████████████████▎                           | 86/224 [00:41<01:08,  2.02it/s]
Epoch 17 Iter 87: loss 0.16250. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.02it/s]
Epoch 17 Iter 87: loss 0.16250. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.02it/s]
Epoch 17 Iter 88: loss 0.17785. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.02it/s]
Epoch 17 Iter 88: loss 0.17785. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.03it/s]
Epoch 17 Iter 89: loss 0.16580. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.03it/s]
Epoch 17 Iter 89: loss 0.16580. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.03it/s]
Epoch 17 Iter 90: loss 0.17169. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.03it/s]
Epoch 17 Iter 90: loss 0.17169. :  40%|██████████████████                           | 90/224 [00:43<01:06,  2.02it/s]
Epoch 17 Iter 91: loss 0.18080. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 17 Iter 91: loss 0.18080. :  41%|██████████████████▎                          | 91/224 [00:44<01:06,  2.02it/s]
Epoch 17 Iter 92: loss 0.17444. :  41%|██████████████████▎                          | 91/224 [00:44<01:06,  2.02it/s]
Epoch 17 Iter 92: loss 0.17444. :  41%|██████████████████▍                          | 92/224 [00:44<01:05,  2.02it/s]
Epoch 17 Iter 93: loss 0.16263. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.02it/s]
Epoch 17 Iter 93: loss 0.16263. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.02it/s]
Epoch 17 Iter 94: loss 0.18615. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.02it/s]
Epoch 17 Iter 94: loss 0.18615. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.04it/s]
Epoch 17 Iter 95: loss 0.15319. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 17 Iter 95: loss 0.15319. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.03it/s]
Epoch 17 Iter 96: loss 0.17018. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.03it/s]
Epoch 17 Iter 96: loss 0.17018. :  43%|███████████████████▎                         | 96/224 [00:46<01:03,  2.02it/s]
Epoch 17 Iter 97: loss 0.17928. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.02it/s]
Epoch 17 Iter 97: loss 0.17928. :  43%|███████████████████▍                         | 97/224 [00:47<01:03,  2.02it/s]
Epoch 17 Iter 98: loss 0.19804. :  43%|███████████████████▍                         | 97/224 [00:47<01:03,  2.02it/s]
Epoch 17 Iter 98: loss 0.19804. :  44%|███████████████████▋                         | 98/224 [00:47<01:02,  2.03it/s]
Epoch 17 Iter 99: loss 0.17862. :  44%|███████████████████▋                         | 98/224 [00:48<01:02,  2.03it/s]
Epoch 17 Iter 99: loss 0.17862. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.03it/s]
Epoch 17 Iter 100: loss 0.15535. :  44%|███████████████████▍                        | 99/224 [00:48<01:01,  2.03it/s]
Epoch 17 Iter 100: loss 0.15535. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.04it/s]
Epoch 17 Iter 101: loss 0.17216. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.04it/s]
Epoch 17 Iter 101: loss 0.17216. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 17 Iter 102: loss 0.18842. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 17 Iter 102: loss 0.18842. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 17 Iter 103: loss 0.19999. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 17 Iter 103: loss 0.19999. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 17 Iter 104: loss 0.16127. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 17 Iter 104: loss 0.16127. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 17 Iter 105: loss 0.15509. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.05it/s]
Epoch 17 Iter 105: loss 0.15509. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 17 Iter 106: loss 0.18947. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 17 Iter 106: loss 0.18947. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 17 Iter 107: loss 0.18208. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.05it/s]
Epoch 17 Iter 107: loss 0.18208. :  48%|████████████████████▌                      | 107/224 [00:52<00:58,  2.02it/s]
Epoch 17 Iter 108: loss 0.19463. :  48%|████████████████████▌                      | 107/224 [00:52<00:58,  2.02it/s]
Epoch 17 Iter 108: loss 0.19463. :  48%|████████████████████▋                      | 108/224 [00:52<00:57,  2.00it/s]
Epoch 17 Iter 109: loss 0.17848. :  48%|████████████████████▋                      | 108/224 [00:53<00:57,  2.00it/s]
Epoch 17 Iter 109: loss 0.17848. :  49%|████████████████████▉                      | 109/224 [00:53<00:58,  1.95it/s]
Epoch 17 Iter 110: loss 0.16934. :  49%|████████████████████▉                      | 109/224 [00:53<00:58,  1.95it/s]
Epoch 17 Iter 110: loss 0.16934. :  49%|█████████████████████                      | 110/224 [00:53<01:00,  1.89it/s]
Epoch 17 Iter 111: loss 0.17616. :  49%|█████████████████████                      | 110/224 [00:54<01:00,  1.89it/s]
Epoch 17 Iter 111: loss 0.17616. :  50%|█████████████████████▎                     | 111/224 [00:54<01:00,  1.86it/s]
Epoch 17 Iter 112: loss 0.18312. :  50%|█████████████████████▎                     | 111/224 [00:54<01:00,  1.86it/s]
Epoch 17 Iter 112: loss 0.18312. :  50%|█████████████████████▌                     | 112/224 [00:54<01:01,  1.83it/s]
Epoch 17 Iter 113: loss 0.16801. :  50%|█████████████████████▌                     | 112/224 [00:55<01:01,  1.83it/s]
Epoch 17 Iter 113: loss 0.16801. :  50%|█████████████████████▋                     | 113/224 [00:55<01:00,  1.85it/s]
Epoch 17 Iter 114: loss 0.17236. :  50%|█████████████████████▋                     | 113/224 [00:55<01:00,  1.85it/s]
Epoch 17 Iter 114: loss 0.17236. :  51%|█████████████████████▉                     | 114/224 [00:55<00:56,  1.94it/s]
Epoch 17 Iter 115: loss 0.18270. :  51%|█████████████████████▉                     | 114/224 [00:56<00:56,  1.94it/s]
Epoch 17 Iter 115: loss 0.18270. :  51%|██████████████████████                     | 115/224 [00:56<00:55,  1.98it/s]
Epoch 17 Iter 116: loss 0.17930. :  51%|██████████████████████                     | 115/224 [00:56<00:55,  1.98it/s]
Epoch 17 Iter 116: loss 0.17930. :  52%|██████████████████████▎                    | 116/224 [00:56<00:54,  1.99it/s]
Epoch 17 Iter 117: loss 0.18296. :  52%|██████████████████████▎                    | 116/224 [00:57<00:54,  1.99it/s]
Epoch 17 Iter 117: loss 0.18296. :  52%|██████████████████████▍                    | 117/224 [00:57<00:53,  2.01it/s]
Epoch 17 Iter 118: loss 0.18073. :  52%|██████████████████████▍                    | 117/224 [00:57<00:53,  2.01it/s]
Epoch 17 Iter 118: loss 0.18073. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.04it/s]
Epoch 17 Iter 119: loss 0.16852. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.04it/s]
Epoch 17 Iter 119: loss 0.16852. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 17 Iter 120: loss 0.15951. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 17 Iter 120: loss 0.15951. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 17 Iter 121: loss 0.19747. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.05it/s]
Epoch 17 Iter 121: loss 0.19747. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 17 Iter 122: loss 0.16114. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 17 Iter 122: loss 0.16114. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 17 Iter 123: loss 0.15522. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.07it/s]
Epoch 17 Iter 123: loss 0.15522. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 17 Iter 124: loss 0.16307. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 17 Iter 124: loss 0.16307. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 17 Iter 125: loss 0.18414. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.06it/s]
Epoch 17 Iter 125: loss 0.18414. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.06it/s]
Epoch 17 Iter 126: loss 0.18400. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.06it/s]
Epoch 17 Iter 126: loss 0.18400. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 17 Iter 127: loss 0.18618. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.08it/s]
Epoch 17 Iter 127: loss 0.18618. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 17 Iter 128: loss 0.18489. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 17 Iter 128: loss 0.18489. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 17 Iter 129: loss 0.17787. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.07it/s]
Epoch 17 Iter 129: loss 0.17787. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.02it/s]
Epoch 17 Iter 130: loss 0.17249. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.02it/s]
Epoch 17 Iter 130: loss 0.17249. :  58%|████████████████████████▉                  | 130/224 [01:03<00:46,  2.02it/s]
Epoch 17 Iter 131: loss 0.21172. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.02it/s]
Epoch 17 Iter 131: loss 0.21172. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.03it/s]
Epoch 17 Iter 132: loss 0.16256. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.03it/s]
Epoch 17 Iter 132: loss 0.16256. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:45,  2.02it/s]
Epoch 17 Iter 133: loss 0.19066. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:45,  2.02it/s]
Epoch 17 Iter 133: loss 0.19066. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:45,  2.02it/s]
Epoch 17 Iter 134: loss 0.16167. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:45,  2.02it/s]
Epoch 17 Iter 134: loss 0.16167. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:44,  2.03it/s]
Epoch 17 Iter 135: loss 0.17079. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:44,  2.03it/s]
Epoch 17 Iter 135: loss 0.17079. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.03it/s]
Epoch 17 Iter 136: loss 0.17812. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.03it/s]
Epoch 17 Iter 136: loss 0.17812. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 17 Iter 137: loss 0.18127. :  61%|██████████████████████████                 | 136/224 [01:07<00:43,  2.04it/s]
Epoch 17 Iter 137: loss 0.18127. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.04it/s]
Epoch 17 Iter 138: loss 0.19891. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.04it/s]
Epoch 17 Iter 138: loss 0.19891. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 17 Iter 139: loss 0.16723. :  62%|██████████████████████████▍                | 138/224 [01:08<00:42,  2.04it/s]
Epoch 17 Iter 139: loss 0.16723. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 17 Iter 140: loss 0.16664. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 17 Iter 140: loss 0.16664. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 17 Iter 141: loss 0.16474. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 17 Iter 141: loss 0.16474. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 17 Iter 142: loss 0.16869. :  63%|███████████████████████████                | 141/224 [01:09<00:39,  2.08it/s]
Epoch 17 Iter 142: loss 0.16869. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 17 Iter 143: loss 0.19814. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 17 Iter 143: loss 0.19814. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 17 Iter 144: loss 0.16194. :  64%|███████████████████████████▍               | 143/224 [01:10<00:38,  2.09it/s]
Epoch 17 Iter 144: loss 0.16194. :  64%|███████████████████████████▋               | 144/224 [01:10<00:37,  2.11it/s]
Epoch 17 Iter 145: loss 0.19269. :  64%|███████████████████████████▋               | 144/224 [01:10<00:37,  2.11it/s]
Epoch 17 Iter 145: loss 0.19269. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.10it/s]
Epoch 17 Iter 146: loss 0.18035. :  65%|███████████████████████████▊               | 145/224 [01:11<00:37,  2.10it/s]
Epoch 17 Iter 146: loss 0.18035. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 17 Iter 147: loss 0.15971. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 17 Iter 147: loss 0.15971. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 17 Iter 148: loss 0.18038. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.08it/s]
Epoch 17 Iter 148: loss 0.18038. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 17 Iter 149: loss 0.19639. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 17 Iter 149: loss 0.19639. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 17 Iter 150: loss 0.18552. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 17 Iter 150: loss 0.18552. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 17 Iter 151: loss 0.16661. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 17 Iter 151: loss 0.16661. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 17 Iter 152: loss 0.19961. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.05it/s]
Epoch 17 Iter 152: loss 0.19961. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 17 Iter 153: loss 0.16042. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 17 Iter 153: loss 0.16042. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 17 Iter 154: loss 0.18196. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 17 Iter 154: loss 0.18196. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 17 Iter 155: loss 0.18811. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.05it/s]
Epoch 17 Iter 155: loss 0.18811. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 17 Iter 156: loss 0.18272. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.05it/s]
Epoch 17 Iter 156: loss 0.18272. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.04it/s]
Epoch 17 Iter 157: loss 0.16909. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.04it/s]
Epoch 17 Iter 157: loss 0.16909. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 17 Iter 158: loss 0.17489. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.05it/s]
Epoch 17 Iter 158: loss 0.17489. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 17 Iter 159: loss 0.20750. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 17 Iter 159: loss 0.20750. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 17 Iter 160: loss 0.18129. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.05it/s]
Epoch 17 Iter 160: loss 0.18129. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 17 Iter 161: loss 0.16727. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 17 Iter 161: loss 0.16727. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 17 Iter 162: loss 0.17442. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.05it/s]
Epoch 17 Iter 162: loss 0.17442. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.05it/s]
Epoch 17 Iter 163: loss 0.20092. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.05it/s]
Epoch 17 Iter 163: loss 0.20092. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.04it/s]
Epoch 17 Iter 164: loss 0.19987. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.04it/s]
Epoch 17 Iter 164: loss 0.19987. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.03it/s]
Epoch 17 Iter 165: loss 0.18618. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.03it/s]
Epoch 17 Iter 165: loss 0.18618. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:29,  2.03it/s]
Epoch 17 Iter 166: loss 0.17468. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:29,  2.03it/s]
Epoch 17 Iter 166: loss 0.17468. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 17 Iter 167: loss 0.19380. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 17 Iter 167: loss 0.19380. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.04it/s]
Epoch 17 Iter 168: loss 0.16201. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.04it/s]
Epoch 17 Iter 168: loss 0.16201. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 17 Iter 169: loss 0.21187. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 17 Iter 169: loss 0.21187. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 17 Iter 170: loss 0.15861. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 17 Iter 170: loss 0.15861. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.07it/s]
Epoch 17 Iter 171: loss 0.17424. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.07it/s]
Epoch 17 Iter 171: loss 0.17424. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 17 Iter 172: loss 0.19113. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.07it/s]
Epoch 17 Iter 172: loss 0.19113. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 17 Iter 173: loss 0.18944. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 17 Iter 173: loss 0.18944. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 17 Iter 174: loss 0.20010. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.07it/s]
Epoch 17 Iter 174: loss 0.20010. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 17 Iter 175: loss 0.19844. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 17 Iter 175: loss 0.19844. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 17 Iter 176: loss 0.18112. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 17 Iter 176: loss 0.18112. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 17 Iter 177: loss 0.18677. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 17 Iter 177: loss 0.18677. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 17 Iter 178: loss 0.18397. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 17 Iter 178: loss 0.18397. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 17 Iter 179: loss 0.16906. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.06it/s]
Epoch 17 Iter 179: loss 0.16906. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 17 Iter 180: loss 0.17962. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 17 Iter 180: loss 0.17962. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 17 Iter 181: loss 0.16153. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.06it/s]
Epoch 17 Iter 181: loss 0.16153. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 17 Iter 182: loss 0.17743. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 17 Iter 182: loss 0.17743. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 17 Iter 183: loss 0.16106. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.05it/s]
Epoch 17 Iter 183: loss 0.16106. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 17 Iter 184: loss 0.16320. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.05it/s]
Epoch 17 Iter 184: loss 0.16320. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 17 Iter 185: loss 0.18146. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 17 Iter 185: loss 0.18146. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 17 Iter 186: loss 0.17805. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 17 Iter 186: loss 0.17805. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 17 Iter 187: loss 0.18642. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.07it/s]
Epoch 17 Iter 187: loss 0.18642. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 17 Iter 188: loss 0.16341. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 17 Iter 188: loss 0.16341. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 17 Iter 189: loss 0.17678. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.06it/s]
Epoch 17 Iter 189: loss 0.17678. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 17 Iter 190: loss 0.17374. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 17 Iter 190: loss 0.17374. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 17 Iter 191: loss 0.17723. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.06it/s]
Epoch 17 Iter 191: loss 0.17723. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 17 Iter 192: loss 0.16547. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 17 Iter 192: loss 0.16547. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 17 Iter 193: loss 0.17048. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.04it/s]
Epoch 17 Iter 193: loss 0.17048. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 17 Iter 194: loss 0.16307. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 17 Iter 194: loss 0.16307. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 17 Iter 195: loss 0.18765. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 195: loss 0.18765. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 196: loss 0.18439. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 17 Iter 196: loss 0.18439. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.04it/s]
Epoch 17 Iter 197: loss 0.17964. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.04it/s]
Epoch 17 Iter 197: loss 0.17964. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.04it/s]
Epoch 17 Iter 198: loss 0.15049. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.04it/s]
Epoch 17 Iter 198: loss 0.15049. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 17 Iter 199: loss 0.15039. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.04it/s]
Epoch 17 Iter 199: loss 0.15039. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 17 Iter 200: loss 0.19520. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 17 Iter 200: loss 0.19520. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 17 Iter 201: loss 0.17006. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.06it/s]
Epoch 17 Iter 201: loss 0.17006. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 17 Iter 202: loss 0.17489. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 17 Iter 202: loss 0.17489. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 17 Iter 203: loss 0.17265. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.06it/s]
Epoch 17 Iter 203: loss 0.17265. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.02it/s]
Epoch 17 Iter 204: loss 0.19005. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.02it/s]
Epoch 17 Iter 204: loss 0.19005. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.04it/s]
Epoch 17 Iter 205: loss 0.17680. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.04it/s]
Epoch 17 Iter 205: loss 0.17680. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.04it/s]
Epoch 17 Iter 206: loss 0.18035. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.04it/s]
Epoch 17 Iter 206: loss 0.18035. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.03it/s]
Epoch 17 Iter 207: loss 0.18364. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.03it/s]
Epoch 17 Iter 207: loss 0.18364. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.04it/s]
Epoch 17 Iter 208: loss 0.18385. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.04it/s]
Epoch 17 Iter 208: loss 0.18385. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 17 Iter 209: loss 0.19922. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.06it/s]
Epoch 17 Iter 209: loss 0.19922. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.06it/s]
Epoch 17 Iter 210: loss 0.17712. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.06it/s]
Epoch 17 Iter 210: loss 0.17712. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 17 Iter 211: loss 0.18631. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.06it/s]
Epoch 17 Iter 211: loss 0.18631. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 17 Iter 212: loss 0.16120. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.06it/s]
Epoch 17 Iter 212: loss 0.16120. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 17 Iter 213: loss 0.16461. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.06it/s]
Epoch 17 Iter 213: loss 0.16461. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.07it/s]
Epoch 17 Iter 214: loss 0.16468. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.07it/s]
Epoch 17 Iter 214: loss 0.16468. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 17 Iter 215: loss 0.18461. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 17 Iter 215: loss 0.18461. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 17 Iter 216: loss 0.18575. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.08it/s]
Epoch 17 Iter 216: loss 0.18575. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 17 Iter 217: loss 0.17714. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 17 Iter 217: loss 0.17714. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 17 Iter 218: loss 0.15591. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 17 Iter 218: loss 0.15591. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 17 Iter 219: loss 0.18804. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 17 Iter 219: loss 0.18804. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 17 Iter 220: loss 0.18551. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.07it/s]
Epoch 17 Iter 220: loss 0.18551. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 17 Iter 221: loss 0.16660. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 17 Iter 221: loss 0.16660. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 17 Iter 222: loss 0.17373. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.07it/s]
Epoch 17 Iter 222: loss 0.17373. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.08it/s]
Epoch 17 Iter 223: loss 0.17023. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.08it/s]
Epoch 17 Iter 223: loss 0.17023. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 17 Iter 224: loss 0.16535. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.08it/s]
Epoch 17 Iter 224: loss 0.16535. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.06it/s]
Epoch 17 Iter 224: loss 0.16535. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]

    Train loss: 0.17789
    Valid loss: 0.18026
       Valid loss recons: 0.17426
       Valid loss KL-D:   60.00432
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.16444. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 18 Iter 1: loss 0.16444. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 18 Iter 2: loss 0.18421. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 18 Iter 2: loss 0.18421. :   1%|▍                                              | 2/224 [00:00<01:48,  2.04it/s]
Epoch 18 Iter 3: loss 0.20101. :   1%|▍                                              | 2/224 [00:01<01:48,  2.04it/s]
Epoch 18 Iter 3: loss 0.20101. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 18 Iter 4: loss 0.16723. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 18 Iter 4: loss 0.16723. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 18 Iter 5: loss 0.18549. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 18 Iter 5: loss 0.18549. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 18 Iter 6: loss 0.18594. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 18 Iter 6: loss 0.18594. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 18 Iter 7: loss 0.17073. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 18 Iter 7: loss 0.17073. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 18 Iter 8: loss 0.18202. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 18 Iter 8: loss 0.18202. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 18 Iter 9: loss 0.17929. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 18 Iter 9: loss 0.17929. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 18 Iter 10: loss 0.16504. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 18 Iter 10: loss 0.16504. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 18 Iter 11: loss 0.18010. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 18 Iter 11: loss 0.18010. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 18 Iter 12: loss 0.18982. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 18 Iter 12: loss 0.18982. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.08it/s]
Epoch 18 Iter 13: loss 0.17587. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.08it/s]
Epoch 18 Iter 13: loss 0.17587. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 18 Iter 14: loss 0.16885. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 18 Iter 14: loss 0.16885. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 18 Iter 15: loss 0.18971. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 18 Iter 15: loss 0.18971. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 18 Iter 16: loss 0.20570. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 18 Iter 16: loss 0.20570. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 18 Iter 17: loss 0.17919. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 18 Iter 17: loss 0.17919. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 18 Iter 18: loss 0.17897. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 18 Iter 18: loss 0.17897. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 18 Iter 19: loss 0.17442. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 18 Iter 19: loss 0.17442. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 18 Iter 20: loss 0.19122. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 18 Iter 20: loss 0.19122. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 18 Iter 21: loss 0.16121. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 18 Iter 21: loss 0.16121. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 18 Iter 22: loss 0.15666. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 18 Iter 22: loss 0.15666. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 18 Iter 23: loss 0.17312. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 18 Iter 23: loss 0.17312. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 18 Iter 24: loss 0.18430. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 18 Iter 24: loss 0.18430. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 18 Iter 25: loss 0.17135. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 18 Iter 25: loss 0.17135. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 18 Iter 26: loss 0.17050. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 18 Iter 26: loss 0.17050. :  12%|█████▏                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 18 Iter 27: loss 0.19062. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 18 Iter 27: loss 0.19062. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.04it/s]
Epoch 18 Iter 28: loss 0.19858. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.04it/s]
Epoch 18 Iter 28: loss 0.19858. :  12%|█████▋                                       | 28/224 [00:13<01:36,  2.04it/s]
Epoch 18 Iter 29: loss 0.16348. :  12%|█████▋                                       | 28/224 [00:14<01:36,  2.04it/s]
Epoch 18 Iter 29: loss 0.16348. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 18 Iter 30: loss 0.16490. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 18 Iter 30: loss 0.16490. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 18 Iter 31: loss 0.17320. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 18 Iter 31: loss 0.17320. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 18 Iter 32: loss 0.19438. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 18 Iter 32: loss 0.19438. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 18 Iter 33: loss 0.17317. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 18 Iter 33: loss 0.17317. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 18 Iter 34: loss 0.15733. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 18 Iter 34: loss 0.15733. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 18 Iter 35: loss 0.15782. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 18 Iter 35: loss 0.15782. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 18 Iter 36: loss 0.16952. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 18 Iter 36: loss 0.16952. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 18 Iter 37: loss 0.17747. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 18 Iter 37: loss 0.17747. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 18 Iter 38: loss 0.18870. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 18 Iter 38: loss 0.18870. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.09it/s]
Epoch 18 Iter 39: loss 0.16583. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.09it/s]
Epoch 18 Iter 39: loss 0.16583. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 18 Iter 40: loss 0.16519. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 18 Iter 40: loss 0.16519. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 18 Iter 41: loss 0.18861. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 18 Iter 41: loss 0.18861. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 18 Iter 42: loss 0.16527. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 18 Iter 42: loss 0.16527. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 18 Iter 43: loss 0.16586. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 18 Iter 43: loss 0.16586. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 18 Iter 44: loss 0.19536. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 18 Iter 44: loss 0.19536. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 18 Iter 45: loss 0.16777. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 18 Iter 45: loss 0.16777. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 18 Iter 46: loss 0.16044. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 18 Iter 46: loss 0.16044. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 18 Iter 47: loss 0.17844. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 18 Iter 47: loss 0.17844. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.05it/s]
Epoch 18 Iter 48: loss 0.20328. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.05it/s]
Epoch 18 Iter 48: loss 0.20328. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 18 Iter 49: loss 0.19389. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 18 Iter 49: loss 0.19389. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 18 Iter 50: loss 0.17969. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 18 Iter 50: loss 0.17969. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 18 Iter 51: loss 0.16662. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 18 Iter 51: loss 0.16662. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 18 Iter 52: loss 0.17532. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 18 Iter 52: loss 0.17532. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 18 Iter 53: loss 0.19805. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 18 Iter 53: loss 0.19805. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 18 Iter 54: loss 0.17607. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 18 Iter 54: loss 0.17607. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 18 Iter 55: loss 0.19544. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 18 Iter 55: loss 0.19544. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 18 Iter 56: loss 0.17229. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 18 Iter 56: loss 0.17229. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 18 Iter 57: loss 0.18193. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 18 Iter 57: loss 0.18193. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 18 Iter 58: loss 0.18257. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 18 Iter 58: loss 0.18257. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 18 Iter 59: loss 0.17527. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 18 Iter 59: loss 0.17527. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 18 Iter 60: loss 0.16237. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 18 Iter 60: loss 0.16237. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 18 Iter 61: loss 0.17627. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 18 Iter 61: loss 0.17627. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 18 Iter 62: loss 0.16936. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 18 Iter 62: loss 0.16936. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 18 Iter 63: loss 0.17440. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 18 Iter 63: loss 0.17440. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 18 Iter 64: loss 0.18551. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 18 Iter 64: loss 0.18551. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 18 Iter 65: loss 0.16552. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 18 Iter 65: loss 0.16552. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 18 Iter 66: loss 0.16977. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 18 Iter 66: loss 0.16977. :  29%|█████████████▎                               | 66/224 [00:31<01:15,  2.08it/s]
Epoch 18 Iter 67: loss 0.17388. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 18 Iter 67: loss 0.17388. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 18 Iter 68: loss 0.18113. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 18 Iter 68: loss 0.18113. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.08it/s]
Epoch 18 Iter 69: loss 0.18389. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 18 Iter 69: loss 0.18389. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.09it/s]
Epoch 18 Iter 70: loss 0.16923. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.09it/s]
Epoch 18 Iter 70: loss 0.16923. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.08it/s]
Epoch 18 Iter 71: loss 0.16397. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.08it/s]
Epoch 18 Iter 71: loss 0.16397. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 18 Iter 72: loss 0.18639. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 18 Iter 72: loss 0.18639. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 18 Iter 73: loss 0.18572. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 18 Iter 73: loss 0.18572. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 18 Iter 74: loss 0.18822. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 18 Iter 74: loss 0.18822. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 18 Iter 75: loss 0.17070. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 18 Iter 75: loss 0.17070. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 18 Iter 76: loss 0.17238. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 18 Iter 76: loss 0.17238. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 18 Iter 77: loss 0.18430. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 18 Iter 77: loss 0.18430. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 18 Iter 78: loss 0.16774. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 18 Iter 78: loss 0.16774. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 18 Iter 79: loss 0.16046. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 18 Iter 79: loss 0.16046. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 18 Iter 80: loss 0.18328. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 18 Iter 80: loss 0.18328. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 18 Iter 81: loss 0.17912. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 18 Iter 81: loss 0.17912. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 18 Iter 82: loss 0.18147. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 18 Iter 82: loss 0.18147. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 18 Iter 83: loss 0.17816. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 18 Iter 83: loss 0.17816. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 18 Iter 84: loss 0.16364. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 18 Iter 84: loss 0.16364. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 18 Iter 85: loss 0.17368. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 18 Iter 85: loss 0.17368. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 18 Iter 86: loss 0.17963. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 18 Iter 86: loss 0.17963. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 18 Iter 87: loss 0.17090. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 18 Iter 87: loss 0.17090. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 18 Iter 88: loss 0.17788. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 18 Iter 88: loss 0.17788. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 18 Iter 89: loss 0.16360. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 18 Iter 89: loss 0.16360. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 18 Iter 90: loss 0.15989. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 18 Iter 90: loss 0.15989. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 18 Iter 91: loss 0.16848. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 18 Iter 91: loss 0.16848. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 18 Iter 92: loss 0.15135. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 18 Iter 92: loss 0.15135. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 18 Iter 93: loss 0.16935. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 18 Iter 93: loss 0.16935. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 18 Iter 94: loss 0.17754. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 18 Iter 94: loss 0.17754. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 18 Iter 95: loss 0.17154. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 18 Iter 95: loss 0.17154. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 18 Iter 96: loss 0.17727. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 18 Iter 96: loss 0.17727. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 18 Iter 97: loss 0.17923. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 18 Iter 97: loss 0.17923. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 18 Iter 98: loss 0.18202. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 18 Iter 98: loss 0.18202. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 18 Iter 99: loss 0.18642. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 18 Iter 99: loss 0.18642. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.08it/s]
Epoch 18 Iter 100: loss 0.18551. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 18 Iter 100: loss 0.18551. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 18 Iter 101: loss 0.17044. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 18 Iter 101: loss 0.17044. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 18 Iter 102: loss 0.17367. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 18 Iter 102: loss 0.17367. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 18 Iter 103: loss 0.17748. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.09it/s]
Epoch 18 Iter 103: loss 0.17748. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 18 Iter 104: loss 0.18312. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 18 Iter 104: loss 0.18312. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 18 Iter 105: loss 0.19202. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 18 Iter 105: loss 0.19202. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 18 Iter 106: loss 0.17275. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 18 Iter 106: loss 0.17275. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 18 Iter 107: loss 0.19095. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 18 Iter 107: loss 0.19095. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 18 Iter 108: loss 0.17082. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 18 Iter 108: loss 0.17082. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 18 Iter 109: loss 0.17709. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 18 Iter 109: loss 0.17709. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 18 Iter 110: loss 0.18011. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 18 Iter 110: loss 0.18011. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 18 Iter 111: loss 0.16982. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 18 Iter 111: loss 0.16982. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 18 Iter 112: loss 0.17542. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 18 Iter 112: loss 0.17542. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 18 Iter 113: loss 0.17770. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 18 Iter 113: loss 0.17770. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 18 Iter 114: loss 0.19395. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 18 Iter 114: loss 0.19395. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 18 Iter 115: loss 0.19659. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 18 Iter 115: loss 0.19659. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 18 Iter 116: loss 0.15842. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.08it/s]
Epoch 18 Iter 116: loss 0.15842. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 18 Iter 117: loss 0.17738. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 18 Iter 117: loss 0.17738. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 18 Iter 118: loss 0.17109. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 18 Iter 118: loss 0.17109. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 18 Iter 119: loss 0.17493. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 18 Iter 119: loss 0.17493. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 18 Iter 120: loss 0.17131. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 18 Iter 120: loss 0.17131. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 18 Iter 121: loss 0.17477. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 18 Iter 121: loss 0.17477. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 18 Iter 122: loss 0.17056. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 18 Iter 122: loss 0.17056. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 18 Iter 123: loss 0.19100. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 18 Iter 123: loss 0.19100. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 18 Iter 124: loss 0.17399. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 18 Iter 124: loss 0.17399. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 18 Iter 125: loss 0.18606. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 18 Iter 125: loss 0.18606. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 18 Iter 126: loss 0.18323. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 18 Iter 126: loss 0.18323. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.06it/s]
Epoch 18 Iter 127: loss 0.16181. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 18 Iter 127: loss 0.16181. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 18 Iter 128: loss 0.17275. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 18 Iter 128: loss 0.17275. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 18 Iter 129: loss 0.16824. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 18 Iter 129: loss 0.16824. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 18 Iter 130: loss 0.16353. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 18 Iter 130: loss 0.16353. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.08it/s]
Epoch 18 Iter 131: loss 0.16919. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 18 Iter 131: loss 0.16919. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 18 Iter 132: loss 0.17402. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 18 Iter 132: loss 0.17402. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 18 Iter 133: loss 0.16062. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 18 Iter 133: loss 0.16062. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.10it/s]
Epoch 18 Iter 134: loss 0.19213. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.10it/s]
Epoch 18 Iter 134: loss 0.19213. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:42,  2.11it/s]
Epoch 18 Iter 135: loss 0.17594. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:42,  2.11it/s]
Epoch 18 Iter 135: loss 0.17594. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.11it/s]
Epoch 18 Iter 136: loss 0.17919. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.11it/s]
Epoch 18 Iter 136: loss 0.17919. :  61%|██████████████████████████                 | 136/224 [01:05<00:41,  2.11it/s]
Epoch 18 Iter 137: loss 0.16382. :  61%|██████████████████████████                 | 136/224 [01:06<00:41,  2.11it/s]
Epoch 18 Iter 137: loss 0.16382. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.11it/s]
Epoch 18 Iter 138: loss 0.16505. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.11it/s]
Epoch 18 Iter 138: loss 0.16505. :  62%|██████████████████████████▍                | 138/224 [01:06<00:40,  2.12it/s]
Epoch 18 Iter 139: loss 0.15040. :  62%|██████████████████████████▍                | 138/224 [01:07<00:40,  2.12it/s]
Epoch 18 Iter 139: loss 0.15040. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.12it/s]
Epoch 18 Iter 140: loss 0.18664. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.12it/s]
Epoch 18 Iter 140: loss 0.18664. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 18 Iter 141: loss 0.17265. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 18 Iter 141: loss 0.17265. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 18 Iter 142: loss 0.19191. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 18 Iter 142: loss 0.19191. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 18 Iter 143: loss 0.16382. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 18 Iter 143: loss 0.16382. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 18 Iter 144: loss 0.18850. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 18 Iter 144: loss 0.18850. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.19706. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 18 Iter 145: loss 0.19706. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 18 Iter 146: loss 0.19093. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 18 Iter 146: loss 0.19093. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 18 Iter 147: loss 0.18205. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 18 Iter 147: loss 0.18205. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 18 Iter 148: loss 0.18584. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 18 Iter 148: loss 0.18584. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 18 Iter 149: loss 0.16964. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 18 Iter 149: loss 0.16964. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 18 Iter 150: loss 0.16996. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 18 Iter 150: loss 0.16996. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 18 Iter 151: loss 0.20839. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 18 Iter 151: loss 0.20839. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 18 Iter 152: loss 0.17848. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 18 Iter 152: loss 0.17848. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 18 Iter 153: loss 0.15968. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 18 Iter 153: loss 0.15968. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.06it/s]
Epoch 18 Iter 154: loss 0.16477. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 18 Iter 154: loss 0.16477. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 18 Iter 155: loss 0.17196. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 18 Iter 155: loss 0.17196. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 18 Iter 156: loss 0.17446. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 18 Iter 156: loss 0.17446. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 18 Iter 157: loss 0.16048. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 18 Iter 157: loss 0.16048. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 18 Iter 158: loss 0.18126. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 18 Iter 158: loss 0.18126. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 18 Iter 159: loss 0.15929. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 18 Iter 159: loss 0.15929. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 18 Iter 160: loss 0.17898. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 18 Iter 160: loss 0.17898. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 18 Iter 161: loss 0.16907. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 18 Iter 161: loss 0.16907. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 18 Iter 162: loss 0.19436. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 18 Iter 162: loss 0.19436. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 18 Iter 163: loss 0.16127. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 18 Iter 163: loss 0.16127. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 18 Iter 164: loss 0.16523. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 18 Iter 164: loss 0.16523. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 18 Iter 165: loss 0.18614. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 18 Iter 165: loss 0.18614. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 18 Iter 166: loss 0.20175. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 18 Iter 166: loss 0.20175. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 18 Iter 167: loss 0.18122. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 18 Iter 167: loss 0.18122. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 18 Iter 168: loss 0.18043. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 18 Iter 168: loss 0.18043. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 18 Iter 169: loss 0.18149. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 18 Iter 169: loss 0.18149. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.17760. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 18 Iter 170: loss 0.17760. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.19128. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 18 Iter 171: loss 0.19128. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 18 Iter 172: loss 0.20266. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 18 Iter 172: loss 0.20266. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 18 Iter 173: loss 0.18686. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 18 Iter 173: loss 0.18686. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 18 Iter 174: loss 0.19478. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 18 Iter 174: loss 0.19478. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 18 Iter 175: loss 0.17689. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 18 Iter 175: loss 0.17689. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 18 Iter 176: loss 0.16215. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 18 Iter 176: loss 0.16215. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 18 Iter 177: loss 0.17894. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 18 Iter 177: loss 0.17894. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:23,  2.04it/s]
Epoch 18 Iter 178: loss 0.18385. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:23,  2.04it/s]
Epoch 18 Iter 178: loss 0.18385. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 18 Iter 179: loss 0.18923. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 18 Iter 179: loss 0.18923. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 18 Iter 180: loss 0.16517. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 18 Iter 180: loss 0.16517. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 18 Iter 181: loss 0.18086. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 18 Iter 181: loss 0.18086. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 18 Iter 182: loss 0.16970. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 18 Iter 182: loss 0.16970. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 18 Iter 183: loss 0.16864. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 18 Iter 183: loss 0.16864. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 18 Iter 184: loss 0.19722. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 18 Iter 184: loss 0.19722. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 18 Iter 185: loss 0.18149. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 18 Iter 185: loss 0.18149. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 18 Iter 186: loss 0.18854. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 18 Iter 186: loss 0.18854. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 18 Iter 187: loss 0.17662. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 18 Iter 187: loss 0.17662. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 18 Iter 188: loss 0.19107. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 18 Iter 188: loss 0.19107. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 18 Iter 189: loss 0.17084. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 18 Iter 189: loss 0.17084. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 18 Iter 190: loss 0.19001. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 18 Iter 190: loss 0.19001. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 18 Iter 191: loss 0.17946. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 18 Iter 191: loss 0.17946. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 18 Iter 192: loss 0.17767. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 18 Iter 192: loss 0.17767. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 18 Iter 193: loss 0.18630. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 18 Iter 193: loss 0.18630. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 18 Iter 194: loss 0.18145. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 18 Iter 194: loss 0.18145. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 18 Iter 195: loss 0.16581. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 18 Iter 195: loss 0.16581. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 18 Iter 196: loss 0.17799. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 18 Iter 196: loss 0.17799. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 18 Iter 197: loss 0.17894. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 18 Iter 197: loss 0.17894. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 18 Iter 198: loss 0.17088. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 18 Iter 198: loss 0.17088. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 18 Iter 199: loss 0.17134. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 18 Iter 199: loss 0.17134. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 18 Iter 200: loss 0.17782. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 18 Iter 200: loss 0.17782. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.04it/s]
Epoch 18 Iter 201: loss 0.18762. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.04it/s]
Epoch 18 Iter 201: loss 0.18762. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 18 Iter 202: loss 0.18997. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 18 Iter 202: loss 0.18997. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 18 Iter 203: loss 0.16508. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 18 Iter 203: loss 0.16508. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 18 Iter 204: loss 0.18722. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 18 Iter 204: loss 0.18722. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 18 Iter 205: loss 0.18095. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 18 Iter 205: loss 0.18095. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 18 Iter 206: loss 0.16854. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 18 Iter 206: loss 0.16854. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.05it/s]
Epoch 18 Iter 207: loss 0.19350. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.05it/s]
Epoch 18 Iter 207: loss 0.19350. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 18 Iter 208: loss 0.20543. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 18 Iter 208: loss 0.20543. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 18 Iter 209: loss 0.17716. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 18 Iter 209: loss 0.17716. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 18 Iter 210: loss 0.18180. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 18 Iter 210: loss 0.18180. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 18 Iter 211: loss 0.16507. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 18 Iter 211: loss 0.16507. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 18 Iter 212: loss 0.17257. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 18 Iter 212: loss 0.17257. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 18 Iter 213: loss 0.17613. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 18 Iter 213: loss 0.17613. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 18 Iter 214: loss 0.17996. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 18 Iter 214: loss 0.17996. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 18 Iter 215: loss 0.17061. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 18 Iter 215: loss 0.17061. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 18 Iter 216: loss 0.17403. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 18 Iter 216: loss 0.17403. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 18 Iter 217: loss 0.20227. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 18 Iter 217: loss 0.20227. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 18 Iter 218: loss 0.16985. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 18 Iter 218: loss 0.16985. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 18 Iter 219: loss 0.16357. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 18 Iter 219: loss 0.16357. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 18 Iter 220: loss 0.20112. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 18 Iter 220: loss 0.20112. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 18 Iter 221: loss 0.17332. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 18 Iter 221: loss 0.17332. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 18 Iter 222: loss 0.18951. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 18 Iter 222: loss 0.18951. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 18 Iter 223: loss 0.17282. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 18 Iter 223: loss 0.17282. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 18 Iter 224: loss 0.16888. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 18 Iter 224: loss 0.16888. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 18 Iter 224: loss 0.16888. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.17017. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 19 Iter 1: loss 0.17017. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 19 Iter 2: loss 0.16901. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 19 Iter 2: loss 0.16901. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 19 Iter 3: loss 0.19860. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 19 Iter 3: loss 0.19860. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 19 Iter 4: loss 0.17087. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 19 Iter 4: loss 0.17087. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 19 Iter 5: loss 0.16377. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 19 Iter 5: loss 0.16377. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 19 Iter 6: loss 0.18068. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 19 Iter 6: loss 0.18068. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 19 Iter 7: loss 0.18104. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 19 Iter 7: loss 0.18104. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 19 Iter 8: loss 0.17419. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 19 Iter 8: loss 0.17419. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 19 Iter 9: loss 0.15707. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 19 Iter 9: loss 0.15707. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 19 Iter 10: loss 0.16437. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 19 Iter 10: loss 0.16437. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 19 Iter 11: loss 0.18599. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 19 Iter 11: loss 0.18599. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 19 Iter 12: loss 0.15258. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 19 Iter 12: loss 0.15258. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 19 Iter 13: loss 0.15208. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 19 Iter 13: loss 0.15208. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 19 Iter 14: loss 0.16125. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 19 Iter 14: loss 0.16125. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 19 Iter 15: loss 0.17742. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 19 Iter 15: loss 0.17742. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 19 Iter 16: loss 0.16025. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 19 Iter 16: loss 0.16025. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 19 Iter 17: loss 0.16137. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 17: loss 0.16137. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 18: loss 0.16257. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 19 Iter 18: loss 0.16257. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 19 Iter 19: loss 0.18698. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 19: loss 0.18698. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.18927. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 20: loss 0.18927. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 19 Iter 21: loss 0.16859. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 19 Iter 21: loss 0.16859. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 19 Iter 22: loss 0.17335. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 19 Iter 22: loss 0.17335. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 19 Iter 23: loss 0.16756. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 19 Iter 23: loss 0.16756. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 19 Iter 24: loss 0.19059. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 19 Iter 24: loss 0.19059. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 19 Iter 25: loss 0.17704. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 19 Iter 25: loss 0.17704. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 19 Iter 26: loss 0.15380. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 19 Iter 26: loss 0.15380. :  12%|█████▏                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 19 Iter 27: loss 0.17645. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 19 Iter 27: loss 0.17645. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 19 Iter 28: loss 0.19396. :  12%|█████▍                                       | 27/224 [00:13<01:37,  2.03it/s]
Epoch 19 Iter 28: loss 0.19396. :  12%|█████▋                                       | 28/224 [00:13<01:37,  2.02it/s]
Epoch 19 Iter 29: loss 0.18432. :  12%|█████▋                                       | 28/224 [00:14<01:37,  2.02it/s]
Epoch 19 Iter 29: loss 0.18432. :  13%|█████▊                                       | 29/224 [00:14<01:37,  2.01it/s]
Epoch 19 Iter 30: loss 0.17316. :  13%|█████▊                                       | 29/224 [00:14<01:37,  2.01it/s]
Epoch 19 Iter 30: loss 0.17316. :  13%|██████                                       | 30/224 [00:14<01:36,  2.01it/s]
Epoch 19 Iter 31: loss 0.18985. :  13%|██████                                       | 30/224 [00:15<01:36,  2.01it/s]
Epoch 19 Iter 31: loss 0.18985. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.02it/s]
Epoch 19 Iter 32: loss 0.17596. :  14%|██████▏                                      | 31/224 [00:15<01:35,  2.02it/s]
Epoch 19 Iter 32: loss 0.17596. :  14%|██████▍                                      | 32/224 [00:15<01:34,  2.03it/s]
Epoch 19 Iter 33: loss 0.19443. :  14%|██████▍                                      | 32/224 [00:16<01:34,  2.03it/s]
Epoch 19 Iter 33: loss 0.19443. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.03it/s]
Epoch 19 Iter 34: loss 0.17856. :  15%|██████▋                                      | 33/224 [00:16<01:34,  2.03it/s]
Epoch 19 Iter 34: loss 0.17856. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 19 Iter 35: loss 0.17125. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 19 Iter 35: loss 0.17125. :  16%|███████                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 19 Iter 36: loss 0.17275. :  16%|███████                                      | 35/224 [00:17<01:34,  2.00it/s]
Epoch 19 Iter 36: loss 0.17275. :  16%|███████▏                                     | 36/224 [00:17<01:34,  2.00it/s]
Epoch 19 Iter 37: loss 0.16609. :  16%|███████▏                                     | 36/224 [00:18<01:34,  2.00it/s]
Epoch 19 Iter 37: loss 0.16609. :  17%|███████▍                                     | 37/224 [00:18<01:32,  2.02it/s]
Epoch 19 Iter 38: loss 0.19632. :  17%|███████▍                                     | 37/224 [00:18<01:32,  2.02it/s]
Epoch 19 Iter 38: loss 0.19632. :  17%|███████▋                                     | 38/224 [00:18<01:32,  2.02it/s]
Epoch 19 Iter 39: loss 0.18192. :  17%|███████▋                                     | 38/224 [00:19<01:32,  2.02it/s]
Epoch 19 Iter 39: loss 0.18192. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 19 Iter 40: loss 0.18606. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 19 Iter 40: loss 0.18606. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 19 Iter 41: loss 0.18817. :  18%|████████                                     | 40/224 [00:20<01:29,  2.06it/s]
Epoch 19 Iter 41: loss 0.18817. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.06it/s]
Epoch 19 Iter 42: loss 0.18505. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.06it/s]
Epoch 19 Iter 42: loss 0.18505. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 19 Iter 43: loss 0.17047. :  19%|████████▍                                    | 42/224 [00:21<01:28,  2.06it/s]
Epoch 19 Iter 43: loss 0.17047. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 19 Iter 44: loss 0.19765. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 19 Iter 44: loss 0.19765. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 19 Iter 45: loss 0.16679. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 19 Iter 45: loss 0.16679. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 19 Iter 46: loss 0.17854. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 19 Iter 46: loss 0.17854. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 19 Iter 47: loss 0.17311. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 19 Iter 47: loss 0.17311. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 19 Iter 48: loss 0.18106. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 19 Iter 48: loss 0.18106. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 19 Iter 49: loss 0.18596. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 19 Iter 49: loss 0.18596. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 19 Iter 50: loss 0.16548. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 19 Iter 50: loss 0.16548. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 19 Iter 51: loss 0.19255. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 19 Iter 51: loss 0.19255. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.04it/s]
Epoch 19 Iter 52: loss 0.16964. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.04it/s]
Epoch 19 Iter 52: loss 0.16964. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 19 Iter 53: loss 0.18344. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 19 Iter 53: loss 0.18344. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.04it/s]
Epoch 19 Iter 54: loss 0.17926. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.04it/s]
Epoch 19 Iter 54: loss 0.17926. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 19 Iter 55: loss 0.17971. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 19 Iter 55: loss 0.17971. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 19 Iter 56: loss 0.16422. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 19 Iter 56: loss 0.16422. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 19 Iter 57: loss 0.16674. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 19 Iter 57: loss 0.16674. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 19 Iter 58: loss 0.18046. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 19 Iter 58: loss 0.18046. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 59: loss 0.17671. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 19 Iter 59: loss 0.17671. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 19 Iter 60: loss 0.19699. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 19 Iter 60: loss 0.19699. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 19 Iter 61: loss 0.17825. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 19 Iter 61: loss 0.17825. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 19 Iter 62: loss 0.17670. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 19 Iter 62: loss 0.17670. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 19 Iter 63: loss 0.17397. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 19 Iter 63: loss 0.17397. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 19 Iter 64: loss 0.17657. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 19 Iter 64: loss 0.17657. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 19 Iter 65: loss 0.18335. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.04it/s]
Epoch 19 Iter 65: loss 0.18335. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 19 Iter 66: loss 0.19009. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 19 Iter 66: loss 0.19009. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 67: loss 0.18078. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 67: loss 0.18078. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.04it/s]
Epoch 19 Iter 68: loss 0.16757. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.04it/s]
Epoch 19 Iter 68: loss 0.16757. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 19 Iter 69: loss 0.19486. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 19 Iter 69: loss 0.19486. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.02it/s]
Epoch 19 Iter 70: loss 0.16194. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.02it/s]
Epoch 19 Iter 70: loss 0.16194. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 19 Iter 71: loss 0.19843. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 19 Iter 71: loss 0.19843. :  32%|██████████████▎                              | 71/224 [00:34<01:16,  2.01it/s]
Epoch 19 Iter 72: loss 0.20812. :  32%|██████████████▎                              | 71/224 [00:35<01:16,  2.01it/s]
Epoch 19 Iter 72: loss 0.20812. :  32%|██████████████▍                              | 72/224 [00:35<01:15,  2.01it/s]
Epoch 19 Iter 73: loss 0.15769. :  32%|██████████████▍                              | 72/224 [00:35<01:15,  2.01it/s]
Epoch 19 Iter 73: loss 0.15769. :  33%|██████████████▋                              | 73/224 [00:35<01:14,  2.02it/s]
Epoch 19 Iter 74: loss 0.16851. :  33%|██████████████▋                              | 73/224 [00:36<01:14,  2.02it/s]
Epoch 19 Iter 74: loss 0.16851. :  33%|██████████████▊                              | 74/224 [00:36<01:14,  2.01it/s]
Epoch 19 Iter 75: loss 0.15408. :  33%|██████████████▊                              | 74/224 [00:36<01:14,  2.01it/s]
Epoch 19 Iter 75: loss 0.15408. :  33%|███████████████                              | 75/224 [00:36<01:13,  2.01it/s]
Epoch 19 Iter 76: loss 0.19352. :  33%|███████████████                              | 75/224 [00:37<01:13,  2.01it/s]
Epoch 19 Iter 76: loss 0.19352. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.02it/s]
Epoch 19 Iter 77: loss 0.17372. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.02it/s]
Epoch 19 Iter 77: loss 0.17372. :  34%|███████████████▍                             | 77/224 [00:37<01:12,  2.03it/s]
Epoch 19 Iter 78: loss 0.19363. :  34%|███████████████▍                             | 77/224 [00:38<01:12,  2.03it/s]
Epoch 19 Iter 78: loss 0.19363. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 19 Iter 79: loss 0.18644. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 19 Iter 79: loss 0.18644. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 19 Iter 80: loss 0.16716. :  35%|███████████████▊                             | 79/224 [00:39<01:10,  2.06it/s]
Epoch 19 Iter 80: loss 0.16716. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 19 Iter 81: loss 0.17464. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 19 Iter 81: loss 0.17464. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.10it/s]
Epoch 19 Iter 82: loss 0.17261. :  36%|████████████████▎                            | 81/224 [00:40<01:08,  2.10it/s]
Epoch 19 Iter 82: loss 0.17261. :  37%|████████████████▍                            | 82/224 [00:40<01:07,  2.09it/s]
Epoch 19 Iter 83: loss 0.17603. :  37%|████████████████▍                            | 82/224 [00:40<01:07,  2.09it/s]
Epoch 19 Iter 83: loss 0.17603. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.10it/s]
Epoch 19 Iter 84: loss 0.17439. :  37%|████████████████▋                            | 83/224 [00:41<01:07,  2.10it/s]
Epoch 19 Iter 84: loss 0.17439. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.08it/s]
Epoch 19 Iter 85: loss 0.18373. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.08it/s]
Epoch 19 Iter 85: loss 0.18373. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 19 Iter 86: loss 0.15541. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 19 Iter 86: loss 0.15541. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 19 Iter 87: loss 0.18553. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 19 Iter 87: loss 0.18553. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 19 Iter 88: loss 0.18604. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 19 Iter 88: loss 0.18604. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 19 Iter 89: loss 0.18084. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 19 Iter 89: loss 0.18084. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 19 Iter 90: loss 0.17579. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 19 Iter 90: loss 0.17579. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 19 Iter 91: loss 0.19322. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 19 Iter 91: loss 0.19322. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 19 Iter 92: loss 0.17488. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 19 Iter 92: loss 0.17488. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 19 Iter 93: loss 0.17519. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 19 Iter 93: loss 0.17519. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 19 Iter 94: loss 0.18044. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 19 Iter 94: loss 0.18044. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 19 Iter 95: loss 0.18110. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 19 Iter 95: loss 0.18110. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 19 Iter 96: loss 0.17236. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 19 Iter 96: loss 0.17236. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 19 Iter 97: loss 0.16455. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 19 Iter 97: loss 0.16455. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 19 Iter 98: loss 0.18221. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 19 Iter 98: loss 0.18221. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 19 Iter 99: loss 0.18220. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 19 Iter 99: loss 0.18220. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.03it/s]
Epoch 19 Iter 100: loss 0.17720. :  44%|███████████████████▍                        | 99/224 [00:48<01:01,  2.03it/s]
Epoch 19 Iter 100: loss 0.17720. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.05it/s]
Epoch 19 Iter 101: loss 0.19237. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.05it/s]
Epoch 19 Iter 101: loss 0.19237. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 19 Iter 102: loss 0.15916. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 19 Iter 102: loss 0.15916. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 19 Iter 103: loss 0.17268. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.06it/s]
Epoch 19 Iter 103: loss 0.17268. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 19 Iter 104: loss 0.15552. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 19 Iter 104: loss 0.15552. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 19 Iter 105: loss 0.18123. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 19 Iter 105: loss 0.18123. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 19 Iter 106: loss 0.18866. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 19 Iter 106: loss 0.18866. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 19 Iter 107: loss 0.16644. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 19 Iter 107: loss 0.16644. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 19 Iter 108: loss 0.18883. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 19 Iter 108: loss 0.18883. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 19 Iter 109: loss 0.16417. :  48%|████████████████████▋                      | 108/224 [00:53<00:55,  2.07it/s]
Epoch 19 Iter 109: loss 0.16417. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 19 Iter 110: loss 0.17147. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 19 Iter 110: loss 0.17147. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 19 Iter 111: loss 0.16785. :  49%|█████████████████████                      | 110/224 [00:54<00:55,  2.06it/s]
Epoch 19 Iter 111: loss 0.16785. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 19 Iter 112: loss 0.18412. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 19 Iter 112: loss 0.18412. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 19 Iter 113: loss 0.18294. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.07it/s]
Epoch 19 Iter 113: loss 0.18294. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 19 Iter 114: loss 0.19068. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 19 Iter 114: loss 0.19068. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 19 Iter 115: loss 0.16832. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.07it/s]
Epoch 19 Iter 115: loss 0.16832. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 19 Iter 116: loss 0.18886. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 19 Iter 116: loss 0.18886. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 19 Iter 117: loss 0.19841. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.06it/s]
Epoch 19 Iter 117: loss 0.19841. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 19 Iter 118: loss 0.15947. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 19 Iter 118: loss 0.15947. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 19 Iter 119: loss 0.16320. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.06it/s]
Epoch 19 Iter 119: loss 0.16320. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 19 Iter 120: loss 0.16977. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 19 Iter 120: loss 0.16977. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 19 Iter 121: loss 0.16959. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 19 Iter 121: loss 0.16959. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 19 Iter 122: loss 0.20047. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 19 Iter 122: loss 0.20047. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 19 Iter 123: loss 0.17959. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 19 Iter 123: loss 0.17959. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.08it/s]
Epoch 19 Iter 124: loss 0.19832. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.08it/s]
Epoch 19 Iter 124: loss 0.19832. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 19 Iter 125: loss 0.17880. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 19 Iter 125: loss 0.17880. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 19 Iter 126: loss 0.19412. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.08it/s]
Epoch 19 Iter 126: loss 0.19412. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 19 Iter 127: loss 0.16929. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 19 Iter 127: loss 0.16929. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 19 Iter 128: loss 0.17488. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 19 Iter 128: loss 0.17488. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 19 Iter 129: loss 0.18465. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 19 Iter 129: loss 0.18465. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 19 Iter 130: loss 0.17000. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 19 Iter 130: loss 0.17000. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 19 Iter 131: loss 0.18876. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 19 Iter 131: loss 0.18876. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 19 Iter 132: loss 0.15578. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 19 Iter 132: loss 0.15578. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 19 Iter 133: loss 0.18270. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 19 Iter 133: loss 0.18270. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 19 Iter 134: loss 0.17821. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 19 Iter 134: loss 0.17821. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 19 Iter 135: loss 0.16215. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 19 Iter 135: loss 0.16215. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 19 Iter 136: loss 0.19767. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.07it/s]
Epoch 19 Iter 136: loss 0.19767. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 19 Iter 137: loss 0.18298. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 19 Iter 137: loss 0.18298. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 19 Iter 138: loss 0.18323. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.07it/s]
Epoch 19 Iter 138: loss 0.18323. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 19 Iter 139: loss 0.17550. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 19 Iter 139: loss 0.17550. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 19 Iter 140: loss 0.18028. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 19 Iter 140: loss 0.18028. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 19 Iter 141: loss 0.17254. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 19 Iter 141: loss 0.17254. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 19 Iter 142: loss 0.19232. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 19 Iter 142: loss 0.19232. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 19 Iter 143: loss 0.17337. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 19 Iter 143: loss 0.17337. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 19 Iter 144: loss 0.17540. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 19 Iter 144: loss 0.17540. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 19 Iter 145: loss 0.16191. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 19 Iter 145: loss 0.16191. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 19 Iter 146: loss 0.20710. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.07it/s]
Epoch 19 Iter 146: loss 0.20710. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 19 Iter 147: loss 0.17636. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 19 Iter 147: loss 0.17636. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 19 Iter 148: loss 0.16796. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.08it/s]
Epoch 19 Iter 148: loss 0.16796. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.08it/s]
Epoch 19 Iter 149: loss 0.16191. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.08it/s]
Epoch 19 Iter 149: loss 0.16191. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 19 Iter 150: loss 0.16347. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 19 Iter 150: loss 0.16347. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 19 Iter 151: loss 0.17324. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 19 Iter 151: loss 0.17324. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 19 Iter 152: loss 0.16135. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 19 Iter 152: loss 0.16135. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 19 Iter 153: loss 0.18120. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 19 Iter 153: loss 0.18120. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 19 Iter 154: loss 0.16053. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 19 Iter 154: loss 0.16053. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 19 Iter 155: loss 0.16442. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 19 Iter 155: loss 0.16442. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 19 Iter 156: loss 0.18288. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 19 Iter 156: loss 0.18288. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 19 Iter 157: loss 0.18485. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 19 Iter 157: loss 0.18485. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 19 Iter 158: loss 0.17825. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 19 Iter 158: loss 0.17825. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 19 Iter 159: loss 0.18163. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 19 Iter 159: loss 0.18163. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 19 Iter 160: loss 0.17412. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 19 Iter 160: loss 0.17412. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 19 Iter 161: loss 0.16479. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 161: loss 0.16479. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 162: loss 0.18131. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 19 Iter 162: loss 0.18131. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 19 Iter 163: loss 0.16979. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 19 Iter 163: loss 0.16979. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.17017. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 19 Iter 164: loss 0.17017. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.17799. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 19 Iter 165: loss 0.17799. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 19 Iter 166: loss 0.16905. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 19 Iter 166: loss 0.16905. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 19 Iter 167: loss 0.18692. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 19 Iter 167: loss 0.18692. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.19160. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 19 Iter 168: loss 0.19160. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 19 Iter 169: loss 0.17521. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.07it/s]
Epoch 19 Iter 169: loss 0.17521. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 19 Iter 170: loss 0.19601. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 19 Iter 170: loss 0.19601. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.08it/s]
Epoch 19 Iter 171: loss 0.15829. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.08it/s]
Epoch 19 Iter 171: loss 0.15829. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 19 Iter 172: loss 0.17026. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 19 Iter 172: loss 0.17026. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 19 Iter 173: loss 0.18702. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.07it/s]
Epoch 19 Iter 173: loss 0.18702. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 19 Iter 174: loss 0.19056. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 19 Iter 174: loss 0.19056. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 19 Iter 175: loss 0.17217. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.06it/s]
Epoch 19 Iter 175: loss 0.17217. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 19 Iter 176: loss 0.17848. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 19 Iter 176: loss 0.17848. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 19 Iter 177: loss 0.17203. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 19 Iter 177: loss 0.17203. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 19 Iter 178: loss 0.18188. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 19 Iter 178: loss 0.18188. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 19 Iter 179: loss 0.19356. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.07it/s]
Epoch 19 Iter 179: loss 0.19356. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 19 Iter 180: loss 0.18239. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 19 Iter 180: loss 0.18239. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 19 Iter 181: loss 0.17838. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 19 Iter 181: loss 0.17838. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 19 Iter 182: loss 0.17442. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 19 Iter 182: loss 0.17442. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.16167. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 19 Iter 183: loss 0.16167. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.18138. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 19 Iter 184: loss 0.18138. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.15834. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 19 Iter 185: loss 0.15834. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 19 Iter 186: loss 0.16776. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 19 Iter 186: loss 0.16776. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 19 Iter 187: loss 0.15846. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 19 Iter 187: loss 0.15846. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.09it/s]
Epoch 19 Iter 188: loss 0.18598. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.09it/s]
Epoch 19 Iter 188: loss 0.18598. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.10it/s]
Epoch 19 Iter 189: loss 0.16065. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.10it/s]
Epoch 19 Iter 189: loss 0.16065. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 19 Iter 190: loss 0.16789. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 19 Iter 190: loss 0.16789. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 19 Iter 191: loss 0.16279. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 19 Iter 191: loss 0.16279. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 19 Iter 192: loss 0.18422. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 19 Iter 192: loss 0.18422. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 19 Iter 193: loss 0.18319. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 19 Iter 193: loss 0.18319. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 19 Iter 194: loss 0.18085. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.06it/s]
Epoch 19 Iter 194: loss 0.18085. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 19 Iter 195: loss 0.17364. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 19 Iter 195: loss 0.17364. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 19 Iter 196: loss 0.17561. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.08it/s]
Epoch 19 Iter 196: loss 0.17561. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 19 Iter 197: loss 0.18331. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 19 Iter 197: loss 0.18331. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 19 Iter 198: loss 0.19105. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 19 Iter 198: loss 0.19105. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 19 Iter 199: loss 0.19166. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 19 Iter 199: loss 0.19166. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 19 Iter 200: loss 0.18405. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.06it/s]
Epoch 19 Iter 200: loss 0.18405. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 19 Iter 201: loss 0.16777. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 19 Iter 201: loss 0.16777. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 19 Iter 202: loss 0.17195. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 19 Iter 202: loss 0.17195. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 19 Iter 203: loss 0.17260. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 19 Iter 203: loss 0.17260. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 19 Iter 204: loss 0.19750. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.06it/s]
Epoch 19 Iter 204: loss 0.19750. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.19238. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 205: loss 0.19238. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 19 Iter 206: loss 0.17360. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 19 Iter 206: loss 0.17360. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 19 Iter 207: loss 0.17691. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 19 Iter 207: loss 0.17691. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 19 Iter 208: loss 0.19153. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.08it/s]
Epoch 19 Iter 208: loss 0.19153. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.09it/s]
Epoch 19 Iter 209: loss 0.18348. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.09it/s]
Epoch 19 Iter 209: loss 0.18348. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 19 Iter 210: loss 0.17518. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 19 Iter 210: loss 0.17518. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 19 Iter 211: loss 0.18572. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 19 Iter 211: loss 0.18572. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 19 Iter 212: loss 0.17605. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 19 Iter 212: loss 0.17605. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 19 Iter 213: loss 0.16774. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 19 Iter 213: loss 0.16774. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 19 Iter 214: loss 0.17482. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 19 Iter 214: loss 0.17482. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 19 Iter 215: loss 0.17940. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.09it/s]
Epoch 19 Iter 215: loss 0.17940. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 19 Iter 216: loss 0.18515. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.08it/s]
Epoch 19 Iter 216: loss 0.18515. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.09it/s]
Epoch 19 Iter 217: loss 0.17912. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.09it/s]
Epoch 19 Iter 217: loss 0.17912. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 19 Iter 218: loss 0.19185. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 19 Iter 218: loss 0.19185. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 19 Iter 219: loss 0.16305. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.09it/s]
Epoch 19 Iter 219: loss 0.16305. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 19 Iter 220: loss 0.17430. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 19 Iter 220: loss 0.17430. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 19 Iter 221: loss 0.18013. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.08it/s]
Epoch 19 Iter 221: loss 0.18013. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 19 Iter 222: loss 0.18520. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 19 Iter 222: loss 0.18520. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 19 Iter 223: loss 0.16377. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 19 Iter 223: loss 0.16377. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 19 Iter 224: loss 0.19313. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 19 Iter 224: loss 0.19313. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 19 Iter 224: loss 0.19313. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17723
    Valid loss: 0.18073
       Valid loss recons: 0.17441
       Valid loss KL-D:   63.22092
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.18057. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 20 Iter 1: loss 0.18057. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 20 Iter 2: loss 0.18775. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 20 Iter 2: loss 0.18775. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 20 Iter 3: loss 0.17596. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 20 Iter 3: loss 0.17596. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 20 Iter 4: loss 0.18496. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 20 Iter 4: loss 0.18496. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 20 Iter 5: loss 0.16911. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 20 Iter 5: loss 0.16911. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 20 Iter 6: loss 0.18617. :   2%|█                                              | 5/224 [00:02<01:47,  2.03it/s]
Epoch 20 Iter 6: loss 0.18617. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 20 Iter 7: loss 0.18530. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 20 Iter 7: loss 0.18530. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 20 Iter 8: loss 0.17502. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 20 Iter 8: loss 0.17502. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 20 Iter 9: loss 0.18257. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 20 Iter 9: loss 0.18257. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 20 Iter 10: loss 0.17847. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 20 Iter 10: loss 0.17847. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 20 Iter 11: loss 0.17903. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 20 Iter 11: loss 0.17903. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 20 Iter 12: loss 0.17804. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 20 Iter 12: loss 0.17804. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 20 Iter 13: loss 0.18739. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 20 Iter 13: loss 0.18739. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.04it/s]
Epoch 20 Iter 14: loss 0.17556. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.04it/s]
Epoch 20 Iter 14: loss 0.17556. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 20 Iter 15: loss 0.20043. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 20 Iter 15: loss 0.20043. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 20 Iter 16: loss 0.16894. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 20 Iter 16: loss 0.16894. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.04it/s]
Epoch 20 Iter 17: loss 0.18925. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.04it/s]
Epoch 20 Iter 17: loss 0.18925. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 20 Iter 18: loss 0.19933. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 20 Iter 18: loss 0.19933. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.08it/s]
Epoch 20 Iter 19: loss 0.19134. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.08it/s]
Epoch 20 Iter 19: loss 0.19134. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.09it/s]
Epoch 20 Iter 20: loss 0.18747. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.09it/s]
Epoch 20 Iter 20: loss 0.18747. :   9%|████                                         | 20/224 [00:09<01:37,  2.08it/s]
Epoch 20 Iter 21: loss 0.15087. :   9%|████                                         | 20/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 21: loss 0.15087. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 22: loss 0.16371. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 22: loss 0.16371. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.08it/s]
Epoch 20 Iter 23: loss 0.17522. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.08it/s]
Epoch 20 Iter 23: loss 0.17522. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 20 Iter 24: loss 0.16836. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 20 Iter 24: loss 0.16836. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 20 Iter 25: loss 0.18665. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 20 Iter 25: loss 0.18665. :  11%|█████                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 20 Iter 26: loss 0.16482. :  11%|█████                                        | 25/224 [00:12<01:38,  2.02it/s]
Epoch 20 Iter 26: loss 0.16482. :  12%|█████▏                                       | 26/224 [00:12<01:41,  1.95it/s]
Epoch 20 Iter 27: loss 0.17896. :  12%|█████▏                                       | 26/224 [00:13<01:41,  1.95it/s]
Epoch 20 Iter 27: loss 0.17896. :  12%|█████▍                                       | 27/224 [00:13<01:40,  1.97it/s]
Epoch 20 Iter 28: loss 0.17279. :  12%|█████▍                                       | 27/224 [00:13<01:40,  1.97it/s]
Epoch 20 Iter 28: loss 0.17279. :  12%|█████▋                                       | 28/224 [00:13<01:38,  1.99it/s]
Epoch 20 Iter 29: loss 0.18310. :  12%|█████▋                                       | 28/224 [00:14<01:38,  1.99it/s]
Epoch 20 Iter 29: loss 0.18310. :  13%|█████▊                                       | 29/224 [00:14<01:37,  2.00it/s]
Epoch 20 Iter 30: loss 0.19332. :  13%|█████▊                                       | 29/224 [00:14<01:37,  2.00it/s]
Epoch 20 Iter 30: loss 0.19332. :  13%|██████                                       | 30/224 [00:14<01:36,  2.02it/s]
Epoch 20 Iter 31: loss 0.17318. :  13%|██████                                       | 30/224 [00:15<01:36,  2.02it/s]
Epoch 20 Iter 31: loss 0.17318. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 20 Iter 32: loss 0.17170. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.04it/s]
Epoch 20 Iter 32: loss 0.17170. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 20 Iter 33: loss 0.17666. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 20 Iter 33: loss 0.17666. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 20 Iter 34: loss 0.19219. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 20 Iter 34: loss 0.19219. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 20 Iter 35: loss 0.17458. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 20 Iter 35: loss 0.17458. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 36: loss 0.17137. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 20 Iter 36: loss 0.17137. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 20 Iter 37: loss 0.16788. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 20 Iter 37: loss 0.16788. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.19012. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 20 Iter 38: loss 0.19012. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 20 Iter 39: loss 0.21052. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.05it/s]
Epoch 20 Iter 39: loss 0.21052. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 20 Iter 40: loss 0.16121. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 20 Iter 40: loss 0.16121. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 20 Iter 41: loss 0.18130. :  18%|████████                                     | 40/224 [00:20<01:29,  2.06it/s]
Epoch 20 Iter 41: loss 0.18130. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 20 Iter 42: loss 0.17325. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 20 Iter 42: loss 0.17325. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 20 Iter 43: loss 0.16835. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 20 Iter 43: loss 0.16835. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 20 Iter 44: loss 0.15431. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 20 Iter 44: loss 0.15431. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 20 Iter 45: loss 0.15982. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 20 Iter 45: loss 0.15982. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 20 Iter 46: loss 0.16272. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 20 Iter 46: loss 0.16272. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 20 Iter 47: loss 0.16313. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 20 Iter 47: loss 0.16313. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.04it/s]
Epoch 20 Iter 48: loss 0.18493. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 20 Iter 48: loss 0.18493. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 20 Iter 49: loss 0.18050. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.04it/s]
Epoch 20 Iter 49: loss 0.18050. :  22%|█████████▊                                   | 49/224 [00:23<01:26,  2.02it/s]
Epoch 20 Iter 50: loss 0.15687. :  22%|█████████▊                                   | 49/224 [00:24<01:26,  2.02it/s]
Epoch 20 Iter 50: loss 0.15687. :  22%|██████████                                   | 50/224 [00:24<01:26,  2.01it/s]
Epoch 20 Iter 51: loss 0.16629. :  22%|██████████                                   | 50/224 [00:24<01:26,  2.01it/s]
Epoch 20 Iter 51: loss 0.16629. :  23%|██████████▏                                  | 51/224 [00:24<01:26,  2.01it/s]
Epoch 20 Iter 52: loss 0.17719. :  23%|██████████▏                                  | 51/224 [00:25<01:26,  2.01it/s]
Epoch 20 Iter 52: loss 0.17719. :  23%|██████████▍                                  | 52/224 [00:25<01:25,  2.01it/s]
Epoch 20 Iter 53: loss 0.19034. :  23%|██████████▍                                  | 52/224 [00:25<01:25,  2.01it/s]
Epoch 20 Iter 53: loss 0.19034. :  24%|██████████▋                                  | 53/224 [00:25<01:24,  2.02it/s]
Epoch 20 Iter 54: loss 0.16539. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.02it/s]
Epoch 20 Iter 54: loss 0.16539. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 20 Iter 55: loss 0.18572. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 20 Iter 55: loss 0.18572. :  25%|███████████                                  | 55/224 [00:26<01:24,  2.00it/s]
Epoch 20 Iter 56: loss 0.19017. :  25%|███████████                                  | 55/224 [00:27<01:24,  2.00it/s]
Epoch 20 Iter 56: loss 0.19017. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.00it/s]
Epoch 20 Iter 57: loss 0.20410. :  25%|███████████▎                                 | 56/224 [00:27<01:23,  2.00it/s]
Epoch 20 Iter 57: loss 0.20410. :  25%|███████████▍                                 | 57/224 [00:27<01:23,  2.01it/s]
Epoch 20 Iter 58: loss 0.17332. :  25%|███████████▍                                 | 57/224 [00:28<01:23,  2.01it/s]
Epoch 20 Iter 58: loss 0.17332. :  26%|███████████▋                                 | 58/224 [00:28<01:23,  1.99it/s]
Epoch 20 Iter 59: loss 0.16621. :  26%|███████████▋                                 | 58/224 [00:28<01:23,  1.99it/s]
Epoch 20 Iter 59: loss 0.16621. :  26%|███████████▊                                 | 59/224 [00:28<01:22,  2.00it/s]
Epoch 20 Iter 60: loss 0.16970. :  26%|███████████▊                                 | 59/224 [00:29<01:22,  2.00it/s]
Epoch 20 Iter 60: loss 0.16970. :  27%|████████████                                 | 60/224 [00:29<01:21,  2.01it/s]
Epoch 20 Iter 61: loss 0.17763. :  27%|████████████                                 | 60/224 [00:29<01:21,  2.01it/s]
Epoch 20 Iter 61: loss 0.17763. :  27%|████████████▎                                | 61/224 [00:29<01:20,  2.02it/s]
Epoch 20 Iter 62: loss 0.16017. :  27%|████████████▎                                | 61/224 [00:30<01:20,  2.02it/s]
Epoch 20 Iter 62: loss 0.16017. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.03it/s]
Epoch 20 Iter 63: loss 0.15972. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.03it/s]
Epoch 20 Iter 63: loss 0.15972. :  28%|████████████▋                                | 63/224 [00:30<01:19,  2.02it/s]
Epoch 20 Iter 64: loss 0.18447. :  28%|████████████▋                                | 63/224 [00:31<01:19,  2.02it/s]
Epoch 20 Iter 64: loss 0.18447. :  29%|████████████▊                                | 64/224 [00:31<01:19,  2.01it/s]
Epoch 20 Iter 65: loss 0.17956. :  29%|████████████▊                                | 64/224 [00:31<01:19,  2.01it/s]
Epoch 20 Iter 65: loss 0.17956. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 20 Iter 66: loss 0.17831. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 20 Iter 66: loss 0.17831. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 20 Iter 67: loss 0.16573. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 20 Iter 67: loss 0.16573. :  30%|█████████████▍                               | 67/224 [00:32<01:18,  2.01it/s]
Epoch 20 Iter 68: loss 0.18616. :  30%|█████████████▍                               | 67/224 [00:33<01:18,  2.01it/s]
Epoch 20 Iter 68: loss 0.18616. :  30%|█████████████▋                               | 68/224 [00:33<01:17,  2.02it/s]
Epoch 20 Iter 69: loss 0.18447. :  30%|█████████████▋                               | 68/224 [00:33<01:17,  2.02it/s]
Epoch 20 Iter 69: loss 0.18447. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.04it/s]
Epoch 20 Iter 70: loss 0.17259. :  31%|█████████████▊                               | 69/224 [00:34<01:16,  2.04it/s]
Epoch 20 Iter 70: loss 0.17259. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 20 Iter 71: loss 0.15652. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.03it/s]
Epoch 20 Iter 71: loss 0.15652. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.18064. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 72: loss 0.18064. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.17706. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.04it/s]
Epoch 20 Iter 73: loss 0.17706. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 20 Iter 74: loss 0.17759. :  33%|██████████████▋                              | 73/224 [00:36<01:13,  2.05it/s]
Epoch 20 Iter 74: loss 0.17759. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 20 Iter 75: loss 0.18452. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 20 Iter 75: loss 0.18452. :  33%|███████████████                              | 75/224 [00:36<01:13,  2.03it/s]
Epoch 20 Iter 76: loss 0.17911. :  33%|███████████████                              | 75/224 [00:37<01:13,  2.03it/s]
Epoch 20 Iter 76: loss 0.17911. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.01it/s]
Epoch 20 Iter 77: loss 0.17623. :  34%|███████████████▎                             | 76/224 [00:37<01:13,  2.01it/s]
Epoch 20 Iter 77: loss 0.17623. :  34%|███████████████▍                             | 77/224 [00:37<01:13,  2.01it/s]
Epoch 20 Iter 78: loss 0.16296. :  34%|███████████████▍                             | 77/224 [00:38<01:13,  2.01it/s]
Epoch 20 Iter 78: loss 0.16296. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.02it/s]
Epoch 20 Iter 79: loss 0.18626. :  35%|███████████████▋                             | 78/224 [00:38<01:12,  2.02it/s]
Epoch 20 Iter 79: loss 0.18626. :  35%|███████████████▊                             | 79/224 [00:38<01:11,  2.02it/s]
Epoch 20 Iter 80: loss 0.18177. :  35%|███████████████▊                             | 79/224 [00:39<01:11,  2.02it/s]
Epoch 20 Iter 80: loss 0.18177. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.02it/s]
Epoch 20 Iter 81: loss 0.17682. :  36%|████████████████                             | 80/224 [00:39<01:11,  2.02it/s]
Epoch 20 Iter 81: loss 0.17682. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.02it/s]
Epoch 20 Iter 82: loss 0.19008. :  36%|████████████████▎                            | 81/224 [00:40<01:10,  2.02it/s]
Epoch 20 Iter 82: loss 0.19008. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.02it/s]
Epoch 20 Iter 83: loss 0.17643. :  37%|████████████████▍                            | 82/224 [00:40<01:10,  2.02it/s]
Epoch 20 Iter 83: loss 0.17643. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.04it/s]
Epoch 20 Iter 84: loss 0.18230. :  37%|████████████████▋                            | 83/224 [00:41<01:08,  2.04it/s]
Epoch 20 Iter 84: loss 0.18230. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 20 Iter 85: loss 0.17249. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 20 Iter 85: loss 0.17249. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 20 Iter 86: loss 0.18499. :  38%|█████████████████                            | 85/224 [00:42<01:08,  2.04it/s]
Epoch 20 Iter 86: loss 0.18499. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.01it/s]
Epoch 20 Iter 87: loss 0.18419. :  38%|█████████████████▎                           | 86/224 [00:42<01:08,  2.01it/s]
Epoch 20 Iter 87: loss 0.18419. :  39%|█████████████████▍                           | 87/224 [00:42<01:08,  2.00it/s]
Epoch 20 Iter 88: loss 0.18846. :  39%|█████████████████▍                           | 87/224 [00:43<01:08,  2.00it/s]
Epoch 20 Iter 88: loss 0.18846. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.01it/s]
Epoch 20 Iter 89: loss 0.16708. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.01it/s]
Epoch 20 Iter 89: loss 0.16708. :  40%|█████████████████▉                           | 89/224 [00:43<01:07,  2.00it/s]
Epoch 20 Iter 90: loss 0.16010. :  40%|█████████████████▉                           | 89/224 [00:44<01:07,  2.00it/s]
Epoch 20 Iter 90: loss 0.16010. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 20 Iter 91: loss 0.18475. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.01it/s]
Epoch 20 Iter 91: loss 0.18475. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.02it/s]
Epoch 20 Iter 92: loss 0.19491. :  41%|██████████████████▎                          | 91/224 [00:45<01:05,  2.02it/s]
Epoch 20 Iter 92: loss 0.19491. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.02it/s]
Epoch 20 Iter 93: loss 0.20010. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.02it/s]
Epoch 20 Iter 93: loss 0.20010. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.03it/s]
Epoch 20 Iter 94: loss 0.19480. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.03it/s]
Epoch 20 Iter 94: loss 0.19480. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 20 Iter 95: loss 0.16329. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 20 Iter 95: loss 0.16329. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.05it/s]
Epoch 20 Iter 96: loss 0.18189. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.05it/s]
Epoch 20 Iter 96: loss 0.18189. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 20 Iter 97: loss 0.18196. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 20 Iter 97: loss 0.18196. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 20 Iter 98: loss 0.19516. :  43%|███████████████████▍                         | 97/224 [00:48<01:02,  2.04it/s]
Epoch 20 Iter 98: loss 0.19516. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 20 Iter 99: loss 0.17035. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 20 Iter 99: loss 0.17035. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.04it/s]
Epoch 20 Iter 100: loss 0.17893. :  44%|███████████████████▍                        | 99/224 [00:49<01:01,  2.04it/s]
Epoch 20 Iter 100: loss 0.17893. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.04it/s]
Epoch 20 Iter 101: loss 0.16398. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.04it/s]
Epoch 20 Iter 101: loss 0.16398. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.03it/s]
Epoch 20 Iter 102: loss 0.16587. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.03it/s]
Epoch 20 Iter 102: loss 0.16587. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.01it/s]
Epoch 20 Iter 103: loss 0.17794. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.01it/s]
Epoch 20 Iter 103: loss 0.17794. :  46%|███████████████████▊                       | 103/224 [00:50<01:00,  1.99it/s]
Epoch 20 Iter 104: loss 0.20334. :  46%|███████████████████▊                       | 103/224 [00:51<01:00,  1.99it/s]
Epoch 20 Iter 104: loss 0.20334. :  46%|███████████████████▉                       | 104/224 [00:51<01:01,  1.96it/s]
Epoch 20 Iter 105: loss 0.20489. :  46%|███████████████████▉                       | 104/224 [00:51<01:01,  1.96it/s]
Epoch 20 Iter 105: loss 0.20489. :  47%|████████████████████▏                      | 105/224 [00:51<00:59,  1.99it/s]
Epoch 20 Iter 106: loss 0.19326. :  47%|████████████████████▏                      | 105/224 [00:52<00:59,  1.99it/s]
Epoch 20 Iter 106: loss 0.19326. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.01it/s]
Epoch 20 Iter 107: loss 0.17516. :  47%|████████████████████▎                      | 106/224 [00:52<00:58,  2.01it/s]
Epoch 20 Iter 107: loss 0.17516. :  48%|████████████████████▌                      | 107/224 [00:52<00:58,  1.99it/s]
Epoch 20 Iter 108: loss 0.19173. :  48%|████████████████████▌                      | 107/224 [00:53<00:58,  1.99it/s]
Epoch 20 Iter 108: loss 0.19173. :  48%|████████████████████▋                      | 108/224 [00:53<00:58,  1.98it/s]
Epoch 20 Iter 109: loss 0.17423. :  48%|████████████████████▋                      | 108/224 [00:53<00:58,  1.98it/s]
Epoch 20 Iter 109: loss 0.17423. :  49%|████████████████████▉                      | 109/224 [00:53<00:58,  1.97it/s]
Epoch 20 Iter 110: loss 0.17228. :  49%|████████████████████▉                      | 109/224 [00:54<00:58,  1.97it/s]
Epoch 20 Iter 110: loss 0.17228. :  49%|█████████████████████                      | 110/224 [00:54<00:57,  1.97it/s]
Epoch 20 Iter 111: loss 0.16919. :  49%|█████████████████████                      | 110/224 [00:54<00:57,  1.97it/s]
Epoch 20 Iter 111: loss 0.16919. :  50%|█████████████████████▎                     | 111/224 [00:54<00:56,  1.99it/s]
Epoch 20 Iter 112: loss 0.17316. :  50%|█████████████████████▎                     | 111/224 [00:55<00:56,  1.99it/s]
Epoch 20 Iter 112: loss 0.17316. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.00it/s]
Epoch 20 Iter 113: loss 0.17780. :  50%|█████████████████████▌                     | 112/224 [00:55<00:55,  2.00it/s]
Epoch 20 Iter 113: loss 0.17780. :  50%|█████████████████████▋                     | 113/224 [00:55<00:55,  2.02it/s]
Epoch 20 Iter 114: loss 0.19245. :  50%|█████████████████████▋                     | 113/224 [00:56<00:55,  2.02it/s]
Epoch 20 Iter 114: loss 0.19245. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 20 Iter 115: loss 0.17178. :  51%|█████████████████████▉                     | 114/224 [00:56<00:54,  2.03it/s]
Epoch 20 Iter 115: loss 0.17178. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.04it/s]
Epoch 20 Iter 116: loss 0.19160. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.04it/s]
Epoch 20 Iter 116: loss 0.19160. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 20 Iter 117: loss 0.18130. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 20 Iter 117: loss 0.18130. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 20 Iter 118: loss 0.17707. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.05it/s]
Epoch 20 Iter 118: loss 0.17707. :  53%|██████████████████████▋                    | 118/224 [00:58<00:52,  2.04it/s]
Epoch 20 Iter 119: loss 0.17504. :  53%|██████████████████████▋                    | 118/224 [00:58<00:52,  2.04it/s]
Epoch 20 Iter 119: loss 0.17504. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.04it/s]
Epoch 20 Iter 120: loss 0.15654. :  53%|██████████████████████▊                    | 119/224 [00:59<00:51,  2.04it/s]
Epoch 20 Iter 120: loss 0.15654. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.04it/s]
Epoch 20 Iter 121: loss 0.16198. :  54%|███████████████████████                    | 120/224 [00:59<00:51,  2.04it/s]
Epoch 20 Iter 121: loss 0.16198. :  54%|███████████████████████▏                   | 121/224 [00:59<00:51,  2.02it/s]
Epoch 20 Iter 122: loss 0.17528. :  54%|███████████████████████▏                   | 121/224 [01:00<00:51,  2.02it/s]
Epoch 20 Iter 122: loss 0.17528. :  54%|███████████████████████▍                   | 122/224 [01:00<00:51,  1.97it/s]
Epoch 20 Iter 123: loss 0.18023. :  54%|███████████████████████▍                   | 122/224 [01:00<00:51,  1.97it/s]
Epoch 20 Iter 123: loss 0.18023. :  55%|███████████████████████▌                   | 123/224 [01:00<00:50,  1.99it/s]
Epoch 20 Iter 124: loss 0.19782. :  55%|███████████████████████▌                   | 123/224 [01:01<00:50,  1.99it/s]
Epoch 20 Iter 124: loss 0.19782. :  55%|███████████████████████▊                   | 124/224 [01:01<00:50,  2.00it/s]
Epoch 20 Iter 125: loss 0.15892. :  55%|███████████████████████▊                   | 124/224 [01:01<00:50,  2.00it/s]
Epoch 20 Iter 125: loss 0.15892. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.02it/s]
Epoch 20 Iter 126: loss 0.17768. :  56%|███████████████████████▉                   | 125/224 [01:02<00:48,  2.02it/s]
Epoch 20 Iter 126: loss 0.17768. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.03it/s]
Epoch 20 Iter 127: loss 0.17002. :  56%|████████████████████████▏                  | 126/224 [01:02<00:48,  2.03it/s]
Epoch 20 Iter 127: loss 0.17002. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.04it/s]
Epoch 20 Iter 128: loss 0.16921. :  57%|████████████████████████▍                  | 127/224 [01:03<00:47,  2.04it/s]
Epoch 20 Iter 128: loss 0.16921. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.05it/s]
Epoch 20 Iter 129: loss 0.16904. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.05it/s]
Epoch 20 Iter 129: loss 0.16904. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.02it/s]
Epoch 20 Iter 130: loss 0.19075. :  58%|████████████████████████▊                  | 129/224 [01:04<00:46,  2.02it/s]
Epoch 20 Iter 130: loss 0.19075. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.03it/s]
Epoch 20 Iter 131: loss 0.18354. :  58%|████████████████████████▉                  | 130/224 [01:04<00:46,  2.03it/s]
Epoch 20 Iter 131: loss 0.18354. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.04it/s]
Epoch 20 Iter 132: loss 0.16443. :  58%|█████████████████████████▏                 | 131/224 [01:05<00:45,  2.04it/s]
Epoch 20 Iter 132: loss 0.16443. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 20 Iter 133: loss 0.19256. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 20 Iter 133: loss 0.19256. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 20 Iter 134: loss 0.16692. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 20 Iter 134: loss 0.16692. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 20 Iter 135: loss 0.14988. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.06it/s]
Epoch 20 Iter 135: loss 0.14988. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.07it/s]
Epoch 20 Iter 136: loss 0.17463. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.07it/s]
Epoch 20 Iter 136: loss 0.17463. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 20 Iter 137: loss 0.18322. :  61%|██████████████████████████                 | 136/224 [01:07<00:42,  2.06it/s]
Epoch 20 Iter 137: loss 0.18322. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 20 Iter 138: loss 0.17804. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.06it/s]
Epoch 20 Iter 138: loss 0.17804. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 20 Iter 139: loss 0.17477. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.07it/s]
Epoch 20 Iter 139: loss 0.17477. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 20 Iter 140: loss 0.16569. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.06it/s]
Epoch 20 Iter 140: loss 0.16569. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 20 Iter 141: loss 0.15979. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 20 Iter 141: loss 0.15979. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 20 Iter 142: loss 0.18357. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 20 Iter 142: loss 0.18357. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 20 Iter 143: loss 0.17336. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.06it/s]
Epoch 20 Iter 143: loss 0.17336. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 20 Iter 144: loss 0.17267. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.06it/s]
Epoch 20 Iter 144: loss 0.17267. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 20 Iter 145: loss 0.16850. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 20 Iter 145: loss 0.16850. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 20 Iter 146: loss 0.18321. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.05it/s]
Epoch 20 Iter 146: loss 0.18321. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.04it/s]
Epoch 20 Iter 147: loss 0.17282. :  65%|████████████████████████████               | 146/224 [01:12<00:38,  2.04it/s]
Epoch 20 Iter 147: loss 0.17282. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.04it/s]
Epoch 20 Iter 148: loss 0.17897. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.04it/s]
Epoch 20 Iter 148: loss 0.17897. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 20 Iter 149: loss 0.18564. :  66%|████████████████████████████▍              | 148/224 [01:13<00:36,  2.06it/s]
Epoch 20 Iter 149: loss 0.18564. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 20 Iter 150: loss 0.18124. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.05it/s]
Epoch 20 Iter 150: loss 0.18124. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.04it/s]
Epoch 20 Iter 151: loss 0.16611. :  67%|████████████████████████████▊              | 150/224 [01:14<00:36,  2.04it/s]
Epoch 20 Iter 151: loss 0.16611. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.04it/s]
Epoch 20 Iter 152: loss 0.17306. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.04it/s]
Epoch 20 Iter 152: loss 0.17306. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.04it/s]
Epoch 20 Iter 153: loss 0.21160. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:35,  2.04it/s]
Epoch 20 Iter 153: loss 0.21160. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.04it/s]
Epoch 20 Iter 154: loss 0.17552. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.04it/s]
Epoch 20 Iter 154: loss 0.17552. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.03it/s]
Epoch 20 Iter 155: loss 0.17090. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:34,  2.03it/s]
Epoch 20 Iter 155: loss 0.17090. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:34,  2.02it/s]
Epoch 20 Iter 156: loss 0.17358. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:34,  2.02it/s]
Epoch 20 Iter 156: loss 0.17358. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.03it/s]
Epoch 20 Iter 157: loss 0.19121. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:33,  2.03it/s]
Epoch 20 Iter 157: loss 0.19121. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:33,  2.03it/s]
Epoch 20 Iter 158: loss 0.16334. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:33,  2.03it/s]
Epoch 20 Iter 158: loss 0.16334. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.03it/s]
Epoch 20 Iter 159: loss 0.20005. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:32,  2.03it/s]
Epoch 20 Iter 159: loss 0.20005. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.03it/s]
Epoch 20 Iter 160: loss 0.17895. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.03it/s]
Epoch 20 Iter 160: loss 0.17895. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.03it/s]
Epoch 20 Iter 161: loss 0.15710. :  71%|██████████████████████████████▋            | 160/224 [01:19<00:31,  2.03it/s]
Epoch 20 Iter 161: loss 0.15710. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.05it/s]
Epoch 20 Iter 162: loss 0.18835. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.05it/s]
Epoch 20 Iter 162: loss 0.18835. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 20 Iter 163: loss 0.17971. :  72%|███████████████████████████████            | 162/224 [01:20<00:30,  2.06it/s]
Epoch 20 Iter 163: loss 0.17971. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.06it/s]
Epoch 20 Iter 164: loss 0.16663. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.06it/s]
Epoch 20 Iter 164: loss 0.16663. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.06it/s]
Epoch 20 Iter 165: loss 0.17264. :  73%|███████████████████████████████▍           | 164/224 [01:21<00:29,  2.06it/s]
Epoch 20 Iter 165: loss 0.17264. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.07it/s]
Epoch 20 Iter 166: loss 0.15931. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.07it/s]
Epoch 20 Iter 166: loss 0.15931. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.06it/s]
Epoch 20 Iter 167: loss 0.16845. :  74%|███████████████████████████████▊           | 166/224 [01:22<00:28,  2.06it/s]
Epoch 20 Iter 167: loss 0.16845. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.06it/s]
Epoch 20 Iter 168: loss 0.15944. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.06it/s]
Epoch 20 Iter 168: loss 0.15944. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 20 Iter 169: loss 0.18690. :  75%|████████████████████████████████▎          | 168/224 [01:23<00:27,  2.06it/s]
Epoch 20 Iter 169: loss 0.18690. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 20 Iter 170: loss 0.19372. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 20 Iter 170: loss 0.19372. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.08it/s]
Epoch 20 Iter 171: loss 0.18545. :  76%|████████████████████████████████▋          | 170/224 [01:24<00:26,  2.08it/s]
Epoch 20 Iter 171: loss 0.18545. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.08it/s]
Epoch 20 Iter 172: loss 0.16954. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.08it/s]
Epoch 20 Iter 172: loss 0.16954. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 20 Iter 173: loss 0.16990. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 20 Iter 173: loss 0.16990. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.16594. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.06it/s]
Epoch 20 Iter 174: loss 0.16594. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 20 Iter 175: loss 0.16773. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 20 Iter 175: loss 0.16773. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 20 Iter 176: loss 0.19182. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.06it/s]
Epoch 20 Iter 176: loss 0.19182. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 20 Iter 177: loss 0.16666. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.05it/s]
Epoch 20 Iter 177: loss 0.16666. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 20 Iter 178: loss 0.17030. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.05it/s]
Epoch 20 Iter 178: loss 0.17030. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.05it/s]
Epoch 20 Iter 179: loss 0.19427. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.05it/s]
Epoch 20 Iter 179: loss 0.19427. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:22,  2.04it/s]
Epoch 20 Iter 180: loss 0.16790. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:22,  2.04it/s]
Epoch 20 Iter 180: loss 0.16790. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.05it/s]
Epoch 20 Iter 181: loss 0.18029. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.05it/s]
Epoch 20 Iter 181: loss 0.18029. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 20 Iter 182: loss 0.16528. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.06it/s]
Epoch 20 Iter 182: loss 0.16528. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 20 Iter 183: loss 0.19199. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 20 Iter 183: loss 0.19199. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 20 Iter 184: loss 0.18245. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.07it/s]
Epoch 20 Iter 184: loss 0.18245. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.05it/s]
Epoch 20 Iter 185: loss 0.17940. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.05it/s]
Epoch 20 Iter 185: loss 0.17940. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 20 Iter 186: loss 0.17039. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:19,  2.05it/s]
Epoch 20 Iter 186: loss 0.17039. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.05it/s]
Epoch 20 Iter 187: loss 0.18553. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.05it/s]
Epoch 20 Iter 187: loss 0.18553. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 20 Iter 188: loss 0.19333. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.07it/s]
Epoch 20 Iter 188: loss 0.19333. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.07it/s]
Epoch 20 Iter 189: loss 0.18994. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.07it/s]
Epoch 20 Iter 189: loss 0.18994. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 20 Iter 190: loss 0.16657. :  84%|████████████████████████████████████▎      | 189/224 [01:33<00:16,  2.07it/s]
Epoch 20 Iter 190: loss 0.16657. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.07it/s]
Epoch 20 Iter 191: loss 0.17519. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.07it/s]
Epoch 20 Iter 191: loss 0.17519. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 20 Iter 192: loss 0.16384. :  85%|████████████████████████████████████▋      | 191/224 [01:34<00:15,  2.07it/s]
Epoch 20 Iter 192: loss 0.16384. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 20 Iter 193: loss 0.19492. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.07it/s]
Epoch 20 Iter 193: loss 0.19492. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.08it/s]
Epoch 20 Iter 194: loss 0.17529. :  86%|█████████████████████████████████████      | 193/224 [01:35<00:14,  2.08it/s]
Epoch 20 Iter 194: loss 0.17529. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.05it/s]
Epoch 20 Iter 195: loss 0.18947. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.05it/s]
Epoch 20 Iter 195: loss 0.18947. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 20 Iter 196: loss 0.18188. :  87%|█████████████████████████████████████▍     | 195/224 [01:36<00:14,  2.06it/s]
Epoch 20 Iter 196: loss 0.18188. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.06it/s]
Epoch 20 Iter 197: loss 0.18453. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.06it/s]
Epoch 20 Iter 197: loss 0.18453. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 20 Iter 198: loss 0.16837. :  88%|█████████████████████████████████████▊     | 197/224 [01:37<00:13,  2.05it/s]
Epoch 20 Iter 198: loss 0.16837. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.03it/s]
Epoch 20 Iter 199: loss 0.17276. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.03it/s]
Epoch 20 Iter 199: loss 0.17276. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.03it/s]
Epoch 20 Iter 200: loss 0.17598. :  89%|██████████████████████████████████████▏    | 199/224 [01:38<00:12,  2.03it/s]
Epoch 20 Iter 200: loss 0.17598. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.04it/s]
Epoch 20 Iter 201: loss 0.18268. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.04it/s]
Epoch 20 Iter 201: loss 0.18268. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.02it/s]
Epoch 20 Iter 202: loss 0.16384. :  90%|██████████████████████████████████████▌    | 201/224 [01:39<00:11,  2.02it/s]
Epoch 20 Iter 202: loss 0.16384. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.02it/s]
Epoch 20 Iter 203: loss 0.16413. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.02it/s]
Epoch 20 Iter 203: loss 0.16413. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.01it/s]
Epoch 20 Iter 204: loss 0.17401. :  91%|██████████████████████████████████████▉    | 203/224 [01:40<00:10,  2.01it/s]
Epoch 20 Iter 204: loss 0.17401. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.00it/s]
Epoch 20 Iter 205: loss 0.18058. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.00it/s]
Epoch 20 Iter 205: loss 0.18058. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.01it/s]
Epoch 20 Iter 206: loss 0.17751. :  92%|███████████████████████████████████████▎   | 205/224 [01:41<00:09,  2.01it/s]
Epoch 20 Iter 206: loss 0.17751. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.02it/s]
Epoch 20 Iter 207: loss 0.19083. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.02it/s]
Epoch 20 Iter 207: loss 0.19083. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.01it/s]
Epoch 20 Iter 208: loss 0.18000. :  92%|███████████████████████████████████████▋   | 207/224 [01:42<00:08,  2.01it/s]
Epoch 20 Iter 208: loss 0.18000. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.01it/s]
Epoch 20 Iter 209: loss 0.16708. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.01it/s]
Epoch 20 Iter 209: loss 0.16708. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.01it/s]
Epoch 20 Iter 210: loss 0.16661. :  93%|████████████████████████████████████████   | 209/224 [01:43<00:07,  2.01it/s]
Epoch 20 Iter 210: loss 0.16661. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.01it/s]
Epoch 20 Iter 211: loss 0.17213. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.01it/s]
Epoch 20 Iter 211: loss 0.17213. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.01it/s]
Epoch 20 Iter 212: loss 0.17000. :  94%|████████████████████████████████████████▌  | 211/224 [01:44<00:06,  2.01it/s]
Epoch 20 Iter 212: loss 0.17000. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.03it/s]
Epoch 20 Iter 213: loss 0.17863. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.03it/s]
Epoch 20 Iter 213: loss 0.17863. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.02it/s]
Epoch 20 Iter 214: loss 0.17021. :  95%|████████████████████████████████████████▉  | 213/224 [01:45<00:05,  2.02it/s]
Epoch 20 Iter 214: loss 0.17021. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.02it/s]
Epoch 20 Iter 215: loss 0.16260. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.02it/s]
Epoch 20 Iter 215: loss 0.16260. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.03it/s]
Epoch 20 Iter 216: loss 0.19591. :  96%|█████████████████████████████████████████▎ | 215/224 [01:46<00:04,  2.03it/s]
Epoch 20 Iter 216: loss 0.19591. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.02it/s]
Epoch 20 Iter 217: loss 0.17380. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.02it/s]
Epoch 20 Iter 217: loss 0.17380. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.02it/s]
Epoch 20 Iter 218: loss 0.17420. :  97%|█████████████████████████████████████████▋ | 217/224 [01:47<00:03,  2.02it/s]
Epoch 20 Iter 218: loss 0.17420. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.02it/s]
Epoch 20 Iter 219: loss 0.17005. :  97%|█████████████████████████████████████████▊ | 218/224 [01:47<00:02,  2.02it/s]
Epoch 20 Iter 219: loss 0.17005. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  1.98it/s]
Epoch 20 Iter 220: loss 0.17265. :  98%|██████████████████████████████████████████ | 219/224 [01:48<00:02,  1.98it/s]
Epoch 20 Iter 220: loss 0.17265. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:02,  1.98it/s]
Epoch 20 Iter 221: loss 0.18320. :  98%|██████████████████████████████████████████▏| 220/224 [01:48<00:02,  1.98it/s]
Epoch 20 Iter 221: loss 0.18320. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  1.98it/s]
Epoch 20 Iter 222: loss 0.16891. :  99%|██████████████████████████████████████████▍| 221/224 [01:49<00:01,  1.98it/s]
Epoch 20 Iter 222: loss 0.16891. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:01,  1.98it/s]
Epoch 20 Iter 223: loss 0.18701. :  99%|██████████████████████████████████████████▌| 222/224 [01:49<00:01,  1.98it/s]
Epoch 20 Iter 223: loss 0.18701. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  1.99it/s]
Epoch 20 Iter 224: loss 0.18014. : 100%|██████████████████████████████████████████▊| 223/224 [01:50<00:00,  1.99it/s]
Epoch 20 Iter 224: loss 0.18014. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  1.99it/s]
Epoch 20 Iter 224: loss 0.18014. : 100%|███████████████████████████████████████████| 224/224 [01:50<00:00,  2.03it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.15980. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 21 Iter 1: loss 0.15980. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 21 Iter 2: loss 0.17254. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 21 Iter 2: loss 0.17254. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 21 Iter 3: loss 0.18237. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 21 Iter 3: loss 0.18237. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 21 Iter 4: loss 0.17930. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 21 Iter 4: loss 0.17930. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.18436. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 21 Iter 5: loss 0.18436. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 21 Iter 6: loss 0.15676. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 21 Iter 6: loss 0.15676. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 21 Iter 7: loss 0.15912. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 21 Iter 7: loss 0.15912. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 21 Iter 8: loss 0.17067. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.04it/s]
Epoch 21 Iter 8: loss 0.17067. :   4%|█▋                                             | 8/224 [00:03<01:46,  2.03it/s]
Epoch 21 Iter 9: loss 0.19286. :   4%|█▋                                             | 8/224 [00:04<01:46,  2.03it/s]
Epoch 21 Iter 9: loss 0.19286. :   4%|█▉                                             | 9/224 [00:04<01:46,  2.02it/s]
Epoch 21 Iter 10: loss 0.16267. :   4%|█▊                                            | 9/224 [00:04<01:46,  2.02it/s]
Epoch 21 Iter 10: loss 0.16267. :   4%|██                                           | 10/224 [00:04<01:44,  2.04it/s]
Epoch 21 Iter 11: loss 0.19442. :   4%|██                                           | 10/224 [00:05<01:44,  2.04it/s]
Epoch 21 Iter 11: loss 0.19442. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 21 Iter 12: loss 0.20078. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.04it/s]
Epoch 21 Iter 12: loss 0.20078. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.04it/s]
Epoch 21 Iter 13: loss 0.18340. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.04it/s]
Epoch 21 Iter 13: loss 0.18340. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.16877. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 21 Iter 14: loss 0.16877. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 21 Iter 15: loss 0.17290. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 21 Iter 15: loss 0.17290. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 21 Iter 16: loss 0.16824. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 21 Iter 16: loss 0.16824. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 21 Iter 17: loss 0.16956. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 21 Iter 17: loss 0.16956. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 21 Iter 18: loss 0.17378. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 21 Iter 18: loss 0.17378. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 21 Iter 19: loss 0.16501. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 21 Iter 19: loss 0.16501. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 21 Iter 20: loss 0.19623. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 21 Iter 20: loss 0.19623. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 21 Iter 21: loss 0.18224. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 21 Iter 21: loss 0.18224. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 21 Iter 22: loss 0.19247. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 21 Iter 22: loss 0.19247. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 21 Iter 23: loss 0.16966. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 21 Iter 23: loss 0.16966. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 21 Iter 24: loss 0.16922. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 21 Iter 24: loss 0.16922. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 21 Iter 25: loss 0.17424. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 21 Iter 25: loss 0.17424. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 21 Iter 26: loss 0.17978. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 21 Iter 26: loss 0.17978. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 21 Iter 27: loss 0.17597. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 21 Iter 27: loss 0.17597. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 21 Iter 28: loss 0.18305. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 21 Iter 28: loss 0.18305. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 21 Iter 29: loss 0.16640. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 21 Iter 29: loss 0.16640. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 21 Iter 30: loss 0.16838. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 21 Iter 30: loss 0.16838. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 21 Iter 31: loss 0.18606. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 21 Iter 31: loss 0.18606. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 21 Iter 32: loss 0.15565. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 21 Iter 32: loss 0.15565. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 21 Iter 33: loss 0.16780. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 21 Iter 33: loss 0.16780. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 21 Iter 34: loss 0.15794. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 21 Iter 34: loss 0.15794. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 21 Iter 35: loss 0.17927. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 21 Iter 35: loss 0.17927. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 21 Iter 36: loss 0.17166. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 21 Iter 36: loss 0.17166. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 21 Iter 37: loss 0.16544. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 21 Iter 37: loss 0.16544. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 21 Iter 38: loss 0.18308. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 21 Iter 38: loss 0.18308. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 21 Iter 39: loss 0.16111. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 21 Iter 39: loss 0.16111. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 21 Iter 40: loss 0.16461. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 21 Iter 40: loss 0.16461. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 21 Iter 41: loss 0.18012. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 21 Iter 41: loss 0.18012. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 21 Iter 42: loss 0.15976. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 21 Iter 42: loss 0.15976. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 21 Iter 43: loss 0.19328. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 21 Iter 43: loss 0.19328. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 21 Iter 44: loss 0.16942. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 21 Iter 44: loss 0.16942. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 21 Iter 45: loss 0.17179. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 21 Iter 45: loss 0.17179. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 21 Iter 46: loss 0.18006. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 21 Iter 46: loss 0.18006. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 21 Iter 47: loss 0.15734. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 21 Iter 47: loss 0.15734. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 21 Iter 48: loss 0.18349. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 21 Iter 48: loss 0.18349. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 21 Iter 49: loss 0.18598. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 21 Iter 49: loss 0.18598. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.08it/s]
Epoch 21 Iter 50: loss 0.19550. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.08it/s]
Epoch 21 Iter 50: loss 0.19550. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 21 Iter 51: loss 0.17633. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 21 Iter 51: loss 0.17633. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 21 Iter 52: loss 0.17174. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 21 Iter 52: loss 0.17174. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 21 Iter 53: loss 0.18722. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 21 Iter 53: loss 0.18722. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 21 Iter 54: loss 0.17348. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 21 Iter 54: loss 0.17348. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 21 Iter 55: loss 0.19801. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 21 Iter 55: loss 0.19801. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 21 Iter 56: loss 0.15092. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 21 Iter 56: loss 0.15092. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.09it/s]
Epoch 21 Iter 57: loss 0.19590. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.09it/s]
Epoch 21 Iter 57: loss 0.19590. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 21 Iter 58: loss 0.16485. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 21 Iter 58: loss 0.16485. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 21 Iter 59: loss 0.18024. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 21 Iter 59: loss 0.18024. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 21 Iter 60: loss 0.20211. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 21 Iter 60: loss 0.20211. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 21 Iter 61: loss 0.19624. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 21 Iter 61: loss 0.19624. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 21 Iter 62: loss 0.18709. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 21 Iter 62: loss 0.18709. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 21 Iter 63: loss 0.17597. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 21 Iter 63: loss 0.17597. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 21 Iter 64: loss 0.17350. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 21 Iter 64: loss 0.17350. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.06it/s]
Epoch 21 Iter 65: loss 0.18016. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 21 Iter 65: loss 0.18016. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.04it/s]
Epoch 21 Iter 66: loss 0.17668. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.04it/s]
Epoch 21 Iter 66: loss 0.17668. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.01it/s]
Epoch 21 Iter 67: loss 0.20208. :  29%|█████████████▎                               | 66/224 [00:32<01:18,  2.01it/s]
Epoch 21 Iter 67: loss 0.20208. :  30%|█████████████▍                               | 67/224 [00:32<01:19,  1.97it/s]
Epoch 21 Iter 68: loss 0.19567. :  30%|█████████████▍                               | 67/224 [00:33<01:19,  1.97it/s]
Epoch 21 Iter 68: loss 0.19567. :  30%|█████████████▋                               | 68/224 [00:33<01:20,  1.93it/s]
Epoch 21 Iter 69: loss 0.17439. :  30%|█████████████▋                               | 68/224 [00:33<01:20,  1.93it/s]
Epoch 21 Iter 69: loss 0.17439. :  31%|█████████████▊                               | 69/224 [00:33<01:24,  1.82it/s]
Epoch 21 Iter 70: loss 0.19996. :  31%|█████████████▊                               | 69/224 [00:34<01:24,  1.82it/s]
Epoch 21 Iter 70: loss 0.19996. :  31%|██████████████                               | 70/224 [00:34<01:22,  1.86it/s]
Epoch 21 Iter 71: loss 0.16451. :  31%|██████████████                               | 70/224 [00:34<01:22,  1.86it/s]
Epoch 21 Iter 71: loss 0.16451. :  32%|██████████████▎                              | 71/224 [00:34<01:21,  1.88it/s]
Epoch 21 Iter 72: loss 0.18044. :  32%|██████████████▎                              | 71/224 [00:35<01:21,  1.88it/s]
Epoch 21 Iter 72: loss 0.18044. :  32%|██████████████▍                              | 72/224 [00:35<01:19,  1.90it/s]
Epoch 21 Iter 73: loss 0.15501. :  32%|██████████████▍                              | 72/224 [00:35<01:19,  1.90it/s]
Epoch 21 Iter 73: loss 0.15501. :  33%|██████████████▋                              | 73/224 [00:35<01:17,  1.95it/s]
Epoch 21 Iter 74: loss 0.18394. :  33%|██████████████▋                              | 73/224 [00:36<01:17,  1.95it/s]
Epoch 21 Iter 74: loss 0.18394. :  33%|██████████████▊                              | 74/224 [00:36<01:16,  1.96it/s]
Epoch 21 Iter 75: loss 0.16820. :  33%|██████████████▊                              | 74/224 [00:36<01:16,  1.96it/s]
Epoch 21 Iter 75: loss 0.16820. :  33%|███████████████                              | 75/224 [00:36<01:16,  1.95it/s]
Epoch 21 Iter 76: loss 0.20086. :  33%|███████████████                              | 75/224 [00:37<01:16,  1.95it/s]
Epoch 21 Iter 76: loss 0.20086. :  34%|███████████████▎                             | 76/224 [00:37<01:15,  1.96it/s]
Epoch 21 Iter 77: loss 0.16916. :  34%|███████████████▎                             | 76/224 [00:37<01:15,  1.96it/s]
Epoch 21 Iter 77: loss 0.16916. :  34%|███████████████▍                             | 77/224 [00:37<01:14,  1.96it/s]
Epoch 21 Iter 78: loss 0.17633. :  34%|███████████████▍                             | 77/224 [00:38<01:14,  1.96it/s]
Epoch 21 Iter 78: loss 0.17633. :  35%|███████████████▋                             | 78/224 [00:38<01:14,  1.96it/s]
Epoch 21 Iter 79: loss 0.15778. :  35%|███████████████▋                             | 78/224 [00:38<01:14,  1.96it/s]
Epoch 21 Iter 79: loss 0.15778. :  35%|███████████████▊                             | 79/224 [00:38<01:13,  1.97it/s]
Epoch 21 Iter 80: loss 0.17478. :  35%|███████████████▊                             | 79/224 [00:39<01:13,  1.97it/s]
Epoch 21 Iter 80: loss 0.17478. :  36%|████████████████                             | 80/224 [00:39<01:13,  1.97it/s]
Epoch 21 Iter 81: loss 0.19670. :  36%|████████████████                             | 80/224 [00:39<01:13,  1.97it/s]
Epoch 21 Iter 81: loss 0.19670. :  36%|████████████████▎                            | 81/224 [00:39<01:12,  1.97it/s]
Epoch 21 Iter 82: loss 0.17546. :  36%|████████████████▎                            | 81/224 [00:40<01:12,  1.97it/s]
Epoch 21 Iter 82: loss 0.17546. :  37%|████████████████▍                            | 82/224 [00:40<01:11,  1.97it/s]
Epoch 21 Iter 83: loss 0.18478. :  37%|████████████████▍                            | 82/224 [00:40<01:11,  1.97it/s]
Epoch 21 Iter 83: loss 0.18478. :  37%|████████████████▋                            | 83/224 [00:40<01:11,  1.97it/s]
Epoch 21 Iter 84: loss 0.16308. :  37%|████████████████▋                            | 83/224 [00:41<01:11,  1.97it/s]
Epoch 21 Iter 84: loss 0.16308. :  38%|████████████████▉                            | 84/224 [00:41<01:11,  1.96it/s]
Epoch 21 Iter 85: loss 0.16295. :  38%|████████████████▉                            | 84/224 [00:41<01:11,  1.96it/s]
Epoch 21 Iter 85: loss 0.16295. :  38%|█████████████████                            | 85/224 [00:41<01:10,  1.96it/s]
Epoch 21 Iter 86: loss 0.16216. :  38%|█████████████████                            | 85/224 [00:42<01:10,  1.96it/s]
Epoch 21 Iter 86: loss 0.16216. :  38%|█████████████████▎                           | 86/224 [00:42<01:10,  1.96it/s]
Epoch 21 Iter 87: loss 0.20117. :  38%|█████████████████▎                           | 86/224 [00:42<01:10,  1.96it/s]
Epoch 21 Iter 87: loss 0.20117. :  39%|█████████████████▍                           | 87/224 [00:42<01:09,  1.98it/s]
Epoch 21 Iter 88: loss 0.16972. :  39%|█████████████████▍                           | 87/224 [00:43<01:09,  1.98it/s]
Epoch 21 Iter 88: loss 0.16972. :  39%|█████████████████▋                           | 88/224 [00:43<01:08,  2.00it/s]
Epoch 21 Iter 89: loss 0.18509. :  39%|█████████████████▋                           | 88/224 [00:43<01:08,  2.00it/s]
Epoch 21 Iter 89: loss 0.18509. :  40%|█████████████████▉                           | 89/224 [00:43<01:07,  2.01it/s]
Epoch 21 Iter 90: loss 0.17762. :  40%|█████████████████▉                           | 89/224 [00:44<01:07,  2.01it/s]
Epoch 21 Iter 90: loss 0.17762. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 21 Iter 91: loss 0.17373. :  40%|██████████████████                           | 90/224 [00:44<01:06,  2.02it/s]
Epoch 21 Iter 91: loss 0.17373. :  41%|██████████████████▎                          | 91/224 [00:44<01:06,  2.01it/s]
Epoch 21 Iter 92: loss 0.18818. :  41%|██████████████████▎                          | 91/224 [00:45<01:06,  2.01it/s]
Epoch 21 Iter 92: loss 0.18818. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.01it/s]
Epoch 21 Iter 93: loss 0.18983. :  41%|██████████████████▍                          | 92/224 [00:45<01:05,  2.01it/s]
Epoch 21 Iter 93: loss 0.18983. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.02it/s]
Epoch 21 Iter 94: loss 0.16721. :  42%|██████████████████▋                          | 93/224 [00:46<01:04,  2.02it/s]
Epoch 21 Iter 94: loss 0.16721. :  42%|██████████████████▉                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 21 Iter 95: loss 0.17035. :  42%|██████████████████▉                          | 94/224 [00:46<01:04,  2.02it/s]
Epoch 21 Iter 95: loss 0.17035. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.02it/s]
Epoch 21 Iter 96: loss 0.17919. :  42%|███████████████████                          | 95/224 [00:47<01:03,  2.02it/s]
Epoch 21 Iter 96: loss 0.17919. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.02it/s]
Epoch 21 Iter 97: loss 0.17974. :  43%|███████████████████▎                         | 96/224 [00:47<01:03,  2.02it/s]
Epoch 21 Iter 97: loss 0.17974. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.02it/s]
Epoch 21 Iter 98: loss 0.19296. :  43%|███████████████████▍                         | 97/224 [00:48<01:02,  2.02it/s]
Epoch 21 Iter 98: loss 0.19296. :  44%|███████████████████▋                         | 98/224 [00:48<01:02,  2.03it/s]
Epoch 21 Iter 99: loss 0.17866. :  44%|███████████████████▋                         | 98/224 [00:48<01:02,  2.03it/s]
Epoch 21 Iter 99: loss 0.17866. :  44%|███████████████████▉                         | 99/224 [00:48<01:01,  2.03it/s]
Epoch 21 Iter 100: loss 0.18547. :  44%|███████████████████▍                        | 99/224 [00:49<01:01,  2.03it/s]
Epoch 21 Iter 100: loss 0.18547. :  45%|███████████████████▏                       | 100/224 [00:49<01:01,  2.02it/s]
Epoch 21 Iter 101: loss 0.17835. :  45%|███████████████████▏                       | 100/224 [00:49<01:01,  2.02it/s]
Epoch 21 Iter 101: loss 0.17835. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.03it/s]
Epoch 21 Iter 102: loss 0.18506. :  45%|███████████████████▍                       | 101/224 [00:50<01:00,  2.03it/s]
Epoch 21 Iter 102: loss 0.18506. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.03it/s]
Epoch 21 Iter 103: loss 0.17648. :  46%|███████████████████▌                       | 102/224 [00:50<01:00,  2.03it/s]
Epoch 21 Iter 103: loss 0.17648. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.04it/s]
Epoch 21 Iter 104: loss 0.15720. :  46%|███████████████████▊                       | 103/224 [00:51<00:59,  2.04it/s]
Epoch 21 Iter 104: loss 0.15720. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.04it/s]
Epoch 21 Iter 105: loss 0.19673. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.04it/s]
Epoch 21 Iter 105: loss 0.19673. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 21 Iter 106: loss 0.16606. :  47%|████████████████████▏                      | 105/224 [00:52<00:58,  2.05it/s]
Epoch 21 Iter 106: loss 0.16606. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.03it/s]
Epoch 21 Iter 107: loss 0.17798. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.03it/s]
Epoch 21 Iter 107: loss 0.17798. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.04it/s]
Epoch 21 Iter 108: loss 0.16272. :  48%|████████████████████▌                      | 107/224 [00:53<00:57,  2.04it/s]
Epoch 21 Iter 108: loss 0.16272. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.04it/s]
Epoch 21 Iter 109: loss 0.16419. :  48%|████████████████████▋                      | 108/224 [00:53<00:56,  2.04it/s]
Epoch 21 Iter 109: loss 0.16419. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.04it/s]
Epoch 21 Iter 110: loss 0.17609. :  49%|████████████████████▉                      | 109/224 [00:54<00:56,  2.04it/s]
Epoch 21 Iter 110: loss 0.17609. :  49%|█████████████████████                      | 110/224 [00:54<00:57,  2.00it/s]
Epoch 21 Iter 111: loss 0.17623. :  49%|█████████████████████                      | 110/224 [00:54<00:57,  2.00it/s]
Epoch 21 Iter 111: loss 0.17623. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.03it/s]
Epoch 21 Iter 112: loss 0.18188. :  50%|█████████████████████▎                     | 111/224 [00:55<00:55,  2.03it/s]
Epoch 21 Iter 112: loss 0.18188. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.04it/s]
Epoch 21 Iter 113: loss 0.18782. :  50%|█████████████████████▌                     | 112/224 [00:55<00:54,  2.04it/s]
Epoch 21 Iter 113: loss 0.18782. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 21 Iter 114: loss 0.16670. :  50%|█████████████████████▋                     | 113/224 [00:56<00:54,  2.05it/s]
Epoch 21 Iter 114: loss 0.16670. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.05it/s]
Epoch 21 Iter 115: loss 0.16894. :  51%|█████████████████████▉                     | 114/224 [00:56<00:53,  2.05it/s]
Epoch 21 Iter 115: loss 0.16894. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.04it/s]
Epoch 21 Iter 116: loss 0.15551. :  51%|██████████████████████                     | 115/224 [00:57<00:53,  2.04it/s]
Epoch 21 Iter 116: loss 0.15551. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 21 Iter 117: loss 0.19686. :  52%|██████████████████████▎                    | 116/224 [00:57<00:52,  2.04it/s]
Epoch 21 Iter 117: loss 0.19686. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 21 Iter 118: loss 0.15947. :  52%|██████████████████████▍                    | 117/224 [00:58<00:52,  2.05it/s]
Epoch 21 Iter 118: loss 0.15947. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.05it/s]
Epoch 21 Iter 119: loss 0.18210. :  53%|██████████████████████▋                    | 118/224 [00:58<00:51,  2.05it/s]
Epoch 21 Iter 119: loss 0.18210. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.04it/s]
Epoch 21 Iter 120: loss 0.19334. :  53%|██████████████████████▊                    | 119/224 [00:59<00:51,  2.04it/s]
Epoch 21 Iter 120: loss 0.19334. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 121: loss 0.18375. :  54%|███████████████████████                    | 120/224 [00:59<00:50,  2.05it/s]
Epoch 21 Iter 121: loss 0.18375. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.04it/s]
Epoch 21 Iter 122: loss 0.18725. :  54%|███████████████████████▏                   | 121/224 [01:00<00:50,  2.04it/s]
Epoch 21 Iter 122: loss 0.18725. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 123: loss 0.15920. :  54%|███████████████████████▍                   | 122/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 123: loss 0.15920. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.17498. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 21 Iter 124: loss 0.17498. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 21 Iter 125: loss 0.15302. :  55%|███████████████████████▊                   | 124/224 [01:01<00:48,  2.07it/s]
Epoch 21 Iter 125: loss 0.15302. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.19165. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 21 Iter 126: loss 0.19165. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 21 Iter 127: loss 0.18307. :  56%|████████████████████████▏                  | 126/224 [01:02<00:47,  2.05it/s]
Epoch 21 Iter 127: loss 0.18307. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 21 Iter 128: loss 0.17208. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 21 Iter 128: loss 0.17208. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.04it/s]
Epoch 21 Iter 129: loss 0.16306. :  57%|████████████████████████▌                  | 128/224 [01:03<00:46,  2.04it/s]
Epoch 21 Iter 129: loss 0.16306. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 21 Iter 130: loss 0.19256. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 21 Iter 130: loss 0.19256. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 21 Iter 131: loss 0.16673. :  58%|████████████████████████▉                  | 130/224 [01:04<00:45,  2.05it/s]
Epoch 21 Iter 131: loss 0.16673. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 21 Iter 132: loss 0.18197. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 21 Iter 132: loss 0.18197. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 21 Iter 133: loss 0.17622. :  59%|█████████████████████████▎                 | 132/224 [01:05<00:44,  2.06it/s]
Epoch 21 Iter 133: loss 0.17622. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 21 Iter 134: loss 0.16380. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.06it/s]
Epoch 21 Iter 134: loss 0.16380. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 21 Iter 135: loss 0.17534. :  60%|█████████████████████████▋                 | 134/224 [01:06<00:43,  2.06it/s]
Epoch 21 Iter 135: loss 0.17534. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 21 Iter 136: loss 0.18297. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 21 Iter 136: loss 0.18297. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 21 Iter 137: loss 0.16232. :  61%|██████████████████████████                 | 136/224 [01:07<00:43,  2.04it/s]
Epoch 21 Iter 137: loss 0.16232. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 21 Iter 138: loss 0.15624. :  61%|██████████████████████████▎                | 137/224 [01:07<00:42,  2.05it/s]
Epoch 21 Iter 138: loss 0.15624. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 21 Iter 139: loss 0.17253. :  62%|██████████████████████████▍                | 138/224 [01:08<00:41,  2.05it/s]
Epoch 21 Iter 139: loss 0.17253. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 21 Iter 140: loss 0.19819. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.05it/s]
Epoch 21 Iter 140: loss 0.19819. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 21 Iter 141: loss 0.16771. :  62%|██████████████████████████▉                | 140/224 [01:09<00:40,  2.06it/s]
Epoch 21 Iter 141: loss 0.16771. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 21 Iter 142: loss 0.17418. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.06it/s]
Epoch 21 Iter 142: loss 0.17418. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 21 Iter 143: loss 0.15834. :  63%|███████████████████████████▎               | 142/224 [01:10<00:39,  2.06it/s]
Epoch 21 Iter 143: loss 0.15834. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 21 Iter 144: loss 0.19459. :  64%|███████████████████████████▍               | 143/224 [01:10<00:39,  2.07it/s]
Epoch 21 Iter 144: loss 0.19459. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 21 Iter 145: loss 0.16557. :  64%|███████████████████████████▋               | 144/224 [01:11<00:38,  2.06it/s]
Epoch 21 Iter 145: loss 0.16557. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 21 Iter 146: loss 0.16987. :  65%|███████████████████████████▊               | 145/224 [01:11<00:38,  2.06it/s]
Epoch 21 Iter 146: loss 0.16987. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 21 Iter 147: loss 0.17287. :  65%|████████████████████████████               | 146/224 [01:12<00:37,  2.06it/s]
Epoch 21 Iter 147: loss 0.17287. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.06it/s]
Epoch 21 Iter 148: loss 0.16566. :  66%|████████████████████████████▏              | 147/224 [01:12<00:37,  2.06it/s]
Epoch 21 Iter 148: loss 0.16566. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 21 Iter 149: loss 0.16689. :  66%|████████████████████████████▍              | 148/224 [01:13<00:36,  2.06it/s]
Epoch 21 Iter 149: loss 0.16689. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.06it/s]
Epoch 21 Iter 150: loss 0.17366. :  67%|████████████████████████████▌              | 149/224 [01:13<00:36,  2.06it/s]
Epoch 21 Iter 150: loss 0.17366. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 21 Iter 151: loss 0.18181. :  67%|████████████████████████████▊              | 150/224 [01:14<00:35,  2.06it/s]
Epoch 21 Iter 151: loss 0.18181. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 21 Iter 152: loss 0.17279. :  67%|████████████████████████████▉              | 151/224 [01:14<00:35,  2.06it/s]
Epoch 21 Iter 152: loss 0.17279. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.06it/s]
Epoch 21 Iter 153: loss 0.17642. :  68%|█████████████████████████████▏             | 152/224 [01:15<00:35,  2.06it/s]
Epoch 21 Iter 153: loss 0.17642. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 21 Iter 154: loss 0.17102. :  68%|█████████████████████████████▎             | 153/224 [01:15<00:34,  2.06it/s]
Epoch 21 Iter 154: loss 0.17102. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 21 Iter 155: loss 0.15788. :  69%|█████████████████████████████▌             | 154/224 [01:16<00:34,  2.06it/s]
Epoch 21 Iter 155: loss 0.15788. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.06it/s]
Epoch 21 Iter 156: loss 0.15051. :  69%|█████████████████████████████▊             | 155/224 [01:16<00:33,  2.06it/s]
Epoch 21 Iter 156: loss 0.15051. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 21 Iter 157: loss 0.17124. :  70%|█████████████████████████████▉             | 156/224 [01:17<00:32,  2.06it/s]
Epoch 21 Iter 157: loss 0.17124. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.06it/s]
Epoch 21 Iter 158: loss 0.18810. :  70%|██████████████████████████████▏            | 157/224 [01:17<00:32,  2.06it/s]
Epoch 21 Iter 158: loss 0.18810. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.06it/s]
Epoch 21 Iter 159: loss 0.17256. :  71%|██████████████████████████████▎            | 158/224 [01:18<00:32,  2.06it/s]
Epoch 21 Iter 159: loss 0.17256. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 21 Iter 160: loss 0.19092. :  71%|██████████████████████████████▌            | 159/224 [01:18<00:31,  2.07it/s]
Epoch 21 Iter 160: loss 0.19092. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 21 Iter 161: loss 0.18461. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.06it/s]
Epoch 21 Iter 161: loss 0.18461. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 21 Iter 162: loss 0.16791. :  72%|██████████████████████████████▉            | 161/224 [01:19<00:30,  2.07it/s]
Epoch 21 Iter 162: loss 0.16791. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 21 Iter 163: loss 0.17831. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 21 Iter 163: loss 0.17831. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 21 Iter 164: loss 0.18287. :  73%|███████████████████████████████▎           | 163/224 [01:20<00:29,  2.06it/s]
Epoch 21 Iter 164: loss 0.18287. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.07it/s]
Epoch 21 Iter 165: loss 0.17823. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.07it/s]
Epoch 21 Iter 165: loss 0.17823. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 21 Iter 166: loss 0.18299. :  74%|███████████████████████████████▋           | 165/224 [01:21<00:28,  2.06it/s]
Epoch 21 Iter 166: loss 0.18299. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 21 Iter 167: loss 0.17016. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.05it/s]
Epoch 21 Iter 167: loss 0.17016. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 21 Iter 168: loss 0.17575. :  75%|████████████████████████████████           | 167/224 [01:22<00:27,  2.05it/s]
Epoch 21 Iter 168: loss 0.17575. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 21 Iter 169: loss 0.18691. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.05it/s]
Epoch 21 Iter 169: loss 0.18691. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 21 Iter 170: loss 0.19986. :  75%|████████████████████████████████▍          | 169/224 [01:23<00:26,  2.06it/s]
Epoch 21 Iter 170: loss 0.19986. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 21 Iter 171: loss 0.17442. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.06it/s]
Epoch 21 Iter 171: loss 0.17442. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 21 Iter 172: loss 0.16910. :  76%|████████████████████████████████▊          | 171/224 [01:24<00:25,  2.06it/s]
Epoch 21 Iter 172: loss 0.16910. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 21 Iter 173: loss 0.20552. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.06it/s]
Epoch 21 Iter 173: loss 0.20552. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 21 Iter 174: loss 0.17507. :  77%|█████████████████████████████████▏         | 173/224 [01:25<00:24,  2.09it/s]
Epoch 21 Iter 174: loss 0.17507. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 21 Iter 175: loss 0.16132. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.08it/s]
Epoch 21 Iter 175: loss 0.16132. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 21 Iter 176: loss 0.18135. :  78%|█████████████████████████████████▌         | 175/224 [01:26<00:23,  2.07it/s]
Epoch 21 Iter 176: loss 0.18135. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 21 Iter 177: loss 0.16848. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 21 Iter 177: loss 0.16848. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 21 Iter 178: loss 0.18334. :  79%|█████████████████████████████████▉         | 177/224 [01:27<00:22,  2.07it/s]
Epoch 21 Iter 178: loss 0.18334. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.08it/s]
Epoch 21 Iter 179: loss 0.17728. :  79%|██████████████████████████████████▏        | 178/224 [01:27<00:22,  2.08it/s]
Epoch 21 Iter 179: loss 0.17728. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 21 Iter 180: loss 0.17416. :  80%|██████████████████████████████████▎        | 179/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 180: loss 0.17416. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.17807. :  80%|██████████████████████████████████▌        | 180/224 [01:28<00:21,  2.07it/s]
Epoch 21 Iter 181: loss 0.17807. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 21 Iter 182: loss 0.19390. :  81%|██████████████████████████████████▋        | 181/224 [01:29<00:20,  2.07it/s]
Epoch 21 Iter 182: loss 0.19390. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 21 Iter 183: loss 0.17831. :  81%|██████████████████████████████████▉        | 182/224 [01:29<00:20,  2.06it/s]
Epoch 21 Iter 183: loss 0.17831. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 21 Iter 184: loss 0.15637. :  82%|███████████████████████████████████▏       | 183/224 [01:30<00:19,  2.06it/s]
Epoch 21 Iter 184: loss 0.15637. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 21 Iter 185: loss 0.18559. :  82%|███████████████████████████████████▎       | 184/224 [01:30<00:19,  2.06it/s]
Epoch 21 Iter 185: loss 0.18559. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.18153. :  83%|███████████████████████████████████▌       | 185/224 [01:31<00:18,  2.06it/s]
Epoch 21 Iter 186: loss 0.18153. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.09it/s]
Epoch 21 Iter 187: loss 0.18418. :  83%|███████████████████████████████████▋       | 186/224 [01:31<00:18,  2.09it/s]
Epoch 21 Iter 187: loss 0.18418. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.10it/s]
Epoch 21 Iter 188: loss 0.16094. :  83%|███████████████████████████████████▉       | 187/224 [01:32<00:17,  2.10it/s]
Epoch 21 Iter 188: loss 0.16094. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.10it/s]
Epoch 21 Iter 189: loss 0.18567. :  84%|████████████████████████████████████       | 188/224 [01:32<00:17,  2.10it/s]
Epoch 21 Iter 189: loss 0.18567. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 21 Iter 190: loss 0.18584. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 21 Iter 190: loss 0.18584. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 21 Iter 191: loss 0.18807. :  85%|████████████████████████████████████▍      | 190/224 [01:33<00:16,  2.08it/s]
Epoch 21 Iter 191: loss 0.18807. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.09it/s]
Epoch 21 Iter 192: loss 0.19644. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.09it/s]
Epoch 21 Iter 192: loss 0.19644. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 21 Iter 193: loss 0.19005. :  86%|████████████████████████████████████▊      | 192/224 [01:34<00:15,  2.08it/s]
Epoch 21 Iter 193: loss 0.19005. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.08it/s]
Epoch 21 Iter 194: loss 0.18003. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.08it/s]
Epoch 21 Iter 194: loss 0.18003. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 21 Iter 195: loss 0.19621. :  87%|█████████████████████████████████████▏     | 194/224 [01:35<00:14,  2.08it/s]
Epoch 21 Iter 195: loss 0.19621. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.08it/s]
Epoch 21 Iter 196: loss 0.16870. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:13,  2.08it/s]
Epoch 21 Iter 196: loss 0.16870. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 21 Iter 197: loss 0.18965. :  88%|█████████████████████████████████████▋     | 196/224 [01:36<00:13,  2.08it/s]
Epoch 21 Iter 197: loss 0.18965. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 21 Iter 198: loss 0.17991. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.07it/s]
Epoch 21 Iter 198: loss 0.17991. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 21 Iter 199: loss 0.18257. :  88%|██████████████████████████████████████     | 198/224 [01:37<00:12,  2.06it/s]
Epoch 21 Iter 199: loss 0.18257. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 21 Iter 200: loss 0.18729. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 21 Iter 200: loss 0.18729. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 21 Iter 201: loss 0.19277. :  89%|██████████████████████████████████████▍    | 200/224 [01:38<00:11,  2.08it/s]
Epoch 21 Iter 201: loss 0.19277. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.08it/s]
Epoch 21 Iter 202: loss 0.16055. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.08it/s]
Epoch 21 Iter 202: loss 0.16055. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 21 Iter 203: loss 0.18862. :  90%|██████████████████████████████████████▊    | 202/224 [01:39<00:10,  2.07it/s]
Epoch 21 Iter 203: loss 0.18862. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 21 Iter 204: loss 0.17964. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.07it/s]
Epoch 21 Iter 204: loss 0.17964. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 21 Iter 205: loss 0.17599. :  91%|███████████████████████████████████████▏   | 204/224 [01:40<00:09,  2.07it/s]
Epoch 21 Iter 205: loss 0.17599. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 21 Iter 206: loss 0.17861. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.07it/s]
Epoch 21 Iter 206: loss 0.17861. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 21 Iter 207: loss 0.18780. :  92%|███████████████████████████████████████▌   | 206/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 207: loss 0.18780. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 208: loss 0.18454. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 21 Iter 208: loss 0.18454. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 21 Iter 209: loss 0.15863. :  93%|███████████████████████████████████████▉   | 208/224 [01:42<00:07,  2.06it/s]
Epoch 21 Iter 209: loss 0.15863. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 21 Iter 210: loss 0.18158. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.07it/s]
Epoch 21 Iter 210: loss 0.18158. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 21 Iter 211: loss 0.16690. :  94%|████████████████████████████████████████▎  | 210/224 [01:43<00:06,  2.07it/s]
Epoch 21 Iter 211: loss 0.16690. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.08it/s]
Epoch 21 Iter 212: loss 0.17537. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.08it/s]
Epoch 21 Iter 212: loss 0.17537. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 21 Iter 213: loss 0.17796. :  95%|████████████████████████████████████████▋  | 212/224 [01:44<00:05,  2.08it/s]
Epoch 21 Iter 213: loss 0.17796. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.08it/s]
Epoch 21 Iter 214: loss 0.17622. :  95%|████████████████████████████████████████▉  | 213/224 [01:44<00:05,  2.08it/s]
Epoch 21 Iter 214: loss 0.17622. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.09it/s]
Epoch 21 Iter 215: loss 0.18401. :  96%|█████████████████████████████████████████  | 214/224 [01:45<00:04,  2.09it/s]
Epoch 21 Iter 215: loss 0.18401. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 21 Iter 216: loss 0.18560. :  96%|█████████████████████████████████████████▎ | 215/224 [01:45<00:04,  2.07it/s]
Epoch 21 Iter 216: loss 0.18560. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 21 Iter 217: loss 0.17632. :  96%|█████████████████████████████████████████▍ | 216/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 217: loss 0.17632. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 218: loss 0.17841. :  97%|█████████████████████████████████████████▋ | 217/224 [01:46<00:03,  2.07it/s]
Epoch 21 Iter 218: loss 0.17841. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 21 Iter 219: loss 0.17937. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 21 Iter 219: loss 0.17937. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 21 Iter 220: loss 0.17847. :  98%|██████████████████████████████████████████ | 219/224 [01:47<00:02,  2.06it/s]
Epoch 21 Iter 220: loss 0.17847. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 21 Iter 221: loss 0.18931. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 21 Iter 221: loss 0.18931. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 21 Iter 222: loss 0.16578. :  99%|██████████████████████████████████████████▍| 221/224 [01:48<00:01,  2.06it/s]
Epoch 21 Iter 222: loss 0.16578. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 21 Iter 223: loss 0.16043. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 21 Iter 223: loss 0.16043. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.17011. : 100%|██████████████████████████████████████████▊| 223/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.17011. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]
Epoch 21 Iter 224: loss 0.17011. : 100%|███████████████████████████████████████████| 224/224 [01:49<00:00,  2.05it/s]

    Train loss: 0.17701
    Valid loss: 0.18002
       Valid loss recons: 0.17378
       Valid loss KL-D:   62.41873
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.17952. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 22 Iter 1: loss 0.17952. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 22 Iter 2: loss 0.17472. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 22 Iter 2: loss 0.17472. :   1%|▍                                              | 2/224 [00:00<01:46,  2.07it/s]
Epoch 22 Iter 3: loss 0.16873. :   1%|▍                                              | 2/224 [00:01<01:46,  2.07it/s]
Epoch 22 Iter 3: loss 0.16873. :   1%|▋                                              | 3/224 [00:01<01:45,  2.09it/s]
Epoch 22 Iter 4: loss 0.18844. :   1%|▋                                              | 3/224 [00:01<01:45,  2.09it/s]
Epoch 22 Iter 4: loss 0.18844. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 22 Iter 5: loss 0.19165. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 22 Iter 5: loss 0.19165. :   2%|█                                              | 5/224 [00:02<01:44,  2.09it/s]
Epoch 22 Iter 6: loss 0.16930. :   2%|█                                              | 5/224 [00:02<01:44,  2.09it/s]
Epoch 22 Iter 6: loss 0.16930. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 22 Iter 7: loss 0.16661. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 22 Iter 7: loss 0.16661. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 22 Iter 8: loss 0.17262. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 22 Iter 8: loss 0.17262. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 22 Iter 9: loss 0.17444. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 22 Iter 9: loss 0.17444. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.08it/s]
Epoch 22 Iter 10: loss 0.19622. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 22 Iter 10: loss 0.19622. :   4%|██                                           | 10/224 [00:04<01:42,  2.09it/s]
Epoch 22 Iter 11: loss 0.17675. :   4%|██                                           | 10/224 [00:05<01:42,  2.09it/s]
Epoch 22 Iter 11: loss 0.17675. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 22 Iter 12: loss 0.17948. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 22 Iter 12: loss 0.17948. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 22 Iter 13: loss 0.18140. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 22 Iter 13: loss 0.18140. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 22 Iter 14: loss 0.17403. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 22 Iter 14: loss 0.17403. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 22 Iter 15: loss 0.17283. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 22 Iter 15: loss 0.17283. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 22 Iter 16: loss 0.18257. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 22 Iter 16: loss 0.18257. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 22 Iter 17: loss 0.19466. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 22 Iter 17: loss 0.19466. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 22 Iter 18: loss 0.17167. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 22 Iter 18: loss 0.17167. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.04it/s]
Epoch 22 Iter 19: loss 0.16506. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.04it/s]
Epoch 22 Iter 19: loss 0.16506. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 22 Iter 20: loss 0.16803. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 22 Iter 20: loss 0.16803. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 22 Iter 21: loss 0.17788. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 22 Iter 21: loss 0.17788. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 22 Iter 22: loss 0.16656. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.05it/s]
Epoch 22 Iter 22: loss 0.16656. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 22 Iter 23: loss 0.18284. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 22 Iter 23: loss 0.18284. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 22 Iter 24: loss 0.16490. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 22 Iter 24: loss 0.16490. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 22 Iter 25: loss 0.17936. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 22 Iter 25: loss 0.17936. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 22 Iter 26: loss 0.19373. :  11%|█████                                        | 25/224 [00:12<01:36,  2.05it/s]
Epoch 22 Iter 26: loss 0.19373. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 22 Iter 27: loss 0.18184. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 22 Iter 27: loss 0.18184. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 22 Iter 28: loss 0.15869. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 22 Iter 28: loss 0.15869. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 22 Iter 29: loss 0.15416. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 22 Iter 29: loss 0.15416. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 22 Iter 30: loss 0.17803. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 22 Iter 30: loss 0.17803. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 22 Iter 31: loss 0.17135. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 22 Iter 31: loss 0.17135. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 22 Iter 32: loss 0.17706. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 22 Iter 32: loss 0.17706. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 22 Iter 33: loss 0.18570. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 22 Iter 33: loss 0.18570. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 22 Iter 34: loss 0.15781. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 22 Iter 34: loss 0.15781. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 22 Iter 35: loss 0.18575. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 22 Iter 35: loss 0.18575. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 22 Iter 36: loss 0.19254. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 22 Iter 36: loss 0.19254. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 22 Iter 37: loss 0.17974. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 22 Iter 37: loss 0.17974. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 22 Iter 38: loss 0.16889. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 22 Iter 38: loss 0.16889. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 22 Iter 39: loss 0.15971. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 22 Iter 39: loss 0.15971. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 22 Iter 40: loss 0.17162. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 22 Iter 40: loss 0.17162. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 22 Iter 41: loss 0.17729. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 22 Iter 41: loss 0.17729. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 22 Iter 42: loss 0.18471. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 22 Iter 42: loss 0.18471. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 22 Iter 43: loss 0.17053. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 22 Iter 43: loss 0.17053. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 22 Iter 44: loss 0.17015. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 22 Iter 44: loss 0.17015. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 22 Iter 45: loss 0.18866. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 22 Iter 45: loss 0.18866. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 22 Iter 46: loss 0.17277. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 22 Iter 46: loss 0.17277. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 22 Iter 47: loss 0.17280. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 22 Iter 47: loss 0.17280. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 22 Iter 48: loss 0.19832. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 22 Iter 48: loss 0.19832. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 22 Iter 49: loss 0.19557. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 22 Iter 49: loss 0.19557. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 22 Iter 50: loss 0.17027. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 22 Iter 50: loss 0.17027. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 22 Iter 51: loss 0.16739. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 22 Iter 51: loss 0.16739. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 22 Iter 52: loss 0.16184. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 22 Iter 52: loss 0.16184. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 22 Iter 53: loss 0.17232. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 22 Iter 53: loss 0.17232. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 22 Iter 54: loss 0.19114. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 22 Iter 54: loss 0.19114. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 22 Iter 55: loss 0.17268. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 22 Iter 55: loss 0.17268. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 22 Iter 56: loss 0.19359. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 22 Iter 56: loss 0.19359. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 22 Iter 57: loss 0.17097. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 22 Iter 57: loss 0.17097. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 22 Iter 58: loss 0.17865. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 22 Iter 58: loss 0.17865. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 22 Iter 59: loss 0.16018. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 22 Iter 59: loss 0.16018. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 22 Iter 60: loss 0.17532. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 22 Iter 60: loss 0.17532. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 22 Iter 61: loss 0.16893. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.08it/s]
Epoch 22 Iter 61: loss 0.16893. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 22 Iter 62: loss 0.17724. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 22 Iter 62: loss 0.17724. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 22 Iter 63: loss 0.17276. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 22 Iter 63: loss 0.17276. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 22 Iter 64: loss 0.17769. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 22 Iter 64: loss 0.17769. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 22 Iter 65: loss 0.17205. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 22 Iter 65: loss 0.17205. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 22 Iter 66: loss 0.19314. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 22 Iter 66: loss 0.19314. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 22 Iter 67: loss 0.17258. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 22 Iter 67: loss 0.17258. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 22 Iter 68: loss 0.16662. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 22 Iter 68: loss 0.16662. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.08it/s]
Epoch 22 Iter 69: loss 0.19390. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 22 Iter 69: loss 0.19390. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 22 Iter 70: loss 0.15828. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 22 Iter 70: loss 0.15828. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 22 Iter 71: loss 0.19821. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 22 Iter 71: loss 0.19821. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 22 Iter 72: loss 0.18401. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 22 Iter 72: loss 0.18401. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 22 Iter 73: loss 0.16723. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 22 Iter 73: loss 0.16723. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 22 Iter 74: loss 0.19169. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 22 Iter 74: loss 0.19169. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 22 Iter 75: loss 0.16789. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 22 Iter 75: loss 0.16789. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 22 Iter 76: loss 0.18018. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 22 Iter 76: loss 0.18018. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 22 Iter 77: loss 0.18498. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 22 Iter 77: loss 0.18498. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 22 Iter 78: loss 0.19155. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 22 Iter 78: loss 0.19155. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 22 Iter 79: loss 0.17539. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 22 Iter 79: loss 0.17539. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 22 Iter 80: loss 0.17952. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 22 Iter 80: loss 0.17952. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 22 Iter 81: loss 0.17942. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 22 Iter 81: loss 0.17942. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 22 Iter 82: loss 0.19594. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 22 Iter 82: loss 0.19594. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 22 Iter 83: loss 0.19398. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 22 Iter 83: loss 0.19398. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 22 Iter 84: loss 0.17573. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 22 Iter 84: loss 0.17573. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 22 Iter 85: loss 0.16888. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 22 Iter 85: loss 0.16888. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 22 Iter 86: loss 0.16109. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 22 Iter 86: loss 0.16109. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 22 Iter 87: loss 0.17116. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 22 Iter 87: loss 0.17116. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 22 Iter 88: loss 0.17568. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 22 Iter 88: loss 0.17568. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 22 Iter 89: loss 0.17825. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 22 Iter 89: loss 0.17825. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 22 Iter 90: loss 0.17096. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 22 Iter 90: loss 0.17096. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 22 Iter 91: loss 0.15884. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 91: loss 0.15884. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 92: loss 0.17113. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 22 Iter 92: loss 0.17113. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 22 Iter 93: loss 0.18254. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 22 Iter 93: loss 0.18254. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 22 Iter 94: loss 0.16922. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 22 Iter 94: loss 0.16922. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 22 Iter 95: loss 0.18141. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 22 Iter 95: loss 0.18141. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.07it/s]
Epoch 22 Iter 96: loss 0.20328. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 22 Iter 96: loss 0.20328. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 22 Iter 97: loss 0.17749. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 22 Iter 97: loss 0.17749. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 22 Iter 98: loss 0.19080. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 22 Iter 98: loss 0.19080. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 22 Iter 99: loss 0.18622. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 22 Iter 99: loss 0.18622. :  44%|███████████████████▉                         | 99/224 [00:47<00:59,  2.09it/s]
Epoch 22 Iter 100: loss 0.18705. :  44%|███████████████████▍                        | 99/224 [00:48<00:59,  2.09it/s]
Epoch 22 Iter 100: loss 0.18705. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 22 Iter 101: loss 0.18893. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 22 Iter 101: loss 0.18893. :  45%|███████████████████▍                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 22 Iter 102: loss 0.15760. :  45%|███████████████████▍                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 22 Iter 102: loss 0.15760. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 22 Iter 103: loss 0.17176. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 22 Iter 103: loss 0.17176. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 22 Iter 104: loss 0.18765. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 22 Iter 104: loss 0.18765. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 22 Iter 105: loss 0.17279. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 22 Iter 105: loss 0.17279. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 22 Iter 106: loss 0.16620. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 22 Iter 106: loss 0.16620. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 22 Iter 107: loss 0.16976. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 22 Iter 107: loss 0.16976. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 22 Iter 108: loss 0.16301. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 22 Iter 108: loss 0.16301. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 22 Iter 109: loss 0.18511. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 22 Iter 109: loss 0.18511. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 22 Iter 110: loss 0.16759. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 22 Iter 110: loss 0.16759. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 22 Iter 111: loss 0.15628. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 22 Iter 111: loss 0.15628. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 22 Iter 112: loss 0.17632. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 22 Iter 112: loss 0.17632. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 22 Iter 113: loss 0.16736. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 22 Iter 113: loss 0.16736. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 22 Iter 114: loss 0.18590. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 22 Iter 114: loss 0.18590. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 22 Iter 115: loss 0.19255. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 22 Iter 115: loss 0.19255. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 22 Iter 116: loss 0.17992. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 22 Iter 116: loss 0.17992. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 22 Iter 117: loss 0.18371. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 22 Iter 117: loss 0.18371. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 22 Iter 118: loss 0.17870. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 22 Iter 118: loss 0.17870. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 22 Iter 119: loss 0.16390. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 22 Iter 119: loss 0.16390. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.08it/s]
Epoch 22 Iter 120: loss 0.17927. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 120: loss 0.17927. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 121: loss 0.17612. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 22 Iter 121: loss 0.17612. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 22 Iter 122: loss 0.19225. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 22 Iter 122: loss 0.19225. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.17292. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 22 Iter 123: loss 0.17292. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 22 Iter 124: loss 0.17764. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 22 Iter 124: loss 0.17764. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.17868. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 22 Iter 125: loss 0.17868. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.09it/s]
Epoch 22 Iter 126: loss 0.15915. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.09it/s]
Epoch 22 Iter 126: loss 0.15915. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.08it/s]
Epoch 22 Iter 127: loss 0.20366. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 22 Iter 127: loss 0.20366. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 22 Iter 128: loss 0.18528. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 22 Iter 128: loss 0.18528. :  57%|████████████████████████▌                  | 128/224 [01:01<00:45,  2.10it/s]
Epoch 22 Iter 129: loss 0.17568. :  57%|████████████████████████▌                  | 128/224 [01:02<00:45,  2.10it/s]
Epoch 22 Iter 129: loss 0.17568. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 22 Iter 130: loss 0.17470. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 22 Iter 130: loss 0.17470. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.08it/s]
Epoch 22 Iter 131: loss 0.17549. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 22 Iter 131: loss 0.17549. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 22 Iter 132: loss 0.16295. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 22 Iter 132: loss 0.16295. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 22 Iter 133: loss 0.20326. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 22 Iter 133: loss 0.20326. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 22 Iter 134: loss 0.17771. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 22 Iter 134: loss 0.17771. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 22 Iter 135: loss 0.19722. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 22 Iter 135: loss 0.19722. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 22 Iter 136: loss 0.16072. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 22 Iter 136: loss 0.16072. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.05it/s]
Epoch 22 Iter 137: loss 0.18862. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 22 Iter 137: loss 0.18862. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 22 Iter 138: loss 0.16046. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 22 Iter 138: loss 0.16046. :  62%|██████████████████████████▍                | 138/224 [01:06<00:42,  2.04it/s]
Epoch 22 Iter 139: loss 0.17394. :  62%|██████████████████████████▍                | 138/224 [01:07<00:42,  2.04it/s]
Epoch 22 Iter 139: loss 0.17394. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 22 Iter 140: loss 0.17695. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 22 Iter 140: loss 0.17695. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 22 Iter 141: loss 0.18900. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 22 Iter 141: loss 0.18900. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 22 Iter 142: loss 0.16265. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 22 Iter 142: loss 0.16265. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 22 Iter 143: loss 0.17286. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 22 Iter 143: loss 0.17286. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 22 Iter 144: loss 0.17166. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 22 Iter 144: loss 0.17166. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.05it/s]
Epoch 22 Iter 145: loss 0.18757. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 22 Iter 145: loss 0.18757. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 22 Iter 146: loss 0.17455. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 22 Iter 146: loss 0.17455. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.09it/s]
Epoch 22 Iter 147: loss 0.16330. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 22 Iter 147: loss 0.16330. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.10it/s]
Epoch 22 Iter 148: loss 0.16743. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.10it/s]
Epoch 22 Iter 148: loss 0.16743. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 22 Iter 149: loss 0.19666. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.08it/s]
Epoch 22 Iter 149: loss 0.19666. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 22 Iter 150: loss 0.19868. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 22 Iter 150: loss 0.19868. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.09it/s]
Epoch 22 Iter 151: loss 0.16990. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.09it/s]
Epoch 22 Iter 151: loss 0.16990. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 22 Iter 152: loss 0.17597. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 22 Iter 152: loss 0.17597. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 22 Iter 153: loss 0.17743. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 22 Iter 153: loss 0.17743. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.07it/s]
Epoch 22 Iter 154: loss 0.17999. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 22 Iter 154: loss 0.17999. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.18116. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.05it/s]
Epoch 22 Iter 155: loss 0.18116. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 22 Iter 156: loss 0.16862. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 22 Iter 156: loss 0.16862. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 22 Iter 157: loss 0.15682. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 22 Iter 157: loss 0.15682. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.05it/s]
Epoch 22 Iter 158: loss 0.17585. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 22 Iter 158: loss 0.17585. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.17635. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 22 Iter 159: loss 0.17635. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.16171. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 22 Iter 160: loss 0.16171. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.17956. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 22 Iter 161: loss 0.17956. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.17227. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 22 Iter 162: loss 0.17227. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 22 Iter 163: loss 0.17343. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 22 Iter 163: loss 0.17343. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 22 Iter 164: loss 0.15573. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 22 Iter 164: loss 0.15573. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 22 Iter 165: loss 0.18792. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 22 Iter 165: loss 0.18792. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 22 Iter 166: loss 0.18176. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 22 Iter 166: loss 0.18176. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 22 Iter 167: loss 0.17290. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 22 Iter 167: loss 0.17290. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 22 Iter 168: loss 0.17042. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 22 Iter 168: loss 0.17042. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 22 Iter 169: loss 0.18783. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 22 Iter 169: loss 0.18783. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 22 Iter 170: loss 0.19503. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 22 Iter 170: loss 0.19503. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 22 Iter 171: loss 0.18759. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 22 Iter 171: loss 0.18759. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 22 Iter 172: loss 0.15690. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 22 Iter 172: loss 0.15690. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 22 Iter 173: loss 0.17573. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 22 Iter 173: loss 0.17573. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 22 Iter 174: loss 0.17252. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 22 Iter 174: loss 0.17252. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 22 Iter 175: loss 0.16748. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 22 Iter 175: loss 0.16748. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 22 Iter 176: loss 0.18215. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 22 Iter 176: loss 0.18215. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 22 Iter 177: loss 0.17472. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 22 Iter 177: loss 0.17472. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 22 Iter 178: loss 0.18937. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 22 Iter 178: loss 0.18937. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 22 Iter 179: loss 0.19783. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 22 Iter 179: loss 0.19783. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 22 Iter 180: loss 0.19332. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 22 Iter 180: loss 0.19332. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 22 Iter 181: loss 0.16435. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 22 Iter 181: loss 0.16435. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 22 Iter 182: loss 0.18727. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 22 Iter 182: loss 0.18727. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 22 Iter 183: loss 0.17027. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 22 Iter 183: loss 0.17027. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 22 Iter 184: loss 0.16665. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 22 Iter 184: loss 0.16665. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 22 Iter 185: loss 0.16545. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 22 Iter 185: loss 0.16545. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 22 Iter 186: loss 0.16582. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 186: loss 0.16582. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 187: loss 0.19335. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 22 Iter 187: loss 0.19335. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 22 Iter 188: loss 0.15691. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 22 Iter 188: loss 0.15691. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.05it/s]
Epoch 22 Iter 189: loss 0.18844. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 22 Iter 189: loss 0.18844. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 22 Iter 190: loss 0.18032. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 22 Iter 190: loss 0.18032. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 22 Iter 191: loss 0.18770. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 22 Iter 191: loss 0.18770. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 22 Iter 192: loss 0.18190. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 22 Iter 192: loss 0.18190. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 22 Iter 193: loss 0.17092. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 22 Iter 193: loss 0.17092. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 22 Iter 194: loss 0.17736. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 22 Iter 194: loss 0.17736. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 22 Iter 195: loss 0.15501. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 22 Iter 195: loss 0.15501. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 22 Iter 196: loss 0.17844. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 22 Iter 196: loss 0.17844. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 22 Iter 197: loss 0.18375. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 22 Iter 197: loss 0.18375. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 22 Iter 198: loss 0.17016. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 22 Iter 198: loss 0.17016. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 22 Iter 199: loss 0.20427. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 22 Iter 199: loss 0.20427. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 22 Iter 200: loss 0.15893. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 22 Iter 200: loss 0.15893. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 22 Iter 201: loss 0.19810. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 22 Iter 201: loss 0.19810. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 22 Iter 202: loss 0.16496. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 22 Iter 202: loss 0.16496. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 22 Iter 203: loss 0.19104. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 22 Iter 203: loss 0.19104. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 22 Iter 204: loss 0.15168. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 22 Iter 204: loss 0.15168. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 22 Iter 205: loss 0.17907. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 205: loss 0.17907. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 206: loss 0.18153. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 22 Iter 206: loss 0.18153. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 22 Iter 207: loss 0.15699. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 207: loss 0.15699. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 208: loss 0.20105. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 22 Iter 208: loss 0.20105. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 22 Iter 209: loss 0.16929. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 22 Iter 209: loss 0.16929. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 22 Iter 210: loss 0.16383. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 22 Iter 210: loss 0.16383. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.03it/s]
Epoch 22 Iter 211: loss 0.16808. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.03it/s]
Epoch 22 Iter 211: loss 0.16808. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 22 Iter 212: loss 0.15723. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 22 Iter 212: loss 0.15723. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.04it/s]
Epoch 22 Iter 213: loss 0.17956. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.04it/s]
Epoch 22 Iter 213: loss 0.17956. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 22 Iter 214: loss 0.17197. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 22 Iter 214: loss 0.17197. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 22 Iter 215: loss 0.18201. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 22 Iter 215: loss 0.18201. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 22 Iter 216: loss 0.17152. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 22 Iter 216: loss 0.17152. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 22 Iter 217: loss 0.18094. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 22 Iter 217: loss 0.18094. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 22 Iter 218: loss 0.18029. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 22 Iter 218: loss 0.18029. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 22 Iter 219: loss 0.16411. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 22 Iter 219: loss 0.16411. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 22 Iter 220: loss 0.16000. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 22 Iter 220: loss 0.16000. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 22 Iter 221: loss 0.17883. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 22 Iter 221: loss 0.17883. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 22 Iter 222: loss 0.19326. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 22 Iter 222: loss 0.19326. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 22 Iter 223: loss 0.17950. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 22 Iter 223: loss 0.17950. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 22 Iter 224: loss 0.18236. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 22 Iter 224: loss 0.18236. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 22 Iter 224: loss 0.18236. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.16661. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 23 Iter 1: loss 0.16661. :   0%|▏                                              | 1/224 [00:00<01:44,  2.14it/s]
Epoch 23 Iter 2: loss 0.17710. :   0%|▏                                              | 1/224 [00:00<01:44,  2.14it/s]
Epoch 23 Iter 2: loss 0.17710. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 23 Iter 3: loss 0.18600. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 23 Iter 3: loss 0.18600. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.18692. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 23 Iter 4: loss 0.18692. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 23 Iter 5: loss 0.18830. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 23 Iter 5: loss 0.18830. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.17407. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 23 Iter 6: loss 0.17407. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 23 Iter 7: loss 0.16650. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 23 Iter 7: loss 0.16650. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 23 Iter 8: loss 0.20044. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 23 Iter 8: loss 0.20044. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.16833. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 23 Iter 9: loss 0.16833. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.17160. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 23 Iter 10: loss 0.17160. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 23 Iter 11: loss 0.18230. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 23 Iter 11: loss 0.18230. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 23 Iter 12: loss 0.18285. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 23 Iter 12: loss 0.18285. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.06it/s]
Epoch 23 Iter 13: loss 0.16289. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.06it/s]
Epoch 23 Iter 13: loss 0.16289. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 23 Iter 14: loss 0.17130. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 23 Iter 14: loss 0.17130. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.06it/s]
Epoch 23 Iter 15: loss 0.18675. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.06it/s]
Epoch 23 Iter 15: loss 0.18675. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 23 Iter 16: loss 0.21168. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 23 Iter 16: loss 0.21168. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 23 Iter 17: loss 0.17723. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 23 Iter 17: loss 0.17723. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.17404. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 18: loss 0.17404. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 23 Iter 19: loss 0.16828. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 23 Iter 19: loss 0.16828. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.17042. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 23 Iter 20: loss 0.17042. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 23 Iter 21: loss 0.18177. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 23 Iter 21: loss 0.18177. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 23 Iter 22: loss 0.16112. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 23 Iter 22: loss 0.16112. :  10%|████▍                                        | 22/224 [00:10<01:36,  2.08it/s]
Epoch 23 Iter 23: loss 0.18675. :  10%|████▍                                        | 22/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 23: loss 0.18675. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 24: loss 0.18172. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 24: loss 0.18172. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.08it/s]
Epoch 23 Iter 25: loss 0.16329. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.08it/s]
Epoch 23 Iter 25: loss 0.16329. :  11%|█████                                        | 25/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 26: loss 0.16463. :  11%|█████                                        | 25/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 26: loss 0.16463. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 23 Iter 27: loss 0.17287. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 23 Iter 27: loss 0.17287. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.18608. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 23 Iter 28: loss 0.18608. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 23 Iter 29: loss 0.17588. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 29: loss 0.17588. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 30: loss 0.17934. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 23 Iter 30: loss 0.17934. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.17542. :  13%|██████                                       | 30/224 [00:15<01:33,  2.08it/s]
Epoch 23 Iter 31: loss 0.17542. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.19042. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 23 Iter 32: loss 0.19042. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.16806. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 23 Iter 33: loss 0.16806. :  15%|██████▋                                      | 33/224 [00:15<01:33,  2.04it/s]
Epoch 23 Iter 34: loss 0.16188. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 23 Iter 34: loss 0.16188. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 23 Iter 35: loss 0.17177. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 23 Iter 35: loss 0.17177. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 23 Iter 36: loss 0.18554. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 23 Iter 36: loss 0.18554. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.17523. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 37: loss 0.17523. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 23 Iter 38: loss 0.18924. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 23 Iter 38: loss 0.18924. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 39: loss 0.17294. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 23 Iter 39: loss 0.17294. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 23 Iter 40: loss 0.16520. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 23 Iter 40: loss 0.16520. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 23 Iter 41: loss 0.17706. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 23 Iter 41: loss 0.17706. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 23 Iter 42: loss 0.18368. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 23 Iter 42: loss 0.18368. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.18315. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 23 Iter 43: loss 0.18315. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 23 Iter 44: loss 0.16532. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 23 Iter 44: loss 0.16532. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.19040. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 23 Iter 45: loss 0.19040. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.18925. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 23 Iter 46: loss 0.18925. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 23 Iter 47: loss 0.18085. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 23 Iter 47: loss 0.18085. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.18713. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 48: loss 0.18713. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.17719. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 23 Iter 49: loss 0.17719. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 23 Iter 50: loss 0.17840. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 50: loss 0.17840. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 51: loss 0.18757. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 23 Iter 51: loss 0.18757. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 23 Iter 52: loss 0.16497. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 23 Iter 52: loss 0.16497. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.19264. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 23 Iter 53: loss 0.19264. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 23 Iter 54: loss 0.18763. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 54: loss 0.18763. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 55: loss 0.16780. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 23 Iter 55: loss 0.16780. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 23 Iter 56: loss 0.18261. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 23 Iter 56: loss 0.18261. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 23 Iter 57: loss 0.17346. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 23 Iter 57: loss 0.17346. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 23 Iter 58: loss 0.19274. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 23 Iter 58: loss 0.19274. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 23 Iter 59: loss 0.17996. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 23 Iter 59: loss 0.17996. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 23 Iter 60: loss 0.15505. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 23 Iter 60: loss 0.15505. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 23 Iter 61: loss 0.17595. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 23 Iter 61: loss 0.17595. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 23 Iter 62: loss 0.18762. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 23 Iter 62: loss 0.18762. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 23 Iter 63: loss 0.18909. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 23 Iter 63: loss 0.18909. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 23 Iter 64: loss 0.18941. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 23 Iter 64: loss 0.18941. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 23 Iter 65: loss 0.17695. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 23 Iter 65: loss 0.17695. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 23 Iter 66: loss 0.19080. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 23 Iter 66: loss 0.19080. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 23 Iter 67: loss 0.17384. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 23 Iter 67: loss 0.17384. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.07it/s]
Epoch 23 Iter 68: loss 0.19082. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.07it/s]
Epoch 23 Iter 68: loss 0.19082. :  30%|█████████████▋                               | 68/224 [00:32<01:17,  2.02it/s]
Epoch 23 Iter 69: loss 0.17885. :  30%|█████████████▋                               | 68/224 [00:33<01:17,  2.02it/s]
Epoch 23 Iter 69: loss 0.17885. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 23 Iter 70: loss 0.17113. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 23 Iter 70: loss 0.17113. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.04it/s]
Epoch 23 Iter 71: loss 0.16852. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 23 Iter 71: loss 0.16852. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.03it/s]
Epoch 23 Iter 72: loss 0.16858. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.03it/s]
Epoch 23 Iter 72: loss 0.16858. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.05it/s]
Epoch 23 Iter 73: loss 0.18967. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 23 Iter 73: loss 0.18967. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 23 Iter 74: loss 0.17573. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 23 Iter 74: loss 0.17573. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 23 Iter 75: loss 0.17415. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 23 Iter 75: loss 0.17415. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 23 Iter 76: loss 0.16890. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 23 Iter 76: loss 0.16890. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 23 Iter 77: loss 0.17141. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 23 Iter 77: loss 0.17141. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 23 Iter 78: loss 0.18180. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 23 Iter 78: loss 0.18180. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 23 Iter 79: loss 0.17643. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 23 Iter 79: loss 0.17643. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 23 Iter 80: loss 0.18499. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 23 Iter 80: loss 0.18499. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 23 Iter 81: loss 0.17751. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 23 Iter 81: loss 0.17751. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 23 Iter 82: loss 0.17650. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 23 Iter 82: loss 0.17650. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 23 Iter 83: loss 0.17459. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 23 Iter 83: loss 0.17459. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 23 Iter 84: loss 0.17051. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 23 Iter 84: loss 0.17051. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 23 Iter 85: loss 0.15991. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 23 Iter 85: loss 0.15991. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 23 Iter 86: loss 0.18415. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 23 Iter 86: loss 0.18415. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 23 Iter 87: loss 0.16210. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 23 Iter 87: loss 0.16210. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 23 Iter 88: loss 0.17047. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 23 Iter 88: loss 0.17047. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 23 Iter 89: loss 0.17004. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 23 Iter 89: loss 0.17004. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 23 Iter 90: loss 0.15988. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 23 Iter 90: loss 0.15988. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.09it/s]
Epoch 23 Iter 91: loss 0.20298. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.09it/s]
Epoch 23 Iter 91: loss 0.20298. :  41%|██████████████████▎                          | 91/224 [00:44<01:03,  2.09it/s]
Epoch 23 Iter 92: loss 0.17488. :  41%|██████████████████▎                          | 91/224 [00:44<01:03,  2.09it/s]
Epoch 23 Iter 92: loss 0.17488. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 23 Iter 93: loss 0.17911. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.08it/s]
Epoch 23 Iter 93: loss 0.17911. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 23 Iter 94: loss 0.17769. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 23 Iter 94: loss 0.17769. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 23 Iter 95: loss 0.19402. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.08it/s]
Epoch 23 Iter 95: loss 0.19402. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 23 Iter 96: loss 0.16451. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 23 Iter 96: loss 0.16451. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 23 Iter 97: loss 0.16848. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 23 Iter 97: loss 0.16848. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 23 Iter 98: loss 0.16074. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 23 Iter 98: loss 0.16074. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 23 Iter 99: loss 0.17132. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 23 Iter 99: loss 0.17132. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 23 Iter 100: loss 0.16773. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 23 Iter 100: loss 0.16773. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 23 Iter 101: loss 0.18342. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 23 Iter 101: loss 0.18342. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 23 Iter 102: loss 0.16578. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 23 Iter 102: loss 0.16578. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 23 Iter 103: loss 0.17272. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 23 Iter 103: loss 0.17272. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.05it/s]
Epoch 23 Iter 104: loss 0.19640. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 23 Iter 104: loss 0.19640. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 23 Iter 105: loss 0.15951. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 23 Iter 105: loss 0.15951. :  47%|████████████████████▏                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 23 Iter 106: loss 0.18980. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 23 Iter 106: loss 0.18980. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 23 Iter 107: loss 0.17019. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 23 Iter 107: loss 0.17019. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 23 Iter 108: loss 0.17662. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 23 Iter 108: loss 0.17662. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 23 Iter 109: loss 0.18287. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 23 Iter 109: loss 0.18287. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 23 Iter 110: loss 0.17496. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 23 Iter 110: loss 0.17496. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 23 Iter 111: loss 0.16387. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 23 Iter 111: loss 0.16387. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 23 Iter 112: loss 0.16436. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 23 Iter 112: loss 0.16436. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 23 Iter 113: loss 0.16966. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 23 Iter 113: loss 0.16966. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 23 Iter 114: loss 0.15783. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 23 Iter 114: loss 0.15783. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 23 Iter 115: loss 0.15736. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 23 Iter 115: loss 0.15736. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.17950. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 23 Iter 116: loss 0.17950. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 23 Iter 117: loss 0.18512. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 23 Iter 117: loss 0.18512. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 23 Iter 118: loss 0.18505. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 23 Iter 118: loss 0.18505. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 23 Iter 119: loss 0.19089. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 23 Iter 119: loss 0.19089. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.04it/s]
Epoch 23 Iter 120: loss 0.16616. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.04it/s]
Epoch 23 Iter 120: loss 0.16616. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.04it/s]
Epoch 23 Iter 121: loss 0.18992. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.04it/s]
Epoch 23 Iter 121: loss 0.18992. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 23 Iter 122: loss 0.17066. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 23 Iter 122: loss 0.17066. :  54%|███████████████████████▍                   | 122/224 [00:59<00:50,  2.03it/s]
Epoch 23 Iter 123: loss 0.17357. :  54%|███████████████████████▍                   | 122/224 [00:59<00:50,  2.03it/s]
Epoch 23 Iter 123: loss 0.17357. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.04it/s]
Epoch 23 Iter 124: loss 0.16246. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.04it/s]
Epoch 23 Iter 124: loss 0.16246. :  55%|███████████████████████▊                   | 124/224 [01:00<00:49,  2.04it/s]
Epoch 23 Iter 125: loss 0.18457. :  55%|███████████████████████▊                   | 124/224 [01:00<00:49,  2.04it/s]
Epoch 23 Iter 125: loss 0.18457. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 23 Iter 126: loss 0.18896. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 23 Iter 126: loss 0.18896. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.17169. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 23 Iter 127: loss 0.17169. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 23 Iter 128: loss 0.17204. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 23 Iter 128: loss 0.17204. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.16888. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 129: loss 0.16888. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.16269. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 23 Iter 130: loss 0.16269. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 23 Iter 131: loss 0.17856. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 23 Iter 131: loss 0.17856. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 23 Iter 132: loss 0.17688. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 23 Iter 132: loss 0.17688. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.09it/s]
Epoch 23 Iter 133: loss 0.15680. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.09it/s]
Epoch 23 Iter 133: loss 0.15680. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 23 Iter 134: loss 0.17723. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 23 Iter 134: loss 0.17723. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 23 Iter 135: loss 0.16121. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 23 Iter 135: loss 0.16121. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 23 Iter 136: loss 0.17234. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 23 Iter 136: loss 0.17234. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.08it/s]
Epoch 23 Iter 137: loss 0.17105. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 23 Iter 137: loss 0.17105. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 23 Iter 138: loss 0.16876. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 23 Iter 138: loss 0.16876. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 23 Iter 139: loss 0.16713. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 23 Iter 139: loss 0.16713. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 23 Iter 140: loss 0.16306. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 23 Iter 140: loss 0.16306. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 23 Iter 141: loss 0.17647. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 23 Iter 141: loss 0.17647. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 23 Iter 142: loss 0.17464. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 23 Iter 142: loss 0.17464. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.09it/s]
Epoch 23 Iter 143: loss 0.20091. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.09it/s]
Epoch 23 Iter 143: loss 0.20091. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 23 Iter 144: loss 0.17192. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 23 Iter 144: loss 0.17192. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 23 Iter 145: loss 0.18090. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 23 Iter 145: loss 0.18090. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.09it/s]
Epoch 23 Iter 146: loss 0.18141. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.09it/s]
Epoch 23 Iter 146: loss 0.18141. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.09it/s]
Epoch 23 Iter 147: loss 0.17200. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.09it/s]
Epoch 23 Iter 147: loss 0.17200. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.09it/s]
Epoch 23 Iter 148: loss 0.16228. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.09it/s]
Epoch 23 Iter 148: loss 0.16228. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 23 Iter 149: loss 0.18004. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.08it/s]
Epoch 23 Iter 149: loss 0.18004. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 23 Iter 150: loss 0.18999. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 23 Iter 150: loss 0.18999. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 23 Iter 151: loss 0.18043. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 23 Iter 151: loss 0.18043. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 23 Iter 152: loss 0.20249. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 23 Iter 152: loss 0.20249. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 23 Iter 153: loss 0.17288. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 23 Iter 153: loss 0.17288. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 23 Iter 154: loss 0.18076. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 23 Iter 154: loss 0.18076. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 23 Iter 155: loss 0.18011. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 23 Iter 155: loss 0.18011. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 23 Iter 156: loss 0.17743. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 23 Iter 156: loss 0.17743. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 23 Iter 157: loss 0.19028. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 23 Iter 157: loss 0.19028. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 23 Iter 158: loss 0.18718. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 23 Iter 158: loss 0.18718. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 23 Iter 159: loss 0.17273. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 23 Iter 159: loss 0.17273. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.09it/s]
Epoch 23 Iter 160: loss 0.18184. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 23 Iter 160: loss 0.18184. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 23 Iter 161: loss 0.17103. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 23 Iter 161: loss 0.17103. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.07it/s]
Epoch 23 Iter 162: loss 0.16712. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 23 Iter 162: loss 0.16712. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 23 Iter 163: loss 0.16748. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 23 Iter 163: loss 0.16748. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.18310. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 23 Iter 164: loss 0.18310. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 23 Iter 165: loss 0.18327. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 23 Iter 165: loss 0.18327. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 23 Iter 166: loss 0.20187. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 23 Iter 166: loss 0.20187. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 23 Iter 167: loss 0.18019. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 23 Iter 167: loss 0.18019. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 23 Iter 168: loss 0.19564. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 23 Iter 168: loss 0.19564. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 23 Iter 169: loss 0.16654. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 23 Iter 169: loss 0.16654. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.18460. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 23 Iter 170: loss 0.18460. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 23 Iter 171: loss 0.19129. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 23 Iter 171: loss 0.19129. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 23 Iter 172: loss 0.16981. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 23 Iter 172: loss 0.16981. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 23 Iter 173: loss 0.17902. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 23 Iter 173: loss 0.17902. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 23 Iter 174: loss 0.18327. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 23 Iter 174: loss 0.18327. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.17760. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 23 Iter 175: loss 0.17760. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 23 Iter 176: loss 0.17255. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 23 Iter 176: loss 0.17255. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 23 Iter 177: loss 0.18576. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 23 Iter 177: loss 0.18576. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 23 Iter 178: loss 0.17714. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 23 Iter 178: loss 0.17714. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 23 Iter 179: loss 0.16721. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 23 Iter 179: loss 0.16721. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 23 Iter 180: loss 0.18034. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 23 Iter 180: loss 0.18034. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 23 Iter 181: loss 0.19079. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 23 Iter 181: loss 0.19079. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.18758. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 23 Iter 182: loss 0.18758. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.17926. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 23 Iter 183: loss 0.17926. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 23 Iter 184: loss 0.17508. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.09it/s]
Epoch 23 Iter 184: loss 0.17508. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 23 Iter 185: loss 0.17819. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 23 Iter 185: loss 0.17819. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 23 Iter 186: loss 0.15586. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.08it/s]
Epoch 23 Iter 186: loss 0.15586. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 23 Iter 187: loss 0.15500. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 23 Iter 187: loss 0.15500. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 23 Iter 188: loss 0.18068. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 23 Iter 188: loss 0.18068. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 23 Iter 189: loss 0.16709. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 23 Iter 189: loss 0.16709. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 23 Iter 190: loss 0.18665. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 23 Iter 190: loss 0.18665. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 23 Iter 191: loss 0.15904. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 23 Iter 191: loss 0.15904. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 23 Iter 192: loss 0.16116. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 23 Iter 192: loss 0.16116. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.09it/s]
Epoch 23 Iter 193: loss 0.16467. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.09it/s]
Epoch 23 Iter 193: loss 0.16467. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.10it/s]
Epoch 23 Iter 194: loss 0.18332. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.10it/s]
Epoch 23 Iter 194: loss 0.18332. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 23 Iter 195: loss 0.18831. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 23 Iter 195: loss 0.18831. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 23 Iter 196: loss 0.18471. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.07it/s]
Epoch 23 Iter 196: loss 0.18471. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 23 Iter 197: loss 0.18310. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 23 Iter 197: loss 0.18310. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 23 Iter 198: loss 0.18482. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 23 Iter 198: loss 0.18482. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 23 Iter 199: loss 0.17265. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 23 Iter 199: loss 0.17265. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.17921. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 23 Iter 200: loss 0.17921. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 23 Iter 201: loss 0.17039. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 23 Iter 201: loss 0.17039. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 23 Iter 202: loss 0.16726. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 23 Iter 202: loss 0.16726. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 23 Iter 203: loss 0.17730. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 23 Iter 203: loss 0.17730. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 23 Iter 204: loss 0.18025. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 23 Iter 204: loss 0.18025. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 23 Iter 205: loss 0.18822. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 23 Iter 205: loss 0.18822. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 23 Iter 206: loss 0.18578. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 23 Iter 206: loss 0.18578. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 23 Iter 207: loss 0.19535. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 23 Iter 207: loss 0.19535. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 23 Iter 208: loss 0.16628. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 23 Iter 208: loss 0.16628. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 23 Iter 209: loss 0.18768. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 23 Iter 209: loss 0.18768. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 23 Iter 210: loss 0.17743. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 23 Iter 210: loss 0.17743. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 23 Iter 211: loss 0.18706. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 23 Iter 211: loss 0.18706. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 23 Iter 212: loss 0.18583. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 23 Iter 212: loss 0.18583. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 23 Iter 213: loss 0.16645. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 23 Iter 213: loss 0.16645. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 23 Iter 214: loss 0.16811. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 23 Iter 214: loss 0.16811. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 23 Iter 215: loss 0.15277. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 23 Iter 215: loss 0.15277. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.18330. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 23 Iter 216: loss 0.18330. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 23 Iter 217: loss 0.15963. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 23 Iter 217: loss 0.15963. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 23 Iter 218: loss 0.16472. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 23 Iter 218: loss 0.16472. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 23 Iter 219: loss 0.17678. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 23 Iter 219: loss 0.17678. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.10it/s]
Epoch 23 Iter 220: loss 0.16102. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.10it/s]
Epoch 23 Iter 220: loss 0.16102. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 23 Iter 221: loss 0.18296. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 23 Iter 221: loss 0.18296. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 23 Iter 222: loss 0.18647. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 23 Iter 222: loss 0.18647. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 23 Iter 223: loss 0.15756. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 23 Iter 223: loss 0.15756. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.09it/s]
Epoch 23 Iter 224: loss 0.17897. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 23 Iter 224: loss 0.17897. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 23 Iter 224: loss 0.17897. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17673
    Valid loss: 0.17991
       Valid loss recons: 0.1735
       Valid loss KL-D:   64.1005
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.16239. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 24 Iter 1: loss 0.16239. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.17411. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 24 Iter 2: loss 0.17411. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 24 Iter 3: loss 0.17672. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 24 Iter 3: loss 0.17672. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 24 Iter 4: loss 0.19037. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 24 Iter 4: loss 0.19037. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 24 Iter 5: loss 0.16909. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 24 Iter 5: loss 0.16909. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 24 Iter 6: loss 0.20154. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 24 Iter 6: loss 0.20154. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 24 Iter 7: loss 0.15435. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 24 Iter 7: loss 0.15435. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 24 Iter 8: loss 0.20187. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 24 Iter 8: loss 0.20187. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 24 Iter 9: loss 0.15714. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 9: loss 0.15714. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.19125. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.04it/s]
Epoch 24 Iter 10: loss 0.19125. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 24 Iter 11: loss 0.19567. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 24 Iter 11: loss 0.19567. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 24 Iter 12: loss 0.17654. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 24 Iter 12: loss 0.17654. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 24 Iter 13: loss 0.16699. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 24 Iter 13: loss 0.16699. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 24 Iter 14: loss 0.18630. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 24 Iter 14: loss 0.18630. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 24 Iter 15: loss 0.19281. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 24 Iter 15: loss 0.19281. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 24 Iter 16: loss 0.17861. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 24 Iter 16: loss 0.17861. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 24 Iter 17: loss 0.17055. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 24 Iter 17: loss 0.17055. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 24 Iter 18: loss 0.17451. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 24 Iter 18: loss 0.17451. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 24 Iter 19: loss 0.16523. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 24 Iter 19: loss 0.16523. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 24 Iter 20: loss 0.17516. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 24 Iter 20: loss 0.17516. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 24 Iter 21: loss 0.16290. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 24 Iter 21: loss 0.16290. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 24 Iter 22: loss 0.16748. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 24 Iter 22: loss 0.16748. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 24 Iter 23: loss 0.17166. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 24 Iter 23: loss 0.17166. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 24 Iter 24: loss 0.17918. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 24 Iter 24: loss 0.17918. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 24 Iter 25: loss 0.18337. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 24 Iter 25: loss 0.18337. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 24 Iter 26: loss 0.18702. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 24 Iter 26: loss 0.18702. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 24 Iter 27: loss 0.17111. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 24 Iter 27: loss 0.17111. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 24 Iter 28: loss 0.17750. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 24 Iter 28: loss 0.17750. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.06it/s]
Epoch 24 Iter 29: loss 0.17639. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.06it/s]
Epoch 24 Iter 29: loss 0.17639. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 24 Iter 30: loss 0.18062. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 24 Iter 30: loss 0.18062. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 24 Iter 31: loss 0.16104. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 24 Iter 31: loss 0.16104. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 24 Iter 32: loss 0.19038. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 24 Iter 32: loss 0.19038. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 24 Iter 33: loss 0.17219. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 24 Iter 33: loss 0.17219. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 24 Iter 34: loss 0.18083. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 24 Iter 34: loss 0.18083. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 24 Iter 35: loss 0.19298. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 24 Iter 35: loss 0.19298. :  16%|███████                                      | 35/224 [00:17<01:31,  2.05it/s]
Epoch 24 Iter 36: loss 0.17638. :  16%|███████                                      | 35/224 [00:17<01:31,  2.05it/s]
Epoch 24 Iter 36: loss 0.17638. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 24 Iter 37: loss 0.17363. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 24 Iter 37: loss 0.17363. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 24 Iter 38: loss 0.18902. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 24 Iter 38: loss 0.18902. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 24 Iter 39: loss 0.15945. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 24 Iter 39: loss 0.15945. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 24 Iter 40: loss 0.17631. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 24 Iter 40: loss 0.17631. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 24 Iter 41: loss 0.16288. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 24 Iter 41: loss 0.16288. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 24 Iter 42: loss 0.18621. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 24 Iter 42: loss 0.18621. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 43: loss 0.17986. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 43: loss 0.17986. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 24 Iter 44: loss 0.15338. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 24 Iter 44: loss 0.15338. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 24 Iter 45: loss 0.17386. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 24 Iter 45: loss 0.17386. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 24 Iter 46: loss 0.15504. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 24 Iter 46: loss 0.15504. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 24 Iter 47: loss 0.16986. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 24 Iter 47: loss 0.16986. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 24 Iter 48: loss 0.16630. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 24 Iter 48: loss 0.16630. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 24 Iter 49: loss 0.16958. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 24 Iter 49: loss 0.16958. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.18262. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 24 Iter 50: loss 0.18262. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 24 Iter 51: loss 0.17492. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 24 Iter 51: loss 0.17492. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 24 Iter 52: loss 0.16474. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 24 Iter 52: loss 0.16474. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 24 Iter 53: loss 0.17967. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 24 Iter 53: loss 0.17967. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 24 Iter 54: loss 0.15940. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 24 Iter 54: loss 0.15940. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 24 Iter 55: loss 0.17066. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 24 Iter 55: loss 0.17066. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 24 Iter 56: loss 0.17957. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 24 Iter 56: loss 0.17957. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 57: loss 0.16844. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 57: loss 0.16844. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 24 Iter 58: loss 0.15920. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 24 Iter 58: loss 0.15920. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 24 Iter 59: loss 0.17461. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 24 Iter 59: loss 0.17461. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 24 Iter 60: loss 0.17135. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 24 Iter 60: loss 0.17135. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 24 Iter 61: loss 0.19845. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 24 Iter 61: loss 0.19845. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 24 Iter 62: loss 0.18746. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.06it/s]
Epoch 24 Iter 62: loss 0.18746. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 24 Iter 63: loss 0.18626. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 24 Iter 63: loss 0.18626. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 24 Iter 64: loss 0.17503. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 24 Iter 64: loss 0.17503. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 24 Iter 65: loss 0.17517. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 24 Iter 65: loss 0.17517. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 24 Iter 66: loss 0.15602. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 24 Iter 66: loss 0.15602. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 24 Iter 67: loss 0.18662. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 24 Iter 67: loss 0.18662. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 24 Iter 68: loss 0.15455. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 24 Iter 68: loss 0.15455. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 24 Iter 69: loss 0.19127. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 24 Iter 69: loss 0.19127. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 24 Iter 70: loss 0.17722. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 24 Iter 70: loss 0.17722. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 24 Iter 71: loss 0.16276. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 24 Iter 71: loss 0.16276. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 24 Iter 72: loss 0.20461. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 24 Iter 72: loss 0.20461. :  32%|██████████████▍                              | 72/224 [00:34<01:12,  2.09it/s]
Epoch 24 Iter 73: loss 0.16832. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.09it/s]
Epoch 24 Iter 73: loss 0.16832. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.09it/s]
Epoch 24 Iter 74: loss 0.18296. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.09it/s]
Epoch 24 Iter 74: loss 0.18296. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 24 Iter 75: loss 0.18967. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 24 Iter 75: loss 0.18967. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 24 Iter 76: loss 0.18701. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 24 Iter 76: loss 0.18701. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 24 Iter 77: loss 0.19266. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 24 Iter 77: loss 0.19266. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 24 Iter 78: loss 0.17405. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 24 Iter 78: loss 0.17405. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 24 Iter 79: loss 0.17040. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 24 Iter 79: loss 0.17040. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.17560. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 24 Iter 80: loss 0.17560. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 24 Iter 81: loss 0.19329. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 81: loss 0.19329. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.20012. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 24 Iter 82: loss 0.20012. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 24 Iter 83: loss 0.15849. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 83: loss 0.15849. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 84: loss 0.17871. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 24 Iter 84: loss 0.17871. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 24 Iter 85: loss 0.14961. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 85: loss 0.14961. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.19401. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 24 Iter 86: loss 0.19401. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 24 Iter 87: loss 0.17021. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 24 Iter 87: loss 0.17021. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 24 Iter 88: loss 0.16616. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 24 Iter 88: loss 0.16616. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.16430. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 24 Iter 89: loss 0.16430. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 24 Iter 90: loss 0.19439. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 24 Iter 90: loss 0.19439. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 24 Iter 91: loss 0.17417. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 24 Iter 91: loss 0.17417. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 92: loss 0.17784. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 92: loss 0.17784. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 24 Iter 93: loss 0.17251. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 24 Iter 93: loss 0.17251. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 24 Iter 94: loss 0.17026. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 24 Iter 94: loss 0.17026. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.16550. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 24 Iter 95: loss 0.16550. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 24 Iter 96: loss 0.18212. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 24 Iter 96: loss 0.18212. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 24 Iter 97: loss 0.17723. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 24 Iter 97: loss 0.17723. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 24 Iter 98: loss 0.16482. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 24 Iter 98: loss 0.16482. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 24 Iter 99: loss 0.18093. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 24 Iter 99: loss 0.18093. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 24 Iter 100: loss 0.18330. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 24 Iter 100: loss 0.18330. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 24 Iter 101: loss 0.18068. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 24 Iter 101: loss 0.18068. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 24 Iter 102: loss 0.17431. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 24 Iter 102: loss 0.17431. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 24 Iter 103: loss 0.18862. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 24 Iter 103: loss 0.18862. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 24 Iter 104: loss 0.18279. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 24 Iter 104: loss 0.18279. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 24 Iter 105: loss 0.16180. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 24 Iter 105: loss 0.16180. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 24 Iter 106: loss 0.15932. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 24 Iter 106: loss 0.15932. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 24 Iter 107: loss 0.18846. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 24 Iter 107: loss 0.18846. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.09it/s]
Epoch 24 Iter 108: loss 0.19192. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 24 Iter 108: loss 0.19192. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 24 Iter 109: loss 0.15780. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 24 Iter 109: loss 0.15780. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 24 Iter 110: loss 0.16274. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 24 Iter 110: loss 0.16274. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.09it/s]
Epoch 24 Iter 111: loss 0.15718. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.09it/s]
Epoch 24 Iter 111: loss 0.15718. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.09it/s]
Epoch 24 Iter 112: loss 0.17674. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.09it/s]
Epoch 24 Iter 112: loss 0.17674. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 24 Iter 113: loss 0.17191. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 24 Iter 113: loss 0.17191. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 24 Iter 114: loss 0.20206. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 114: loss 0.20206. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 115: loss 0.18665. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 24 Iter 115: loss 0.18665. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 24 Iter 116: loss 0.18492. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 116: loss 0.18492. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 117: loss 0.15194. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 24 Iter 117: loss 0.15194. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 24 Iter 118: loss 0.16514. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 118: loss 0.16514. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 119: loss 0.17779. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 24 Iter 119: loss 0.17779. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 24 Iter 120: loss 0.18369. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 24 Iter 120: loss 0.18369. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 24 Iter 121: loss 0.17527. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 24 Iter 121: loss 0.17527. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 24 Iter 122: loss 0.16568. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 24 Iter 122: loss 0.16568. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 24 Iter 123: loss 0.16832. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 24 Iter 123: loss 0.16832. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 24 Iter 124: loss 0.17414. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 24 Iter 124: loss 0.17414. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.17275. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 24 Iter 125: loss 0.17275. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.16471. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 24 Iter 126: loss 0.16471. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.19196. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 24 Iter 127: loss 0.19196. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 24 Iter 128: loss 0.19487. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 24 Iter 128: loss 0.19487. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.19397. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 129: loss 0.19397. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 130: loss 0.17267. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 24 Iter 130: loss 0.17267. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.17152. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 24 Iter 131: loss 0.17152. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 24 Iter 132: loss 0.17761. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 24 Iter 132: loss 0.17761. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 24 Iter 133: loss 0.19531. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 24 Iter 133: loss 0.19531. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 24 Iter 134: loss 0.19497. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 24 Iter 134: loss 0.19497. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 24 Iter 135: loss 0.18612. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 24 Iter 135: loss 0.18612. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 24 Iter 136: loss 0.17335. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 24 Iter 136: loss 0.17335. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.08it/s]
Epoch 24 Iter 137: loss 0.17793. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 24 Iter 137: loss 0.17793. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 24 Iter 138: loss 0.17970. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 24 Iter 138: loss 0.17970. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 24 Iter 139: loss 0.17338. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 24 Iter 139: loss 0.17338. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 24 Iter 140: loss 0.19378. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 24 Iter 140: loss 0.19378. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 24 Iter 141: loss 0.17792. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 24 Iter 141: loss 0.17792. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 24 Iter 142: loss 0.16792. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 24 Iter 142: loss 0.16792. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.16985. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 24 Iter 143: loss 0.16985. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 24 Iter 144: loss 0.17218. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 24 Iter 144: loss 0.17218. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 24 Iter 145: loss 0.18889. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 24 Iter 145: loss 0.18889. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.17048. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 24 Iter 146: loss 0.17048. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 24 Iter 147: loss 0.17349. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 24 Iter 147: loss 0.17349. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 24 Iter 148: loss 0.16886. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 24 Iter 148: loss 0.16886. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 24 Iter 149: loss 0.16869. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 24 Iter 149: loss 0.16869. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 24 Iter 150: loss 0.14164. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 24 Iter 150: loss 0.14164. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 24 Iter 151: loss 0.17616. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 24 Iter 151: loss 0.17616. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 24 Iter 152: loss 0.17279. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 24 Iter 152: loss 0.17279. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 24 Iter 153: loss 0.17310. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 24 Iter 153: loss 0.17310. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 24 Iter 154: loss 0.20985. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 24 Iter 154: loss 0.20985. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 24 Iter 155: loss 0.19159. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 24 Iter 155: loss 0.19159. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.18123. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 24 Iter 156: loss 0.18123. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 24 Iter 157: loss 0.18744. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 24 Iter 157: loss 0.18744. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.09it/s]
Epoch 24 Iter 158: loss 0.19019. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.09it/s]
Epoch 24 Iter 158: loss 0.19019. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 24 Iter 159: loss 0.16862. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.06it/s]
Epoch 24 Iter 159: loss 0.16862. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.19480. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 160: loss 0.19480. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 161: loss 0.18515. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 24 Iter 161: loss 0.18515. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.06it/s]
Epoch 24 Iter 162: loss 0.16565. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 24 Iter 162: loss 0.16565. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 24 Iter 163: loss 0.18257. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 24 Iter 163: loss 0.18257. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 24 Iter 164: loss 0.18321. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 24 Iter 164: loss 0.18321. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 24 Iter 165: loss 0.16027. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 24 Iter 165: loss 0.16027. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 24 Iter 166: loss 0.17788. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 24 Iter 166: loss 0.17788. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 24 Iter 167: loss 0.16925. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 24 Iter 167: loss 0.16925. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 24 Iter 168: loss 0.18447. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 168: loss 0.18447. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.20642. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 24 Iter 169: loss 0.20642. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.04it/s]
Epoch 24 Iter 170: loss 0.18085. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.04it/s]
Epoch 24 Iter 170: loss 0.18085. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 24 Iter 171: loss 0.18548. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 24 Iter 171: loss 0.18548. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 24 Iter 172: loss 0.18242. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 172: loss 0.18242. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.16387. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 24 Iter 173: loss 0.16387. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 24 Iter 174: loss 0.17215. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 174: loss 0.17215. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 175: loss 0.14994. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 24 Iter 175: loss 0.14994. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 24 Iter 176: loss 0.18290. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 24 Iter 176: loss 0.18290. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 24 Iter 177: loss 0.15622. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.05it/s]
Epoch 24 Iter 177: loss 0.15622. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 24 Iter 178: loss 0.17404. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 24 Iter 178: loss 0.17404. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 24 Iter 179: loss 0.19370. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 24 Iter 179: loss 0.19370. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 24 Iter 180: loss 0.17538. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 24 Iter 180: loss 0.17538. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 24 Iter 181: loss 0.16885. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 24 Iter 181: loss 0.16885. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 24 Iter 182: loss 0.19212. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 182: loss 0.19212. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 183: loss 0.18022. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 24 Iter 183: loss 0.18022. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 24 Iter 184: loss 0.16677. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 184: loss 0.16677. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 185: loss 0.16939. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 24 Iter 185: loss 0.16939. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 24 Iter 186: loss 0.16462. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 186: loss 0.16462. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 187: loss 0.20112. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 24 Iter 187: loss 0.20112. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 24 Iter 188: loss 0.17478. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 188: loss 0.17478. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 189: loss 0.18343. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 24 Iter 189: loss 0.18343. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 24 Iter 190: loss 0.17015. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 24 Iter 190: loss 0.17015. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 24 Iter 191: loss 0.18066. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 24 Iter 191: loss 0.18066. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 24 Iter 192: loss 0.16819. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 24 Iter 192: loss 0.16819. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.18426. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 24 Iter 193: loss 0.18426. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 24 Iter 194: loss 0.18189. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 24 Iter 194: loss 0.18189. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 24 Iter 195: loss 0.18833. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 24 Iter 195: loss 0.18833. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 24 Iter 196: loss 0.16063. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 24 Iter 196: loss 0.16063. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.08it/s]
Epoch 24 Iter 197: loss 0.18292. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 24 Iter 197: loss 0.18292. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 24 Iter 198: loss 0.18770. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 24 Iter 198: loss 0.18770. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 24 Iter 199: loss 0.19014. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 24 Iter 199: loss 0.19014. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 24 Iter 200: loss 0.18033. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 24 Iter 200: loss 0.18033. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 24 Iter 201: loss 0.15852. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 24 Iter 201: loss 0.15852. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 24 Iter 202: loss 0.17395. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 24 Iter 202: loss 0.17395. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 24 Iter 203: loss 0.17259. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 24 Iter 203: loss 0.17259. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 24 Iter 204: loss 0.16486. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 24 Iter 204: loss 0.16486. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 24 Iter 205: loss 0.18260. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 24 Iter 205: loss 0.18260. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 24 Iter 206: loss 0.16564. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 24 Iter 206: loss 0.16564. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 24 Iter 207: loss 0.18179. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 207: loss 0.18179. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 208: loss 0.16992. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 24 Iter 208: loss 0.16992. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 24 Iter 209: loss 0.16706. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 24 Iter 209: loss 0.16706. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.18238. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 24 Iter 210: loss 0.18238. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 24 Iter 211: loss 0.17461. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 24 Iter 211: loss 0.17461. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.16891. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 24 Iter 212: loss 0.16891. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.17475. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 213: loss 0.17475. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.19688. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 24 Iter 214: loss 0.19688. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 24 Iter 215: loss 0.16636. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 24 Iter 215: loss 0.16636. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 24 Iter 216: loss 0.16024. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 24 Iter 216: loss 0.16024. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 24 Iter 217: loss 0.18855. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 24 Iter 217: loss 0.18855. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 24 Iter 218: loss 0.20460. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 24 Iter 218: loss 0.20460. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 24 Iter 219: loss 0.17722. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 24 Iter 219: loss 0.17722. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.06it/s]
Epoch 24 Iter 220: loss 0.16757. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 24 Iter 220: loss 0.16757. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 24 Iter 221: loss 0.16686. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 24 Iter 221: loss 0.16686. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 24 Iter 222: loss 0.16852. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 24 Iter 222: loss 0.16852. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 24 Iter 223: loss 0.18899. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 24 Iter 223: loss 0.18899. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.18034. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 24 Iter 224: loss 0.18034. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 24 Iter 224: loss 0.18034. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.17919. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 25 Iter 1: loss 0.17919. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 25 Iter 2: loss 0.19227. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 25 Iter 2: loss 0.19227. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 25 Iter 3: loss 0.16808. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 25 Iter 3: loss 0.16808. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 25 Iter 4: loss 0.16987. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 25 Iter 4: loss 0.16987. :   2%|▊                                              | 4/224 [00:01<01:45,  2.09it/s]
Epoch 25 Iter 5: loss 0.15690. :   2%|▊                                              | 4/224 [00:02<01:45,  2.09it/s]
Epoch 25 Iter 5: loss 0.15690. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 25 Iter 6: loss 0.17775. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 25 Iter 6: loss 0.17775. :   3%|█▎                                             | 6/224 [00:02<01:44,  2.08it/s]
Epoch 25 Iter 7: loss 0.16213. :   3%|█▎                                             | 6/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 7: loss 0.16213. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 8: loss 0.19986. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 8: loss 0.19986. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.08it/s]
Epoch 25 Iter 9: loss 0.17276. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.08it/s]
Epoch 25 Iter 9: loss 0.17276. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 25 Iter 10: loss 0.18526. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 25 Iter 10: loss 0.18526. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 25 Iter 11: loss 0.16003. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 25 Iter 11: loss 0.16003. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 25 Iter 12: loss 0.17663. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 25 Iter 12: loss 0.17663. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 25 Iter 13: loss 0.16860. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 25 Iter 13: loss 0.16860. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 25 Iter 14: loss 0.18102. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 25 Iter 14: loss 0.18102. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 25 Iter 15: loss 0.18489. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 25 Iter 15: loss 0.18489. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 16: loss 0.18859. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 16: loss 0.18859. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 25 Iter 17: loss 0.17035. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 25 Iter 17: loss 0.17035. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 18: loss 0.17069. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 18: loss 0.17069. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 25 Iter 19: loss 0.16386. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 25 Iter 19: loss 0.16386. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 25 Iter 20: loss 0.18326. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 25 Iter 20: loss 0.18326. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 25 Iter 21: loss 0.20198. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 25 Iter 21: loss 0.20198. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 25 Iter 22: loss 0.16538. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 25 Iter 22: loss 0.16538. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 25 Iter 23: loss 0.16403. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 25 Iter 23: loss 0.16403. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.17688. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 24: loss 0.17688. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 25 Iter 25: loss 0.18579. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 25 Iter 25: loss 0.18579. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 26: loss 0.18084. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 26: loss 0.18084. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 25 Iter 27: loss 0.18072. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 25 Iter 27: loss 0.18072. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 25 Iter 28: loss 0.16717. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 25 Iter 28: loss 0.16717. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 25 Iter 29: loss 0.18652. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 25 Iter 29: loss 0.18652. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 25 Iter 30: loss 0.16739. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 25 Iter 30: loss 0.16739. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 25 Iter 31: loss 0.17552. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 25 Iter 31: loss 0.17552. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.17242. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 25 Iter 32: loss 0.17242. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.19327. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 33: loss 0.19327. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 25 Iter 34: loss 0.19034. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 25 Iter 34: loss 0.19034. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 35: loss 0.18983. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 25 Iter 35: loss 0.18983. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 25 Iter 36: loss 0.18027. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 25 Iter 36: loss 0.18027. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 25 Iter 37: loss 0.16785. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 25 Iter 37: loss 0.16785. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 25 Iter 38: loss 0.17014. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 25 Iter 38: loss 0.17014. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 25 Iter 39: loss 0.18182. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 25 Iter 39: loss 0.18182. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 25 Iter 40: loss 0.17997. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 25 Iter 40: loss 0.17997. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.18595. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 41: loss 0.18595. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.16883. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 25 Iter 42: loss 0.16883. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 25 Iter 43: loss 0.16543. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 25 Iter 43: loss 0.16543. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 25 Iter 44: loss 0.16540. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 25 Iter 44: loss 0.16540. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 45: loss 0.17417. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 45: loss 0.17417. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 25 Iter 46: loss 0.17851. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 25 Iter 46: loss 0.17851. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 25 Iter 47: loss 0.17412. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 25 Iter 47: loss 0.17412. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 25 Iter 48: loss 0.17503. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 25 Iter 48: loss 0.17503. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 25 Iter 49: loss 0.16640. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 25 Iter 49: loss 0.16640. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 25 Iter 50: loss 0.16394. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 50: loss 0.16394. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 51: loss 0.16939. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 25 Iter 51: loss 0.16939. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 25 Iter 52: loss 0.17357. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 52: loss 0.17357. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.18122. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 25 Iter 53: loss 0.18122. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 25 Iter 54: loss 0.17338. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 25 Iter 54: loss 0.17338. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 55: loss 0.17078. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 55: loss 0.17078. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 25 Iter 56: loss 0.15925. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 25 Iter 56: loss 0.15925. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 25 Iter 57: loss 0.18071. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 25 Iter 57: loss 0.18071. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 25 Iter 58: loss 0.19137. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 25 Iter 58: loss 0.19137. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 25 Iter 59: loss 0.17924. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 25 Iter 59: loss 0.17924. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 25 Iter 60: loss 0.16717. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 60: loss 0.16717. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.17185. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 61: loss 0.17185. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 25 Iter 62: loss 0.17252. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 25 Iter 62: loss 0.17252. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 25 Iter 63: loss 0.17556. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 25 Iter 63: loss 0.17556. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 25 Iter 64: loss 0.16358. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 25 Iter 64: loss 0.16358. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 25 Iter 65: loss 0.17891. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 25 Iter 65: loss 0.17891. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 25 Iter 66: loss 0.17948. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.09it/s]
Epoch 25 Iter 66: loss 0.17948. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 25 Iter 67: loss 0.17474. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 25 Iter 67: loss 0.17474. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 25 Iter 68: loss 0.17591. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 25 Iter 68: loss 0.17591. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 25 Iter 69: loss 0.17432. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 25 Iter 69: loss 0.17432. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 25 Iter 70: loss 0.18965. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 25 Iter 70: loss 0.18965. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.17901. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 25 Iter 71: loss 0.17901. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 25 Iter 72: loss 0.19477. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 25 Iter 72: loss 0.19477. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 25 Iter 73: loss 0.17886. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 25 Iter 73: loss 0.17886. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 74: loss 0.18944. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 74: loss 0.18944. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 25 Iter 75: loss 0.15814. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 25 Iter 75: loss 0.15814. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 25 Iter 76: loss 0.17783. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 25 Iter 76: loss 0.17783. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.17136. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 25 Iter 77: loss 0.17136. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.17567. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 78: loss 0.17567. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.16629. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 25 Iter 79: loss 0.16629. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 80: loss 0.16098. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 80: loss 0.16098. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 25 Iter 81: loss 0.17976. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 25 Iter 81: loss 0.17976. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 25 Iter 82: loss 0.17644. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 25 Iter 82: loss 0.17644. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 25 Iter 83: loss 0.16753. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 25 Iter 83: loss 0.16753. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 25 Iter 84: loss 0.17332. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 25 Iter 84: loss 0.17332. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.17912. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 25 Iter 85: loss 0.17912. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 25 Iter 86: loss 0.18200. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 25 Iter 86: loss 0.18200. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.16372. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 25 Iter 87: loss 0.16372. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.18933. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 25 Iter 88: loss 0.18933. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 25 Iter 89: loss 0.18586. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 25 Iter 89: loss 0.18586. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 25 Iter 90: loss 0.18155. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 25 Iter 90: loss 0.18155. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.04it/s]
Epoch 25 Iter 91: loss 0.17730. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.04it/s]
Epoch 25 Iter 91: loss 0.17730. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 92: loss 0.17559. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 92: loss 0.17559. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.20224. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 25 Iter 93: loss 0.20224. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 94: loss 0.16221. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 25 Iter 94: loss 0.16221. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.04it/s]
Epoch 25 Iter 95: loss 0.16704. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.04it/s]
Epoch 25 Iter 95: loss 0.16704. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 25 Iter 96: loss 0.17826. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 25 Iter 96: loss 0.17826. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 25 Iter 97: loss 0.17697. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 25 Iter 97: loss 0.17697. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.03it/s]
Epoch 25 Iter 98: loss 0.16737. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.03it/s]
Epoch 25 Iter 98: loss 0.16737. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.04it/s]
Epoch 25 Iter 99: loss 0.18742. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.04it/s]
Epoch 25 Iter 99: loss 0.18742. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 25 Iter 100: loss 0.15376. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 25 Iter 100: loss 0.15376. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.03it/s]
Epoch 25 Iter 101: loss 0.20979. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.03it/s]
Epoch 25 Iter 101: loss 0.20979. :  45%|███████████████████▍                       | 101/224 [00:48<01:00,  2.04it/s]
Epoch 25 Iter 102: loss 0.17820. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 25 Iter 102: loss 0.17820. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.03it/s]
Epoch 25 Iter 103: loss 0.17053. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.03it/s]
Epoch 25 Iter 103: loss 0.17053. :  46%|███████████████████▊                       | 103/224 [00:49<00:59,  2.02it/s]
Epoch 25 Iter 104: loss 0.16919. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.02it/s]
Epoch 25 Iter 104: loss 0.16919. :  46%|███████████████████▉                       | 104/224 [00:50<00:59,  2.03it/s]
Epoch 25 Iter 105: loss 0.17491. :  46%|███████████████████▉                       | 104/224 [00:50<00:59,  2.03it/s]
Epoch 25 Iter 105: loss 0.17491. :  47%|████████████████████▏                      | 105/224 [00:50<00:58,  2.05it/s]
Epoch 25 Iter 106: loss 0.16794. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 25 Iter 106: loss 0.16794. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.04it/s]
Epoch 25 Iter 107: loss 0.16664. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.04it/s]
Epoch 25 Iter 107: loss 0.16664. :  48%|████████████████████▌                      | 107/224 [00:51<00:57,  2.04it/s]
Epoch 25 Iter 108: loss 0.16494. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.04it/s]
Epoch 25 Iter 108: loss 0.16494. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 25 Iter 109: loss 0.16722. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 25 Iter 109: loss 0.16722. :  49%|████████████████████▉                      | 109/224 [00:52<00:56,  2.05it/s]
Epoch 25 Iter 110: loss 0.17759. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.05it/s]
Epoch 25 Iter 110: loss 0.17759. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 25 Iter 111: loss 0.18015. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 25 Iter 111: loss 0.18015. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 25 Iter 112: loss 0.19387. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 25 Iter 112: loss 0.19387. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.17528. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 25 Iter 113: loss 0.17528. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.16230. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 114: loss 0.16230. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.19853. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 115: loss 0.19853. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.19499. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 25 Iter 116: loss 0.19499. :  52%|██████████████████████▎                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 25 Iter 117: loss 0.16140. :  52%|██████████████████████▎                    | 116/224 [00:56<00:53,  2.03it/s]
Epoch 25 Iter 117: loss 0.16140. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.04it/s]
Epoch 25 Iter 118: loss 0.18231. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 25 Iter 118: loss 0.18231. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.16929. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 119: loss 0.16929. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 25 Iter 120: loss 0.17830. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 25 Iter 120: loss 0.17830. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 25 Iter 121: loss 0.18790. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 25 Iter 121: loss 0.18790. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 25 Iter 122: loss 0.16647. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 25 Iter 122: loss 0.16647. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 25 Iter 123: loss 0.18060. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 25 Iter 123: loss 0.18060. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 25 Iter 124: loss 0.17215. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 25 Iter 124: loss 0.17215. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 25 Iter 125: loss 0.18712. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 25 Iter 125: loss 0.18712. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 25 Iter 126: loss 0.17956. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 126: loss 0.17956. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 127: loss 0.16500. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 25 Iter 127: loss 0.16500. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 25 Iter 128: loss 0.15309. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 25 Iter 128: loss 0.15309. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.17154. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 129: loss 0.17154. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.17278. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 25 Iter 130: loss 0.17278. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 131: loss 0.16059. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 131: loss 0.16059. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.16831. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 25 Iter 132: loss 0.16831. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 25 Iter 133: loss 0.19369. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 25 Iter 133: loss 0.19369. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 25 Iter 134: loss 0.19150. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 25 Iter 134: loss 0.19150. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 25 Iter 135: loss 0.16982. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 25 Iter 135: loss 0.16982. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 25 Iter 136: loss 0.16301. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.08it/s]
Epoch 25 Iter 136: loss 0.16301. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 25 Iter 137: loss 0.16548. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 25 Iter 137: loss 0.16548. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 25 Iter 138: loss 0.19742. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 25 Iter 138: loss 0.19742. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 25 Iter 139: loss 0.18633. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 25 Iter 139: loss 0.18633. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 25 Iter 140: loss 0.16179. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 25 Iter 140: loss 0.16179. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 25 Iter 141: loss 0.18014. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 141: loss 0.18014. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 142: loss 0.18031. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 25 Iter 142: loss 0.18031. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 25 Iter 143: loss 0.18007. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 25 Iter 143: loss 0.18007. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 25 Iter 144: loss 0.17419. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 25 Iter 144: loss 0.17419. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 25 Iter 145: loss 0.17654. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 25 Iter 145: loss 0.17654. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 25 Iter 146: loss 0.17294. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 25 Iter 146: loss 0.17294. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 25 Iter 147: loss 0.16566. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 25 Iter 147: loss 0.16566. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 25 Iter 148: loss 0.17553. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 25 Iter 148: loss 0.17553. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 25 Iter 149: loss 0.18841. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 25 Iter 149: loss 0.18841. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 25 Iter 150: loss 0.18253. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 25 Iter 150: loss 0.18253. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 25 Iter 151: loss 0.17308. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 25 Iter 151: loss 0.17308. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 25 Iter 152: loss 0.16863. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 25 Iter 152: loss 0.16863. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 25 Iter 153: loss 0.16470. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 25 Iter 153: loss 0.16470. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 154: loss 0.16202. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 25 Iter 154: loss 0.16202. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 25 Iter 155: loss 0.18450. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 25 Iter 155: loss 0.18450. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 25 Iter 156: loss 0.20875. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 25 Iter 156: loss 0.20875. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 25 Iter 157: loss 0.17193. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 25 Iter 157: loss 0.17193. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 25 Iter 158: loss 0.20234. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 25 Iter 158: loss 0.20234. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 25 Iter 159: loss 0.16221. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 25 Iter 159: loss 0.16221. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.18470. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 25 Iter 160: loss 0.18470. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 25 Iter 161: loss 0.17699. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 25 Iter 161: loss 0.17699. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 25 Iter 162: loss 0.18729. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 25 Iter 162: loss 0.18729. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 25 Iter 163: loss 0.18489. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.08it/s]
Epoch 25 Iter 163: loss 0.18489. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.17844. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 25 Iter 164: loss 0.17844. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 25 Iter 165: loss 0.17893. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.07it/s]
Epoch 25 Iter 165: loss 0.17893. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 25 Iter 166: loss 0.18397. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 25 Iter 166: loss 0.18397. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 25 Iter 167: loss 0.16912. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 25 Iter 167: loss 0.16912. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 25 Iter 168: loss 0.18300. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 25 Iter 168: loss 0.18300. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 25 Iter 169: loss 0.17953. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 25 Iter 169: loss 0.17953. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 25 Iter 170: loss 0.16907. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 25 Iter 170: loss 0.16907. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 25 Iter 171: loss 0.17595. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 25 Iter 171: loss 0.17595. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 25 Iter 172: loss 0.15473. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 25 Iter 172: loss 0.15473. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 25 Iter 173: loss 0.19737. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 25 Iter 173: loss 0.19737. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 25 Iter 174: loss 0.15763. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 174: loss 0.15763. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.18427. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 25 Iter 175: loss 0.18427. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 25 Iter 176: loss 0.16373. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 25 Iter 176: loss 0.16373. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 25 Iter 177: loss 0.17596. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 25 Iter 177: loss 0.17596. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 25 Iter 178: loss 0.18836. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 25 Iter 178: loss 0.18836. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 25 Iter 179: loss 0.19121. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 25 Iter 179: loss 0.19121. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 25 Iter 180: loss 0.17633. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 25 Iter 180: loss 0.17633. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 25 Iter 181: loss 0.17758. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 25 Iter 181: loss 0.17758. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 25 Iter 182: loss 0.17070. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 182: loss 0.17070. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 183: loss 0.17562. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 25 Iter 183: loss 0.17562. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 25 Iter 184: loss 0.17491. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 25 Iter 184: loss 0.17491. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 25 Iter 185: loss 0.19726. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 25 Iter 185: loss 0.19726. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.04it/s]
Epoch 25 Iter 186: loss 0.17314. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.04it/s]
Epoch 25 Iter 186: loss 0.17314. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 25 Iter 187: loss 0.18087. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 25 Iter 187: loss 0.18087. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 25 Iter 188: loss 0.15446. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 25 Iter 188: loss 0.15446. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 189: loss 0.16778. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 189: loss 0.16778. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 25 Iter 190: loss 0.17196. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.05it/s]
Epoch 25 Iter 190: loss 0.17196. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 25 Iter 191: loss 0.17946. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 25 Iter 191: loss 0.17946. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 25 Iter 192: loss 0.19460. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 25 Iter 192: loss 0.19460. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 25 Iter 193: loss 0.17800. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 25 Iter 193: loss 0.17800. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 25 Iter 194: loss 0.16778. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 194: loss 0.16778. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 195: loss 0.18906. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 25 Iter 195: loss 0.18906. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 25 Iter 196: loss 0.16495. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 25 Iter 196: loss 0.16495. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 25 Iter 197: loss 0.16553. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 25 Iter 197: loss 0.16553. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 25 Iter 198: loss 0.17488. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:12,  2.08it/s]
Epoch 25 Iter 198: loss 0.17488. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.09it/s]
Epoch 25 Iter 199: loss 0.18983. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.09it/s]
Epoch 25 Iter 199: loss 0.18983. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 25 Iter 200: loss 0.15867. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 25 Iter 200: loss 0.15867. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.18541. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 25 Iter 201: loss 0.18541. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.14719. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 25 Iter 202: loss 0.14719. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 25 Iter 203: loss 0.17730. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 25 Iter 203: loss 0.17730. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 25 Iter 204: loss 0.18420. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 25 Iter 204: loss 0.18420. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 25 Iter 205: loss 0.17248. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 25 Iter 205: loss 0.17248. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 25 Iter 206: loss 0.18118. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 25 Iter 206: loss 0.18118. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 25 Iter 207: loss 0.18625. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 25 Iter 207: loss 0.18625. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 25 Iter 208: loss 0.16723. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 25 Iter 208: loss 0.16723. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 25 Iter 209: loss 0.17865. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 25 Iter 209: loss 0.17865. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 25 Iter 210: loss 0.17192. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 25 Iter 210: loss 0.17192. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 25 Iter 211: loss 0.18146. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 25 Iter 211: loss 0.18146. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 25 Iter 212: loss 0.19545. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 25 Iter 212: loss 0.19545. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 25 Iter 213: loss 0.16501. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 25 Iter 213: loss 0.16501. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 25 Iter 214: loss 0.20769. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 25 Iter 214: loss 0.20769. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 25 Iter 215: loss 0.18412. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 25 Iter 215: loss 0.18412. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 25 Iter 216: loss 0.18342. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 25 Iter 216: loss 0.18342. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.03it/s]
Epoch 25 Iter 217: loss 0.18068. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.03it/s]
Epoch 25 Iter 217: loss 0.18068. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 25 Iter 218: loss 0.19567. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 25 Iter 218: loss 0.19567. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 25 Iter 219: loss 0.17882. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 25 Iter 219: loss 0.17882. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 25 Iter 220: loss 0.18502. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.04it/s]
Epoch 25 Iter 220: loss 0.18502. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 25 Iter 221: loss 0.18192. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 25 Iter 221: loss 0.18192. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 25 Iter 222: loss 0.16143. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 25 Iter 222: loss 0.16143. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 25 Iter 223: loss 0.17200. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 25 Iter 223: loss 0.17200. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 25 Iter 224: loss 0.15978. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 25 Iter 224: loss 0.15978. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 25 Iter 224: loss 0.15978. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17649
    Valid loss: 0.17978
       Valid loss recons: 0.17362
       Valid loss KL-D:   61.58097
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.16307. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 26 Iter 1: loss 0.16307. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 26 Iter 2: loss 0.16131. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 26 Iter 2: loss 0.16131. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 26 Iter 3: loss 0.19050. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 26 Iter 3: loss 0.19050. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 26 Iter 4: loss 0.18933. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 26 Iter 4: loss 0.18933. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 26 Iter 5: loss 0.16744. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 5: loss 0.16744. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 6: loss 0.18670. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 26 Iter 6: loss 0.18670. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 26 Iter 7: loss 0.20093. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 26 Iter 7: loss 0.20093. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 26 Iter 8: loss 0.18290. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 26 Iter 8: loss 0.18290. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 26 Iter 9: loss 0.17266. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 26 Iter 9: loss 0.17266. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 26 Iter 10: loss 0.15540. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 26 Iter 10: loss 0.15540. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 26 Iter 11: loss 0.16617. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 26 Iter 11: loss 0.16617. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 26 Iter 12: loss 0.15963. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 26 Iter 12: loss 0.15963. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 26 Iter 13: loss 0.18907. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 13: loss 0.18907. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 14: loss 0.20015. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 26 Iter 14: loss 0.20015. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.08it/s]
Epoch 26 Iter 15: loss 0.18373. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.08it/s]
Epoch 26 Iter 15: loss 0.18373. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 26 Iter 16: loss 0.16884. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 26 Iter 16: loss 0.16884. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 26 Iter 17: loss 0.18289. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 26 Iter 17: loss 0.18289. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 26 Iter 18: loss 0.19422. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 26 Iter 18: loss 0.19422. :   8%|███▌                                         | 18/224 [00:08<01:41,  2.02it/s]
Epoch 26 Iter 19: loss 0.18251. :   8%|███▌                                         | 18/224 [00:09<01:41,  2.02it/s]
Epoch 26 Iter 19: loss 0.18251. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 26 Iter 20: loss 0.16989. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 26 Iter 20: loss 0.16989. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 26 Iter 21: loss 0.18103. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 26 Iter 21: loss 0.18103. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 26 Iter 22: loss 0.17342. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 26 Iter 22: loss 0.17342. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 26 Iter 23: loss 0.16596. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 26 Iter 23: loss 0.16596. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 26 Iter 24: loss 0.17459. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 26 Iter 24: loss 0.17459. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 26 Iter 25: loss 0.17241. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 26 Iter 25: loss 0.17241. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 26 Iter 26: loss 0.16839. :  11%|█████                                        | 25/224 [00:12<01:35,  2.09it/s]
Epoch 26 Iter 26: loss 0.16839. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 26 Iter 27: loss 0.16240. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 26 Iter 27: loss 0.16240. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 28: loss 0.16720. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 26 Iter 28: loss 0.16720. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.06it/s]
Epoch 26 Iter 29: loss 0.17734. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.06it/s]
Epoch 26 Iter 29: loss 0.17734. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 26 Iter 30: loss 0.16783. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 26 Iter 30: loss 0.16783. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 26 Iter 31: loss 0.17242. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 26 Iter 31: loss 0.17242. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 26 Iter 32: loss 0.15903. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 26 Iter 32: loss 0.15903. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 26 Iter 33: loss 0.15667. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 26 Iter 33: loss 0.15667. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 26 Iter 34: loss 0.17000. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 26 Iter 34: loss 0.17000. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 26 Iter 35: loss 0.17234. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 26 Iter 35: loss 0.17234. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 26 Iter 36: loss 0.17648. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 26 Iter 36: loss 0.17648. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 26 Iter 37: loss 0.18483. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 26 Iter 37: loss 0.18483. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 26 Iter 38: loss 0.16274. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 26 Iter 38: loss 0.16274. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 26 Iter 39: loss 0.16715. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 26 Iter 39: loss 0.16715. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 26 Iter 40: loss 0.18382. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 26 Iter 40: loss 0.18382. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 41: loss 0.15169. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 41: loss 0.15169. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 26 Iter 42: loss 0.16873. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 26 Iter 42: loss 0.16873. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 26 Iter 43: loss 0.18442. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 26 Iter 43: loss 0.18442. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 26 Iter 44: loss 0.18140. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 26 Iter 44: loss 0.18140. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 26 Iter 45: loss 0.16389. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 26 Iter 45: loss 0.16389. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 26 Iter 46: loss 0.17955. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 26 Iter 46: loss 0.17955. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 26 Iter 47: loss 0.18026. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.05it/s]
Epoch 26 Iter 47: loss 0.18026. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.06it/s]
Epoch 26 Iter 48: loss 0.17599. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.06it/s]
Epoch 26 Iter 48: loss 0.17599. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 26 Iter 49: loss 0.18066. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 26 Iter 49: loss 0.18066. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 26 Iter 50: loss 0.17361. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 26 Iter 50: loss 0.17361. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 26 Iter 51: loss 0.19352. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 26 Iter 51: loss 0.19352. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 26 Iter 52: loss 0.18353. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 26 Iter 52: loss 0.18353. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 26 Iter 53: loss 0.19214. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 26 Iter 53: loss 0.19214. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 26 Iter 54: loss 0.16382. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 26 Iter 54: loss 0.16382. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 26 Iter 55: loss 0.17270. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 26 Iter 55: loss 0.17270. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 26 Iter 56: loss 0.17635. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 26 Iter 56: loss 0.17635. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 26 Iter 57: loss 0.17236. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 26 Iter 57: loss 0.17236. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 26 Iter 58: loss 0.17962. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 26 Iter 58: loss 0.17962. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 59: loss 0.18566. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 59: loss 0.18566. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.17835. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 26 Iter 60: loss 0.17835. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.19503. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 61: loss 0.19503. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 26 Iter 62: loss 0.18386. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 26 Iter 62: loss 0.18386. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 26 Iter 63: loss 0.17946. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 26 Iter 63: loss 0.17946. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 26 Iter 64: loss 0.18793. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 26 Iter 64: loss 0.18793. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 26 Iter 65: loss 0.17740. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 26 Iter 65: loss 0.17740. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 26 Iter 66: loss 0.17305. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 26 Iter 66: loss 0.17305. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.17944. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 67: loss 0.17944. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 68: loss 0.16712. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 68: loss 0.16712. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.08it/s]
Epoch 26 Iter 69: loss 0.17194. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 26 Iter 69: loss 0.17194. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 26 Iter 70: loss 0.18289. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 26 Iter 70: loss 0.18289. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 26 Iter 71: loss 0.16700. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 26 Iter 71: loss 0.16700. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 26 Iter 72: loss 0.17942. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 26 Iter 72: loss 0.17942. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 26 Iter 73: loss 0.15842. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 26 Iter 73: loss 0.15842. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 26 Iter 74: loss 0.17319. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 26 Iter 74: loss 0.17319. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 26 Iter 75: loss 0.16727. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 26 Iter 75: loss 0.16727. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 26 Iter 76: loss 0.19044. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 26 Iter 76: loss 0.19044. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 26 Iter 77: loss 0.17586. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 26 Iter 77: loss 0.17586. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 26 Iter 78: loss 0.15612. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 26 Iter 78: loss 0.15612. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 26 Iter 79: loss 0.18069. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 26 Iter 79: loss 0.18069. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 26 Iter 80: loss 0.16380. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 26 Iter 80: loss 0.16380. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 26 Iter 81: loss 0.18072. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 81: loss 0.18072. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 82: loss 0.17767. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 26 Iter 82: loss 0.17767. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 26 Iter 83: loss 0.18208. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 26 Iter 83: loss 0.18208. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 26 Iter 84: loss 0.17077. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 26 Iter 84: loss 0.17077. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 26 Iter 85: loss 0.17572. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 26 Iter 85: loss 0.17572. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 26 Iter 86: loss 0.19215. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 26 Iter 86: loss 0.19215. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 26 Iter 87: loss 0.18091. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 26 Iter 87: loss 0.18091. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 26 Iter 88: loss 0.17958. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 26 Iter 88: loss 0.17958. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 26 Iter 89: loss 0.17457. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 26 Iter 89: loss 0.17457. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 26 Iter 90: loss 0.18957. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 26 Iter 90: loss 0.18957. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 26 Iter 91: loss 0.16949. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 26 Iter 91: loss 0.16949. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.08it/s]
Epoch 26 Iter 92: loss 0.17764. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.08it/s]
Epoch 26 Iter 92: loss 0.17764. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 26 Iter 93: loss 0.18431. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 26 Iter 93: loss 0.18431. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.16527. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 26 Iter 94: loss 0.16527. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 26 Iter 95: loss 0.16977. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 95: loss 0.16977. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 96: loss 0.17670. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 26 Iter 96: loss 0.17670. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 26 Iter 97: loss 0.19995. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 26 Iter 97: loss 0.19995. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 26 Iter 98: loss 0.17909. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 26 Iter 98: loss 0.17909. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 26 Iter 99: loss 0.15347. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 26 Iter 99: loss 0.15347. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 26 Iter 100: loss 0.17828. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 26 Iter 100: loss 0.17828. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 26 Iter 101: loss 0.17534. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 26 Iter 101: loss 0.17534. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 26 Iter 102: loss 0.18310. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 26 Iter 102: loss 0.18310. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 26 Iter 103: loss 0.15279. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 26 Iter 103: loss 0.15279. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 26 Iter 104: loss 0.19718. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 26 Iter 104: loss 0.19718. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 26 Iter 105: loss 0.18190. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 26 Iter 105: loss 0.18190. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 26 Iter 106: loss 0.15992. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 26 Iter 106: loss 0.15992. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 26 Iter 107: loss 0.15751. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 26 Iter 107: loss 0.15751. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 26 Iter 108: loss 0.16714. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 108: loss 0.16714. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 109: loss 0.16506. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 26 Iter 109: loss 0.16506. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 26 Iter 110: loss 0.19721. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 110: loss 0.19721. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 111: loss 0.17241. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 26 Iter 111: loss 0.17241. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 26 Iter 112: loss 0.17875. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 26 Iter 112: loss 0.17875. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 26 Iter 113: loss 0.17675. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 26 Iter 113: loss 0.17675. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 26 Iter 114: loss 0.18424. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 114: loss 0.18424. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 115: loss 0.15633. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 26 Iter 115: loss 0.15633. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 26 Iter 116: loss 0.19873. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 26 Iter 116: loss 0.19873. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 26 Iter 117: loss 0.18958. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 26 Iter 117: loss 0.18958. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 26 Iter 118: loss 0.18874. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 26 Iter 118: loss 0.18874. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 26 Iter 119: loss 0.17625. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 26 Iter 119: loss 0.17625. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 26 Iter 120: loss 0.19653. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 26 Iter 120: loss 0.19653. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.08it/s]
Epoch 26 Iter 121: loss 0.17922. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.08it/s]
Epoch 26 Iter 121: loss 0.17922. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.09it/s]
Epoch 26 Iter 122: loss 0.16178. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.09it/s]
Epoch 26 Iter 122: loss 0.16178. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 26 Iter 123: loss 0.18120. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 26 Iter 123: loss 0.18120. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 26 Iter 124: loss 0.19368. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 26 Iter 124: loss 0.19368. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 125: loss 0.17716. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 26 Iter 125: loss 0.17716. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 26 Iter 126: loss 0.17438. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 26 Iter 126: loss 0.17438. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 26 Iter 127: loss 0.17810. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 26 Iter 127: loss 0.17810. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 26 Iter 128: loss 0.17145. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 26 Iter 128: loss 0.17145. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.08it/s]
Epoch 26 Iter 129: loss 0.17194. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.08it/s]
Epoch 26 Iter 129: loss 0.17194. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.09it/s]
Epoch 26 Iter 130: loss 0.17619. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.09it/s]
Epoch 26 Iter 130: loss 0.17619. :  58%|████████████████████████▉                  | 130/224 [01:02<00:44,  2.09it/s]
Epoch 26 Iter 131: loss 0.17466. :  58%|████████████████████████▉                  | 130/224 [01:03<00:44,  2.09it/s]
Epoch 26 Iter 131: loss 0.17466. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 26 Iter 132: loss 0.18294. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.07it/s]
Epoch 26 Iter 132: loss 0.18294. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 26 Iter 133: loss 0.17342. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 26 Iter 133: loss 0.17342. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 26 Iter 134: loss 0.19099. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 26 Iter 134: loss 0.19099. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 26 Iter 135: loss 0.18418. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 26 Iter 135: loss 0.18418. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 26 Iter 136: loss 0.15115. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 26 Iter 136: loss 0.15115. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 26 Iter 137: loss 0.17018. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 26 Iter 137: loss 0.17018. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 26 Iter 138: loss 0.18319. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.05it/s]
Epoch 26 Iter 138: loss 0.18319. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 26 Iter 139: loss 0.18313. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 26 Iter 139: loss 0.18313. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 26 Iter 140: loss 0.16805. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 26 Iter 140: loss 0.16805. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.05it/s]
Epoch 26 Iter 141: loss 0.16466. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 26 Iter 141: loss 0.16466. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 26 Iter 142: loss 0.17602. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 26 Iter 142: loss 0.17602. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 26 Iter 143: loss 0.16935. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 26 Iter 143: loss 0.16935. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 26 Iter 144: loss 0.17425. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 26 Iter 144: loss 0.17425. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.04it/s]
Epoch 26 Iter 145: loss 0.18643. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.04it/s]
Epoch 26 Iter 145: loss 0.18643. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 26 Iter 146: loss 0.17296. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 26 Iter 146: loss 0.17296. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 26 Iter 147: loss 0.16489. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 26 Iter 147: loss 0.16489. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 26 Iter 148: loss 0.18273. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 26 Iter 148: loss 0.18273. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 26 Iter 149: loss 0.17697. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 26 Iter 149: loss 0.17697. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 26 Iter 150: loss 0.16758. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 26 Iter 150: loss 0.16758. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 26 Iter 151: loss 0.18890. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 26 Iter 151: loss 0.18890. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 26 Iter 152: loss 0.18683. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 26 Iter 152: loss 0.18683. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.09it/s]
Epoch 26 Iter 153: loss 0.17678. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.09it/s]
Epoch 26 Iter 153: loss 0.17678. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 26 Iter 154: loss 0.17376. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 26 Iter 154: loss 0.17376. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 26 Iter 155: loss 0.18578. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 26 Iter 155: loss 0.18578. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 26 Iter 156: loss 0.16602. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 26 Iter 156: loss 0.16602. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 26 Iter 157: loss 0.18194. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 26 Iter 157: loss 0.18194. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 26 Iter 158: loss 0.18611. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 26 Iter 158: loss 0.18611. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 26 Iter 159: loss 0.17250. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 26 Iter 159: loss 0.17250. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.05it/s]
Epoch 26 Iter 160: loss 0.18183. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 160: loss 0.18183. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 161: loss 0.19138. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 26 Iter 161: loss 0.19138. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 26 Iter 162: loss 0.18598. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 26 Iter 162: loss 0.18598. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 26 Iter 163: loss 0.17061. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 26 Iter 163: loss 0.17061. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 26 Iter 164: loss 0.19393. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 26 Iter 164: loss 0.19393. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 26 Iter 165: loss 0.16019. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 26 Iter 165: loss 0.16019. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 26 Iter 166: loss 0.18143. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 26 Iter 166: loss 0.18143. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 167: loss 0.17219. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 26 Iter 167: loss 0.17219. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 26 Iter 168: loss 0.16589. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 26 Iter 168: loss 0.16589. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 26 Iter 169: loss 0.17086. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 26 Iter 169: loss 0.17086. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.09it/s]
Epoch 26 Iter 170: loss 0.15657. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.09it/s]
Epoch 26 Iter 170: loss 0.15657. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 26 Iter 171: loss 0.16258. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 26 Iter 171: loss 0.16258. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.10it/s]
Epoch 26 Iter 172: loss 0.16404. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.10it/s]
Epoch 26 Iter 172: loss 0.16404. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.10it/s]
Epoch 26 Iter 173: loss 0.15432. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.10it/s]
Epoch 26 Iter 173: loss 0.15432. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.09it/s]
Epoch 26 Iter 174: loss 0.16785. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 26 Iter 174: loss 0.16785. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 26 Iter 175: loss 0.19429. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 26 Iter 175: loss 0.19429. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 26 Iter 176: loss 0.17422. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 26 Iter 176: loss 0.17422. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 26 Iter 177: loss 0.16775. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 26 Iter 177: loss 0.16775. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 26 Iter 178: loss 0.16853. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 26 Iter 178: loss 0.16853. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 26 Iter 179: loss 0.15823. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 26 Iter 179: loss 0.15823. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:22,  2.05it/s]
Epoch 26 Iter 180: loss 0.18281. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:22,  2.05it/s]
Epoch 26 Iter 180: loss 0.18281. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 26 Iter 181: loss 0.18706. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 26 Iter 181: loss 0.18706. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.19052. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 26 Iter 182: loss 0.19052. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 26 Iter 183: loss 0.19770. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 26 Iter 183: loss 0.19770. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 26 Iter 184: loss 0.18462. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 184: loss 0.18462. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.16750. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 26 Iter 185: loss 0.16750. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.17895. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 26 Iter 186: loss 0.17895. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 26 Iter 187: loss 0.16675. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 26 Iter 187: loss 0.16675. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.18497. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 188: loss 0.18497. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.17766. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 26 Iter 189: loss 0.17766. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 26 Iter 190: loss 0.17322. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 26 Iter 190: loss 0.17322. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 26 Iter 191: loss 0.18020. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 26 Iter 191: loss 0.18020. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 26 Iter 192: loss 0.18689. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 26 Iter 192: loss 0.18689. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 26 Iter 193: loss 0.17244. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 26 Iter 193: loss 0.17244. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 26 Iter 194: loss 0.18732. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 26 Iter 194: loss 0.18732. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 26 Iter 195: loss 0.17784. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 195: loss 0.17784. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 196: loss 0.15918. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 26 Iter 196: loss 0.15918. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.18035. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 26 Iter 197: loss 0.18035. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 26 Iter 198: loss 0.19503. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 26 Iter 198: loss 0.19503. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.05it/s]
Epoch 26 Iter 199: loss 0.17716. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 26 Iter 199: loss 0.17716. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 26 Iter 200: loss 0.17596. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 26 Iter 200: loss 0.17596. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.17796. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 26 Iter 201: loss 0.17796. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 26 Iter 202: loss 0.16435. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.05it/s]
Epoch 26 Iter 202: loss 0.16435. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 26 Iter 203: loss 0.18261. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 26 Iter 203: loss 0.18261. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.17382. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 26 Iter 204: loss 0.17382. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 26 Iter 205: loss 0.18177. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 26 Iter 205: loss 0.18177. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 26 Iter 206: loss 0.16072. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 26 Iter 206: loss 0.16072. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 26 Iter 207: loss 0.18480. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 26 Iter 207: loss 0.18480. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 26 Iter 208: loss 0.19862. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 26 Iter 208: loss 0.19862. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 26 Iter 209: loss 0.19215. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 26 Iter 209: loss 0.19215. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 26 Iter 210: loss 0.18522. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 26 Iter 210: loss 0.18522. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 26 Iter 211: loss 0.17382. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 26 Iter 211: loss 0.17382. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 26 Iter 212: loss 0.17072. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 26 Iter 212: loss 0.17072. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 26 Iter 213: loss 0.16183. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 26 Iter 213: loss 0.16183. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 26 Iter 214: loss 0.18740. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.04it/s]
Epoch 26 Iter 214: loss 0.18740. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.03it/s]
Epoch 26 Iter 215: loss 0.16497. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.03it/s]
Epoch 26 Iter 215: loss 0.16497. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 26 Iter 216: loss 0.16288. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 26 Iter 216: loss 0.16288. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 26 Iter 217: loss 0.16260. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.04it/s]
Epoch 26 Iter 217: loss 0.16260. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 26 Iter 218: loss 0.17292. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.04it/s]
Epoch 26 Iter 218: loss 0.17292. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 26 Iter 219: loss 0.18557. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 26 Iter 219: loss 0.18557. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 26 Iter 220: loss 0.19099. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 26 Iter 220: loss 0.19099. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 26 Iter 221: loss 0.17822. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 26 Iter 221: loss 0.17822. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 26 Iter 222: loss 0.18993. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 26 Iter 222: loss 0.18993. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 26 Iter 223: loss 0.17933. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.07it/s]
Epoch 26 Iter 223: loss 0.17933. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 26 Iter 224: loss 0.18980. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 26 Iter 224: loss 0.18980. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 26 Iter 224: loss 0.18980. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.17332. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 27 Iter 1: loss 0.17332. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 27 Iter 2: loss 0.16556. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 27 Iter 2: loss 0.16556. :   1%|▍                                              | 2/224 [00:00<01:49,  2.03it/s]
Epoch 27 Iter 3: loss 0.17812. :   1%|▍                                              | 2/224 [00:01<01:49,  2.03it/s]
Epoch 27 Iter 3: loss 0.17812. :   1%|▋                                              | 3/224 [00:01<01:50,  2.00it/s]
Epoch 27 Iter 4: loss 0.17173. :   1%|▋                                              | 3/224 [00:01<01:50,  2.00it/s]
Epoch 27 Iter 4: loss 0.17173. :   2%|▊                                              | 4/224 [00:01<01:48,  2.02it/s]
Epoch 27 Iter 5: loss 0.16738. :   2%|▊                                              | 4/224 [00:02<01:48,  2.02it/s]
Epoch 27 Iter 5: loss 0.16738. :   2%|█                                              | 5/224 [00:02<01:49,  2.01it/s]
Epoch 27 Iter 6: loss 0.18883. :   2%|█                                              | 5/224 [00:02<01:49,  2.01it/s]
Epoch 27 Iter 6: loss 0.18883. :   3%|█▎                                             | 6/224 [00:02<01:48,  2.02it/s]
Epoch 27 Iter 7: loss 0.18691. :   3%|█▎                                             | 6/224 [00:03<01:48,  2.02it/s]
Epoch 27 Iter 7: loss 0.18691. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.03it/s]
Epoch 27 Iter 8: loss 0.15993. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.03it/s]
Epoch 27 Iter 8: loss 0.15993. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.04it/s]
Epoch 27 Iter 9: loss 0.17553. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.04it/s]
Epoch 27 Iter 9: loss 0.17553. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.05it/s]
Epoch 27 Iter 10: loss 0.17643. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.05it/s]
Epoch 27 Iter 10: loss 0.17643. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 27 Iter 11: loss 0.17421. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 27 Iter 11: loss 0.17421. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 27 Iter 12: loss 0.16279. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 27 Iter 12: loss 0.16279. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 27 Iter 13: loss 0.16514. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 27 Iter 13: loss 0.16514. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 27 Iter 14: loss 0.15964. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 27 Iter 14: loss 0.15964. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 27 Iter 15: loss 0.17284. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 27 Iter 15: loss 0.17284. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 16: loss 0.15061. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 16: loss 0.15061. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 27 Iter 17: loss 0.17076. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 27 Iter 17: loss 0.17076. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 27 Iter 18: loss 0.15888. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 27 Iter 18: loss 0.15888. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 27 Iter 19: loss 0.18299. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 27 Iter 19: loss 0.18299. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 27 Iter 20: loss 0.17193. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 27 Iter 20: loss 0.17193. :   9%|████                                         | 20/224 [00:09<01:39,  2.04it/s]
Epoch 27 Iter 21: loss 0.19566. :   9%|████                                         | 20/224 [00:10<01:39,  2.04it/s]
Epoch 27 Iter 21: loss 0.19566. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 27 Iter 22: loss 0.18144. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 27 Iter 22: loss 0.18144. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 27 Iter 23: loss 0.16601. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 27 Iter 23: loss 0.16601. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 27 Iter 24: loss 0.17622. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 27 Iter 24: loss 0.17622. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 27 Iter 25: loss 0.17684. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 27 Iter 25: loss 0.17684. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 27 Iter 26: loss 0.14563. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 27 Iter 26: loss 0.14563. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 27 Iter 27: loss 0.17147. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 27 Iter 27: loss 0.17147. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 27 Iter 28: loss 0.16382. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.05it/s]
Epoch 27 Iter 28: loss 0.16382. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 27 Iter 29: loss 0.18480. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 27 Iter 29: loss 0.18480. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 27 Iter 30: loss 0.17787. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 27 Iter 30: loss 0.17787. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 27 Iter 31: loss 0.17541. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 27 Iter 31: loss 0.17541. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 27 Iter 32: loss 0.16495. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 27 Iter 32: loss 0.16495. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 27 Iter 33: loss 0.17186. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 27 Iter 33: loss 0.17186. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 27 Iter 34: loss 0.18534. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 27 Iter 34: loss 0.18534. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.04it/s]
Epoch 27 Iter 35: loss 0.18768. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.04it/s]
Epoch 27 Iter 35: loss 0.18768. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 27 Iter 36: loss 0.18910. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 27 Iter 36: loss 0.18910. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 27 Iter 37: loss 0.17823. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.07it/s]
Epoch 27 Iter 37: loss 0.17823. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 38: loss 0.15988. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 38: loss 0.15988. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 27 Iter 39: loss 0.17264. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.06it/s]
Epoch 27 Iter 39: loss 0.17264. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 40: loss 0.17337. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 40: loss 0.17337. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 41: loss 0.16598. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 27 Iter 41: loss 0.16598. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 27 Iter 42: loss 0.17715. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 27 Iter 42: loss 0.17715. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 27 Iter 43: loss 0.19241. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 27 Iter 43: loss 0.19241. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 27 Iter 44: loss 0.18125. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 27 Iter 44: loss 0.18125. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 27 Iter 45: loss 0.18160. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 27 Iter 45: loss 0.18160. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 27 Iter 46: loss 0.19867. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 27 Iter 46: loss 0.19867. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 27 Iter 47: loss 0.19437. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 27 Iter 47: loss 0.19437. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 27 Iter 48: loss 0.18661. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 27 Iter 48: loss 0.18661. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 27 Iter 49: loss 0.17783. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 27 Iter 49: loss 0.17783. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 27 Iter 50: loss 0.16823. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 27 Iter 50: loss 0.16823. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 27 Iter 51: loss 0.18725. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 27 Iter 51: loss 0.18725. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 27 Iter 52: loss 0.18274. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 27 Iter 52: loss 0.18274. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 27 Iter 53: loss 0.18545. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 27 Iter 53: loss 0.18545. :  24%|██████████▋                                  | 53/224 [00:25<01:21,  2.09it/s]
Epoch 27 Iter 54: loss 0.19213. :  24%|██████████▋                                  | 53/224 [00:26<01:21,  2.09it/s]
Epoch 27 Iter 54: loss 0.19213. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 27 Iter 55: loss 0.18234. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 27 Iter 55: loss 0.18234. :  25%|███████████                                  | 55/224 [00:26<01:20,  2.09it/s]
Epoch 27 Iter 56: loss 0.18731. :  25%|███████████                                  | 55/224 [00:27<01:20,  2.09it/s]
Epoch 27 Iter 56: loss 0.18731. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 27 Iter 57: loss 0.16805. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 27 Iter 57: loss 0.16805. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 27 Iter 58: loss 0.17453. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.08it/s]
Epoch 27 Iter 58: loss 0.17453. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 27 Iter 59: loss 0.18104. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 27 Iter 59: loss 0.18104. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 27 Iter 60: loss 0.18620. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 27 Iter 60: loss 0.18620. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 27 Iter 61: loss 0.17881. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 27 Iter 61: loss 0.17881. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 27 Iter 62: loss 0.18025. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 27 Iter 62: loss 0.18025. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 27 Iter 63: loss 0.16058. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 27 Iter 63: loss 0.16058. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 27 Iter 64: loss 0.18348. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 27 Iter 64: loss 0.18348. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 27 Iter 65: loss 0.17037. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 27 Iter 65: loss 0.17037. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 27 Iter 66: loss 0.16265. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 27 Iter 66: loss 0.16265. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 27 Iter 67: loss 0.17672. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 27 Iter 67: loss 0.17672. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 27 Iter 68: loss 0.21664. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 27 Iter 68: loss 0.21664. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 27 Iter 69: loss 0.19316. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 27 Iter 69: loss 0.19316. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 27 Iter 70: loss 0.17674. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 27 Iter 70: loss 0.17674. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 27 Iter 71: loss 0.16747. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 27 Iter 71: loss 0.16747. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 27 Iter 72: loss 0.16256. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.07it/s]
Epoch 27 Iter 72: loss 0.16256. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 27 Iter 73: loss 0.17198. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 27 Iter 73: loss 0.17198. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 27 Iter 74: loss 0.16230. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 27 Iter 74: loss 0.16230. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 27 Iter 75: loss 0.18806. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 27 Iter 75: loss 0.18806. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 27 Iter 76: loss 0.18507. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 27 Iter 76: loss 0.18507. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 27 Iter 77: loss 0.17328. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 27 Iter 77: loss 0.17328. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 27 Iter 78: loss 0.17833. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 27 Iter 78: loss 0.17833. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 27 Iter 79: loss 0.16876. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 27 Iter 79: loss 0.16876. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 27 Iter 80: loss 0.15572. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 27 Iter 80: loss 0.15572. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 27 Iter 81: loss 0.17816. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 27 Iter 81: loss 0.17816. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 27 Iter 82: loss 0.17147. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 27 Iter 82: loss 0.17147. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 27 Iter 83: loss 0.18289. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 27 Iter 83: loss 0.18289. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.07it/s]
Epoch 27 Iter 84: loss 0.18302. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.07it/s]
Epoch 27 Iter 84: loss 0.18302. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 27 Iter 85: loss 0.18359. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 27 Iter 85: loss 0.18359. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 27 Iter 86: loss 0.18241. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 27 Iter 86: loss 0.18241. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 27 Iter 87: loss 0.18860. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 27 Iter 87: loss 0.18860. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 27 Iter 88: loss 0.19320. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 27 Iter 88: loss 0.19320. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 27 Iter 89: loss 0.19241. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 27 Iter 89: loss 0.19241. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 27 Iter 90: loss 0.19644. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 27 Iter 90: loss 0.19644. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 27 Iter 91: loss 0.16857. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 27 Iter 91: loss 0.16857. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 27 Iter 92: loss 0.16497. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 27 Iter 92: loss 0.16497. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 27 Iter 93: loss 0.16756. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 27 Iter 93: loss 0.16756. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 27 Iter 94: loss 0.17587. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 27 Iter 94: loss 0.17587. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 27 Iter 95: loss 0.17234. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.08it/s]
Epoch 27 Iter 95: loss 0.17234. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 27 Iter 96: loss 0.18869. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 27 Iter 96: loss 0.18869. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.18357. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 97: loss 0.18357. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.18629. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 27 Iter 98: loss 0.18629. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.17939. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 99: loss 0.17939. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.15979. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 27 Iter 100: loss 0.15979. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 27 Iter 101: loss 0.16271. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 27 Iter 101: loss 0.16271. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 27 Iter 102: loss 0.16303. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 27 Iter 102: loss 0.16303. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 27 Iter 103: loss 0.16953. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 27 Iter 103: loss 0.16953. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.16366. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 27 Iter 104: loss 0.16366. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.17774. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 27 Iter 105: loss 0.17774. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 27 Iter 106: loss 0.18428. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 27 Iter 106: loss 0.18428. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 27 Iter 107: loss 0.17640. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 27 Iter 107: loss 0.17640. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 27 Iter 108: loss 0.17934. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 27 Iter 108: loss 0.17934. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 27 Iter 109: loss 0.17435. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 27 Iter 109: loss 0.17435. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 27 Iter 110: loss 0.16505. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 27 Iter 110: loss 0.16505. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 27 Iter 111: loss 0.19158. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 27 Iter 111: loss 0.19158. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 27 Iter 112: loss 0.18016. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 27 Iter 112: loss 0.18016. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 27 Iter 113: loss 0.17549. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 27 Iter 113: loss 0.17549. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 27 Iter 114: loss 0.17562. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 27 Iter 114: loss 0.17562. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 27 Iter 115: loss 0.17862. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 27 Iter 115: loss 0.17862. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 27 Iter 116: loss 0.15559. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 27 Iter 116: loss 0.15559. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 27 Iter 117: loss 0.15435. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 27 Iter 117: loss 0.15435. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 27 Iter 118: loss 0.18569. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 27 Iter 118: loss 0.18569. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.16246. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 27 Iter 119: loss 0.16246. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.16281. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 27 Iter 120: loss 0.16281. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 27 Iter 121: loss 0.17475. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 27 Iter 121: loss 0.17475. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 27 Iter 122: loss 0.16617. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 27 Iter 122: loss 0.16617. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.17507. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 27 Iter 123: loss 0.17507. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 27 Iter 124: loss 0.16019. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 27 Iter 124: loss 0.16019. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 27 Iter 125: loss 0.16317. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 27 Iter 125: loss 0.16317. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 27 Iter 126: loss 0.17259. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 27 Iter 126: loss 0.17259. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 27 Iter 127: loss 0.18028. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 27 Iter 127: loss 0.18028. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 27 Iter 128: loss 0.17034. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 27 Iter 128: loss 0.17034. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 27 Iter 129: loss 0.16259. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 27 Iter 129: loss 0.16259. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 130: loss 0.17939. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 27 Iter 130: loss 0.17939. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.18724. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 27 Iter 131: loss 0.18724. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 27 Iter 132: loss 0.19893. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 27 Iter 132: loss 0.19893. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 27 Iter 133: loss 0.18347. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 27 Iter 133: loss 0.18347. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 134: loss 0.17663. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 134: loss 0.17663. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 27 Iter 135: loss 0.15642. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 27 Iter 135: loss 0.15642. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 136: loss 0.17016. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 27 Iter 136: loss 0.17016. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 27 Iter 137: loss 0.17689. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 27 Iter 137: loss 0.17689. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 27 Iter 138: loss 0.18056. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 27 Iter 138: loss 0.18056. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 27 Iter 139: loss 0.16344. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 27 Iter 139: loss 0.16344. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 27 Iter 140: loss 0.18682. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.05it/s]
Epoch 27 Iter 140: loss 0.18682. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.05it/s]
Epoch 27 Iter 141: loss 0.15869. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.05it/s]
Epoch 27 Iter 141: loss 0.15869. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 27 Iter 142: loss 0.17297. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 27 Iter 142: loss 0.17297. :  63%|███████████████████████████▎               | 142/224 [01:08<00:40,  2.05it/s]
Epoch 27 Iter 143: loss 0.19433. :  63%|███████████████████████████▎               | 142/224 [01:09<00:40,  2.05it/s]
Epoch 27 Iter 143: loss 0.19433. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.04it/s]
Epoch 27 Iter 144: loss 0.16555. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.04it/s]
Epoch 27 Iter 144: loss 0.16555. :  64%|███████████████████████████▋               | 144/224 [01:09<00:39,  2.05it/s]
Epoch 27 Iter 145: loss 0.19954. :  64%|███████████████████████████▋               | 144/224 [01:10<00:39,  2.05it/s]
Epoch 27 Iter 145: loss 0.19954. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 27 Iter 146: loss 0.17956. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 27 Iter 146: loss 0.17956. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 27 Iter 147: loss 0.18061. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 27 Iter 147: loss 0.18061. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 27 Iter 148: loss 0.16864. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 27 Iter 148: loss 0.16864. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.05it/s]
Epoch 27 Iter 149: loss 0.18202. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.05it/s]
Epoch 27 Iter 149: loss 0.18202. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 27 Iter 150: loss 0.16969. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 27 Iter 150: loss 0.16969. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.03it/s]
Epoch 27 Iter 151: loss 0.15586. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.03it/s]
Epoch 27 Iter 151: loss 0.15586. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 27 Iter 152: loss 0.18598. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 27 Iter 152: loss 0.18598. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 27 Iter 153: loss 0.17359. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 27 Iter 153: loss 0.17359. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 27 Iter 154: loss 0.18969. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 27 Iter 154: loss 0.18969. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.06it/s]
Epoch 27 Iter 155: loss 0.17869. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.06it/s]
Epoch 27 Iter 155: loss 0.17869. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 27 Iter 156: loss 0.19206. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 27 Iter 156: loss 0.19206. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 27 Iter 157: loss 0.15062. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 27 Iter 157: loss 0.15062. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 27 Iter 158: loss 0.17367. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 27 Iter 158: loss 0.17367. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 27 Iter 159: loss 0.15701. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 27 Iter 159: loss 0.15701. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 27 Iter 160: loss 0.17047. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 27 Iter 160: loss 0.17047. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 27 Iter 161: loss 0.17817. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 27 Iter 161: loss 0.17817. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 27 Iter 162: loss 0.17763. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 27 Iter 162: loss 0.17763. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 27 Iter 163: loss 0.17230. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 27 Iter 163: loss 0.17230. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 27 Iter 164: loss 0.18879. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 27 Iter 164: loss 0.18879. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 27 Iter 165: loss 0.20168. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 27 Iter 165: loss 0.20168. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.15469. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 27 Iter 166: loss 0.15469. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 27 Iter 167: loss 0.16848. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 27 Iter 167: loss 0.16848. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 27 Iter 168: loss 0.16552. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 27 Iter 168: loss 0.16552. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 27 Iter 169: loss 0.16116. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 27 Iter 169: loss 0.16116. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 27 Iter 170: loss 0.17131. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 27 Iter 170: loss 0.17131. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 27 Iter 171: loss 0.15187. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 27 Iter 171: loss 0.15187. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 27 Iter 172: loss 0.17598. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 27 Iter 172: loss 0.17598. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 173: loss 0.17771. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 27 Iter 173: loss 0.17771. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 27 Iter 174: loss 0.16967. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 174: loss 0.16967. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 175: loss 0.18422. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 27 Iter 175: loss 0.18422. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 27 Iter 176: loss 0.19541. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 27 Iter 176: loss 0.19541. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 27 Iter 177: loss 0.18707. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 27 Iter 177: loss 0.18707. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.09it/s]
Epoch 27 Iter 178: loss 0.18870. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.09it/s]
Epoch 27 Iter 178: loss 0.18870. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.18144. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 27 Iter 179: loss 0.18144. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 27 Iter 180: loss 0.19227. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 27 Iter 180: loss 0.19227. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 27 Iter 181: loss 0.16533. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 27 Iter 181: loss 0.16533. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 27 Iter 182: loss 0.17129. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 27 Iter 182: loss 0.17129. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 27 Iter 183: loss 0.17909. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 27 Iter 183: loss 0.17909. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 27 Iter 184: loss 0.14337. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.09it/s]
Epoch 27 Iter 184: loss 0.14337. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 27 Iter 185: loss 0.17415. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 27 Iter 185: loss 0.17415. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 27 Iter 186: loss 0.19321. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 27 Iter 186: loss 0.19321. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 27 Iter 187: loss 0.18517. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 27 Iter 187: loss 0.18517. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.18133. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 27 Iter 188: loss 0.18133. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 27 Iter 189: loss 0.17679. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 27 Iter 189: loss 0.17679. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 27 Iter 190: loss 0.17214. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 27 Iter 190: loss 0.17214. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 27 Iter 191: loss 0.14971. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 27 Iter 191: loss 0.14971. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 27 Iter 192: loss 0.16679. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.06it/s]
Epoch 27 Iter 192: loss 0.16679. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 27 Iter 193: loss 0.17807. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 27 Iter 193: loss 0.17807. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 27 Iter 194: loss 0.15851. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 27 Iter 194: loss 0.15851. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 27 Iter 195: loss 0.18930. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 27 Iter 195: loss 0.18930. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 27 Iter 196: loss 0.16855. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 27 Iter 196: loss 0.16855. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 27 Iter 197: loss 0.18564. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 27 Iter 197: loss 0.18564. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 27 Iter 198: loss 0.18212. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 27 Iter 198: loss 0.18212. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 27 Iter 199: loss 0.17014. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 27 Iter 199: loss 0.17014. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 27 Iter 200: loss 0.19431. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 27 Iter 200: loss 0.19431. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 27 Iter 201: loss 0.20136. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 27 Iter 201: loss 0.20136. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 27 Iter 202: loss 0.18754. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 27 Iter 202: loss 0.18754. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 27 Iter 203: loss 0.19066. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 27 Iter 203: loss 0.19066. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 204: loss 0.19715. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 27 Iter 204: loss 0.19715. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.18337. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 205: loss 0.18337. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 206: loss 0.17823. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 27 Iter 206: loss 0.17823. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.16501. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 207: loss 0.16501. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.17556. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 27 Iter 208: loss 0.17556. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.17805. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 209: loss 0.17805. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 210: loss 0.18342. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 27 Iter 210: loss 0.18342. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 27 Iter 211: loss 0.19807. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 27 Iter 211: loss 0.19807. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 27 Iter 212: loss 0.19730. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 27 Iter 212: loss 0.19730. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 27 Iter 213: loss 0.17874. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 27 Iter 213: loss 0.17874. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 27 Iter 214: loss 0.19988. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.10it/s]
Epoch 27 Iter 214: loss 0.19988. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.12it/s]
Epoch 27 Iter 215: loss 0.17745. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.12it/s]
Epoch 27 Iter 215: loss 0.17745. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.11it/s]
Epoch 27 Iter 216: loss 0.17682. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.11it/s]
Epoch 27 Iter 216: loss 0.17682. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.10it/s]
Epoch 27 Iter 217: loss 0.18075. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.10it/s]
Epoch 27 Iter 217: loss 0.18075. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.11it/s]
Epoch 27 Iter 218: loss 0.18070. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.11it/s]
Epoch 27 Iter 218: loss 0.18070. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.10it/s]
Epoch 27 Iter 219: loss 0.17350. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.10it/s]
Epoch 27 Iter 219: loss 0.17350. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 27 Iter 220: loss 0.17214. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 27 Iter 220: loss 0.17214. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 27 Iter 221: loss 0.19053. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 27 Iter 221: loss 0.19053. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 27 Iter 222: loss 0.19694. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 27 Iter 222: loss 0.19694. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 27 Iter 223: loss 0.16064. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 27 Iter 223: loss 0.16064. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 27 Iter 224: loss 0.17948. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 27 Iter 224: loss 0.17948. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 27 Iter 224: loss 0.17948. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17647
    Valid loss: 0.18008
       Valid loss recons: 0.17355
       Valid loss KL-D:   65.21879
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.16251. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 28 Iter 1: loss 0.16251. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 28 Iter 2: loss 0.17144. :   0%|▏                                              | 1/224 [00:00<01:47,  2.08it/s]
Epoch 28 Iter 2: loss 0.17144. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 28 Iter 3: loss 0.17606. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 28 Iter 3: loss 0.17606. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 28 Iter 4: loss 0.17562. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 28 Iter 4: loss 0.17562. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 28 Iter 5: loss 0.16307. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 28 Iter 5: loss 0.16307. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 28 Iter 6: loss 0.17519. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 28 Iter 6: loss 0.17519. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 28 Iter 7: loss 0.17095. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 28 Iter 7: loss 0.17095. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 28 Iter 8: loss 0.17589. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 28 Iter 8: loss 0.17589. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 28 Iter 9: loss 0.18098. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 28 Iter 9: loss 0.18098. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 28 Iter 10: loss 0.18602. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 28 Iter 10: loss 0.18602. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 28 Iter 11: loss 0.17842. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 28 Iter 11: loss 0.17842. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 28 Iter 12: loss 0.18495. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 28 Iter 12: loss 0.18495. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 28 Iter 13: loss 0.18404. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 28 Iter 13: loss 0.18404. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 14: loss 0.17415. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 14: loss 0.17415. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 28 Iter 15: loss 0.18374. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 28 Iter 15: loss 0.18374. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 28 Iter 16: loss 0.17099. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 28 Iter 16: loss 0.17099. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 28 Iter 17: loss 0.17183. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 28 Iter 17: loss 0.17183. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 28 Iter 18: loss 0.18179. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 28 Iter 18: loss 0.18179. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 28 Iter 19: loss 0.18484. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 28 Iter 19: loss 0.18484. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 28 Iter 20: loss 0.18580. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 28 Iter 20: loss 0.18580. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.16969. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 28 Iter 21: loss 0.16969. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 28 Iter 22: loss 0.18655. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 28 Iter 22: loss 0.18655. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.16607. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 23: loss 0.16607. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 24: loss 0.18126. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 28 Iter 24: loss 0.18126. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 28 Iter 25: loss 0.17894. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 25: loss 0.17894. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 26: loss 0.18398. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 28 Iter 26: loss 0.18398. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 28 Iter 27: loss 0.16174. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 28 Iter 27: loss 0.16174. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 28 Iter 28: loss 0.18358. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 28 Iter 28: loss 0.18358. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 28 Iter 29: loss 0.17071. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 28 Iter 29: loss 0.17071. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 28 Iter 30: loss 0.17916. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 28 Iter 30: loss 0.17916. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 28 Iter 31: loss 0.17674. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 28 Iter 31: loss 0.17674. :  14%|██████▏                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 28 Iter 32: loss 0.20483. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 28 Iter 32: loss 0.20483. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 28 Iter 33: loss 0.16456. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 28 Iter 33: loss 0.16456. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.08it/s]
Epoch 28 Iter 34: loss 0.16012. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 28 Iter 34: loss 0.16012. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.17172. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 28 Iter 35: loss 0.17172. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 28 Iter 36: loss 0.16571. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 28 Iter 36: loss 0.16571. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.16553. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 28 Iter 37: loss 0.16553. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 28 Iter 38: loss 0.18668. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 28 Iter 38: loss 0.18668. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.19109. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 28 Iter 39: loss 0.19109. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 28 Iter 40: loss 0.19356. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 28 Iter 40: loss 0.19356. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 28 Iter 41: loss 0.17402. :  18%|████████                                     | 40/224 [00:19<01:30,  2.04it/s]
Epoch 28 Iter 41: loss 0.17402. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 28 Iter 42: loss 0.16439. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 28 Iter 42: loss 0.16439. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.15635. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 28 Iter 43: loss 0.15635. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 28 Iter 44: loss 0.16817. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 44: loss 0.16817. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 45: loss 0.18514. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 28 Iter 45: loss 0.18514. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.18226. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 28 Iter 46: loss 0.18226. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 28 Iter 47: loss 0.15676. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 28 Iter 47: loss 0.15676. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.05it/s]
Epoch 28 Iter 48: loss 0.15252. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.05it/s]
Epoch 28 Iter 48: loss 0.15252. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 28 Iter 49: loss 0.16506. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 28 Iter 49: loss 0.16506. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.04it/s]
Epoch 28 Iter 50: loss 0.15731. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.04it/s]
Epoch 28 Iter 50: loss 0.15731. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 28 Iter 51: loss 0.17303. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 28 Iter 51: loss 0.17303. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.17817. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 28 Iter 52: loss 0.17817. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.15396. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 28 Iter 53: loss 0.15396. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 28 Iter 54: loss 0.17811. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 28 Iter 54: loss 0.17811. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 28 Iter 55: loss 0.17185. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 28 Iter 55: loss 0.17185. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.18390. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 56: loss 0.18390. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 57: loss 0.18593. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 28 Iter 57: loss 0.18593. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 28 Iter 58: loss 0.15736. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 28 Iter 58: loss 0.15736. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 28 Iter 59: loss 0.17511. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 28 Iter 59: loss 0.17511. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.16544. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 60: loss 0.16544. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 61: loss 0.19637. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 28 Iter 61: loss 0.19637. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.16619. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 28 Iter 62: loss 0.16619. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.19308. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 63: loss 0.19308. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.17175. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 28 Iter 64: loss 0.17175. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 28 Iter 65: loss 0.18718. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 28 Iter 65: loss 0.18718. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 28 Iter 66: loss 0.18216. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 28 Iter 66: loss 0.18216. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 28 Iter 67: loss 0.19564. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 28 Iter 67: loss 0.19564. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 28 Iter 68: loss 0.16702. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 28 Iter 68: loss 0.16702. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 28 Iter 69: loss 0.16036. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 28 Iter 69: loss 0.16036. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 70: loss 0.20088. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 28 Iter 70: loss 0.20088. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 28 Iter 71: loss 0.18257. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 28 Iter 71: loss 0.18257. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 28 Iter 72: loss 0.18161. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 28 Iter 72: loss 0.18161. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 28 Iter 73: loss 0.15116. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 28 Iter 73: loss 0.15116. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 28 Iter 74: loss 0.17105. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 28 Iter 74: loss 0.17105. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 28 Iter 75: loss 0.20731. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 75: loss 0.20731. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 76: loss 0.18907. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 28 Iter 76: loss 0.18907. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 28 Iter 77: loss 0.18553. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 28 Iter 77: loss 0.18553. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 28 Iter 78: loss 0.17088. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 28 Iter 78: loss 0.17088. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 28 Iter 79: loss 0.18698. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 28 Iter 79: loss 0.18698. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 28 Iter 80: loss 0.18568. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 28 Iter 80: loss 0.18568. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 28 Iter 81: loss 0.16118. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 28 Iter 81: loss 0.16118. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 28 Iter 82: loss 0.17171. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 28 Iter 82: loss 0.17171. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 28 Iter 83: loss 0.16569. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 83: loss 0.16569. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 84: loss 0.17280. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 84: loss 0.17280. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 28 Iter 85: loss 0.17407. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 28 Iter 85: loss 0.17407. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 28 Iter 86: loss 0.16376. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 28 Iter 86: loss 0.16376. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.04it/s]
Epoch 28 Iter 87: loss 0.17462. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 87: loss 0.17462. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 88: loss 0.19124. :  39%|█████████████████▍                           | 87/224 [00:42<01:07,  2.04it/s]
Epoch 28 Iter 88: loss 0.19124. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 28 Iter 89: loss 0.16783. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 28 Iter 89: loss 0.16783. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 28 Iter 90: loss 0.16880. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 28 Iter 90: loss 0.16880. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 28 Iter 91: loss 0.18434. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 28 Iter 91: loss 0.18434. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 92: loss 0.17979. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 92: loss 0.17979. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.16051. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 28 Iter 93: loss 0.16051. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.18738. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 94: loss 0.18738. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 28 Iter 95: loss 0.17677. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 28 Iter 95: loss 0.17677. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 28 Iter 96: loss 0.15973. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 28 Iter 96: loss 0.15973. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 28 Iter 97: loss 0.16549. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 28 Iter 97: loss 0.16549. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 98: loss 0.18413. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 98: loss 0.18413. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 28 Iter 99: loss 0.15771. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 28 Iter 99: loss 0.15771. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 28 Iter 100: loss 0.16386. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 28 Iter 100: loss 0.16386. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 28 Iter 101: loss 0.19663. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 28 Iter 101: loss 0.19663. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 28 Iter 102: loss 0.16080. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 28 Iter 102: loss 0.16080. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 28 Iter 103: loss 0.17083. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 28 Iter 103: loss 0.17083. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.18099. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 28 Iter 104: loss 0.18099. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 28 Iter 105: loss 0.19504. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 28 Iter 105: loss 0.19504. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.16566. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 28 Iter 106: loss 0.16566. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.17035. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 28 Iter 107: loss 0.17035. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 28 Iter 108: loss 0.15460. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 28 Iter 108: loss 0.15460. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 28 Iter 109: loss 0.18351. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 28 Iter 109: loss 0.18351. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 28 Iter 110: loss 0.16163. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 28 Iter 110: loss 0.16163. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 28 Iter 111: loss 0.17124. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 28 Iter 111: loss 0.17124. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 28 Iter 112: loss 0.19173. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 28 Iter 112: loss 0.19173. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 28 Iter 113: loss 0.17279. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 28 Iter 113: loss 0.17279. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 28 Iter 114: loss 0.16327. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 28 Iter 114: loss 0.16327. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 28 Iter 115: loss 0.17326. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 28 Iter 115: loss 0.17326. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 28 Iter 116: loss 0.16342. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 28 Iter 116: loss 0.16342. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 28 Iter 117: loss 0.17031. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 28 Iter 117: loss 0.17031. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 28 Iter 118: loss 0.16652. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 28 Iter 118: loss 0.16652. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 28 Iter 119: loss 0.16226. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 28 Iter 119: loss 0.16226. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 28 Iter 120: loss 0.18078. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 120: loss 0.18078. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 121: loss 0.16696. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 28 Iter 121: loss 0.16696. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 28 Iter 122: loss 0.19332. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 28 Iter 122: loss 0.19332. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.18021. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 28 Iter 123: loss 0.18021. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 28 Iter 124: loss 0.18767. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 28 Iter 124: loss 0.18767. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.16862. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 28 Iter 125: loss 0.16862. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.16989. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 126: loss 0.16989. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 127: loss 0.16226. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 28 Iter 127: loss 0.16226. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 28 Iter 128: loss 0.17028. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 28 Iter 128: loss 0.17028. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 28 Iter 129: loss 0.19785. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 28 Iter 129: loss 0.19785. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 28 Iter 130: loss 0.16514. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 28 Iter 130: loss 0.16514. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.08it/s]
Epoch 28 Iter 131: loss 0.17477. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 28 Iter 131: loss 0.17477. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 28 Iter 132: loss 0.15707. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 28 Iter 132: loss 0.15707. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.18063. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 28 Iter 133: loss 0.18063. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 28 Iter 134: loss 0.18615. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 28 Iter 134: loss 0.18615. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 28 Iter 135: loss 0.18405. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 28 Iter 135: loss 0.18405. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 28 Iter 136: loss 0.16192. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 28 Iter 136: loss 0.16192. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 28 Iter 137: loss 0.17349. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 28 Iter 137: loss 0.17349. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 28 Iter 138: loss 0.20197. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 28 Iter 138: loss 0.20197. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 28 Iter 139: loss 0.15221. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 28 Iter 139: loss 0.15221. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 28 Iter 140: loss 0.18364. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 28 Iter 140: loss 0.18364. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 28 Iter 141: loss 0.19776. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 141: loss 0.19776. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 142: loss 0.19216. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 28 Iter 142: loss 0.19216. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 28 Iter 143: loss 0.17027. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 28 Iter 143: loss 0.17027. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 28 Iter 144: loss 0.18604. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 28 Iter 144: loss 0.18604. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 28 Iter 145: loss 0.19517. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 28 Iter 145: loss 0.19517. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 28 Iter 146: loss 0.18289. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 28 Iter 146: loss 0.18289. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.18570. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 28 Iter 147: loss 0.18570. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 28 Iter 148: loss 0.18779. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 28 Iter 148: loss 0.18779. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 28 Iter 149: loss 0.16450. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 28 Iter 149: loss 0.16450. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 28 Iter 150: loss 0.17158. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 28 Iter 150: loss 0.17158. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 28 Iter 151: loss 0.19053. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 28 Iter 151: loss 0.19053. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 28 Iter 152: loss 0.16615. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 28 Iter 152: loss 0.16615. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 28 Iter 153: loss 0.16637. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 28 Iter 153: loss 0.16637. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 28 Iter 154: loss 0.19386. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 28 Iter 154: loss 0.19386. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 28 Iter 155: loss 0.18977. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 28 Iter 155: loss 0.18977. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 28 Iter 156: loss 0.16401. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:32,  2.10it/s]
Epoch 28 Iter 156: loss 0.16401. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 28 Iter 157: loss 0.15946. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.09it/s]
Epoch 28 Iter 157: loss 0.15946. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 28 Iter 158: loss 0.18571. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 28 Iter 158: loss 0.18571. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 28 Iter 159: loss 0.16567. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 28 Iter 159: loss 0.16567. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 28 Iter 160: loss 0.18981. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 28 Iter 160: loss 0.18981. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 28 Iter 161: loss 0.19120. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 28 Iter 161: loss 0.19120. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.09it/s]
Epoch 28 Iter 162: loss 0.17185. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.09it/s]
Epoch 28 Iter 162: loss 0.17185. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 28 Iter 163: loss 0.19025. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 28 Iter 163: loss 0.19025. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.08it/s]
Epoch 28 Iter 164: loss 0.19973. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 28 Iter 164: loss 0.19973. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 28 Iter 165: loss 0.16454. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 28 Iter 165: loss 0.16454. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.08it/s]
Epoch 28 Iter 166: loss 0.18052. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 28 Iter 166: loss 0.18052. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 28 Iter 167: loss 0.16641. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 28 Iter 167: loss 0.16641. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 28 Iter 168: loss 0.18564. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 28 Iter 168: loss 0.18564. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 28 Iter 169: loss 0.18473. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 28 Iter 169: loss 0.18473. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 28 Iter 170: loss 0.17302. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 28 Iter 170: loss 0.17302. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 28 Iter 171: loss 0.17277. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 28 Iter 171: loss 0.17277. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 28 Iter 172: loss 0.18454. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 28 Iter 172: loss 0.18454. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 28 Iter 173: loss 0.17454. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 28 Iter 173: loss 0.17454. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 28 Iter 174: loss 0.18228. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 28 Iter 174: loss 0.18228. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 28 Iter 175: loss 0.17481. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 28 Iter 175: loss 0.17481. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 28 Iter 176: loss 0.16939. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 28 Iter 176: loss 0.16939. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 28 Iter 177: loss 0.19552. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 28 Iter 177: loss 0.19552. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 28 Iter 178: loss 0.17578. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 28 Iter 178: loss 0.17578. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.09it/s]
Epoch 28 Iter 179: loss 0.18544. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.09it/s]
Epoch 28 Iter 179: loss 0.18544. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 28 Iter 180: loss 0.17586. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 28 Iter 180: loss 0.17586. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 28 Iter 181: loss 0.17603. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 28 Iter 181: loss 0.17603. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 28 Iter 182: loss 0.15505. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 28 Iter 182: loss 0.15505. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 28 Iter 183: loss 0.18876. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 28 Iter 183: loss 0.18876. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 28 Iter 184: loss 0.15842. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 28 Iter 184: loss 0.15842. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 28 Iter 185: loss 0.18454. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 28 Iter 185: loss 0.18454. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 28 Iter 186: loss 0.16762. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 28 Iter 186: loss 0.16762. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 28 Iter 187: loss 0.17419. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 28 Iter 187: loss 0.17419. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 28 Iter 188: loss 0.15802. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 188: loss 0.15802. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 28 Iter 189: loss 0.15895. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 28 Iter 189: loss 0.15895. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 190: loss 0.15778. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 28 Iter 190: loss 0.15778. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 28 Iter 191: loss 0.18347. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 28 Iter 191: loss 0.18347. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 28 Iter 192: loss 0.16506. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 28 Iter 192: loss 0.16506. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.05it/s]
Epoch 28 Iter 193: loss 0.19755. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 28 Iter 193: loss 0.19755. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 194: loss 0.17061. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 28 Iter 194: loss 0.17061. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.04it/s]
Epoch 28 Iter 195: loss 0.17951. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.04it/s]
Epoch 28 Iter 195: loss 0.17951. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 28 Iter 196: loss 0.17677. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 28 Iter 196: loss 0.17677. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 28 Iter 197: loss 0.16512. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 197: loss 0.16512. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 198: loss 0.19471. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 28 Iter 198: loss 0.19471. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 28 Iter 199: loss 0.17366. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 199: loss 0.17366. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 200: loss 0.16623. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 28 Iter 200: loss 0.16623. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 28 Iter 201: loss 0.16991. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 28 Iter 201: loss 0.16991. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 28 Iter 202: loss 0.19025. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 28 Iter 202: loss 0.19025. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 28 Iter 203: loss 0.18843. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 28 Iter 203: loss 0.18843. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 28 Iter 204: loss 0.17282. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 28 Iter 204: loss 0.17282. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 28 Iter 205: loss 0.18987. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 28 Iter 205: loss 0.18987. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 28 Iter 206: loss 0.18555. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 28 Iter 206: loss 0.18555. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 28 Iter 207: loss 0.17859. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 28 Iter 207: loss 0.17859. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 28 Iter 208: loss 0.18329. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.08it/s]
Epoch 28 Iter 208: loss 0.18329. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 28 Iter 209: loss 0.15204. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 28 Iter 209: loss 0.15204. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 28 Iter 210: loss 0.17432. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 28 Iter 210: loss 0.17432. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.17189. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 28 Iter 211: loss 0.17189. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.18892. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 28 Iter 212: loss 0.18892. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.16575. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 213: loss 0.16575. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 214: loss 0.20569. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 28 Iter 214: loss 0.20569. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 28 Iter 215: loss 0.18837. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 28 Iter 215: loss 0.18837. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 28 Iter 216: loss 0.17195. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 28 Iter 216: loss 0.17195. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 28 Iter 217: loss 0.17816. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 28 Iter 217: loss 0.17816. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 28 Iter 218: loss 0.18132. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.05it/s]
Epoch 28 Iter 218: loss 0.18132. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 28 Iter 219: loss 0.16318. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 28 Iter 219: loss 0.16318. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 28 Iter 220: loss 0.17463. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 28 Iter 220: loss 0.17463. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 28 Iter 221: loss 0.19007. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 28 Iter 221: loss 0.19007. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 28 Iter 222: loss 0.17183. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 28 Iter 222: loss 0.17183. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 28 Iter 223: loss 0.17151. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 28 Iter 223: loss 0.17151. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.18899. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.18899. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 28 Iter 224: loss 0.18899. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.18005. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 29 Iter 1: loss 0.18005. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 29 Iter 2: loss 0.16565. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 29 Iter 2: loss 0.16565. :   1%|▍                                              | 2/224 [00:00<01:46,  2.09it/s]
Epoch 29 Iter 3: loss 0.16108. :   1%|▍                                              | 2/224 [00:01<01:46,  2.09it/s]
Epoch 29 Iter 3: loss 0.16108. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 29 Iter 4: loss 0.16605. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 29 Iter 4: loss 0.16605. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 29 Iter 5: loss 0.20628. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 29 Iter 5: loss 0.20628. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 29 Iter 6: loss 0.16810. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 29 Iter 6: loss 0.16810. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 29 Iter 7: loss 0.18297. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 29 Iter 7: loss 0.18297. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 29 Iter 8: loss 0.20453. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 29 Iter 8: loss 0.20453. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 29 Iter 9: loss 0.18051. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 9: loss 0.18051. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 10: loss 0.16446. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 29 Iter 10: loss 0.16446. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.17716. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 29 Iter 11: loss 0.17716. :   5%|██▏                                          | 11/224 [00:05<01:45,  2.02it/s]
Epoch 29 Iter 12: loss 0.18313. :   5%|██▏                                          | 11/224 [00:05<01:45,  2.02it/s]
Epoch 29 Iter 12: loss 0.18313. :   5%|██▍                                          | 12/224 [00:05<01:44,  2.03it/s]
Epoch 29 Iter 13: loss 0.17340. :   5%|██▍                                          | 12/224 [00:06<01:44,  2.03it/s]
Epoch 29 Iter 13: loss 0.17340. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.03it/s]
Epoch 29 Iter 14: loss 0.20599. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.03it/s]
Epoch 29 Iter 14: loss 0.20599. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 29 Iter 15: loss 0.16332. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 29 Iter 15: loss 0.16332. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 29 Iter 16: loss 0.17920. :   7%|███                                          | 15/224 [00:07<01:42,  2.04it/s]
Epoch 29 Iter 16: loss 0.17920. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.03it/s]
Epoch 29 Iter 17: loss 0.16476. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.03it/s]
Epoch 29 Iter 17: loss 0.16476. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 29 Iter 18: loss 0.18136. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 29 Iter 18: loss 0.18136. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 29 Iter 19: loss 0.17941. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 29 Iter 19: loss 0.17941. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 29 Iter 20: loss 0.19397. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 29 Iter 20: loss 0.19397. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 29 Iter 21: loss 0.15924. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 29 Iter 21: loss 0.15924. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 22: loss 0.16817. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 22: loss 0.16817. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 29 Iter 23: loss 0.18727. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 29 Iter 23: loss 0.18727. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.18169. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 24: loss 0.18169. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 29 Iter 25: loss 0.16652. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 29 Iter 25: loss 0.16652. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.17944. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 29 Iter 26: loss 0.17944. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 29 Iter 27: loss 0.14654. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 29 Iter 27: loss 0.14654. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 29 Iter 28: loss 0.16587. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 29 Iter 28: loss 0.16587. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 29 Iter 29: loss 0.16861. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 29 Iter 29: loss 0.16861. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 29 Iter 30: loss 0.16555. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 29 Iter 30: loss 0.16555. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 29 Iter 31: loss 0.18656. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 29 Iter 31: loss 0.18656. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 29 Iter 32: loss 0.16571. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 29 Iter 32: loss 0.16571. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 29 Iter 33: loss 0.16634. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.08it/s]
Epoch 29 Iter 33: loss 0.16634. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 29 Iter 34: loss 0.20633. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 29 Iter 34: loss 0.20633. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 29 Iter 35: loss 0.17375. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 29 Iter 35: loss 0.17375. :  16%|███████                                      | 35/224 [00:16<01:29,  2.11it/s]
Epoch 29 Iter 36: loss 0.17607. :  16%|███████                                      | 35/224 [00:17<01:29,  2.11it/s]
Epoch 29 Iter 36: loss 0.17607. :  16%|███████▏                                     | 36/224 [00:17<01:29,  2.10it/s]
Epoch 29 Iter 37: loss 0.16263. :  16%|███████▏                                     | 36/224 [00:17<01:29,  2.10it/s]
Epoch 29 Iter 37: loss 0.16263. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.10it/s]
Epoch 29 Iter 38: loss 0.19095. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.10it/s]
Epoch 29 Iter 38: loss 0.19095. :  17%|███████▋                                     | 38/224 [00:18<01:28,  2.11it/s]
Epoch 29 Iter 39: loss 0.19956. :  17%|███████▋                                     | 38/224 [00:18<01:28,  2.11it/s]
Epoch 29 Iter 39: loss 0.19956. :  17%|███████▊                                     | 39/224 [00:18<01:27,  2.12it/s]
Epoch 29 Iter 40: loss 0.16647. :  17%|███████▊                                     | 39/224 [00:19<01:27,  2.12it/s]
Epoch 29 Iter 40: loss 0.16647. :  18%|████████                                     | 40/224 [00:19<01:27,  2.09it/s]
Epoch 29 Iter 41: loss 0.15338. :  18%|████████                                     | 40/224 [00:19<01:27,  2.09it/s]
Epoch 29 Iter 41: loss 0.15338. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.09it/s]
Epoch 29 Iter 42: loss 0.18130. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.09it/s]
Epoch 29 Iter 42: loss 0.18130. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 29 Iter 43: loss 0.17614. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 29 Iter 43: loss 0.17614. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 29 Iter 44: loss 0.17666. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 29 Iter 44: loss 0.17666. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.09it/s]
Epoch 29 Iter 45: loss 0.16751. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.09it/s]
Epoch 29 Iter 45: loss 0.16751. :  20%|█████████                                    | 45/224 [00:21<01:25,  2.09it/s]
Epoch 29 Iter 46: loss 0.18727. :  20%|█████████                                    | 45/224 [00:22<01:25,  2.09it/s]
Epoch 29 Iter 46: loss 0.18727. :  21%|█████████▏                                   | 46/224 [00:22<01:24,  2.10it/s]
Epoch 29 Iter 47: loss 0.16482. :  21%|█████████▏                                   | 46/224 [00:22<01:24,  2.10it/s]
Epoch 29 Iter 47: loss 0.16482. :  21%|█████████▍                                   | 47/224 [00:22<01:24,  2.11it/s]
Epoch 29 Iter 48: loss 0.17689. :  21%|█████████▍                                   | 47/224 [00:23<01:24,  2.11it/s]
Epoch 29 Iter 48: loss 0.17689. :  21%|█████████▋                                   | 48/224 [00:23<01:23,  2.12it/s]
Epoch 29 Iter 49: loss 0.17767. :  21%|█████████▋                                   | 48/224 [00:23<01:23,  2.12it/s]
Epoch 29 Iter 49: loss 0.17767. :  22%|█████████▊                                   | 49/224 [00:23<01:23,  2.11it/s]
Epoch 29 Iter 50: loss 0.16334. :  22%|█████████▊                                   | 49/224 [00:24<01:23,  2.11it/s]
Epoch 29 Iter 50: loss 0.16334. :  22%|██████████                                   | 50/224 [00:24<01:22,  2.11it/s]
Epoch 29 Iter 51: loss 0.16346. :  22%|██████████                                   | 50/224 [00:24<01:22,  2.11it/s]
Epoch 29 Iter 51: loss 0.16346. :  23%|██████████▏                                  | 51/224 [00:24<01:22,  2.08it/s]
Epoch 29 Iter 52: loss 0.15814. :  23%|██████████▏                                  | 51/224 [00:25<01:22,  2.08it/s]
Epoch 29 Iter 52: loss 0.15814. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.09it/s]
Epoch 29 Iter 53: loss 0.16184. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.09it/s]
Epoch 29 Iter 53: loss 0.16184. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 29 Iter 54: loss 0.19452. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 29 Iter 54: loss 0.19452. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 29 Iter 55: loss 0.17925. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 29 Iter 55: loss 0.17925. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 29 Iter 56: loss 0.17550. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 29 Iter 56: loss 0.17550. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.09it/s]
Epoch 29 Iter 57: loss 0.17380. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.09it/s]
Epoch 29 Iter 57: loss 0.17380. :  25%|███████████▍                                 | 57/224 [00:27<01:19,  2.09it/s]
Epoch 29 Iter 58: loss 0.16544. :  25%|███████████▍                                 | 57/224 [00:27<01:19,  2.09it/s]
Epoch 29 Iter 58: loss 0.16544. :  26%|███████████▋                                 | 58/224 [00:27<01:19,  2.09it/s]
Epoch 29 Iter 59: loss 0.17181. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.09it/s]
Epoch 29 Iter 59: loss 0.17181. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 29 Iter 60: loss 0.17022. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 29 Iter 60: loss 0.17022. :  27%|████████████                                 | 60/224 [00:28<01:19,  2.06it/s]
Epoch 29 Iter 61: loss 0.17126. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 29 Iter 61: loss 0.17126. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 29 Iter 62: loss 0.19794. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 29 Iter 62: loss 0.19794. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.07it/s]
Epoch 29 Iter 63: loss 0.16311. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 29 Iter 63: loss 0.16311. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 29 Iter 64: loss 0.18042. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 29 Iter 64: loss 0.18042. :  29%|████████████▊                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 29 Iter 65: loss 0.19216. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 29 Iter 65: loss 0.19216. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 29 Iter 66: loss 0.17337. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 29 Iter 66: loss 0.17337. :  29%|█████████████▎                               | 66/224 [00:31<01:15,  2.09it/s]
Epoch 29 Iter 67: loss 0.18256. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.09it/s]
Epoch 29 Iter 67: loss 0.18256. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 29 Iter 68: loss 0.16870. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.08it/s]
Epoch 29 Iter 68: loss 0.16870. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 29 Iter 69: loss 0.17940. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 29 Iter 69: loss 0.17940. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 29 Iter 70: loss 0.16779. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 29 Iter 70: loss 0.16779. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 29 Iter 71: loss 0.17172. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 29 Iter 71: loss 0.17172. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 29 Iter 72: loss 0.17389. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 29 Iter 72: loss 0.17389. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 29 Iter 73: loss 0.16792. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 29 Iter 73: loss 0.16792. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 29 Iter 74: loss 0.18049. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 29 Iter 74: loss 0.18049. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 29 Iter 75: loss 0.15386. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 29 Iter 75: loss 0.15386. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 29 Iter 76: loss 0.16335. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 29 Iter 76: loss 0.16335. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 29 Iter 77: loss 0.19220. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 29 Iter 77: loss 0.19220. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 29 Iter 78: loss 0.19204. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 29 Iter 78: loss 0.19204. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 29 Iter 79: loss 0.17150. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 29 Iter 79: loss 0.17150. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.10it/s]
Epoch 29 Iter 80: loss 0.16795. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.10it/s]
Epoch 29 Iter 80: loss 0.16795. :  36%|████████████████                             | 80/224 [00:38<01:08,  2.10it/s]
Epoch 29 Iter 81: loss 0.20000. :  36%|████████████████                             | 80/224 [00:39<01:08,  2.10it/s]
Epoch 29 Iter 81: loss 0.20000. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.09it/s]
Epoch 29 Iter 82: loss 0.17042. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.09it/s]
Epoch 29 Iter 82: loss 0.17042. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 29 Iter 83: loss 0.16816. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 29 Iter 83: loss 0.16816. :  37%|████████████████▋                            | 83/224 [00:39<01:07,  2.09it/s]
Epoch 29 Iter 84: loss 0.17236. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.09it/s]
Epoch 29 Iter 84: loss 0.17236. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.08it/s]
Epoch 29 Iter 85: loss 0.17190. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.08it/s]
Epoch 29 Iter 85: loss 0.17190. :  38%|█████████████████                            | 85/224 [00:40<01:06,  2.08it/s]
Epoch 29 Iter 86: loss 0.16706. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 29 Iter 86: loss 0.16706. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 29 Iter 87: loss 0.17950. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 29 Iter 87: loss 0.17950. :  39%|█████████████████▍                           | 87/224 [00:41<01:05,  2.08it/s]
Epoch 29 Iter 88: loss 0.16491. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 29 Iter 88: loss 0.16491. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 29 Iter 89: loss 0.17928. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 29 Iter 89: loss 0.17928. :  40%|█████████████████▉                           | 89/224 [00:42<01:05,  2.07it/s]
Epoch 29 Iter 90: loss 0.17838. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 29 Iter 90: loss 0.17838. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 29 Iter 91: loss 0.16265. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 29 Iter 91: loss 0.16265. :  41%|██████████████████▎                          | 91/224 [00:43<01:04,  2.08it/s]
Epoch 29 Iter 92: loss 0.16083. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.08it/s]
Epoch 29 Iter 92: loss 0.16083. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 29 Iter 93: loss 0.15822. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 29 Iter 93: loss 0.15822. :  42%|██████████████████▋                          | 93/224 [00:44<01:03,  2.07it/s]
Epoch 29 Iter 94: loss 0.17724. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 29 Iter 94: loss 0.17724. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 29 Iter 95: loss 0.15810. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 29 Iter 95: loss 0.15810. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.08it/s]
Epoch 29 Iter 96: loss 0.17812. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 29 Iter 96: loss 0.17812. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 29 Iter 97: loss 0.17307. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 29 Iter 97: loss 0.17307. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.07it/s]
Epoch 29 Iter 98: loss 0.17049. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 29 Iter 98: loss 0.17049. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 99: loss 0.17548. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 99: loss 0.17548. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 29 Iter 100: loss 0.18259. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 29 Iter 100: loss 0.18259. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 101: loss 0.17576. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 101: loss 0.17576. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 29 Iter 102: loss 0.19871. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 29 Iter 102: loss 0.19871. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 29 Iter 103: loss 0.20718. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 29 Iter 103: loss 0.20718. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 29 Iter 104: loss 0.18707. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 29 Iter 104: loss 0.18707. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 29 Iter 105: loss 0.17637. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 29 Iter 105: loss 0.17637. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 29 Iter 106: loss 0.17099. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 29 Iter 106: loss 0.17099. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 29 Iter 107: loss 0.17797. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 29 Iter 107: loss 0.17797. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.09it/s]
Epoch 29 Iter 108: loss 0.19214. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 29 Iter 108: loss 0.19214. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 29 Iter 109: loss 0.17117. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.09it/s]
Epoch 29 Iter 109: loss 0.17117. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 29 Iter 110: loss 0.18718. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 29 Iter 110: loss 0.18718. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 29 Iter 111: loss 0.16256. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 29 Iter 111: loss 0.16256. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 29 Iter 112: loss 0.16843. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 29 Iter 112: loss 0.16843. :  50%|█████████████████████▌                     | 112/224 [00:53<00:54,  2.05it/s]
Epoch 29 Iter 113: loss 0.16407. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 29 Iter 113: loss 0.16407. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 29 Iter 114: loss 0.17170. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 29 Iter 114: loss 0.17170. :  51%|█████████████████████▉                     | 114/224 [00:54<00:53,  2.05it/s]
Epoch 29 Iter 115: loss 0.17316. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 29 Iter 115: loss 0.17316. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 29 Iter 116: loss 0.18812. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 29 Iter 116: loss 0.18812. :  52%|██████████████████████▎                    | 116/224 [00:55<00:52,  2.05it/s]
Epoch 29 Iter 117: loss 0.17529. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 29 Iter 117: loss 0.17529. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 118: loss 0.18287. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 29 Iter 118: loss 0.18287. :  53%|██████████████████████▋                    | 118/224 [00:56<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.17758. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 29 Iter 119: loss 0.17758. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.03it/s]
Epoch 29 Iter 120: loss 0.17292. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.03it/s]
Epoch 29 Iter 120: loss 0.17292. :  54%|███████████████████████                    | 120/224 [00:57<00:50,  2.04it/s]
Epoch 29 Iter 121: loss 0.16442. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.04it/s]
Epoch 29 Iter 121: loss 0.16442. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.04it/s]
Epoch 29 Iter 122: loss 0.19278. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.04it/s]
Epoch 29 Iter 122: loss 0.19278. :  54%|███████████████████████▍                   | 122/224 [00:58<00:49,  2.05it/s]
Epoch 29 Iter 123: loss 0.15915. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 29 Iter 123: loss 0.15915. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 29 Iter 124: loss 0.17426. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 29 Iter 124: loss 0.17426. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.06it/s]
Epoch 29 Iter 125: loss 0.18766. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 29 Iter 125: loss 0.18766. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.04it/s]
Epoch 29 Iter 126: loss 0.19328. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.04it/s]
Epoch 29 Iter 126: loss 0.19328. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 29 Iter 127: loss 0.18463. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 29 Iter 127: loss 0.18463. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.16196. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 29 Iter 128: loss 0.16196. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 29 Iter 129: loss 0.18130. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 29 Iter 129: loss 0.18130. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 29 Iter 130: loss 0.17377. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 29 Iter 130: loss 0.17377. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 29 Iter 131: loss 0.16738. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 29 Iter 131: loss 0.16738. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 29 Iter 132: loss 0.17347. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.04it/s]
Epoch 29 Iter 132: loss 0.17347. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 29 Iter 133: loss 0.17245. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 29 Iter 133: loss 0.17245. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 29 Iter 134: loss 0.19048. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 29 Iter 134: loss 0.19048. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.17073. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 29 Iter 135: loss 0.17073. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 29 Iter 136: loss 0.16719. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 29 Iter 136: loss 0.16719. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.08it/s]
Epoch 29 Iter 137: loss 0.15572. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 29 Iter 137: loss 0.15572. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 29 Iter 138: loss 0.18155. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 29 Iter 138: loss 0.18155. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.09it/s]
Epoch 29 Iter 139: loss 0.18483. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.09it/s]
Epoch 29 Iter 139: loss 0.18483. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 29 Iter 140: loss 0.17041. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.10it/s]
Epoch 29 Iter 140: loss 0.17041. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.09it/s]
Epoch 29 Iter 141: loss 0.17780. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.09it/s]
Epoch 29 Iter 141: loss 0.17780. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 142: loss 0.18115. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 142: loss 0.18115. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 29 Iter 143: loss 0.17325. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 29 Iter 143: loss 0.17325. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 29 Iter 144: loss 0.16486. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 29 Iter 144: loss 0.16486. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 29 Iter 145: loss 0.16366. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 29 Iter 145: loss 0.16366. :  65%|███████████████████████████▊               | 145/224 [01:09<00:37,  2.10it/s]
Epoch 29 Iter 146: loss 0.17641. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.10it/s]
Epoch 29 Iter 146: loss 0.17641. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.10it/s]
Epoch 29 Iter 147: loss 0.17205. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.10it/s]
Epoch 29 Iter 147: loss 0.17205. :  66%|████████████████████████████▏              | 147/224 [01:10<00:36,  2.09it/s]
Epoch 29 Iter 148: loss 0.15239. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.09it/s]
Epoch 29 Iter 148: loss 0.15239. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 29 Iter 149: loss 0.15431. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 29 Iter 149: loss 0.15431. :  67%|████████████████████████████▌              | 149/224 [01:11<00:36,  2.07it/s]
Epoch 29 Iter 150: loss 0.16479. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 29 Iter 150: loss 0.16479. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 29 Iter 151: loss 0.17890. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 29 Iter 151: loss 0.17890. :  67%|████████████████████████████▉              | 151/224 [01:12<00:35,  2.06it/s]
Epoch 29 Iter 152: loss 0.18878. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 29 Iter 152: loss 0.18878. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 29 Iter 153: loss 0.19363. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 29 Iter 153: loss 0.19363. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.06it/s]
Epoch 29 Iter 154: loss 0.15809. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 29 Iter 154: loss 0.15809. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 29 Iter 155: loss 0.18300. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 29 Iter 155: loss 0.18300. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 29 Iter 156: loss 0.18620. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 29 Iter 156: loss 0.18620. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 29 Iter 157: loss 0.16644. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 29 Iter 157: loss 0.16644. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.05it/s]
Epoch 29 Iter 158: loss 0.18399. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 158: loss 0.18399. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.17400. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 29 Iter 159: loss 0.17400. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.18120. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 160: loss 0.18120. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 161: loss 0.19495. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 29 Iter 161: loss 0.19495. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.06it/s]
Epoch 29 Iter 162: loss 0.15248. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 29 Iter 162: loss 0.15248. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 29 Iter 163: loss 0.19610. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.05it/s]
Epoch 29 Iter 163: loss 0.19610. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 29 Iter 164: loss 0.18558. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 29 Iter 164: loss 0.18558. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 29 Iter 165: loss 0.17303. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 29 Iter 165: loss 0.17303. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.18087. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 166: loss 0.18087. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 167: loss 0.15355. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 29 Iter 167: loss 0.15355. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.17658. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 168: loss 0.17658. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.18321. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 29 Iter 169: loss 0.18321. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 29 Iter 170: loss 0.16574. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 29 Iter 170: loss 0.16574. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 29 Iter 171: loss 0.17004. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.04it/s]
Epoch 29 Iter 171: loss 0.17004. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.05it/s]
Epoch 29 Iter 172: loss 0.17764. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.05it/s]
Epoch 29 Iter 172: loss 0.17764. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 173: loss 0.17394. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 29 Iter 173: loss 0.17394. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 29 Iter 174: loss 0.17659. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 29 Iter 174: loss 0.17659. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 29 Iter 175: loss 0.17947. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 29 Iter 175: loss 0.17947. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 29 Iter 176: loss 0.18843. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 29 Iter 176: loss 0.18843. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 29 Iter 177: loss 0.17239. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 29 Iter 177: loss 0.17239. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 29 Iter 178: loss 0.16405. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 29 Iter 178: loss 0.16405. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.03it/s]
Epoch 29 Iter 179: loss 0.19191. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.03it/s]
Epoch 29 Iter 179: loss 0.19191. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:22,  2.04it/s]
Epoch 29 Iter 180: loss 0.15942. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:22,  2.04it/s]
Epoch 29 Iter 180: loss 0.15942. :  80%|██████████████████████████████████▌        | 180/224 [01:26<00:21,  2.06it/s]
Epoch 29 Iter 181: loss 0.16850. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 29 Iter 181: loss 0.16850. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 29 Iter 182: loss 0.18526. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 29 Iter 182: loss 0.18526. :  81%|██████████████████████████████████▉        | 182/224 [01:27<00:20,  2.06it/s]
Epoch 29 Iter 183: loss 0.18002. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 29 Iter 183: loss 0.18002. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 29 Iter 184: loss 0.18555. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 29 Iter 184: loss 0.18555. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.07it/s]
Epoch 29 Iter 185: loss 0.17239. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 29 Iter 185: loss 0.17239. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 29 Iter 186: loss 0.16456. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 29 Iter 186: loss 0.16456. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 29 Iter 187: loss 0.18652. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 29 Iter 187: loss 0.18652. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 29 Iter 188: loss 0.17532. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 29 Iter 188: loss 0.17532. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 29 Iter 189: loss 0.18172. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 29 Iter 189: loss 0.18172. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 29 Iter 190: loss 0.14999. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 29 Iter 190: loss 0.14999. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 29 Iter 191: loss 0.16943. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 29 Iter 191: loss 0.16943. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 192: loss 0.18307. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 29 Iter 192: loss 0.18307. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.08it/s]
Epoch 29 Iter 193: loss 0.18615. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 29 Iter 193: loss 0.18615. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 29 Iter 194: loss 0.18912. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 29 Iter 194: loss 0.18912. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 29 Iter 195: loss 0.19393. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 29 Iter 195: loss 0.19393. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 29 Iter 196: loss 0.16938. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 29 Iter 196: loss 0.16938. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.17070. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 29 Iter 197: loss 0.17070. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 29 Iter 198: loss 0.16896. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 29 Iter 198: loss 0.16896. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.17390. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 199: loss 0.17390. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 200: loss 0.18405. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 29 Iter 200: loss 0.18405. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 29 Iter 201: loss 0.16883. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 29 Iter 201: loss 0.16883. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 29 Iter 202: loss 0.18192. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 29 Iter 202: loss 0.18192. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 29 Iter 203: loss 0.18533. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 29 Iter 203: loss 0.18533. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 29 Iter 204: loss 0.16535. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 29 Iter 204: loss 0.16535. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 29 Iter 205: loss 0.16697. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 29 Iter 205: loss 0.16697. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 29 Iter 206: loss 0.17206. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 29 Iter 206: loss 0.17206. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 29 Iter 207: loss 0.18446. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 29 Iter 207: loss 0.18446. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.18193. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.05it/s]
Epoch 29 Iter 208: loss 0.18193. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.20014. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 29 Iter 209: loss 0.20014. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 29 Iter 210: loss 0.17938. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 29 Iter 210: loss 0.17938. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.15895. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 29 Iter 211: loss 0.15895. :  94%|████████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.06it/s]
Epoch 29 Iter 212: loss 0.21271. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 29 Iter 212: loss 0.21271. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 29 Iter 213: loss 0.19772. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 29 Iter 213: loss 0.19772. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.18981. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 29 Iter 214: loss 0.18981. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 29 Iter 215: loss 0.17325. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 29 Iter 215: loss 0.17325. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.07it/s]
Epoch 29 Iter 216: loss 0.17292. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 29 Iter 216: loss 0.17292. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 29 Iter 217: loss 0.17713. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 29 Iter 217: loss 0.17713. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.09it/s]
Epoch 29 Iter 218: loss 0.18481. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.09it/s]
Epoch 29 Iter 218: loss 0.18481. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 29 Iter 219: loss 0.17867. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 29 Iter 219: loss 0.17867. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.09it/s]
Epoch 29 Iter 220: loss 0.18089. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.09it/s]
Epoch 29 Iter 220: loss 0.18089. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.10it/s]
Epoch 29 Iter 221: loss 0.17240. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.10it/s]
Epoch 29 Iter 221: loss 0.17240. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 29 Iter 222: loss 0.19494. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 29 Iter 222: loss 0.19494. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 29 Iter 223: loss 0.16240. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 29 Iter 223: loss 0.16240. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.08it/s]
Epoch 29 Iter 224: loss 0.19405. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 29 Iter 224: loss 0.19405. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 29 Iter 224: loss 0.19405. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17598
    Valid loss: 0.17988
       Valid loss recons: 0.17338
       Valid loss KL-D:   65.0745
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.15916. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 30 Iter 1: loss 0.15916. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 30 Iter 2: loss 0.15911. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 30 Iter 2: loss 0.15911. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 30 Iter 3: loss 0.17963. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 30 Iter 3: loss 0.17963. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 30 Iter 4: loss 0.18732. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 30 Iter 4: loss 0.18732. :   2%|▊                                              | 4/224 [00:01<01:45,  2.09it/s]
Epoch 30 Iter 5: loss 0.17965. :   2%|▊                                              | 4/224 [00:02<01:45,  2.09it/s]
Epoch 30 Iter 5: loss 0.17965. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 30 Iter 6: loss 0.17000. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 30 Iter 6: loss 0.17000. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 30 Iter 7: loss 0.18603. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 30 Iter 7: loss 0.18603. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.10it/s]
Epoch 30 Iter 8: loss 0.16400. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.10it/s]
Epoch 30 Iter 8: loss 0.16400. :   4%|█▋                                             | 8/224 [00:03<01:42,  2.12it/s]
Epoch 30 Iter 9: loss 0.18112. :   4%|█▋                                             | 8/224 [00:04<01:42,  2.12it/s]
Epoch 30 Iter 9: loss 0.18112. :   4%|█▉                                             | 9/224 [00:04<01:42,  2.11it/s]
Epoch 30 Iter 10: loss 0.18743. :   4%|█▊                                            | 9/224 [00:04<01:42,  2.11it/s]
Epoch 30 Iter 10: loss 0.18743. :   4%|██                                           | 10/224 [00:04<01:42,  2.09it/s]
Epoch 30 Iter 11: loss 0.16251. :   4%|██                                           | 10/224 [00:05<01:42,  2.09it/s]
Epoch 30 Iter 11: loss 0.16251. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 30 Iter 12: loss 0.15931. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 30 Iter 12: loss 0.15931. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.09it/s]
Epoch 30 Iter 13: loss 0.18175. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.09it/s]
Epoch 30 Iter 13: loss 0.18175. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.09it/s]
Epoch 30 Iter 14: loss 0.16947. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.09it/s]
Epoch 30 Iter 14: loss 0.16947. :   6%|██▊                                          | 14/224 [00:06<01:40,  2.08it/s]
Epoch 30 Iter 15: loss 0.16380. :   6%|██▊                                          | 14/224 [00:07<01:40,  2.08it/s]
Epoch 30 Iter 15: loss 0.16380. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 16: loss 0.19070. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 16: loss 0.19070. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 30 Iter 17: loss 0.16747. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 30 Iter 17: loss 0.16747. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 30 Iter 18: loss 0.17383. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 30 Iter 18: loss 0.17383. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 30 Iter 19: loss 0.16640. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 30 Iter 19: loss 0.16640. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 30 Iter 20: loss 0.17005. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 30 Iter 20: loss 0.17005. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 30 Iter 21: loss 0.18153. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 30 Iter 21: loss 0.18153. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 30 Iter 22: loss 0.17241. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 30 Iter 22: loss 0.17241. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 30 Iter 23: loss 0.18420. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 30 Iter 23: loss 0.18420. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.15245. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 30 Iter 24: loss 0.15245. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.17920. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 25: loss 0.17920. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 26: loss 0.17527. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 30 Iter 26: loss 0.17527. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 30 Iter 27: loss 0.18785. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 30 Iter 27: loss 0.18785. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 28: loss 0.18596. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 28: loss 0.18596. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 29: loss 0.18400. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 30 Iter 29: loss 0.18400. :  13%|█████▊                                       | 29/224 [00:13<01:34,  2.06it/s]
Epoch 30 Iter 30: loss 0.17288. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 30: loss 0.17288. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 31: loss 0.18528. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 30 Iter 31: loss 0.18528. :  14%|██████▏                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.16077. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 32: loss 0.16077. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 33: loss 0.18549. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 30 Iter 33: loss 0.18549. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.08it/s]
Epoch 30 Iter 34: loss 0.17154. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 30 Iter 34: loss 0.17154. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 30 Iter 35: loss 0.16740. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 30 Iter 35: loss 0.16740. :  16%|███████                                      | 35/224 [00:16<01:30,  2.09it/s]
Epoch 30 Iter 36: loss 0.17966. :  16%|███████                                      | 35/224 [00:17<01:30,  2.09it/s]
Epoch 30 Iter 36: loss 0.17966. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 30 Iter 37: loss 0.20406. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 30 Iter 37: loss 0.20406. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 30 Iter 38: loss 0.18281. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 30 Iter 38: loss 0.18281. :  17%|███████▋                                     | 38/224 [00:18<01:28,  2.09it/s]
Epoch 30 Iter 39: loss 0.17614. :  17%|███████▋                                     | 38/224 [00:18<01:28,  2.09it/s]
Epoch 30 Iter 39: loss 0.17614. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 30 Iter 40: loss 0.18186. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 30 Iter 40: loss 0.18186. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 30 Iter 41: loss 0.16942. :  18%|████████                                     | 40/224 [00:19<01:28,  2.07it/s]
Epoch 30 Iter 41: loss 0.16942. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 30 Iter 42: loss 0.16232. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 30 Iter 42: loss 0.16232. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 30 Iter 43: loss 0.16963. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 30 Iter 43: loss 0.16963. :  19%|████████▋                                    | 43/224 [00:20<01:29,  2.02it/s]
Epoch 30 Iter 44: loss 0.17916. :  19%|████████▋                                    | 43/224 [00:21<01:29,  2.02it/s]
Epoch 30 Iter 44: loss 0.17916. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.03it/s]
Epoch 30 Iter 45: loss 0.17263. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.03it/s]
Epoch 30 Iter 45: loss 0.17263. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 30 Iter 46: loss 0.19421. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 30 Iter 46: loss 0.19421. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 30 Iter 47: loss 0.16631. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 30 Iter 47: loss 0.16631. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 30 Iter 48: loss 0.17373. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 30 Iter 48: loss 0.17373. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 30 Iter 49: loss 0.17308. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 30 Iter 49: loss 0.17308. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 30 Iter 50: loss 0.16664. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 30 Iter 50: loss 0.16664. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 30 Iter 51: loss 0.17398. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 30 Iter 51: loss 0.17398. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.17125. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 30 Iter 52: loss 0.17125. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 30 Iter 53: loss 0.18054. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 30 Iter 53: loss 0.18054. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.04it/s]
Epoch 30 Iter 54: loss 0.15715. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.04it/s]
Epoch 30 Iter 54: loss 0.15715. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 30 Iter 55: loss 0.15627. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.05it/s]
Epoch 30 Iter 55: loss 0.15627. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 30 Iter 56: loss 0.19738. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 30 Iter 56: loss 0.19738. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 30 Iter 57: loss 0.16960. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 30 Iter 57: loss 0.16960. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.19335. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 30 Iter 58: loss 0.19335. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.18274. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 59: loss 0.18274. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 60: loss 0.17494. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 30 Iter 60: loss 0.17494. :  27%|████████████                                 | 60/224 [00:28<01:18,  2.08it/s]
Epoch 30 Iter 61: loss 0.18028. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 30 Iter 61: loss 0.18028. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 30 Iter 62: loss 0.17493. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 30 Iter 62: loss 0.17493. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.07it/s]
Epoch 30 Iter 63: loss 0.17362. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 30 Iter 63: loss 0.17362. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 64: loss 0.17058. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 30 Iter 64: loss 0.17058. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.06it/s]
Epoch 30 Iter 65: loss 0.16639. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 65: loss 0.16639. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 66: loss 0.16830. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 30 Iter 66: loss 0.16830. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 30 Iter 67: loss 0.17986. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 30 Iter 67: loss 0.17986. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 30 Iter 68: loss 0.15522. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 30 Iter 68: loss 0.15522. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.17379. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 30 Iter 69: loss 0.17379. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 30 Iter 70: loss 0.17421. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 30 Iter 70: loss 0.17421. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 30 Iter 71: loss 0.18384. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 30 Iter 71: loss 0.18384. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 30 Iter 72: loss 0.18343. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.08it/s]
Epoch 30 Iter 72: loss 0.18343. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 30 Iter 73: loss 0.16877. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 30 Iter 73: loss 0.16877. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 30 Iter 74: loss 0.18270. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 30 Iter 74: loss 0.18270. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 30 Iter 75: loss 0.18875. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 30 Iter 75: loss 0.18875. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 30 Iter 76: loss 0.17239. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 30 Iter 76: loss 0.17239. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 30 Iter 77: loss 0.19985. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 30 Iter 77: loss 0.19985. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 30 Iter 78: loss 0.17862. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 30 Iter 78: loss 0.17862. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 30 Iter 79: loss 0.18973. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 30 Iter 79: loss 0.18973. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 30 Iter 80: loss 0.16103. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 30 Iter 80: loss 0.16103. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 30 Iter 81: loss 0.17819. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 30 Iter 81: loss 0.17819. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 30 Iter 82: loss 0.14867. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 30 Iter 82: loss 0.14867. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 30 Iter 83: loss 0.16719. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 30 Iter 83: loss 0.16719. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 30 Iter 84: loss 0.15920. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 30 Iter 84: loss 0.15920. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 30 Iter 85: loss 0.19896. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 30 Iter 85: loss 0.19896. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 30 Iter 86: loss 0.16849. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 30 Iter 86: loss 0.16849. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 30 Iter 87: loss 0.18006. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 30 Iter 87: loss 0.18006. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 30 Iter 88: loss 0.17803. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 30 Iter 88: loss 0.17803. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 30 Iter 89: loss 0.16514. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 89: loss 0.16514. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 90: loss 0.18297. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 30 Iter 90: loss 0.18297. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.06it/s]
Epoch 30 Iter 91: loss 0.16523. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.06it/s]
Epoch 30 Iter 91: loss 0.16523. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 30 Iter 92: loss 0.16796. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 30 Iter 92: loss 0.16796. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 30 Iter 93: loss 0.16637. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 30 Iter 93: loss 0.16637. :  42%|██████████████████▋                          | 93/224 [00:44<01:03,  2.06it/s]
Epoch 30 Iter 94: loss 0.19438. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 30 Iter 94: loss 0.19438. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.06it/s]
Epoch 30 Iter 95: loss 0.19434. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.06it/s]
Epoch 30 Iter 95: loss 0.19434. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.07it/s]
Epoch 30 Iter 96: loss 0.17509. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 30 Iter 96: loss 0.17509. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 30 Iter 97: loss 0.16721. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 30 Iter 97: loss 0.16721. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.17033. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.05it/s]
Epoch 30 Iter 98: loss 0.17033. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.17463. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 30 Iter 99: loss 0.17463. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.17378. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 30 Iter 100: loss 0.17378. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.17360. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 30 Iter 101: loss 0.17360. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.18817. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 102: loss 0.18817. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.19078. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 30 Iter 103: loss 0.19078. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.18665. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 30 Iter 104: loss 0.18665. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 105: loss 0.18031. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 105: loss 0.18031. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.17622. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 30 Iter 106: loss 0.17622. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 30 Iter 107: loss 0.18026. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 30 Iter 107: loss 0.18026. :  48%|████████████████████▌                      | 107/224 [00:51<00:57,  2.04it/s]
Epoch 30 Iter 108: loss 0.16627. :  48%|████████████████████▌                      | 107/224 [00:52<00:57,  2.04it/s]
Epoch 30 Iter 108: loss 0.16627. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 30 Iter 109: loss 0.17572. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 30 Iter 109: loss 0.17572. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 30 Iter 110: loss 0.16481. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 30 Iter 110: loss 0.16481. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 30 Iter 111: loss 0.19348. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 30 Iter 111: loss 0.19348. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 30 Iter 112: loss 0.19395. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 30 Iter 112: loss 0.19395. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 30 Iter 113: loss 0.14881. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 30 Iter 113: loss 0.14881. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 30 Iter 114: loss 0.16331. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.08it/s]
Epoch 30 Iter 114: loss 0.16331. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.08it/s]
Epoch 30 Iter 115: loss 0.16279. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.08it/s]
Epoch 30 Iter 115: loss 0.16279. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 30 Iter 116: loss 0.18985. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 30 Iter 116: loss 0.18985. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 30 Iter 117: loss 0.19497. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 30 Iter 117: loss 0.19497. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 30 Iter 118: loss 0.17381. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 118: loss 0.17381. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 119: loss 0.17096. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 30 Iter 119: loss 0.17096. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 30 Iter 120: loss 0.15876. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 30 Iter 120: loss 0.15876. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 30 Iter 121: loss 0.17433. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 30 Iter 121: loss 0.17433. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 30 Iter 122: loss 0.18305. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 30 Iter 122: loss 0.18305. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 30 Iter 123: loss 0.16283. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 30 Iter 123: loss 0.16283. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 30 Iter 124: loss 0.17431. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 30 Iter 124: loss 0.17431. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.07it/s]
Epoch 30 Iter 125: loss 0.19148. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 30 Iter 125: loss 0.19148. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 30 Iter 126: loss 0.17276. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 30 Iter 126: loss 0.17276. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 30 Iter 127: loss 0.18380. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 30 Iter 127: loss 0.18380. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 30 Iter 128: loss 0.16146. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 30 Iter 128: loss 0.16146. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 30 Iter 129: loss 0.16935. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 30 Iter 129: loss 0.16935. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 30 Iter 130: loss 0.17472. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 30 Iter 130: loss 0.17472. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.17537. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 30 Iter 131: loss 0.17537. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.09it/s]
Epoch 30 Iter 132: loss 0.18406. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.09it/s]
Epoch 30 Iter 132: loss 0.18406. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.09it/s]
Epoch 30 Iter 133: loss 0.18159. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.09it/s]
Epoch 30 Iter 133: loss 0.18159. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 30 Iter 134: loss 0.18069. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.09it/s]
Epoch 30 Iter 134: loss 0.18069. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.08it/s]
Epoch 30 Iter 135: loss 0.17177. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 30 Iter 135: loss 0.17177. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 30 Iter 136: loss 0.21003. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 30 Iter 136: loss 0.21003. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 30 Iter 137: loss 0.18564. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 30 Iter 137: loss 0.18564. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 30 Iter 138: loss 0.18257. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 30 Iter 138: loss 0.18257. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 30 Iter 139: loss 0.18874. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 30 Iter 139: loss 0.18874. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 30 Iter 140: loss 0.18326. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 30 Iter 140: loss 0.18326. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.09it/s]
Epoch 30 Iter 141: loss 0.16705. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.09it/s]
Epoch 30 Iter 141: loss 0.16705. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 30 Iter 142: loss 0.15519. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 30 Iter 142: loss 0.15519. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.10it/s]
Epoch 30 Iter 143: loss 0.19705. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.10it/s]
Epoch 30 Iter 143: loss 0.19705. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 30 Iter 144: loss 0.16734. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 30 Iter 144: loss 0.16734. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 30 Iter 145: loss 0.17304. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 30 Iter 145: loss 0.17304. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 30 Iter 146: loss 0.15354. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.08it/s]
Epoch 30 Iter 146: loss 0.15354. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 30 Iter 147: loss 0.15926. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 30 Iter 147: loss 0.15926. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.17031. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 30 Iter 148: loss 0.17031. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 30 Iter 149: loss 0.17398. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 30 Iter 149: loss 0.17398. :  67%|████████████████████████████▌              | 149/224 [01:11<00:35,  2.09it/s]
Epoch 30 Iter 150: loss 0.19190. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.09it/s]
Epoch 30 Iter 150: loss 0.19190. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.09it/s]
Epoch 30 Iter 151: loss 0.17537. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.09it/s]
Epoch 30 Iter 151: loss 0.17537. :  67%|████████████████████████████▉              | 151/224 [01:12<00:34,  2.09it/s]
Epoch 30 Iter 152: loss 0.16699. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 30 Iter 152: loss 0.16699. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 30 Iter 153: loss 0.19411. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 30 Iter 153: loss 0.19411. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.08it/s]
Epoch 30 Iter 154: loss 0.18220. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 30 Iter 154: loss 0.18220. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.18610. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 155: loss 0.18610. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.20441. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 30 Iter 156: loss 0.20441. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 30 Iter 157: loss 0.15997. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 30 Iter 157: loss 0.15997. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.05it/s]
Epoch 30 Iter 158: loss 0.16360. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 30 Iter 158: loss 0.16360. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 30 Iter 159: loss 0.16647. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 30 Iter 159: loss 0.16647. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.05it/s]
Epoch 30 Iter 160: loss 0.18533. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.05it/s]
Epoch 30 Iter 160: loss 0.18533. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 30 Iter 161: loss 0.16233. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 30 Iter 161: loss 0.16233. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 30 Iter 162: loss 0.16591. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 30 Iter 162: loss 0.16591. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 30 Iter 163: loss 0.18563. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 30 Iter 163: loss 0.18563. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 30 Iter 164: loss 0.18051. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 30 Iter 164: loss 0.18051. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 30 Iter 165: loss 0.17705. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 30 Iter 165: loss 0.17705. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.08it/s]
Epoch 30 Iter 166: loss 0.16964. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 30 Iter 166: loss 0.16964. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 30 Iter 167: loss 0.18526. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 30 Iter 167: loss 0.18526. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 30 Iter 168: loss 0.16162. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 168: loss 0.16162. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 169: loss 0.18886. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 30 Iter 169: loss 0.18886. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 30 Iter 170: loss 0.18275. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 30 Iter 170: loss 0.18275. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 30 Iter 171: loss 0.17728. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 30 Iter 171: loss 0.17728. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.17914. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 30 Iter 172: loss 0.17914. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 30 Iter 173: loss 0.17175. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 30 Iter 173: loss 0.17175. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 30 Iter 174: loss 0.17058. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 30 Iter 174: loss 0.17058. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 30 Iter 175: loss 0.18135. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 30 Iter 175: loss 0.18135. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 30 Iter 176: loss 0.17889. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 30 Iter 176: loss 0.17889. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 30 Iter 177: loss 0.17117. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 30 Iter 177: loss 0.17117. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 30 Iter 178: loss 0.17187. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 30 Iter 178: loss 0.17187. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 30 Iter 179: loss 0.18397. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 30 Iter 179: loss 0.18397. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 30 Iter 180: loss 0.17600. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 30 Iter 180: loss 0.17600. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 30 Iter 181: loss 0.18137. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 30 Iter 181: loss 0.18137. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 30 Iter 182: loss 0.18366. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 30 Iter 182: loss 0.18366. :  81%|██████████████████████████████████▉        | 182/224 [01:27<00:20,  2.06it/s]
Epoch 30 Iter 183: loss 0.18992. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 30 Iter 183: loss 0.18992. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 30 Iter 184: loss 0.18544. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 30 Iter 184: loss 0.18544. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.07it/s]
Epoch 30 Iter 185: loss 0.19296. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 30 Iter 185: loss 0.19296. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 30 Iter 186: loss 0.18960. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 30 Iter 186: loss 0.18960. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.06it/s]
Epoch 30 Iter 187: loss 0.16370. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 30 Iter 187: loss 0.16370. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 30 Iter 188: loss 0.16757. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 30 Iter 188: loss 0.16757. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 30 Iter 189: loss 0.16384. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 30 Iter 189: loss 0.16384. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 190: loss 0.17930. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 190: loss 0.17930. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.08it/s]
Epoch 30 Iter 191: loss 0.17515. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 30 Iter 191: loss 0.17515. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 30 Iter 192: loss 0.15958. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.08it/s]
Epoch 30 Iter 192: loss 0.15958. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.04it/s]
Epoch 30 Iter 193: loss 0.17174. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 30 Iter 193: loss 0.17174. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.04it/s]
Epoch 30 Iter 194: loss 0.16585. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.04it/s]
Epoch 30 Iter 194: loss 0.16585. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.03it/s]
Epoch 30 Iter 195: loss 0.16901. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.03it/s]
Epoch 30 Iter 195: loss 0.16901. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 30 Iter 196: loss 0.17721. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.04it/s]
Epoch 30 Iter 196: loss 0.17721. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.05it/s]
Epoch 30 Iter 197: loss 0.17910. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 30 Iter 197: loss 0.17910. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 30 Iter 198: loss 0.17275. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 30 Iter 198: loss 0.17275. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.05it/s]
Epoch 30 Iter 199: loss 0.18055. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 30 Iter 199: loss 0.18055. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 30 Iter 200: loss 0.17299. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 30 Iter 200: loss 0.17299. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.04it/s]
Epoch 30 Iter 201: loss 0.15089. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.04it/s]
Epoch 30 Iter 201: loss 0.15089. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 30 Iter 202: loss 0.14922. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 30 Iter 202: loss 0.14922. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.04it/s]
Epoch 30 Iter 203: loss 0.17643. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.04it/s]
Epoch 30 Iter 203: loss 0.17643. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 30 Iter 204: loss 0.18378. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.04it/s]
Epoch 30 Iter 204: loss 0.18378. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 30 Iter 205: loss 0.16788. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 30 Iter 205: loss 0.16788. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 30 Iter 206: loss 0.17833. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.05it/s]
Epoch 30 Iter 206: loss 0.17833. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.04it/s]
Epoch 30 Iter 207: loss 0.16753. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 30 Iter 207: loss 0.16753. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.04it/s]
Epoch 30 Iter 208: loss 0.17378. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.04it/s]
Epoch 30 Iter 208: loss 0.17378. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.05it/s]
Epoch 30 Iter 209: loss 0.15781. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 30 Iter 209: loss 0.15781. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 30 Iter 210: loss 0.17738. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 30 Iter 210: loss 0.17738. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 30 Iter 211: loss 0.18194. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 30 Iter 211: loss 0.18194. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 30 Iter 212: loss 0.18873. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 30 Iter 212: loss 0.18873. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 30 Iter 213: loss 0.18448. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 30 Iter 213: loss 0.18448. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.19880. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 30 Iter 214: loss 0.19880. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.17156. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 30 Iter 215: loss 0.17156. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 30 Iter 216: loss 0.19715. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.04it/s]
Epoch 30 Iter 216: loss 0.19715. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 30 Iter 217: loss 0.17937. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.05it/s]
Epoch 30 Iter 217: loss 0.17937. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 218: loss 0.16037. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 30 Iter 218: loss 0.16037. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 30 Iter 219: loss 0.19127. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 30 Iter 219: loss 0.19127. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 30 Iter 220: loss 0.17276. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 30 Iter 220: loss 0.17276. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 30 Iter 221: loss 0.18710. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 30 Iter 221: loss 0.18710. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 30 Iter 222: loss 0.17347. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 30 Iter 222: loss 0.17347. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 30 Iter 223: loss 0.16195. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 30 Iter 223: loss 0.16195. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 30 Iter 224: loss 0.18680. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 30 Iter 224: loss 0.18680. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 30 Iter 224: loss 0.18680. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.17283. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 31 Iter 1: loss 0.17283. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.15285. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 31 Iter 2: loss 0.15285. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.18007. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 31 Iter 3: loss 0.18007. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 31 Iter 4: loss 0.16913. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 31 Iter 4: loss 0.16913. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 31 Iter 5: loss 0.17715. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 31 Iter 5: loss 0.17715. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 31 Iter 6: loss 0.17233. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 31 Iter 6: loss 0.17233. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 31 Iter 7: loss 0.17484. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 7: loss 0.17484. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 8: loss 0.17276. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 8: loss 0.17276. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.06it/s]
Epoch 31 Iter 9: loss 0.17252. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.06it/s]
Epoch 31 Iter 9: loss 0.17252. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 10: loss 0.19343. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 10: loss 0.19343. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.16007. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 31 Iter 11: loss 0.16007. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.17890. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 31 Iter 12: loss 0.17890. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.19484. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 31 Iter 13: loss 0.19484. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.16782. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 31 Iter 14: loss 0.16782. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 31 Iter 15: loss 0.16551. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 15: loss 0.16551. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 31 Iter 16: loss 0.17530. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 31 Iter 16: loss 0.17530. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 31 Iter 17: loss 0.16070. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 31 Iter 17: loss 0.16070. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 31 Iter 18: loss 0.15677. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 31 Iter 18: loss 0.15677. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 31 Iter 19: loss 0.18200. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 31 Iter 19: loss 0.18200. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 31 Iter 20: loss 0.17950. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 31 Iter 20: loss 0.17950. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 31 Iter 21: loss 0.17296. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 31 Iter 21: loss 0.17296. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 31 Iter 22: loss 0.15436. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 31 Iter 22: loss 0.15436. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 31 Iter 23: loss 0.14468. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 31 Iter 23: loss 0.14468. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 31 Iter 24: loss 0.18913. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 31 Iter 24: loss 0.18913. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 31 Iter 25: loss 0.17875. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 31 Iter 25: loss 0.17875. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 26: loss 0.15866. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 31 Iter 26: loss 0.15866. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 31 Iter 27: loss 0.17217. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 31 Iter 27: loss 0.17217. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.09it/s]
Epoch 31 Iter 28: loss 0.18415. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.09it/s]
Epoch 31 Iter 28: loss 0.18415. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.08it/s]
Epoch 31 Iter 29: loss 0.17915. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.08it/s]
Epoch 31 Iter 29: loss 0.17915. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 31 Iter 30: loss 0.15931. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 31 Iter 30: loss 0.15931. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 31 Iter 31: loss 0.18895. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 31 Iter 31: loss 0.18895. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 31 Iter 32: loss 0.16255. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 31 Iter 32: loss 0.16255. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 31 Iter 33: loss 0.17860. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 31 Iter 33: loss 0.17860. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 31 Iter 34: loss 0.16304. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 31 Iter 34: loss 0.16304. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 31 Iter 35: loss 0.15917. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 31 Iter 35: loss 0.15917. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 31 Iter 36: loss 0.15746. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 31 Iter 36: loss 0.15746. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 31 Iter 37: loss 0.15314. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 31 Iter 37: loss 0.15314. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 31 Iter 38: loss 0.17315. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 31 Iter 38: loss 0.17315. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 31 Iter 39: loss 0.16891. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 31 Iter 39: loss 0.16891. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 31 Iter 40: loss 0.18670. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 31 Iter 40: loss 0.18670. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 31 Iter 41: loss 0.18444. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 31 Iter 41: loss 0.18444. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 31 Iter 42: loss 0.18017. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 31 Iter 42: loss 0.18017. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 31 Iter 43: loss 0.16982. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.07it/s]
Epoch 31 Iter 43: loss 0.16982. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 31 Iter 44: loss 0.18258. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 31 Iter 44: loss 0.18258. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 31 Iter 45: loss 0.16983. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 31 Iter 45: loss 0.16983. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 31 Iter 46: loss 0.18467. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 31 Iter 46: loss 0.18467. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 31 Iter 47: loss 0.18748. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 31 Iter 47: loss 0.18748. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 31 Iter 48: loss 0.17901. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 31 Iter 48: loss 0.17901. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 31 Iter 49: loss 0.16093. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 31 Iter 49: loss 0.16093. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 31 Iter 50: loss 0.17373. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 31 Iter 50: loss 0.17373. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 31 Iter 51: loss 0.16428. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 31 Iter 51: loss 0.16428. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.18308. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 31 Iter 52: loss 0.18308. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 31 Iter 53: loss 0.17145. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 31 Iter 53: loss 0.17145. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.18353. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 31 Iter 54: loss 0.18353. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 31 Iter 55: loss 0.18450. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 31 Iter 55: loss 0.18450. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 31 Iter 56: loss 0.19369. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 31 Iter 56: loss 0.19369. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 57: loss 0.19545. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 57: loss 0.19545. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 31 Iter 58: loss 0.19822. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 31 Iter 58: loss 0.19822. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 31 Iter 59: loss 0.16867. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 31 Iter 59: loss 0.16867. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.06it/s]
Epoch 31 Iter 60: loss 0.16182. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.06it/s]
Epoch 31 Iter 60: loss 0.16182. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 31 Iter 61: loss 0.17347. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 31 Iter 61: loss 0.17347. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 31 Iter 62: loss 0.16964. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.06it/s]
Epoch 31 Iter 62: loss 0.16964. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.08it/s]
Epoch 31 Iter 63: loss 0.17836. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.08it/s]
Epoch 31 Iter 63: loss 0.17836. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.18277. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 31 Iter 64: loss 0.18277. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 31 Iter 65: loss 0.20008. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 31 Iter 65: loss 0.20008. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 31 Iter 66: loss 0.19038. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 31 Iter 66: loss 0.19038. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 31 Iter 67: loss 0.16389. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 31 Iter 67: loss 0.16389. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 31 Iter 68: loss 0.16775. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 31 Iter 68: loss 0.16775. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 31 Iter 69: loss 0.16826. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 69: loss 0.16826. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 70: loss 0.14882. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 31 Iter 70: loss 0.14882. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 31 Iter 71: loss 0.17130. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 31 Iter 71: loss 0.17130. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 31 Iter 72: loss 0.16732. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 31 Iter 72: loss 0.16732. :  32%|██████████████▍                              | 72/224 [00:34<01:12,  2.09it/s]
Epoch 31 Iter 73: loss 0.18322. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.09it/s]
Epoch 31 Iter 73: loss 0.18322. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.15957. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 74: loss 0.15957. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 31 Iter 75: loss 0.18690. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 31 Iter 75: loss 0.18690. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 31 Iter 76: loss 0.15999. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 31 Iter 76: loss 0.15999. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 31 Iter 77: loss 0.18271. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 31 Iter 77: loss 0.18271. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 31 Iter 78: loss 0.16950. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 31 Iter 78: loss 0.16950. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 31 Iter 79: loss 0.17586. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 31 Iter 79: loss 0.17586. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 31 Iter 80: loss 0.16772. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 31 Iter 80: loss 0.16772. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.03it/s]
Epoch 31 Iter 81: loss 0.17963. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.03it/s]
Epoch 31 Iter 81: loss 0.17963. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.03it/s]
Epoch 31 Iter 82: loss 0.15050. :  36%|████████████████▎                            | 81/224 [00:39<01:10,  2.03it/s]
Epoch 31 Iter 82: loss 0.15050. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 31 Iter 83: loss 0.19569. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 31 Iter 83: loss 0.19569. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 31 Iter 84: loss 0.17489. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 31 Iter 84: loss 0.17489. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 31 Iter 85: loss 0.20843. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 31 Iter 85: loss 0.20843. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 31 Iter 86: loss 0.17211. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 31 Iter 86: loss 0.17211. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 31 Iter 87: loss 0.19255. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 31 Iter 87: loss 0.19255. :  39%|█████████████████▍                           | 87/224 [00:42<01:08,  2.00it/s]
Epoch 31 Iter 88: loss 0.18626. :  39%|█████████████████▍                           | 87/224 [00:42<01:08,  2.00it/s]
Epoch 31 Iter 88: loss 0.18626. :  39%|█████████████████▋                           | 88/224 [00:42<01:07,  2.02it/s]
Epoch 31 Iter 89: loss 0.20698. :  39%|█████████████████▋                           | 88/224 [00:43<01:07,  2.02it/s]
Epoch 31 Iter 89: loss 0.20698. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 31 Iter 90: loss 0.20721. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 31 Iter 90: loss 0.20721. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.03it/s]
Epoch 31 Iter 91: loss 0.16789. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.03it/s]
Epoch 31 Iter 91: loss 0.16789. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 31 Iter 92: loss 0.17689. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 31 Iter 92: loss 0.17689. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 31 Iter 93: loss 0.16390. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 31 Iter 93: loss 0.16390. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 31 Iter 94: loss 0.17508. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 31 Iter 94: loss 0.17508. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 31 Iter 95: loss 0.17237. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 31 Iter 95: loss 0.17237. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 31 Iter 96: loss 0.17056. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 31 Iter 96: loss 0.17056. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 31 Iter 97: loss 0.18411. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 31 Iter 97: loss 0.18411. :  43%|███████████████████▍                         | 97/224 [00:46<01:00,  2.08it/s]
Epoch 31 Iter 98: loss 0.15335. :  43%|███████████████████▍                         | 97/224 [00:47<01:00,  2.08it/s]
Epoch 31 Iter 98: loss 0.15335. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 99: loss 0.20567. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 99: loss 0.20567. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 31 Iter 100: loss 0.16399. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 31 Iter 100: loss 0.16399. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 101: loss 0.16889. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 101: loss 0.16889. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.16905. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 31 Iter 102: loss 0.16905. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 31 Iter 103: loss 0.19833. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 31 Iter 103: loss 0.19833. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.05it/s]
Epoch 31 Iter 104: loss 0.18382. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 31 Iter 104: loss 0.18382. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 31 Iter 105: loss 0.17423. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.05it/s]
Epoch 31 Iter 105: loss 0.17423. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.18554. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 31 Iter 106: loss 0.18554. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 31 Iter 107: loss 0.15998. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 31 Iter 107: loss 0.15998. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.17808. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 108: loss 0.17808. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.17578. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 31 Iter 109: loss 0.17578. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.18977. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 31 Iter 110: loss 0.18977. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 111: loss 0.17990. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 31 Iter 111: loss 0.17990. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 31 Iter 112: loss 0.19893. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 31 Iter 112: loss 0.19893. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 31 Iter 113: loss 0.17872. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 31 Iter 113: loss 0.17872. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 31 Iter 114: loss 0.17448. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.08it/s]
Epoch 31 Iter 114: loss 0.17448. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 31 Iter 115: loss 0.16259. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 31 Iter 115: loss 0.16259. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.09it/s]
Epoch 31 Iter 116: loss 0.15557. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.09it/s]
Epoch 31 Iter 116: loss 0.15557. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 31 Iter 117: loss 0.18705. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 31 Iter 117: loss 0.18705. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 31 Iter 118: loss 0.17224. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 31 Iter 118: loss 0.17224. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 31 Iter 119: loss 0.17978. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 31 Iter 119: loss 0.17978. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 31 Iter 120: loss 0.17112. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 31 Iter 120: loss 0.17112. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 31 Iter 121: loss 0.16880. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 31 Iter 121: loss 0.16880. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 31 Iter 122: loss 0.16862. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 31 Iter 122: loss 0.16862. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 31 Iter 123: loss 0.17601. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 31 Iter 123: loss 0.17601. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 31 Iter 124: loss 0.18755. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 31 Iter 124: loss 0.18755. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 31 Iter 125: loss 0.18833. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 31 Iter 125: loss 0.18833. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 31 Iter 126: loss 0.16954. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 31 Iter 126: loss 0.16954. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 31 Iter 127: loss 0.16177. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 31 Iter 127: loss 0.16177. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 31 Iter 128: loss 0.16668. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 31 Iter 128: loss 0.16668. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 31 Iter 129: loss 0.17284. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 31 Iter 129: loss 0.17284. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 31 Iter 130: loss 0.19789. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 31 Iter 130: loss 0.19789. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.05it/s]
Epoch 31 Iter 131: loss 0.18066. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 31 Iter 131: loss 0.18066. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 31 Iter 132: loss 0.17404. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 31 Iter 132: loss 0.17404. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 31 Iter 133: loss 0.17468. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 31 Iter 133: loss 0.17468. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 31 Iter 134: loss 0.16547. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 31 Iter 134: loss 0.16547. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.05it/s]
Epoch 31 Iter 135: loss 0.17868. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 31 Iter 135: loss 0.17868. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 31 Iter 136: loss 0.16445. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 31 Iter 136: loss 0.16445. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.05it/s]
Epoch 31 Iter 137: loss 0.15388. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.05it/s]
Epoch 31 Iter 137: loss 0.15388. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 31 Iter 138: loss 0.17222. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 31 Iter 138: loss 0.17222. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 31 Iter 139: loss 0.16288. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 31 Iter 139: loss 0.16288. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 31 Iter 140: loss 0.18370. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 31 Iter 140: loss 0.18370. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 31 Iter 141: loss 0.16873. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 31 Iter 141: loss 0.16873. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 31 Iter 142: loss 0.17196. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 31 Iter 142: loss 0.17196. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 31 Iter 143: loss 0.17743. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 31 Iter 143: loss 0.17743. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 31 Iter 144: loss 0.18504. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 31 Iter 144: loss 0.18504. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 31 Iter 145: loss 0.17833. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 31 Iter 145: loss 0.17833. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 31 Iter 146: loss 0.21274. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 31 Iter 146: loss 0.21274. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 31 Iter 147: loss 0.17140. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 31 Iter 147: loss 0.17140. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.04it/s]
Epoch 31 Iter 148: loss 0.18097. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.04it/s]
Epoch 31 Iter 148: loss 0.18097. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 31 Iter 149: loss 0.19241. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 31 Iter 149: loss 0.19241. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 31 Iter 150: loss 0.16305. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 31 Iter 150: loss 0.16305. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 31 Iter 151: loss 0.16920. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 151: loss 0.16920. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 152: loss 0.17608. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 31 Iter 152: loss 0.17608. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 31 Iter 153: loss 0.17857. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 31 Iter 153: loss 0.17857. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 31 Iter 154: loss 0.15813. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 31 Iter 154: loss 0.15813. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 31 Iter 155: loss 0.19775. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 155: loss 0.19775. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 156: loss 0.17138. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 156: loss 0.17138. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.06it/s]
Epoch 31 Iter 157: loss 0.15822. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.06it/s]
Epoch 31 Iter 157: loss 0.15822. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 31 Iter 158: loss 0.15691. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 31 Iter 158: loss 0.15691. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 31 Iter 159: loss 0.17192. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 31 Iter 159: loss 0.17192. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 31 Iter 160: loss 0.16426. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 31 Iter 160: loss 0.16426. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.05it/s]
Epoch 31 Iter 161: loss 0.17631. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.05it/s]
Epoch 31 Iter 161: loss 0.17631. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 31 Iter 162: loss 0.17653. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 31 Iter 162: loss 0.17653. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 31 Iter 163: loss 0.17813. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 31 Iter 163: loss 0.17813. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 31 Iter 164: loss 0.17187. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 164: loss 0.17187. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 165: loss 0.18444. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 31 Iter 165: loss 0.18444. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.18588. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 31 Iter 166: loss 0.18588. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 31 Iter 167: loss 0.19489. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.04it/s]
Epoch 31 Iter 167: loss 0.19489. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 31 Iter 168: loss 0.18338. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 31 Iter 168: loss 0.18338. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 31 Iter 169: loss 0.18563. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 31 Iter 169: loss 0.18563. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 31 Iter 170: loss 0.18117. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 31 Iter 170: loss 0.18117. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 31 Iter 171: loss 0.16348. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 31 Iter 171: loss 0.16348. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 31 Iter 172: loss 0.17092. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 172: loss 0.17092. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 173: loss 0.17076. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 31 Iter 173: loss 0.17076. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 31 Iter 174: loss 0.15572. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 31 Iter 174: loss 0.15572. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 31 Iter 175: loss 0.16415. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 31 Iter 175: loss 0.16415. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 31 Iter 176: loss 0.16290. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 31 Iter 176: loss 0.16290. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 31 Iter 177: loss 0.19323. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 31 Iter 177: loss 0.19323. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.17300. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 31 Iter 178: loss 0.17300. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 31 Iter 179: loss 0.19046. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 31 Iter 179: loss 0.19046. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 31 Iter 180: loss 0.18379. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 31 Iter 180: loss 0.18379. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.09it/s]
Epoch 31 Iter 181: loss 0.19106. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.09it/s]
Epoch 31 Iter 181: loss 0.19106. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 31 Iter 182: loss 0.18441. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 31 Iter 182: loss 0.18441. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 31 Iter 183: loss 0.17153. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 31 Iter 183: loss 0.17153. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 31 Iter 184: loss 0.16501. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 31 Iter 184: loss 0.16501. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 31 Iter 185: loss 0.18259. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.05it/s]
Epoch 31 Iter 185: loss 0.18259. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 31 Iter 186: loss 0.18325. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 31 Iter 186: loss 0.18325. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 31 Iter 187: loss 0.17403. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.05it/s]
Epoch 31 Iter 187: loss 0.17403. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 31 Iter 188: loss 0.16936. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 31 Iter 188: loss 0.16936. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.02it/s]
Epoch 31 Iter 189: loss 0.17881. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.02it/s]
Epoch 31 Iter 189: loss 0.17881. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 31 Iter 190: loss 0.18064. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.04it/s]
Epoch 31 Iter 190: loss 0.18064. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 191: loss 0.17512. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 31 Iter 191: loss 0.17512. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.04it/s]
Epoch 31 Iter 192: loss 0.18020. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.04it/s]
Epoch 31 Iter 192: loss 0.18020. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 31 Iter 193: loss 0.18001. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.04it/s]
Epoch 31 Iter 193: loss 0.18001. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.18326. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 31 Iter 194: loss 0.18326. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 31 Iter 195: loss 0.16808. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 31 Iter 195: loss 0.16808. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 31 Iter 196: loss 0.18604. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 31 Iter 196: loss 0.18604. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 31 Iter 197: loss 0.17613. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 31 Iter 197: loss 0.17613. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 31 Iter 198: loss 0.17642. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 31 Iter 198: loss 0.17642. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 31 Iter 199: loss 0.18181. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 199: loss 0.18181. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 200: loss 0.18377. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 31 Iter 200: loss 0.18377. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 31 Iter 201: loss 0.17775. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 201: loss 0.17775. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 202: loss 0.18374. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 31 Iter 202: loss 0.18374. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.09it/s]
Epoch 31 Iter 203: loss 0.16168. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.09it/s]
Epoch 31 Iter 203: loss 0.16168. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 31 Iter 204: loss 0.16846. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.09it/s]
Epoch 31 Iter 204: loss 0.16846. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 31 Iter 205: loss 0.19148. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 205: loss 0.19148. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 206: loss 0.19163. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.09it/s]
Epoch 31 Iter 206: loss 0.19163. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.10it/s]
Epoch 31 Iter 207: loss 0.15627. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.10it/s]
Epoch 31 Iter 207: loss 0.15627. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.10it/s]
Epoch 31 Iter 208: loss 0.16499. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.10it/s]
Epoch 31 Iter 208: loss 0.16499. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 31 Iter 209: loss 0.19522. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 31 Iter 209: loss 0.19522. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 31 Iter 210: loss 0.15561. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 31 Iter 210: loss 0.15561. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 31 Iter 211: loss 0.18122. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 31 Iter 211: loss 0.18122. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 31 Iter 212: loss 0.17710. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 31 Iter 212: loss 0.17710. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 31 Iter 213: loss 0.18525. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 31 Iter 213: loss 0.18525. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 31 Iter 214: loss 0.17346. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 31 Iter 214: loss 0.17346. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 31 Iter 215: loss 0.17221. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 31 Iter 215: loss 0.17221. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 31 Iter 216: loss 0.17673. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 31 Iter 216: loss 0.17673. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 31 Iter 217: loss 0.17077. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 31 Iter 217: loss 0.17077. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 31 Iter 218: loss 0.19892. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 31 Iter 218: loss 0.19892. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 31 Iter 219: loss 0.16602. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 31 Iter 219: loss 0.16602. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 31 Iter 220: loss 0.18359. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 31 Iter 220: loss 0.18359. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 31 Iter 221: loss 0.16367. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 31 Iter 221: loss 0.16367. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 31 Iter 222: loss 0.18613. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 31 Iter 222: loss 0.18613. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.17910. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 31 Iter 223: loss 0.17910. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 31 Iter 224: loss 0.16930. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 31 Iter 224: loss 0.16930. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 31 Iter 224: loss 0.16930. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17573
    Valid loss: 0.17977
       Valid loss recons: 0.17363
       Valid loss KL-D:   61.33091
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.18237. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 32 Iter 1: loss 0.18237. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 32 Iter 2: loss 0.15593. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 32 Iter 2: loss 0.15593. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 32 Iter 3: loss 0.18218. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 32 Iter 3: loss 0.18218. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 32 Iter 4: loss 0.18469. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 32 Iter 4: loss 0.18469. :   2%|▊                                              | 4/224 [00:01<01:45,  2.08it/s]
Epoch 32 Iter 5: loss 0.19442. :   2%|▊                                              | 4/224 [00:02<01:45,  2.08it/s]
Epoch 32 Iter 5: loss 0.19442. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 32 Iter 6: loss 0.17787. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 32 Iter 6: loss 0.17787. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 32 Iter 7: loss 0.17567. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 32 Iter 7: loss 0.17567. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 32 Iter 8: loss 0.18474. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 32 Iter 8: loss 0.18474. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 32 Iter 9: loss 0.18687. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 32 Iter 9: loss 0.18687. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 32 Iter 10: loss 0.19642. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 32 Iter 10: loss 0.19642. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 32 Iter 11: loss 0.18292. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 32 Iter 11: loss 0.18292. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 32 Iter 12: loss 0.15797. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 32 Iter 12: loss 0.15797. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 32 Iter 13: loss 0.16561. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 32 Iter 13: loss 0.16561. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 32 Iter 14: loss 0.17679. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 32 Iter 14: loss 0.17679. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 32 Iter 15: loss 0.17024. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 32 Iter 15: loss 0.17024. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 32 Iter 16: loss 0.17708. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 32 Iter 16: loss 0.17708. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 32 Iter 17: loss 0.17159. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 32 Iter 17: loss 0.17159. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 32 Iter 18: loss 0.15320. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 32 Iter 18: loss 0.15320. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 32 Iter 19: loss 0.17630. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 32 Iter 19: loss 0.17630. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 32 Iter 20: loss 0.18394. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 32 Iter 20: loss 0.18394. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 32 Iter 21: loss 0.20455. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 32 Iter 21: loss 0.20455. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 32 Iter 22: loss 0.16144. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 32 Iter 22: loss 0.16144. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 32 Iter 23: loss 0.17372. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 23: loss 0.17372. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 24: loss 0.17993. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 32 Iter 24: loss 0.17993. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 32 Iter 25: loss 0.16838. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 32 Iter 25: loss 0.16838. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 32 Iter 26: loss 0.18519. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 32 Iter 26: loss 0.18519. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 32 Iter 27: loss 0.18338. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 32 Iter 27: loss 0.18338. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 32 Iter 28: loss 0.17888. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 32 Iter 28: loss 0.17888. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 32 Iter 29: loss 0.15503. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 32 Iter 29: loss 0.15503. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 32 Iter 30: loss 0.16359. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 32 Iter 30: loss 0.16359. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 32 Iter 31: loss 0.17006. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 32 Iter 31: loss 0.17006. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 32 Iter 32: loss 0.15847. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 32 Iter 32: loss 0.15847. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 32 Iter 33: loss 0.19238. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 32 Iter 33: loss 0.19238. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 34: loss 0.17591. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 34: loss 0.17591. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 35: loss 0.16880. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 32 Iter 35: loss 0.16880. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 32 Iter 36: loss 0.16863. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 32 Iter 36: loss 0.16863. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 32 Iter 37: loss 0.16524. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 32 Iter 37: loss 0.16524. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 32 Iter 38: loss 0.18178. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 32 Iter 38: loss 0.18178. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 32 Iter 39: loss 0.17626. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 32 Iter 39: loss 0.17626. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 32 Iter 40: loss 0.15428. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 32 Iter 40: loss 0.15428. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 32 Iter 41: loss 0.17953. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 32 Iter 41: loss 0.17953. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 32 Iter 42: loss 0.17609. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 32 Iter 42: loss 0.17609. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 32 Iter 43: loss 0.17388. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 32 Iter 43: loss 0.17388. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.05it/s]
Epoch 32 Iter 44: loss 0.17604. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.05it/s]
Epoch 32 Iter 44: loss 0.17604. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 32 Iter 45: loss 0.18335. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 32 Iter 45: loss 0.18335. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 32 Iter 46: loss 0.17137. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 32 Iter 46: loss 0.17137. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 32 Iter 47: loss 0.16664. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 32 Iter 47: loss 0.16664. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 32 Iter 48: loss 0.17789. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 32 Iter 48: loss 0.17789. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 32 Iter 49: loss 0.17386. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 32 Iter 49: loss 0.17386. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 32 Iter 50: loss 0.17386. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 32 Iter 50: loss 0.17386. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 32 Iter 51: loss 0.17328. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 32 Iter 51: loss 0.17328. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 32 Iter 52: loss 0.15727. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 32 Iter 52: loss 0.15727. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 53: loss 0.19180. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 53: loss 0.19180. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.17385. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 32 Iter 54: loss 0.17385. :  24%|██████████▊                                  | 54/224 [00:26<01:24,  2.02it/s]
Epoch 32 Iter 55: loss 0.17598. :  24%|██████████▊                                  | 54/224 [00:26<01:24,  2.02it/s]
Epoch 32 Iter 55: loss 0.17598. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.04it/s]
Epoch 32 Iter 56: loss 0.17063. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 32 Iter 56: loss 0.17063. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 32 Iter 57: loss 0.16650. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 32 Iter 57: loss 0.16650. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.04it/s]
Epoch 32 Iter 58: loss 0.17102. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.04it/s]
Epoch 32 Iter 58: loss 0.17102. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 32 Iter 59: loss 0.18194. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.03it/s]
Epoch 32 Iter 59: loss 0.18194. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.04it/s]
Epoch 32 Iter 60: loss 0.15384. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.04it/s]
Epoch 32 Iter 60: loss 0.15384. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 32 Iter 61: loss 0.16467. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 32 Iter 61: loss 0.16467. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 32 Iter 62: loss 0.17878. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 32 Iter 62: loss 0.17878. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 32 Iter 63: loss 0.17037. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 32 Iter 63: loss 0.17037. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 32 Iter 64: loss 0.18527. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 32 Iter 64: loss 0.18527. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.03it/s]
Epoch 32 Iter 65: loss 0.17447. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.03it/s]
Epoch 32 Iter 65: loss 0.17447. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.04it/s]
Epoch 32 Iter 66: loss 0.18107. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.04it/s]
Epoch 32 Iter 66: loss 0.18107. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 32 Iter 67: loss 0.18863. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.04it/s]
Epoch 32 Iter 67: loss 0.18863. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.04it/s]
Epoch 32 Iter 68: loss 0.17474. :  30%|█████████████▍                               | 67/224 [00:33<01:17,  2.04it/s]
Epoch 32 Iter 68: loss 0.17474. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 32 Iter 69: loss 0.19097. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.04it/s]
Epoch 32 Iter 69: loss 0.19097. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.17884. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 32 Iter 70: loss 0.17884. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 32 Iter 71: loss 0.16593. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 32 Iter 71: loss 0.16593. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 32 Iter 72: loss 0.18503. :  32%|██████████████▎                              | 71/224 [00:35<01:14,  2.04it/s]
Epoch 32 Iter 72: loss 0.18503. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.18133. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.05it/s]
Epoch 32 Iter 73: loss 0.18133. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 32 Iter 74: loss 0.17109. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 32 Iter 74: loss 0.17109. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 32 Iter 75: loss 0.16432. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 32 Iter 75: loss 0.16432. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 32 Iter 76: loss 0.17615. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 32 Iter 76: loss 0.17615. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 32 Iter 77: loss 0.18099. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 32 Iter 77: loss 0.18099. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 32 Iter 78: loss 0.20467. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 32 Iter 78: loss 0.20467. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 32 Iter 79: loss 0.16885. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 32 Iter 79: loss 0.16885. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 80: loss 0.17390. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 80: loss 0.17390. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 32 Iter 81: loss 0.17601. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 32 Iter 81: loss 0.17601. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.15395. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 32 Iter 82: loss 0.15395. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 32 Iter 83: loss 0.17996. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 32 Iter 83: loss 0.17996. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 32 Iter 84: loss 0.17331. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 32 Iter 84: loss 0.17331. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 32 Iter 85: loss 0.17143. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 32 Iter 85: loss 0.17143. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.19387. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 86: loss 0.19387. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.06it/s]
Epoch 32 Iter 87: loss 0.16505. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.06it/s]
Epoch 32 Iter 87: loss 0.16505. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 32 Iter 88: loss 0.14777. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 32 Iter 88: loss 0.14777. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.18405. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.04it/s]
Epoch 32 Iter 89: loss 0.18405. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 32 Iter 90: loss 0.16371. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 32 Iter 90: loss 0.16371. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 32 Iter 91: loss 0.18506. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 32 Iter 91: loss 0.18506. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 32 Iter 92: loss 0.16204. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 32 Iter 92: loss 0.16204. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 32 Iter 93: loss 0.17484. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 32 Iter 93: loss 0.17484. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 32 Iter 94: loss 0.17439. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 32 Iter 94: loss 0.17439. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 32 Iter 95: loss 0.18838. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 32 Iter 95: loss 0.18838. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 32 Iter 96: loss 0.17431. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 32 Iter 96: loss 0.17431. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 32 Iter 97: loss 0.17946. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 32 Iter 97: loss 0.17946. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 32 Iter 98: loss 0.17773. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 32 Iter 98: loss 0.17773. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 32 Iter 99: loss 0.17699. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 99: loss 0.17699. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 100: loss 0.17393. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 32 Iter 100: loss 0.17393. :  45%|███████████████████▏                       | 100/224 [00:48<01:01,  2.03it/s]
Epoch 32 Iter 101: loss 0.17335. :  45%|███████████████████▏                       | 100/224 [00:49<01:01,  2.03it/s]
Epoch 32 Iter 101: loss 0.17335. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 32 Iter 102: loss 0.16882. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.04it/s]
Epoch 32 Iter 102: loss 0.16882. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 32 Iter 103: loss 0.17543. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 32 Iter 103: loss 0.17543. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 32 Iter 104: loss 0.17831. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 32 Iter 104: loss 0.17831. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 32 Iter 105: loss 0.18628. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 32 Iter 105: loss 0.18628. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 32 Iter 106: loss 0.17690. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 32 Iter 106: loss 0.17690. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 32 Iter 107: loss 0.18086. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 32 Iter 107: loss 0.18086. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 32 Iter 108: loss 0.16890. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 32 Iter 108: loss 0.16890. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 32 Iter 109: loss 0.15847. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 32 Iter 109: loss 0.15847. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 32 Iter 110: loss 0.18586. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 32 Iter 110: loss 0.18586. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 32 Iter 111: loss 0.15214. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 32 Iter 111: loss 0.15214. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 32 Iter 112: loss 0.17770. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 32 Iter 112: loss 0.17770. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 32 Iter 113: loss 0.20073. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 32 Iter 113: loss 0.20073. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.09it/s]
Epoch 32 Iter 114: loss 0.17574. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.09it/s]
Epoch 32 Iter 114: loss 0.17574. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 32 Iter 115: loss 0.18821. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.08it/s]
Epoch 32 Iter 115: loss 0.18821. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 32 Iter 116: loss 0.17183. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 32 Iter 116: loss 0.17183. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.08it/s]
Epoch 32 Iter 117: loss 0.19393. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.08it/s]
Epoch 32 Iter 117: loss 0.19393. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 32 Iter 118: loss 0.17451. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 32 Iter 118: loss 0.17451. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 32 Iter 119: loss 0.18453. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 32 Iter 119: loss 0.18453. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 32 Iter 120: loss 0.17435. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 32 Iter 120: loss 0.17435. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 32 Iter 121: loss 0.16896. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 32 Iter 121: loss 0.16896. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 32 Iter 122: loss 0.18398. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 32 Iter 122: loss 0.18398. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 32 Iter 123: loss 0.18216. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 32 Iter 123: loss 0.18216. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 32 Iter 124: loss 0.18314. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 32 Iter 124: loss 0.18314. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 32 Iter 125: loss 0.15792. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 32 Iter 125: loss 0.15792. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 32 Iter 126: loss 0.18667. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 32 Iter 126: loss 0.18667. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 32 Iter 127: loss 0.18368. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 32 Iter 127: loss 0.18368. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.06it/s]
Epoch 32 Iter 128: loss 0.16712. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.06it/s]
Epoch 32 Iter 128: loss 0.16712. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 32 Iter 129: loss 0.16883. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 32 Iter 129: loss 0.16883. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 32 Iter 130: loss 0.19905. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.06it/s]
Epoch 32 Iter 130: loss 0.19905. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.17997. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 131: loss 0.17997. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 32 Iter 132: loss 0.17922. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 32 Iter 132: loss 0.17922. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 32 Iter 133: loss 0.18009. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 32 Iter 133: loss 0.18009. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 32 Iter 134: loss 0.17151. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.05it/s]
Epoch 32 Iter 134: loss 0.17151. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 135: loss 0.17796. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 32 Iter 135: loss 0.17796. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 32 Iter 136: loss 0.17023. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:43,  2.06it/s]
Epoch 32 Iter 136: loss 0.17023. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 32 Iter 137: loss 0.16237. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 32 Iter 137: loss 0.16237. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 32 Iter 138: loss 0.19169. :  61%|██████████████████████████▎                | 137/224 [01:07<00:41,  2.08it/s]
Epoch 32 Iter 138: loss 0.19169. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 32 Iter 139: loss 0.16393. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 32 Iter 139: loss 0.16393. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 32 Iter 140: loss 0.17711. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 32 Iter 140: loss 0.17711. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 141: loss 0.17603. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 141: loss 0.17603. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 142: loss 0.16268. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 32 Iter 142: loss 0.16268. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 32 Iter 143: loss 0.17318. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 32 Iter 143: loss 0.17318. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 32 Iter 144: loss 0.17166. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 32 Iter 144: loss 0.17166. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.15743. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 145: loss 0.15743. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 146: loss 0.18615. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 32 Iter 146: loss 0.18615. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.05it/s]
Epoch 32 Iter 147: loss 0.21132. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.05it/s]
Epoch 32 Iter 147: loss 0.21132. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 32 Iter 148: loss 0.15784. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 32 Iter 148: loss 0.15784. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 32 Iter 149: loss 0.16265. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 32 Iter 149: loss 0.16265. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 32 Iter 150: loss 0.18398. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 32 Iter 150: loss 0.18398. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 32 Iter 151: loss 0.16821. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 32 Iter 151: loss 0.16821. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 32 Iter 152: loss 0.16789. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 32 Iter 152: loss 0.16789. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.19448. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 32 Iter 153: loss 0.19448. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 32 Iter 154: loss 0.19224. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 32 Iter 154: loss 0.19224. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 32 Iter 155: loss 0.18743. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 155: loss 0.18743. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 156: loss 0.16245. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 32 Iter 156: loss 0.16245. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.04it/s]
Epoch 32 Iter 157: loss 0.18359. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.04it/s]
Epoch 32 Iter 157: loss 0.18359. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 158: loss 0.18696. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 158: loss 0.18696. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.04it/s]
Epoch 32 Iter 159: loss 0.17354. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.04it/s]
Epoch 32 Iter 159: loss 0.17354. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:32,  2.03it/s]
Epoch 32 Iter 160: loss 0.14835. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:32,  2.03it/s]
Epoch 32 Iter 160: loss 0.14835. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.04it/s]
Epoch 32 Iter 161: loss 0.17232. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:31,  2.04it/s]
Epoch 32 Iter 161: loss 0.17232. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 32 Iter 162: loss 0.16611. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 32 Iter 162: loss 0.16611. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.04it/s]
Epoch 32 Iter 163: loss 0.17380. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.04it/s]
Epoch 32 Iter 163: loss 0.17380. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 32 Iter 164: loss 0.19102. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 32 Iter 164: loss 0.19102. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.05it/s]
Epoch 32 Iter 165: loss 0.17560. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.05it/s]
Epoch 32 Iter 165: loss 0.17560. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 32 Iter 166: loss 0.17538. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 32 Iter 166: loss 0.17538. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.16653. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.06it/s]
Epoch 32 Iter 167: loss 0.16653. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.18294. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 32 Iter 168: loss 0.18294. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.04it/s]
Epoch 32 Iter 169: loss 0.14427. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.04it/s]
Epoch 32 Iter 169: loss 0.14427. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 170: loss 0.19143. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 170: loss 0.19143. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.05it/s]
Epoch 32 Iter 171: loss 0.17652. :  76%|████████████████████████████████▋          | 170/224 [01:23<00:26,  2.05it/s]
Epoch 32 Iter 171: loss 0.17652. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.04it/s]
Epoch 32 Iter 172: loss 0.16974. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.04it/s]
Epoch 32 Iter 172: loss 0.16974. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.04it/s]
Epoch 32 Iter 173: loss 0.16009. :  77%|█████████████████████████████████          | 172/224 [01:24<00:25,  2.04it/s]
Epoch 32 Iter 173: loss 0.16009. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 174: loss 0.17749. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 174: loss 0.17749. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.05it/s]
Epoch 32 Iter 175: loss 0.16899. :  78%|█████████████████████████████████▍         | 174/224 [01:25<00:24,  2.05it/s]
Epoch 32 Iter 175: loss 0.16899. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 32 Iter 176: loss 0.17024. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 32 Iter 176: loss 0.17024. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 32 Iter 177: loss 0.18769. :  79%|█████████████████████████████████▊         | 176/224 [01:26<00:23,  2.06it/s]
Epoch 32 Iter 177: loss 0.18769. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 178: loss 0.17495. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 178: loss 0.17495. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 179: loss 0.18523. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 32 Iter 179: loss 0.18523. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 32 Iter 180: loss 0.17886. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 180: loss 0.17886. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 181: loss 0.17700. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 32 Iter 181: loss 0.17700. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 32 Iter 182: loss 0.17898. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 32 Iter 182: loss 0.17898. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 32 Iter 183: loss 0.18114. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 32 Iter 183: loss 0.18114. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 32 Iter 184: loss 0.17368. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 32 Iter 184: loss 0.17368. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 32 Iter 185: loss 0.18905. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 32 Iter 185: loss 0.18905. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 32 Iter 186: loss 0.19088. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.07it/s]
Epoch 32 Iter 186: loss 0.19088. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 32 Iter 187: loss 0.15989. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 32 Iter 187: loss 0.15989. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 32 Iter 188: loss 0.18907. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 32 Iter 188: loss 0.18907. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 32 Iter 189: loss 0.14915. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 32 Iter 189: loss 0.14915. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 32 Iter 190: loss 0.19112. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 32 Iter 190: loss 0.19112. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 32 Iter 191: loss 0.16291. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 32 Iter 191: loss 0.16291. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 32 Iter 192: loss 0.18165. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 32 Iter 192: loss 0.18165. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 32 Iter 193: loss 0.18768. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 32 Iter 193: loss 0.18768. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 32 Iter 194: loss 0.17888. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 32 Iter 194: loss 0.17888. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 32 Iter 195: loss 0.16034. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 32 Iter 195: loss 0.16034. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 32 Iter 196: loss 0.17424. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.06it/s]
Epoch 32 Iter 196: loss 0.17424. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 197: loss 0.17208. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 32 Iter 197: loss 0.17208. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 32 Iter 198: loss 0.18800. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.06it/s]
Epoch 32 Iter 198: loss 0.18800. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 32 Iter 199: loss 0.17173. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 32 Iter 199: loss 0.17173. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 32 Iter 200: loss 0.16792. :  89%|██████████████████████████████████████▏    | 199/224 [01:37<00:12,  2.08it/s]
Epoch 32 Iter 200: loss 0.16792. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.19143. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 32 Iter 201: loss 0.19143. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 32 Iter 202: loss 0.19898. :  90%|██████████████████████████████████████▌    | 201/224 [01:38<00:11,  2.06it/s]
Epoch 32 Iter 202: loss 0.19898. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 32 Iter 203: loss 0.18010. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 32 Iter 203: loss 0.18010. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 32 Iter 204: loss 0.17677. :  91%|██████████████████████████████████████▉    | 203/224 [01:39<00:10,  2.05it/s]
Epoch 32 Iter 204: loss 0.17677. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 205: loss 0.17668. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 205: loss 0.17668. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 32 Iter 206: loss 0.16554. :  92%|███████████████████████████████████████▎   | 205/224 [01:40<00:09,  2.06it/s]
Epoch 32 Iter 206: loss 0.16554. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 32 Iter 207: loss 0.17499. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.04it/s]
Epoch 32 Iter 207: loss 0.17499. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 32 Iter 208: loss 0.16457. :  92%|███████████████████████████████████████▋   | 207/224 [01:41<00:08,  2.06it/s]
Epoch 32 Iter 208: loss 0.16457. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 32 Iter 209: loss 0.17040. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.05it/s]
Epoch 32 Iter 209: loss 0.17040. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.03it/s]
Epoch 32 Iter 210: loss 0.16704. :  93%|████████████████████████████████████████   | 209/224 [01:42<00:07,  2.03it/s]
Epoch 32 Iter 210: loss 0.16704. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.04it/s]
Epoch 32 Iter 211: loss 0.19380. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.04it/s]
Epoch 32 Iter 211: loss 0.19380. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 32 Iter 212: loss 0.18245. :  94%|████████████████████████████████████████▌  | 211/224 [01:43<00:06,  2.05it/s]
Epoch 32 Iter 212: loss 0.18245. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.16795. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 32 Iter 213: loss 0.16795. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 32 Iter 214: loss 0.16147. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 32 Iter 214: loss 0.16147. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 32 Iter 215: loss 0.17638. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 215: loss 0.17638. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.17417. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 32 Iter 216: loss 0.17417. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 32 Iter 217: loss 0.18387. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 217: loss 0.18387. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.16415. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 32 Iter 218: loss 0.16415. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 32 Iter 219: loss 0.19267. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.04it/s]
Epoch 32 Iter 219: loss 0.19267. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 32 Iter 220: loss 0.18723. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 32 Iter 220: loss 0.18723. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 32 Iter 221: loss 0.17410. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 221: loss 0.17410. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.16734. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 32 Iter 222: loss 0.16734. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 32 Iter 223: loss 0.16543. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 223: loss 0.16543. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.16691. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.16691. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 32 Iter 224: loss 0.16691. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.18031. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 33 Iter 1: loss 0.18031. :   0%|▏                                              | 1/224 [00:00<01:45,  2.12it/s]
Epoch 33 Iter 2: loss 0.16966. :   0%|▏                                              | 1/224 [00:00<01:45,  2.12it/s]
Epoch 33 Iter 2: loss 0.16966. :   1%|▍                                              | 2/224 [00:00<01:44,  2.12it/s]
Epoch 33 Iter 3: loss 0.17551. :   1%|▍                                              | 2/224 [00:01<01:44,  2.12it/s]
Epoch 33 Iter 3: loss 0.17551. :   1%|▋                                              | 3/224 [00:01<01:44,  2.11it/s]
Epoch 33 Iter 4: loss 0.18006. :   1%|▋                                              | 3/224 [00:01<01:44,  2.11it/s]
Epoch 33 Iter 4: loss 0.18006. :   2%|▊                                              | 4/224 [00:01<01:45,  2.09it/s]
Epoch 33 Iter 5: loss 0.18139. :   2%|▊                                              | 4/224 [00:02<01:45,  2.09it/s]
Epoch 33 Iter 5: loss 0.18139. :   2%|█                                              | 5/224 [00:02<01:44,  2.10it/s]
Epoch 33 Iter 6: loss 0.17752. :   2%|█                                              | 5/224 [00:02<01:44,  2.10it/s]
Epoch 33 Iter 6: loss 0.17752. :   3%|█▎                                             | 6/224 [00:02<01:44,  2.09it/s]
Epoch 33 Iter 7: loss 0.19187. :   3%|█▎                                             | 6/224 [00:03<01:44,  2.09it/s]
Epoch 33 Iter 7: loss 0.19187. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.10it/s]
Epoch 33 Iter 8: loss 0.18753. :   3%|█▍                                             | 7/224 [00:03<01:43,  2.10it/s]
Epoch 33 Iter 8: loss 0.18753. :   4%|█▋                                             | 8/224 [00:03<01:43,  2.08it/s]
Epoch 33 Iter 9: loss 0.16111. :   4%|█▋                                             | 8/224 [00:04<01:43,  2.08it/s]
Epoch 33 Iter 9: loss 0.16111. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 33 Iter 10: loss 0.17822. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 33 Iter 10: loss 0.17822. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 33 Iter 11: loss 0.17272. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 33 Iter 11: loss 0.17272. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 33 Iter 12: loss 0.19545. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 33 Iter 12: loss 0.19545. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 33 Iter 13: loss 0.16818. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 33 Iter 13: loss 0.16818. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 33 Iter 14: loss 0.17888. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 33 Iter 14: loss 0.17888. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.08it/s]
Epoch 33 Iter 15: loss 0.15961. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.08it/s]
Epoch 33 Iter 15: loss 0.15961. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 16: loss 0.16408. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 16: loss 0.16408. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 33 Iter 17: loss 0.17072. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 17: loss 0.17072. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 18: loss 0.18828. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.07it/s]
Epoch 33 Iter 18: loss 0.18828. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 33 Iter 19: loss 0.17257. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 33 Iter 19: loss 0.17257. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 33 Iter 20: loss 0.18663. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 33 Iter 20: loss 0.18663. :   9%|████                                         | 20/224 [00:09<01:38,  2.08it/s]
Epoch 33 Iter 21: loss 0.16134. :   9%|████                                         | 20/224 [00:10<01:38,  2.08it/s]
Epoch 33 Iter 21: loss 0.16134. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 33 Iter 22: loss 0.15867. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 33 Iter 22: loss 0.15867. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 33 Iter 23: loss 0.17041. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 33 Iter 23: loss 0.17041. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 24: loss 0.17212. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 33 Iter 24: loss 0.17212. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 33 Iter 25: loss 0.19662. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 33 Iter 25: loss 0.19662. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 33 Iter 26: loss 0.16850. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 33 Iter 26: loss 0.16850. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.17756. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 27: loss 0.17756. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 28: loss 0.14458. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 33 Iter 28: loss 0.14458. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 33 Iter 29: loss 0.17986. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 33 Iter 29: loss 0.17986. :  13%|█████▊                                       | 29/224 [00:13<01:34,  2.06it/s]
Epoch 33 Iter 30: loss 0.18715. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 30: loss 0.18715. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.16818. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 33 Iter 31: loss 0.16818. :  14%|██████▏                                      | 31/224 [00:14<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.15626. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 32: loss 0.15626. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 33: loss 0.18771. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 33 Iter 33: loss 0.18771. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.08it/s]
Epoch 33 Iter 34: loss 0.16017. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 33 Iter 34: loss 0.16017. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 33 Iter 35: loss 0.15888. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 33 Iter 35: loss 0.15888. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 33 Iter 36: loss 0.16470. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 33 Iter 36: loss 0.16470. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 33 Iter 37: loss 0.16534. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 33 Iter 37: loss 0.16534. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.05it/s]
Epoch 33 Iter 38: loss 0.15167. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 33 Iter 38: loss 0.15167. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 33 Iter 39: loss 0.17093. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 33 Iter 39: loss 0.17093. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 33 Iter 40: loss 0.16691. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 33 Iter 40: loss 0.16691. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 33 Iter 41: loss 0.16120. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 33 Iter 41: loss 0.16120. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 33 Iter 42: loss 0.17876. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 33 Iter 42: loss 0.17876. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 33 Iter 43: loss 0.18773. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 33 Iter 43: loss 0.18773. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 33 Iter 44: loss 0.18848. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 33 Iter 44: loss 0.18848. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 33 Iter 45: loss 0.18208. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 33 Iter 45: loss 0.18208. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 33 Iter 46: loss 0.16442. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 33 Iter 46: loss 0.16442. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.17668. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 33 Iter 47: loss 0.17668. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 33 Iter 48: loss 0.17128. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 33 Iter 48: loss 0.17128. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 33 Iter 49: loss 0.16547. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.07it/s]
Epoch 33 Iter 49: loss 0.16547. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 33 Iter 50: loss 0.17864. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 33 Iter 50: loss 0.17864. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.09it/s]
Epoch 33 Iter 51: loss 0.18241. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.09it/s]
Epoch 33 Iter 51: loss 0.18241. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 33 Iter 52: loss 0.19438. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 33 Iter 52: loss 0.19438. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 53: loss 0.17409. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 53: loss 0.17409. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 33 Iter 54: loss 0.18392. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 33 Iter 54: loss 0.18392. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 33 Iter 55: loss 0.17840. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.09it/s]
Epoch 33 Iter 55: loss 0.17840. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 33 Iter 56: loss 0.16412. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 33 Iter 56: loss 0.16412. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 33 Iter 57: loss 0.17908. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 33 Iter 57: loss 0.17908. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 33 Iter 58: loss 0.18714. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 33 Iter 58: loss 0.18714. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 33 Iter 59: loss 0.16646. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 33 Iter 59: loss 0.16646. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.04it/s]
Epoch 33 Iter 60: loss 0.17781. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.04it/s]
Epoch 33 Iter 60: loss 0.17781. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 33 Iter 61: loss 0.17720. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.05it/s]
Epoch 33 Iter 61: loss 0.17720. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 33 Iter 62: loss 0.17260. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 33 Iter 62: loss 0.17260. :  28%|████████████▍                                | 62/224 [00:29<01:19,  2.05it/s]
Epoch 33 Iter 63: loss 0.18226. :  28%|████████████▍                                | 62/224 [00:30<01:19,  2.05it/s]
Epoch 33 Iter 63: loss 0.18226. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 33 Iter 64: loss 0.18357. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 33 Iter 64: loss 0.18357. :  29%|████████████▊                                | 64/224 [00:30<01:18,  2.05it/s]
Epoch 33 Iter 65: loss 0.19196. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 33 Iter 65: loss 0.19196. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 33 Iter 66: loss 0.14118. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 33 Iter 66: loss 0.14118. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.05it/s]
Epoch 33 Iter 67: loss 0.18228. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.05it/s]
Epoch 33 Iter 67: loss 0.18228. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 33 Iter 68: loss 0.19824. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 33 Iter 68: loss 0.19824. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 33 Iter 69: loss 0.18475. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 33 Iter 69: loss 0.18475. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 33 Iter 70: loss 0.18388. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 33 Iter 70: loss 0.18388. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 33 Iter 71: loss 0.17259. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 33 Iter 71: loss 0.17259. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 33 Iter 72: loss 0.16586. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 33 Iter 72: loss 0.16586. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 33 Iter 73: loss 0.17375. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 33 Iter 73: loss 0.17375. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 33 Iter 74: loss 0.20031. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 33 Iter 74: loss 0.20031. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 33 Iter 75: loss 0.17496. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 33 Iter 75: loss 0.17496. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 33 Iter 76: loss 0.17497. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 33 Iter 76: loss 0.17497. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.10it/s]
Epoch 33 Iter 77: loss 0.16758. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.10it/s]
Epoch 33 Iter 77: loss 0.16758. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 33 Iter 78: loss 0.17307. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 33 Iter 78: loss 0.17307. :  35%|███████████████▋                             | 78/224 [00:37<01:09,  2.10it/s]
Epoch 33 Iter 79: loss 0.17755. :  35%|███████████████▋                             | 78/224 [00:38<01:09,  2.10it/s]
Epoch 33 Iter 79: loss 0.17755. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 33 Iter 80: loss 0.17760. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 33 Iter 80: loss 0.17760. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 33 Iter 81: loss 0.15207. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 33 Iter 81: loss 0.15207. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 33 Iter 82: loss 0.18160. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 33 Iter 82: loss 0.18160. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.17477. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 33 Iter 83: loss 0.17477. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 33 Iter 84: loss 0.18207. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 33 Iter 84: loss 0.18207. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 33 Iter 85: loss 0.16153. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 85: loss 0.16153. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 86: loss 0.18045. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 33 Iter 86: loss 0.18045. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 33 Iter 87: loss 0.18095. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 33 Iter 87: loss 0.18095. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.17096. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 33 Iter 88: loss 0.17096. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 33 Iter 89: loss 0.17686. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 89: loss 0.17686. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 90: loss 0.17471. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 90: loss 0.17471. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.15644. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 33 Iter 91: loss 0.15644. :  41%|██████████████████▎                          | 91/224 [00:43<01:04,  2.06it/s]
Epoch 33 Iter 92: loss 0.18066. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 33 Iter 92: loss 0.18066. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 33 Iter 93: loss 0.16829. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 33 Iter 93: loss 0.16829. :  42%|██████████████████▋                          | 93/224 [00:44<01:03,  2.07it/s]
Epoch 33 Iter 94: loss 0.16128. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 33 Iter 94: loss 0.16128. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.17960. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 33 Iter 95: loss 0.17960. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.05it/s]
Epoch 33 Iter 96: loss 0.18341. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 33 Iter 96: loss 0.18341. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.17881. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 33 Iter 97: loss 0.17881. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.17238. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 98: loss 0.17238. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.17770. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 33 Iter 99: loss 0.17770. :  44%|███████████████████▉                         | 99/224 [00:47<01:01,  2.05it/s]
Epoch 33 Iter 100: loss 0.16686. :  44%|███████████████████▍                        | 99/224 [00:48<01:01,  2.05it/s]
Epoch 33 Iter 100: loss 0.16686. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 101: loss 0.16747. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 33 Iter 101: loss 0.16747. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 33 Iter 102: loss 0.18421. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 33 Iter 102: loss 0.18421. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 33 Iter 103: loss 0.18536. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 33 Iter 103: loss 0.18536. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 33 Iter 104: loss 0.17673. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 33 Iter 104: loss 0.17673. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 33 Iter 105: loss 0.17093. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 33 Iter 105: loss 0.17093. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 33 Iter 106: loss 0.19734. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 33 Iter 106: loss 0.19734. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 33 Iter 107: loss 0.16988. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 33 Iter 107: loss 0.16988. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 33 Iter 108: loss 0.16665. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 33 Iter 108: loss 0.16665. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 33 Iter 109: loss 0.16959. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.05it/s]
Epoch 33 Iter 109: loss 0.16959. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.18781. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 33 Iter 110: loss 0.18781. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.17681. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 33 Iter 111: loss 0.17681. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.16429. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 33 Iter 112: loss 0.16429. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 33 Iter 113: loss 0.16439. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 33 Iter 113: loss 0.16439. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 33 Iter 114: loss 0.18994. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 33 Iter 114: loss 0.18994. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 33 Iter 115: loss 0.19439. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 33 Iter 115: loss 0.19439. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 33 Iter 116: loss 0.17639. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 33 Iter 116: loss 0.17639. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 33 Iter 117: loss 0.15595. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 33 Iter 117: loss 0.15595. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.04it/s]
Epoch 33 Iter 118: loss 0.17893. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.04it/s]
Epoch 33 Iter 118: loss 0.17893. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 33 Iter 119: loss 0.17020. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 33 Iter 119: loss 0.17020. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 33 Iter 120: loss 0.18842. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 33 Iter 120: loss 0.18842. :  54%|███████████████████████                    | 120/224 [00:58<00:51,  2.04it/s]
Epoch 33 Iter 121: loss 0.18384. :  54%|███████████████████████                    | 120/224 [00:58<00:51,  2.04it/s]
Epoch 33 Iter 121: loss 0.18384. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 33 Iter 122: loss 0.18730. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 33 Iter 122: loss 0.18730. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 33 Iter 123: loss 0.15372. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 33 Iter 123: loss 0.15372. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.16602. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 33 Iter 124: loss 0.16602. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 33 Iter 125: loss 0.17620. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 33 Iter 125: loss 0.17620. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 33 Iter 126: loss 0.15252. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 33 Iter 126: loss 0.15252. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 33 Iter 127: loss 0.17133. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 33 Iter 127: loss 0.17133. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 33 Iter 128: loss 0.19307. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 33 Iter 128: loss 0.19307. :  57%|████████████████████████▌                  | 128/224 [01:01<00:47,  2.04it/s]
Epoch 33 Iter 129: loss 0.18862. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 33 Iter 129: loss 0.18862. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.04it/s]
Epoch 33 Iter 130: loss 0.18164. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.04it/s]
Epoch 33 Iter 130: loss 0.18164. :  58%|████████████████████████▉                  | 130/224 [01:02<00:46,  2.04it/s]
Epoch 33 Iter 131: loss 0.16810. :  58%|████████████████████████▉                  | 130/224 [01:03<00:46,  2.04it/s]
Epoch 33 Iter 131: loss 0.16810. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 33 Iter 132: loss 0.18832. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 33 Iter 132: loss 0.18832. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 33 Iter 133: loss 0.16529. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 33 Iter 133: loss 0.16529. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 33 Iter 134: loss 0.18782. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 33 Iter 134: loss 0.18782. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 33 Iter 135: loss 0.18044. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 135: loss 0.18044. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 136: loss 0.19253. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 33 Iter 136: loss 0.19253. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 33 Iter 137: loss 0.15827. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 137: loss 0.15827. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 138: loss 0.17491. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 33 Iter 138: loss 0.17491. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.18091. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 139: loss 0.18091. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.17605. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 33 Iter 140: loss 0.17605. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.16856. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 33 Iter 141: loss 0.16856. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 33 Iter 142: loss 0.18253. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 33 Iter 142: loss 0.18253. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 33 Iter 143: loss 0.15099. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 33 Iter 143: loss 0.15099. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.16694. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 33 Iter 144: loss 0.16694. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 33 Iter 145: loss 0.16922. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 33 Iter 145: loss 0.16922. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 33 Iter 146: loss 0.18672. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.08it/s]
Epoch 33 Iter 146: loss 0.18672. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 33 Iter 147: loss 0.17289. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 33 Iter 147: loss 0.17289. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.17506. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 33 Iter 148: loss 0.17506. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.16300. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 33 Iter 149: loss 0.16300. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 33 Iter 150: loss 0.18047. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 33 Iter 150: loss 0.18047. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 33 Iter 151: loss 0.17529. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 33 Iter 151: loss 0.17529. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 33 Iter 152: loss 0.18455. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 33 Iter 152: loss 0.18455. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 33 Iter 153: loss 0.18334. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 33 Iter 153: loss 0.18334. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 33 Iter 154: loss 0.16539. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 33 Iter 154: loss 0.16539. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 33 Iter 155: loss 0.18149. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 155: loss 0.18149. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 156: loss 0.19418. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 33 Iter 156: loss 0.19418. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 33 Iter 157: loss 0.18390. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.06it/s]
Epoch 33 Iter 157: loss 0.18390. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 33 Iter 158: loss 0.18581. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 33 Iter 158: loss 0.18581. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 33 Iter 159: loss 0.19865. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 33 Iter 159: loss 0.19865. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 33 Iter 160: loss 0.16126. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 160: loss 0.16126. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 161: loss 0.18152. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 33 Iter 161: loss 0.18152. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.05it/s]
Epoch 33 Iter 162: loss 0.17423. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.05it/s]
Epoch 33 Iter 162: loss 0.17423. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 163: loss 0.17334. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 33 Iter 163: loss 0.17334. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.05it/s]
Epoch 33 Iter 164: loss 0.17080. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.05it/s]
Epoch 33 Iter 164: loss 0.17080. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 33 Iter 165: loss 0.17669. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 33 Iter 165: loss 0.17669. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.05it/s]
Epoch 33 Iter 166: loss 0.19530. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 166: loss 0.19530. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 167: loss 0.17002. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 33 Iter 167: loss 0.17002. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 33 Iter 168: loss 0.16452. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 33 Iter 168: loss 0.16452. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 33 Iter 169: loss 0.17880. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 33 Iter 169: loss 0.17880. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.04it/s]
Epoch 33 Iter 170: loss 0.17973. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.04it/s]
Epoch 33 Iter 170: loss 0.17973. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 33 Iter 171: loss 0.20066. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 33 Iter 171: loss 0.20066. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 33 Iter 172: loss 0.16796. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 33 Iter 172: loss 0.16796. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.17425. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 33 Iter 173: loss 0.17425. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 33 Iter 174: loss 0.16244. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 33 Iter 174: loss 0.16244. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 33 Iter 175: loss 0.16241. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 33 Iter 175: loss 0.16241. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 33 Iter 176: loss 0.17621. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 33 Iter 176: loss 0.17621. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 33 Iter 177: loss 0.17257. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 33 Iter 177: loss 0.17257. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 33 Iter 178: loss 0.17100. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 33 Iter 178: loss 0.17100. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 33 Iter 179: loss 0.17229. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 33 Iter 179: loss 0.17229. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 33 Iter 180: loss 0.18886. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 33 Iter 180: loss 0.18886. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 33 Iter 181: loss 0.17234. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 33 Iter 181: loss 0.17234. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 33 Iter 182: loss 0.17754. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 33 Iter 182: loss 0.17754. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 33 Iter 183: loss 0.20181. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 33 Iter 183: loss 0.20181. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 33 Iter 184: loss 0.19851. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 184: loss 0.19851. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 185: loss 0.18848. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 33 Iter 185: loss 0.18848. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.05it/s]
Epoch 33 Iter 186: loss 0.17120. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.05it/s]
Epoch 33 Iter 186: loss 0.17120. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 33 Iter 187: loss 0.16988. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 33 Iter 187: loss 0.16988. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.05it/s]
Epoch 33 Iter 188: loss 0.17182. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.05it/s]
Epoch 33 Iter 188: loss 0.17182. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 33 Iter 189: loss 0.16782. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 33 Iter 189: loss 0.16782. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 33 Iter 190: loss 0.16851. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 33 Iter 190: loss 0.16851. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 33 Iter 191: loss 0.18223. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 33 Iter 191: loss 0.18223. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 33 Iter 192: loss 0.15745. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 33 Iter 192: loss 0.15745. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 33 Iter 193: loss 0.19645. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 33 Iter 193: loss 0.19645. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 33 Iter 194: loss 0.16881. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 33 Iter 194: loss 0.16881. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.17780. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 195: loss 0.17780. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 196: loss 0.15048. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 33 Iter 196: loss 0.15048. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 33 Iter 197: loss 0.18135. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 33 Iter 197: loss 0.18135. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 33 Iter 198: loss 0.16981. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 33 Iter 198: loss 0.16981. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 33 Iter 199: loss 0.17467. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 33 Iter 199: loss 0.17467. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 33 Iter 200: loss 0.17341. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 33 Iter 200: loss 0.17341. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 33 Iter 201: loss 0.17050. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 201: loss 0.17050. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 202: loss 0.19135. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 33 Iter 202: loss 0.19135. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 33 Iter 203: loss 0.17684. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 203: loss 0.17684. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.19169. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 33 Iter 204: loss 0.19169. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 33 Iter 205: loss 0.17030. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 33 Iter 205: loss 0.17030. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.16552. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 33 Iter 206: loss 0.16552. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.17715. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 207: loss 0.17715. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 208: loss 0.18693. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 33 Iter 208: loss 0.18693. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.18325. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 33 Iter 209: loss 0.18325. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 33 Iter 210: loss 0.19513. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 33 Iter 210: loss 0.19513. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.17708. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 33 Iter 211: loss 0.17708. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 33 Iter 212: loss 0.19379. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 33 Iter 212: loss 0.19379. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.09it/s]
Epoch 33 Iter 213: loss 0.18238. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.09it/s]
Epoch 33 Iter 213: loss 0.18238. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 33 Iter 214: loss 0.16569. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.09it/s]
Epoch 33 Iter 214: loss 0.16569. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 33 Iter 215: loss 0.16269. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 215: loss 0.16269. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 216: loss 0.16912. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 33 Iter 216: loss 0.16912. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 33 Iter 217: loss 0.18780. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 33 Iter 217: loss 0.18780. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 218: loss 0.18030. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 33 Iter 218: loss 0.18030. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 33 Iter 219: loss 0.14971. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 33 Iter 219: loss 0.14971. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.18610. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 33 Iter 220: loss 0.18610. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.17712. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 33 Iter 221: loss 0.17712. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 33 Iter 222: loss 0.17902. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 33 Iter 222: loss 0.17902. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 33 Iter 223: loss 0.16290. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 33 Iter 223: loss 0.16290. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 33 Iter 224: loss 0.16898. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.04it/s]
Epoch 33 Iter 224: loss 0.16898. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 33 Iter 224: loss 0.16898. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17565
    Valid loss: 0.17985
       Valid loss recons: 0.17347
       Valid loss KL-D:   63.732
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.17530. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 34 Iter 1: loss 0.17530. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 34 Iter 2: loss 0.17738. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 34 Iter 2: loss 0.17738. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.16341. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 34 Iter 3: loss 0.16341. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 34 Iter 4: loss 0.17669. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 34 Iter 4: loss 0.17669. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 34 Iter 5: loss 0.19665. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 34 Iter 5: loss 0.19665. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 34 Iter 6: loss 0.17447. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 34 Iter 6: loss 0.17447. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.06it/s]
Epoch 34 Iter 7: loss 0.18482. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.06it/s]
Epoch 34 Iter 7: loss 0.18482. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 8: loss 0.18379. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 34 Iter 8: loss 0.18379. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 34 Iter 9: loss 0.18190. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 34 Iter 9: loss 0.18190. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 10: loss 0.16116. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 10: loss 0.16116. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.15822. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 34 Iter 11: loss 0.15822. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 34 Iter 12: loss 0.17807. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 34 Iter 12: loss 0.17807. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 34 Iter 13: loss 0.18853. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 34 Iter 13: loss 0.18853. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 34 Iter 14: loss 0.16466. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 34 Iter 14: loss 0.16466. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 34 Iter 15: loss 0.16421. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 34 Iter 15: loss 0.16421. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 34 Iter 16: loss 0.17850. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 34 Iter 16: loss 0.17850. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 34 Iter 17: loss 0.18021. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 34 Iter 17: loss 0.18021. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 34 Iter 18: loss 0.18997. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 34 Iter 18: loss 0.18997. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.04it/s]
Epoch 34 Iter 19: loss 0.19723. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.04it/s]
Epoch 34 Iter 19: loss 0.19723. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 34 Iter 20: loss 0.16538. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 34 Iter 20: loss 0.16538. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.16941. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 34 Iter 21: loss 0.16941. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 34 Iter 22: loss 0.16518. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 34 Iter 22: loss 0.16518. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 34 Iter 23: loss 0.19966. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 34 Iter 23: loss 0.19966. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 34 Iter 24: loss 0.18911. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 34 Iter 24: loss 0.18911. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 34 Iter 25: loss 0.15058. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 34 Iter 25: loss 0.15058. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 26: loss 0.17691. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 26: loss 0.17691. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 34 Iter 27: loss 0.16675. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 34 Iter 27: loss 0.16675. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 34 Iter 28: loss 0.16619. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 34 Iter 28: loss 0.16619. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.06it/s]
Epoch 34 Iter 29: loss 0.15012. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.06it/s]
Epoch 34 Iter 29: loss 0.15012. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 34 Iter 30: loss 0.18390. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 34 Iter 30: loss 0.18390. :  13%|██████                                       | 30/224 [00:14<01:33,  2.06it/s]
Epoch 34 Iter 31: loss 0.17325. :  13%|██████                                       | 30/224 [00:15<01:33,  2.06it/s]
Epoch 34 Iter 31: loss 0.17325. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 34 Iter 32: loss 0.17554. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 34 Iter 32: loss 0.17554. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 34 Iter 33: loss 0.17350. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.08it/s]
Epoch 34 Iter 33: loss 0.17350. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 34 Iter 34: loss 0.19270. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 34 Iter 34: loss 0.19270. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 34 Iter 35: loss 0.17018. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 34 Iter 35: loss 0.17018. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 34 Iter 36: loss 0.17172. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 36: loss 0.17172. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 37: loss 0.17052. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 34 Iter 37: loss 0.17052. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 34 Iter 38: loss 0.17189. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 38: loss 0.17189. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 39: loss 0.16262. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 34 Iter 39: loss 0.16262. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 34 Iter 40: loss 0.16252. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 34 Iter 40: loss 0.16252. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 34 Iter 41: loss 0.15369. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 34 Iter 41: loss 0.15369. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 34 Iter 42: loss 0.19773. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 34 Iter 42: loss 0.19773. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 34 Iter 43: loss 0.15520. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 34 Iter 43: loss 0.15520. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 34 Iter 44: loss 0.17263. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 34 Iter 44: loss 0.17263. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 34 Iter 45: loss 0.16928. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 34 Iter 45: loss 0.16928. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 34 Iter 46: loss 0.16375. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 34 Iter 46: loss 0.16375. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 47: loss 0.16273. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 47: loss 0.16273. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.18367. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 34 Iter 48: loss 0.18367. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 34 Iter 49: loss 0.18746. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 34 Iter 49: loss 0.18746. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 34 Iter 50: loss 0.17346. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 34 Iter 50: loss 0.17346. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 34 Iter 51: loss 0.17329. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 34 Iter 51: loss 0.17329. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 34 Iter 52: loss 0.16726. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 34 Iter 52: loss 0.16726. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 34 Iter 53: loss 0.16053. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 34 Iter 53: loss 0.16053. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 34 Iter 54: loss 0.17652. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 34 Iter 54: loss 0.17652. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 34 Iter 55: loss 0.19687. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 34 Iter 55: loss 0.19687. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 34 Iter 56: loss 0.17822. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 34 Iter 56: loss 0.17822. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 34 Iter 57: loss 0.18164. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 34 Iter 57: loss 0.18164. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 34 Iter 58: loss 0.18800. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 58: loss 0.18800. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.16281. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 34 Iter 59: loss 0.16281. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.21066. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 60: loss 0.21066. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.17471. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 34 Iter 61: loss 0.17471. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 34 Iter 62: loss 0.18685. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 34 Iter 62: loss 0.18685. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.17971. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 63: loss 0.17971. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.16165. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 34 Iter 64: loss 0.16165. :  29%|████████████▊                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 34 Iter 65: loss 0.19610. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 65: loss 0.19610. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 66: loss 0.17872. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 66: loss 0.17872. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 34 Iter 67: loss 0.16481. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 34 Iter 67: loss 0.16481. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 34 Iter 68: loss 0.19103. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 34 Iter 68: loss 0.19103. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 34 Iter 69: loss 0.17439. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 34 Iter 69: loss 0.17439. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 70: loss 0.19546. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 70: loss 0.19546. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.19882. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 34 Iter 71: loss 0.19882. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 34 Iter 72: loss 0.15737. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 34 Iter 72: loss 0.15737. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.08it/s]
Epoch 34 Iter 73: loss 0.16835. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.08it/s]
Epoch 34 Iter 73: loss 0.16835. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 34 Iter 74: loss 0.19730. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 34 Iter 74: loss 0.19730. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 34 Iter 75: loss 0.18558. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 34 Iter 75: loss 0.18558. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 34 Iter 76: loss 0.20001. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 34 Iter 76: loss 0.20001. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 34 Iter 77: loss 0.16726. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 34 Iter 77: loss 0.16726. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 78: loss 0.17962. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 34 Iter 78: loss 0.17962. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 34 Iter 79: loss 0.18119. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 34 Iter 79: loss 0.18119. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 34 Iter 80: loss 0.15937. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 34 Iter 80: loss 0.15937. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 34 Iter 81: loss 0.18244. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 34 Iter 81: loss 0.18244. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 34 Iter 82: loss 0.18253. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 34 Iter 82: loss 0.18253. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 34 Iter 83: loss 0.20025. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 34 Iter 83: loss 0.20025. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 34 Iter 84: loss 0.16941. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 34 Iter 84: loss 0.16941. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.16670. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 34 Iter 85: loss 0.16670. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 34 Iter 86: loss 0.17122. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 34 Iter 86: loss 0.17122. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 34 Iter 87: loss 0.14293. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 34 Iter 87: loss 0.14293. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 34 Iter 88: loss 0.16547. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 34 Iter 88: loss 0.16547. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 34 Iter 89: loss 0.16101. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 34 Iter 89: loss 0.16101. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 90: loss 0.17854. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 90: loss 0.17854. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.06it/s]
Epoch 34 Iter 91: loss 0.19280. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.06it/s]
Epoch 34 Iter 91: loss 0.19280. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 34 Iter 92: loss 0.15806. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 34 Iter 92: loss 0.15806. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 34 Iter 93: loss 0.16468. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.06it/s]
Epoch 34 Iter 93: loss 0.16468. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 34 Iter 94: loss 0.16180. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.05it/s]
Epoch 34 Iter 94: loss 0.16180. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 34 Iter 95: loss 0.18340. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 34 Iter 95: loss 0.18340. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 34 Iter 96: loss 0.18531. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 34 Iter 96: loss 0.18531. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.16983. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.04it/s]
Epoch 34 Iter 97: loss 0.16983. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 34 Iter 98: loss 0.18131. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 34 Iter 98: loss 0.18131. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 34 Iter 99: loss 0.17685. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 34 Iter 99: loss 0.17685. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 34 Iter 100: loss 0.16393. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 34 Iter 100: loss 0.16393. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 34 Iter 101: loss 0.17992. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 34 Iter 101: loss 0.17992. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 34 Iter 102: loss 0.17633. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 34 Iter 102: loss 0.17633. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 34 Iter 103: loss 0.15613. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 34 Iter 103: loss 0.15613. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 34 Iter 104: loss 0.15370. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 34 Iter 104: loss 0.15370. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 34 Iter 105: loss 0.21278. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 34 Iter 105: loss 0.21278. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 34 Iter 106: loss 0.17614. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 34 Iter 106: loss 0.17614. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 34 Iter 107: loss 0.17779. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 34 Iter 107: loss 0.17779. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 34 Iter 108: loss 0.16777. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 34 Iter 108: loss 0.16777. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 34 Iter 109: loss 0.17163. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 34 Iter 109: loss 0.17163. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 34 Iter 110: loss 0.17548. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 110: loss 0.17548. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.16734. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 34 Iter 111: loss 0.16734. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 34 Iter 112: loss 0.18946. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 112: loss 0.18946. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 113: loss 0.18849. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 34 Iter 113: loss 0.18849. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 34 Iter 114: loss 0.17403. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 34 Iter 114: loss 0.17403. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 34 Iter 115: loss 0.18617. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 34 Iter 115: loss 0.18617. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 34 Iter 116: loss 0.16991. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 34 Iter 116: loss 0.16991. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 34 Iter 117: loss 0.20217. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 34 Iter 117: loss 0.20217. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 34 Iter 118: loss 0.19301. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 34 Iter 118: loss 0.19301. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 34 Iter 119: loss 0.17167. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 34 Iter 119: loss 0.17167. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.06it/s]
Epoch 34 Iter 120: loss 0.16717. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.06it/s]
Epoch 34 Iter 120: loss 0.16717. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 34 Iter 121: loss 0.18728. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 34 Iter 121: loss 0.18728. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 34 Iter 122: loss 0.18264. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 34 Iter 122: loss 0.18264. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 34 Iter 123: loss 0.17405. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 34 Iter 123: loss 0.17405. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 34 Iter 124: loss 0.17556. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 124: loss 0.17556. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 125: loss 0.16429. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 125: loss 0.16429. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 34 Iter 126: loss 0.17463. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 34 Iter 126: loss 0.17463. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 34 Iter 127: loss 0.15375. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 34 Iter 127: loss 0.15375. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 34 Iter 128: loss 0.19311. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 34 Iter 128: loss 0.19311. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 34 Iter 129: loss 0.17539. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 34 Iter 129: loss 0.17539. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 34 Iter 130: loss 0.17584. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 34 Iter 130: loss 0.17584. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.05it/s]
Epoch 34 Iter 131: loss 0.18930. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 34 Iter 131: loss 0.18930. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 34 Iter 132: loss 0.17725. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 34 Iter 132: loss 0.17725. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 34 Iter 133: loss 0.17187. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 133: loss 0.17187. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.17640. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 34 Iter 134: loss 0.17640. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.05it/s]
Epoch 34 Iter 135: loss 0.16385. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 135: loss 0.16385. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.17687. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 34 Iter 136: loss 0.17687. :  61%|██████████████████████████                 | 136/224 [01:05<00:43,  2.04it/s]
Epoch 34 Iter 137: loss 0.18190. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 34 Iter 137: loss 0.18190. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 34 Iter 138: loss 0.16646. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 34 Iter 138: loss 0.16646. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 34 Iter 139: loss 0.18325. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 34 Iter 139: loss 0.18325. :  62%|██████████████████████████▋                | 139/224 [01:07<00:42,  2.01it/s]
Epoch 34 Iter 140: loss 0.18209. :  62%|██████████████████████████▋                | 139/224 [01:07<00:42,  2.01it/s]
Epoch 34 Iter 140: loss 0.18209. :  62%|██████████████████████████▉                | 140/224 [01:07<00:41,  2.02it/s]
Epoch 34 Iter 141: loss 0.16679. :  62%|██████████████████████████▉                | 140/224 [01:08<00:41,  2.02it/s]
Epoch 34 Iter 141: loss 0.16679. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 34 Iter 142: loss 0.15799. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.04it/s]
Epoch 34 Iter 142: loss 0.15799. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.18793. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 143: loss 0.18793. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.16744. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 34 Iter 144: loss 0.16744. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.05it/s]
Epoch 34 Iter 145: loss 0.17830. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.05it/s]
Epoch 34 Iter 145: loss 0.17830. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.16947. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 34 Iter 146: loss 0.16947. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 34 Iter 147: loss 0.17133. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 147: loss 0.17133. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.17024. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 34 Iter 148: loss 0.17024. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.18529. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 149: loss 0.18529. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 150: loss 0.18446. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 34 Iter 150: loss 0.18446. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.17188. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 34 Iter 151: loss 0.17188. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.16877. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 152: loss 0.16877. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 34 Iter 153: loss 0.19489. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 34 Iter 153: loss 0.19489. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 34 Iter 154: loss 0.17846. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.05it/s]
Epoch 34 Iter 154: loss 0.17846. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:34,  2.02it/s]
Epoch 34 Iter 155: loss 0.17592. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:34,  2.02it/s]
Epoch 34 Iter 155: loss 0.17592. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 34 Iter 156: loss 0.18237. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.05it/s]
Epoch 34 Iter 156: loss 0.18237. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:33,  2.05it/s]
Epoch 34 Iter 157: loss 0.15856. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:33,  2.05it/s]
Epoch 34 Iter 157: loss 0.15856. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 158: loss 0.18474. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 158: loss 0.18474. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.16110. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:32,  2.05it/s]
Epoch 34 Iter 159: loss 0.16110. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 34 Iter 160: loss 0.17322. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 34 Iter 160: loss 0.17322. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 34 Iter 161: loss 0.16713. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 34 Iter 161: loss 0.16713. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 34 Iter 162: loss 0.17959. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 34 Iter 162: loss 0.17959. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 34 Iter 163: loss 0.16909. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 34 Iter 163: loss 0.16909. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 34 Iter 164: loss 0.17755. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 34 Iter 164: loss 0.17755. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 34 Iter 165: loss 0.17666. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:29,  2.07it/s]
Epoch 34 Iter 165: loss 0.17666. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 34 Iter 166: loss 0.18017. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 34 Iter 166: loss 0.18017. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 34 Iter 167: loss 0.18428. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 34 Iter 167: loss 0.18428. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 34 Iter 168: loss 0.18051. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 34 Iter 168: loss 0.18051. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 34 Iter 169: loss 0.16313. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 34 Iter 169: loss 0.16313. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 34 Iter 170: loss 0.18596. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 34 Iter 170: loss 0.18596. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 34 Iter 171: loss 0.15358. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 34 Iter 171: loss 0.15358. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 34 Iter 172: loss 0.16672. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 34 Iter 172: loss 0.16672. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 173: loss 0.18598. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 34 Iter 173: loss 0.18598. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.15416. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 174: loss 0.15416. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.17406. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 34 Iter 175: loss 0.17406. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.17825. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 176: loss 0.17825. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.17813. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 34 Iter 177: loss 0.17813. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.20642. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 34 Iter 178: loss 0.20642. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 34 Iter 179: loss 0.16689. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 34 Iter 179: loss 0.16689. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.05it/s]
Epoch 34 Iter 180: loss 0.17520. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.05it/s]
Epoch 34 Iter 180: loss 0.17520. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.17519. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 34 Iter 181: loss 0.17519. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.17213. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 182: loss 0.17213. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 183: loss 0.17931. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 34 Iter 183: loss 0.17931. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.20922. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 34 Iter 184: loss 0.20922. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.14538. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 34 Iter 185: loss 0.14538. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.19259. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 186: loss 0.19259. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.18233. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 34 Iter 187: loss 0.18233. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 34 Iter 188: loss 0.15183. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 188: loss 0.15183. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.17265. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 34 Iter 189: loss 0.17265. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.16742. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 34 Iter 190: loss 0.16742. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 34 Iter 191: loss 0.18474. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 34 Iter 191: loss 0.18474. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 34 Iter 192: loss 0.16948. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 34 Iter 192: loss 0.16948. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 34 Iter 193: loss 0.15752. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 34 Iter 193: loss 0.15752. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 34 Iter 194: loss 0.16927. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 34 Iter 194: loss 0.16927. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 34 Iter 195: loss 0.18538. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 34 Iter 195: loss 0.18538. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 34 Iter 196: loss 0.18871. :  87%|█████████████████████████████████████▍     | 195/224 [01:35<00:14,  2.07it/s]
Epoch 34 Iter 196: loss 0.18871. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 34 Iter 197: loss 0.18748. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 34 Iter 197: loss 0.18748. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 34 Iter 198: loss 0.17798. :  88%|█████████████████████████████████████▊     | 197/224 [01:36<00:13,  2.05it/s]
Epoch 34 Iter 198: loss 0.17798. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 199: loss 0.18249. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 199: loss 0.18249. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 200: loss 0.16900. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 34 Iter 200: loss 0.16900. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 34 Iter 201: loss 0.16991. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 201: loss 0.16991. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.17558. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 34 Iter 202: loss 0.17558. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 34 Iter 203: loss 0.17134. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 203: loss 0.17134. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.16967. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 34 Iter 204: loss 0.16967. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.18309. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 34 Iter 205: loss 0.18309. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 34 Iter 206: loss 0.16821. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 34 Iter 206: loss 0.16821. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 34 Iter 207: loss 0.16591. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 207: loss 0.16591. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 208: loss 0.15999. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 34 Iter 208: loss 0.15999. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.17480. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 34 Iter 209: loss 0.17480. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.17405. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.05it/s]
Epoch 34 Iter 210: loss 0.17405. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.17050. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 211: loss 0.17050. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.16828. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 34 Iter 212: loss 0.16828. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.17607. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 34 Iter 213: loss 0.17607. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 34 Iter 214: loss 0.17341. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 34 Iter 214: loss 0.17341. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 34 Iter 215: loss 0.17590. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 34 Iter 215: loss 0.17590. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 34 Iter 216: loss 0.16485. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 34 Iter 216: loss 0.16485. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 34 Iter 217: loss 0.18611. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 34 Iter 217: loss 0.18611. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 34 Iter 218: loss 0.16454. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 34 Iter 218: loss 0.16454. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.05it/s]
Epoch 34 Iter 219: loss 0.16818. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 219: loss 0.16818. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 220: loss 0.17410. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 34 Iter 220: loss 0.17410. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 34 Iter 221: loss 0.19053. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.06it/s]
Epoch 34 Iter 221: loss 0.19053. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 34 Iter 222: loss 0.16676. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 34 Iter 222: loss 0.16676. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.18340. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 34 Iter 223: loss 0.18340. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 34 Iter 224: loss 0.17371. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 34 Iter 224: loss 0.17371. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 34 Iter 224: loss 0.17371. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.15920. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 35 Iter 1: loss 0.15920. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 35 Iter 2: loss 0.18295. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 35 Iter 2: loss 0.18295. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 35 Iter 3: loss 0.17747. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 35 Iter 3: loss 0.17747. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.18143. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 35 Iter 4: loss 0.18143. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.18079. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 35 Iter 5: loss 0.18079. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 35 Iter 6: loss 0.18044. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 35 Iter 6: loss 0.18044. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 35 Iter 7: loss 0.18038. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 35 Iter 7: loss 0.18038. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 35 Iter 8: loss 0.17683. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 35 Iter 8: loss 0.17683. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 35 Iter 9: loss 0.17131. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 35 Iter 9: loss 0.17131. :   4%|█▉                                             | 9/224 [00:04<01:45,  2.04it/s]
Epoch 35 Iter 10: loss 0.16275. :   4%|█▊                                            | 9/224 [00:04<01:45,  2.04it/s]
Epoch 35 Iter 10: loss 0.16275. :   4%|██                                           | 10/224 [00:04<01:44,  2.04it/s]
Epoch 35 Iter 11: loss 0.17574. :   4%|██                                           | 10/224 [00:05<01:44,  2.04it/s]
Epoch 35 Iter 11: loss 0.17574. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 35 Iter 12: loss 0.16434. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 35 Iter 12: loss 0.16434. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 35 Iter 13: loss 0.18745. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 35 Iter 13: loss 0.18745. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 35 Iter 14: loss 0.16048. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 35 Iter 14: loss 0.16048. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.06it/s]
Epoch 35 Iter 15: loss 0.17216. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.06it/s]
Epoch 35 Iter 15: loss 0.17216. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 35 Iter 16: loss 0.18690. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 35 Iter 16: loss 0.18690. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.04it/s]
Epoch 35 Iter 17: loss 0.15842. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.04it/s]
Epoch 35 Iter 17: loss 0.15842. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 35 Iter 18: loss 0.16964. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 35 Iter 18: loss 0.16964. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 35 Iter 19: loss 0.18661. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 35 Iter 19: loss 0.18661. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 35 Iter 20: loss 0.19402. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 35 Iter 20: loss 0.19402. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 35 Iter 21: loss 0.16977. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 35 Iter 21: loss 0.16977. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 35 Iter 22: loss 0.19402. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 35 Iter 22: loss 0.19402. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.05it/s]
Epoch 35 Iter 23: loss 0.17540. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.05it/s]
Epoch 35 Iter 23: loss 0.17540. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 35 Iter 24: loss 0.18044. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.05it/s]
Epoch 35 Iter 24: loss 0.18044. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 35 Iter 25: loss 0.17457. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 35 Iter 25: loss 0.17457. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 35 Iter 26: loss 0.17853. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 35 Iter 26: loss 0.17853. :  12%|█████▏                                       | 26/224 [00:12<01:37,  2.04it/s]
Epoch 35 Iter 27: loss 0.16360. :  12%|█████▏                                       | 26/224 [00:13<01:37,  2.04it/s]
Epoch 35 Iter 27: loss 0.16360. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 35 Iter 28: loss 0.17584. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 35 Iter 28: loss 0.17584. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.04it/s]
Epoch 35 Iter 29: loss 0.16641. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.04it/s]
Epoch 35 Iter 29: loss 0.16641. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 35 Iter 30: loss 0.18204. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 35 Iter 30: loss 0.18204. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 35 Iter 31: loss 0.17290. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 35 Iter 31: loss 0.17290. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 35 Iter 32: loss 0.17255. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 35 Iter 32: loss 0.17255. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 35 Iter 33: loss 0.18384. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 35 Iter 33: loss 0.18384. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.19916. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 34: loss 0.19916. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 35 Iter 35: loss 0.17651. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 35 Iter 35: loss 0.17651. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 35 Iter 36: loss 0.18366. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 35 Iter 36: loss 0.18366. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 35 Iter 37: loss 0.16143. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.07it/s]
Epoch 35 Iter 37: loss 0.16143. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 35 Iter 38: loss 0.17434. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 38: loss 0.17434. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 39: loss 0.18272. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.07it/s]
Epoch 35 Iter 39: loss 0.18272. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 35 Iter 40: loss 0.17944. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 35 Iter 40: loss 0.17944. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.16785. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 35 Iter 41: loss 0.16785. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.16922. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 35 Iter 42: loss 0.16922. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 35 Iter 43: loss 0.19166. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.07it/s]
Epoch 35 Iter 43: loss 0.19166. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 35 Iter 44: loss 0.18659. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 35 Iter 44: loss 0.18659. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 35 Iter 45: loss 0.15823. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.07it/s]
Epoch 35 Iter 45: loss 0.15823. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 35 Iter 46: loss 0.17398. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 35 Iter 46: loss 0.17398. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 35 Iter 47: loss 0.16210. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.08it/s]
Epoch 35 Iter 47: loss 0.16210. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 35 Iter 48: loss 0.18647. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 35 Iter 48: loss 0.18647. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 49: loss 0.18965. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 49: loss 0.18965. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 35 Iter 50: loss 0.18596. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 35 Iter 50: loss 0.18596. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 35 Iter 51: loss 0.17106. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 35 Iter 51: loss 0.17106. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 35 Iter 52: loss 0.17905. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 35 Iter 52: loss 0.17905. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.05it/s]
Epoch 35 Iter 53: loss 0.19170. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.05it/s]
Epoch 35 Iter 53: loss 0.19170. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.06it/s]
Epoch 35 Iter 54: loss 0.18345. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.06it/s]
Epoch 35 Iter 54: loss 0.18345. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 35 Iter 55: loss 0.19101. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 35 Iter 55: loss 0.19101. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.06it/s]
Epoch 35 Iter 56: loss 0.16658. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 56: loss 0.16658. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 57: loss 0.17996. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 35 Iter 57: loss 0.17996. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 35 Iter 58: loss 0.18008. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 35 Iter 58: loss 0.18008. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.16006. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 35 Iter 59: loss 0.16006. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 35 Iter 60: loss 0.19928. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 35 Iter 60: loss 0.19928. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 35 Iter 61: loss 0.18539. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 35 Iter 61: loss 0.18539. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 35 Iter 62: loss 0.16491. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 35 Iter 62: loss 0.16491. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 35 Iter 63: loss 0.17233. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 35 Iter 63: loss 0.17233. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 35 Iter 64: loss 0.18777. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 35 Iter 64: loss 0.18777. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 65: loss 0.19028. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 65: loss 0.19028. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 35 Iter 66: loss 0.16580. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 35 Iter 66: loss 0.16580. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 67: loss 0.18807. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 67: loss 0.18807. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.16478. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 35 Iter 68: loss 0.16478. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.05it/s]
Epoch 35 Iter 69: loss 0.18565. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.05it/s]
Epoch 35 Iter 69: loss 0.18565. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 35 Iter 70: loss 0.17577. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 35 Iter 70: loss 0.17577. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 35 Iter 71: loss 0.17074. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 35 Iter 71: loss 0.17074. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 35 Iter 72: loss 0.16010. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 35 Iter 72: loss 0.16010. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 35 Iter 73: loss 0.16634. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 35 Iter 73: loss 0.16634. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 35 Iter 74: loss 0.16468. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 35 Iter 74: loss 0.16468. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 35 Iter 75: loss 0.17077. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 35 Iter 75: loss 0.17077. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 35 Iter 76: loss 0.17905. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 35 Iter 76: loss 0.17905. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.07it/s]
Epoch 35 Iter 77: loss 0.16999. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 77: loss 0.16999. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 78: loss 0.18226. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 35 Iter 78: loss 0.18226. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 35 Iter 79: loss 0.16538. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 35 Iter 79: loss 0.16538. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 35 Iter 80: loss 0.17923. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 35 Iter 80: loss 0.17923. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 35 Iter 81: loss 0.15160. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 35 Iter 81: loss 0.15160. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 35 Iter 82: loss 0.17709. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 35 Iter 82: loss 0.17709. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 35 Iter 83: loss 0.17877. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 35 Iter 83: loss 0.17877. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.16791. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 35 Iter 84: loss 0.16791. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 35 Iter 85: loss 0.17868. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 35 Iter 85: loss 0.17868. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 35 Iter 86: loss 0.16204. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 35 Iter 86: loss 0.16204. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 35 Iter 87: loss 0.17841. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 35 Iter 87: loss 0.17841. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 88: loss 0.16730. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 35 Iter 88: loss 0.16730. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 35 Iter 89: loss 0.16168. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 35 Iter 89: loss 0.16168. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 35 Iter 90: loss 0.16701. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 35 Iter 90: loss 0.16701. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 35 Iter 91: loss 0.18534. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 35 Iter 91: loss 0.18534. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 35 Iter 92: loss 0.15889. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 35 Iter 92: loss 0.15889. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.16659. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 35 Iter 93: loss 0.16659. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 35 Iter 94: loss 0.16863. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.08it/s]
Epoch 35 Iter 94: loss 0.16863. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 35 Iter 95: loss 0.17449. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.08it/s]
Epoch 35 Iter 95: loss 0.17449. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 35 Iter 96: loss 0.16775. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 35 Iter 96: loss 0.16775. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 35 Iter 97: loss 0.18105. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 35 Iter 97: loss 0.18105. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 35 Iter 98: loss 0.17747. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 35 Iter 98: loss 0.17747. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 35 Iter 99: loss 0.17465. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.06it/s]
Epoch 35 Iter 99: loss 0.17465. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 35 Iter 100: loss 0.18011. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 35 Iter 100: loss 0.18011. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 35 Iter 101: loss 0.16377. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 35 Iter 101: loss 0.16377. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 35 Iter 102: loss 0.18257. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 35 Iter 102: loss 0.18257. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 35 Iter 103: loss 0.16990. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 35 Iter 103: loss 0.16990. :  46%|███████████████████▊                       | 103/224 [00:49<00:59,  2.05it/s]
Epoch 35 Iter 104: loss 0.16542. :  46%|███████████████████▊                       | 103/224 [00:50<00:59,  2.05it/s]
Epoch 35 Iter 104: loss 0.16542. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 105: loss 0.17173. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 35 Iter 105: loss 0.17173. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 35 Iter 106: loss 0.19742. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 35 Iter 106: loss 0.19742. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 35 Iter 107: loss 0.17750. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 35 Iter 107: loss 0.17750. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 35 Iter 108: loss 0.19315. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 35 Iter 108: loss 0.19315. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 35 Iter 109: loss 0.16939. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 35 Iter 109: loss 0.16939. :  49%|████████████████████▉                      | 109/224 [00:52<00:54,  2.09it/s]
Epoch 35 Iter 110: loss 0.17859. :  49%|████████████████████▉                      | 109/224 [00:53<00:54,  2.09it/s]
Epoch 35 Iter 110: loss 0.17859. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.10it/s]
Epoch 35 Iter 111: loss 0.16912. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.10it/s]
Epoch 35 Iter 111: loss 0.16912. :  50%|█████████████████████▎                     | 111/224 [00:53<00:53,  2.10it/s]
Epoch 35 Iter 112: loss 0.17165. :  50%|█████████████████████▎                     | 111/224 [00:54<00:53,  2.10it/s]
Epoch 35 Iter 112: loss 0.17165. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 35 Iter 113: loss 0.17732. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 35 Iter 113: loss 0.17732. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.09it/s]
Epoch 35 Iter 114: loss 0.17575. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.09it/s]
Epoch 35 Iter 114: loss 0.17575. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 35 Iter 115: loss 0.16067. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 35 Iter 115: loss 0.16067. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.09it/s]
Epoch 35 Iter 116: loss 0.17767. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.09it/s]
Epoch 35 Iter 116: loss 0.17767. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.09it/s]
Epoch 35 Iter 117: loss 0.16890. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.09it/s]
Epoch 35 Iter 117: loss 0.16890. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.10it/s]
Epoch 35 Iter 118: loss 0.18812. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.10it/s]
Epoch 35 Iter 118: loss 0.18812. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 35 Iter 119: loss 0.17664. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 35 Iter 119: loss 0.17664. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.09it/s]
Epoch 35 Iter 120: loss 0.17063. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.09it/s]
Epoch 35 Iter 120: loss 0.17063. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.10it/s]
Epoch 35 Iter 121: loss 0.16291. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.10it/s]
Epoch 35 Iter 121: loss 0.16291. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 35 Iter 122: loss 0.16151. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 35 Iter 122: loss 0.16151. :  54%|███████████████████████▍                   | 122/224 [00:59<00:48,  2.08it/s]
Epoch 35 Iter 123: loss 0.18130. :  54%|███████████████████████▍                   | 122/224 [00:59<00:48,  2.08it/s]
Epoch 35 Iter 123: loss 0.18130. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.09it/s]
Epoch 35 Iter 124: loss 0.16480. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.09it/s]
Epoch 35 Iter 124: loss 0.16480. :  55%|███████████████████████▊                   | 124/224 [01:00<00:47,  2.09it/s]
Epoch 35 Iter 125: loss 0.17874. :  55%|███████████████████████▊                   | 124/224 [01:00<00:47,  2.09it/s]
Epoch 35 Iter 125: loss 0.17874. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 35 Iter 126: loss 0.18527. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 35 Iter 126: loss 0.18527. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.08it/s]
Epoch 35 Iter 127: loss 0.19154. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.08it/s]
Epoch 35 Iter 127: loss 0.19154. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 35 Iter 128: loss 0.16786. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 35 Iter 128: loss 0.16786. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 35 Iter 129: loss 0.16730. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 35 Iter 129: loss 0.16730. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 35 Iter 130: loss 0.17622. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 35 Iter 130: loss 0.17622. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 35 Iter 131: loss 0.19532. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 35 Iter 131: loss 0.19532. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 35 Iter 132: loss 0.16002. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 35 Iter 132: loss 0.16002. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 35 Iter 133: loss 0.17557. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 35 Iter 133: loss 0.17557. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 35 Iter 134: loss 0.17460. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 35 Iter 134: loss 0.17460. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 35 Iter 135: loss 0.18425. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 35 Iter 135: loss 0.18425. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 35 Iter 136: loss 0.17295. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 35 Iter 136: loss 0.17295. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.08it/s]
Epoch 35 Iter 137: loss 0.15202. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.08it/s]
Epoch 35 Iter 137: loss 0.15202. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 35 Iter 138: loss 0.17655. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 35 Iter 138: loss 0.17655. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.16648. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 35 Iter 139: loss 0.16648. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 35 Iter 140: loss 0.16251. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 35 Iter 140: loss 0.16251. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 35 Iter 141: loss 0.17741. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 35 Iter 141: loss 0.17741. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 35 Iter 142: loss 0.17363. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 35 Iter 142: loss 0.17363. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.16053. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 143: loss 0.16053. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 144: loss 0.17589. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.05it/s]
Epoch 35 Iter 144: loss 0.17589. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.16717. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 145: loss 0.16717. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 146: loss 0.16358. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 35 Iter 146: loss 0.16358. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 35 Iter 147: loss 0.17199. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 35 Iter 147: loss 0.17199. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 35 Iter 148: loss 0.18123. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 35 Iter 148: loss 0.18123. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 35 Iter 149: loss 0.15975. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 35 Iter 149: loss 0.15975. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 35 Iter 150: loss 0.17206. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 35 Iter 150: loss 0.17206. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 35 Iter 151: loss 0.17163. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 35 Iter 151: loss 0.17163. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.17865. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 35 Iter 152: loss 0.17865. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 35 Iter 153: loss 0.19919. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 35 Iter 153: loss 0.19919. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 35 Iter 154: loss 0.16465. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 35 Iter 154: loss 0.16465. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 35 Iter 155: loss 0.17871. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 35 Iter 155: loss 0.17871. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 35 Iter 156: loss 0.17386. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 35 Iter 156: loss 0.17386. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.17961. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 35 Iter 157: loss 0.17961. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.18762. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 35 Iter 158: loss 0.18762. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.19021. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 35 Iter 159: loss 0.19021. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 35 Iter 160: loss 0.16694. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 35 Iter 160: loss 0.16694. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 35 Iter 161: loss 0.17198. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 35 Iter 161: loss 0.17198. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.07it/s]
Epoch 35 Iter 162: loss 0.17065. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 162: loss 0.17065. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 163: loss 0.19195. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 35 Iter 163: loss 0.19195. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 35 Iter 164: loss 0.19484. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 164: loss 0.19484. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.17563. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 35 Iter 165: loss 0.17563. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 35 Iter 166: loss 0.15644. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 35 Iter 166: loss 0.15644. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 35 Iter 167: loss 0.15436. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 35 Iter 167: loss 0.15436. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.16102. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 168: loss 0.16102. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 169: loss 0.16472. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 35 Iter 169: loss 0.16472. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 35 Iter 170: loss 0.16687. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 35 Iter 170: loss 0.16687. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.17028. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 35 Iter 171: loss 0.17028. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.17202. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 172: loss 0.17202. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 173: loss 0.17038. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 35 Iter 173: loss 0.17038. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 35 Iter 174: loss 0.19930. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 35 Iter 174: loss 0.19930. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 35 Iter 175: loss 0.16672. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 35 Iter 175: loss 0.16672. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 35 Iter 176: loss 0.20081. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 176: loss 0.20081. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.19423. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 35 Iter 177: loss 0.19423. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.15304. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 178: loss 0.15304. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 179: loss 0.20242. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 35 Iter 179: loss 0.20242. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 35 Iter 180: loss 0.16272. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 180: loss 0.16272. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 181: loss 0.16728. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 35 Iter 181: loss 0.16728. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 35 Iter 182: loss 0.17174. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 182: loss 0.17174. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 183: loss 0.16522. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 35 Iter 183: loss 0.16522. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 35 Iter 184: loss 0.17771. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 35 Iter 184: loss 0.17771. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 35 Iter 185: loss 0.19175. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 35 Iter 185: loss 0.19175. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 35 Iter 186: loss 0.18385. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.08it/s]
Epoch 35 Iter 186: loss 0.18385. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 35 Iter 187: loss 0.17348. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 35 Iter 187: loss 0.17348. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 35 Iter 188: loss 0.19044. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 35 Iter 188: loss 0.19044. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.08it/s]
Epoch 35 Iter 189: loss 0.18158. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.08it/s]
Epoch 35 Iter 189: loss 0.18158. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 35 Iter 190: loss 0.17109. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 35 Iter 190: loss 0.17109. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 35 Iter 191: loss 0.17555. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 35 Iter 191: loss 0.17555. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 192: loss 0.17049. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 35 Iter 192: loss 0.17049. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 35 Iter 193: loss 0.20141. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 35 Iter 193: loss 0.20141. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 35 Iter 194: loss 0.18833. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 35 Iter 194: loss 0.18833. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 35 Iter 195: loss 0.18250. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 35 Iter 195: loss 0.18250. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 35 Iter 196: loss 0.19959. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 35 Iter 196: loss 0.19959. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.17943. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 35 Iter 197: loss 0.17943. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.08it/s]
Epoch 35 Iter 198: loss 0.17492. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.08it/s]
Epoch 35 Iter 198: loss 0.17492. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 35 Iter 199: loss 0.16017. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 35 Iter 199: loss 0.16017. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 35 Iter 200: loss 0.16069. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 35 Iter 200: loss 0.16069. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 35 Iter 201: loss 0.18779. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 35 Iter 201: loss 0.18779. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 35 Iter 202: loss 0.18417. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 35 Iter 202: loss 0.18417. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 35 Iter 203: loss 0.18135. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 35 Iter 203: loss 0.18135. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 35 Iter 204: loss 0.15640. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 35 Iter 204: loss 0.15640. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 35 Iter 205: loss 0.17171. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 35 Iter 205: loss 0.17171. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 35 Iter 206: loss 0.19394. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 35 Iter 206: loss 0.19394. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 35 Iter 207: loss 0.17434. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 35 Iter 207: loss 0.17434. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 35 Iter 208: loss 0.17342. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 35 Iter 208: loss 0.17342. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 35 Iter 209: loss 0.17928. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 35 Iter 209: loss 0.17928. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 35 Iter 210: loss 0.16991. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 35 Iter 210: loss 0.16991. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 35 Iter 211: loss 0.16362. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 35 Iter 211: loss 0.16362. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 35 Iter 212: loss 0.16409. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 35 Iter 212: loss 0.16409. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 35 Iter 213: loss 0.16856. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 35 Iter 213: loss 0.16856. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 35 Iter 214: loss 0.18701. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 35 Iter 214: loss 0.18701. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 35 Iter 215: loss 0.15734. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 35 Iter 215: loss 0.15734. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 35 Iter 216: loss 0.20844. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 35 Iter 216: loss 0.20844. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.15884. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 35 Iter 217: loss 0.15884. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 35 Iter 218: loss 0.19761. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 35 Iter 218: loss 0.19761. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 35 Iter 219: loss 0.18576. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 35 Iter 219: loss 0.18576. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 35 Iter 220: loss 0.16670. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 35 Iter 220: loss 0.16670. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 35 Iter 221: loss 0.17026. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 35 Iter 221: loss 0.17026. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 35 Iter 222: loss 0.17262. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 35 Iter 222: loss 0.17262. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 35 Iter 223: loss 0.16644. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 35 Iter 223: loss 0.16644. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 35 Iter 224: loss 0.16466. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 35 Iter 224: loss 0.16466. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 35 Iter 224: loss 0.16466. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17533
    Valid loss: 0.17969
       Valid loss recons: 0.17333
       Valid loss KL-D:   63.55731
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.18384. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 36 Iter 1: loss 0.18384. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 36 Iter 2: loss 0.17573. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 36 Iter 2: loss 0.17573. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 36 Iter 3: loss 0.18949. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 3: loss 0.18949. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 36 Iter 4: loss 0.16707. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 36 Iter 4: loss 0.16707. :   2%|▊                                              | 4/224 [00:01<01:47,  2.06it/s]
Epoch 36 Iter 5: loss 0.16766. :   2%|▊                                              | 4/224 [00:02<01:47,  2.06it/s]
Epoch 36 Iter 5: loss 0.16766. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.18333. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 36 Iter 6: loss 0.18333. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 36 Iter 7: loss 0.17650. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 36 Iter 7: loss 0.17650. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 36 Iter 8: loss 0.19002. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 36 Iter 8: loss 0.19002. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 36 Iter 9: loss 0.17202. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 36 Iter 9: loss 0.17202. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.16690. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 36 Iter 10: loss 0.16690. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 36 Iter 11: loss 0.19498. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 36 Iter 11: loss 0.19498. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 12: loss 0.16262. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 12: loss 0.16262. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 36 Iter 13: loss 0.20128. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 36 Iter 13: loss 0.20128. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 14: loss 0.17174. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 36 Iter 14: loss 0.17174. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 36 Iter 15: loss 0.14805. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 36 Iter 15: loss 0.14805. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 16: loss 0.17174. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 16: loss 0.17174. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 36 Iter 17: loss 0.18583. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 36 Iter 17: loss 0.18583. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 36 Iter 18: loss 0.17996. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 36 Iter 18: loss 0.17996. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.17568. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 36 Iter 19: loss 0.17568. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.16631. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 20: loss 0.16631. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.17977. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 36 Iter 21: loss 0.17977. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 36 Iter 22: loss 0.16890. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 36 Iter 22: loss 0.16890. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 36 Iter 23: loss 0.16216. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 36 Iter 23: loss 0.16216. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 36 Iter 24: loss 0.18019. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 36 Iter 24: loss 0.18019. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 36 Iter 25: loss 0.16274. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 36 Iter 25: loss 0.16274. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 26: loss 0.18639. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 26: loss 0.18639. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 36 Iter 27: loss 0.17840. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 36 Iter 27: loss 0.17840. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.17863. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 28: loss 0.17863. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 36 Iter 29: loss 0.18200. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 36 Iter 29: loss 0.18200. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 36 Iter 30: loss 0.17621. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 36 Iter 30: loss 0.17621. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 36 Iter 31: loss 0.18177. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 36 Iter 31: loss 0.18177. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 36 Iter 32: loss 0.16317. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 36 Iter 32: loss 0.16317. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 36 Iter 33: loss 0.15786. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 36 Iter 33: loss 0.15786. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 36 Iter 34: loss 0.15170. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.05it/s]
Epoch 36 Iter 34: loss 0.15170. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 36 Iter 35: loss 0.16801. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.05it/s]
Epoch 36 Iter 35: loss 0.16801. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 36 Iter 36: loss 0.16504. :  16%|███████                                      | 35/224 [00:17<01:32,  2.04it/s]
Epoch 36 Iter 36: loss 0.16504. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 36 Iter 37: loss 0.20279. :  16%|███████▏                                     | 36/224 [00:18<01:32,  2.04it/s]
Epoch 36 Iter 37: loss 0.20279. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 36 Iter 38: loss 0.18943. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 36 Iter 38: loss 0.18943. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 36 Iter 39: loss 0.16741. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 36 Iter 39: loss 0.16741. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.08it/s]
Epoch 36 Iter 40: loss 0.15185. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.08it/s]
Epoch 36 Iter 40: loss 0.15185. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 36 Iter 41: loss 0.17227. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 36 Iter 41: loss 0.17227. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 36 Iter 42: loss 0.16903. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 42: loss 0.16903. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 43: loss 0.17902. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 43: loss 0.17902. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.06it/s]
Epoch 36 Iter 44: loss 0.17565. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.06it/s]
Epoch 36 Iter 44: loss 0.17565. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 36 Iter 45: loss 0.17717. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 36 Iter 45: loss 0.17717. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 36 Iter 46: loss 0.16997. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 36 Iter 46: loss 0.16997. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 36 Iter 47: loss 0.17608. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 36 Iter 47: loss 0.17608. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 36 Iter 48: loss 0.17675. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 36 Iter 48: loss 0.17675. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 36 Iter 49: loss 0.17725. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 36 Iter 49: loss 0.17725. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 36 Iter 50: loss 0.17306. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 36 Iter 50: loss 0.17306. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 36 Iter 51: loss 0.16645. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 36 Iter 51: loss 0.16645. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 36 Iter 52: loss 0.15866. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 36 Iter 52: loss 0.15866. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 36 Iter 53: loss 0.19029. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 36 Iter 53: loss 0.19029. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 36 Iter 54: loss 0.17030. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 36 Iter 54: loss 0.17030. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 36 Iter 55: loss 0.18973. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 36 Iter 55: loss 0.18973. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 36 Iter 56: loss 0.17878. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 36 Iter 56: loss 0.17878. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 36 Iter 57: loss 0.19242. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 36 Iter 57: loss 0.19242. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 36 Iter 58: loss 0.18770. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 36 Iter 58: loss 0.18770. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 36 Iter 59: loss 0.16717. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 36 Iter 59: loss 0.16717. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 36 Iter 60: loss 0.15622. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 36 Iter 60: loss 0.15622. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 61: loss 0.17976. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 61: loss 0.17976. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 36 Iter 62: loss 0.16873. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 36 Iter 62: loss 0.16873. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 36 Iter 63: loss 0.17812. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 36 Iter 63: loss 0.17812. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 36 Iter 64: loss 0.17630. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 36 Iter 64: loss 0.17630. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 36 Iter 65: loss 0.16425. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 36 Iter 65: loss 0.16425. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 36 Iter 66: loss 0.18587. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 36 Iter 66: loss 0.18587. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 36 Iter 67: loss 0.17939. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 36 Iter 67: loss 0.17939. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 36 Iter 68: loss 0.17864. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 36 Iter 68: loss 0.17864. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 36 Iter 69: loss 0.20147. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 36 Iter 69: loss 0.20147. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.04it/s]
Epoch 36 Iter 70: loss 0.16559. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.04it/s]
Epoch 36 Iter 70: loss 0.16559. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 36 Iter 71: loss 0.17237. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 36 Iter 71: loss 0.17237. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 36 Iter 72: loss 0.16055. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 36 Iter 72: loss 0.16055. :  32%|██████████████▍                              | 72/224 [00:34<01:14,  2.03it/s]
Epoch 36 Iter 73: loss 0.17470. :  32%|██████████████▍                              | 72/224 [00:35<01:14,  2.03it/s]
Epoch 36 Iter 73: loss 0.17470. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 36 Iter 74: loss 0.17719. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 36 Iter 74: loss 0.17719. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 36 Iter 75: loss 0.16005. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 36 Iter 75: loss 0.16005. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 36 Iter 76: loss 0.18772. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.08it/s]
Epoch 36 Iter 76: loss 0.18772. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 36 Iter 77: loss 0.17970. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 36 Iter 77: loss 0.17970. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 36 Iter 78: loss 0.16925. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 36 Iter 78: loss 0.16925. :  35%|███████████████▋                             | 78/224 [00:37<01:09,  2.09it/s]
Epoch 36 Iter 79: loss 0.17818. :  35%|███████████████▋                             | 78/224 [00:38<01:09,  2.09it/s]
Epoch 36 Iter 79: loss 0.17818. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 36 Iter 80: loss 0.17178. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 36 Iter 80: loss 0.17178. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.09it/s]
Epoch 36 Iter 81: loss 0.18640. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.09it/s]
Epoch 36 Iter 81: loss 0.18640. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 36 Iter 82: loss 0.16248. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 36 Iter 82: loss 0.16248. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.06it/s]
Epoch 36 Iter 83: loss 0.19712. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.06it/s]
Epoch 36 Iter 83: loss 0.19712. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 36 Iter 84: loss 0.19200. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 36 Iter 84: loss 0.19200. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 36 Iter 85: loss 0.18194. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 36 Iter 85: loss 0.18194. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.17331. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 36 Iter 86: loss 0.17331. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 36 Iter 87: loss 0.17189. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 36 Iter 87: loss 0.17189. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 36 Iter 88: loss 0.15369. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 36 Iter 88: loss 0.15369. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 36 Iter 89: loss 0.18758. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 36 Iter 89: loss 0.18758. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 36 Iter 90: loss 0.18312. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 36 Iter 90: loss 0.18312. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 36 Iter 91: loss 0.17275. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 36 Iter 91: loss 0.17275. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 36 Iter 92: loss 0.18638. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 36 Iter 92: loss 0.18638. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 36 Iter 93: loss 0.19488. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.08it/s]
Epoch 36 Iter 93: loss 0.19488. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 36 Iter 94: loss 0.17409. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 36 Iter 94: loss 0.17409. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 36 Iter 95: loss 0.17410. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 36 Iter 95: loss 0.17410. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 36 Iter 96: loss 0.19648. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 36 Iter 96: loss 0.19648. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 36 Iter 97: loss 0.19239. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 36 Iter 97: loss 0.19239. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 98: loss 0.16145. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 36 Iter 98: loss 0.16145. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 36 Iter 99: loss 0.16735. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 36 Iter 99: loss 0.16735. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 36 Iter 100: loss 0.18915. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 36 Iter 100: loss 0.18915. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 36 Iter 101: loss 0.17242. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 36 Iter 101: loss 0.17242. :  45%|███████████████████▍                       | 101/224 [00:48<01:00,  2.05it/s]
Epoch 36 Iter 102: loss 0.18704. :  45%|███████████████████▍                       | 101/224 [00:49<01:00,  2.05it/s]
Epoch 36 Iter 102: loss 0.18704. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.16455. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.06it/s]
Epoch 36 Iter 103: loss 0.16455. :  46%|███████████████████▊                       | 103/224 [00:49<00:57,  2.09it/s]
Epoch 36 Iter 104: loss 0.18051. :  46%|███████████████████▊                       | 103/224 [00:50<00:57,  2.09it/s]
Epoch 36 Iter 104: loss 0.18051. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.10it/s]
Epoch 36 Iter 105: loss 0.15243. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.10it/s]
Epoch 36 Iter 105: loss 0.15243. :  47%|████████████████████▏                      | 105/224 [00:50<00:56,  2.10it/s]
Epoch 36 Iter 106: loss 0.18500. :  47%|████████████████████▏                      | 105/224 [00:51<00:56,  2.10it/s]
Epoch 36 Iter 106: loss 0.18500. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 36 Iter 107: loss 0.15804. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.09it/s]
Epoch 36 Iter 107: loss 0.15804. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.09it/s]
Epoch 36 Iter 108: loss 0.15703. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.09it/s]
Epoch 36 Iter 108: loss 0.15703. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 36 Iter 109: loss 0.16883. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 36 Iter 109: loss 0.16883. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 36 Iter 110: loss 0.18900. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 36 Iter 110: loss 0.18900. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 36 Iter 111: loss 0.18338. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 36 Iter 111: loss 0.18338. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 36 Iter 112: loss 0.18420. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 112: loss 0.18420. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 113: loss 0.17719. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 36 Iter 113: loss 0.17719. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 36 Iter 114: loss 0.16507. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 36 Iter 114: loss 0.16507. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 36 Iter 115: loss 0.17951. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 36 Iter 115: loss 0.17951. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 36 Iter 116: loss 0.18868. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 36 Iter 116: loss 0.18868. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 36 Iter 117: loss 0.16707. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 36 Iter 117: loss 0.16707. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 36 Iter 118: loss 0.17214. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 36 Iter 118: loss 0.17214. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 36 Iter 119: loss 0.16282. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.08it/s]
Epoch 36 Iter 119: loss 0.16282. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 36 Iter 120: loss 0.17545. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 36 Iter 120: loss 0.17545. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 36 Iter 121: loss 0.18114. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 36 Iter 121: loss 0.18114. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 36 Iter 122: loss 0.16279. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 36 Iter 122: loss 0.16279. :  54%|███████████████████████▍                   | 122/224 [00:59<00:48,  2.10it/s]
Epoch 36 Iter 123: loss 0.20161. :  54%|███████████████████████▍                   | 122/224 [00:59<00:48,  2.10it/s]
Epoch 36 Iter 123: loss 0.20161. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 36 Iter 124: loss 0.18902. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 36 Iter 124: loss 0.18902. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 36 Iter 125: loss 0.18192. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 36 Iter 125: loss 0.18192. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 36 Iter 126: loss 0.18514. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 36 Iter 126: loss 0.18514. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 36 Iter 127: loss 0.18208. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 36 Iter 127: loss 0.18208. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 36 Iter 128: loss 0.18420. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 36 Iter 128: loss 0.18420. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 36 Iter 129: loss 0.18563. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 36 Iter 129: loss 0.18563. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.17468. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 130: loss 0.17468. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.07it/s]
Epoch 36 Iter 131: loss 0.17981. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 36 Iter 131: loss 0.17981. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 36 Iter 132: loss 0.16840. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 36 Iter 132: loss 0.16840. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 36 Iter 133: loss 0.16607. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 36 Iter 133: loss 0.16607. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 36 Iter 134: loss 0.20401. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 36 Iter 134: loss 0.20401. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 36 Iter 135: loss 0.18670. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 36 Iter 135: loss 0.18670. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 36 Iter 136: loss 0.16888. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 36 Iter 136: loss 0.16888. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 36 Iter 137: loss 0.18395. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 36 Iter 137: loss 0.18395. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 36 Iter 138: loss 0.18067. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 36 Iter 138: loss 0.18067. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 36 Iter 139: loss 0.19709. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 36 Iter 139: loss 0.19709. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 36 Iter 140: loss 0.16572. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 36 Iter 140: loss 0.16572. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 36 Iter 141: loss 0.17154. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 36 Iter 141: loss 0.17154. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 142: loss 0.16975. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 36 Iter 142: loss 0.16975. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 36 Iter 143: loss 0.17558. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 36 Iter 143: loss 0.17558. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 36 Iter 144: loss 0.16955. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 36 Iter 144: loss 0.16955. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 36 Iter 145: loss 0.19846. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 36 Iter 145: loss 0.19846. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 36 Iter 146: loss 0.18788. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 36 Iter 146: loss 0.18788. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 36 Iter 147: loss 0.15705. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 36 Iter 147: loss 0.15705. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 36 Iter 148: loss 0.18150. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 36 Iter 148: loss 0.18150. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 36 Iter 149: loss 0.16755. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 36 Iter 149: loss 0.16755. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 36 Iter 150: loss 0.16138. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 36 Iter 150: loss 0.16138. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 36 Iter 151: loss 0.18195. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 36 Iter 151: loss 0.18195. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 36 Iter 152: loss 0.13351. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 36 Iter 152: loss 0.13351. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 36 Iter 153: loss 0.19804. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 36 Iter 153: loss 0.19804. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 36 Iter 154: loss 0.16674. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 36 Iter 154: loss 0.16674. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 36 Iter 155: loss 0.17374. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 36 Iter 155: loss 0.17374. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 36 Iter 156: loss 0.16214. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 36 Iter 156: loss 0.16214. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 36 Iter 157: loss 0.16464. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 36 Iter 157: loss 0.16464. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 36 Iter 158: loss 0.17829. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 36 Iter 158: loss 0.17829. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 36 Iter 159: loss 0.18530. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 36 Iter 159: loss 0.18530. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.09it/s]
Epoch 36 Iter 160: loss 0.16566. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 36 Iter 160: loss 0.16566. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 36 Iter 161: loss 0.17605. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 36 Iter 161: loss 0.17605. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 36 Iter 162: loss 0.14728. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 36 Iter 162: loss 0.14728. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 36 Iter 163: loss 0.17983. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 36 Iter 163: loss 0.17983. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 36 Iter 164: loss 0.16735. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 36 Iter 164: loss 0.16735. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 36 Iter 165: loss 0.18343. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 36 Iter 165: loss 0.18343. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.08it/s]
Epoch 36 Iter 166: loss 0.17307. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 36 Iter 166: loss 0.17307. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 36 Iter 167: loss 0.17115. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 36 Iter 167: loss 0.17115. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 36 Iter 168: loss 0.16086. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 36 Iter 168: loss 0.16086. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 36 Iter 169: loss 0.18308. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 36 Iter 169: loss 0.18308. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.09it/s]
Epoch 36 Iter 170: loss 0.18393. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.09it/s]
Epoch 36 Iter 170: loss 0.18393. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.10it/s]
Epoch 36 Iter 171: loss 0.16301. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.10it/s]
Epoch 36 Iter 171: loss 0.16301. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.09it/s]
Epoch 36 Iter 172: loss 0.18586. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.09it/s]
Epoch 36 Iter 172: loss 0.18586. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.08it/s]
Epoch 36 Iter 173: loss 0.17442. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.08it/s]
Epoch 36 Iter 173: loss 0.17442. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.09it/s]
Epoch 36 Iter 174: loss 0.18679. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 36 Iter 174: loss 0.18679. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.08it/s]
Epoch 36 Iter 175: loss 0.16511. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.08it/s]
Epoch 36 Iter 175: loss 0.16511. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.08it/s]
Epoch 36 Iter 176: loss 0.17688. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.08it/s]
Epoch 36 Iter 176: loss 0.17688. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 36 Iter 177: loss 0.18246. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 36 Iter 177: loss 0.18246. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 36 Iter 178: loss 0.17677. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 36 Iter 178: loss 0.17677. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 36 Iter 179: loss 0.15872. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.09it/s]
Epoch 36 Iter 179: loss 0.15872. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.09it/s]
Epoch 36 Iter 180: loss 0.17597. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.09it/s]
Epoch 36 Iter 180: loss 0.17597. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 36 Iter 181: loss 0.17965. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 36 Iter 181: loss 0.17965. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 36 Iter 182: loss 0.18238. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 36 Iter 182: loss 0.18238. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 36 Iter 183: loss 0.18891. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 36 Iter 183: loss 0.18891. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 36 Iter 184: loss 0.17638. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 36 Iter 184: loss 0.17638. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.07it/s]
Epoch 36 Iter 185: loss 0.18152. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 36 Iter 185: loss 0.18152. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 36 Iter 186: loss 0.17282. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 36 Iter 186: loss 0.17282. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.06it/s]
Epoch 36 Iter 187: loss 0.17080. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 36 Iter 187: loss 0.17080. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 36 Iter 188: loss 0.19565. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 36 Iter 188: loss 0.19565. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.06it/s]
Epoch 36 Iter 189: loss 0.17110. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 189: loss 0.17110. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 190: loss 0.18457. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 36 Iter 190: loss 0.18457. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 36 Iter 191: loss 0.17180. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 36 Iter 191: loss 0.17180. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 36 Iter 192: loss 0.16230. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.06it/s]
Epoch 36 Iter 192: loss 0.16230. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 36 Iter 193: loss 0.18256. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 36 Iter 193: loss 0.18256. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 36 Iter 194: loss 0.18902. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 36 Iter 194: loss 0.18902. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 36 Iter 195: loss 0.16501. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 36 Iter 195: loss 0.16501. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 36 Iter 196: loss 0.13670. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 36 Iter 196: loss 0.13670. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 36 Iter 197: loss 0.17161. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 36 Iter 197: loss 0.17161. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 36 Iter 198: loss 0.17108. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 36 Iter 198: loss 0.17108. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 36 Iter 199: loss 0.17778. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 36 Iter 199: loss 0.17778. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 36 Iter 200: loss 0.15306. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 36 Iter 200: loss 0.15306. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.11it/s]
Epoch 36 Iter 201: loss 0.18611. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.11it/s]
Epoch 36 Iter 201: loss 0.18611. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:10,  2.12it/s]
Epoch 36 Iter 202: loss 0.17161. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:10,  2.12it/s]
Epoch 36 Iter 202: loss 0.17161. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.11it/s]
Epoch 36 Iter 203: loss 0.16533. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.11it/s]
Epoch 36 Iter 203: loss 0.16533. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:09,  2.12it/s]
Epoch 36 Iter 204: loss 0.18783. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:09,  2.12it/s]
Epoch 36 Iter 204: loss 0.18783. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.11it/s]
Epoch 36 Iter 205: loss 0.14616. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.11it/s]
Epoch 36 Iter 205: loss 0.14616. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:08,  2.11it/s]
Epoch 36 Iter 206: loss 0.17344. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:08,  2.11it/s]
Epoch 36 Iter 206: loss 0.17344. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.10it/s]
Epoch 36 Iter 207: loss 0.17124. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.10it/s]
Epoch 36 Iter 207: loss 0.17124. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 36 Iter 208: loss 0.19527. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 36 Iter 208: loss 0.19527. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.09it/s]
Epoch 36 Iter 209: loss 0.16583. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.09it/s]
Epoch 36 Iter 209: loss 0.16583. :  93%|████████████████████████████████████████   | 209/224 [01:40<00:07,  2.09it/s]
Epoch 36 Iter 210: loss 0.18090. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.09it/s]
Epoch 36 Iter 210: loss 0.18090. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.09it/s]
Epoch 36 Iter 211: loss 0.17624. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.09it/s]
Epoch 36 Iter 211: loss 0.17624. :  94%|████████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.08it/s]
Epoch 36 Iter 212: loss 0.18187. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 36 Iter 212: loss 0.18187. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 36 Iter 213: loss 0.17615. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 36 Iter 213: loss 0.17615. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.07it/s]
Epoch 36 Iter 214: loss 0.18512. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 36 Iter 214: loss 0.18512. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 36 Iter 215: loss 0.16619. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 36 Iter 215: loss 0.16619. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.05it/s]
Epoch 36 Iter 216: loss 0.16707. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.05it/s]
Epoch 36 Iter 216: loss 0.16707. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 36 Iter 217: loss 0.17944. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.05it/s]
Epoch 36 Iter 217: loss 0.17944. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.06it/s]
Epoch 36 Iter 218: loss 0.16038. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 36 Iter 218: loss 0.16038. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 36 Iter 219: loss 0.16614. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.04it/s]
Epoch 36 Iter 219: loss 0.16614. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.06it/s]
Epoch 36 Iter 220: loss 0.15773. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.06it/s]
Epoch 36 Iter 220: loss 0.15773. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 36 Iter 221: loss 0.18536. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.06it/s]
Epoch 36 Iter 221: loss 0.18536. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.05it/s]
Epoch 36 Iter 222: loss 0.15395. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 36 Iter 222: loss 0.15395. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 36 Iter 223: loss 0.18627. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 36 Iter 223: loss 0.18627. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.08it/s]
Epoch 36 Iter 224: loss 0.18075. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 36 Iter 224: loss 0.18075. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 36 Iter 224: loss 0.18075. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.18741. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 37 Iter 1: loss 0.18741. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 37 Iter 2: loss 0.16149. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 37 Iter 2: loss 0.16149. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.17471. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 37 Iter 3: loss 0.17471. :   1%|▋                                              | 3/224 [00:01<01:48,  2.05it/s]
Epoch 37 Iter 4: loss 0.15882. :   1%|▋                                              | 3/224 [00:01<01:48,  2.05it/s]
Epoch 37 Iter 4: loss 0.15882. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 37 Iter 5: loss 0.17202. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 37 Iter 5: loss 0.17202. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.15961. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 37 Iter 6: loss 0.15961. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 37 Iter 7: loss 0.17464. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 37 Iter 7: loss 0.17464. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 37 Iter 8: loss 0.15734. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 37 Iter 8: loss 0.15734. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.06it/s]
Epoch 37 Iter 9: loss 0.20129. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.06it/s]
Epoch 37 Iter 9: loss 0.20129. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 37 Iter 10: loss 0.17737. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 37 Iter 10: loss 0.17737. :   4%|██                                           | 10/224 [00:04<01:44,  2.06it/s]
Epoch 37 Iter 11: loss 0.17040. :   4%|██                                           | 10/224 [00:05<01:44,  2.06it/s]
Epoch 37 Iter 11: loss 0.17040. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 37 Iter 12: loss 0.18589. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 37 Iter 12: loss 0.18589. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 37 Iter 13: loss 0.20769. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 37 Iter 13: loss 0.20769. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 37 Iter 14: loss 0.18045. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 37 Iter 14: loss 0.18045. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 37 Iter 15: loss 0.17570. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 37 Iter 15: loss 0.17570. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 37 Iter 16: loss 0.18803. :   7%|███                                          | 15/224 [00:07<01:41,  2.05it/s]
Epoch 37 Iter 16: loss 0.18803. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 37 Iter 17: loss 0.16562. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 37 Iter 17: loss 0.16562. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 37 Iter 18: loss 0.18543. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 37 Iter 18: loss 0.18543. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 37 Iter 19: loss 0.20855. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 37 Iter 19: loss 0.20855. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 37 Iter 20: loss 0.16708. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.04it/s]
Epoch 37 Iter 20: loss 0.16708. :   9%|████                                         | 20/224 [00:09<01:39,  2.04it/s]
Epoch 37 Iter 21: loss 0.17857. :   9%|████                                         | 20/224 [00:10<01:39,  2.04it/s]
Epoch 37 Iter 21: loss 0.17857. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 37 Iter 22: loss 0.17487. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.04it/s]
Epoch 37 Iter 22: loss 0.17487. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.02it/s]
Epoch 37 Iter 23: loss 0.17158. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.02it/s]
Epoch 37 Iter 23: loss 0.17158. :  10%|████▌                                        | 23/224 [00:11<01:39,  2.03it/s]
Epoch 37 Iter 24: loss 0.14943. :  10%|████▌                                        | 23/224 [00:11<01:39,  2.03it/s]
Epoch 37 Iter 24: loss 0.14943. :  11%|████▊                                        | 24/224 [00:11<01:38,  2.03it/s]
Epoch 37 Iter 25: loss 0.18309. :  11%|████▊                                        | 24/224 [00:12<01:38,  2.03it/s]
Epoch 37 Iter 25: loss 0.18309. :  11%|█████                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 37 Iter 26: loss 0.17204. :  11%|█████                                        | 25/224 [00:12<01:38,  2.03it/s]
Epoch 37 Iter 26: loss 0.17204. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.04it/s]
Epoch 37 Iter 27: loss 0.18119. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.04it/s]
Epoch 37 Iter 27: loss 0.18119. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 37 Iter 28: loss 0.16443. :  12%|█████▍                                       | 27/224 [00:13<01:36,  2.05it/s]
Epoch 37 Iter 28: loss 0.16443. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.05it/s]
Epoch 37 Iter 29: loss 0.16560. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.05it/s]
Epoch 37 Iter 29: loss 0.16560. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 37 Iter 30: loss 0.16883. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 37 Iter 30: loss 0.16883. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 37 Iter 31: loss 0.18627. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 37 Iter 31: loss 0.18627. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 37 Iter 32: loss 0.16271. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 37 Iter 32: loss 0.16271. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 37 Iter 33: loss 0.17041. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.06it/s]
Epoch 37 Iter 33: loss 0.17041. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 37 Iter 34: loss 0.16642. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 37 Iter 34: loss 0.16642. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 37 Iter 35: loss 0.18209. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 37 Iter 35: loss 0.18209. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 37 Iter 36: loss 0.16866. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 37 Iter 36: loss 0.16866. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 37 Iter 37: loss 0.17960. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.05it/s]
Epoch 37 Iter 37: loss 0.17960. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 37 Iter 38: loss 0.16832. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 37 Iter 38: loss 0.16832. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.04it/s]
Epoch 37 Iter 39: loss 0.17927. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.04it/s]
Epoch 37 Iter 39: loss 0.17927. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 37 Iter 40: loss 0.17142. :  17%|███████▊                                     | 39/224 [00:19<01:30,  2.04it/s]
Epoch 37 Iter 40: loss 0.17142. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 37 Iter 41: loss 0.15524. :  18%|████████                                     | 40/224 [00:20<01:29,  2.05it/s]
Epoch 37 Iter 41: loss 0.15524. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 37 Iter 42: loss 0.19360. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.04it/s]
Epoch 37 Iter 42: loss 0.19360. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 37 Iter 43: loss 0.18237. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 37 Iter 43: loss 0.18237. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 37 Iter 44: loss 0.17168. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 37 Iter 44: loss 0.17168. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 37 Iter 45: loss 0.19299. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 37 Iter 45: loss 0.19299. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 37 Iter 46: loss 0.19260. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 37 Iter 46: loss 0.19260. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 37 Iter 47: loss 0.15440. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 37 Iter 47: loss 0.15440. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 37 Iter 48: loss 0.17579. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 37 Iter 48: loss 0.17579. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 37 Iter 49: loss 0.16387. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 37 Iter 49: loss 0.16387. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.08it/s]
Epoch 37 Iter 50: loss 0.18118. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.08it/s]
Epoch 37 Iter 50: loss 0.18118. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 37 Iter 51: loss 0.18447. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.08it/s]
Epoch 37 Iter 51: loss 0.18447. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 37 Iter 52: loss 0.16091. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 37 Iter 52: loss 0.16091. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 53: loss 0.18318. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 37 Iter 53: loss 0.18318. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 37 Iter 54: loss 0.17854. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 37 Iter 54: loss 0.17854. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 37 Iter 55: loss 0.18439. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 37 Iter 55: loss 0.18439. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 37 Iter 56: loss 0.18166. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 37 Iter 56: loss 0.18166. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 37 Iter 57: loss 0.18059. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 37 Iter 57: loss 0.18059. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 37 Iter 58: loss 0.19277. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 37 Iter 58: loss 0.19277. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 37 Iter 59: loss 0.17393. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 37 Iter 59: loss 0.17393. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.05it/s]
Epoch 37 Iter 60: loss 0.16072. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.05it/s]
Epoch 37 Iter 60: loss 0.16072. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 37 Iter 61: loss 0.15479. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 37 Iter 61: loss 0.15479. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.04it/s]
Epoch 37 Iter 62: loss 0.17264. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.04it/s]
Epoch 37 Iter 62: loss 0.17264. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 37 Iter 63: loss 0.17291. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 37 Iter 63: loss 0.17291. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 37 Iter 64: loss 0.16945. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 37 Iter 64: loss 0.16945. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 37 Iter 65: loss 0.16888. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 37 Iter 65: loss 0.16888. :  29%|█████████████                                | 65/224 [00:31<01:18,  2.03it/s]
Epoch 37 Iter 66: loss 0.16638. :  29%|█████████████                                | 65/224 [00:32<01:18,  2.03it/s]
Epoch 37 Iter 66: loss 0.16638. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 37 Iter 67: loss 0.14724. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.05it/s]
Epoch 37 Iter 67: loss 0.14724. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 37 Iter 68: loss 0.21352. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 37 Iter 68: loss 0.21352. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 37 Iter 69: loss 0.18664. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 37 Iter 69: loss 0.18664. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 37 Iter 70: loss 0.18185. :  31%|█████████████▊                               | 69/224 [00:34<01:14,  2.07it/s]
Epoch 37 Iter 70: loss 0.18185. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 37 Iter 71: loss 0.16153. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 37 Iter 71: loss 0.16153. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 37 Iter 72: loss 0.15338. :  32%|██████████████▎                              | 71/224 [00:35<01:13,  2.07it/s]
Epoch 37 Iter 72: loss 0.15338. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 73: loss 0.16563. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 37 Iter 73: loss 0.16563. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 37 Iter 74: loss 0.18432. :  33%|██████████████▋                              | 73/224 [00:36<01:12,  2.07it/s]
Epoch 37 Iter 74: loss 0.18432. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 37 Iter 75: loss 0.18847. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 37 Iter 75: loss 0.18847. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 37 Iter 76: loss 0.18691. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 37 Iter 76: loss 0.18691. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 37 Iter 77: loss 0.16952. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 37 Iter 77: loss 0.16952. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 37 Iter 78: loss 0.18060. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.07it/s]
Epoch 37 Iter 78: loss 0.18060. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.06it/s]
Epoch 37 Iter 79: loss 0.17802. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.06it/s]
Epoch 37 Iter 79: loss 0.17802. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 37 Iter 80: loss 0.17396. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.05it/s]
Epoch 37 Iter 80: loss 0.17396. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 37 Iter 81: loss 0.18627. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 81: loss 0.18627. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 82: loss 0.17250. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 37 Iter 82: loss 0.17250. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 37 Iter 83: loss 0.16939. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 83: loss 0.16939. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 84: loss 0.18312. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.06it/s]
Epoch 37 Iter 84: loss 0.18312. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 37 Iter 85: loss 0.18265. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 37 Iter 85: loss 0.18265. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 37 Iter 86: loss 0.17495. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 37 Iter 86: loss 0.17495. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 37 Iter 87: loss 0.20100. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 37 Iter 87: loss 0.20100. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 37 Iter 88: loss 0.18179. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 37 Iter 88: loss 0.18179. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 37 Iter 89: loss 0.18452. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 37 Iter 89: loss 0.18452. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 37 Iter 90: loss 0.16939. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 37 Iter 90: loss 0.16939. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 37 Iter 91: loss 0.17703. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 91: loss 0.17703. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 92: loss 0.17415. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 37 Iter 92: loss 0.17415. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.17669. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 93: loss 0.17669. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 94: loss 0.18540. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 37 Iter 94: loss 0.18540. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 37 Iter 95: loss 0.16165. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 37 Iter 95: loss 0.16165. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 37 Iter 96: loss 0.19267. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.06it/s]
Epoch 37 Iter 96: loss 0.19267. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 37 Iter 97: loss 0.17077. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 37 Iter 97: loss 0.17077. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 37 Iter 98: loss 0.16325. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 37 Iter 98: loss 0.16325. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 37 Iter 99: loss 0.16716. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 37 Iter 99: loss 0.16716. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.08it/s]
Epoch 37 Iter 100: loss 0.16968. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 37 Iter 100: loss 0.16968. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 37 Iter 101: loss 0.15280. :  45%|███████████████████▏                       | 100/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 101: loss 0.15280. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 102: loss 0.18348. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 37 Iter 102: loss 0.18348. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 37 Iter 103: loss 0.17148. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.08it/s]
Epoch 37 Iter 103: loss 0.17148. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 37 Iter 104: loss 0.17544. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 37 Iter 104: loss 0.17544. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 37 Iter 105: loss 0.18414. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.06it/s]
Epoch 37 Iter 105: loss 0.18414. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 37 Iter 106: loss 0.17138. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 37 Iter 106: loss 0.17138. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 37 Iter 107: loss 0.17461. :  47%|████████████████████▎                      | 106/224 [00:52<00:57,  2.06it/s]
Epoch 37 Iter 107: loss 0.17461. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 37 Iter 108: loss 0.16864. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 37 Iter 108: loss 0.16864. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 37 Iter 109: loss 0.17787. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 37 Iter 109: loss 0.17787. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 37 Iter 110: loss 0.17189. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 37 Iter 110: loss 0.17189. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 37 Iter 111: loss 0.16415. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.07it/s]
Epoch 37 Iter 111: loss 0.16415. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.07it/s]
Epoch 37 Iter 112: loss 0.19160. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.07it/s]
Epoch 37 Iter 112: loss 0.19160. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.17062. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 37 Iter 113: loss 0.17062. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.16226. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 37 Iter 114: loss 0.16226. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 37 Iter 115: loss 0.18509. :  51%|█████████████████████▉                     | 114/224 [00:55<00:52,  2.09it/s]
Epoch 37 Iter 115: loss 0.18509. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.09it/s]
Epoch 37 Iter 116: loss 0.17167. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.09it/s]
Epoch 37 Iter 116: loss 0.17167. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 37 Iter 117: loss 0.17036. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 37 Iter 117: loss 0.17036. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.08it/s]
Epoch 37 Iter 118: loss 0.16613. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.08it/s]
Epoch 37 Iter 118: loss 0.16613. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 37 Iter 119: loss 0.16004. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.08it/s]
Epoch 37 Iter 119: loss 0.16004. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 37 Iter 120: loss 0.17368. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 37 Iter 120: loss 0.17368. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 37 Iter 121: loss 0.19136. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.07it/s]
Epoch 37 Iter 121: loss 0.19136. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 37 Iter 122: loss 0.16705. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 37 Iter 122: loss 0.16705. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 37 Iter 123: loss 0.16068. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 37 Iter 123: loss 0.16068. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 37 Iter 124: loss 0.17129. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 37 Iter 124: loss 0.17129. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 37 Iter 125: loss 0.16542. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.08it/s]
Epoch 37 Iter 125: loss 0.16542. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.08it/s]
Epoch 37 Iter 126: loss 0.19227. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.08it/s]
Epoch 37 Iter 126: loss 0.19227. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 37 Iter 127: loss 0.19714. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 37 Iter 127: loss 0.19714. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 37 Iter 128: loss 0.18222. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 37 Iter 128: loss 0.18222. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 37 Iter 129: loss 0.16674. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 37 Iter 129: loss 0.16674. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 37 Iter 130: loss 0.16020. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 37 Iter 130: loss 0.16020. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 37 Iter 131: loss 0.18199. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 37 Iter 131: loss 0.18199. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 37 Iter 132: loss 0.17027. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:44,  2.07it/s]
Epoch 37 Iter 132: loss 0.17027. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 37 Iter 133: loss 0.16679. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 37 Iter 133: loss 0.16679. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 37 Iter 134: loss 0.20387. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.07it/s]
Epoch 37 Iter 134: loss 0.20387. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 37 Iter 135: loss 0.19301. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 37 Iter 135: loss 0.19301. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 37 Iter 136: loss 0.18186. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 37 Iter 136: loss 0.18186. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 37 Iter 137: loss 0.18854. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 37 Iter 137: loss 0.18854. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 37 Iter 138: loss 0.15876. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 37 Iter 138: loss 0.15876. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 37 Iter 139: loss 0.18242. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 37 Iter 139: loss 0.18242. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 37 Iter 140: loss 0.18672. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 37 Iter 140: loss 0.18672. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 37 Iter 141: loss 0.16906. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 37 Iter 141: loss 0.16906. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 37 Iter 142: loss 0.15940. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 37 Iter 142: loss 0.15940. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 37 Iter 143: loss 0.15606. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 37 Iter 143: loss 0.15606. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 37 Iter 144: loss 0.18530. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 37 Iter 144: loss 0.18530. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 37 Iter 145: loss 0.17375. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 37 Iter 145: loss 0.17375. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.09it/s]
Epoch 37 Iter 146: loss 0.14721. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.09it/s]
Epoch 37 Iter 146: loss 0.14721. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 37 Iter 147: loss 0.17929. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 37 Iter 147: loss 0.17929. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 37 Iter 148: loss 0.18274. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 37 Iter 148: loss 0.18274. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 37 Iter 149: loss 0.17576. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 37 Iter 149: loss 0.17576. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 37 Iter 150: loss 0.15456. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 37 Iter 150: loss 0.15456. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 37 Iter 151: loss 0.18807. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 37 Iter 151: loss 0.18807. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 37 Iter 152: loss 0.15957. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 37 Iter 152: loss 0.15957. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 37 Iter 153: loss 0.16934. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 37 Iter 153: loss 0.16934. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 37 Iter 154: loss 0.18633. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 37 Iter 154: loss 0.18633. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 37 Iter 155: loss 0.18612. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 37 Iter 155: loss 0.18612. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 37 Iter 156: loss 0.18414. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 37 Iter 156: loss 0.18414. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 37 Iter 157: loss 0.16793. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 157: loss 0.16793. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 158: loss 0.15279. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 37 Iter 158: loss 0.15279. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 37 Iter 159: loss 0.16070. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 159: loss 0.16070. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 160: loss 0.18918. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 37 Iter 160: loss 0.18918. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 37 Iter 161: loss 0.16744. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 37 Iter 161: loss 0.16744. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 162: loss 0.16820. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 37 Iter 162: loss 0.16820. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 37 Iter 163: loss 0.16863. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.07it/s]
Epoch 37 Iter 163: loss 0.16863. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 37 Iter 164: loss 0.18304. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 37 Iter 164: loss 0.18304. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 165: loss 0.19012. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 37 Iter 165: loss 0.19012. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 37 Iter 166: loss 0.18441. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 37 Iter 166: loss 0.18441. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 37 Iter 167: loss 0.15976. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 37 Iter 167: loss 0.15976. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 37 Iter 168: loss 0.15327. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 168: loss 0.15327. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 169: loss 0.15945. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.05it/s]
Epoch 37 Iter 169: loss 0.15945. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.05it/s]
Epoch 37 Iter 170: loss 0.15757. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.05it/s]
Epoch 37 Iter 170: loss 0.15757. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 37 Iter 171: loss 0.18333. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 37 Iter 171: loss 0.18333. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 37 Iter 172: loss 0.20746. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 37 Iter 172: loss 0.20746. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 37 Iter 173: loss 0.16960. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 37 Iter 173: loss 0.16960. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 37 Iter 174: loss 0.15699. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 37 Iter 174: loss 0.15699. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 37 Iter 175: loss 0.18912. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 37 Iter 175: loss 0.18912. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.06it/s]
Epoch 37 Iter 176: loss 0.18309. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 176: loss 0.18309. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 177: loss 0.19967. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 37 Iter 177: loss 0.19967. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 37 Iter 178: loss 0.15609. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 37 Iter 178: loss 0.15609. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 37 Iter 179: loss 0.17899. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 37 Iter 179: loss 0.17899. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 37 Iter 180: loss 0.20644. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 37 Iter 180: loss 0.20644. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 37 Iter 181: loss 0.17799. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 37 Iter 181: loss 0.17799. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 37 Iter 182: loss 0.17903. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 37 Iter 182: loss 0.17903. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 37 Iter 183: loss 0.17388. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 37 Iter 183: loss 0.17388. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 37 Iter 184: loss 0.18053. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.09it/s]
Epoch 37 Iter 184: loss 0.18053. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:18,  2.11it/s]
Epoch 37 Iter 185: loss 0.17184. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:18,  2.11it/s]
Epoch 37 Iter 185: loss 0.17184. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.11it/s]
Epoch 37 Iter 186: loss 0.14749. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.11it/s]
Epoch 37 Iter 186: loss 0.14749. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.10it/s]
Epoch 37 Iter 187: loss 0.18855. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.10it/s]
Epoch 37 Iter 187: loss 0.18855. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 37 Iter 188: loss 0.16746. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.08it/s]
Epoch 37 Iter 188: loss 0.16746. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.09it/s]
Epoch 37 Iter 189: loss 0.15940. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.09it/s]
Epoch 37 Iter 189: loss 0.15940. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 37 Iter 190: loss 0.17240. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.08it/s]
Epoch 37 Iter 190: loss 0.17240. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 37 Iter 191: loss 0.16166. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 37 Iter 191: loss 0.16166. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 37 Iter 192: loss 0.19339. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 37 Iter 192: loss 0.19339. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.08it/s]
Epoch 37 Iter 193: loss 0.17943. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 37 Iter 193: loss 0.17943. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 37 Iter 194: loss 0.18711. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 37 Iter 194: loss 0.18711. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 37 Iter 195: loss 0.16643. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 37 Iter 195: loss 0.16643. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 37 Iter 196: loss 0.16715. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 37 Iter 196: loss 0.16715. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.08it/s]
Epoch 37 Iter 197: loss 0.17591. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 37 Iter 197: loss 0.17591. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 37 Iter 198: loss 0.17695. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 37 Iter 198: loss 0.17695. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 37 Iter 199: loss 0.17355. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 37 Iter 199: loss 0.17355. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 37 Iter 200: loss 0.18648. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 37 Iter 200: loss 0.18648. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.03it/s]
Epoch 37 Iter 201: loss 0.17749. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.03it/s]
Epoch 37 Iter 201: loss 0.17749. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 37 Iter 202: loss 0.17519. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.04it/s]
Epoch 37 Iter 202: loss 0.17519. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.05it/s]
Epoch 37 Iter 203: loss 0.19684. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.05it/s]
Epoch 37 Iter 203: loss 0.19684. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 37 Iter 204: loss 0.16702. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.05it/s]
Epoch 37 Iter 204: loss 0.16702. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.05it/s]
Epoch 37 Iter 205: loss 0.17299. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.05it/s]
Epoch 37 Iter 205: loss 0.17299. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 206: loss 0.18471. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 37 Iter 206: loss 0.18471. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 37 Iter 207: loss 0.17343. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 37 Iter 207: loss 0.17343. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 37 Iter 208: loss 0.18281. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 37 Iter 208: loss 0.18281. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 37 Iter 209: loss 0.16211. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 37 Iter 209: loss 0.16211. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 210: loss 0.19120. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 37 Iter 210: loss 0.19120. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.17539. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 37 Iter 211: loss 0.17539. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 37 Iter 212: loss 0.15893. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 37 Iter 212: loss 0.15893. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 37 Iter 213: loss 0.16828. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 213: loss 0.16828. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.17660. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 37 Iter 214: loss 0.17660. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 37 Iter 215: loss 0.18135. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 37 Iter 215: loss 0.18135. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.18678. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 37 Iter 216: loss 0.18678. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 37 Iter 217: loss 0.17154. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 37 Iter 217: loss 0.17154. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 37 Iter 218: loss 0.16225. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 37 Iter 218: loss 0.16225. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.06it/s]
Epoch 37 Iter 219: loss 0.17825. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.06it/s]
Epoch 37 Iter 219: loss 0.17825. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 37 Iter 220: loss 0.17431. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.05it/s]
Epoch 37 Iter 220: loss 0.17431. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.05it/s]
Epoch 37 Iter 221: loss 0.19500. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 221: loss 0.19500. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 222: loss 0.17339. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.05it/s]
Epoch 37 Iter 222: loss 0.17339. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 37 Iter 223: loss 0.16321. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.05it/s]
Epoch 37 Iter 223: loss 0.16321. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.17452. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.17452. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 37 Iter 224: loss 0.17452. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17521
    Valid loss: 0.17992
       Valid loss recons: 0.17347
       Valid loss KL-D:   64.53594
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.18789. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 38 Iter 1: loss 0.18789. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 38 Iter 2: loss 0.18972. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 38 Iter 2: loss 0.18972. :   1%|▍                                              | 2/224 [00:00<01:49,  2.03it/s]
Epoch 38 Iter 3: loss 0.18953. :   1%|▍                                              | 2/224 [00:01<01:49,  2.03it/s]
Epoch 38 Iter 3: loss 0.18953. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 38 Iter 4: loss 0.16701. :   1%|▋                                              | 3/224 [00:01<01:47,  2.06it/s]
Epoch 38 Iter 4: loss 0.16701. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 38 Iter 5: loss 0.19973. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 38 Iter 5: loss 0.19973. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 38 Iter 6: loss 0.17641. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 38 Iter 6: loss 0.17641. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 38 Iter 7: loss 0.18615. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 38 Iter 7: loss 0.18615. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 38 Iter 8: loss 0.18655. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 38 Iter 8: loss 0.18655. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 38 Iter 9: loss 0.17799. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 38 Iter 9: loss 0.17799. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 38 Iter 10: loss 0.20276. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 38 Iter 10: loss 0.20276. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 38 Iter 11: loss 0.16565. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 38 Iter 11: loss 0.16565. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 38 Iter 12: loss 0.18671. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 38 Iter 12: loss 0.18671. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 38 Iter 13: loss 0.18734. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 38 Iter 13: loss 0.18734. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 38 Iter 14: loss 0.17585. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 38 Iter 14: loss 0.17585. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 38 Iter 15: loss 0.17253. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 38 Iter 15: loss 0.17253. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 38 Iter 16: loss 0.18641. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 38 Iter 16: loss 0.18641. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 38 Iter 17: loss 0.17810. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 38 Iter 17: loss 0.17810. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 38 Iter 18: loss 0.17594. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 38 Iter 18: loss 0.17594. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.04it/s]
Epoch 38 Iter 19: loss 0.17173. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.04it/s]
Epoch 38 Iter 19: loss 0.17173. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 20: loss 0.17443. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 20: loss 0.17443. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 38 Iter 21: loss 0.17330. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 38 Iter 21: loss 0.17330. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 22: loss 0.16611. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 22: loss 0.16611. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 38 Iter 23: loss 0.18317. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 38 Iter 23: loss 0.18317. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 38 Iter 24: loss 0.16874. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 38 Iter 24: loss 0.16874. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 38 Iter 25: loss 0.17478. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 25: loss 0.17478. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 26: loss 0.17762. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 38 Iter 26: loss 0.17762. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.07it/s]
Epoch 38 Iter 27: loss 0.16711. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.07it/s]
Epoch 38 Iter 27: loss 0.16711. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 28: loss 0.18931. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 28: loss 0.18931. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 38 Iter 29: loss 0.16195. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 38 Iter 29: loss 0.16195. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.17704. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 38 Iter 30: loss 0.17704. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 38 Iter 31: loss 0.19879. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 31: loss 0.19879. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.16496. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.07it/s]
Epoch 38 Iter 32: loss 0.16496. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 38 Iter 33: loss 0.18138. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 38 Iter 33: loss 0.18138. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 38 Iter 34: loss 0.19380. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 38 Iter 34: loss 0.19380. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.17216. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 38 Iter 35: loss 0.17216. :  16%|███████                                      | 35/224 [00:16<01:33,  2.03it/s]
Epoch 38 Iter 36: loss 0.17151. :  16%|███████                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 38 Iter 36: loss 0.17151. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 38 Iter 37: loss 0.14648. :  16%|███████▏                                     | 36/224 [00:17<01:32,  2.04it/s]
Epoch 38 Iter 37: loss 0.14648. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.04it/s]
Epoch 38 Iter 38: loss 0.18139. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.04it/s]
Epoch 38 Iter 38: loss 0.18139. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 38 Iter 39: loss 0.17613. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 38 Iter 39: loss 0.17613. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 38 Iter 40: loss 0.18405. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 38 Iter 40: loss 0.18405. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 38 Iter 41: loss 0.15832. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 38 Iter 41: loss 0.15832. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.15903. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 38 Iter 42: loss 0.15903. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.16871. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 38 Iter 43: loss 0.16871. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 38 Iter 44: loss 0.17232. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 38 Iter 44: loss 0.17232. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 38 Iter 45: loss 0.15735. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 38 Iter 45: loss 0.15735. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 38 Iter 46: loss 0.18415. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 38 Iter 46: loss 0.18415. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 38 Iter 47: loss 0.18570. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 38 Iter 47: loss 0.18570. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.08it/s]
Epoch 38 Iter 48: loss 0.18584. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.08it/s]
Epoch 38 Iter 48: loss 0.18584. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 38 Iter 49: loss 0.16827. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 38 Iter 49: loss 0.16827. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 38 Iter 50: loss 0.18618. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 38 Iter 50: loss 0.18618. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 38 Iter 51: loss 0.15753. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 38 Iter 51: loss 0.15753. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.08it/s]
Epoch 38 Iter 52: loss 0.17931. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.08it/s]
Epoch 38 Iter 52: loss 0.17931. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 38 Iter 53: loss 0.16244. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.07it/s]
Epoch 38 Iter 53: loss 0.16244. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.17220. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 38 Iter 54: loss 0.17220. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 38 Iter 55: loss 0.16554. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 38 Iter 55: loss 0.16554. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.17486. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 38 Iter 56: loss 0.17486. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 38 Iter 57: loss 0.17781. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 38 Iter 57: loss 0.17781. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 38 Iter 58: loss 0.16689. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 38 Iter 58: loss 0.16689. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 38 Iter 59: loss 0.19233. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 38 Iter 59: loss 0.19233. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 38 Iter 60: loss 0.15831. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 38 Iter 60: loss 0.15831. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 38 Iter 61: loss 0.18238. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 38 Iter 61: loss 0.18238. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 38 Iter 62: loss 0.19024. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 38 Iter 62: loss 0.19024. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 38 Iter 63: loss 0.17903. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 38 Iter 63: loss 0.17903. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 38 Iter 64: loss 0.17462. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 38 Iter 64: loss 0.17462. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 38 Iter 65: loss 0.17880. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 38 Iter 65: loss 0.17880. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 38 Iter 66: loss 0.17857. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 38 Iter 66: loss 0.17857. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 38 Iter 67: loss 0.15987. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 38 Iter 67: loss 0.15987. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 68: loss 0.17575. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 68: loss 0.17575. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 38 Iter 69: loss 0.17341. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 38 Iter 69: loss 0.17341. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.17770. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.08it/s]
Epoch 38 Iter 70: loss 0.17770. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 38 Iter 71: loss 0.18306. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 38 Iter 71: loss 0.18306. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 38 Iter 72: loss 0.18105. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 38 Iter 72: loss 0.18105. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 38 Iter 73: loss 0.19131. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 38 Iter 73: loss 0.19131. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 38 Iter 74: loss 0.17679. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 38 Iter 74: loss 0.17679. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 38 Iter 75: loss 0.18203. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 38 Iter 75: loss 0.18203. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 38 Iter 76: loss 0.18512. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 38 Iter 76: loss 0.18512. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.08it/s]
Epoch 38 Iter 77: loss 0.16842. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.08it/s]
Epoch 38 Iter 77: loss 0.16842. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 38 Iter 78: loss 0.18839. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.09it/s]
Epoch 38 Iter 78: loss 0.18839. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 38 Iter 79: loss 0.18215. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 38 Iter 79: loss 0.18215. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 38 Iter 80: loss 0.18443. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.09it/s]
Epoch 38 Iter 80: loss 0.18443. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 38 Iter 81: loss 0.16984. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 38 Iter 81: loss 0.16984. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 38 Iter 82: loss 0.16263. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 38 Iter 82: loss 0.16263. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 38 Iter 83: loss 0.18061. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 38 Iter 83: loss 0.18061. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 38 Iter 84: loss 0.17383. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 38 Iter 84: loss 0.17383. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 38 Iter 85: loss 0.17752. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 38 Iter 85: loss 0.17752. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 38 Iter 86: loss 0.17747. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 38 Iter 86: loss 0.17747. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 38 Iter 87: loss 0.15815. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 38 Iter 87: loss 0.15815. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 38 Iter 88: loss 0.16400. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 38 Iter 88: loss 0.16400. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.06it/s]
Epoch 38 Iter 89: loss 0.17544. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.06it/s]
Epoch 38 Iter 89: loss 0.17544. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 38 Iter 90: loss 0.16149. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 38 Iter 90: loss 0.16149. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 38 Iter 91: loss 0.15814. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 38 Iter 91: loss 0.15814. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 38 Iter 92: loss 0.16890. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 38 Iter 92: loss 0.16890. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.06it/s]
Epoch 38 Iter 93: loss 0.16928. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.06it/s]
Epoch 38 Iter 93: loss 0.16928. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 38 Iter 94: loss 0.17435. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 38 Iter 94: loss 0.17435. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 38 Iter 95: loss 0.17642. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 38 Iter 95: loss 0.17642. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 38 Iter 96: loss 0.19086. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 38 Iter 96: loss 0.19086. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 38 Iter 97: loss 0.17041. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.04it/s]
Epoch 38 Iter 97: loss 0.17041. :  43%|███████████████████▍                         | 97/224 [00:46<01:02,  2.04it/s]
Epoch 38 Iter 98: loss 0.18448. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 38 Iter 98: loss 0.18448. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 38 Iter 99: loss 0.20870. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 38 Iter 99: loss 0.20870. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 38 Iter 100: loss 0.17477. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 38 Iter 100: loss 0.17477. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 38 Iter 101: loss 0.18604. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 38 Iter 101: loss 0.18604. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 38 Iter 102: loss 0.16756. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 38 Iter 102: loss 0.16756. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 38 Iter 103: loss 0.17205. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 38 Iter 103: loss 0.17205. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 38 Iter 104: loss 0.15941. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 38 Iter 104: loss 0.15941. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 38 Iter 105: loss 0.18159. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 38 Iter 105: loss 0.18159. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 38 Iter 106: loss 0.16939. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 38 Iter 106: loss 0.16939. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 38 Iter 107: loss 0.18584. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 38 Iter 107: loss 0.18584. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 38 Iter 108: loss 0.17552. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 38 Iter 108: loss 0.17552. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 38 Iter 109: loss 0.19175. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 38 Iter 109: loss 0.19175. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 38 Iter 110: loss 0.16700. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 38 Iter 110: loss 0.16700. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 38 Iter 111: loss 0.17157. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 38 Iter 111: loss 0.17157. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 38 Iter 112: loss 0.16234. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 38 Iter 112: loss 0.16234. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 38 Iter 113: loss 0.15062. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 38 Iter 113: loss 0.15062. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.19076. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 38 Iter 114: loss 0.19076. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 115: loss 0.17517. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 115: loss 0.17517. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 38 Iter 116: loss 0.16210. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 38 Iter 116: loss 0.16210. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.18791. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 117: loss 0.18791. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.16493. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 38 Iter 118: loss 0.16493. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 38 Iter 119: loss 0.19329. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 38 Iter 119: loss 0.19329. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 38 Iter 120: loss 0.18976. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 38 Iter 120: loss 0.18976. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 38 Iter 121: loss 0.16289. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 38 Iter 121: loss 0.16289. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 38 Iter 122: loss 0.16584. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 38 Iter 122: loss 0.16584. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 38 Iter 123: loss 0.15728. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 38 Iter 123: loss 0.15728. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 38 Iter 124: loss 0.16594. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 38 Iter 124: loss 0.16594. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 38 Iter 125: loss 0.16723. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 38 Iter 125: loss 0.16723. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 38 Iter 126: loss 0.19376. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 38 Iter 126: loss 0.19376. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 38 Iter 127: loss 0.19281. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 38 Iter 127: loss 0.19281. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 38 Iter 128: loss 0.15838. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 38 Iter 128: loss 0.15838. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 38 Iter 129: loss 0.17837. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 38 Iter 129: loss 0.17837. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 38 Iter 130: loss 0.17855. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 38 Iter 130: loss 0.17855. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.08it/s]
Epoch 38 Iter 131: loss 0.17448. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 38 Iter 131: loss 0.17448. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 38 Iter 132: loss 0.17015. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 38 Iter 132: loss 0.17015. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 38 Iter 133: loss 0.15721. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 38 Iter 133: loss 0.15721. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 134: loss 0.17906. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 134: loss 0.17906. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 38 Iter 135: loss 0.18810. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 38 Iter 135: loss 0.18810. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.15949. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 38 Iter 136: loss 0.15949. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.17509. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 38 Iter 137: loss 0.17509. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 38 Iter 138: loss 0.16798. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.06it/s]
Epoch 38 Iter 138: loss 0.16798. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 38 Iter 139: loss 0.17079. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 38 Iter 139: loss 0.17079. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 38 Iter 140: loss 0.18434. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 38 Iter 140: loss 0.18434. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 38 Iter 141: loss 0.18069. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 38 Iter 141: loss 0.18069. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 38 Iter 142: loss 0.17784. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 38 Iter 142: loss 0.17784. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 38 Iter 143: loss 0.17434. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 38 Iter 143: loss 0.17434. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 38 Iter 144: loss 0.16848. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 38 Iter 144: loss 0.16848. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 38 Iter 145: loss 0.15552. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 38 Iter 145: loss 0.15552. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 38 Iter 146: loss 0.17862. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 38 Iter 146: loss 0.17862. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.16243. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 38 Iter 147: loss 0.16243. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 38 Iter 148: loss 0.18178. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 38 Iter 148: loss 0.18178. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.09it/s]
Epoch 38 Iter 149: loss 0.16488. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.09it/s]
Epoch 38 Iter 149: loss 0.16488. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.10it/s]
Epoch 38 Iter 150: loss 0.15884. :  67%|████████████████████████████▌              | 149/224 [01:12<00:35,  2.10it/s]
Epoch 38 Iter 150: loss 0.15884. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.10it/s]
Epoch 38 Iter 151: loss 0.17492. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.10it/s]
Epoch 38 Iter 151: loss 0.17492. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 38 Iter 152: loss 0.15607. :  67%|████████████████████████████▉              | 151/224 [01:13<00:34,  2.09it/s]
Epoch 38 Iter 152: loss 0.15607. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.09it/s]
Epoch 38 Iter 153: loss 0.16900. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.09it/s]
Epoch 38 Iter 153: loss 0.16900. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.09it/s]
Epoch 38 Iter 154: loss 0.15655. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.09it/s]
Epoch 38 Iter 154: loss 0.15655. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 38 Iter 155: loss 0.18792. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 38 Iter 155: loss 0.18792. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.09it/s]
Epoch 38 Iter 156: loss 0.16811. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.09it/s]
Epoch 38 Iter 156: loss 0.16811. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 157: loss 0.17532. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 38 Iter 157: loss 0.17532. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 38 Iter 158: loss 0.18337. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 38 Iter 158: loss 0.18337. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 159: loss 0.16994. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 159: loss 0.16994. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.17167. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 38 Iter 160: loss 0.17167. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 38 Iter 161: loss 0.16806. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 38 Iter 161: loss 0.16806. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.07it/s]
Epoch 38 Iter 162: loss 0.17946. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 38 Iter 162: loss 0.17946. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 38 Iter 163: loss 0.16271. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 38 Iter 163: loss 0.16271. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 38 Iter 164: loss 0.19303. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 38 Iter 164: loss 0.19303. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 38 Iter 165: loss 0.18187. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 38 Iter 165: loss 0.18187. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.08it/s]
Epoch 38 Iter 166: loss 0.15778. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.08it/s]
Epoch 38 Iter 166: loss 0.15778. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 38 Iter 167: loss 0.17898. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 38 Iter 167: loss 0.17898. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 38 Iter 168: loss 0.17758. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 38 Iter 168: loss 0.17758. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 38 Iter 169: loss 0.16366. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 38 Iter 169: loss 0.16366. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 38 Iter 170: loss 0.16646. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 38 Iter 170: loss 0.16646. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.17409. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 38 Iter 171: loss 0.17409. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 38 Iter 172: loss 0.17508. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 38 Iter 172: loss 0.17508. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 38 Iter 173: loss 0.18290. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 38 Iter 173: loss 0.18290. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 38 Iter 174: loss 0.18200. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 38 Iter 174: loss 0.18200. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 175: loss 0.19103. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 38 Iter 175: loss 0.19103. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 38 Iter 176: loss 0.18145. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 38 Iter 176: loss 0.18145. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 38 Iter 177: loss 0.15408. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 38 Iter 177: loss 0.15408. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 38 Iter 178: loss 0.16504. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 38 Iter 178: loss 0.16504. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 38 Iter 179: loss 0.18621. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 38 Iter 179: loss 0.18621. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.09it/s]
Epoch 38 Iter 180: loss 0.16569. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.09it/s]
Epoch 38 Iter 180: loss 0.16569. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:20,  2.10it/s]
Epoch 38 Iter 181: loss 0.18528. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:20,  2.10it/s]
Epoch 38 Iter 181: loss 0.18528. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 38 Iter 182: loss 0.16436. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 38 Iter 182: loss 0.16436. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 38 Iter 183: loss 0.20905. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 38 Iter 183: loss 0.20905. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 38 Iter 184: loss 0.16826. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 38 Iter 184: loss 0.16826. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.09it/s]
Epoch 38 Iter 185: loss 0.17488. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 38 Iter 185: loss 0.17488. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 38 Iter 186: loss 0.17541. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 38 Iter 186: loss 0.17541. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.09it/s]
Epoch 38 Iter 187: loss 0.16282. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 38 Iter 187: loss 0.16282. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.10it/s]
Epoch 38 Iter 188: loss 0.17123. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.10it/s]
Epoch 38 Iter 188: loss 0.17123. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.09it/s]
Epoch 38 Iter 189: loss 0.18593. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.09it/s]
Epoch 38 Iter 189: loss 0.18593. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.09it/s]
Epoch 38 Iter 190: loss 0.15722. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.09it/s]
Epoch 38 Iter 190: loss 0.15722. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.08it/s]
Epoch 38 Iter 191: loss 0.16101. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.08it/s]
Epoch 38 Iter 191: loss 0.16101. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 38 Iter 192: loss 0.15898. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 38 Iter 192: loss 0.15898. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.08it/s]
Epoch 38 Iter 193: loss 0.16066. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.08it/s]
Epoch 38 Iter 193: loss 0.16066. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.09it/s]
Epoch 38 Iter 194: loss 0.17625. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.09it/s]
Epoch 38 Iter 194: loss 0.17625. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 38 Iter 195: loss 0.18704. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 38 Iter 195: loss 0.18704. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 38 Iter 196: loss 0.17061. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 38 Iter 196: loss 0.17061. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 38 Iter 197: loss 0.16682. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 38 Iter 197: loss 0.16682. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 38 Iter 198: loss 0.16703. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.08it/s]
Epoch 38 Iter 198: loss 0.16703. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 38 Iter 199: loss 0.18063. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 38 Iter 199: loss 0.18063. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 38 Iter 200: loss 0.16533. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:11,  2.09it/s]
Epoch 38 Iter 200: loss 0.16533. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.08it/s]
Epoch 38 Iter 201: loss 0.20474. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.08it/s]
Epoch 38 Iter 201: loss 0.20474. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 38 Iter 202: loss 0.17677. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 38 Iter 202: loss 0.17677. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 38 Iter 203: loss 0.17679. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 38 Iter 203: loss 0.17679. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 38 Iter 204: loss 0.20040. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 38 Iter 204: loss 0.20040. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 38 Iter 205: loss 0.15384. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 38 Iter 205: loss 0.15384. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 38 Iter 206: loss 0.18708. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 38 Iter 206: loss 0.18708. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.16995. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 207: loss 0.16995. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 208: loss 0.16455. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 38 Iter 208: loss 0.16455. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 38 Iter 209: loss 0.18475. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 38 Iter 209: loss 0.18475. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 38 Iter 210: loss 0.16350. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 38 Iter 210: loss 0.16350. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 38 Iter 211: loss 0.19244. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 38 Iter 211: loss 0.19244. :  94%|████████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.08it/s]
Epoch 38 Iter 212: loss 0.18269. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.08it/s]
Epoch 38 Iter 212: loss 0.18269. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 38 Iter 213: loss 0.17066. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 38 Iter 213: loss 0.17066. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.08it/s]
Epoch 38 Iter 214: loss 0.16692. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 38 Iter 214: loss 0.16692. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 215: loss 0.15772. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 215: loss 0.15772. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.09it/s]
Epoch 38 Iter 216: loss 0.17503. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.09it/s]
Epoch 38 Iter 216: loss 0.17503. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.18915. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 217: loss 0.18915. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.08it/s]
Epoch 38 Iter 218: loss 0.16147. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 38 Iter 218: loss 0.16147. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 38 Iter 219: loss 0.17512. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.09it/s]
Epoch 38 Iter 219: loss 0.17512. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.10it/s]
Epoch 38 Iter 220: loss 0.20304. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.10it/s]
Epoch 38 Iter 220: loss 0.20304. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.09it/s]
Epoch 38 Iter 221: loss 0.18564. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.09it/s]
Epoch 38 Iter 221: loss 0.18564. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 38 Iter 222: loss 0.17799. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 38 Iter 222: loss 0.17799. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 38 Iter 223: loss 0.18900. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 38 Iter 223: loss 0.18900. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.05it/s]
Epoch 38 Iter 224: loss 0.16959. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.05it/s]
Epoch 38 Iter 224: loss 0.16959. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 38 Iter 224: loss 0.16959. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.17759. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 39 Iter 1: loss 0.17759. :   0%|▏                                              | 1/224 [00:00<01:45,  2.12it/s]
Epoch 39 Iter 2: loss 0.19744. :   0%|▏                                              | 1/224 [00:00<01:45,  2.12it/s]
Epoch 39 Iter 2: loss 0.19744. :   1%|▍                                              | 2/224 [00:00<01:45,  2.10it/s]
Epoch 39 Iter 3: loss 0.18646. :   1%|▍                                              | 2/224 [00:01<01:45,  2.10it/s]
Epoch 39 Iter 3: loss 0.18646. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 39 Iter 4: loss 0.16678. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 39 Iter 4: loss 0.16678. :   2%|▊                                              | 4/224 [00:01<01:45,  2.08it/s]
Epoch 39 Iter 5: loss 0.17190. :   2%|▊                                              | 4/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 5: loss 0.17190. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.19329. :   2%|█                                              | 5/224 [00:02<01:45,  2.08it/s]
Epoch 39 Iter 6: loss 0.19329. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 39 Iter 7: loss 0.17470. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 39 Iter 7: loss 0.17470. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 39 Iter 8: loss 0.16330. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 39 Iter 8: loss 0.16330. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 39 Iter 9: loss 0.16722. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 9: loss 0.16722. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 10: loss 0.17749. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 39 Iter 10: loss 0.17749. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.16631. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 39 Iter 11: loss 0.16631. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 39 Iter 12: loss 0.16545. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 39 Iter 12: loss 0.16545. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 39 Iter 13: loss 0.17456. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 39 Iter 13: loss 0.17456. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 39 Iter 14: loss 0.16646. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 39 Iter 14: loss 0.16646. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 39 Iter 15: loss 0.16869. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 39 Iter 15: loss 0.16869. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 39 Iter 16: loss 0.17343. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 39 Iter 16: loss 0.17343. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 39 Iter 17: loss 0.16476. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 39 Iter 17: loss 0.16476. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 39 Iter 18: loss 0.16227. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 39 Iter 18: loss 0.16227. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 39 Iter 19: loss 0.17521. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 39 Iter 19: loss 0.17521. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 39 Iter 20: loss 0.18389. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 39 Iter 20: loss 0.18389. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 39 Iter 21: loss 0.17348. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 39 Iter 21: loss 0.17348. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 39 Iter 22: loss 0.19906. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 39 Iter 22: loss 0.19906. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 39 Iter 23: loss 0.17506. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 23: loss 0.17506. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 39 Iter 24: loss 0.16943. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 39 Iter 24: loss 0.16943. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.15162. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 39 Iter 25: loss 0.15162. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 39 Iter 26: loss 0.16968. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 39 Iter 26: loss 0.16968. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 39 Iter 27: loss 0.19914. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 39 Iter 27: loss 0.19914. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 39 Iter 28: loss 0.16048. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 39 Iter 28: loss 0.16048. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.16890. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 39 Iter 29: loss 0.16890. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 30: loss 0.16361. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 30: loss 0.16361. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.16717. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 39 Iter 31: loss 0.16717. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.19537. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 39 Iter 32: loss 0.19537. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 39 Iter 33: loss 0.17762. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 39 Iter 33: loss 0.17762. :  15%|██████▋                                      | 33/224 [00:15<01:33,  2.04it/s]
Epoch 39 Iter 34: loss 0.17578. :  15%|██████▋                                      | 33/224 [00:16<01:33,  2.04it/s]
Epoch 39 Iter 34: loss 0.17578. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 39 Iter 35: loss 0.18103. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 39 Iter 35: loss 0.18103. :  16%|███████                                      | 35/224 [00:16<01:32,  2.05it/s]
Epoch 39 Iter 36: loss 0.18343. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 39 Iter 36: loss 0.18343. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.04it/s]
Epoch 39 Iter 37: loss 0.20212. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.04it/s]
Epoch 39 Iter 37: loss 0.20212. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.05it/s]
Epoch 39 Iter 38: loss 0.15892. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 39 Iter 38: loss 0.15892. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 39 Iter 39: loss 0.17159. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 39 Iter 39: loss 0.17159. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.18757. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 40: loss 0.18757. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 41: loss 0.16941. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 39 Iter 41: loss 0.16941. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.18302. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 39 Iter 42: loss 0.18302. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 39 Iter 43: loss 0.20333. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 39 Iter 43: loss 0.20333. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 39 Iter 44: loss 0.18346. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 39 Iter 44: loss 0.18346. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 39 Iter 45: loss 0.18299. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 39 Iter 45: loss 0.18299. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.06it/s]
Epoch 39 Iter 46: loss 0.18346. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.06it/s]
Epoch 39 Iter 46: loss 0.18346. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 39 Iter 47: loss 0.17963. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 39 Iter 47: loss 0.17963. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 39 Iter 48: loss 0.17032. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 39 Iter 48: loss 0.17032. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 39 Iter 49: loss 0.15915. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.08it/s]
Epoch 39 Iter 49: loss 0.15915. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 39 Iter 50: loss 0.18374. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 39 Iter 50: loss 0.18374. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 39 Iter 51: loss 0.15519. :  22%|██████████                                   | 50/224 [00:24<01:23,  2.07it/s]
Epoch 39 Iter 51: loss 0.15519. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 39 Iter 52: loss 0.16808. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 39 Iter 52: loss 0.16808. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 39 Iter 53: loss 0.17566. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.07it/s]
Epoch 39 Iter 53: loss 0.17566. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.08it/s]
Epoch 39 Iter 54: loss 0.17593. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.08it/s]
Epoch 39 Iter 54: loss 0.17593. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 39 Iter 55: loss 0.18040. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 39 Iter 55: loss 0.18040. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.07it/s]
Epoch 39 Iter 56: loss 0.18089. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 56: loss 0.18089. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.15504. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 39 Iter 57: loss 0.15504. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.16882. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 58: loss 0.16882. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.17370. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 39 Iter 59: loss 0.17370. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.18786. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.07it/s]
Epoch 39 Iter 60: loss 0.18786. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.19486. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 39 Iter 61: loss 0.19486. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.16914. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 39 Iter 62: loss 0.16914. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 39 Iter 63: loss 0.16412. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 39 Iter 63: loss 0.16412. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 39 Iter 64: loss 0.19432. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 39 Iter 64: loss 0.19432. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.18736. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 39 Iter 65: loss 0.18736. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 39 Iter 66: loss 0.17976. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 39 Iter 66: loss 0.17976. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 39 Iter 67: loss 0.17430. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 67: loss 0.17430. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 68: loss 0.16318. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 39 Iter 68: loss 0.16318. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 39 Iter 69: loss 0.17053. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 69: loss 0.17053. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 70: loss 0.16186. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 39 Iter 70: loss 0.16186. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 39 Iter 71: loss 0.17001. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 39 Iter 71: loss 0.17001. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 39 Iter 72: loss 0.17042. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.05it/s]
Epoch 39 Iter 72: loss 0.17042. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.05it/s]
Epoch 39 Iter 73: loss 0.16228. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.05it/s]
Epoch 39 Iter 73: loss 0.16228. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.18662. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 39 Iter 74: loss 0.18662. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 39 Iter 75: loss 0.16287. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 75: loss 0.16287. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 76: loss 0.18225. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 39 Iter 76: loss 0.18225. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 39 Iter 77: loss 0.16337. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 39 Iter 77: loss 0.16337. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 39 Iter 78: loss 0.16343. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 39 Iter 78: loss 0.16343. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.09it/s]
Epoch 39 Iter 79: loss 0.15379. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.09it/s]
Epoch 39 Iter 79: loss 0.15379. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 39 Iter 80: loss 0.18955. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 39 Iter 80: loss 0.18955. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 39 Iter 81: loss 0.18074. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 39 Iter 81: loss 0.18074. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 39 Iter 82: loss 0.18540. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 39 Iter 82: loss 0.18540. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.08it/s]
Epoch 39 Iter 83: loss 0.17041. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.08it/s]
Epoch 39 Iter 83: loss 0.17041. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 39 Iter 84: loss 0.15970. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.08it/s]
Epoch 39 Iter 84: loss 0.15970. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.08it/s]
Epoch 39 Iter 85: loss 0.17481. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.08it/s]
Epoch 39 Iter 85: loss 0.17481. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 39 Iter 86: loss 0.19626. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.08it/s]
Epoch 39 Iter 86: loss 0.19626. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.08it/s]
Epoch 39 Iter 87: loss 0.17182. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.08it/s]
Epoch 39 Iter 87: loss 0.17182. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 39 Iter 88: loss 0.19668. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 39 Iter 88: loss 0.19668. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.15294. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 89: loss 0.15294. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 90: loss 0.16333. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 39 Iter 90: loss 0.16333. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 39 Iter 91: loss 0.16233. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 39 Iter 91: loss 0.16233. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 39 Iter 92: loss 0.17523. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 39 Iter 92: loss 0.17523. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 39 Iter 93: loss 0.17162. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.06it/s]
Epoch 39 Iter 93: loss 0.17162. :  42%|██████████████████▋                          | 93/224 [00:44<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.17047. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 94: loss 0.17047. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 95: loss 0.15546. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 39 Iter 95: loss 0.15546. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.05it/s]
Epoch 39 Iter 96: loss 0.17754. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 39 Iter 96: loss 0.17754. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 39 Iter 97: loss 0.17453. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 39 Iter 97: loss 0.17453. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 39 Iter 98: loss 0.18376. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 39 Iter 98: loss 0.18376. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 39 Iter 99: loss 0.17459. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 39 Iter 99: loss 0.17459. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 39 Iter 100: loss 0.16545. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 39 Iter 100: loss 0.16545. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 39 Iter 101: loss 0.17011. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 39 Iter 101: loss 0.17011. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 39 Iter 102: loss 0.17926. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 39 Iter 102: loss 0.17926. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 39 Iter 103: loss 0.16815. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 39 Iter 103: loss 0.16815. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.06it/s]
Epoch 39 Iter 104: loss 0.18850. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.06it/s]
Epoch 39 Iter 104: loss 0.18850. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 39 Iter 105: loss 0.16232. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 39 Iter 105: loss 0.16232. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.05it/s]
Epoch 39 Iter 106: loss 0.17262. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 106: loss 0.17262. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 107: loss 0.17611. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 39 Iter 107: loss 0.17611. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 39 Iter 108: loss 0.14928. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 39 Iter 108: loss 0.14928. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 39 Iter 109: loss 0.16377. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 39 Iter 109: loss 0.16377. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 39 Iter 110: loss 0.16858. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 39 Iter 110: loss 0.16858. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 111: loss 0.16141. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 111: loss 0.16141. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.08it/s]
Epoch 39 Iter 112: loss 0.16105. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.08it/s]
Epoch 39 Iter 112: loss 0.16105. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 113: loss 0.17162. :  50%|█████████████████████▌                     | 112/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 113: loss 0.17162. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.08it/s]
Epoch 39 Iter 114: loss 0.17769. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.08it/s]
Epoch 39 Iter 114: loss 0.17769. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 39 Iter 115: loss 0.16658. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 39 Iter 115: loss 0.16658. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 39 Iter 116: loss 0.18294. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 39 Iter 116: loss 0.18294. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 39 Iter 117: loss 0.16751. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 39 Iter 117: loss 0.16751. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 39 Iter 118: loss 0.15449. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 39 Iter 118: loss 0.15449. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 39 Iter 119: loss 0.18916. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 39 Iter 119: loss 0.18916. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 39 Iter 120: loss 0.15089. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 39 Iter 120: loss 0.15089. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 39 Iter 121: loss 0.20366. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 39 Iter 121: loss 0.20366. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 39 Iter 122: loss 0.16864. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 39 Iter 122: loss 0.16864. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 39 Iter 123: loss 0.17700. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.06it/s]
Epoch 39 Iter 123: loss 0.17700. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 39 Iter 124: loss 0.17694. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.06it/s]
Epoch 39 Iter 124: loss 0.17694. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 39 Iter 125: loss 0.17807. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 39 Iter 125: loss 0.17807. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 39 Iter 126: loss 0.18210. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 39 Iter 126: loss 0.18210. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 39 Iter 127: loss 0.16615. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 39 Iter 127: loss 0.16615. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 39 Iter 128: loss 0.18091. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 39 Iter 128: loss 0.18091. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 39 Iter 129: loss 0.17117. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 39 Iter 129: loss 0.17117. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.19927. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 39 Iter 130: loss 0.19927. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 39 Iter 131: loss 0.16491. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 39 Iter 131: loss 0.16491. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 39 Iter 132: loss 0.19752. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 39 Iter 132: loss 0.19752. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 39 Iter 133: loss 0.17073. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 39 Iter 133: loss 0.17073. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 39 Iter 134: loss 0.16302. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 39 Iter 134: loss 0.16302. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 39 Iter 135: loss 0.16709. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 39 Iter 135: loss 0.16709. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 39 Iter 136: loss 0.15334. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 39 Iter 136: loss 0.15334. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 39 Iter 137: loss 0.15542. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 39 Iter 137: loss 0.15542. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 39 Iter 138: loss 0.18713. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 39 Iter 138: loss 0.18713. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 39 Iter 139: loss 0.19614. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 39 Iter 139: loss 0.19614. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 39 Iter 140: loss 0.18567. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.07it/s]
Epoch 39 Iter 140: loss 0.18567. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 39 Iter 141: loss 0.16070. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 39 Iter 141: loss 0.16070. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 39 Iter 142: loss 0.17444. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.08it/s]
Epoch 39 Iter 142: loss 0.17444. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.18809. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 39 Iter 143: loss 0.18809. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 39 Iter 144: loss 0.17151. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 39 Iter 144: loss 0.17151. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 39 Iter 145: loss 0.16349. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 39 Iter 145: loss 0.16349. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 146: loss 0.16425. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 39 Iter 146: loss 0.16425. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 39 Iter 147: loss 0.19063. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 39 Iter 147: loss 0.19063. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 39 Iter 148: loss 0.16693. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 39 Iter 148: loss 0.16693. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 39 Iter 149: loss 0.18984. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 39 Iter 149: loss 0.18984. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 39 Iter 150: loss 0.15577. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 39 Iter 150: loss 0.15577. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.07it/s]
Epoch 39 Iter 151: loss 0.18286. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.07it/s]
Epoch 39 Iter 151: loss 0.18286. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 39 Iter 152: loss 0.15601. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 39 Iter 152: loss 0.15601. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 39 Iter 153: loss 0.19099. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 39 Iter 153: loss 0.19099. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 39 Iter 154: loss 0.18542. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.06it/s]
Epoch 39 Iter 154: loss 0.18542. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 39 Iter 155: loss 0.18593. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 39 Iter 155: loss 0.18593. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 39 Iter 156: loss 0.19679. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 39 Iter 156: loss 0.19679. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 39 Iter 157: loss 0.17574. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 39 Iter 157: loss 0.17574. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.09it/s]
Epoch 39 Iter 158: loss 0.17240. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.09it/s]
Epoch 39 Iter 158: loss 0.17240. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 39 Iter 159: loss 0.18641. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 39 Iter 159: loss 0.18641. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.08it/s]
Epoch 39 Iter 160: loss 0.18950. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 39 Iter 160: loss 0.18950. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 161: loss 0.17060. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 161: loss 0.17060. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.08it/s]
Epoch 39 Iter 162: loss 0.17409. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 39 Iter 162: loss 0.17409. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 39 Iter 163: loss 0.16656. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 39 Iter 163: loss 0.16656. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 39 Iter 164: loss 0.17697. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 164: loss 0.17697. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 165: loss 0.17373. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 39 Iter 165: loss 0.17373. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.18409. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 39 Iter 166: loss 0.18409. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 39 Iter 167: loss 0.16145. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 39 Iter 167: loss 0.16145. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 39 Iter 168: loss 0.16711. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 39 Iter 168: loss 0.16711. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 39 Iter 169: loss 0.17980. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 39 Iter 169: loss 0.17980. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 39 Iter 170: loss 0.17948. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 39 Iter 170: loss 0.17948. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 39 Iter 171: loss 0.18815. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 39 Iter 171: loss 0.18815. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 39 Iter 172: loss 0.18755. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 39 Iter 172: loss 0.18755. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 39 Iter 173: loss 0.17289. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 39 Iter 173: loss 0.17289. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 39 Iter 174: loss 0.18528. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 39 Iter 174: loss 0.18528. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 39 Iter 175: loss 0.16431. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 39 Iter 175: loss 0.16431. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 39 Iter 176: loss 0.17024. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 39 Iter 176: loss 0.17024. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 39 Iter 177: loss 0.17092. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 39 Iter 177: loss 0.17092. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 39 Iter 178: loss 0.18581. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 39 Iter 178: loss 0.18581. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 39 Iter 179: loss 0.17419. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.05it/s]
Epoch 39 Iter 179: loss 0.17419. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 39 Iter 180: loss 0.18726. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 180: loss 0.18726. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 181: loss 0.17393. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 39 Iter 181: loss 0.17393. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 39 Iter 182: loss 0.17927. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 39 Iter 182: loss 0.17927. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 39 Iter 183: loss 0.16473. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 39 Iter 183: loss 0.16473. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 39 Iter 184: loss 0.18935. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 39 Iter 184: loss 0.18935. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.08it/s]
Epoch 39 Iter 185: loss 0.19283. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.08it/s]
Epoch 39 Iter 185: loss 0.19283. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.15673. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.07it/s]
Epoch 39 Iter 186: loss 0.15673. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 39 Iter 187: loss 0.18665. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 39 Iter 187: loss 0.18665. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 39 Iter 188: loss 0.16152. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 39 Iter 188: loss 0.16152. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.04it/s]
Epoch 39 Iter 189: loss 0.15903. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.04it/s]
Epoch 39 Iter 189: loss 0.15903. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.18928. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.05it/s]
Epoch 39 Iter 190: loss 0.18928. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 39 Iter 191: loss 0.18862. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 39 Iter 191: loss 0.18862. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 39 Iter 192: loss 0.16595. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 39 Iter 192: loss 0.16595. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.17575. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 193: loss 0.17575. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.17243. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 39 Iter 194: loss 0.17243. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 39 Iter 195: loss 0.17497. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 39 Iter 195: loss 0.17497. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 196: loss 0.18175. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 39 Iter 196: loss 0.18175. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 39 Iter 197: loss 0.17792. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 39 Iter 197: loss 0.17792. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 39 Iter 198: loss 0.17218. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 39 Iter 198: loss 0.17218. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.05it/s]
Epoch 39 Iter 199: loss 0.15978. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 39 Iter 199: loss 0.15978. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 39 Iter 200: loss 0.18168. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 39 Iter 200: loss 0.18168. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 39 Iter 201: loss 0.19301. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 39 Iter 201: loss 0.19301. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 39 Iter 202: loss 0.19885. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 39 Iter 202: loss 0.19885. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 39 Iter 203: loss 0.20190. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 39 Iter 203: loss 0.20190. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.18485. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 39 Iter 204: loss 0.18485. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 39 Iter 205: loss 0.18101. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 205: loss 0.18101. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.15255. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.06it/s]
Epoch 39 Iter 206: loss 0.15255. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 39 Iter 207: loss 0.17276. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 39 Iter 207: loss 0.17276. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 39 Iter 208: loss 0.17874. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 39 Iter 208: loss 0.17874. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 39 Iter 209: loss 0.17594. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 209: loss 0.17594. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 210: loss 0.16863. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 39 Iter 210: loss 0.16863. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.05it/s]
Epoch 39 Iter 211: loss 0.15124. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 211: loss 0.15124. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 212: loss 0.21266. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.05it/s]
Epoch 39 Iter 212: loss 0.21266. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 39 Iter 213: loss 0.17714. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 39 Iter 213: loss 0.17714. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 39 Iter 214: loss 0.17904. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 39 Iter 214: loss 0.17904. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.08it/s]
Epoch 39 Iter 215: loss 0.16265. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.08it/s]
Epoch 39 Iter 215: loss 0.16265. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.09it/s]
Epoch 39 Iter 216: loss 0.17936. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.09it/s]
Epoch 39 Iter 216: loss 0.17936. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.09it/s]
Epoch 39 Iter 217: loss 0.17577. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.09it/s]
Epoch 39 Iter 217: loss 0.17577. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.10it/s]
Epoch 39 Iter 218: loss 0.19042. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.10it/s]
Epoch 39 Iter 218: loss 0.19042. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.10it/s]
Epoch 39 Iter 219: loss 0.18069. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.10it/s]
Epoch 39 Iter 219: loss 0.18069. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.09it/s]
Epoch 39 Iter 220: loss 0.16702. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.09it/s]
Epoch 39 Iter 220: loss 0.16702. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 39 Iter 221: loss 0.19258. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 39 Iter 221: loss 0.19258. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 39 Iter 222: loss 0.17375. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 39 Iter 222: loss 0.17375. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 39 Iter 223: loss 0.16365. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 39 Iter 223: loss 0.16365. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.14840. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.14840. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 39 Iter 224: loss 0.14840. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17508
    Valid loss: 0.17967
       Valid loss recons: 0.17332
       Valid loss KL-D:   63.48909
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.19458. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 40 Iter 1: loss 0.19458. :   0%|▏                                              | 1/224 [00:00<01:50,  2.02it/s]
Epoch 40 Iter 2: loss 0.16919. :   0%|▏                                              | 1/224 [00:00<01:50,  2.02it/s]
Epoch 40 Iter 2: loss 0.16919. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 40 Iter 3: loss 0.18370. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 40 Iter 3: loss 0.18370. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 40 Iter 4: loss 0.17701. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 40 Iter 4: loss 0.17701. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 40 Iter 5: loss 0.19045. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 40 Iter 5: loss 0.19045. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 40 Iter 6: loss 0.17177. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 40 Iter 6: loss 0.17177. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 40 Iter 7: loss 0.16976. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 40 Iter 7: loss 0.16976. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 40 Iter 8: loss 0.18262. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 40 Iter 8: loss 0.18262. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 40 Iter 9: loss 0.18421. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 40 Iter 9: loss 0.18421. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 40 Iter 10: loss 0.17816. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 40 Iter 10: loss 0.17816. :   4%|██                                           | 10/224 [00:04<01:44,  2.05it/s]
Epoch 40 Iter 11: loss 0.19403. :   4%|██                                           | 10/224 [00:05<01:44,  2.05it/s]
Epoch 40 Iter 11: loss 0.19403. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 40 Iter 12: loss 0.20290. :   5%|██▏                                          | 11/224 [00:05<01:44,  2.05it/s]
Epoch 40 Iter 12: loss 0.20290. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 40 Iter 13: loss 0.18312. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 40 Iter 13: loss 0.18312. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 14: loss 0.15836. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 14: loss 0.15836. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 40 Iter 15: loss 0.18528. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 40 Iter 15: loss 0.18528. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.16796. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 40 Iter 16: loss 0.16796. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 40 Iter 17: loss 0.18609. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 40 Iter 17: loss 0.18609. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 40 Iter 18: loss 0.15991. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.05it/s]
Epoch 40 Iter 18: loss 0.15991. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.06it/s]
Epoch 40 Iter 19: loss 0.18159. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.06it/s]
Epoch 40 Iter 19: loss 0.18159. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 40 Iter 20: loss 0.19396. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 40 Iter 20: loss 0.19396. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 40 Iter 21: loss 0.18958. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 40 Iter 21: loss 0.18958. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 40 Iter 22: loss 0.16778. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 40 Iter 22: loss 0.16778. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 40 Iter 23: loss 0.17029. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 40 Iter 23: loss 0.17029. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 40 Iter 24: loss 0.19156. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 40 Iter 24: loss 0.19156. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.06it/s]
Epoch 40 Iter 25: loss 0.17716. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 25: loss 0.17716. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 26: loss 0.18511. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 26: loss 0.18511. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 40 Iter 27: loss 0.17811. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 40 Iter 27: loss 0.17811. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 40 Iter 28: loss 0.16969. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 40 Iter 28: loss 0.16969. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 40 Iter 29: loss 0.18016. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 40 Iter 29: loss 0.18016. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 40 Iter 30: loss 0.16275. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.05it/s]
Epoch 40 Iter 30: loss 0.16275. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 40 Iter 31: loss 0.18966. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 40 Iter 31: loss 0.18966. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 40 Iter 32: loss 0.18794. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 40 Iter 32: loss 0.18794. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 40 Iter 33: loss 0.21291. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 40 Iter 33: loss 0.21291. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 40 Iter 34: loss 0.16908. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 40 Iter 34: loss 0.16908. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 40 Iter 35: loss 0.15724. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 40 Iter 35: loss 0.15724. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.16319. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 36: loss 0.16319. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.17191. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 40 Iter 37: loss 0.17191. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.18765. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 40 Iter 38: loss 0.18765. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.16869. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.05it/s]
Epoch 40 Iter 39: loss 0.16869. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.18214. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 40: loss 0.18214. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 41: loss 0.17874. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 41: loss 0.17874. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.06it/s]
Epoch 40 Iter 42: loss 0.17709. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.06it/s]
Epoch 40 Iter 42: loss 0.17709. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.19301. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.05it/s]
Epoch 40 Iter 43: loss 0.19301. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.06it/s]
Epoch 40 Iter 44: loss 0.16896. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.06it/s]
Epoch 40 Iter 44: loss 0.16896. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 40 Iter 45: loss 0.17154. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 40 Iter 45: loss 0.17154. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 40 Iter 46: loss 0.16637. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 40 Iter 46: loss 0.16637. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 40 Iter 47: loss 0.16924. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 40 Iter 47: loss 0.16924. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 40 Iter 48: loss 0.16276. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 40 Iter 48: loss 0.16276. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.19312. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 40 Iter 49: loss 0.19312. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 40 Iter 50: loss 0.17884. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 50: loss 0.17884. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.17844. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 51: loss 0.17844. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 40 Iter 52: loss 0.16652. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 40 Iter 52: loss 0.16652. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 53: loss 0.17934. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 53: loss 0.17934. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.15567. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 40 Iter 54: loss 0.15567. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 40 Iter 55: loss 0.19671. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.07it/s]
Epoch 40 Iter 55: loss 0.19671. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.17273. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 40 Iter 56: loss 0.17273. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 40 Iter 57: loss 0.18314. :  25%|███████████▎                                 | 56/224 [00:27<01:20,  2.08it/s]
Epoch 40 Iter 57: loss 0.18314. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 40 Iter 58: loss 0.19409. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 40 Iter 58: loss 0.19409. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 59: loss 0.16592. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 59: loss 0.16592. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 40 Iter 60: loss 0.17579. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 40 Iter 60: loss 0.17579. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 61: loss 0.17918. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 61: loss 0.17918. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.15418. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 40 Iter 62: loss 0.15418. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 63: loss 0.17885. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 63: loss 0.17885. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 40 Iter 64: loss 0.16810. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.06it/s]
Epoch 40 Iter 64: loss 0.16810. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 40 Iter 65: loss 0.17281. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 40 Iter 65: loss 0.17281. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.17546. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 40 Iter 66: loss 0.17546. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.08it/s]
Epoch 40 Iter 67: loss 0.15037. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.08it/s]
Epoch 40 Iter 67: loss 0.15037. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.17709. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 40 Iter 68: loss 0.17709. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.08it/s]
Epoch 40 Iter 69: loss 0.17118. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.08it/s]
Epoch 40 Iter 69: loss 0.17118. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 70: loss 0.15688. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 70: loss 0.15688. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 40 Iter 71: loss 0.17289. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 40 Iter 71: loss 0.17289. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 40 Iter 72: loss 0.16752. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 40 Iter 72: loss 0.16752. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.05it/s]
Epoch 40 Iter 73: loss 0.19257. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.05it/s]
Epoch 40 Iter 73: loss 0.19257. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 40 Iter 74: loss 0.17590. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 40 Iter 74: loss 0.17590. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 40 Iter 75: loss 0.16111. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 40 Iter 75: loss 0.16111. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 40 Iter 76: loss 0.17587. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.06it/s]
Epoch 40 Iter 76: loss 0.17587. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 40 Iter 77: loss 0.16434. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 77: loss 0.16434. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 78: loss 0.17638. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 40 Iter 78: loss 0.17638. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 40 Iter 79: loss 0.17635. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 40 Iter 79: loss 0.17635. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 40 Iter 80: loss 0.16061. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 40 Iter 80: loss 0.16061. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.06it/s]
Epoch 40 Iter 81: loss 0.18728. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.06it/s]
Epoch 40 Iter 81: loss 0.18728. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 40 Iter 82: loss 0.17301. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 40 Iter 82: loss 0.17301. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 40 Iter 83: loss 0.17214. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 40 Iter 83: loss 0.17214. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 40 Iter 84: loss 0.17996. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 40 Iter 84: loss 0.17996. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 40 Iter 85: loss 0.16288. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 40 Iter 85: loss 0.16288. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 86: loss 0.17348. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 40 Iter 86: loss 0.17348. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 40 Iter 87: loss 0.17965. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 40 Iter 87: loss 0.17965. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 40 Iter 88: loss 0.17741. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 40 Iter 88: loss 0.17741. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 40 Iter 89: loss 0.17901. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 40 Iter 89: loss 0.17901. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 40 Iter 90: loss 0.17896. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.06it/s]
Epoch 40 Iter 90: loss 0.17896. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 40 Iter 91: loss 0.17232. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 40 Iter 91: loss 0.17232. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 40 Iter 92: loss 0.17662. :  41%|██████████████████▎                          | 91/224 [00:44<01:05,  2.04it/s]
Epoch 40 Iter 92: loss 0.17662. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 40 Iter 93: loss 0.14719. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 40 Iter 93: loss 0.14719. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 40 Iter 94: loss 0.17175. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 40 Iter 94: loss 0.17175. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.06it/s]
Epoch 40 Iter 95: loss 0.18279. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.06it/s]
Epoch 40 Iter 95: loss 0.18279. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 40 Iter 96: loss 0.20384. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.05it/s]
Epoch 40 Iter 96: loss 0.20384. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 40 Iter 97: loss 0.16222. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 40 Iter 97: loss 0.16222. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 98: loss 0.16796. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 40 Iter 98: loss 0.16796. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 40 Iter 99: loss 0.17862. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.07it/s]
Epoch 40 Iter 99: loss 0.17862. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.07it/s]
Epoch 40 Iter 100: loss 0.17524. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 40 Iter 100: loss 0.17524. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 40 Iter 101: loss 0.17034. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 40 Iter 101: loss 0.17034. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.07it/s]
Epoch 40 Iter 102: loss 0.17188. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 40 Iter 102: loss 0.17188. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 40 Iter 103: loss 0.16204. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 40 Iter 103: loss 0.16204. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 40 Iter 104: loss 0.16797. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 40 Iter 104: loss 0.16797. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 40 Iter 105: loss 0.17534. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 40 Iter 105: loss 0.17534. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.16979. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 40 Iter 106: loss 0.16979. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 40 Iter 107: loss 0.16428. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.07it/s]
Epoch 40 Iter 107: loss 0.16428. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 40 Iter 108: loss 0.17870. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 108: loss 0.17870. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.17741. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 40 Iter 109: loss 0.17741. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 40 Iter 110: loss 0.16729. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 40 Iter 110: loss 0.16729. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 40 Iter 111: loss 0.18244. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 40 Iter 111: loss 0.18244. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 40 Iter 112: loss 0.15829. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 40 Iter 112: loss 0.15829. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 40 Iter 113: loss 0.18430. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 40 Iter 113: loss 0.18430. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 40 Iter 114: loss 0.17761. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 40 Iter 114: loss 0.17761. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.17631. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 115: loss 0.17631. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.17385. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 40 Iter 116: loss 0.17385. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 40 Iter 117: loss 0.15767. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 40 Iter 117: loss 0.15767. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 40 Iter 118: loss 0.18119. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 40 Iter 118: loss 0.18119. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 40 Iter 119: loss 0.16711. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 40 Iter 119: loss 0.16711. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.08it/s]
Epoch 40 Iter 120: loss 0.16070. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.08it/s]
Epoch 40 Iter 120: loss 0.16070. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.09it/s]
Epoch 40 Iter 121: loss 0.18687. :  54%|███████████████████████                    | 120/224 [00:58<00:49,  2.09it/s]
Epoch 40 Iter 121: loss 0.18687. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.08it/s]
Epoch 40 Iter 122: loss 0.16982. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.08it/s]
Epoch 40 Iter 122: loss 0.16982. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 40 Iter 123: loss 0.16925. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.08it/s]
Epoch 40 Iter 123: loss 0.16925. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 40 Iter 124: loss 0.18566. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 40 Iter 124: loss 0.18566. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 40 Iter 125: loss 0.16478. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 40 Iter 125: loss 0.16478. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 40 Iter 126: loss 0.17558. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 40 Iter 126: loss 0.17558. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 40 Iter 127: loss 0.18324. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 40 Iter 127: loss 0.18324. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 40 Iter 128: loss 0.17837. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 128: loss 0.17837. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 129: loss 0.16463. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 40 Iter 129: loss 0.16463. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.07it/s]
Epoch 40 Iter 130: loss 0.18563. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.07it/s]
Epoch 40 Iter 130: loss 0.18563. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 131: loss 0.15040. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 131: loss 0.15040. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 132: loss 0.17134. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 40 Iter 132: loss 0.17134. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 40 Iter 133: loss 0.16552. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 40 Iter 133: loss 0.16552. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 40 Iter 134: loss 0.17260. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 40 Iter 134: loss 0.17260. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.07it/s]
Epoch 40 Iter 135: loss 0.16110. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 40 Iter 135: loss 0.16110. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 40 Iter 136: loss 0.17817. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 40 Iter 136: loss 0.17817. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 40 Iter 137: loss 0.20197. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 40 Iter 137: loss 0.20197. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 40 Iter 138: loss 0.16494. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 40 Iter 138: loss 0.16494. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 40 Iter 139: loss 0.17513. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 40 Iter 139: loss 0.17513. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 40 Iter 140: loss 0.18264. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 40 Iter 140: loss 0.18264. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 40 Iter 141: loss 0.15981. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 141: loss 0.15981. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 142: loss 0.18363. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.06it/s]
Epoch 40 Iter 142: loss 0.18363. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.17115. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 40 Iter 143: loss 0.17115. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.17812. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 40 Iter 144: loss 0.17812. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 40 Iter 145: loss 0.17691. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 145: loss 0.17691. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 146: loss 0.16950. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 40 Iter 146: loss 0.16950. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.16955. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 40 Iter 147: loss 0.16955. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 40 Iter 148: loss 0.17720. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 40 Iter 148: loss 0.17720. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 40 Iter 149: loss 0.16454. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 40 Iter 149: loss 0.16454. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 40 Iter 150: loss 0.17784. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.05it/s]
Epoch 40 Iter 150: loss 0.17784. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 40 Iter 151: loss 0.17710. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 40 Iter 151: loss 0.17710. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 152: loss 0.18577. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 152: loss 0.18577. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:35,  2.05it/s]
Epoch 40 Iter 153: loss 0.19368. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:35,  2.05it/s]
Epoch 40 Iter 153: loss 0.19368. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 40 Iter 154: loss 0.17418. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 40 Iter 154: loss 0.17418. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.08it/s]
Epoch 40 Iter 155: loss 0.17638. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.08it/s]
Epoch 40 Iter 155: loss 0.17638. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 40 Iter 156: loss 0.17406. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 40 Iter 156: loss 0.17406. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 40 Iter 157: loss 0.19287. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.08it/s]
Epoch 40 Iter 157: loss 0.19287. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 40 Iter 158: loss 0.15710. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 40 Iter 158: loss 0.15710. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 40 Iter 159: loss 0.17510. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 159: loss 0.17510. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 160: loss 0.16614. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 40 Iter 160: loss 0.16614. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 40 Iter 161: loss 0.16589. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 40 Iter 161: loss 0.16589. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 40 Iter 162: loss 0.16880. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 40 Iter 162: loss 0.16880. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 40 Iter 163: loss 0.18160. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.07it/s]
Epoch 40 Iter 163: loss 0.18160. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 40 Iter 164: loss 0.16904. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 40 Iter 164: loss 0.16904. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.20760. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 165: loss 0.20760. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 40 Iter 166: loss 0.18398. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 40 Iter 166: loss 0.18398. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 40 Iter 167: loss 0.19016. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 40 Iter 167: loss 0.19016. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 40 Iter 168: loss 0.17476. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 40 Iter 168: loss 0.17476. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 40 Iter 169: loss 0.16887. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 40 Iter 169: loss 0.16887. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 40 Iter 170: loss 0.15331. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 40 Iter 170: loss 0.15331. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 40 Iter 171: loss 0.16880. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 40 Iter 171: loss 0.16880. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 40 Iter 172: loss 0.17451. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 40 Iter 172: loss 0.17451. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.10it/s]
Epoch 40 Iter 173: loss 0.20051. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.10it/s]
Epoch 40 Iter 173: loss 0.20051. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.09it/s]
Epoch 40 Iter 174: loss 0.18007. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.09it/s]
Epoch 40 Iter 174: loss 0.18007. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 40 Iter 175: loss 0.17906. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:23,  2.09it/s]
Epoch 40 Iter 175: loss 0.17906. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.09it/s]
Epoch 40 Iter 176: loss 0.16765. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.09it/s]
Epoch 40 Iter 176: loss 0.16765. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 40 Iter 177: loss 0.16028. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 40 Iter 177: loss 0.16028. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.11it/s]
Epoch 40 Iter 178: loss 0.19755. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.11it/s]
Epoch 40 Iter 178: loss 0.19755. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.10it/s]
Epoch 40 Iter 179: loss 0.17341. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.10it/s]
Epoch 40 Iter 179: loss 0.17341. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.11it/s]
Epoch 40 Iter 180: loss 0.17825. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.11it/s]
Epoch 40 Iter 180: loss 0.17825. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:20,  2.10it/s]
Epoch 40 Iter 181: loss 0.19743. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:20,  2.10it/s]
Epoch 40 Iter 181: loss 0.19743. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 40 Iter 182: loss 0.18155. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 40 Iter 182: loss 0.18155. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 40 Iter 183: loss 0.16635. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 40 Iter 183: loss 0.16635. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 40 Iter 184: loss 0.17679. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 184: loss 0.17679. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 185: loss 0.16797. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 40 Iter 185: loss 0.16797. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.02it/s]
Epoch 40 Iter 186: loss 0.17978. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.02it/s]
Epoch 40 Iter 186: loss 0.17978. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 40 Iter 187: loss 0.17566. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.04it/s]
Epoch 40 Iter 187: loss 0.17566. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:18,  2.04it/s]
Epoch 40 Iter 188: loss 0.15013. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:18,  2.04it/s]
Epoch 40 Iter 188: loss 0.15013. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.03it/s]
Epoch 40 Iter 189: loss 0.17289. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.03it/s]
Epoch 40 Iter 189: loss 0.17289. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.04it/s]
Epoch 40 Iter 190: loss 0.18564. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.04it/s]
Epoch 40 Iter 190: loss 0.18564. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 40 Iter 191: loss 0.18181. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 40 Iter 191: loss 0.18181. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.16292. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 40 Iter 192: loss 0.16292. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 40 Iter 193: loss 0.17897. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 40 Iter 193: loss 0.17897. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 40 Iter 194: loss 0.19046. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 40 Iter 194: loss 0.19046. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.17264. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 195: loss 0.17264. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 196: loss 0.18804. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 40 Iter 196: loss 0.18804. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.16155. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 197: loss 0.16155. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 198: loss 0.14784. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 40 Iter 198: loss 0.14784. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 40 Iter 199: loss 0.16271. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 199: loss 0.16271. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 200: loss 0.17146. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 40 Iter 200: loss 0.17146. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 40 Iter 201: loss 0.16462. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 40 Iter 201: loss 0.16462. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 40 Iter 202: loss 0.17774. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 40 Iter 202: loss 0.17774. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 40 Iter 203: loss 0.17975. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 40 Iter 203: loss 0.17975. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 40 Iter 204: loss 0.15179. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 40 Iter 204: loss 0.15179. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 40 Iter 205: loss 0.15115. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 40 Iter 205: loss 0.15115. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 40 Iter 206: loss 0.15971. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 40 Iter 206: loss 0.15971. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 40 Iter 207: loss 0.16159. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 40 Iter 207: loss 0.16159. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 40 Iter 208: loss 0.18777. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 40 Iter 208: loss 0.18777. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 40 Iter 209: loss 0.17387. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 40 Iter 209: loss 0.17387. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 40 Iter 210: loss 0.16253. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 40 Iter 210: loss 0.16253. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 40 Iter 211: loss 0.18960. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 40 Iter 211: loss 0.18960. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 40 Iter 212: loss 0.17715. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 40 Iter 212: loss 0.17715. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 40 Iter 213: loss 0.19030. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 40 Iter 213: loss 0.19030. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 40 Iter 214: loss 0.16831. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 40 Iter 214: loss 0.16831. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 40 Iter 215: loss 0.16679. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 40 Iter 215: loss 0.16679. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 40 Iter 216: loss 0.17487. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 40 Iter 216: loss 0.17487. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 40 Iter 217: loss 0.15851. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 40 Iter 217: loss 0.15851. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 40 Iter 218: loss 0.16924. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 40 Iter 218: loss 0.16924. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 40 Iter 219: loss 0.15626. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.08it/s]
Epoch 40 Iter 219: loss 0.15626. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 40 Iter 220: loss 0.17661. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 40 Iter 220: loss 0.17661. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 40 Iter 221: loss 0.18400. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 40 Iter 221: loss 0.18400. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 40 Iter 222: loss 0.18180. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 40 Iter 222: loss 0.18180. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 40 Iter 223: loss 0.18244. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.07it/s]
Epoch 40 Iter 223: loss 0.18244. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 40 Iter 224: loss 0.19113. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 40 Iter 224: loss 0.19113. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 40 Iter 224: loss 0.19113. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.15720. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 41 Iter 1: loss 0.15720. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 41 Iter 2: loss 0.16897. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 41 Iter 2: loss 0.16897. :   1%|▍                                              | 2/224 [00:00<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.17110. :   1%|▍                                              | 2/224 [00:01<01:46,  2.08it/s]
Epoch 41 Iter 3: loss 0.17110. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 41 Iter 4: loss 0.17704. :   1%|▋                                              | 3/224 [00:01<01:48,  2.04it/s]
Epoch 41 Iter 4: loss 0.17704. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 41 Iter 5: loss 0.17262. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 41 Iter 5: loss 0.17262. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 41 Iter 6: loss 0.17738. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 41 Iter 6: loss 0.17738. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 41 Iter 7: loss 0.15949. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 41 Iter 7: loss 0.15949. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 41 Iter 8: loss 0.16057. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.08it/s]
Epoch 41 Iter 8: loss 0.16057. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 41 Iter 9: loss 0.17141. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 41 Iter 9: loss 0.17141. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 10: loss 0.17875. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 10: loss 0.17875. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 41 Iter 11: loss 0.20181. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 41 Iter 11: loss 0.20181. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 41 Iter 12: loss 0.18133. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.07it/s]
Epoch 41 Iter 12: loss 0.18133. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.16790. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 13: loss 0.16790. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 14: loss 0.18933. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 41 Iter 14: loss 0.18933. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 41 Iter 15: loss 0.20039. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 41 Iter 15: loss 0.20039. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 41 Iter 16: loss 0.15980. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 41 Iter 16: loss 0.15980. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 41 Iter 17: loss 0.19311. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 41 Iter 17: loss 0.19311. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 18: loss 0.18981. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 18: loss 0.18981. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 41 Iter 19: loss 0.17028. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 41 Iter 19: loss 0.17028. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 41 Iter 20: loss 0.16144. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.05it/s]
Epoch 41 Iter 20: loss 0.16144. :   9%|████                                         | 20/224 [00:09<01:39,  2.05it/s]
Epoch 41 Iter 21: loss 0.17558. :   9%|████                                         | 20/224 [00:10<01:39,  2.05it/s]
Epoch 41 Iter 21: loss 0.17558. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 41 Iter 22: loss 0.15385. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 41 Iter 22: loss 0.15385. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.08it/s]
Epoch 41 Iter 23: loss 0.17175. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.08it/s]
Epoch 41 Iter 23: loss 0.17175. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 41 Iter 24: loss 0.17614. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 41 Iter 24: loss 0.17614. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.08it/s]
Epoch 41 Iter 25: loss 0.15514. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.08it/s]
Epoch 41 Iter 25: loss 0.15514. :  11%|█████                                        | 25/224 [00:12<01:35,  2.08it/s]
Epoch 41 Iter 26: loss 0.17260. :  11%|█████                                        | 25/224 [00:12<01:35,  2.08it/s]
Epoch 41 Iter 26: loss 0.17260. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 41 Iter 27: loss 0.15435. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 41 Iter 27: loss 0.15435. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 41 Iter 28: loss 0.17655. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 41 Iter 28: loss 0.17655. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.17226. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 41 Iter 29: loss 0.17226. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 30: loss 0.17005. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 30: loss 0.17005. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 41 Iter 31: loss 0.16213. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 41 Iter 31: loss 0.16213. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 32: loss 0.16669. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 41 Iter 32: loss 0.16669. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 41 Iter 33: loss 0.16353. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 41 Iter 33: loss 0.16353. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.06it/s]
Epoch 41 Iter 34: loss 0.16899. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 41 Iter 34: loss 0.16899. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.17787. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 41 Iter 35: loss 0.17787. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 41 Iter 36: loss 0.18086. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 41 Iter 36: loss 0.18086. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 41 Iter 37: loss 0.15593. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 41 Iter 37: loss 0.15593. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.06it/s]
Epoch 41 Iter 38: loss 0.16359. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 38: loss 0.16359. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 39: loss 0.17468. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 41 Iter 39: loss 0.17468. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 41 Iter 40: loss 0.17572. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 41 Iter 40: loss 0.17572. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 41 Iter 41: loss 0.17442. :  18%|████████                                     | 40/224 [00:19<01:29,  2.05it/s]
Epoch 41 Iter 41: loss 0.17442. :  18%|████████▏                                    | 41/224 [00:19<01:29,  2.05it/s]
Epoch 41 Iter 42: loss 0.18284. :  18%|████████▏                                    | 41/224 [00:20<01:29,  2.05it/s]
Epoch 41 Iter 42: loss 0.18284. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 41 Iter 43: loss 0.17707. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 41 Iter 43: loss 0.17707. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 41 Iter 44: loss 0.17232. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 41 Iter 44: loss 0.17232. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 41 Iter 45: loss 0.14899. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 41 Iter 45: loss 0.14899. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 41 Iter 46: loss 0.18829. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 41 Iter 46: loss 0.18829. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 41 Iter 47: loss 0.17956. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 41 Iter 47: loss 0.17956. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 41 Iter 48: loss 0.18566. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 41 Iter 48: loss 0.18566. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 41 Iter 49: loss 0.17596. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 41 Iter 49: loss 0.17596. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 41 Iter 50: loss 0.18352. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 41 Iter 50: loss 0.18352. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 41 Iter 51: loss 0.16904. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 41 Iter 51: loss 0.16904. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.05it/s]
Epoch 41 Iter 52: loss 0.18133. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.05it/s]
Epoch 41 Iter 52: loss 0.18133. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 41 Iter 53: loss 0.15803. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.05it/s]
Epoch 41 Iter 53: loss 0.15803. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 41 Iter 54: loss 0.15367. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 41 Iter 54: loss 0.15367. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 41 Iter 55: loss 0.18187. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 41 Iter 55: loss 0.18187. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.06it/s]
Epoch 41 Iter 56: loss 0.16286. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 56: loss 0.16286. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 57: loss 0.17990. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 57: loss 0.17990. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.06it/s]
Epoch 41 Iter 58: loss 0.16280. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.06it/s]
Epoch 41 Iter 58: loss 0.16280. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 41 Iter 59: loss 0.18274. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 41 Iter 59: loss 0.18274. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 41 Iter 60: loss 0.17807. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 41 Iter 60: loss 0.17807. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 41 Iter 61: loss 0.17864. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 41 Iter 61: loss 0.17864. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 41 Iter 62: loss 0.16055. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.07it/s]
Epoch 41 Iter 62: loss 0.16055. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 41 Iter 63: loss 0.18745. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 41 Iter 63: loss 0.18745. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.07it/s]
Epoch 41 Iter 64: loss 0.17602. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 64: loss 0.17602. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.16078. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.07it/s]
Epoch 41 Iter 65: loss 0.16078. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.19101. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 66: loss 0.19101. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.17027. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 41 Iter 67: loss 0.17027. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 41 Iter 68: loss 0.18790. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 41 Iter 68: loss 0.18790. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.07it/s]
Epoch 41 Iter 69: loss 0.16720. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 41 Iter 69: loss 0.16720. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 41 Iter 70: loss 0.15899. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 41 Iter 70: loss 0.15899. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 41 Iter 71: loss 0.18894. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 71: loss 0.18894. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 72: loss 0.17682. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 41 Iter 72: loss 0.17682. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 41 Iter 73: loss 0.16677. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 41 Iter 73: loss 0.16677. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 41 Iter 74: loss 0.16881. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 41 Iter 74: loss 0.16881. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 41 Iter 75: loss 0.18671. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 41 Iter 75: loss 0.18671. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 41 Iter 76: loss 0.16066. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 41 Iter 76: loss 0.16066. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 41 Iter 77: loss 0.18714. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 41 Iter 77: loss 0.18714. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 41 Iter 78: loss 0.18632. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 41 Iter 78: loss 0.18632. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 41 Iter 79: loss 0.15421. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 41 Iter 79: loss 0.15421. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 41 Iter 80: loss 0.17832. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.06it/s]
Epoch 41 Iter 80: loss 0.17832. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.04it/s]
Epoch 41 Iter 81: loss 0.15732. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.04it/s]
Epoch 41 Iter 81: loss 0.15732. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.04it/s]
Epoch 41 Iter 82: loss 0.15793. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.04it/s]
Epoch 41 Iter 82: loss 0.15793. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 41 Iter 83: loss 0.17028. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 41 Iter 83: loss 0.17028. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 41 Iter 84: loss 0.16773. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 41 Iter 84: loss 0.16773. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 41 Iter 85: loss 0.16588. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 41 Iter 85: loss 0.16588. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 41 Iter 86: loss 0.17438. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 41 Iter 86: loss 0.17438. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 41 Iter 87: loss 0.16693. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 41 Iter 87: loss 0.16693. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 41 Iter 88: loss 0.16431. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 41 Iter 88: loss 0.16431. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.03it/s]
Epoch 41 Iter 89: loss 0.17857. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.03it/s]
Epoch 41 Iter 89: loss 0.17857. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 41 Iter 90: loss 0.19351. :  40%|█████████████████▉                           | 89/224 [00:43<01:06,  2.04it/s]
Epoch 41 Iter 90: loss 0.19351. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 41 Iter 91: loss 0.16308. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 41 Iter 91: loss 0.16308. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 41 Iter 92: loss 0.19748. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.05it/s]
Epoch 41 Iter 92: loss 0.19748. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.04it/s]
Epoch 41 Iter 93: loss 0.19303. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.04it/s]
Epoch 41 Iter 93: loss 0.19303. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 41 Iter 94: loss 0.17011. :  42%|██████████████████▋                          | 93/224 [00:45<01:04,  2.04it/s]
Epoch 41 Iter 94: loss 0.17011. :  42%|██████████████████▉                          | 94/224 [00:45<01:03,  2.05it/s]
Epoch 41 Iter 95: loss 0.17291. :  42%|██████████████████▉                          | 94/224 [00:46<01:03,  2.05it/s]
Epoch 41 Iter 95: loss 0.17291. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 41 Iter 96: loss 0.18139. :  42%|███████████████████                          | 95/224 [00:46<01:03,  2.04it/s]
Epoch 41 Iter 96: loss 0.18139. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.05it/s]
Epoch 41 Iter 97: loss 0.17917. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.05it/s]
Epoch 41 Iter 97: loss 0.17917. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 41 Iter 98: loss 0.20176. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 41 Iter 98: loss 0.20176. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 41 Iter 99: loss 0.16515. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 41 Iter 99: loss 0.16515. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 41 Iter 100: loss 0.16935. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 41 Iter 100: loss 0.16935. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 41 Iter 101: loss 0.17663. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 41 Iter 101: loss 0.17663. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 41 Iter 102: loss 0.21123. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.05it/s]
Epoch 41 Iter 102: loss 0.21123. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 41 Iter 103: loss 0.17445. :  46%|███████████████████▌                       | 102/224 [00:50<00:59,  2.05it/s]
Epoch 41 Iter 103: loss 0.17445. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 41 Iter 104: loss 0.18394. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.05it/s]
Epoch 41 Iter 104: loss 0.18394. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.04it/s]
Epoch 41 Iter 105: loss 0.16397. :  46%|███████████████████▉                       | 104/224 [00:51<00:58,  2.04it/s]
Epoch 41 Iter 105: loss 0.16397. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 41 Iter 106: loss 0.17837. :  47%|████████████████████▏                      | 105/224 [00:51<00:58,  2.05it/s]
Epoch 41 Iter 106: loss 0.17837. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 41 Iter 107: loss 0.15847. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.05it/s]
Epoch 41 Iter 107: loss 0.15847. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.05it/s]
Epoch 41 Iter 108: loss 0.18159. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.05it/s]
Epoch 41 Iter 108: loss 0.18159. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 41 Iter 109: loss 0.17518. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 41 Iter 109: loss 0.17518. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.05it/s]
Epoch 41 Iter 110: loss 0.18300. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.05it/s]
Epoch 41 Iter 110: loss 0.18300. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 41 Iter 111: loss 0.16590. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.05it/s]
Epoch 41 Iter 111: loss 0.16590. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 41 Iter 112: loss 0.18042. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 41 Iter 112: loss 0.18042. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 41 Iter 113: loss 0.18721. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.07it/s]
Epoch 41 Iter 113: loss 0.18721. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 41 Iter 114: loss 0.17186. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 41 Iter 114: loss 0.17186. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 41 Iter 115: loss 0.16588. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 41 Iter 115: loss 0.16588. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.05it/s]
Epoch 41 Iter 116: loss 0.15448. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.05it/s]
Epoch 41 Iter 116: loss 0.15448. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 41 Iter 117: loss 0.17282. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 41 Iter 117: loss 0.17282. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 41 Iter 118: loss 0.18729. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 41 Iter 118: loss 0.18729. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 41 Iter 119: loss 0.16723. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 41 Iter 119: loss 0.16723. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.17573. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 41 Iter 120: loss 0.17573. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.17776. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 41 Iter 121: loss 0.17776. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 41 Iter 122: loss 0.18359. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.05it/s]
Epoch 41 Iter 122: loss 0.18359. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 41 Iter 123: loss 0.18264. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.04it/s]
Epoch 41 Iter 123: loss 0.18264. :  55%|███████████████████████▌                   | 123/224 [00:59<00:50,  2.00it/s]
Epoch 41 Iter 124: loss 0.17965. :  55%|███████████████████████▌                   | 123/224 [01:00<00:50,  2.00it/s]
Epoch 41 Iter 124: loss 0.17965. :  55%|███████████████████████▊                   | 124/224 [01:00<00:49,  2.02it/s]
Epoch 41 Iter 125: loss 0.17024. :  55%|███████████████████████▊                   | 124/224 [01:00<00:49,  2.02it/s]
Epoch 41 Iter 125: loss 0.17024. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.03it/s]
Epoch 41 Iter 126: loss 0.16619. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.03it/s]
Epoch 41 Iter 126: loss 0.16619. :  56%|████████████████████████▏                  | 126/224 [01:01<00:48,  2.04it/s]
Epoch 41 Iter 127: loss 0.17043. :  56%|████████████████████████▏                  | 126/224 [01:01<00:48,  2.04it/s]
Epoch 41 Iter 127: loss 0.17043. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 41 Iter 128: loss 0.16313. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 41 Iter 128: loss 0.16313. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.03it/s]
Epoch 41 Iter 129: loss 0.17999. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.03it/s]
Epoch 41 Iter 129: loss 0.17999. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 41 Iter 130: loss 0.16099. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 41 Iter 130: loss 0.16099. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 131: loss 0.16309. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 131: loss 0.16309. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.05it/s]
Epoch 41 Iter 132: loss 0.17511. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.05it/s]
Epoch 41 Iter 132: loss 0.17511. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.17512. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 41 Iter 133: loss 0.17512. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 41 Iter 134: loss 0.15561. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.08it/s]
Epoch 41 Iter 134: loss 0.15561. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 41 Iter 135: loss 0.17638. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.08it/s]
Epoch 41 Iter 135: loss 0.17638. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.08it/s]
Epoch 41 Iter 136: loss 0.19310. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.08it/s]
Epoch 41 Iter 136: loss 0.19310. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 41 Iter 137: loss 0.16980. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 41 Iter 137: loss 0.16980. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.08it/s]
Epoch 41 Iter 138: loss 0.16785. :  61%|██████████████████████████▎                | 137/224 [01:07<00:41,  2.08it/s]
Epoch 41 Iter 138: loss 0.16785. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 41 Iter 139: loss 0.15925. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 41 Iter 139: loss 0.15925. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 41 Iter 140: loss 0.17350. :  62%|██████████████████████████▋                | 139/224 [01:08<00:41,  2.07it/s]
Epoch 41 Iter 140: loss 0.17350. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 41 Iter 141: loss 0.17014. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 41 Iter 141: loss 0.17014. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 41 Iter 142: loss 0.18489. :  63%|███████████████████████████                | 141/224 [01:09<00:40,  2.07it/s]
Epoch 41 Iter 142: loss 0.18489. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 143: loss 0.16759. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.07it/s]
Epoch 41 Iter 143: loss 0.16759. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 41 Iter 144: loss 0.16526. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.08it/s]
Epoch 41 Iter 144: loss 0.16526. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 41 Iter 145: loss 0.17043. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 41 Iter 145: loss 0.17043. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 41 Iter 146: loss 0.18162. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 41 Iter 146: loss 0.18162. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 41 Iter 147: loss 0.19487. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 41 Iter 147: loss 0.19487. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 41 Iter 148: loss 0.19261. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 41 Iter 148: loss 0.19261. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 41 Iter 149: loss 0.17775. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 149: loss 0.17775. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 150: loss 0.19534. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 41 Iter 150: loss 0.19534. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 41 Iter 151: loss 0.16452. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 41 Iter 151: loss 0.16452. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 41 Iter 152: loss 0.17305. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.08it/s]
Epoch 41 Iter 152: loss 0.17305. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.08it/s]
Epoch 41 Iter 153: loss 0.16306. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.08it/s]
Epoch 41 Iter 153: loss 0.16306. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 41 Iter 154: loss 0.18295. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.08it/s]
Epoch 41 Iter 154: loss 0.18295. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.09it/s]
Epoch 41 Iter 155: loss 0.18458. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.09it/s]
Epoch 41 Iter 155: loss 0.18458. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.09it/s]
Epoch 41 Iter 156: loss 0.17272. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.09it/s]
Epoch 41 Iter 156: loss 0.17272. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 41 Iter 157: loss 0.18471. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.09it/s]
Epoch 41 Iter 157: loss 0.18471. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.09it/s]
Epoch 41 Iter 158: loss 0.15195. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.09it/s]
Epoch 41 Iter 158: loss 0.15195. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.09it/s]
Epoch 41 Iter 159: loss 0.18064. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.09it/s]
Epoch 41 Iter 159: loss 0.18064. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 41 Iter 160: loss 0.16352. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 41 Iter 160: loss 0.16352. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.18198. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 41 Iter 161: loss 0.18198. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.17952. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.08it/s]
Epoch 41 Iter 162: loss 0.17952. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 41 Iter 163: loss 0.18339. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.08it/s]
Epoch 41 Iter 163: loss 0.18339. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.16680. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.10it/s]
Epoch 41 Iter 164: loss 0.16680. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 41 Iter 165: loss 0.20223. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.08it/s]
Epoch 41 Iter 165: loss 0.20223. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 166: loss 0.16156. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 166: loss 0.16156. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 41 Iter 167: loss 0.16865. :  74%|███████████████████████████████▊           | 166/224 [01:21<00:28,  2.07it/s]
Epoch 41 Iter 167: loss 0.16865. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 41 Iter 168: loss 0.17458. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 41 Iter 168: loss 0.17458. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 41 Iter 169: loss 0.18691. :  75%|████████████████████████████████▎          | 168/224 [01:22<00:27,  2.06it/s]
Epoch 41 Iter 169: loss 0.18691. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 41 Iter 170: loss 0.15399. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 41 Iter 170: loss 0.15399. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 41 Iter 171: loss 0.17990. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.08it/s]
Epoch 41 Iter 171: loss 0.17990. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.08it/s]
Epoch 41 Iter 172: loss 0.18154. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.08it/s]
Epoch 41 Iter 172: loss 0.18154. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.08it/s]
Epoch 41 Iter 173: loss 0.15964. :  77%|█████████████████████████████████          | 172/224 [01:23<00:24,  2.08it/s]
Epoch 41 Iter 173: loss 0.15964. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 41 Iter 174: loss 0.17798. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 41 Iter 174: loss 0.17798. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 41 Iter 175: loss 0.17766. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.08it/s]
Epoch 41 Iter 175: loss 0.17766. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 41 Iter 176: loss 0.18106. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 41 Iter 176: loss 0.18106. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 41 Iter 177: loss 0.18853. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.08it/s]
Epoch 41 Iter 177: loss 0.18853. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 41 Iter 178: loss 0.18166. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 41 Iter 178: loss 0.18166. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 41 Iter 179: loss 0.18077. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 41 Iter 179: loss 0.18077. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 41 Iter 180: loss 0.17884. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 41 Iter 180: loss 0.17884. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 41 Iter 181: loss 0.16824. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 41 Iter 181: loss 0.16824. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.08it/s]
Epoch 41 Iter 182: loss 0.17073. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.08it/s]
Epoch 41 Iter 182: loss 0.17073. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 41 Iter 183: loss 0.18309. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 41 Iter 183: loss 0.18309. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.10it/s]
Epoch 41 Iter 184: loss 0.17749. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.10it/s]
Epoch 41 Iter 184: loss 0.17749. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 41 Iter 185: loss 0.15015. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 41 Iter 185: loss 0.15015. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 41 Iter 186: loss 0.18551. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.09it/s]
Epoch 41 Iter 186: loss 0.18551. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 41 Iter 187: loss 0.16864. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.09it/s]
Epoch 41 Iter 187: loss 0.16864. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 41 Iter 188: loss 0.19656. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 41 Iter 188: loss 0.19656. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 41 Iter 189: loss 0.16477. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 41 Iter 189: loss 0.16477. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.09it/s]
Epoch 41 Iter 190: loss 0.17111. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.09it/s]
Epoch 41 Iter 190: loss 0.17111. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.09it/s]
Epoch 41 Iter 191: loss 0.17388. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.09it/s]
Epoch 41 Iter 191: loss 0.17388. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 41 Iter 192: loss 0.16125. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.09it/s]
Epoch 41 Iter 192: loss 0.16125. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.09it/s]
Epoch 41 Iter 193: loss 0.18469. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.09it/s]
Epoch 41 Iter 193: loss 0.18469. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.10it/s]
Epoch 41 Iter 194: loss 0.16823. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.10it/s]
Epoch 41 Iter 194: loss 0.16823. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.09it/s]
Epoch 41 Iter 195: loss 0.17012. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.09it/s]
Epoch 41 Iter 195: loss 0.17012. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.09it/s]
Epoch 41 Iter 196: loss 0.18137. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.09it/s]
Epoch 41 Iter 196: loss 0.18137. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.09it/s]
Epoch 41 Iter 197: loss 0.16533. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.09it/s]
Epoch 41 Iter 197: loss 0.16533. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 41 Iter 198: loss 0.17626. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 41 Iter 198: loss 0.17626. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 41 Iter 199: loss 0.17288. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 41 Iter 199: loss 0.17288. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 41 Iter 200: loss 0.17972. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 41 Iter 200: loss 0.17972. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 41 Iter 201: loss 0.17531. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 41 Iter 201: loss 0.17531. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 41 Iter 202: loss 0.15880. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 41 Iter 202: loss 0.15880. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 41 Iter 203: loss 0.20084. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 41 Iter 203: loss 0.20084. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 41 Iter 204: loss 0.16439. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 41 Iter 204: loss 0.16439. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 41 Iter 205: loss 0.17383. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 41 Iter 205: loss 0.17383. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 41 Iter 206: loss 0.15901. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 41 Iter 206: loss 0.15901. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.16586. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 207: loss 0.16586. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 208: loss 0.16889. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 41 Iter 208: loss 0.16889. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 41 Iter 209: loss 0.16710. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 41 Iter 209: loss 0.16710. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 41 Iter 210: loss 0.16505. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 41 Iter 210: loss 0.16505. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 41 Iter 211: loss 0.17889. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.06it/s]
Epoch 41 Iter 211: loss 0.17889. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 41 Iter 212: loss 0.16702. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 41 Iter 212: loss 0.16702. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.18452. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 41 Iter 213: loss 0.18452. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 41 Iter 214: loss 0.17207. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 41 Iter 214: loss 0.17207. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 41 Iter 215: loss 0.18485. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 215: loss 0.18485. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.17791. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 41 Iter 216: loss 0.17791. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 41 Iter 217: loss 0.18333. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 41 Iter 217: loss 0.18333. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 41 Iter 218: loss 0.16104. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 41 Iter 218: loss 0.16104. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 41 Iter 219: loss 0.16778. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 41 Iter 219: loss 0.16778. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 41 Iter 220: loss 0.17237. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 41 Iter 220: loss 0.17237. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 41 Iter 221: loss 0.18973. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 41 Iter 221: loss 0.18973. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 41 Iter 222: loss 0.17224. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 41 Iter 222: loss 0.17224. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 41 Iter 223: loss 0.17570. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 223: loss 0.17570. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.18757. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.18757. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]
Epoch 41 Iter 224: loss 0.18757. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

    Train loss: 0.17417
    Valid loss: 0.17986
       Valid loss recons: 0.17342
       Valid loss KL-D:   64.32978
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.16718. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 42 Iter 1: loss 0.16718. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 2: loss 0.17152. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 42 Iter 2: loss 0.17152. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 42 Iter 3: loss 0.18115. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 42 Iter 3: loss 0.18115. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 42 Iter 4: loss 0.15002. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 42 Iter 4: loss 0.15002. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 42 Iter 5: loss 0.15527. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 5: loss 0.15527. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.15830. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 42 Iter 6: loss 0.15830. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 42 Iter 7: loss 0.18773. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 42 Iter 7: loss 0.18773. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 42 Iter 8: loss 0.18272. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 42 Iter 8: loss 0.18272. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 42 Iter 9: loss 0.17335. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 42 Iter 9: loss 0.17335. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 10: loss 0.17381. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 42 Iter 10: loss 0.17381. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 42 Iter 11: loss 0.18961. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 42 Iter 11: loss 0.18961. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 42 Iter 12: loss 0.18263. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 42 Iter 12: loss 0.18263. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 42 Iter 13: loss 0.18524. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 42 Iter 13: loss 0.18524. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 42 Iter 14: loss 0.18469. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 42 Iter 14: loss 0.18469. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 42 Iter 15: loss 0.18295. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 42 Iter 15: loss 0.18295. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.15193. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 16: loss 0.15193. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 42 Iter 17: loss 0.17164. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 42 Iter 17: loss 0.17164. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.18772. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 42 Iter 18: loss 0.18772. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.08it/s]
Epoch 42 Iter 19: loss 0.15792. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.08it/s]
Epoch 42 Iter 19: loss 0.15792. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 42 Iter 20: loss 0.15316. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 42 Iter 20: loss 0.15316. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 42 Iter 21: loss 0.18944. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 42 Iter 21: loss 0.18944. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 42 Iter 22: loss 0.16605. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.05it/s]
Epoch 42 Iter 22: loss 0.16605. :  10%|████▍                                        | 22/224 [00:10<01:38,  2.06it/s]
Epoch 42 Iter 23: loss 0.18110. :  10%|████▍                                        | 22/224 [00:11<01:38,  2.06it/s]
Epoch 42 Iter 23: loss 0.18110. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 42 Iter 24: loss 0.18753. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 42 Iter 24: loss 0.18753. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 42 Iter 25: loss 0.17116. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 25: loss 0.17116. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 26: loss 0.18428. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 42 Iter 26: loss 0.18428. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.06it/s]
Epoch 42 Iter 27: loss 0.17947. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.06it/s]
Epoch 42 Iter 27: loss 0.17947. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 42 Iter 28: loss 0.18899. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 42 Iter 28: loss 0.18899. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 42 Iter 29: loss 0.15606. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 42 Iter 29: loss 0.15606. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 42 Iter 30: loss 0.15758. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 42 Iter 30: loss 0.15758. :  13%|██████                                       | 30/224 [00:14<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.16812. :  13%|██████                                       | 30/224 [00:15<01:34,  2.06it/s]
Epoch 42 Iter 31: loss 0.16812. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 32: loss 0.17680. :  14%|██████▏                                      | 31/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 32: loss 0.17680. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 33: loss 0.17280. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.06it/s]
Epoch 42 Iter 33: loss 0.17280. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 42 Iter 34: loss 0.18112. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 42 Iter 34: loss 0.18112. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 42 Iter 35: loss 0.16125. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 42 Iter 35: loss 0.16125. :  16%|███████                                      | 35/224 [00:16<01:31,  2.08it/s]
Epoch 42 Iter 36: loss 0.18241. :  16%|███████                                      | 35/224 [00:17<01:31,  2.08it/s]
Epoch 42 Iter 36: loss 0.18241. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 42 Iter 37: loss 0.19501. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.07it/s]
Epoch 42 Iter 37: loss 0.19501. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 42 Iter 38: loss 0.17311. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 42 Iter 38: loss 0.17311. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 42 Iter 39: loss 0.18633. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 42 Iter 39: loss 0.18633. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 42 Iter 40: loss 0.17323. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 42 Iter 40: loss 0.17323. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 42 Iter 41: loss 0.18926. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 42 Iter 41: loss 0.18926. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 42 Iter 42: loss 0.16986. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 42 Iter 42: loss 0.16986. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 42 Iter 43: loss 0.17341. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 42 Iter 43: loss 0.17341. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 42 Iter 44: loss 0.18361. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 42 Iter 44: loss 0.18361. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 42 Iter 45: loss 0.17147. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 42 Iter 45: loss 0.17147. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.04it/s]
Epoch 42 Iter 46: loss 0.18014. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.04it/s]
Epoch 42 Iter 46: loss 0.18014. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 42 Iter 47: loss 0.16099. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 42 Iter 47: loss 0.16099. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.04it/s]
Epoch 42 Iter 48: loss 0.17175. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 42 Iter 48: loss 0.17175. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 42 Iter 49: loss 0.17656. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 42 Iter 49: loss 0.17656. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.04it/s]
Epoch 42 Iter 50: loss 0.17388. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.04it/s]
Epoch 42 Iter 50: loss 0.17388. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 42 Iter 51: loss 0.15833. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 42 Iter 51: loss 0.15833. :  23%|██████████▏                                  | 51/224 [00:24<01:25,  2.03it/s]
Epoch 42 Iter 52: loss 0.15389. :  23%|██████████▏                                  | 51/224 [00:25<01:25,  2.03it/s]
Epoch 42 Iter 52: loss 0.15389. :  23%|██████████▍                                  | 52/224 [00:25<01:25,  2.02it/s]
Epoch 42 Iter 53: loss 0.16380. :  23%|██████████▍                                  | 52/224 [00:25<01:25,  2.02it/s]
Epoch 42 Iter 53: loss 0.16380. :  24%|██████████▋                                  | 53/224 [00:25<01:24,  2.02it/s]
Epoch 42 Iter 54: loss 0.16480. :  24%|██████████▋                                  | 53/224 [00:26<01:24,  2.02it/s]
Epoch 42 Iter 54: loss 0.16480. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.03it/s]
Epoch 42 Iter 55: loss 0.16381. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.03it/s]
Epoch 42 Iter 55: loss 0.16381. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.04it/s]
Epoch 42 Iter 56: loss 0.18097. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.04it/s]
Epoch 42 Iter 56: loss 0.18097. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 42 Iter 57: loss 0.18599. :  25%|███████████▎                                 | 56/224 [00:27<01:22,  2.04it/s]
Epoch 42 Iter 57: loss 0.18599. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.04it/s]
Epoch 42 Iter 58: loss 0.17719. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.04it/s]
Epoch 42 Iter 58: loss 0.17719. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 42 Iter 59: loss 0.15722. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.05it/s]
Epoch 42 Iter 59: loss 0.15722. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 42 Iter 60: loss 0.17626. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 42 Iter 60: loss 0.17626. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 42 Iter 61: loss 0.13888. :  27%|████████████                                 | 60/224 [00:29<01:20,  2.04it/s]
Epoch 42 Iter 61: loss 0.13888. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.05it/s]
Epoch 42 Iter 62: loss 0.18790. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.05it/s]
Epoch 42 Iter 62: loss 0.18790. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 63: loss 0.15697. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 63: loss 0.15697. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 42 Iter 64: loss 0.18420. :  28%|████████████▋                                | 63/224 [00:31<01:18,  2.05it/s]
Epoch 42 Iter 64: loss 0.18420. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 42 Iter 65: loss 0.16331. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 42 Iter 65: loss 0.16331. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.04it/s]
Epoch 42 Iter 66: loss 0.18156. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.04it/s]
Epoch 42 Iter 66: loss 0.18156. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.03it/s]
Epoch 42 Iter 67: loss 0.18296. :  29%|█████████████▎                               | 66/224 [00:32<01:17,  2.03it/s]
Epoch 42 Iter 67: loss 0.18296. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.05it/s]
Epoch 42 Iter 68: loss 0.15827. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.05it/s]
Epoch 42 Iter 68: loss 0.15827. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 42 Iter 69: loss 0.15446. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.05it/s]
Epoch 42 Iter 69: loss 0.15446. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.05it/s]
Epoch 42 Iter 70: loss 0.17641. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.05it/s]
Epoch 42 Iter 70: loss 0.17641. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 42 Iter 71: loss 0.18781. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.04it/s]
Epoch 42 Iter 71: loss 0.18781. :  32%|██████████████▎                              | 71/224 [00:34<01:15,  2.04it/s]
Epoch 42 Iter 72: loss 0.16758. :  32%|██████████████▎                              | 71/224 [00:35<01:15,  2.04it/s]
Epoch 42 Iter 72: loss 0.16758. :  32%|██████████████▍                              | 72/224 [00:35<01:16,  1.99it/s]
Epoch 42 Iter 73: loss 0.17290. :  32%|██████████████▍                              | 72/224 [00:35<01:16,  1.99it/s]
Epoch 42 Iter 73: loss 0.17290. :  33%|██████████████▋                              | 73/224 [00:35<01:15,  2.01it/s]
Epoch 42 Iter 74: loss 0.16523. :  33%|██████████████▋                              | 73/224 [00:36<01:15,  2.01it/s]
Epoch 42 Iter 74: loss 0.16523. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 42 Iter 75: loss 0.17206. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.04it/s]
Epoch 42 Iter 75: loss 0.17206. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.04it/s]
Epoch 42 Iter 76: loss 0.16250. :  33%|███████████████                              | 75/224 [00:37<01:12,  2.04it/s]
Epoch 42 Iter 76: loss 0.16250. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 42 Iter 77: loss 0.15801. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 42 Iter 77: loss 0.15801. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 42 Iter 78: loss 0.20429. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.05it/s]
Epoch 42 Iter 78: loss 0.20429. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.06it/s]
Epoch 42 Iter 79: loss 0.16988. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.06it/s]
Epoch 42 Iter 79: loss 0.16988. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 42 Iter 80: loss 0.18665. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 42 Iter 80: loss 0.18665. :  36%|████████████████                             | 80/224 [00:38<01:08,  2.09it/s]
Epoch 42 Iter 81: loss 0.16373. :  36%|████████████████                             | 80/224 [00:39<01:08,  2.09it/s]
Epoch 42 Iter 81: loss 0.16373. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.09it/s]
Epoch 42 Iter 82: loss 0.18190. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.09it/s]
Epoch 42 Iter 82: loss 0.18190. :  37%|████████████████▍                            | 82/224 [00:39<01:07,  2.09it/s]
Epoch 42 Iter 83: loss 0.18264. :  37%|████████████████▍                            | 82/224 [00:40<01:07,  2.09it/s]
Epoch 42 Iter 83: loss 0.18264. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.10it/s]
Epoch 42 Iter 84: loss 0.16466. :  37%|████████████████▋                            | 83/224 [00:40<01:07,  2.10it/s]
Epoch 42 Iter 84: loss 0.16466. :  38%|████████████████▉                            | 84/224 [00:40<01:06,  2.10it/s]
Epoch 42 Iter 85: loss 0.17724. :  38%|████████████████▉                            | 84/224 [00:41<01:06,  2.10it/s]
Epoch 42 Iter 85: loss 0.17724. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.09it/s]
Epoch 42 Iter 86: loss 0.17281. :  38%|█████████████████                            | 85/224 [00:41<01:06,  2.09it/s]
Epoch 42 Iter 86: loss 0.17281. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 42 Iter 87: loss 0.17023. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 42 Iter 87: loss 0.17023. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 42 Iter 88: loss 0.17893. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 42 Iter 88: loss 0.17893. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 42 Iter 89: loss 0.18331. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 42 Iter 89: loss 0.18331. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 42 Iter 90: loss 0.17977. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 42 Iter 90: loss 0.17977. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 42 Iter 91: loss 0.17339. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 42 Iter 91: loss 0.17339. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 42 Iter 92: loss 0.18025. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.06it/s]
Epoch 42 Iter 92: loss 0.18025. :  41%|██████████████████▍                          | 92/224 [00:44<01:04,  2.05it/s]
Epoch 42 Iter 93: loss 0.15688. :  41%|██████████████████▍                          | 92/224 [00:45<01:04,  2.05it/s]
Epoch 42 Iter 93: loss 0.15688. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 42 Iter 94: loss 0.18112. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 42 Iter 94: loss 0.18112. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 42 Iter 95: loss 0.18391. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 42 Iter 95: loss 0.18391. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 42 Iter 96: loss 0.16720. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 42 Iter 96: loss 0.16720. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 42 Iter 97: loss 0.16648. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.08it/s]
Epoch 42 Iter 97: loss 0.16648. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 42 Iter 98: loss 0.16692. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 42 Iter 98: loss 0.16692. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 42 Iter 99: loss 0.17068. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 42 Iter 99: loss 0.17068. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 100: loss 0.18733. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 100: loss 0.18733. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 42 Iter 101: loss 0.18512. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 42 Iter 101: loss 0.18512. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 42 Iter 102: loss 0.16240. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 42 Iter 102: loss 0.16240. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 42 Iter 103: loss 0.15438. :  46%|███████████████████▌                       | 102/224 [00:50<00:58,  2.07it/s]
Epoch 42 Iter 103: loss 0.15438. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 42 Iter 104: loss 0.19741. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 42 Iter 104: loss 0.19741. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 42 Iter 105: loss 0.15964. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 42 Iter 105: loss 0.15964. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 42 Iter 106: loss 0.16670. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 42 Iter 106: loss 0.16670. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 42 Iter 107: loss 0.18430. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 42 Iter 107: loss 0.18430. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 42 Iter 108: loss 0.16577. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 108: loss 0.16577. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 109: loss 0.15897. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 42 Iter 109: loss 0.15897. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.20305. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 110: loss 0.20305. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 111: loss 0.16440. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 42 Iter 111: loss 0.16440. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.18060. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 42 Iter 112: loss 0.18060. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.16726. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 42 Iter 113: loss 0.16726. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.17875. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 42 Iter 114: loss 0.17875. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 42 Iter 115: loss 0.19574. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 42 Iter 115: loss 0.19574. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 42 Iter 116: loss 0.17327. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.08it/s]
Epoch 42 Iter 116: loss 0.17327. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 42 Iter 117: loss 0.17248. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 42 Iter 117: loss 0.17248. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.17525. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 118: loss 0.17525. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.17396. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 42 Iter 119: loss 0.17396. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 42 Iter 120: loss 0.18594. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.07it/s]
Epoch 42 Iter 120: loss 0.18594. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.17776. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.06it/s]
Epoch 42 Iter 121: loss 0.17776. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.17061. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 122: loss 0.17061. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 123: loss 0.17628. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 42 Iter 123: loss 0.17628. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 42 Iter 124: loss 0.16153. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 42 Iter 124: loss 0.16153. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 125: loss 0.17152. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 42 Iter 125: loss 0.17152. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 42 Iter 126: loss 0.17624. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.05it/s]
Epoch 42 Iter 126: loss 0.17624. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.18096. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 127: loss 0.18096. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 42 Iter 128: loss 0.16850. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.05it/s]
Epoch 42 Iter 128: loss 0.16850. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 42 Iter 129: loss 0.17011. :  57%|████████████████████████▌                  | 128/224 [01:02<00:47,  2.04it/s]
Epoch 42 Iter 129: loss 0.17011. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.17361. :  58%|████████████████████████▊                  | 129/224 [01:03<00:46,  2.05it/s]
Epoch 42 Iter 130: loss 0.17361. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 131: loss 0.16552. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 131: loss 0.16552. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 42 Iter 132: loss 0.18323. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 42 Iter 132: loss 0.18323. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 42 Iter 133: loss 0.16950. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 42 Iter 133: loss 0.16950. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.08it/s]
Epoch 42 Iter 134: loss 0.16076. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:43,  2.08it/s]
Epoch 42 Iter 134: loss 0.16076. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 42 Iter 135: loss 0.18236. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 42 Iter 135: loss 0.18236. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 42 Iter 136: loss 0.17199. :  60%|█████████████████████████▉                 | 135/224 [01:06<00:42,  2.07it/s]
Epoch 42 Iter 136: loss 0.17199. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 42 Iter 137: loss 0.18573. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 42 Iter 137: loss 0.18573. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 42 Iter 138: loss 0.16873. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 42 Iter 138: loss 0.16873. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 42 Iter 139: loss 0.17655. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 42 Iter 139: loss 0.17655. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 42 Iter 140: loss 0.18497. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 42 Iter 140: loss 0.18497. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 42 Iter 141: loss 0.15365. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 141: loss 0.15365. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 142: loss 0.18108. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 42 Iter 142: loss 0.18108. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 42 Iter 143: loss 0.16048. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 42 Iter 143: loss 0.16048. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 42 Iter 144: loss 0.16511. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 42 Iter 144: loss 0.16511. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 42 Iter 145: loss 0.16106. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 145: loss 0.16106. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 146: loss 0.16989. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 42 Iter 146: loss 0.16989. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.16969. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 147: loss 0.16969. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 148: loss 0.17984. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 42 Iter 148: loss 0.17984. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 42 Iter 149: loss 0.18055. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 149: loss 0.18055. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 150: loss 0.18767. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 42 Iter 150: loss 0.18767. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.18230. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 42 Iter 151: loss 0.18230. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 42 Iter 152: loss 0.18495. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 42 Iter 152: loss 0.18495. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 42 Iter 153: loss 0.18200. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 42 Iter 153: loss 0.18200. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 42 Iter 154: loss 0.15483. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 42 Iter 154: loss 0.15483. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 42 Iter 155: loss 0.16068. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 42 Iter 155: loss 0.16068. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 42 Iter 156: loss 0.18313. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 42 Iter 156: loss 0.18313. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 42 Iter 157: loss 0.16614. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 42 Iter 157: loss 0.16614. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 42 Iter 158: loss 0.16113. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 42 Iter 158: loss 0.16113. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 42 Iter 159: loss 0.18394. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.08it/s]
Epoch 42 Iter 159: loss 0.18394. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 42 Iter 160: loss 0.17583. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.08it/s]
Epoch 42 Iter 160: loss 0.17583. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.08it/s]
Epoch 42 Iter 161: loss 0.18517. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.08it/s]
Epoch 42 Iter 161: loss 0.18517. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.09it/s]
Epoch 42 Iter 162: loss 0.15690. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.09it/s]
Epoch 42 Iter 162: loss 0.15690. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.09it/s]
Epoch 42 Iter 163: loss 0.17289. :  72%|███████████████████████████████            | 162/224 [01:19<00:29,  2.09it/s]
Epoch 42 Iter 163: loss 0.17289. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 42 Iter 164: loss 0.16697. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.08it/s]
Epoch 42 Iter 164: loss 0.16697. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 42 Iter 165: loss 0.18675. :  73%|███████████████████████████████▍           | 164/224 [01:20<00:28,  2.08it/s]
Epoch 42 Iter 165: loss 0.18675. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 42 Iter 166: loss 0.19186. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 42 Iter 166: loss 0.19186. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 42 Iter 167: loss 0.18644. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.07it/s]
Epoch 42 Iter 167: loss 0.18644. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 42 Iter 168: loss 0.18283. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 42 Iter 168: loss 0.18283. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 42 Iter 169: loss 0.17094. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 42 Iter 169: loss 0.17094. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 42 Iter 170: loss 0.15648. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 42 Iter 170: loss 0.15648. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 42 Iter 171: loss 0.16429. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 42 Iter 171: loss 0.16429. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 42 Iter 172: loss 0.17308. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 42 Iter 172: loss 0.17308. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 42 Iter 173: loss 0.18758. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 42 Iter 173: loss 0.18758. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 42 Iter 174: loss 0.17949. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 42 Iter 174: loss 0.17949. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 42 Iter 175: loss 0.15660. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 42 Iter 175: loss 0.15660. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.17253. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 176: loss 0.17253. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 177: loss 0.17353. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 42 Iter 177: loss 0.17353. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 42 Iter 178: loss 0.19428. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 42 Iter 178: loss 0.19428. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 42 Iter 179: loss 0.19165. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.08it/s]
Epoch 42 Iter 179: loss 0.19165. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.18342. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.08it/s]
Epoch 42 Iter 180: loss 0.18342. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 42 Iter 181: loss 0.17850. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 42 Iter 181: loss 0.17850. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.18789. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 42 Iter 182: loss 0.18789. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 42 Iter 183: loss 0.18355. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 42 Iter 183: loss 0.18355. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.07it/s]
Epoch 42 Iter 184: loss 0.16112. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.07it/s]
Epoch 42 Iter 184: loss 0.16112. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 42 Iter 185: loss 0.17324. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 42 Iter 185: loss 0.17324. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 42 Iter 186: loss 0.19415. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.08it/s]
Epoch 42 Iter 186: loss 0.19415. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 42 Iter 187: loss 0.16428. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 42 Iter 187: loss 0.16428. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 42 Iter 188: loss 0.18092. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 42 Iter 188: loss 0.18092. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 42 Iter 189: loss 0.18026. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 42 Iter 189: loss 0.18026. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 42 Iter 190: loss 0.19178. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:17,  2.06it/s]
Epoch 42 Iter 190: loss 0.19178. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 42 Iter 191: loss 0.18126. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 42 Iter 191: loss 0.18126. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 42 Iter 192: loss 0.17072. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:16,  2.06it/s]
Epoch 42 Iter 192: loss 0.17072. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 42 Iter 193: loss 0.16090. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 42 Iter 193: loss 0.16090. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.05it/s]
Epoch 42 Iter 194: loss 0.16811. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:15,  2.05it/s]
Epoch 42 Iter 194: loss 0.16811. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 42 Iter 195: loss 0.18802. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.05it/s]
Epoch 42 Iter 195: loss 0.18802. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 42 Iter 196: loss 0.18487. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 42 Iter 196: loss 0.18487. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 42 Iter 197: loss 0.16856. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 42 Iter 197: loss 0.16856. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 42 Iter 198: loss 0.16880. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.06it/s]
Epoch 42 Iter 198: loss 0.16880. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.08it/s]
Epoch 42 Iter 199: loss 0.17997. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 199: loss 0.17997. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 200: loss 0.17455. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 42 Iter 200: loss 0.17455. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 42 Iter 201: loss 0.16949. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 201: loss 0.16949. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 202: loss 0.15368. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 42 Iter 202: loss 0.15368. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 42 Iter 203: loss 0.15856. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 42 Iter 203: loss 0.15856. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 42 Iter 204: loss 0.16155. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 42 Iter 204: loss 0.16155. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.18698. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 42 Iter 205: loss 0.18698. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 42 Iter 206: loss 0.16130. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 42 Iter 206: loss 0.16130. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 42 Iter 207: loss 0.17934. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 207: loss 0.17934. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 208: loss 0.17364. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 42 Iter 208: loss 0.17364. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 42 Iter 209: loss 0.18521. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 42 Iter 209: loss 0.18521. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 42 Iter 210: loss 0.17432. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 42 Iter 210: loss 0.17432. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 42 Iter 211: loss 0.19809. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 42 Iter 211: loss 0.19809. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 42 Iter 212: loss 0.16784. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 42 Iter 212: loss 0.16784. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 42 Iter 213: loss 0.16714. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 42 Iter 213: loss 0.16714. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 42 Iter 214: loss 0.17414. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 42 Iter 214: loss 0.17414. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 42 Iter 215: loss 0.18556. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 215: loss 0.18556. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 216: loss 0.16710. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 42 Iter 216: loss 0.16710. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.08it/s]
Epoch 42 Iter 217: loss 0.16664. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.08it/s]
Epoch 42 Iter 217: loss 0.16664. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 42 Iter 218: loss 0.16861. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 42 Iter 218: loss 0.16861. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 42 Iter 219: loss 0.16491. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 42 Iter 219: loss 0.16491. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 42 Iter 220: loss 0.17874. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 42 Iter 220: loss 0.17874. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 42 Iter 221: loss 0.18511. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.08it/s]
Epoch 42 Iter 221: loss 0.18511. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.09it/s]
Epoch 42 Iter 222: loss 0.16446. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.09it/s]
Epoch 42 Iter 222: loss 0.16446. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 42 Iter 223: loss 0.16158. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.08it/s]
Epoch 42 Iter 223: loss 0.16158. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 42 Iter 224: loss 0.17409. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 42 Iter 224: loss 0.17409. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 42 Iter 224: loss 0.17409. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.17002. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 43 Iter 1: loss 0.17002. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 43 Iter 2: loss 0.16293. :   0%|▏                                              | 1/224 [00:00<01:46,  2.10it/s]
Epoch 43 Iter 2: loss 0.16293. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 43 Iter 3: loss 0.17260. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 43 Iter 3: loss 0.17260. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 43 Iter 4: loss 0.17579. :   1%|▋                                              | 3/224 [00:01<01:47,  2.05it/s]
Epoch 43 Iter 4: loss 0.17579. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 43 Iter 5: loss 0.17800. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 43 Iter 5: loss 0.17800. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 6: loss 0.16865. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 6: loss 0.16865. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 43 Iter 7: loss 0.17652. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 43 Iter 7: loss 0.17652. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 43 Iter 8: loss 0.16546. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 43 Iter 8: loss 0.16546. :   4%|█▋                                             | 8/224 [00:03<01:43,  2.08it/s]
Epoch 43 Iter 9: loss 0.16742. :   4%|█▋                                             | 8/224 [00:04<01:43,  2.08it/s]
Epoch 43 Iter 9: loss 0.16742. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.08it/s]
Epoch 43 Iter 10: loss 0.18385. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.08it/s]
Epoch 43 Iter 10: loss 0.18385. :   4%|██                                           | 10/224 [00:04<01:42,  2.09it/s]
Epoch 43 Iter 11: loss 0.17601. :   4%|██                                           | 10/224 [00:05<01:42,  2.09it/s]
Epoch 43 Iter 11: loss 0.17601. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 43 Iter 12: loss 0.15021. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.09it/s]
Epoch 43 Iter 12: loss 0.15021. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.09it/s]
Epoch 43 Iter 13: loss 0.18662. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.09it/s]
Epoch 43 Iter 13: loss 0.18662. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 43 Iter 14: loss 0.16490. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 43 Iter 14: loss 0.16490. :   6%|██▊                                          | 14/224 [00:06<01:40,  2.08it/s]
Epoch 43 Iter 15: loss 0.18615. :   6%|██▊                                          | 14/224 [00:07<01:40,  2.08it/s]
Epoch 43 Iter 15: loss 0.18615. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 43 Iter 16: loss 0.15925. :   7%|███                                          | 15/224 [00:07<01:40,  2.08it/s]
Epoch 43 Iter 16: loss 0.15925. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.08it/s]
Epoch 43 Iter 17: loss 0.17712. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.08it/s]
Epoch 43 Iter 17: loss 0.17712. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 43 Iter 18: loss 0.18234. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.08it/s]
Epoch 43 Iter 18: loss 0.18234. :   8%|███▌                                         | 18/224 [00:08<01:38,  2.08it/s]
Epoch 43 Iter 19: loss 0.16378. :   8%|███▌                                         | 18/224 [00:09<01:38,  2.08it/s]
Epoch 43 Iter 19: loss 0.16378. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 43 Iter 20: loss 0.17667. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 43 Iter 20: loss 0.17667. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 43 Iter 21: loss 0.18229. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 43 Iter 21: loss 0.18229. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 43 Iter 22: loss 0.17242. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.07it/s]
Epoch 43 Iter 22: loss 0.17242. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 43 Iter 23: loss 0.18911. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 43 Iter 23: loss 0.18911. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 43 Iter 24: loss 0.18033. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 43 Iter 24: loss 0.18033. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 43 Iter 25: loss 0.18464. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 25: loss 0.18464. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 26: loss 0.18968. :  11%|█████                                        | 25/224 [00:12<01:37,  2.05it/s]
Epoch 43 Iter 26: loss 0.18968. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.16594. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 43 Iter 27: loss 0.16594. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 28: loss 0.16142. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 28: loss 0.16142. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.18138. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 43 Iter 29: loss 0.18138. :  13%|█████▊                                       | 29/224 [00:13<01:33,  2.08it/s]
Epoch 43 Iter 30: loss 0.15983. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 43 Iter 30: loss 0.15983. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 43 Iter 31: loss 0.16111. :  13%|██████                                       | 30/224 [00:14<01:33,  2.08it/s]
Epoch 43 Iter 31: loss 0.16111. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 43 Iter 32: loss 0.16627. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 43 Iter 32: loss 0.16627. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 43 Iter 33: loss 0.17097. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.08it/s]
Epoch 43 Iter 33: loss 0.17097. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.07it/s]
Epoch 43 Iter 34: loss 0.19009. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.07it/s]
Epoch 43 Iter 34: loss 0.19009. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 43 Iter 35: loss 0.18306. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 43 Iter 35: loss 0.18306. :  16%|███████                                      | 35/224 [00:16<01:30,  2.09it/s]
Epoch 43 Iter 36: loss 0.16124. :  16%|███████                                      | 35/224 [00:17<01:30,  2.09it/s]
Epoch 43 Iter 36: loss 0.16124. :  16%|███████▏                                     | 36/224 [00:17<01:29,  2.10it/s]
Epoch 43 Iter 37: loss 0.18405. :  16%|███████▏                                     | 36/224 [00:17<01:29,  2.10it/s]
Epoch 43 Iter 37: loss 0.18405. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 43 Iter 38: loss 0.16812. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 43 Iter 38: loss 0.16812. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 43 Iter 39: loss 0.15818. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 43 Iter 39: loss 0.15818. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.08it/s]
Epoch 43 Iter 40: loss 0.16915. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.08it/s]
Epoch 43 Iter 40: loss 0.16915. :  18%|████████                                     | 40/224 [00:19<01:27,  2.09it/s]
Epoch 43 Iter 41: loss 0.17685. :  18%|████████                                     | 40/224 [00:19<01:27,  2.09it/s]
Epoch 43 Iter 41: loss 0.17685. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.09it/s]
Epoch 43 Iter 42: loss 0.15750. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.09it/s]
Epoch 43 Iter 42: loss 0.15750. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 43: loss 0.16735. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 43 Iter 43: loss 0.16735. :  19%|████████▋                                    | 43/224 [00:20<01:26,  2.09it/s]
Epoch 43 Iter 44: loss 0.15514. :  19%|████████▋                                    | 43/224 [00:21<01:26,  2.09it/s]
Epoch 43 Iter 44: loss 0.15514. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 43 Iter 45: loss 0.19321. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.08it/s]
Epoch 43 Iter 45: loss 0.19321. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 43 Iter 46: loss 0.17271. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 43 Iter 46: loss 0.17271. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 43 Iter 47: loss 0.16274. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 43 Iter 47: loss 0.16274. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.05it/s]
Epoch 43 Iter 48: loss 0.16444. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.05it/s]
Epoch 43 Iter 48: loss 0.16444. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 43 Iter 49: loss 0.17554. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 43 Iter 49: loss 0.17554. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 43 Iter 50: loss 0.17443. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 43 Iter 50: loss 0.17443. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 43 Iter 51: loss 0.22453. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.05it/s]
Epoch 43 Iter 51: loss 0.22453. :  23%|██████████▏                                  | 51/224 [00:24<01:24,  2.06it/s]
Epoch 43 Iter 52: loss 0.16511. :  23%|██████████▏                                  | 51/224 [00:25<01:24,  2.06it/s]
Epoch 43 Iter 52: loss 0.16511. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 43 Iter 53: loss 0.16151. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 43 Iter 53: loss 0.16151. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.18695. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.07it/s]
Epoch 43 Iter 54: loss 0.18695. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 43 Iter 55: loss 0.16134. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.05it/s]
Epoch 43 Iter 55: loss 0.16134. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 43 Iter 56: loss 0.17922. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 43 Iter 56: loss 0.17922. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 43 Iter 57: loss 0.17456. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 43 Iter 57: loss 0.17456. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.05it/s]
Epoch 43 Iter 58: loss 0.17792. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.05it/s]
Epoch 43 Iter 58: loss 0.17792. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 59: loss 0.17883. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 59: loss 0.17883. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.17586. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 43 Iter 60: loss 0.17586. :  27%|████████████                                 | 60/224 [00:28<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.19497. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 43 Iter 61: loss 0.19497. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 43 Iter 62: loss 0.16993. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 43 Iter 62: loss 0.16993. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.06it/s]
Epoch 43 Iter 63: loss 0.17204. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 43 Iter 63: loss 0.17204. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 43 Iter 64: loss 0.17495. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.05it/s]
Epoch 43 Iter 64: loss 0.17495. :  29%|████████████▊                                | 64/224 [00:30<01:18,  2.05it/s]
Epoch 43 Iter 65: loss 0.17500. :  29%|████████████▊                                | 64/224 [00:31<01:18,  2.05it/s]
Epoch 43 Iter 65: loss 0.17500. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.05it/s]
Epoch 43 Iter 66: loss 0.16925. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.05it/s]
Epoch 43 Iter 66: loss 0.16925. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.06it/s]
Epoch 43 Iter 67: loss 0.17423. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 43 Iter 67: loss 0.17423. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.04it/s]
Epoch 43 Iter 68: loss 0.18630. :  30%|█████████████▍                               | 67/224 [00:32<01:17,  2.04it/s]
Epoch 43 Iter 68: loss 0.18630. :  30%|█████████████▋                               | 68/224 [00:32<01:16,  2.03it/s]
Epoch 43 Iter 69: loss 0.17172. :  30%|█████████████▋                               | 68/224 [00:33<01:16,  2.03it/s]
Epoch 43 Iter 69: loss 0.17172. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 43 Iter 70: loss 0.16476. :  31%|█████████████▊                               | 69/224 [00:33<01:16,  2.03it/s]
Epoch 43 Iter 70: loss 0.16476. :  31%|██████████████                               | 70/224 [00:33<01:15,  2.05it/s]
Epoch 43 Iter 71: loss 0.19460. :  31%|██████████████                               | 70/224 [00:34<01:15,  2.05it/s]
Epoch 43 Iter 71: loss 0.19460. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 43 Iter 72: loss 0.19283. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.04it/s]
Epoch 43 Iter 72: loss 0.19283. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.05it/s]
Epoch 43 Iter 73: loss 0.18162. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 73: loss 0.18162. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.16188. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.05it/s]
Epoch 43 Iter 74: loss 0.16188. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.05it/s]
Epoch 43 Iter 75: loss 0.15048. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 75: loss 0.15048. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.17175. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 76: loss 0.17175. :  34%|███████████████▎                             | 76/224 [00:36<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.19976. :  34%|███████████████▎                             | 76/224 [00:37<01:12,  2.05it/s]
Epoch 43 Iter 77: loss 0.19976. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.17119. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 43 Iter 78: loss 0.17119. :  35%|███████████████▋                             | 78/224 [00:37<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.20404. :  35%|███████████████▋                             | 78/224 [00:38<01:11,  2.05it/s]
Epoch 43 Iter 79: loss 0.20404. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 43 Iter 80: loss 0.15995. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 43 Iter 80: loss 0.15995. :  36%|████████████████                             | 80/224 [00:38<01:10,  2.05it/s]
Epoch 43 Iter 81: loss 0.16222. :  36%|████████████████                             | 80/224 [00:39<01:10,  2.05it/s]
Epoch 43 Iter 81: loss 0.16222. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 43 Iter 82: loss 0.16515. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.05it/s]
Epoch 43 Iter 82: loss 0.16515. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 43 Iter 83: loss 0.18281. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 83: loss 0.18281. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 43 Iter 84: loss 0.16724. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 43 Iter 84: loss 0.16724. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.06it/s]
Epoch 43 Iter 85: loss 0.15817. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.06it/s]
Epoch 43 Iter 85: loss 0.15817. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 43 Iter 86: loss 0.18466. :  38%|█████████████████                            | 85/224 [00:41<01:08,  2.04it/s]
Epoch 43 Iter 86: loss 0.18466. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 43 Iter 87: loss 0.16572. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 43 Iter 87: loss 0.16572. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 43 Iter 88: loss 0.19474. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.06it/s]
Epoch 43 Iter 88: loss 0.19474. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.06it/s]
Epoch 43 Iter 89: loss 0.19461. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.06it/s]
Epoch 43 Iter 89: loss 0.19461. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 43 Iter 90: loss 0.17418. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 43 Iter 90: loss 0.17418. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 43 Iter 91: loss 0.15585. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 91: loss 0.15585. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.16825. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 43 Iter 92: loss 0.16825. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 43 Iter 93: loss 0.16943. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 43 Iter 93: loss 0.16943. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 43 Iter 94: loss 0.19970. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.07it/s]
Epoch 43 Iter 94: loss 0.19970. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 43 Iter 95: loss 0.16085. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 43 Iter 95: loss 0.16085. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.07it/s]
Epoch 43 Iter 96: loss 0.17888. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 43 Iter 96: loss 0.17888. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 97: loss 0.17705. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 43 Iter 97: loss 0.17705. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.06it/s]
Epoch 43 Iter 98: loss 0.16715. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 98: loss 0.16715. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 99: loss 0.18480. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.06it/s]
Epoch 43 Iter 99: loss 0.18480. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.05it/s]
Epoch 43 Iter 100: loss 0.19522. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.05it/s]
Epoch 43 Iter 100: loss 0.19522. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 43 Iter 101: loss 0.18806. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 43 Iter 101: loss 0.18806. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.06it/s]
Epoch 43 Iter 102: loss 0.17061. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.06it/s]
Epoch 43 Iter 102: loss 0.17061. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 43 Iter 103: loss 0.17600. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.05it/s]
Epoch 43 Iter 103: loss 0.17600. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 43 Iter 104: loss 0.16824. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 43 Iter 104: loss 0.16824. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 43 Iter 105: loss 0.18038. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 43 Iter 105: loss 0.18038. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 43 Iter 106: loss 0.17401. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 43 Iter 106: loss 0.17401. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 43 Iter 107: loss 0.17531. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 43 Iter 107: loss 0.17531. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 43 Iter 108: loss 0.18953. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 43 Iter 108: loss 0.18953. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 109: loss 0.16538. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 109: loss 0.16538. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.18408. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 43 Iter 110: loss 0.18408. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 43 Iter 111: loss 0.17420. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 43 Iter 111: loss 0.17420. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 43 Iter 112: loss 0.17782. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 43 Iter 112: loss 0.17782. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 43 Iter 113: loss 0.17283. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 43 Iter 113: loss 0.17283. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 43 Iter 114: loss 0.18650. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 43 Iter 114: loss 0.18650. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 115: loss 0.15232. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.05it/s]
Epoch 43 Iter 115: loss 0.15232. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.03it/s]
Epoch 43 Iter 116: loss 0.17378. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.03it/s]
Epoch 43 Iter 116: loss 0.17378. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 43 Iter 117: loss 0.16806. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.04it/s]
Epoch 43 Iter 117: loss 0.16806. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 43 Iter 118: loss 0.18193. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 43 Iter 118: loss 0.18193. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 43 Iter 119: loss 0.19386. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 43 Iter 119: loss 0.19386. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 43 Iter 120: loss 0.15568. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 43 Iter 120: loss 0.15568. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 43 Iter 121: loss 0.16061. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 43 Iter 121: loss 0.16061. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 43 Iter 122: loss 0.16561. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 43 Iter 122: loss 0.16561. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 43 Iter 123: loss 0.16619. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 43 Iter 123: loss 0.16619. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.06it/s]
Epoch 43 Iter 124: loss 0.17139. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.06it/s]
Epoch 43 Iter 124: loss 0.17139. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 43 Iter 125: loss 0.16894. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.06it/s]
Epoch 43 Iter 125: loss 0.16894. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 43 Iter 126: loss 0.17713. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 126: loss 0.17713. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 127: loss 0.17243. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 43 Iter 127: loss 0.17243. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.08it/s]
Epoch 43 Iter 128: loss 0.18418. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.08it/s]
Epoch 43 Iter 128: loss 0.18418. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.16850. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 43 Iter 129: loss 0.16850. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 130: loss 0.17593. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 130: loss 0.17593. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.08it/s]
Epoch 43 Iter 131: loss 0.16261. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.08it/s]
Epoch 43 Iter 131: loss 0.16261. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 43 Iter 132: loss 0.17604. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 43 Iter 132: loss 0.17604. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.19331. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 133: loss 0.19331. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 134: loss 0.14424. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 43 Iter 134: loss 0.14424. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 43 Iter 135: loss 0.14715. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 43 Iter 135: loss 0.14715. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 43 Iter 136: loss 0.19315. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.06it/s]
Epoch 43 Iter 136: loss 0.19315. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 43 Iter 137: loss 0.17786. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 43 Iter 137: loss 0.17786. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 43 Iter 138: loss 0.17431. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.07it/s]
Epoch 43 Iter 138: loss 0.17431. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 43 Iter 139: loss 0.15886. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 43 Iter 139: loss 0.15886. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 43 Iter 140: loss 0.14791. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 43 Iter 140: loss 0.14791. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 43 Iter 141: loss 0.16313. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 43 Iter 141: loss 0.16313. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 43 Iter 142: loss 0.15457. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.05it/s]
Epoch 43 Iter 142: loss 0.15457. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 43 Iter 143: loss 0.19646. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 43 Iter 143: loss 0.19646. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.15872. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 43 Iter 144: loss 0.15872. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.18883. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 43 Iter 145: loss 0.18883. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 43 Iter 146: loss 0.17553. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.05it/s]
Epoch 43 Iter 146: loss 0.17553. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.15390. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 147: loss 0.15390. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.18416. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 43 Iter 148: loss 0.18416. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 43 Iter 149: loss 0.16097. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 43 Iter 149: loss 0.16097. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 43 Iter 150: loss 0.17762. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 43 Iter 150: loss 0.17762. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 43 Iter 151: loss 0.18534. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 43 Iter 151: loss 0.18534. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 43 Iter 152: loss 0.15688. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 43 Iter 152: loss 0.15688. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 43 Iter 153: loss 0.17644. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.07it/s]
Epoch 43 Iter 153: loss 0.17644. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 43 Iter 154: loss 0.20495. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 43 Iter 154: loss 0.20495. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 43 Iter 155: loss 0.15965. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 43 Iter 155: loss 0.15965. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 43 Iter 156: loss 0.19409. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 43 Iter 156: loss 0.19409. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.09it/s]
Epoch 43 Iter 157: loss 0.18611. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.09it/s]
Epoch 43 Iter 157: loss 0.18611. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 43 Iter 158: loss 0.18162. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.08it/s]
Epoch 43 Iter 158: loss 0.18162. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 43 Iter 159: loss 0.18143. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.08it/s]
Epoch 43 Iter 159: loss 0.18143. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.09it/s]
Epoch 43 Iter 160: loss 0.17598. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.09it/s]
Epoch 43 Iter 160: loss 0.17598. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 43 Iter 161: loss 0.17807. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.09it/s]
Epoch 43 Iter 161: loss 0.17807. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.10it/s]
Epoch 43 Iter 162: loss 0.17478. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.10it/s]
Epoch 43 Iter 162: loss 0.17478. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.09it/s]
Epoch 43 Iter 163: loss 0.15136. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.09it/s]
Epoch 43 Iter 163: loss 0.15136. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 43 Iter 164: loss 0.16772. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 43 Iter 164: loss 0.16772. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 43 Iter 165: loss 0.18039. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:28,  2.08it/s]
Epoch 43 Iter 165: loss 0.18039. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.18201. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 43 Iter 166: loss 0.18201. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 43 Iter 167: loss 0.17012. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 43 Iter 167: loss 0.17012. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 43 Iter 168: loss 0.17170. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 43 Iter 168: loss 0.17170. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 43 Iter 169: loss 0.16042. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 43 Iter 169: loss 0.16042. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.08it/s]
Epoch 43 Iter 170: loss 0.18898. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.08it/s]
Epoch 43 Iter 170: loss 0.18898. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 43 Iter 171: loss 0.17649. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:25,  2.09it/s]
Epoch 43 Iter 171: loss 0.17649. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.09it/s]
Epoch 43 Iter 172: loss 0.17807. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.09it/s]
Epoch 43 Iter 172: loss 0.17807. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 173: loss 0.17749. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 43 Iter 173: loss 0.17749. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 43 Iter 174: loss 0.16506. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 174: loss 0.16506. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 175: loss 0.16733. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 43 Iter 175: loss 0.16733. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 43 Iter 176: loss 0.17090. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 176: loss 0.17090. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 177: loss 0.17927. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 43 Iter 177: loss 0.17927. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.16500. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 178: loss 0.16500. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 179: loss 0.19309. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 43 Iter 179: loss 0.19309. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 43 Iter 180: loss 0.17461. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 43 Iter 180: loss 0.17461. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 43 Iter 181: loss 0.17176. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.06it/s]
Epoch 43 Iter 181: loss 0.17176. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.06it/s]
Epoch 43 Iter 182: loss 0.17911. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 182: loss 0.17911. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 183: loss 0.17192. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.06it/s]
Epoch 43 Iter 183: loss 0.17192. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 43 Iter 184: loss 0.15924. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 43 Iter 184: loss 0.15924. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 43 Iter 185: loss 0.14333. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 43 Iter 185: loss 0.14333. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 43 Iter 186: loss 0.16322. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 43 Iter 186: loss 0.16322. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 43 Iter 187: loss 0.16433. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 43 Iter 187: loss 0.16433. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 43 Iter 188: loss 0.17892. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 43 Iter 188: loss 0.17892. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 43 Iter 189: loss 0.17660. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 43 Iter 189: loss 0.17660. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 43 Iter 190: loss 0.19123. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.08it/s]
Epoch 43 Iter 190: loss 0.19123. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.09it/s]
Epoch 43 Iter 191: loss 0.17430. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.09it/s]
Epoch 43 Iter 191: loss 0.17430. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 43 Iter 192: loss 0.18202. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.09it/s]
Epoch 43 Iter 192: loss 0.18202. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.10it/s]
Epoch 43 Iter 193: loss 0.16487. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.10it/s]
Epoch 43 Iter 193: loss 0.16487. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 43 Iter 194: loss 0.18244. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.08it/s]
Epoch 43 Iter 194: loss 0.18244. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.08it/s]
Epoch 43 Iter 195: loss 0.15299. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.08it/s]
Epoch 43 Iter 195: loss 0.15299. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 43 Iter 196: loss 0.16456. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 43 Iter 196: loss 0.16456. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.08it/s]
Epoch 43 Iter 197: loss 0.17113. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.08it/s]
Epoch 43 Iter 197: loss 0.17113. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.09it/s]
Epoch 43 Iter 198: loss 0.18399. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:12,  2.09it/s]
Epoch 43 Iter 198: loss 0.18399. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 43 Iter 199: loss 0.15876. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 43 Iter 199: loss 0.15876. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 43 Iter 200: loss 0.17393. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 43 Iter 200: loss 0.17393. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 43 Iter 201: loss 0.19509. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 43 Iter 201: loss 0.19509. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 43 Iter 202: loss 0.17795. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.08it/s]
Epoch 43 Iter 202: loss 0.17795. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 43 Iter 203: loss 0.18997. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 43 Iter 203: loss 0.18997. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 43 Iter 204: loss 0.19468. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 43 Iter 204: loss 0.19468. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.08it/s]
Epoch 43 Iter 205: loss 0.16651. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.08it/s]
Epoch 43 Iter 205: loss 0.16651. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 43 Iter 206: loss 0.17026. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 43 Iter 206: loss 0.17026. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 43 Iter 207: loss 0.17559. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 43 Iter 207: loss 0.17559. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 43 Iter 208: loss 0.15370. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 43 Iter 208: loss 0.15370. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 43 Iter 209: loss 0.16834. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 43 Iter 209: loss 0.16834. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 43 Iter 210: loss 0.17569. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.08it/s]
Epoch 43 Iter 210: loss 0.17569. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.16066. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 43 Iter 211: loss 0.16066. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 43 Iter 212: loss 0.18026. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 43 Iter 212: loss 0.18026. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.16919. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 213: loss 0.16919. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 214: loss 0.16748. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 43 Iter 214: loss 0.16748. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 43 Iter 215: loss 0.18355. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 43 Iter 215: loss 0.18355. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.07it/s]
Epoch 43 Iter 216: loss 0.18060. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 43 Iter 216: loss 0.18060. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 43 Iter 217: loss 0.16923. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 43 Iter 217: loss 0.16923. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.07it/s]
Epoch 43 Iter 218: loss 0.18478. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 43 Iter 218: loss 0.18478. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 43 Iter 219: loss 0.17447. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 43 Iter 219: loss 0.17447. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.08it/s]
Epoch 43 Iter 220: loss 0.17781. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 43 Iter 220: loss 0.17781. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 43 Iter 221: loss 0.15866. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 43 Iter 221: loss 0.15866. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.08it/s]
Epoch 43 Iter 222: loss 0.17475. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 43 Iter 222: loss 0.17475. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 43 Iter 223: loss 0.15825. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 43 Iter 223: loss 0.15825. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.08it/s]
Epoch 43 Iter 224: loss 0.19323. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.08it/s]
Epoch 43 Iter 224: loss 0.19323. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.09it/s]
Epoch 43 Iter 224: loss 0.19323. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17389
    Valid loss: 0.17937
       Valid loss recons: 0.17302
       Valid loss KL-D:   63.50596
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.17828. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 44 Iter 1: loss 0.17828. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 44 Iter 2: loss 0.15944. :   0%|▏                                              | 1/224 [00:00<01:48,  2.06it/s]
Epoch 44 Iter 2: loss 0.15944. :   1%|▍                                              | 2/224 [00:00<01:48,  2.05it/s]
Epoch 44 Iter 3: loss 0.17880. :   1%|▍                                              | 2/224 [00:01<01:48,  2.05it/s]
Epoch 44 Iter 3: loss 0.17880. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 44 Iter 4: loss 0.17266. :   1%|▋                                              | 3/224 [00:01<01:48,  2.03it/s]
Epoch 44 Iter 4: loss 0.17266. :   2%|▊                                              | 4/224 [00:01<01:47,  2.04it/s]
Epoch 44 Iter 5: loss 0.17471. :   2%|▊                                              | 4/224 [00:02<01:47,  2.04it/s]
Epoch 44 Iter 5: loss 0.17471. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 44 Iter 6: loss 0.19032. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 44 Iter 6: loss 0.19032. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 44 Iter 7: loss 0.17911. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 44 Iter 7: loss 0.17911. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.05it/s]
Epoch 44 Iter 8: loss 0.17109. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.05it/s]
Epoch 44 Iter 8: loss 0.17109. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 44 Iter 9: loss 0.18231. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 44 Iter 9: loss 0.18231. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 44 Iter 10: loss 0.16644. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 44 Iter 10: loss 0.16644. :   4%|██                                           | 10/224 [00:04<01:44,  2.04it/s]
Epoch 44 Iter 11: loss 0.15446. :   4%|██                                           | 10/224 [00:05<01:44,  2.04it/s]
Epoch 44 Iter 11: loss 0.15446. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 44 Iter 12: loss 0.17780. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 44 Iter 12: loss 0.17780. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.17524. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 44 Iter 13: loss 0.17524. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 44 Iter 14: loss 0.17726. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.05it/s]
Epoch 44 Iter 14: loss 0.17726. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 44 Iter 15: loss 0.15927. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 44 Iter 15: loss 0.15927. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 44 Iter 16: loss 0.16819. :   7%|███                                          | 15/224 [00:07<01:42,  2.05it/s]
Epoch 44 Iter 16: loss 0.16819. :   7%|███▏                                         | 16/224 [00:07<01:42,  2.04it/s]
Epoch 44 Iter 17: loss 0.15980. :   7%|███▏                                         | 16/224 [00:08<01:42,  2.04it/s]
Epoch 44 Iter 17: loss 0.15980. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 44 Iter 18: loss 0.16750. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 44 Iter 18: loss 0.16750. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.05it/s]
Epoch 44 Iter 19: loss 0.18238. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.05it/s]
Epoch 44 Iter 19: loss 0.18238. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 44 Iter 20: loss 0.20628. :   8%|███▊                                         | 19/224 [00:09<01:40,  2.05it/s]
Epoch 44 Iter 20: loss 0.20628. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 44 Iter 21: loss 0.16076. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 44 Iter 21: loss 0.16076. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 44 Iter 22: loss 0.15412. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 44 Iter 22: loss 0.15412. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.04it/s]
Epoch 44 Iter 23: loss 0.18965. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.04it/s]
Epoch 44 Iter 23: loss 0.18965. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 44 Iter 24: loss 0.16662. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.05it/s]
Epoch 44 Iter 24: loss 0.16662. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 44 Iter 25: loss 0.17650. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 44 Iter 25: loss 0.17650. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 44 Iter 26: loss 0.16947. :  11%|█████                                        | 25/224 [00:12<01:37,  2.04it/s]
Epoch 44 Iter 26: loss 0.16947. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.05it/s]
Epoch 44 Iter 27: loss 0.17985. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.05it/s]
Epoch 44 Iter 27: loss 0.17985. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 28: loss 0.15593. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 28: loss 0.15593. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.17418. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 44 Iter 29: loss 0.17418. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 44 Iter 30: loss 0.17536. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.05it/s]
Epoch 44 Iter 30: loss 0.17536. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 44 Iter 31: loss 0.17947. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 31: loss 0.17947. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 32: loss 0.16115. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 44 Iter 32: loss 0.16115. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 44 Iter 33: loss 0.17625. :  14%|██████▍                                      | 32/224 [00:16<01:33,  2.05it/s]
Epoch 44 Iter 33: loss 0.17625. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 34: loss 0.17847. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 34: loss 0.17847. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.17507. :  15%|██████▊                                      | 34/224 [00:17<01:32,  2.06it/s]
Epoch 44 Iter 35: loss 0.17507. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 44 Iter 36: loss 0.18210. :  16%|███████                                      | 35/224 [00:17<01:32,  2.05it/s]
Epoch 44 Iter 36: loss 0.18210. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 44 Iter 37: loss 0.17592. :  16%|███████▏                                     | 36/224 [00:18<01:31,  2.06it/s]
Epoch 44 Iter 37: loss 0.17592. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.15728. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 44 Iter 38: loss 0.15728. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 44 Iter 39: loss 0.18337. :  17%|███████▋                                     | 38/224 [00:19<01:30,  2.06it/s]
Epoch 44 Iter 39: loss 0.18337. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 44 Iter 40: loss 0.20372. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 44 Iter 40: loss 0.20372. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 44 Iter 41: loss 0.17980. :  18%|████████                                     | 40/224 [00:19<01:29,  2.06it/s]
Epoch 44 Iter 41: loss 0.17980. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.06it/s]
Epoch 44 Iter 42: loss 0.14478. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 42: loss 0.14478. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.16473. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 44 Iter 43: loss 0.16473. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.04it/s]
Epoch 44 Iter 44: loss 0.17083. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.04it/s]
Epoch 44 Iter 44: loss 0.17083. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 44 Iter 45: loss 0.16760. :  20%|████████▊                                    | 44/224 [00:21<01:28,  2.04it/s]
Epoch 44 Iter 45: loss 0.16760. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.17906. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.05it/s]
Epoch 44 Iter 46: loss 0.17906. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.16955. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 44 Iter 47: loss 0.16955. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 44 Iter 48: loss 0.18678. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 48: loss 0.18678. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 49: loss 0.17818. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 44 Iter 49: loss 0.17818. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.17164. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.05it/s]
Epoch 44 Iter 50: loss 0.17164. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 44 Iter 51: loss 0.17141. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.06it/s]
Epoch 44 Iter 51: loss 0.17141. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.06it/s]
Epoch 44 Iter 52: loss 0.17629. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.06it/s]
Epoch 44 Iter 52: loss 0.17629. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 44 Iter 53: loss 0.17275. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 44 Iter 53: loss 0.17275. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 44 Iter 54: loss 0.16950. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 44 Iter 54: loss 0.16950. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 44 Iter 55: loss 0.18981. :  24%|██████████▊                                  | 54/224 [00:26<01:22,  2.06it/s]
Epoch 44 Iter 55: loss 0.18981. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.06it/s]
Epoch 44 Iter 56: loss 0.17426. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.06it/s]
Epoch 44 Iter 56: loss 0.17426. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 44 Iter 57: loss 0.18735. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 44 Iter 57: loss 0.18735. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 44 Iter 58: loss 0.16604. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 44 Iter 58: loss 0.16604. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 44 Iter 59: loss 0.19140. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.07it/s]
Epoch 44 Iter 59: loss 0.19140. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 44 Iter 60: loss 0.17586. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 44 Iter 60: loss 0.17586. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.09it/s]
Epoch 44 Iter 61: loss 0.18444. :  27%|████████████                                 | 60/224 [00:29<01:18,  2.09it/s]
Epoch 44 Iter 61: loss 0.18444. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 44 Iter 62: loss 0.16030. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 44 Iter 62: loss 0.16030. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 44 Iter 63: loss 0.18121. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 44 Iter 63: loss 0.18121. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 44 Iter 64: loss 0.16518. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 44 Iter 64: loss 0.16518. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 44 Iter 65: loss 0.16714. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 44 Iter 65: loss 0.16714. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.07it/s]
Epoch 44 Iter 66: loss 0.14768. :  29%|█████████████                                | 65/224 [00:32<01:16,  2.07it/s]
Epoch 44 Iter 66: loss 0.14768. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 67: loss 0.17585. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 67: loss 0.17585. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 44 Iter 68: loss 0.15992. :  30%|█████████████▍                               | 67/224 [00:33<01:16,  2.06it/s]
Epoch 44 Iter 68: loss 0.15992. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 69: loss 0.16132. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 69: loss 0.16132. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 44 Iter 70: loss 0.17336. :  31%|█████████████▊                               | 69/224 [00:34<01:15,  2.06it/s]
Epoch 44 Iter 70: loss 0.17336. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.18151. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 71: loss 0.18151. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.17850. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 44 Iter 72: loss 0.17850. :  32%|██████████████▍                              | 72/224 [00:34<01:12,  2.08it/s]
Epoch 44 Iter 73: loss 0.18577. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 44 Iter 73: loss 0.18577. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 74: loss 0.17116. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.07it/s]
Epoch 44 Iter 74: loss 0.17116. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 44 Iter 75: loss 0.17313. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 44 Iter 75: loss 0.17313. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 44 Iter 76: loss 0.17907. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.07it/s]
Epoch 44 Iter 76: loss 0.17907. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 44 Iter 77: loss 0.18943. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 44 Iter 77: loss 0.18943. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.19805. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 78: loss 0.19805. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.17270. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 44 Iter 79: loss 0.17270. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 44 Iter 80: loss 0.18178. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 44 Iter 80: loss 0.18178. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 44 Iter 81: loss 0.17779. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 44 Iter 81: loss 0.17779. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 44 Iter 82: loss 0.17803. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.08it/s]
Epoch 44 Iter 82: loss 0.17803. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 44 Iter 83: loss 0.16001. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 44 Iter 83: loss 0.16001. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 44 Iter 84: loss 0.17851. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 44 Iter 84: loss 0.17851. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.18016. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.06it/s]
Epoch 44 Iter 85: loss 0.18016. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 44 Iter 86: loss 0.17243. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 44 Iter 86: loss 0.17243. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.16335. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 44 Iter 87: loss 0.16335. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 44 Iter 88: loss 0.16237. :  39%|█████████████████▍                           | 87/224 [00:42<01:05,  2.08it/s]
Epoch 44 Iter 88: loss 0.16237. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 44 Iter 89: loss 0.18021. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.08it/s]
Epoch 44 Iter 89: loss 0.18021. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 44 Iter 90: loss 0.17148. :  40%|█████████████████▉                           | 89/224 [00:43<01:04,  2.08it/s]
Epoch 44 Iter 90: loss 0.17148. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.08it/s]
Epoch 44 Iter 91: loss 0.18161. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.08it/s]
Epoch 44 Iter 91: loss 0.18161. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 92: loss 0.16365. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 44 Iter 92: loss 0.16365. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 44 Iter 93: loss 0.17583. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 44 Iter 93: loss 0.17583. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 94: loss 0.17453. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 44 Iter 94: loss 0.17453. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 44 Iter 95: loss 0.17723. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 44 Iter 95: loss 0.17723. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 44 Iter 96: loss 0.17523. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 44 Iter 96: loss 0.17523. :  43%|███████████████████▎                         | 96/224 [00:46<01:02,  2.06it/s]
Epoch 44 Iter 97: loss 0.17238. :  43%|███████████████████▎                         | 96/224 [00:47<01:02,  2.06it/s]
Epoch 44 Iter 97: loss 0.17238. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 44 Iter 98: loss 0.16057. :  43%|███████████████████▍                         | 97/224 [00:47<01:02,  2.04it/s]
Epoch 44 Iter 98: loss 0.16057. :  44%|███████████████████▋                         | 98/224 [00:47<01:01,  2.05it/s]
Epoch 44 Iter 99: loss 0.16255. :  44%|███████████████████▋                         | 98/224 [00:48<01:01,  2.05it/s]
Epoch 44 Iter 99: loss 0.16255. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.06it/s]
Epoch 44 Iter 100: loss 0.16217. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 44 Iter 100: loss 0.16217. :  45%|███████████████████▏                       | 100/224 [00:48<01:00,  2.06it/s]
Epoch 44 Iter 101: loss 0.16658. :  45%|███████████████████▏                       | 100/224 [00:49<01:00,  2.06it/s]
Epoch 44 Iter 101: loss 0.16658. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 44 Iter 102: loss 0.16136. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.07it/s]
Epoch 44 Iter 102: loss 0.16136. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 44 Iter 103: loss 0.17316. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 44 Iter 103: loss 0.17316. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 44 Iter 104: loss 0.18407. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 44 Iter 104: loss 0.18407. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 44 Iter 105: loss 0.16222. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.06it/s]
Epoch 44 Iter 105: loss 0.16222. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.06it/s]
Epoch 44 Iter 106: loss 0.17922. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.06it/s]
Epoch 44 Iter 106: loss 0.17922. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 44 Iter 107: loss 0.18273. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.07it/s]
Epoch 44 Iter 107: loss 0.18273. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.08it/s]
Epoch 44 Iter 108: loss 0.17001. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.08it/s]
Epoch 44 Iter 108: loss 0.17001. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 44 Iter 109: loss 0.15430. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.08it/s]
Epoch 44 Iter 109: loss 0.15430. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.17499. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 110: loss 0.17499. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 111: loss 0.17877. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.07it/s]
Epoch 44 Iter 111: loss 0.17877. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.17666. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 44 Iter 112: loss 0.17666. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 44 Iter 113: loss 0.16468. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 44 Iter 113: loss 0.16468. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.15660. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 44 Iter 114: loss 0.15660. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.18437. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 115: loss 0.18437. :  51%|██████████████████████                     | 115/224 [00:55<00:53,  2.06it/s]
Epoch 44 Iter 116: loss 0.15466. :  51%|██████████████████████                     | 115/224 [00:56<00:53,  2.06it/s]
Epoch 44 Iter 116: loss 0.15466. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 44 Iter 117: loss 0.17863. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 44 Iter 117: loss 0.17863. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 44 Iter 118: loss 0.17065. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 44 Iter 118: loss 0.17065. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 44 Iter 119: loss 0.16244. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.05it/s]
Epoch 44 Iter 119: loss 0.16244. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.06it/s]
Epoch 44 Iter 120: loss 0.16787. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.06it/s]
Epoch 44 Iter 120: loss 0.16787. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.18159. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 44 Iter 121: loss 0.18159. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.17846. :  54%|███████████████████████▏                   | 121/224 [00:59<00:49,  2.06it/s]
Epoch 44 Iter 122: loss 0.17846. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 123: loss 0.17242. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 123: loss 0.17242. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.16761. :  55%|███████████████████████▌                   | 123/224 [01:00<00:49,  2.05it/s]
Epoch 44 Iter 124: loss 0.16761. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 44 Iter 125: loss 0.15407. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 44 Iter 125: loss 0.15407. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 44 Iter 126: loss 0.15992. :  56%|███████████████████████▉                   | 125/224 [01:01<00:48,  2.06it/s]
Epoch 44 Iter 126: loss 0.15992. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 44 Iter 127: loss 0.16857. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 44 Iter 127: loss 0.16857. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 44 Iter 128: loss 0.15717. :  57%|████████████████████████▍                  | 127/224 [01:02<00:47,  2.06it/s]
Epoch 44 Iter 128: loss 0.15717. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.16157. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 44 Iter 129: loss 0.16157. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 44 Iter 130: loss 0.17379. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.08it/s]
Epoch 44 Iter 130: loss 0.17379. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 44 Iter 131: loss 0.17001. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 44 Iter 131: loss 0.17001. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 44 Iter 132: loss 0.18159. :  58%|█████████████████████████▏                 | 131/224 [01:04<00:45,  2.06it/s]
Epoch 44 Iter 132: loss 0.18159. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 44 Iter 133: loss 0.16937. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 44 Iter 133: loss 0.16937. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.07it/s]
Epoch 44 Iter 134: loss 0.17314. :  59%|█████████████████████████▌                 | 133/224 [01:05<00:44,  2.07it/s]
Epoch 44 Iter 134: loss 0.17314. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 135: loss 0.18057. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 135: loss 0.18057. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 136: loss 0.15825. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 44 Iter 136: loss 0.15825. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 44 Iter 137: loss 0.17150. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 137: loss 0.17150. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 138: loss 0.17643. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 44 Iter 138: loss 0.17643. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 44 Iter 139: loss 0.18201. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 44 Iter 139: loss 0.18201. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 44 Iter 140: loss 0.17369. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 44 Iter 140: loss 0.17369. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.06it/s]
Epoch 44 Iter 141: loss 0.17893. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.06it/s]
Epoch 44 Iter 141: loss 0.17893. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 44 Iter 142: loss 0.19161. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 44 Iter 142: loss 0.19161. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 44 Iter 143: loss 0.19346. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 143: loss 0.19346. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 144: loss 0.16316. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 44 Iter 144: loss 0.16316. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.06it/s]
Epoch 44 Iter 145: loss 0.16241. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.06it/s]
Epoch 44 Iter 145: loss 0.16241. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 44 Iter 146: loss 0.18163. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 44 Iter 146: loss 0.18163. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 44 Iter 147: loss 0.17605. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.07it/s]
Epoch 44 Iter 147: loss 0.17605. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.08it/s]
Epoch 44 Iter 148: loss 0.16799. :  66%|████████████████████████████▏              | 147/224 [01:11<00:36,  2.08it/s]
Epoch 44 Iter 148: loss 0.16799. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 44 Iter 149: loss 0.16423. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 149: loss 0.16423. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 150: loss 0.16503. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.07it/s]
Epoch 44 Iter 150: loss 0.16503. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 44 Iter 151: loss 0.17973. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.08it/s]
Epoch 44 Iter 151: loss 0.17973. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 44 Iter 152: loss 0.16516. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 44 Iter 152: loss 0.16516. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 44 Iter 153: loss 0.19418. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 44 Iter 153: loss 0.19418. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 44 Iter 154: loss 0.16012. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 44 Iter 154: loss 0.16012. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 44 Iter 155: loss 0.19122. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 44 Iter 155: loss 0.19122. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 44 Iter 156: loss 0.19037. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.08it/s]
Epoch 44 Iter 156: loss 0.19037. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.08it/s]
Epoch 44 Iter 157: loss 0.18178. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.08it/s]
Epoch 44 Iter 157: loss 0.18178. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 44 Iter 158: loss 0.19039. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 44 Iter 158: loss 0.19039. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 44 Iter 159: loss 0.17411. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 44 Iter 159: loss 0.17411. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 44 Iter 160: loss 0.16209. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 44 Iter 160: loss 0.16209. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 44 Iter 161: loss 0.18184. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 44 Iter 161: loss 0.18184. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 44 Iter 162: loss 0.17020. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.07it/s]
Epoch 44 Iter 162: loss 0.17020. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 44 Iter 163: loss 0.18448. :  72%|███████████████████████████████            | 162/224 [01:19<00:30,  2.06it/s]
Epoch 44 Iter 163: loss 0.18448. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 44 Iter 164: loss 0.16591. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 44 Iter 164: loss 0.16591. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 44 Iter 165: loss 0.17250. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 44 Iter 165: loss 0.17250. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 44 Iter 166: loss 0.17687. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 44 Iter 166: loss 0.17687. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 44 Iter 167: loss 0.17990. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.06it/s]
Epoch 44 Iter 167: loss 0.17990. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 44 Iter 168: loss 0.17172. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 44 Iter 168: loss 0.17172. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 44 Iter 169: loss 0.17588. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 44 Iter 169: loss 0.17588. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 44 Iter 170: loss 0.17251. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 44 Iter 170: loss 0.17251. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 44 Iter 171: loss 0.17104. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 44 Iter 171: loss 0.17104. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 44 Iter 172: loss 0.16964. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 44 Iter 172: loss 0.16964. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 44 Iter 173: loss 0.16615. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.07it/s]
Epoch 44 Iter 173: loss 0.16615. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 44 Iter 174: loss 0.15776. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 44 Iter 174: loss 0.15776. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 44 Iter 175: loss 0.17739. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 44 Iter 175: loss 0.17739. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 44 Iter 176: loss 0.17137. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 44 Iter 176: loss 0.17137. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 44 Iter 177: loss 0.17850. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 44 Iter 177: loss 0.17850. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.07it/s]
Epoch 44 Iter 178: loss 0.19178. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.07it/s]
Epoch 44 Iter 178: loss 0.19178. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 44 Iter 179: loss 0.16984. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 44 Iter 179: loss 0.16984. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 44 Iter 180: loss 0.16171. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 44 Iter 180: loss 0.16171. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 44 Iter 181: loss 0.17322. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.07it/s]
Epoch 44 Iter 181: loss 0.17322. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 44 Iter 182: loss 0.17523. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 182: loss 0.17523. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 183: loss 0.17849. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 44 Iter 183: loss 0.17849. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 44 Iter 184: loss 0.16812. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 184: loss 0.16812. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 185: loss 0.18207. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 44 Iter 185: loss 0.18207. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:19,  2.05it/s]
Epoch 44 Iter 186: loss 0.17531. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:19,  2.05it/s]
Epoch 44 Iter 186: loss 0.17531. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 44 Iter 187: loss 0.19303. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.06it/s]
Epoch 44 Iter 187: loss 0.19303. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.17327. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 188: loss 0.17327. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 189: loss 0.16249. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 44 Iter 189: loss 0.16249. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 44 Iter 190: loss 0.15703. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 190: loss 0.15703. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 191: loss 0.15468. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 44 Iter 191: loss 0.15468. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 44 Iter 192: loss 0.16202. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 44 Iter 192: loss 0.16202. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 44 Iter 193: loss 0.19407. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 44 Iter 193: loss 0.19407. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 44 Iter 194: loss 0.17130. :  86%|█████████████████████████████████████      | 193/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 194: loss 0.17130. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.17351. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.07it/s]
Epoch 44 Iter 195: loss 0.17351. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 44 Iter 196: loss 0.19754. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:13,  2.08it/s]
Epoch 44 Iter 196: loss 0.19754. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.16598. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 197: loss 0.16598. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 198: loss 0.17026. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 44 Iter 198: loss 0.17026. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 44 Iter 199: loss 0.17691. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 44 Iter 199: loss 0.17691. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 44 Iter 200: loss 0.18146. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.08it/s]
Epoch 44 Iter 200: loss 0.18146. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 44 Iter 201: loss 0.17897. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 44 Iter 201: loss 0.17897. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 44 Iter 202: loss 0.16148. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 44 Iter 202: loss 0.16148. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 44 Iter 203: loss 0.17217. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.07it/s]
Epoch 44 Iter 203: loss 0.17217. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 44 Iter 204: loss 0.17033. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.08it/s]
Epoch 44 Iter 204: loss 0.17033. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.09it/s]
Epoch 44 Iter 205: loss 0.19252. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.09it/s]
Epoch 44 Iter 205: loss 0.19252. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 44 Iter 206: loss 0.16801. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 44 Iter 206: loss 0.16801. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.08it/s]
Epoch 44 Iter 207: loss 0.18127. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.08it/s]
Epoch 44 Iter 207: loss 0.18127. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 44 Iter 208: loss 0.17598. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 44 Iter 208: loss 0.17598. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.08it/s]
Epoch 44 Iter 209: loss 0.18961. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.08it/s]
Epoch 44 Iter 209: loss 0.18961. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 210: loss 0.16591. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 44 Iter 210: loss 0.16591. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.07it/s]
Epoch 44 Iter 211: loss 0.18024. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.07it/s]
Epoch 44 Iter 211: loss 0.18024. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 44 Iter 212: loss 0.17541. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 44 Iter 212: loss 0.17541. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.08it/s]
Epoch 44 Iter 213: loss 0.17165. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.08it/s]
Epoch 44 Iter 213: loss 0.17165. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 44 Iter 214: loss 0.16340. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.08it/s]
Epoch 44 Iter 214: loss 0.16340. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 44 Iter 215: loss 0.17835. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 44 Iter 215: loss 0.17835. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 44 Iter 216: loss 0.18508. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 44 Iter 216: loss 0.18508. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 44 Iter 217: loss 0.18503. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 44 Iter 217: loss 0.18503. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 44 Iter 218: loss 0.16933. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.08it/s]
Epoch 44 Iter 218: loss 0.16933. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.08it/s]
Epoch 44 Iter 219: loss 0.16934. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.08it/s]
Epoch 44 Iter 219: loss 0.16934. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 44 Iter 220: loss 0.17764. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 44 Iter 220: loss 0.17764. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 44 Iter 221: loss 0.18108. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 44 Iter 221: loss 0.18108. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 44 Iter 222: loss 0.17490. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.08it/s]
Epoch 44 Iter 222: loss 0.17490. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.19780. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.06it/s]
Epoch 44 Iter 223: loss 0.19780. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 44 Iter 224: loss 0.18394. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 44 Iter 224: loss 0.18394. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 44 Iter 224: loss 0.18394. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.17687. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 45 Iter 1: loss 0.17687. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 2: loss 0.18172. :   0%|▏                                              | 1/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 2: loss 0.18172. :   1%|▍                                              | 2/224 [00:00<01:47,  2.07it/s]
Epoch 45 Iter 3: loss 0.18631. :   1%|▍                                              | 2/224 [00:01<01:47,  2.07it/s]
Epoch 45 Iter 3: loss 0.18631. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 45 Iter 4: loss 0.17516. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 45 Iter 4: loss 0.17516. :   2%|▊                                              | 4/224 [00:01<01:45,  2.08it/s]
Epoch 45 Iter 5: loss 0.19707. :   2%|▊                                              | 4/224 [00:02<01:45,  2.08it/s]
Epoch 45 Iter 5: loss 0.19707. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 45 Iter 6: loss 0.17169. :   2%|█                                              | 5/224 [00:02<01:45,  2.07it/s]
Epoch 45 Iter 6: loss 0.17169. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.17877. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.05it/s]
Epoch 45 Iter 7: loss 0.17877. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 45 Iter 8: loss 0.16208. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.05it/s]
Epoch 45 Iter 8: loss 0.16208. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.16554. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 45 Iter 9: loss 0.16554. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 45 Iter 10: loss 0.15981. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 45 Iter 10: loss 0.15981. :   4%|██                                           | 10/224 [00:04<01:42,  2.09it/s]
Epoch 45 Iter 11: loss 0.17170. :   4%|██                                           | 10/224 [00:05<01:42,  2.09it/s]
Epoch 45 Iter 11: loss 0.17170. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 45 Iter 12: loss 0.18270. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 45 Iter 12: loss 0.18270. :   5%|██▍                                          | 12/224 [00:05<01:41,  2.08it/s]
Epoch 45 Iter 13: loss 0.18607. :   5%|██▍                                          | 12/224 [00:06<01:41,  2.08it/s]
Epoch 45 Iter 13: loss 0.18607. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 45 Iter 14: loss 0.15953. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 45 Iter 14: loss 0.15953. :   6%|██▊                                          | 14/224 [00:06<01:40,  2.08it/s]
Epoch 45 Iter 15: loss 0.18846. :   6%|██▊                                          | 14/224 [00:07<01:40,  2.08it/s]
Epoch 45 Iter 15: loss 0.18846. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 45 Iter 16: loss 0.15409. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 45 Iter 16: loss 0.15409. :   7%|███▏                                         | 16/224 [00:07<01:39,  2.08it/s]
Epoch 45 Iter 17: loss 0.15987. :   7%|███▏                                         | 16/224 [00:08<01:39,  2.08it/s]
Epoch 45 Iter 17: loss 0.15987. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.09it/s]
Epoch 45 Iter 18: loss 0.17549. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.09it/s]
Epoch 45 Iter 18: loss 0.17549. :   8%|███▌                                         | 18/224 [00:08<01:38,  2.08it/s]
Epoch 45 Iter 19: loss 0.18092. :   8%|███▌                                         | 18/224 [00:09<01:38,  2.08it/s]
Epoch 45 Iter 19: loss 0.18092. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 45 Iter 20: loss 0.14696. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 45 Iter 20: loss 0.14696. :   9%|████                                         | 20/224 [00:09<01:39,  2.06it/s]
Epoch 45 Iter 21: loss 0.17985. :   9%|████                                         | 20/224 [00:10<01:39,  2.06it/s]
Epoch 45 Iter 21: loss 0.17985. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 22: loss 0.17282. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 45 Iter 22: loss 0.17282. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 45 Iter 23: loss 0.17721. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 45 Iter 23: loss 0.17721. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 45 Iter 24: loss 0.16928. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 45 Iter 24: loss 0.16928. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.06it/s]
Epoch 45 Iter 25: loss 0.16841. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.06it/s]
Epoch 45 Iter 25: loss 0.16841. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 45 Iter 26: loss 0.17529. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 45 Iter 26: loss 0.17529. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 45 Iter 27: loss 0.17568. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 45 Iter 27: loss 0.17568. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 45 Iter 28: loss 0.16234. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 45 Iter 28: loss 0.16234. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 45 Iter 29: loss 0.16003. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 45 Iter 29: loss 0.16003. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 45 Iter 30: loss 0.19157. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.07it/s]
Epoch 45 Iter 30: loss 0.19157. :  13%|██████                                       | 30/224 [00:14<01:33,  2.06it/s]
Epoch 45 Iter 31: loss 0.18731. :  13%|██████                                       | 30/224 [00:14<01:33,  2.06it/s]
Epoch 45 Iter 31: loss 0.18731. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.08it/s]
Epoch 45 Iter 32: loss 0.18140. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 45 Iter 32: loss 0.18140. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.09it/s]
Epoch 45 Iter 33: loss 0.16038. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.09it/s]
Epoch 45 Iter 33: loss 0.16038. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.08it/s]
Epoch 45 Iter 34: loss 0.17370. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 34: loss 0.17370. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 35: loss 0.17365. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.08it/s]
Epoch 45 Iter 35: loss 0.17365. :  16%|███████                                      | 35/224 [00:16<01:30,  2.08it/s]
Epoch 45 Iter 36: loss 0.20416. :  16%|███████                                      | 35/224 [00:17<01:30,  2.08it/s]
Epoch 45 Iter 36: loss 0.20416. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 45 Iter 37: loss 0.17248. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 45 Iter 37: loss 0.17248. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.09it/s]
Epoch 45 Iter 38: loss 0.18700. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.09it/s]
Epoch 45 Iter 38: loss 0.18700. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 39: loss 0.16280. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 39: loss 0.16280. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.07it/s]
Epoch 45 Iter 40: loss 0.16860. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.07it/s]
Epoch 45 Iter 40: loss 0.16860. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 45 Iter 41: loss 0.19173. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 45 Iter 41: loss 0.19173. :  18%|████████▏                                    | 41/224 [00:19<01:27,  2.09it/s]
Epoch 45 Iter 42: loss 0.16589. :  18%|████████▏                                    | 41/224 [00:20<01:27,  2.09it/s]
Epoch 45 Iter 42: loss 0.16589. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 45 Iter 43: loss 0.17719. :  19%|████████▍                                    | 42/224 [00:20<01:27,  2.08it/s]
Epoch 45 Iter 43: loss 0.17719. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.08it/s]
Epoch 45 Iter 44: loss 0.18821. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.08it/s]
Epoch 45 Iter 44: loss 0.18821. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.09it/s]
Epoch 45 Iter 45: loss 0.17602. :  20%|████████▊                                    | 44/224 [00:21<01:26,  2.09it/s]
Epoch 45 Iter 45: loss 0.17602. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.08it/s]
Epoch 45 Iter 46: loss 0.17760. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.08it/s]
Epoch 45 Iter 46: loss 0.17760. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 47: loss 0.19076. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.07it/s]
Epoch 45 Iter 47: loss 0.19076. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.17741. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 45 Iter 48: loss 0.17741. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.16465. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.05it/s]
Epoch 45 Iter 49: loss 0.16465. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.06it/s]
Epoch 45 Iter 50: loss 0.17386. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.06it/s]
Epoch 45 Iter 50: loss 0.17386. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 45 Iter 51: loss 0.15968. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 45 Iter 51: loss 0.15968. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.17887. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 45 Iter 52: loss 0.17887. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 45 Iter 53: loss 0.18058. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 45 Iter 53: loss 0.18058. :  24%|██████████▋                                  | 53/224 [00:25<01:21,  2.09it/s]
Epoch 45 Iter 54: loss 0.18319. :  24%|██████████▋                                  | 53/224 [00:26<01:21,  2.09it/s]
Epoch 45 Iter 54: loss 0.18319. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 45 Iter 55: loss 0.16798. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.07it/s]
Epoch 45 Iter 55: loss 0.16798. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.06it/s]
Epoch 45 Iter 56: loss 0.17313. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.06it/s]
Epoch 45 Iter 56: loss 0.17313. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 45 Iter 57: loss 0.18163. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.05it/s]
Epoch 45 Iter 57: loss 0.18163. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.06it/s]
Epoch 45 Iter 58: loss 0.17742. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 58: loss 0.17742. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.20437. :  26%|███████████▋                                 | 58/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 59: loss 0.20437. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.18053. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 45 Iter 60: loss 0.18053. :  27%|████████████                                 | 60/224 [00:28<01:19,  2.06it/s]
Epoch 45 Iter 61: loss 0.17599. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 45 Iter 61: loss 0.17599. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 45 Iter 62: loss 0.16076. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.07it/s]
Epoch 45 Iter 62: loss 0.16076. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.06it/s]
Epoch 45 Iter 63: loss 0.15534. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 63: loss 0.15534. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.18446. :  28%|████████████▋                                | 63/224 [00:30<01:18,  2.06it/s]
Epoch 45 Iter 64: loss 0.18446. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.15573. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 65: loss 0.15573. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 66: loss 0.18051. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 45 Iter 66: loss 0.18051. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.16009. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 45 Iter 67: loss 0.16009. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.17606. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 45 Iter 68: loss 0.17606. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 45 Iter 69: loss 0.18002. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 69: loss 0.18002. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 70: loss 0.20012. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 45 Iter 70: loss 0.20012. :  31%|██████████████                               | 70/224 [00:33<01:13,  2.08it/s]
Epoch 45 Iter 71: loss 0.16392. :  31%|██████████████                               | 70/224 [00:34<01:13,  2.08it/s]
Epoch 45 Iter 71: loss 0.16392. :  32%|██████████████▎                              | 71/224 [00:34<01:12,  2.10it/s]
Epoch 45 Iter 72: loss 0.17277. :  32%|██████████████▎                              | 71/224 [00:34<01:12,  2.10it/s]
Epoch 45 Iter 72: loss 0.17277. :  32%|██████████████▍                              | 72/224 [00:34<01:12,  2.08it/s]
Epoch 45 Iter 73: loss 0.16285. :  32%|██████████████▍                              | 72/224 [00:35<01:12,  2.08it/s]
Epoch 45 Iter 73: loss 0.16285. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 45 Iter 74: loss 0.19798. :  33%|██████████████▋                              | 73/224 [00:35<01:12,  2.08it/s]
Epoch 45 Iter 74: loss 0.19798. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.08it/s]
Epoch 45 Iter 75: loss 0.16419. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.08it/s]
Epoch 45 Iter 75: loss 0.16419. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 45 Iter 76: loss 0.17631. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 45 Iter 76: loss 0.17631. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 45 Iter 77: loss 0.15782. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 45 Iter 77: loss 0.15782. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 45 Iter 78: loss 0.16457. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.08it/s]
Epoch 45 Iter 78: loss 0.16457. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.08it/s]
Epoch 45 Iter 79: loss 0.17570. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.08it/s]
Epoch 45 Iter 79: loss 0.17570. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 45 Iter 80: loss 0.18697. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 45 Iter 80: loss 0.18697. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.08it/s]
Epoch 45 Iter 81: loss 0.18804. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.08it/s]
Epoch 45 Iter 81: loss 0.18804. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.07it/s]
Epoch 45 Iter 82: loss 0.17535. :  36%|████████████████▎                            | 81/224 [00:39<01:08,  2.07it/s]
Epoch 45 Iter 82: loss 0.17535. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.06it/s]
Epoch 45 Iter 83: loss 0.16585. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.06it/s]
Epoch 45 Iter 83: loss 0.16585. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 45 Iter 84: loss 0.18982. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 45 Iter 84: loss 0.18982. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 45 Iter 85: loss 0.16646. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 45 Iter 85: loss 0.16646. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 45 Iter 86: loss 0.16110. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 45 Iter 86: loss 0.16110. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 45 Iter 87: loss 0.15795. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 45 Iter 87: loss 0.15795. :  39%|█████████████████▍                           | 87/224 [00:41<01:06,  2.07it/s]
Epoch 45 Iter 88: loss 0.17259. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 45 Iter 88: loss 0.17259. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 45 Iter 89: loss 0.18053. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.08it/s]
Epoch 45 Iter 89: loss 0.18053. :  40%|█████████████████▉                           | 89/224 [00:42<01:05,  2.07it/s]
Epoch 45 Iter 90: loss 0.19387. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.07it/s]
Epoch 45 Iter 90: loss 0.19387. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 45 Iter 91: loss 0.19038. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 45 Iter 91: loss 0.19038. :  41%|██████████████████▎                          | 91/224 [00:43<01:04,  2.07it/s]
Epoch 45 Iter 92: loss 0.16719. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 45 Iter 92: loss 0.16719. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 45 Iter 93: loss 0.18118. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 45 Iter 93: loss 0.18118. :  42%|██████████████████▋                          | 93/224 [00:44<01:02,  2.08it/s]
Epoch 45 Iter 94: loss 0.16284. :  42%|██████████████████▋                          | 93/224 [00:45<01:02,  2.08it/s]
Epoch 45 Iter 94: loss 0.16284. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 45 Iter 95: loss 0.16466. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 45 Iter 95: loss 0.16466. :  42%|███████████████████                          | 95/224 [00:45<01:02,  2.08it/s]
Epoch 45 Iter 96: loss 0.16345. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.08it/s]
Epoch 45 Iter 96: loss 0.16345. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 97: loss 0.15501. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 97: loss 0.15501. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 45 Iter 98: loss 0.20188. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 45 Iter 98: loss 0.20188. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 45 Iter 99: loss 0.16538. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 45 Iter 99: loss 0.16538. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.06it/s]
Epoch 45 Iter 100: loss 0.17252. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.06it/s]
Epoch 45 Iter 100: loss 0.17252. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 45 Iter 101: loss 0.16973. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 45 Iter 101: loss 0.16973. :  45%|███████████████████▍                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 45 Iter 102: loss 0.18547. :  45%|███████████████████▍                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 45 Iter 102: loss 0.18547. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.10it/s]
Epoch 45 Iter 103: loss 0.16824. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.10it/s]
Epoch 45 Iter 103: loss 0.16824. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 45 Iter 104: loss 0.16548. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 45 Iter 104: loss 0.16548. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 45 Iter 105: loss 0.17266. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 45 Iter 105: loss 0.17266. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 45 Iter 106: loss 0.17393. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 45 Iter 106: loss 0.17393. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 45 Iter 107: loss 0.16645. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 45 Iter 107: loss 0.16645. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 45 Iter 108: loss 0.16248. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 45 Iter 108: loss 0.16248. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 45 Iter 109: loss 0.16732. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.07it/s]
Epoch 45 Iter 109: loss 0.16732. :  49%|████████████████████▉                      | 109/224 [00:52<00:56,  2.05it/s]
Epoch 45 Iter 110: loss 0.15975. :  49%|████████████████████▉                      | 109/224 [00:53<00:56,  2.05it/s]
Epoch 45 Iter 110: loss 0.15975. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 45 Iter 111: loss 0.19119. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 45 Iter 111: loss 0.19119. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 45 Iter 112: loss 0.17488. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 112: loss 0.17488. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 113: loss 0.15924. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 45 Iter 113: loss 0.15924. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 45 Iter 114: loss 0.17449. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 114: loss 0.17449. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 115: loss 0.14947. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 45 Iter 115: loss 0.14947. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 45 Iter 116: loss 0.18114. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.08it/s]
Epoch 45 Iter 116: loss 0.18114. :  52%|██████████████████████▎                    | 116/224 [00:55<00:51,  2.08it/s]
Epoch 45 Iter 117: loss 0.17659. :  52%|██████████████████████▎                    | 116/224 [00:56<00:51,  2.08it/s]
Epoch 45 Iter 117: loss 0.17659. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.16867. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 45 Iter 118: loss 0.16867. :  53%|██████████████████████▋                    | 118/224 [00:56<00:51,  2.07it/s]
Epoch 45 Iter 119: loss 0.19306. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.07it/s]
Epoch 45 Iter 119: loss 0.19306. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 45 Iter 120: loss 0.16164. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.07it/s]
Epoch 45 Iter 120: loss 0.16164. :  54%|███████████████████████                    | 120/224 [00:57<00:50,  2.05it/s]
Epoch 45 Iter 121: loss 0.14770. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 45 Iter 121: loss 0.14770. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 45 Iter 122: loss 0.17446. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 45 Iter 122: loss 0.17446. :  54%|███████████████████████▍                   | 122/224 [00:58<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.18372. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.05it/s]
Epoch 45 Iter 123: loss 0.18372. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 45 Iter 124: loss 0.17663. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.06it/s]
Epoch 45 Iter 124: loss 0.17663. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.07it/s]
Epoch 45 Iter 125: loss 0.15528. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 45 Iter 125: loss 0.15528. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 45 Iter 126: loss 0.16678. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.06it/s]
Epoch 45 Iter 126: loss 0.16678. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.07it/s]
Epoch 45 Iter 127: loss 0.14993. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.07it/s]
Epoch 45 Iter 127: loss 0.14993. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 128: loss 0.17208. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.06it/s]
Epoch 45 Iter 128: loss 0.17208. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.16352. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 129: loss 0.16352. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 130: loss 0.16859. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 45 Iter 130: loss 0.16859. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 45 Iter 131: loss 0.16114. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 131: loss 0.16114. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.17307. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:45,  2.06it/s]
Epoch 45 Iter 132: loss 0.17307. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.19483. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 45 Iter 133: loss 0.19483. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 45 Iter 134: loss 0.18005. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.04it/s]
Epoch 45 Iter 134: loss 0.18005. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 45 Iter 135: loss 0.16840. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 45 Iter 135: loss 0.16840. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 45 Iter 136: loss 0.18825. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.07it/s]
Epoch 45 Iter 136: loss 0.18825. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.09it/s]
Epoch 45 Iter 137: loss 0.17776. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.09it/s]
Epoch 45 Iter 137: loss 0.17776. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 45 Iter 138: loss 0.15974. :  61%|██████████████████████████▎                | 137/224 [01:06<00:41,  2.09it/s]
Epoch 45 Iter 138: loss 0.15974. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.08it/s]
Epoch 45 Iter 139: loss 0.18081. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.08it/s]
Epoch 45 Iter 139: loss 0.18081. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 45 Iter 140: loss 0.17702. :  62%|██████████████████████████▋                | 139/224 [01:07<00:40,  2.08it/s]
Epoch 45 Iter 140: loss 0.17702. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 45 Iter 141: loss 0.17479. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 45 Iter 141: loss 0.17479. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 45 Iter 142: loss 0.17273. :  63%|███████████████████████████                | 141/224 [01:08<00:39,  2.09it/s]
Epoch 45 Iter 142: loss 0.17273. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 45 Iter 143: loss 0.17010. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 45 Iter 143: loss 0.17010. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 45 Iter 144: loss 0.17923. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.09it/s]
Epoch 45 Iter 144: loss 0.17923. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.09it/s]
Epoch 45 Iter 145: loss 0.19823. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.09it/s]
Epoch 45 Iter 145: loss 0.19823. :  65%|███████████████████████████▊               | 145/224 [01:09<00:37,  2.09it/s]
Epoch 45 Iter 146: loss 0.17548. :  65%|███████████████████████████▊               | 145/224 [01:10<00:37,  2.09it/s]
Epoch 45 Iter 146: loss 0.17548. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 45 Iter 147: loss 0.17531. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.07it/s]
Epoch 45 Iter 147: loss 0.17531. :  66%|████████████████████████████▏              | 147/224 [01:10<00:37,  2.08it/s]
Epoch 45 Iter 148: loss 0.16456. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.08it/s]
Epoch 45 Iter 148: loss 0.16456. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 45 Iter 149: loss 0.17334. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.08it/s]
Epoch 45 Iter 149: loss 0.17334. :  67%|████████████████████████████▌              | 149/224 [01:11<00:36,  2.08it/s]
Epoch 45 Iter 150: loss 0.15296. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.08it/s]
Epoch 45 Iter 150: loss 0.15296. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 45 Iter 151: loss 0.20985. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.08it/s]
Epoch 45 Iter 151: loss 0.20985. :  67%|████████████████████████████▉              | 151/224 [01:12<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.17634. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.07it/s]
Epoch 45 Iter 152: loss 0.17634. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 45 Iter 153: loss 0.18707. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.07it/s]
Epoch 45 Iter 153: loss 0.18707. :  68%|█████████████████████████████▎             | 153/224 [01:13<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.18155. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 45 Iter 154: loss 0.18155. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.18284. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 45 Iter 155: loss 0.18284. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.17017. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 45 Iter 156: loss 0.17017. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 45 Iter 157: loss 0.18992. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 45 Iter 157: loss 0.18992. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 45 Iter 158: loss 0.16349. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 45 Iter 158: loss 0.16349. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.17588. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 45 Iter 159: loss 0.17588. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.15763. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.07it/s]
Epoch 45 Iter 160: loss 0.15763. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.18559. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 45 Iter 161: loss 0.18559. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.09it/s]
Epoch 45 Iter 162: loss 0.16400. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.09it/s]
Epoch 45 Iter 162: loss 0.16400. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.17784. :  72%|███████████████████████████████            | 162/224 [01:18<00:29,  2.08it/s]
Epoch 45 Iter 163: loss 0.17784. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 45 Iter 164: loss 0.16994. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 45 Iter 164: loss 0.16994. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.18662. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.06it/s]
Epoch 45 Iter 165: loss 0.18662. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.17260. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 166: loss 0.17260. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 167: loss 0.17315. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 45 Iter 167: loss 0.17315. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.07it/s]
Epoch 45 Iter 168: loss 0.17837. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.07it/s]
Epoch 45 Iter 168: loss 0.17837. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 45 Iter 169: loss 0.18648. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.06it/s]
Epoch 45 Iter 169: loss 0.18648. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 45 Iter 170: loss 0.15373. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 45 Iter 170: loss 0.15373. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 45 Iter 171: loss 0.16902. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 45 Iter 171: loss 0.16902. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 45 Iter 172: loss 0.19216. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 45 Iter 172: loss 0.19216. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 45 Iter 173: loss 0.16927. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 45 Iter 173: loss 0.16927. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.07it/s]
Epoch 45 Iter 174: loss 0.18951. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.07it/s]
Epoch 45 Iter 174: loss 0.18951. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 45 Iter 175: loss 0.17942. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 45 Iter 175: loss 0.17942. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.09it/s]
Epoch 45 Iter 176: loss 0.17117. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.09it/s]
Epoch 45 Iter 176: loss 0.17117. :  79%|█████████████████████████████████▊         | 176/224 [01:24<00:22,  2.09it/s]
Epoch 45 Iter 177: loss 0.20219. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:22,  2.09it/s]
Epoch 45 Iter 177: loss 0.20219. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.09it/s]
Epoch 45 Iter 178: loss 0.17523. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.09it/s]
Epoch 45 Iter 178: loss 0.17523. :  79%|██████████████████████████████████▏        | 178/224 [01:25<00:21,  2.12it/s]
Epoch 45 Iter 179: loss 0.17366. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:21,  2.12it/s]
Epoch 45 Iter 179: loss 0.17366. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.12it/s]
Epoch 45 Iter 180: loss 0.18463. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.12it/s]
Epoch 45 Iter 180: loss 0.18463. :  80%|██████████████████████████████████▌        | 180/224 [01:26<00:20,  2.10it/s]
Epoch 45 Iter 181: loss 0.17517. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:20,  2.10it/s]
Epoch 45 Iter 181: loss 0.17517. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 45 Iter 182: loss 0.16476. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 45 Iter 182: loss 0.16476. :  81%|██████████████████████████████████▉        | 182/224 [01:27<00:20,  2.09it/s]
Epoch 45 Iter 183: loss 0.19714. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.09it/s]
Epoch 45 Iter 183: loss 0.19714. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 45 Iter 184: loss 0.17343. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.09it/s]
Epoch 45 Iter 184: loss 0.17343. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.10it/s]
Epoch 45 Iter 185: loss 0.16539. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.10it/s]
Epoch 45 Iter 185: loss 0.16539. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 45 Iter 186: loss 0.16599. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.09it/s]
Epoch 45 Iter 186: loss 0.16599. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.08it/s]
Epoch 45 Iter 187: loss 0.16149. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 45 Iter 187: loss 0.16149. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 45 Iter 188: loss 0.16630. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.08it/s]
Epoch 45 Iter 188: loss 0.16630. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.07it/s]
Epoch 45 Iter 189: loss 0.18728. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.07it/s]
Epoch 45 Iter 189: loss 0.18728. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 45 Iter 190: loss 0.16673. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:17,  2.06it/s]
Epoch 45 Iter 190: loss 0.16673. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.05it/s]
Epoch 45 Iter 191: loss 0.16037. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.05it/s]
Epoch 45 Iter 191: loss 0.16037. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 45 Iter 192: loss 0.16672. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.06it/s]
Epoch 45 Iter 192: loss 0.16672. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.06it/s]
Epoch 45 Iter 193: loss 0.16625. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.06it/s]
Epoch 45 Iter 193: loss 0.16625. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 45 Iter 194: loss 0.18352. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 45 Iter 194: loss 0.18352. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.17187. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 45 Iter 195: loss 0.17187. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 45 Iter 196: loss 0.15875. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 45 Iter 196: loss 0.15875. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.07it/s]
Epoch 45 Iter 197: loss 0.16972. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.07it/s]
Epoch 45 Iter 197: loss 0.16972. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 45 Iter 198: loss 0.17256. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.07it/s]
Epoch 45 Iter 198: loss 0.17256. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.07it/s]
Epoch 45 Iter 199: loss 0.17813. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.07it/s]
Epoch 45 Iter 199: loss 0.17813. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 45 Iter 200: loss 0.16816. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 45 Iter 200: loss 0.16816. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 45 Iter 201: loss 0.17781. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 45 Iter 201: loss 0.17781. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.18145. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 45 Iter 202: loss 0.18145. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 45 Iter 203: loss 0.17482. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.07it/s]
Epoch 45 Iter 203: loss 0.17482. :  91%|██████████████████████████████████████▉    | 203/224 [01:37<00:10,  2.06it/s]
Epoch 45 Iter 204: loss 0.16293. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 45 Iter 204: loss 0.16293. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 45 Iter 205: loss 0.18237. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 45 Iter 205: loss 0.18237. :  92%|███████████████████████████████████████▎   | 205/224 [01:38<00:09,  2.07it/s]
Epoch 45 Iter 206: loss 0.16076. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 45 Iter 206: loss 0.16076. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 45 Iter 207: loss 0.17972. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 45 Iter 207: loss 0.17972. :  92%|███████████████████████████████████████▋   | 207/224 [01:39<00:08,  2.07it/s]
Epoch 45 Iter 208: loss 0.18089. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 45 Iter 208: loss 0.18089. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 45 Iter 209: loss 0.15453. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 45 Iter 209: loss 0.15453. :  93%|████████████████████████████████████████   | 209/224 [01:40<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.17133. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.06it/s]
Epoch 45 Iter 210: loss 0.17133. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 45 Iter 211: loss 0.16982. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.06it/s]
Epoch 45 Iter 211: loss 0.16982. :  94%|████████████████████████████████████████▌  | 211/224 [01:41<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.17259. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.06it/s]
Epoch 45 Iter 212: loss 0.17259. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.17841. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 45 Iter 213: loss 0.17841. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.06it/s]
Epoch 45 Iter 214: loss 0.15801. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.06it/s]
Epoch 45 Iter 214: loss 0.15801. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 45 Iter 215: loss 0.16101. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.06it/s]
Epoch 45 Iter 215: loss 0.16101. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.03it/s]
Epoch 45 Iter 216: loss 0.18519. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.03it/s]
Epoch 45 Iter 216: loss 0.18519. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 45 Iter 217: loss 0.15654. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.04it/s]
Epoch 45 Iter 217: loss 0.15654. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.17138. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.06it/s]
Epoch 45 Iter 218: loss 0.17138. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 45 Iter 219: loss 0.17446. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 45 Iter 219: loss 0.17446. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.08it/s]
Epoch 45 Iter 220: loss 0.17400. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.08it/s]
Epoch 45 Iter 220: loss 0.17400. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 45 Iter 221: loss 0.17663. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.08it/s]
Epoch 45 Iter 221: loss 0.17663. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.07it/s]
Epoch 45 Iter 222: loss 0.15902. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 45 Iter 222: loss 0.15902. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 45 Iter 223: loss 0.18238. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.08it/s]
Epoch 45 Iter 223: loss 0.18238. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 45 Iter 224: loss 0.15764. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 45 Iter 224: loss 0.15764. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]
Epoch 45 Iter 224: loss 0.15764. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17373
    Valid loss: 0.17944
       Valid loss recons: 0.17301
       Valid loss KL-D:   64.30685
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.15793. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 46 Iter 1: loss 0.15793. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 46 Iter 2: loss 0.19599. :   0%|▏                                              | 1/224 [00:00<01:49,  2.04it/s]
Epoch 46 Iter 2: loss 0.19599. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 46 Iter 3: loss 0.18102. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 46 Iter 3: loss 0.18102. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 46 Iter 4: loss 0.19091. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 46 Iter 4: loss 0.19091. :   2%|▊                                              | 4/224 [00:01<01:46,  2.07it/s]
Epoch 46 Iter 5: loss 0.15221. :   2%|▊                                              | 4/224 [00:02<01:46,  2.07it/s]
Epoch 46 Iter 5: loss 0.15221. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.16384. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 46 Iter 6: loss 0.16384. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.07it/s]
Epoch 46 Iter 7: loss 0.18724. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.07it/s]
Epoch 46 Iter 7: loss 0.18724. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 46 Iter 8: loss 0.17355. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.07it/s]
Epoch 46 Iter 8: loss 0.17355. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 46 Iter 9: loss 0.18282. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 46 Iter 9: loss 0.18282. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 46 Iter 10: loss 0.17059. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 46 Iter 10: loss 0.17059. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 46 Iter 11: loss 0.16731. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 46 Iter 11: loss 0.16731. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 12: loss 0.16349. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 12: loss 0.16349. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 46 Iter 13: loss 0.17116. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 46 Iter 13: loss 0.17116. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 46 Iter 14: loss 0.15992. :   6%|██▌                                          | 13/224 [00:06<01:41,  2.08it/s]
Epoch 46 Iter 14: loss 0.15992. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.07it/s]
Epoch 46 Iter 15: loss 0.17245. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.07it/s]
Epoch 46 Iter 15: loss 0.17245. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 46 Iter 16: loss 0.17060. :   7%|███                                          | 15/224 [00:07<01:40,  2.07it/s]
Epoch 46 Iter 16: loss 0.17060. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.17826. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.07it/s]
Epoch 46 Iter 17: loss 0.17826. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 18: loss 0.17335. :   8%|███▍                                         | 17/224 [00:08<01:39,  2.07it/s]
Epoch 46 Iter 18: loss 0.17335. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.08it/s]
Epoch 46 Iter 19: loss 0.17392. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.08it/s]
Epoch 46 Iter 19: loss 0.17392. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.14868. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 20: loss 0.14868. :   9%|████                                         | 20/224 [00:09<01:38,  2.08it/s]
Epoch 46 Iter 21: loss 0.18105. :   9%|████                                         | 20/224 [00:10<01:38,  2.08it/s]
Epoch 46 Iter 21: loss 0.18105. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 46 Iter 22: loss 0.17375. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.08it/s]
Epoch 46 Iter 22: loss 0.17375. :  10%|████▍                                        | 22/224 [00:10<01:36,  2.09it/s]
Epoch 46 Iter 23: loss 0.16572. :  10%|████▍                                        | 22/224 [00:11<01:36,  2.09it/s]
Epoch 46 Iter 23: loss 0.16572. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 46 Iter 24: loss 0.17619. :  10%|████▌                                        | 23/224 [00:11<01:36,  2.08it/s]
Epoch 46 Iter 24: loss 0.17619. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.08it/s]
Epoch 46 Iter 25: loss 0.15262. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.08it/s]
Epoch 46 Iter 25: loss 0.15262. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 46 Iter 26: loss 0.18398. :  11%|█████                                        | 25/224 [00:12<01:35,  2.07it/s]
Epoch 46 Iter 26: loss 0.18398. :  12%|█████▏                                       | 26/224 [00:12<01:35,  2.08it/s]
Epoch 46 Iter 27: loss 0.18207. :  12%|█████▏                                       | 26/224 [00:13<01:35,  2.08it/s]
Epoch 46 Iter 27: loss 0.18207. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.07it/s]
Epoch 46 Iter 28: loss 0.17731. :  12%|█████▍                                       | 27/224 [00:13<01:34,  2.07it/s]
Epoch 46 Iter 28: loss 0.17731. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.08it/s]
Epoch 46 Iter 29: loss 0.18938. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.08it/s]
Epoch 46 Iter 29: loss 0.18938. :  13%|█████▊                                       | 29/224 [00:13<01:33,  2.08it/s]
Epoch 46 Iter 30: loss 0.17271. :  13%|█████▊                                       | 29/224 [00:14<01:33,  2.08it/s]
Epoch 46 Iter 30: loss 0.17271. :  13%|██████                                       | 30/224 [00:14<01:33,  2.09it/s]
Epoch 46 Iter 31: loss 0.15941. :  13%|██████                                       | 30/224 [00:14<01:33,  2.09it/s]
Epoch 46 Iter 31: loss 0.15941. :  14%|██████▏                                      | 31/224 [00:14<01:32,  2.09it/s]
Epoch 46 Iter 32: loss 0.17262. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.09it/s]
Epoch 46 Iter 32: loss 0.17262. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.10it/s]
Epoch 46 Iter 33: loss 0.16985. :  14%|██████▍                                      | 32/224 [00:15<01:31,  2.10it/s]
Epoch 46 Iter 33: loss 0.16985. :  15%|██████▋                                      | 33/224 [00:15<01:31,  2.09it/s]
Epoch 46 Iter 34: loss 0.17093. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.09it/s]
Epoch 46 Iter 34: loss 0.17093. :  15%|██████▊                                      | 34/224 [00:16<01:30,  2.10it/s]
Epoch 46 Iter 35: loss 0.16674. :  15%|██████▊                                      | 34/224 [00:16<01:30,  2.10it/s]
Epoch 46 Iter 35: loss 0.16674. :  16%|███████                                      | 35/224 [00:16<01:30,  2.09it/s]
Epoch 46 Iter 36: loss 0.16836. :  16%|███████                                      | 35/224 [00:17<01:30,  2.09it/s]
Epoch 46 Iter 36: loss 0.16836. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 46 Iter 37: loss 0.19573. :  16%|███████▏                                     | 36/224 [00:17<01:30,  2.08it/s]
Epoch 46 Iter 37: loss 0.19573. :  17%|███████▍                                     | 37/224 [00:17<01:29,  2.08it/s]
Epoch 46 Iter 38: loss 0.18073. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 46 Iter 38: loss 0.18073. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 46 Iter 39: loss 0.17296. :  17%|███████▋                                     | 38/224 [00:18<01:29,  2.08it/s]
Epoch 46 Iter 39: loss 0.17296. :  17%|███████▊                                     | 39/224 [00:18<01:28,  2.09it/s]
Epoch 46 Iter 40: loss 0.17193. :  17%|███████▊                                     | 39/224 [00:19<01:28,  2.09it/s]
Epoch 46 Iter 40: loss 0.17193. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 46 Iter 41: loss 0.17051. :  18%|████████                                     | 40/224 [00:19<01:28,  2.09it/s]
Epoch 46 Iter 41: loss 0.17051. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 46 Iter 42: loss 0.17950. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 46 Iter 42: loss 0.17950. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.19196. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 46 Iter 43: loss 0.19196. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.15637. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 44: loss 0.15637. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 46 Iter 45: loss 0.18781. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.07it/s]
Epoch 46 Iter 45: loss 0.18781. :  20%|█████████                                    | 45/224 [00:21<01:27,  2.06it/s]
Epoch 46 Iter 46: loss 0.17810. :  20%|█████████                                    | 45/224 [00:22<01:27,  2.06it/s]
Epoch 46 Iter 46: loss 0.17810. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 46 Iter 47: loss 0.16227. :  21%|█████████▏                                   | 46/224 [00:22<01:26,  2.06it/s]
Epoch 46 Iter 47: loss 0.16227. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.17285. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 48: loss 0.17285. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.16470. :  21%|█████████▋                                   | 48/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 49: loss 0.16470. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.16789. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.06it/s]
Epoch 46 Iter 50: loss 0.16789. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 46 Iter 51: loss 0.17669. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 46 Iter 51: loss 0.17669. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 46 Iter 52: loss 0.18012. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 46 Iter 52: loss 0.18012. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 46 Iter 53: loss 0.17269. :  23%|██████████▍                                  | 52/224 [00:25<01:22,  2.08it/s]
Epoch 46 Iter 53: loss 0.17269. :  24%|██████████▋                                  | 53/224 [00:25<01:21,  2.09it/s]
Epoch 46 Iter 54: loss 0.19173. :  24%|██████████▋                                  | 53/224 [00:26<01:21,  2.09it/s]
Epoch 46 Iter 54: loss 0.19173. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 55: loss 0.18434. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 55: loss 0.18434. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 56: loss 0.16285. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 46 Iter 56: loss 0.16285. :  25%|███████████▎                                 | 56/224 [00:26<01:21,  2.07it/s]
Epoch 46 Iter 57: loss 0.17244. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 46 Iter 57: loss 0.17244. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 46 Iter 58: loss 0.18233. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.08it/s]
Epoch 46 Iter 58: loss 0.18233. :  26%|███████████▋                                 | 58/224 [00:27<01:19,  2.08it/s]
Epoch 46 Iter 59: loss 0.19773. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 46 Iter 59: loss 0.19773. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 46 Iter 60: loss 0.16690. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.07it/s]
Epoch 46 Iter 60: loss 0.16690. :  27%|████████████                                 | 60/224 [00:28<01:19,  2.07it/s]
Epoch 46 Iter 61: loss 0.19355. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 46 Iter 61: loss 0.19355. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 46 Iter 62: loss 0.17843. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 46 Iter 62: loss 0.17843. :  28%|████████████▍                                | 62/224 [00:29<01:18,  2.07it/s]
Epoch 46 Iter 63: loss 0.16307. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 46 Iter 63: loss 0.16307. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 46 Iter 64: loss 0.17598. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 46 Iter 64: loss 0.17598. :  29%|████████████▊                                | 64/224 [00:30<01:17,  2.06it/s]
Epoch 46 Iter 65: loss 0.15954. :  29%|████████████▊                                | 64/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 65: loss 0.15954. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 66: loss 0.17258. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 46 Iter 66: loss 0.17258. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.05it/s]
Epoch 46 Iter 67: loss 0.17002. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.05it/s]
Epoch 46 Iter 67: loss 0.17002. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.16044. :  30%|█████████████▍                               | 67/224 [00:32<01:16,  2.06it/s]
Epoch 46 Iter 68: loss 0.16044. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.05it/s]
Epoch 46 Iter 69: loss 0.16623. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.05it/s]
Epoch 46 Iter 69: loss 0.16623. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 46 Iter 70: loss 0.17165. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.07it/s]
Epoch 46 Iter 70: loss 0.17165. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 46 Iter 71: loss 0.18319. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 71: loss 0.18319. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 72: loss 0.17134. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 46 Iter 72: loss 0.17134. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 46 Iter 73: loss 0.16601. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 73: loss 0.16601. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 74: loss 0.17836. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.06it/s]
Epoch 46 Iter 74: loss 0.17836. :  33%|██████████████▊                              | 74/224 [00:35<01:13,  2.05it/s]
Epoch 46 Iter 75: loss 0.15193. :  33%|██████████████▊                              | 74/224 [00:36<01:13,  2.05it/s]
Epoch 46 Iter 75: loss 0.15193. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 46 Iter 76: loss 0.16091. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.05it/s]
Epoch 46 Iter 76: loss 0.16091. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 46 Iter 77: loss 0.16262. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 46 Iter 77: loss 0.16262. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 46 Iter 78: loss 0.17649. :  34%|███████████████▍                             | 77/224 [00:37<01:11,  2.06it/s]
Epoch 46 Iter 78: loss 0.17649. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 46 Iter 79: loss 0.16493. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 46 Iter 79: loss 0.16493. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.15662. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.08it/s]
Epoch 46 Iter 80: loss 0.15662. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 46 Iter 81: loss 0.17006. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 46 Iter 81: loss 0.17006. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 46 Iter 82: loss 0.15610. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 46 Iter 82: loss 0.15610. :  37%|████████████████▍                            | 82/224 [00:39<01:09,  2.04it/s]
Epoch 46 Iter 83: loss 0.18457. :  37%|████████████████▍                            | 82/224 [00:40<01:09,  2.04it/s]
Epoch 46 Iter 83: loss 0.18457. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 46 Iter 84: loss 0.17458. :  37%|████████████████▋                            | 83/224 [00:40<01:09,  2.04it/s]
Epoch 46 Iter 84: loss 0.17458. :  38%|████████████████▉                            | 84/224 [00:40<01:08,  2.05it/s]
Epoch 46 Iter 85: loss 0.17468. :  38%|████████████████▉                            | 84/224 [00:41<01:08,  2.05it/s]
Epoch 46 Iter 85: loss 0.17468. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 46 Iter 86: loss 0.17976. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.05it/s]
Epoch 46 Iter 86: loss 0.17976. :  38%|█████████████████▎                           | 86/224 [00:41<01:07,  2.05it/s]
Epoch 46 Iter 87: loss 0.19576. :  38%|█████████████████▎                           | 86/224 [00:42<01:07,  2.05it/s]
Epoch 46 Iter 87: loss 0.19576. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 88: loss 0.15513. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 88: loss 0.15513. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 46 Iter 89: loss 0.15538. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 46 Iter 89: loss 0.15538. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 46 Iter 90: loss 0.16743. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 46 Iter 90: loss 0.16743. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 46 Iter 91: loss 0.17481. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 46 Iter 91: loss 0.17481. :  41%|██████████████████▎                          | 91/224 [00:43<01:03,  2.08it/s]
Epoch 46 Iter 92: loss 0.18020. :  41%|██████████████████▎                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 46 Iter 92: loss 0.18020. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.09it/s]
Epoch 46 Iter 93: loss 0.17972. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.09it/s]
Epoch 46 Iter 93: loss 0.17972. :  42%|██████████████████▋                          | 93/224 [00:44<01:02,  2.09it/s]
Epoch 46 Iter 94: loss 0.17774. :  42%|██████████████████▋                          | 93/224 [00:45<01:02,  2.09it/s]
Epoch 46 Iter 94: loss 0.17774. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 46 Iter 95: loss 0.18619. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.08it/s]
Epoch 46 Iter 95: loss 0.18619. :  42%|███████████████████                          | 95/224 [00:45<01:01,  2.09it/s]
Epoch 46 Iter 96: loss 0.17728. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 46 Iter 96: loss 0.17728. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 46 Iter 97: loss 0.19368. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.09it/s]
Epoch 46 Iter 97: loss 0.19368. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.08it/s]
Epoch 46 Iter 98: loss 0.17686. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.08it/s]
Epoch 46 Iter 98: loss 0.17686. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 46 Iter 99: loss 0.14592. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 46 Iter 99: loss 0.14592. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 46 Iter 100: loss 0.17225. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 46 Iter 100: loss 0.17225. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 46 Iter 101: loss 0.19280. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.08it/s]
Epoch 46 Iter 101: loss 0.19280. :  45%|███████████████████▍                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 46 Iter 102: loss 0.16529. :  45%|███████████████████▍                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 46 Iter 102: loss 0.16529. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 46 Iter 103: loss 0.18078. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.07it/s]
Epoch 46 Iter 103: loss 0.18078. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 46 Iter 104: loss 0.16681. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 46 Iter 104: loss 0.16681. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 46 Iter 105: loss 0.17537. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.08it/s]
Epoch 46 Iter 105: loss 0.17537. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.08it/s]
Epoch 46 Iter 106: loss 0.18107. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.08it/s]
Epoch 46 Iter 106: loss 0.18107. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 46 Iter 107: loss 0.16186. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 46 Iter 107: loss 0.16186. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.14557. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 46 Iter 108: loss 0.14557. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 46 Iter 109: loss 0.17512. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 46 Iter 109: loss 0.17512. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.07it/s]
Epoch 46 Iter 110: loss 0.17864. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.07it/s]
Epoch 46 Iter 110: loss 0.17864. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 46 Iter 111: loss 0.18086. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 46 Iter 111: loss 0.18086. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 46 Iter 112: loss 0.15617. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 46 Iter 112: loss 0.15617. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 46 Iter 113: loss 0.18301. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 46 Iter 113: loss 0.18301. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.16659. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 114: loss 0.16659. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 115: loss 0.17395. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.07it/s]
Epoch 46 Iter 115: loss 0.17395. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.06it/s]
Epoch 46 Iter 116: loss 0.17899. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.06it/s]
Epoch 46 Iter 116: loss 0.17899. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 117: loss 0.18005. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 117: loss 0.18005. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.05it/s]
Epoch 46 Iter 118: loss 0.18429. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.05it/s]
Epoch 46 Iter 118: loss 0.18429. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 46 Iter 119: loss 0.16872. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 46 Iter 119: loss 0.16872. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 46 Iter 120: loss 0.17491. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 46 Iter 120: loss 0.17491. :  54%|███████████████████████                    | 120/224 [00:57<00:50,  2.05it/s]
Epoch 46 Iter 121: loss 0.17650. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 121: loss 0.17650. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 122: loss 0.18603. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.05it/s]
Epoch 46 Iter 122: loss 0.18603. :  54%|███████████████████████▍                   | 122/224 [00:58<00:50,  2.02it/s]
Epoch 46 Iter 123: loss 0.17490. :  54%|███████████████████████▍                   | 122/224 [00:59<00:50,  2.02it/s]
Epoch 46 Iter 123: loss 0.17490. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.03it/s]
Epoch 46 Iter 124: loss 0.16330. :  55%|███████████████████████▌                   | 123/224 [00:59<00:49,  2.03it/s]
Epoch 46 Iter 124: loss 0.16330. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.04it/s]
Epoch 46 Iter 125: loss 0.17104. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.04it/s]
Epoch 46 Iter 125: loss 0.17104. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 46 Iter 126: loss 0.17273. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.05it/s]
Epoch 46 Iter 126: loss 0.17273. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.05it/s]
Epoch 46 Iter 127: loss 0.15828. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 46 Iter 127: loss 0.15828. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 46 Iter 128: loss 0.18367. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.04it/s]
Epoch 46 Iter 128: loss 0.18367. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.05it/s]
Epoch 46 Iter 129: loss 0.16722. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.05it/s]
Epoch 46 Iter 129: loss 0.16722. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 46 Iter 130: loss 0.18595. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.05it/s]
Epoch 46 Iter 130: loss 0.18595. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 46 Iter 131: loss 0.16519. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 46 Iter 131: loss 0.16519. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 46 Iter 132: loss 0.18494. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 46 Iter 132: loss 0.18494. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.05it/s]
Epoch 46 Iter 133: loss 0.15052. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.05it/s]
Epoch 46 Iter 133: loss 0.15052. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 46 Iter 134: loss 0.16346. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.05it/s]
Epoch 46 Iter 134: loss 0.16346. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.05it/s]
Epoch 46 Iter 135: loss 0.17761. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 46 Iter 135: loss 0.17761. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 46 Iter 136: loss 0.16109. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 46 Iter 136: loss 0.16109. :  61%|██████████████████████████                 | 136/224 [01:05<00:43,  2.04it/s]
Epoch 46 Iter 137: loss 0.17996. :  61%|██████████████████████████                 | 136/224 [01:06<00:43,  2.04it/s]
Epoch 46 Iter 137: loss 0.17996. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 46 Iter 138: loss 0.18689. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.04it/s]
Epoch 46 Iter 138: loss 0.18689. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.05it/s]
Epoch 46 Iter 139: loss 0.17696. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.05it/s]
Epoch 46 Iter 139: loss 0.17696. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.17501. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 46 Iter 140: loss 0.17501. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 46 Iter 141: loss 0.17735. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 46 Iter 141: loss 0.17735. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 46 Iter 142: loss 0.16409. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 46 Iter 142: loss 0.16409. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 46 Iter 143: loss 0.16349. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 46 Iter 143: loss 0.16349. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 46 Iter 144: loss 0.18468. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.07it/s]
Epoch 46 Iter 144: loss 0.18468. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 46 Iter 145: loss 0.18136. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 46 Iter 145: loss 0.18136. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.17295. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 46 Iter 146: loss 0.17295. :  65%|████████████████████████████               | 146/224 [01:10<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.18995. :  65%|████████████████████████████               | 146/224 [01:11<00:38,  2.05it/s]
Epoch 46 Iter 147: loss 0.18995. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 46 Iter 148: loss 0.20517. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 46 Iter 148: loss 0.20517. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 46 Iter 149: loss 0.18097. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 149: loss 0.18097. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 150: loss 0.17206. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 46 Iter 150: loss 0.17206. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 46 Iter 151: loss 0.16023. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 151: loss 0.16023. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.17732. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 46 Iter 152: loss 0.17732. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 46 Iter 153: loss 0.17259. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 46 Iter 153: loss 0.17259. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 46 Iter 154: loss 0.17611. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 46 Iter 154: loss 0.17611. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.06it/s]
Epoch 46 Iter 155: loss 0.17562. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 155: loss 0.17562. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.16870. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.06it/s]
Epoch 46 Iter 156: loss 0.16870. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 46 Iter 157: loss 0.19274. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 46 Iter 157: loss 0.19274. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.07it/s]
Epoch 46 Iter 158: loss 0.17857. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 46 Iter 158: loss 0.17857. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 46 Iter 159: loss 0.16616. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.06it/s]
Epoch 46 Iter 159: loss 0.16616. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 46 Iter 160: loss 0.18450. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 46 Iter 160: loss 0.18450. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.06it/s]
Epoch 46 Iter 161: loss 0.15603. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.06it/s]
Epoch 46 Iter 161: loss 0.15603. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.06it/s]
Epoch 46 Iter 162: loss 0.17118. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 46 Iter 162: loss 0.17118. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 46 Iter 163: loss 0.16496. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 46 Iter 163: loss 0.16496. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.07it/s]
Epoch 46 Iter 164: loss 0.18014. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.07it/s]
Epoch 46 Iter 164: loss 0.18014. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 46 Iter 165: loss 0.17442. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 46 Iter 165: loss 0.17442. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.06it/s]
Epoch 46 Iter 166: loss 0.16120. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.06it/s]
Epoch 46 Iter 166: loss 0.16120. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 46 Iter 167: loss 0.15467. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.05it/s]
Epoch 46 Iter 167: loss 0.15467. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.05it/s]
Epoch 46 Iter 168: loss 0.15532. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.05it/s]
Epoch 46 Iter 168: loss 0.15532. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 46 Iter 169: loss 0.19790. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:27,  2.07it/s]
Epoch 46 Iter 169: loss 0.19790. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 46 Iter 170: loss 0.18991. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 170: loss 0.18991. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 171: loss 0.16096. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 46 Iter 171: loss 0.16096. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.06it/s]
Epoch 46 Iter 172: loss 0.19228. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.06it/s]
Epoch 46 Iter 172: loss 0.19228. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 46 Iter 173: loss 0.17480. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.06it/s]
Epoch 46 Iter 173: loss 0.17480. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.05it/s]
Epoch 46 Iter 174: loss 0.18042. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.05it/s]
Epoch 46 Iter 174: loss 0.18042. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 46 Iter 175: loss 0.17439. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.06it/s]
Epoch 46 Iter 175: loss 0.17439. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.18265. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.05it/s]
Epoch 46 Iter 176: loss 0.18265. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 46 Iter 177: loss 0.17882. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.04it/s]
Epoch 46 Iter 177: loss 0.17882. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.18470. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.05it/s]
Epoch 46 Iter 178: loss 0.18470. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 46 Iter 179: loss 0.18166. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 46 Iter 179: loss 0.18166. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 46 Iter 180: loss 0.18437. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 46 Iter 180: loss 0.18437. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 46 Iter 181: loss 0.17260. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.08it/s]
Epoch 46 Iter 181: loss 0.17260. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.16958. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.07it/s]
Epoch 46 Iter 182: loss 0.16958. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 46 Iter 183: loss 0.19216. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.08it/s]
Epoch 46 Iter 183: loss 0.19216. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 46 Iter 184: loss 0.17797. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.08it/s]
Epoch 46 Iter 184: loss 0.17797. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.16812. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.06it/s]
Epoch 46 Iter 185: loss 0.16812. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 46 Iter 186: loss 0.17450. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.08it/s]
Epoch 46 Iter 186: loss 0.17450. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 46 Iter 187: loss 0.16019. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.08it/s]
Epoch 46 Iter 187: loss 0.16019. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.16369. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 46 Iter 188: loss 0.16369. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.19725. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 46 Iter 189: loss 0.19725. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.17104. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.06it/s]
Epoch 46 Iter 190: loss 0.17104. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.07it/s]
Epoch 46 Iter 191: loss 0.17492. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 46 Iter 191: loss 0.17492. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.16146. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 192: loss 0.16146. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.18643. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 46 Iter 193: loss 0.18643. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 46 Iter 194: loss 0.17375. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 46 Iter 194: loss 0.17375. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 46 Iter 195: loss 0.15736. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 46 Iter 195: loss 0.15736. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 46 Iter 196: loss 0.17301. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.07it/s]
Epoch 46 Iter 196: loss 0.17301. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 46 Iter 197: loss 0.18197. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 46 Iter 197: loss 0.18197. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 46 Iter 198: loss 0.17883. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 46 Iter 198: loss 0.17883. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.05it/s]
Epoch 46 Iter 199: loss 0.17043. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.05it/s]
Epoch 46 Iter 199: loss 0.17043. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 46 Iter 200: loss 0.18170. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.06it/s]
Epoch 46 Iter 200: loss 0.18170. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.07it/s]
Epoch 46 Iter 201: loss 0.17992. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.07it/s]
Epoch 46 Iter 201: loss 0.17992. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 46 Iter 202: loss 0.17060. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 46 Iter 202: loss 0.17060. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.08it/s]
Epoch 46 Iter 203: loss 0.17314. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.08it/s]
Epoch 46 Iter 203: loss 0.17314. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 204: loss 0.17091. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 46 Iter 204: loss 0.17091. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 46 Iter 205: loss 0.16848. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 205: loss 0.16848. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.17607. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.07it/s]
Epoch 46 Iter 206: loss 0.17607. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.06it/s]
Epoch 46 Iter 207: loss 0.17687. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.06it/s]
Epoch 46 Iter 207: loss 0.17687. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 46 Iter 208: loss 0.14937. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.06it/s]
Epoch 46 Iter 208: loss 0.14937. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.06it/s]
Epoch 46 Iter 209: loss 0.16736. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.06it/s]
Epoch 46 Iter 209: loss 0.16736. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 46 Iter 210: loss 0.17484. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 46 Iter 210: loss 0.17484. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.03it/s]
Epoch 46 Iter 211: loss 0.16034. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.03it/s]
Epoch 46 Iter 211: loss 0.16034. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 46 Iter 212: loss 0.17847. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.04it/s]
Epoch 46 Iter 212: loss 0.17847. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.05it/s]
Epoch 46 Iter 213: loss 0.16133. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 213: loss 0.16133. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 214: loss 0.17021. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.05it/s]
Epoch 46 Iter 214: loss 0.17021. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.05it/s]
Epoch 46 Iter 215: loss 0.17502. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.05it/s]
Epoch 46 Iter 215: loss 0.17502. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 46 Iter 216: loss 0.17931. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 46 Iter 216: loss 0.17931. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 46 Iter 217: loss 0.16883. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 217: loss 0.16883. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 218: loss 0.16886. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 46 Iter 218: loss 0.16886. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 46 Iter 219: loss 0.16754. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 219: loss 0.16754. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 220: loss 0.18583. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 46 Iter 220: loss 0.18583. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 46 Iter 221: loss 0.19333. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 46 Iter 221: loss 0.19333. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 46 Iter 222: loss 0.17231. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 46 Iter 222: loss 0.17231. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 46 Iter 223: loss 0.17352. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.06it/s]
Epoch 46 Iter 223: loss 0.17352. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.07it/s]
Epoch 46 Iter 224: loss 0.18388. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.07it/s]
Epoch 46 Iter 224: loss 0.18388. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.02it/s]
Epoch 46 Iter 224: loss 0.18388. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.17132. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 47 Iter 1: loss 0.17132. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 47 Iter 2: loss 0.15648. :   0%|▏                                              | 1/224 [00:00<01:46,  2.09it/s]
Epoch 47 Iter 2: loss 0.15648. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 47 Iter 3: loss 0.15926. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 47 Iter 3: loss 0.15926. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 47 Iter 4: loss 0.19294. :   1%|▋                                              | 3/224 [00:01<01:46,  2.07it/s]
Epoch 47 Iter 4: loss 0.19294. :   2%|▊                                              | 4/224 [00:01<01:47,  2.05it/s]
Epoch 47 Iter 5: loss 0.16967. :   2%|▊                                              | 4/224 [00:02<01:47,  2.05it/s]
Epoch 47 Iter 5: loss 0.16967. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 47 Iter 6: loss 0.17282. :   2%|█                                              | 5/224 [00:02<01:46,  2.06it/s]
Epoch 47 Iter 6: loss 0.17282. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 47 Iter 7: loss 0.17256. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 47 Iter 7: loss 0.17256. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 47 Iter 8: loss 0.16619. :   3%|█▍                                             | 7/224 [00:03<01:45,  2.06it/s]
Epoch 47 Iter 8: loss 0.16619. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.06it/s]
Epoch 47 Iter 9: loss 0.17540. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.06it/s]
Epoch 47 Iter 9: loss 0.17540. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 47 Iter 10: loss 0.17395. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 47 Iter 10: loss 0.17395. :   4%|██                                           | 10/224 [00:04<01:43,  2.06it/s]
Epoch 47 Iter 11: loss 0.15911. :   4%|██                                           | 10/224 [00:05<01:43,  2.06it/s]
Epoch 47 Iter 11: loss 0.15911. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 47 Iter 12: loss 0.18138. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.05it/s]
Epoch 47 Iter 12: loss 0.18138. :   5%|██▍                                          | 12/224 [00:05<01:43,  2.05it/s]
Epoch 47 Iter 13: loss 0.17096. :   5%|██▍                                          | 12/224 [00:06<01:43,  2.05it/s]
Epoch 47 Iter 13: loss 0.17096. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 47 Iter 14: loss 0.18322. :   6%|██▌                                          | 13/224 [00:06<01:43,  2.05it/s]
Epoch 47 Iter 14: loss 0.18322. :   6%|██▊                                          | 14/224 [00:06<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.17794. :   6%|██▊                                          | 14/224 [00:07<01:42,  2.05it/s]
Epoch 47 Iter 15: loss 0.17794. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 47 Iter 16: loss 0.15777. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 47 Iter 16: loss 0.15777. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.05it/s]
Epoch 47 Iter 17: loss 0.20045. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.05it/s]
Epoch 47 Iter 17: loss 0.20045. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 47 Iter 18: loss 0.17507. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 47 Iter 18: loss 0.17507. :   8%|███▌                                         | 18/224 [00:08<01:39,  2.07it/s]
Epoch 47 Iter 19: loss 0.16353. :   8%|███▌                                         | 18/224 [00:09<01:39,  2.07it/s]
Epoch 47 Iter 19: loss 0.16353. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 47 Iter 20: loss 0.17419. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.07it/s]
Epoch 47 Iter 20: loss 0.17419. :   9%|████                                         | 20/224 [00:09<01:38,  2.06it/s]
Epoch 47 Iter 21: loss 0.18673. :   9%|████                                         | 20/224 [00:10<01:38,  2.06it/s]
Epoch 47 Iter 21: loss 0.18673. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 47 Iter 22: loss 0.16758. :   9%|████▏                                        | 21/224 [00:10<01:39,  2.03it/s]
Epoch 47 Iter 22: loss 0.16758. :  10%|████▍                                        | 22/224 [00:10<01:39,  2.04it/s]
Epoch 47 Iter 23: loss 0.17827. :  10%|████▍                                        | 22/224 [00:11<01:39,  2.04it/s]
Epoch 47 Iter 23: loss 0.17827. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 47 Iter 24: loss 0.16689. :  10%|████▌                                        | 23/224 [00:11<01:38,  2.04it/s]
Epoch 47 Iter 24: loss 0.16689. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 47 Iter 25: loss 0.16453. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 47 Iter 25: loss 0.16453. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 26: loss 0.15132. :  11%|█████                                        | 25/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 26: loss 0.15132. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 47 Iter 27: loss 0.18485. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 47 Iter 27: loss 0.18485. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 47 Iter 28: loss 0.19066. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.06it/s]
Epoch 47 Iter 28: loss 0.19066. :  12%|█████▋                                       | 28/224 [00:13<01:34,  2.07it/s]
Epoch 47 Iter 29: loss 0.16436. :  12%|█████▋                                       | 28/224 [00:14<01:34,  2.07it/s]
Epoch 47 Iter 29: loss 0.16436. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 47 Iter 30: loss 0.16271. :  13%|█████▊                                       | 29/224 [00:14<01:34,  2.06it/s]
Epoch 47 Iter 30: loss 0.16271. :  13%|██████                                       | 30/224 [00:14<01:33,  2.07it/s]
Epoch 47 Iter 31: loss 0.16584. :  13%|██████                                       | 30/224 [00:15<01:33,  2.07it/s]
Epoch 47 Iter 31: loss 0.16584. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 47 Iter 32: loss 0.16483. :  14%|██████▏                                      | 31/224 [00:15<01:32,  2.08it/s]
Epoch 47 Iter 32: loss 0.16483. :  14%|██████▍                                      | 32/224 [00:15<01:32,  2.07it/s]
Epoch 47 Iter 33: loss 0.17855. :  14%|██████▍                                      | 32/224 [00:16<01:32,  2.07it/s]
Epoch 47 Iter 33: loss 0.17855. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 47 Iter 34: loss 0.17125. :  15%|██████▋                                      | 33/224 [00:16<01:31,  2.08it/s]
Epoch 47 Iter 34: loss 0.17125. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 47 Iter 35: loss 0.16644. :  15%|██████▊                                      | 34/224 [00:16<01:31,  2.07it/s]
Epoch 47 Iter 35: loss 0.16644. :  16%|███████                                      | 35/224 [00:16<01:31,  2.07it/s]
Epoch 47 Iter 36: loss 0.18952. :  16%|███████                                      | 35/224 [00:17<01:31,  2.07it/s]
Epoch 47 Iter 36: loss 0.18952. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 47 Iter 37: loss 0.19005. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.06it/s]
Epoch 47 Iter 37: loss 0.19005. :  17%|███████▍                                     | 37/224 [00:17<01:30,  2.07it/s]
Epoch 47 Iter 38: loss 0.18029. :  17%|███████▍                                     | 37/224 [00:18<01:30,  2.07it/s]
Epoch 47 Iter 38: loss 0.18029. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 47 Iter 39: loss 0.16847. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 47 Iter 39: loss 0.16847. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 47 Iter 40: loss 0.17718. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 47 Iter 40: loss 0.17718. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 47 Iter 41: loss 0.18305. :  18%|████████                                     | 40/224 [00:19<01:29,  2.07it/s]
Epoch 47 Iter 41: loss 0.18305. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 47 Iter 42: loss 0.16247. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 47 Iter 42: loss 0.16247. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 47 Iter 43: loss 0.17576. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 47 Iter 43: loss 0.17576. :  19%|████████▋                                    | 43/224 [00:20<01:27,  2.07it/s]
Epoch 47 Iter 44: loss 0.18557. :  19%|████████▋                                    | 43/224 [00:21<01:27,  2.07it/s]
Epoch 47 Iter 44: loss 0.18557. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 47 Iter 45: loss 0.17040. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.06it/s]
Epoch 47 Iter 45: loss 0.17040. :  20%|█████████                                    | 45/224 [00:21<01:26,  2.07it/s]
Epoch 47 Iter 46: loss 0.17598. :  20%|█████████                                    | 45/224 [00:22<01:26,  2.07it/s]
Epoch 47 Iter 46: loss 0.17598. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 47 Iter 47: loss 0.18889. :  21%|█████████▏                                   | 46/224 [00:22<01:25,  2.07it/s]
Epoch 47 Iter 47: loss 0.18889. :  21%|█████████▍                                   | 47/224 [00:22<01:25,  2.07it/s]
Epoch 47 Iter 48: loss 0.16248. :  21%|█████████▍                                   | 47/224 [00:23<01:25,  2.07it/s]
Epoch 47 Iter 48: loss 0.16248. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 47 Iter 49: loss 0.18246. :  21%|█████████▋                                   | 48/224 [00:23<01:24,  2.07it/s]
Epoch 47 Iter 49: loss 0.18246. :  22%|█████████▊                                   | 49/224 [00:23<01:24,  2.07it/s]
Epoch 47 Iter 50: loss 0.16514. :  22%|█████████▊                                   | 49/224 [00:24<01:24,  2.07it/s]
Epoch 47 Iter 50: loss 0.16514. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 47 Iter 51: loss 0.16946. :  22%|██████████                                   | 50/224 [00:24<01:24,  2.07it/s]
Epoch 47 Iter 51: loss 0.16946. :  23%|██████████▏                                  | 51/224 [00:24<01:23,  2.07it/s]
Epoch 47 Iter 52: loss 0.17567. :  23%|██████████▏                                  | 51/224 [00:25<01:23,  2.07it/s]
Epoch 47 Iter 52: loss 0.17567. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 47 Iter 53: loss 0.18649. :  23%|██████████▍                                  | 52/224 [00:25<01:23,  2.06it/s]
Epoch 47 Iter 53: loss 0.18649. :  24%|██████████▋                                  | 53/224 [00:25<01:22,  2.06it/s]
Epoch 47 Iter 54: loss 0.16473. :  24%|██████████▋                                  | 53/224 [00:26<01:22,  2.06it/s]
Epoch 47 Iter 54: loss 0.16473. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 47 Iter 55: loss 0.16487. :  24%|██████████▊                                  | 54/224 [00:26<01:21,  2.08it/s]
Epoch 47 Iter 55: loss 0.16487. :  25%|███████████                                  | 55/224 [00:26<01:21,  2.08it/s]
Epoch 47 Iter 56: loss 0.18008. :  25%|███████████                                  | 55/224 [00:27<01:21,  2.08it/s]
Epoch 47 Iter 56: loss 0.18008. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 47 Iter 57: loss 0.19208. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.07it/s]
Epoch 47 Iter 57: loss 0.19208. :  25%|███████████▍                                 | 57/224 [00:27<01:20,  2.07it/s]
Epoch 47 Iter 58: loss 0.13490. :  25%|███████████▍                                 | 57/224 [00:28<01:20,  2.07it/s]
Epoch 47 Iter 58: loss 0.13490. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 47 Iter 59: loss 0.16481. :  26%|███████████▋                                 | 58/224 [00:28<01:19,  2.08it/s]
Epoch 47 Iter 59: loss 0.16481. :  26%|███████████▊                                 | 59/224 [00:28<01:19,  2.08it/s]
Epoch 47 Iter 60: loss 0.16565. :  26%|███████████▊                                 | 59/224 [00:29<01:19,  2.08it/s]
Epoch 47 Iter 60: loss 0.16565. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 47 Iter 61: loss 0.14836. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.07it/s]
Epoch 47 Iter 61: loss 0.14836. :  27%|████████████▎                                | 61/224 [00:29<01:18,  2.08it/s]
Epoch 47 Iter 62: loss 0.18689. :  27%|████████████▎                                | 61/224 [00:30<01:18,  2.08it/s]
Epoch 47 Iter 62: loss 0.18689. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 47 Iter 63: loss 0.18408. :  28%|████████████▍                                | 62/224 [00:30<01:18,  2.07it/s]
Epoch 47 Iter 63: loss 0.18408. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 47 Iter 64: loss 0.18869. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 47 Iter 64: loss 0.18869. :  29%|████████████▊                                | 64/224 [00:30<01:16,  2.08it/s]
Epoch 47 Iter 65: loss 0.18768. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 47 Iter 65: loss 0.18768. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 47 Iter 66: loss 0.16195. :  29%|█████████████                                | 65/224 [00:31<01:16,  2.08it/s]
Epoch 47 Iter 66: loss 0.16195. :  29%|█████████████▎                               | 66/224 [00:31<01:16,  2.07it/s]
Epoch 47 Iter 67: loss 0.15942. :  29%|█████████████▎                               | 66/224 [00:32<01:16,  2.07it/s]
Epoch 47 Iter 67: loss 0.15942. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 47 Iter 68: loss 0.16483. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 47 Iter 68: loss 0.16483. :  30%|█████████████▋                               | 68/224 [00:32<01:15,  2.06it/s]
Epoch 47 Iter 69: loss 0.15156. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.06it/s]
Epoch 47 Iter 69: loss 0.15156. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 47 Iter 70: loss 0.15605. :  31%|█████████████▊                               | 69/224 [00:33<01:14,  2.07it/s]
Epoch 47 Iter 70: loss 0.15605. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.07it/s]
Epoch 47 Iter 71: loss 0.18430. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.07it/s]
Epoch 47 Iter 71: loss 0.18430. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 72: loss 0.17141. :  32%|██████████████▎                              | 71/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 72: loss 0.17141. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.07it/s]
Epoch 47 Iter 73: loss 0.17555. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 73: loss 0.17555. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 74: loss 0.18426. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 47 Iter 74: loss 0.18426. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.07it/s]
Epoch 47 Iter 75: loss 0.16565. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.07it/s]
Epoch 47 Iter 75: loss 0.16565. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 47 Iter 76: loss 0.17210. :  33%|███████████████                              | 75/224 [00:36<01:11,  2.09it/s]
Epoch 47 Iter 76: loss 0.17210. :  34%|███████████████▎                             | 76/224 [00:36<01:10,  2.09it/s]
Epoch 47 Iter 77: loss 0.15836. :  34%|███████████████▎                             | 76/224 [00:37<01:10,  2.09it/s]
Epoch 47 Iter 77: loss 0.15836. :  34%|███████████████▍                             | 77/224 [00:37<01:09,  2.10it/s]
Epoch 47 Iter 78: loss 0.19468. :  34%|███████████████▍                             | 77/224 [00:37<01:09,  2.10it/s]
Epoch 47 Iter 78: loss 0.19468. :  35%|███████████████▋                             | 78/224 [00:37<01:09,  2.09it/s]
Epoch 47 Iter 79: loss 0.18681. :  35%|███████████████▋                             | 78/224 [00:38<01:09,  2.09it/s]
Epoch 47 Iter 79: loss 0.18681. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 47 Iter 80: loss 0.16091. :  35%|███████████████▊                             | 79/224 [00:38<01:10,  2.07it/s]
Epoch 47 Iter 80: loss 0.16091. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 47 Iter 81: loss 0.18955. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 81: loss 0.18955. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.18066. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.07it/s]
Epoch 47 Iter 82: loss 0.18066. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 47 Iter 83: loss 0.17711. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 47 Iter 83: loss 0.17711. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 47 Iter 84: loss 0.16443. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.05it/s]
Epoch 47 Iter 84: loss 0.16443. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 47 Iter 85: loss 0.20010. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 85: loss 0.20010. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 86: loss 0.17500. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.07it/s]
Epoch 47 Iter 86: loss 0.17500. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.07it/s]
Epoch 47 Iter 87: loss 0.19431. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 87: loss 0.19431. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 88: loss 0.16296. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 47 Iter 88: loss 0.16296. :  39%|█████████████████▋                           | 88/224 [00:42<01:05,  2.07it/s]
Epoch 47 Iter 89: loss 0.18523. :  39%|█████████████████▋                           | 88/224 [00:43<01:05,  2.07it/s]
Epoch 47 Iter 89: loss 0.18523. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 47 Iter 90: loss 0.15136. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.08it/s]
Epoch 47 Iter 90: loss 0.15136. :  40%|██████████████████                           | 90/224 [00:43<01:04,  2.07it/s]
Epoch 47 Iter 91: loss 0.17679. :  40%|██████████████████                           | 90/224 [00:44<01:04,  2.07it/s]
Epoch 47 Iter 91: loss 0.17679. :  41%|██████████████████▎                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 47 Iter 92: loss 0.16506. :  41%|██████████████████▎                          | 91/224 [00:44<01:03,  2.08it/s]
Epoch 47 Iter 92: loss 0.16506. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 47 Iter 93: loss 0.18203. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.08it/s]
Epoch 47 Iter 93: loss 0.18203. :  42%|██████████████████▋                          | 93/224 [00:44<01:02,  2.10it/s]
Epoch 47 Iter 94: loss 0.16480. :  42%|██████████████████▋                          | 93/224 [00:45<01:02,  2.10it/s]
Epoch 47 Iter 94: loss 0.16480. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.09it/s]
Epoch 47 Iter 95: loss 0.17441. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.09it/s]
Epoch 47 Iter 95: loss 0.17441. :  42%|███████████████████                          | 95/224 [00:45<01:01,  2.09it/s]
Epoch 47 Iter 96: loss 0.19253. :  42%|███████████████████                          | 95/224 [00:46<01:01,  2.09it/s]
Epoch 47 Iter 96: loss 0.19253. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 47 Iter 97: loss 0.16963. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 47 Iter 97: loss 0.16963. :  43%|███████████████████▍                         | 97/224 [00:46<01:01,  2.07it/s]
Epoch 47 Iter 98: loss 0.16928. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 47 Iter 98: loss 0.16928. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 47 Iter 99: loss 0.16520. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.07it/s]
Epoch 47 Iter 99: loss 0.16520. :  44%|███████████████████▉                         | 99/224 [00:47<01:00,  2.07it/s]
Epoch 47 Iter 100: loss 0.18141. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.07it/s]
Epoch 47 Iter 100: loss 0.18141. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 47 Iter 101: loss 0.19061. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.07it/s]
Epoch 47 Iter 101: loss 0.19061. :  45%|███████████████████▍                       | 101/224 [00:48<00:59,  2.08it/s]
Epoch 47 Iter 102: loss 0.16075. :  45%|███████████████████▍                       | 101/224 [00:49<00:59,  2.08it/s]
Epoch 47 Iter 102: loss 0.16075. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 47 Iter 103: loss 0.18817. :  46%|███████████████████▌                       | 102/224 [00:49<00:59,  2.07it/s]
Epoch 47 Iter 103: loss 0.18817. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.08it/s]
Epoch 47 Iter 104: loss 0.16942. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.08it/s]
Epoch 47 Iter 104: loss 0.16942. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 47 Iter 105: loss 0.17117. :  46%|███████████████████▉                       | 104/224 [00:50<00:57,  2.07it/s]
Epoch 47 Iter 105: loss 0.17117. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 47 Iter 106: loss 0.17627. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 47 Iter 106: loss 0.17627. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 47 Iter 107: loss 0.16810. :  47%|████████████████████▎                      | 106/224 [00:51<00:56,  2.08it/s]
Epoch 47 Iter 107: loss 0.16810. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.07it/s]
Epoch 47 Iter 108: loss 0.17178. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.07it/s]
Epoch 47 Iter 108: loss 0.17178. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.16739. :  48%|████████████████████▋                      | 108/224 [00:52<00:56,  2.06it/s]
Epoch 47 Iter 109: loss 0.16739. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.05it/s]
Epoch 47 Iter 110: loss 0.16323. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 110: loss 0.16323. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 47 Iter 111: loss 0.18673. :  49%|█████████████████████                      | 110/224 [00:53<00:55,  2.06it/s]
Epoch 47 Iter 111: loss 0.18673. :  50%|█████████████████████▎                     | 111/224 [00:53<00:55,  2.05it/s]
Epoch 47 Iter 112: loss 0.18743. :  50%|█████████████████████▎                     | 111/224 [00:54<00:55,  2.05it/s]
Epoch 47 Iter 112: loss 0.18743. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 47 Iter 113: loss 0.17066. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.06it/s]
Epoch 47 Iter 113: loss 0.17066. :  50%|█████████████████████▋                     | 113/224 [00:54<00:54,  2.05it/s]
Epoch 47 Iter 114: loss 0.15007. :  50%|█████████████████████▋                     | 113/224 [00:55<00:54,  2.05it/s]
Epoch 47 Iter 114: loss 0.15007. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.17534. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 47 Iter 115: loss 0.17534. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 47 Iter 116: loss 0.18004. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 47 Iter 116: loss 0.18004. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 117: loss 0.18528. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.06it/s]
Epoch 47 Iter 117: loss 0.18528. :  52%|██████████████████████▍                    | 117/224 [00:56<00:51,  2.07it/s]
Epoch 47 Iter 118: loss 0.18572. :  52%|██████████████████████▍                    | 117/224 [00:57<00:51,  2.07it/s]
Epoch 47 Iter 118: loss 0.18572. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 119: loss 0.17902. :  53%|██████████████████████▋                    | 118/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 119: loss 0.17902. :  53%|██████████████████████▊                    | 119/224 [00:57<00:50,  2.09it/s]
Epoch 47 Iter 120: loss 0.16075. :  53%|██████████████████████▊                    | 119/224 [00:58<00:50,  2.09it/s]
Epoch 47 Iter 120: loss 0.16075. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 47 Iter 121: loss 0.18167. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.08it/s]
Epoch 47 Iter 121: loss 0.18167. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 47 Iter 122: loss 0.19117. :  54%|███████████████████████▏                   | 121/224 [00:58<00:49,  2.07it/s]
Epoch 47 Iter 122: loss 0.19117. :  54%|███████████████████████▍                   | 122/224 [00:58<00:49,  2.07it/s]
Epoch 47 Iter 123: loss 0.19182. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 47 Iter 123: loss 0.19182. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 47 Iter 124: loss 0.16198. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 47 Iter 124: loss 0.16198. :  55%|███████████████████████▊                   | 124/224 [00:59<00:48,  2.05it/s]
Epoch 47 Iter 125: loss 0.18658. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.05it/s]
Epoch 47 Iter 125: loss 0.18658. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 126: loss 0.16137. :  56%|███████████████████████▉                   | 125/224 [01:00<00:48,  2.06it/s]
Epoch 47 Iter 126: loss 0.16137. :  56%|████████████████████████▏                  | 126/224 [01:00<00:47,  2.05it/s]
Epoch 47 Iter 127: loss 0.15791. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.05it/s]
Epoch 47 Iter 127: loss 0.15791. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 47 Iter 128: loss 0.17521. :  57%|████████████████████████▍                  | 127/224 [01:01<00:47,  2.05it/s]
Epoch 47 Iter 128: loss 0.17521. :  57%|████████████████████████▌                  | 128/224 [01:01<00:46,  2.07it/s]
Epoch 47 Iter 129: loss 0.18761. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 47 Iter 129: loss 0.18761. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 47 Iter 130: loss 0.16050. :  58%|████████████████████████▊                  | 129/224 [01:02<00:46,  2.06it/s]
Epoch 47 Iter 130: loss 0.16050. :  58%|████████████████████████▉                  | 130/224 [01:02<00:45,  2.06it/s]
Epoch 47 Iter 131: loss 0.16975. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.06it/s]
Epoch 47 Iter 131: loss 0.16975. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 47 Iter 132: loss 0.16893. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.08it/s]
Epoch 47 Iter 132: loss 0.16893. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.08it/s]
Epoch 47 Iter 133: loss 0.15992. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.08it/s]
Epoch 47 Iter 133: loss 0.15992. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 47 Iter 134: loss 0.18245. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:43,  2.07it/s]
Epoch 47 Iter 134: loss 0.18245. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.05it/s]
Epoch 47 Iter 135: loss 0.16909. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 135: loss 0.16909. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 136: loss 0.16103. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:43,  2.05it/s]
Epoch 47 Iter 136: loss 0.16103. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.06it/s]
Epoch 47 Iter 137: loss 0.18885. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.06it/s]
Epoch 47 Iter 137: loss 0.18885. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 47 Iter 138: loss 0.15228. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 47 Iter 138: loss 0.15228. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.07it/s]
Epoch 47 Iter 139: loss 0.18021. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.07it/s]
Epoch 47 Iter 139: loss 0.18021. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 47 Iter 140: loss 0.18841. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.06it/s]
Epoch 47 Iter 140: loss 0.18841. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.07it/s]
Epoch 47 Iter 141: loss 0.14688. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 141: loss 0.14688. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 142: loss 0.19338. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 47 Iter 142: loss 0.19338. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.06it/s]
Epoch 47 Iter 143: loss 0.16184. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 143: loss 0.16184. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 144: loss 0.16944. :  64%|███████████████████████████▍               | 143/224 [01:09<00:39,  2.06it/s]
Epoch 47 Iter 144: loss 0.16944. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.07it/s]
Epoch 47 Iter 145: loss 0.18399. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.07it/s]
Epoch 47 Iter 145: loss 0.18399. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 47 Iter 146: loss 0.17146. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.06it/s]
Epoch 47 Iter 146: loss 0.17146. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.08it/s]
Epoch 47 Iter 147: loss 0.16885. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.08it/s]
Epoch 47 Iter 147: loss 0.16885. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 47 Iter 148: loss 0.17134. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.07it/s]
Epoch 47 Iter 148: loss 0.17134. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.07it/s]
Epoch 47 Iter 149: loss 0.17504. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.07it/s]
Epoch 47 Iter 149: loss 0.17504. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 47 Iter 150: loss 0.16588. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 47 Iter 150: loss 0.16588. :  67%|████████████████████████████▊              | 150/224 [01:12<00:35,  2.06it/s]
Epoch 47 Iter 151: loss 0.16677. :  67%|████████████████████████████▊              | 150/224 [01:13<00:35,  2.06it/s]
Epoch 47 Iter 151: loss 0.16677. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 47 Iter 152: loss 0.15316. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 47 Iter 152: loss 0.15316. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 47 Iter 153: loss 0.17764. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 47 Iter 153: loss 0.17764. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 47 Iter 154: loss 0.16912. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 47 Iter 154: loss 0.16912. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 47 Iter 155: loss 0.16383. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 47 Iter 155: loss 0.16383. :  69%|█████████████████████████████▊             | 155/224 [01:14<00:33,  2.07it/s]
Epoch 47 Iter 156: loss 0.15937. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 47 Iter 156: loss 0.15937. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 47 Iter 157: loss 0.15987. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.06it/s]
Epoch 47 Iter 157: loss 0.15987. :  70%|██████████████████████████████▏            | 157/224 [01:15<00:32,  2.06it/s]
Epoch 47 Iter 158: loss 0.17228. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.06it/s]
Epoch 47 Iter 158: loss 0.17228. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 47 Iter 159: loss 0.17026. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 47 Iter 159: loss 0.17026. :  71%|██████████████████████████████▌            | 159/224 [01:16<00:31,  2.06it/s]
Epoch 47 Iter 160: loss 0.18377. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 160: loss 0.18377. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.16896. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:31,  2.06it/s]
Epoch 47 Iter 161: loss 0.16896. :  72%|██████████████████████████████▉            | 161/224 [01:17<00:30,  2.06it/s]
Epoch 47 Iter 162: loss 0.18969. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 47 Iter 162: loss 0.18969. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 47 Iter 163: loss 0.16307. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.06it/s]
Epoch 47 Iter 163: loss 0.16307. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 47 Iter 164: loss 0.17371. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 47 Iter 164: loss 0.17371. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 47 Iter 165: loss 0.17185. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 47 Iter 165: loss 0.17185. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 47 Iter 166: loss 0.15921. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 47 Iter 166: loss 0.15921. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 47 Iter 167: loss 0.17600. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:28,  2.07it/s]
Epoch 47 Iter 167: loss 0.17600. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.06it/s]
Epoch 47 Iter 168: loss 0.19505. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.06it/s]
Epoch 47 Iter 168: loss 0.19505. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 47 Iter 169: loss 0.16363. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.07it/s]
Epoch 47 Iter 169: loss 0.16363. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.06it/s]
Epoch 47 Iter 170: loss 0.16998. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.06it/s]
Epoch 47 Iter 170: loss 0.16998. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 47 Iter 171: loss 0.16759. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.06it/s]
Epoch 47 Iter 171: loss 0.16759. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 47 Iter 172: loss 0.17404. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 47 Iter 172: loss 0.17404. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 47 Iter 173: loss 0.16892. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.08it/s]
Epoch 47 Iter 173: loss 0.16892. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.08it/s]
Epoch 47 Iter 174: loss 0.16980. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.08it/s]
Epoch 47 Iter 174: loss 0.16980. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 47 Iter 175: loss 0.16482. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 47 Iter 175: loss 0.16482. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 47 Iter 176: loss 0.18521. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 47 Iter 176: loss 0.18521. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 47 Iter 177: loss 0.16823. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.07it/s]
Epoch 47 Iter 177: loss 0.16823. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.08it/s]
Epoch 47 Iter 178: loss 0.19899. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.08it/s]
Epoch 47 Iter 178: loss 0.19899. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 47 Iter 179: loss 0.15320. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.07it/s]
Epoch 47 Iter 179: loss 0.15320. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.07it/s]
Epoch 47 Iter 180: loss 0.18281. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.07it/s]
Epoch 47 Iter 180: loss 0.18281. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.09it/s]
Epoch 47 Iter 181: loss 0.16573. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.09it/s]
Epoch 47 Iter 181: loss 0.16573. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:20,  2.09it/s]
Epoch 47 Iter 182: loss 0.15433. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:20,  2.09it/s]
Epoch 47 Iter 182: loss 0.15433. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 47 Iter 183: loss 0.18878. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.07it/s]
Epoch 47 Iter 183: loss 0.18878. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 47 Iter 184: loss 0.18824. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.08it/s]
Epoch 47 Iter 184: loss 0.18824. :  82%|███████████████████████████████████▎       | 184/224 [01:28<00:19,  2.09it/s]
Epoch 47 Iter 185: loss 0.17536. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.09it/s]
Epoch 47 Iter 185: loss 0.17536. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 47 Iter 186: loss 0.17741. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.08it/s]
Epoch 47 Iter 186: loss 0.17741. :  83%|███████████████████████████████████▋       | 186/224 [01:29<00:18,  2.07it/s]
Epoch 47 Iter 187: loss 0.17315. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 47 Iter 187: loss 0.17315. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.17701. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.06it/s]
Epoch 47 Iter 188: loss 0.17701. :  84%|████████████████████████████████████       | 188/224 [01:30<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.17041. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.06it/s]
Epoch 47 Iter 189: loss 0.17041. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.16127. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 47 Iter 190: loss 0.16127. :  85%|████████████████████████████████████▍      | 190/224 [01:31<00:16,  2.06it/s]
Epoch 47 Iter 191: loss 0.18802. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.06it/s]
Epoch 47 Iter 191: loss 0.18802. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 47 Iter 192: loss 0.17449. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:16,  2.05it/s]
Epoch 47 Iter 192: loss 0.17449. :  86%|████████████████████████████████████▊      | 192/224 [01:32<00:15,  2.05it/s]
Epoch 47 Iter 193: loss 0.16091. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.05it/s]
Epoch 47 Iter 193: loss 0.16091. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 194: loss 0.16943. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:15,  2.06it/s]
Epoch 47 Iter 194: loss 0.16943. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 47 Iter 195: loss 0.18072. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 47 Iter 195: loss 0.18072. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 47 Iter 196: loss 0.17299. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.05it/s]
Epoch 47 Iter 196: loss 0.17299. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.05it/s]
Epoch 47 Iter 197: loss 0.16714. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.05it/s]
Epoch 47 Iter 197: loss 0.16714. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 47 Iter 198: loss 0.17845. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 47 Iter 198: loss 0.17845. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.06it/s]
Epoch 47 Iter 199: loss 0.18940. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.06it/s]
Epoch 47 Iter 199: loss 0.18940. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.17168. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.07it/s]
Epoch 47 Iter 200: loss 0.17168. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 47 Iter 201: loss 0.17929. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 201: loss 0.17929. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.18405. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.06it/s]
Epoch 47 Iter 202: loss 0.18405. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 47 Iter 203: loss 0.16505. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 47 Iter 203: loss 0.16505. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.17671. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.07it/s]
Epoch 47 Iter 204: loss 0.17671. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.17026. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.06it/s]
Epoch 47 Iter 205: loss 0.17026. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 47 Iter 206: loss 0.17051. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 47 Iter 206: loss 0.17051. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.09it/s]
Epoch 47 Iter 207: loss 0.19297. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.09it/s]
Epoch 47 Iter 207: loss 0.19297. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 47 Iter 208: loss 0.18242. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.09it/s]
Epoch 47 Iter 208: loss 0.18242. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.09it/s]
Epoch 47 Iter 209: loss 0.17788. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.09it/s]
Epoch 47 Iter 209: loss 0.17788. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.10it/s]
Epoch 47 Iter 210: loss 0.19048. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.10it/s]
Epoch 47 Iter 210: loss 0.19048. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.11it/s]
Epoch 47 Iter 211: loss 0.17009. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.11it/s]
Epoch 47 Iter 211: loss 0.17009. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.10it/s]
Epoch 47 Iter 212: loss 0.16492. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.10it/s]
Epoch 47 Iter 212: loss 0.16492. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.09it/s]
Epoch 47 Iter 213: loss 0.18523. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.09it/s]
Epoch 47 Iter 213: loss 0.18523. :  95%|████████████████████████████████████████▉  | 213/224 [01:42<00:05,  2.07it/s]
Epoch 47 Iter 214: loss 0.17587. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 47 Iter 214: loss 0.17587. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 47 Iter 215: loss 0.16361. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 47 Iter 215: loss 0.16361. :  96%|█████████████████████████████████████████▎ | 215/224 [01:43<00:04,  2.07it/s]
Epoch 47 Iter 216: loss 0.16778. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.07it/s]
Epoch 47 Iter 216: loss 0.16778. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 47 Iter 217: loss 0.17877. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.07it/s]
Epoch 47 Iter 217: loss 0.17877. :  97%|█████████████████████████████████████████▋ | 217/224 [01:44<00:03,  2.07it/s]
Epoch 47 Iter 218: loss 0.16398. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 47 Iter 218: loss 0.16398. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 47 Iter 219: loss 0.17634. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 47 Iter 219: loss 0.17634. :  98%|██████████████████████████████████████████ | 219/224 [01:45<00:02,  2.07it/s]
Epoch 47 Iter 220: loss 0.19985. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 47 Iter 220: loss 0.19985. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 47 Iter 221: loss 0.18079. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 47 Iter 221: loss 0.18079. :  99%|██████████████████████████████████████████▍| 221/224 [01:46<00:01,  2.06it/s]
Epoch 47 Iter 222: loss 0.19196. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.06it/s]
Epoch 47 Iter 222: loss 0.19196. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.17530. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.05it/s]
Epoch 47 Iter 223: loss 0.17530. : 100%|██████████████████████████████████████████▊| 223/224 [01:47<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.17033. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.06it/s]
Epoch 47 Iter 224: loss 0.17033. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.05it/s]
Epoch 47 Iter 224: loss 0.17033. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.07it/s]

    Train loss: 0.17363
    Valid loss: 0.17952
       Valid loss recons: 0.173
       Valid loss KL-D:   65.28997
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.15807. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 48 Iter 1: loss 0.15807. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 48 Iter 2: loss 0.14749. :   0%|▏                                              | 1/224 [00:00<01:48,  2.05it/s]
Epoch 48 Iter 2: loss 0.14749. :   1%|▍                                              | 2/224 [00:00<01:47,  2.06it/s]
Epoch 48 Iter 3: loss 0.17339. :   1%|▍                                              | 2/224 [00:01<01:47,  2.06it/s]
Epoch 48 Iter 3: loss 0.17339. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 48 Iter 4: loss 0.15175. :   1%|▋                                              | 3/224 [00:01<01:46,  2.08it/s]
Epoch 48 Iter 4: loss 0.15175. :   2%|▊                                              | 4/224 [00:01<01:46,  2.06it/s]
Epoch 48 Iter 5: loss 0.16809. :   2%|▊                                              | 4/224 [00:02<01:46,  2.06it/s]
Epoch 48 Iter 5: loss 0.16809. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 48 Iter 6: loss 0.17304. :   2%|█                                              | 5/224 [00:02<01:46,  2.05it/s]
Epoch 48 Iter 6: loss 0.17304. :   3%|█▎                                             | 6/224 [00:02<01:45,  2.06it/s]
Epoch 48 Iter 7: loss 0.16327. :   3%|█▎                                             | 6/224 [00:03<01:45,  2.06it/s]
Epoch 48 Iter 7: loss 0.16327. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 8: loss 0.17218. :   3%|█▍                                             | 7/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 8: loss 0.17218. :   4%|█▋                                             | 8/224 [00:03<01:44,  2.07it/s]
Epoch 48 Iter 9: loss 0.17187. :   4%|█▋                                             | 8/224 [00:04<01:44,  2.07it/s]
Epoch 48 Iter 9: loss 0.17187. :   4%|█▉                                             | 9/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 10: loss 0.16201. :   4%|█▊                                            | 9/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 10: loss 0.16201. :   4%|██                                           | 10/224 [00:04<01:43,  2.07it/s]
Epoch 48 Iter 11: loss 0.17388. :   4%|██                                           | 10/224 [00:05<01:43,  2.07it/s]
Epoch 48 Iter 11: loss 0.17388. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 48 Iter 12: loss 0.17611. :   5%|██▏                                          | 11/224 [00:05<01:42,  2.08it/s]
Epoch 48 Iter 12: loss 0.17611. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 48 Iter 13: loss 0.17813. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 48 Iter 13: loss 0.17813. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 48 Iter 14: loss 0.16501. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.07it/s]
Epoch 48 Iter 14: loss 0.16501. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 48 Iter 15: loss 0.16154. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 48 Iter 15: loss 0.16154. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 48 Iter 16: loss 0.16281. :   7%|███                                          | 15/224 [00:07<01:41,  2.06it/s]
Epoch 48 Iter 16: loss 0.16281. :   7%|███▏                                         | 16/224 [00:07<01:40,  2.06it/s]
Epoch 48 Iter 17: loss 0.17672. :   7%|███▏                                         | 16/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 17: loss 0.17672. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.17277. :   8%|███▍                                         | 17/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 18: loss 0.17277. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 48 Iter 19: loss 0.20910. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 48 Iter 19: loss 0.20910. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 48 Iter 20: loss 0.16756. :   8%|███▊                                         | 19/224 [00:09<01:39,  2.06it/s]
Epoch 48 Iter 20: loss 0.16756. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 48 Iter 21: loss 0.19374. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 48 Iter 21: loss 0.19374. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 48 Iter 22: loss 0.17974. :   9%|████▏                                        | 21/224 [00:10<01:38,  2.06it/s]
Epoch 48 Iter 22: loss 0.17974. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.06it/s]
Epoch 48 Iter 23: loss 0.18041. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.06it/s]
Epoch 48 Iter 23: loss 0.18041. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 48 Iter 24: loss 0.18985. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.07it/s]
Epoch 48 Iter 24: loss 0.18985. :  11%|████▊                                        | 24/224 [00:11<01:36,  2.07it/s]
Epoch 48 Iter 25: loss 0.17847. :  11%|████▊                                        | 24/224 [00:12<01:36,  2.07it/s]
Epoch 48 Iter 25: loss 0.17847. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 48 Iter 26: loss 0.15730. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 48 Iter 26: loss 0.15730. :  12%|█████▏                                       | 26/224 [00:12<01:36,  2.06it/s]
Epoch 48 Iter 27: loss 0.18077. :  12%|█████▏                                       | 26/224 [00:13<01:36,  2.06it/s]
Epoch 48 Iter 27: loss 0.18077. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 48 Iter 28: loss 0.15970. :  12%|█████▍                                       | 27/224 [00:13<01:35,  2.07it/s]
Epoch 48 Iter 28: loss 0.15970. :  12%|█████▋                                       | 28/224 [00:13<01:35,  2.06it/s]
Epoch 48 Iter 29: loss 0.16149. :  12%|█████▋                                       | 28/224 [00:14<01:35,  2.06it/s]
Epoch 48 Iter 29: loss 0.16149. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 48 Iter 30: loss 0.16093. :  13%|█████▊                                       | 29/224 [00:14<01:35,  2.04it/s]
Epoch 48 Iter 30: loss 0.16093. :  13%|██████                                       | 30/224 [00:14<01:34,  2.05it/s]
Epoch 48 Iter 31: loss 0.15147. :  13%|██████                                       | 30/224 [00:15<01:34,  2.05it/s]
Epoch 48 Iter 31: loss 0.15147. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 48 Iter 32: loss 0.18173. :  14%|██████▏                                      | 31/224 [00:15<01:34,  2.05it/s]
Epoch 48 Iter 32: loss 0.18173. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 48 Iter 33: loss 0.18353. :  14%|██████▍                                      | 32/224 [00:15<01:33,  2.05it/s]
Epoch 48 Iter 33: loss 0.18353. :  15%|██████▋                                      | 33/224 [00:15<01:32,  2.06it/s]
Epoch 48 Iter 34: loss 0.17647. :  15%|██████▋                                      | 33/224 [00:16<01:32,  2.06it/s]
Epoch 48 Iter 34: loss 0.17647. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 48 Iter 35: loss 0.17477. :  15%|██████▊                                      | 34/224 [00:16<01:32,  2.05it/s]
Epoch 48 Iter 35: loss 0.17477. :  16%|███████                                      | 35/224 [00:16<01:31,  2.06it/s]
Epoch 48 Iter 36: loss 0.16460. :  16%|███████                                      | 35/224 [00:17<01:31,  2.06it/s]
Epoch 48 Iter 36: loss 0.16460. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 48 Iter 37: loss 0.18652. :  16%|███████▏                                     | 36/224 [00:17<01:31,  2.05it/s]
Epoch 48 Iter 37: loss 0.18652. :  17%|███████▍                                     | 37/224 [00:17<01:31,  2.05it/s]
Epoch 48 Iter 38: loss 0.15074. :  17%|███████▍                                     | 37/224 [00:18<01:31,  2.05it/s]
Epoch 48 Iter 38: loss 0.15074. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 48 Iter 39: loss 0.18801. :  17%|███████▋                                     | 38/224 [00:18<01:30,  2.06it/s]
Epoch 48 Iter 39: loss 0.18801. :  17%|███████▊                                     | 39/224 [00:18<01:29,  2.06it/s]
Epoch 48 Iter 40: loss 0.16254. :  17%|███████▊                                     | 39/224 [00:19<01:29,  2.06it/s]
Epoch 48 Iter 40: loss 0.16254. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 48 Iter 41: loss 0.17327. :  18%|████████                                     | 40/224 [00:19<01:28,  2.08it/s]
Epoch 48 Iter 41: loss 0.17327. :  18%|████████▏                                    | 41/224 [00:19<01:28,  2.07it/s]
Epoch 48 Iter 42: loss 0.19871. :  18%|████████▏                                    | 41/224 [00:20<01:28,  2.07it/s]
Epoch 48 Iter 42: loss 0.19871. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 48 Iter 43: loss 0.14967. :  19%|████████▍                                    | 42/224 [00:20<01:28,  2.06it/s]
Epoch 48 Iter 43: loss 0.14967. :  19%|████████▋                                    | 43/224 [00:20<01:28,  2.06it/s]
Epoch 48 Iter 44: loss 0.17564. :  19%|████████▋                                    | 43/224 [00:21<01:28,  2.06it/s]
Epoch 48 Iter 44: loss 0.17564. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 48 Iter 45: loss 0.17514. :  20%|████████▊                                    | 44/224 [00:21<01:27,  2.05it/s]
Epoch 48 Iter 45: loss 0.17514. :  20%|█████████                                    | 45/224 [00:21<01:28,  2.03it/s]
Epoch 48 Iter 46: loss 0.18450. :  20%|█████████                                    | 45/224 [00:22<01:28,  2.03it/s]
Epoch 48 Iter 46: loss 0.18450. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 48 Iter 47: loss 0.16311. :  21%|█████████▏                                   | 46/224 [00:22<01:27,  2.04it/s]
Epoch 48 Iter 47: loss 0.16311. :  21%|█████████▍                                   | 47/224 [00:22<01:26,  2.04it/s]
Epoch 48 Iter 48: loss 0.16625. :  21%|█████████▍                                   | 47/224 [00:23<01:26,  2.04it/s]
Epoch 48 Iter 48: loss 0.16625. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 48 Iter 49: loss 0.17451. :  21%|█████████▋                                   | 48/224 [00:23<01:26,  2.03it/s]
Epoch 48 Iter 49: loss 0.17451. :  22%|█████████▊                                   | 49/224 [00:23<01:25,  2.04it/s]
Epoch 48 Iter 50: loss 0.15978. :  22%|█████████▊                                   | 49/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 50: loss 0.15978. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 51: loss 0.17302. :  22%|██████████                                   | 50/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 51: loss 0.17302. :  23%|██████████▏                                  | 51/224 [00:24<01:25,  2.04it/s]
Epoch 48 Iter 52: loss 0.18860. :  23%|██████████▏                                  | 51/224 [00:25<01:25,  2.04it/s]
Epoch 48 Iter 52: loss 0.18860. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 48 Iter 53: loss 0.16746. :  23%|██████████▍                                  | 52/224 [00:25<01:24,  2.04it/s]
Epoch 48 Iter 53: loss 0.16746. :  24%|██████████▋                                  | 53/224 [00:25<01:23,  2.05it/s]
Epoch 48 Iter 54: loss 0.16396. :  24%|██████████▋                                  | 53/224 [00:26<01:23,  2.05it/s]
Epoch 48 Iter 54: loss 0.16396. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 48 Iter 55: loss 0.18352. :  24%|██████████▊                                  | 54/224 [00:26<01:23,  2.04it/s]
Epoch 48 Iter 55: loss 0.18352. :  25%|███████████                                  | 55/224 [00:26<01:22,  2.05it/s]
Epoch 48 Iter 56: loss 0.19999. :  25%|███████████                                  | 55/224 [00:27<01:22,  2.05it/s]
Epoch 48 Iter 56: loss 0.19999. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 48 Iter 57: loss 0.17540. :  25%|███████████▎                                 | 56/224 [00:27<01:21,  2.06it/s]
Epoch 48 Iter 57: loss 0.17540. :  25%|███████████▍                                 | 57/224 [00:27<01:21,  2.04it/s]
Epoch 48 Iter 58: loss 0.18037. :  25%|███████████▍                                 | 57/224 [00:28<01:21,  2.04it/s]
Epoch 48 Iter 58: loss 0.18037. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 48 Iter 59: loss 0.19436. :  26%|███████████▋                                 | 58/224 [00:28<01:21,  2.04it/s]
Epoch 48 Iter 59: loss 0.19436. :  26%|███████████▊                                 | 59/224 [00:28<01:20,  2.06it/s]
Epoch 48 Iter 60: loss 0.15947. :  26%|███████████▊                                 | 59/224 [00:29<01:20,  2.06it/s]
Epoch 48 Iter 60: loss 0.15947. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 48 Iter 61: loss 0.17957. :  27%|████████████                                 | 60/224 [00:29<01:19,  2.06it/s]
Epoch 48 Iter 61: loss 0.17957. :  27%|████████████▎                                | 61/224 [00:29<01:19,  2.06it/s]
Epoch 48 Iter 62: loss 0.16790. :  27%|████████████▎                                | 61/224 [00:30<01:19,  2.06it/s]
Epoch 48 Iter 62: loss 0.16790. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 48 Iter 63: loss 0.18060. :  28%|████████████▍                                | 62/224 [00:30<01:17,  2.08it/s]
Epoch 48 Iter 63: loss 0.18060. :  28%|████████████▋                                | 63/224 [00:30<01:17,  2.08it/s]
Epoch 48 Iter 64: loss 0.17259. :  28%|████████████▋                                | 63/224 [00:31<01:17,  2.08it/s]
Epoch 48 Iter 64: loss 0.17259. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 48 Iter 65: loss 0.17123. :  29%|████████████▊                                | 64/224 [00:31<01:16,  2.08it/s]
Epoch 48 Iter 65: loss 0.17123. :  29%|█████████████                                | 65/224 [00:31<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.16085. :  29%|█████████████                                | 65/224 [00:32<01:17,  2.06it/s]
Epoch 48 Iter 66: loss 0.16085. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 48 Iter 67: loss 0.17000. :  29%|█████████████▎                               | 66/224 [00:32<01:15,  2.08it/s]
Epoch 48 Iter 67: loss 0.17000. :  30%|█████████████▍                               | 67/224 [00:32<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.15726. :  30%|█████████████▍                               | 67/224 [00:33<01:15,  2.07it/s]
Epoch 48 Iter 68: loss 0.15726. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 48 Iter 69: loss 0.19057. :  30%|█████████████▋                               | 68/224 [00:33<01:15,  2.07it/s]
Epoch 48 Iter 69: loss 0.19057. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 48 Iter 70: loss 0.15343. :  31%|█████████████▊                               | 69/224 [00:33<01:15,  2.06it/s]
Epoch 48 Iter 70: loss 0.15343. :  31%|██████████████                               | 70/224 [00:33<01:14,  2.06it/s]
Epoch 48 Iter 71: loss 0.17332. :  31%|██████████████                               | 70/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 71: loss 0.17332. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 72: loss 0.17963. :  32%|██████████████▎                              | 71/224 [00:34<01:14,  2.06it/s]
Epoch 48 Iter 72: loss 0.17963. :  32%|██████████████▍                              | 72/224 [00:34<01:13,  2.06it/s]
Epoch 48 Iter 73: loss 0.17299. :  32%|██████████████▍                              | 72/224 [00:35<01:13,  2.06it/s]
Epoch 48 Iter 73: loss 0.17299. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 48 Iter 74: loss 0.17347. :  33%|██████████████▋                              | 73/224 [00:35<01:13,  2.07it/s]
Epoch 48 Iter 74: loss 0.17347. :  33%|██████████████▊                              | 74/224 [00:35<01:12,  2.06it/s]
Epoch 48 Iter 75: loss 0.16626. :  33%|██████████████▊                              | 74/224 [00:36<01:12,  2.06it/s]
Epoch 48 Iter 75: loss 0.16626. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 48 Iter 76: loss 0.16280. :  33%|███████████████                              | 75/224 [00:36<01:12,  2.07it/s]
Epoch 48 Iter 76: loss 0.16280. :  34%|███████████████▎                             | 76/224 [00:36<01:11,  2.06it/s]
Epoch 48 Iter 77: loss 0.15486. :  34%|███████████████▎                             | 76/224 [00:37<01:11,  2.06it/s]
Epoch 48 Iter 77: loss 0.15486. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 48 Iter 78: loss 0.17778. :  34%|███████████████▍                             | 77/224 [00:37<01:10,  2.07it/s]
Epoch 48 Iter 78: loss 0.17778. :  35%|███████████████▋                             | 78/224 [00:37<01:10,  2.07it/s]
Epoch 48 Iter 79: loss 0.17396. :  35%|███████████████▋                             | 78/224 [00:38<01:10,  2.07it/s]
Epoch 48 Iter 79: loss 0.17396. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 48 Iter 80: loss 0.16190. :  35%|███████████████▊                             | 79/224 [00:38<01:09,  2.07it/s]
Epoch 48 Iter 80: loss 0.16190. :  36%|████████████████                             | 80/224 [00:38<01:09,  2.07it/s]
Epoch 48 Iter 81: loss 0.16713. :  36%|████████████████                             | 80/224 [00:39<01:09,  2.07it/s]
Epoch 48 Iter 81: loss 0.16713. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 48 Iter 82: loss 0.15556. :  36%|████████████████▎                            | 81/224 [00:39<01:09,  2.06it/s]
Epoch 48 Iter 82: loss 0.15556. :  37%|████████████████▍                            | 82/224 [00:39<01:08,  2.07it/s]
Epoch 48 Iter 83: loss 0.18132. :  37%|████████████████▍                            | 82/224 [00:40<01:08,  2.07it/s]
Epoch 48 Iter 83: loss 0.18132. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 48 Iter 84: loss 0.16378. :  37%|████████████████▋                            | 83/224 [00:40<01:08,  2.07it/s]
Epoch 48 Iter 84: loss 0.16378. :  38%|████████████████▉                            | 84/224 [00:40<01:07,  2.07it/s]
Epoch 48 Iter 85: loss 0.17573. :  38%|████████████████▉                            | 84/224 [00:41<01:07,  2.07it/s]
Epoch 48 Iter 85: loss 0.17573. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 48 Iter 86: loss 0.18975. :  38%|█████████████████                            | 85/224 [00:41<01:07,  2.06it/s]
Epoch 48 Iter 86: loss 0.18975. :  38%|█████████████████▎                           | 86/224 [00:41<01:06,  2.06it/s]
Epoch 48 Iter 87: loss 0.17734. :  38%|█████████████████▎                           | 86/224 [00:42<01:06,  2.06it/s]
Epoch 48 Iter 87: loss 0.17734. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 48 Iter 88: loss 0.17643. :  39%|█████████████████▍                           | 87/224 [00:42<01:06,  2.07it/s]
Epoch 48 Iter 88: loss 0.17643. :  39%|█████████████████▋                           | 88/224 [00:42<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.17772. :  39%|█████████████████▋                           | 88/224 [00:43<01:06,  2.05it/s]
Epoch 48 Iter 89: loss 0.17772. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.15604. :  40%|█████████████████▉                           | 89/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 90: loss 0.15604. :  40%|██████████████████                           | 90/224 [00:43<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.17698. :  40%|██████████████████                           | 90/224 [00:44<01:05,  2.05it/s]
Epoch 48 Iter 91: loss 0.17698. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 48 Iter 92: loss 0.16994. :  41%|██████████████████▎                          | 91/224 [00:44<01:04,  2.07it/s]
Epoch 48 Iter 92: loss 0.16994. :  41%|██████████████████▍                          | 92/224 [00:44<01:03,  2.07it/s]
Epoch 48 Iter 93: loss 0.15111. :  41%|██████████████████▍                          | 92/224 [00:45<01:03,  2.07it/s]
Epoch 48 Iter 93: loss 0.15111. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.18425. :  42%|██████████████████▋                          | 93/224 [00:45<01:03,  2.06it/s]
Epoch 48 Iter 94: loss 0.18425. :  42%|██████████████████▉                          | 94/224 [00:45<01:02,  2.07it/s]
Epoch 48 Iter 95: loss 0.18825. :  42%|██████████████████▉                          | 94/224 [00:46<01:02,  2.07it/s]
Epoch 48 Iter 95: loss 0.18825. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 48 Iter 96: loss 0.14384. :  42%|███████████████████                          | 95/224 [00:46<01:02,  2.07it/s]
Epoch 48 Iter 96: loss 0.14384. :  43%|███████████████████▎                         | 96/224 [00:46<01:01,  2.07it/s]
Epoch 48 Iter 97: loss 0.16882. :  43%|███████████████████▎                         | 96/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 97: loss 0.16882. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.17844. :  43%|███████████████████▍                         | 97/224 [00:47<01:01,  2.07it/s]
Epoch 48 Iter 98: loss 0.17844. :  44%|███████████████████▋                         | 98/224 [00:47<01:00,  2.08it/s]
Epoch 48 Iter 99: loss 0.17091. :  44%|███████████████████▋                         | 98/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 99: loss 0.17091. :  44%|███████████████████▉                         | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.16332. :  44%|███████████████████▍                        | 99/224 [00:48<01:00,  2.08it/s]
Epoch 48 Iter 100: loss 0.16332. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 48 Iter 101: loss 0.18496. :  45%|███████████████████▏                       | 100/224 [00:48<00:59,  2.09it/s]
Epoch 48 Iter 101: loss 0.18496. :  45%|███████████████████▍                       | 101/224 [00:48<00:58,  2.09it/s]
Epoch 48 Iter 102: loss 0.16182. :  45%|███████████████████▍                       | 101/224 [00:49<00:58,  2.09it/s]
Epoch 48 Iter 102: loss 0.16182. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 48 Iter 103: loss 0.17566. :  46%|███████████████████▌                       | 102/224 [00:49<00:58,  2.08it/s]
Epoch 48 Iter 103: loss 0.17566. :  46%|███████████████████▊                       | 103/224 [00:49<00:58,  2.07it/s]
Epoch 48 Iter 104: loss 0.18975. :  46%|███████████████████▊                       | 103/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 104: loss 0.18975. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 105: loss 0.17531. :  46%|███████████████████▉                       | 104/224 [00:50<00:58,  2.07it/s]
Epoch 48 Iter 105: loss 0.17531. :  47%|████████████████████▏                      | 105/224 [00:50<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.16741. :  47%|████████████████████▏                      | 105/224 [00:51<00:57,  2.07it/s]
Epoch 48 Iter 106: loss 0.16741. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 48 Iter 107: loss 0.16923. :  47%|████████████████████▎                      | 106/224 [00:51<00:57,  2.06it/s]
Epoch 48 Iter 107: loss 0.16923. :  48%|████████████████████▌                      | 107/224 [00:51<00:56,  2.06it/s]
Epoch 48 Iter 108: loss 0.17556. :  48%|████████████████████▌                      | 107/224 [00:52<00:56,  2.06it/s]
Epoch 48 Iter 108: loss 0.17556. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 48 Iter 109: loss 0.18624. :  48%|████████████████████▋                      | 108/224 [00:52<00:55,  2.07it/s]
Epoch 48 Iter 109: loss 0.18624. :  49%|████████████████████▉                      | 109/224 [00:52<00:55,  2.08it/s]
Epoch 48 Iter 110: loss 0.18086. :  49%|████████████████████▉                      | 109/224 [00:53<00:55,  2.08it/s]
Epoch 48 Iter 110: loss 0.18086. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 48 Iter 111: loss 0.18429. :  49%|█████████████████████                      | 110/224 [00:53<00:54,  2.08it/s]
Epoch 48 Iter 111: loss 0.18429. :  50%|█████████████████████▎                     | 111/224 [00:53<00:54,  2.06it/s]
Epoch 48 Iter 112: loss 0.17527. :  50%|█████████████████████▎                     | 111/224 [00:54<00:54,  2.06it/s]
Epoch 48 Iter 112: loss 0.17527. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 48 Iter 113: loss 0.17753. :  50%|█████████████████████▌                     | 112/224 [00:54<00:54,  2.05it/s]
Epoch 48 Iter 113: loss 0.17753. :  50%|█████████████████████▋                     | 113/224 [00:54<00:53,  2.06it/s]
Epoch 48 Iter 114: loss 0.16958. :  50%|█████████████████████▋                     | 113/224 [00:55<00:53,  2.06it/s]
Epoch 48 Iter 114: loss 0.16958. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 48 Iter 115: loss 0.17754. :  51%|█████████████████████▉                     | 114/224 [00:55<00:53,  2.06it/s]
Epoch 48 Iter 115: loss 0.17754. :  51%|██████████████████████                     | 115/224 [00:55<00:52,  2.07it/s]
Epoch 48 Iter 116: loss 0.16973. :  51%|██████████████████████                     | 115/224 [00:56<00:52,  2.07it/s]
Epoch 48 Iter 116: loss 0.16973. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 48 Iter 117: loss 0.17342. :  52%|██████████████████████▎                    | 116/224 [00:56<00:52,  2.07it/s]
Epoch 48 Iter 117: loss 0.17342. :  52%|██████████████████████▍                    | 117/224 [00:56<00:52,  2.06it/s]
Epoch 48 Iter 118: loss 0.18823. :  52%|██████████████████████▍                    | 117/224 [00:57<00:52,  2.06it/s]
Epoch 48 Iter 118: loss 0.18823. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 48 Iter 119: loss 0.18077. :  53%|██████████████████████▋                    | 118/224 [00:57<00:51,  2.06it/s]
Epoch 48 Iter 119: loss 0.18077. :  53%|██████████████████████▊                    | 119/224 [00:57<00:51,  2.05it/s]
Epoch 48 Iter 120: loss 0.17409. :  53%|██████████████████████▊                    | 119/224 [00:58<00:51,  2.05it/s]
Epoch 48 Iter 120: loss 0.17409. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 48 Iter 121: loss 0.16889. :  54%|███████████████████████                    | 120/224 [00:58<00:50,  2.05it/s]
Epoch 48 Iter 121: loss 0.16889. :  54%|███████████████████████▏                   | 121/224 [00:58<00:50,  2.06it/s]
Epoch 48 Iter 122: loss 0.17324. :  54%|███████████████████████▏                   | 121/224 [00:59<00:50,  2.06it/s]
Epoch 48 Iter 122: loss 0.17324. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 48 Iter 123: loss 0.17697. :  54%|███████████████████████▍                   | 122/224 [00:59<00:49,  2.07it/s]
Epoch 48 Iter 123: loss 0.17697. :  55%|███████████████████████▌                   | 123/224 [00:59<00:48,  2.07it/s]
Epoch 48 Iter 124: loss 0.19334. :  55%|███████████████████████▌                   | 123/224 [01:00<00:48,  2.07it/s]
Epoch 48 Iter 124: loss 0.19334. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 48 Iter 125: loss 0.15996. :  55%|███████████████████████▊                   | 124/224 [01:00<00:48,  2.07it/s]
Epoch 48 Iter 125: loss 0.15996. :  56%|███████████████████████▉                   | 125/224 [01:00<00:47,  2.07it/s]
Epoch 48 Iter 126: loss 0.17930. :  56%|███████████████████████▉                   | 125/224 [01:01<00:47,  2.07it/s]
Epoch 48 Iter 126: loss 0.17930. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 48 Iter 127: loss 0.15960. :  56%|████████████████████████▏                  | 126/224 [01:01<00:47,  2.06it/s]
Epoch 48 Iter 127: loss 0.15960. :  57%|████████████████████████▍                  | 127/224 [01:01<00:46,  2.07it/s]
Epoch 48 Iter 128: loss 0.18359. :  57%|████████████████████████▍                  | 127/224 [01:02<00:46,  2.07it/s]
Epoch 48 Iter 128: loss 0.18359. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 48 Iter 129: loss 0.15654. :  57%|████████████████████████▌                  | 128/224 [01:02<00:46,  2.07it/s]
Epoch 48 Iter 129: loss 0.15654. :  58%|████████████████████████▊                  | 129/224 [01:02<00:45,  2.08it/s]
Epoch 48 Iter 130: loss 0.15099. :  58%|████████████████████████▊                  | 129/224 [01:03<00:45,  2.08it/s]
Epoch 48 Iter 130: loss 0.15099. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 48 Iter 131: loss 0.14863. :  58%|████████████████████████▉                  | 130/224 [01:03<00:45,  2.07it/s]
Epoch 48 Iter 131: loss 0.14863. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 48 Iter 132: loss 0.19281. :  58%|█████████████████████████▏                 | 131/224 [01:03<00:44,  2.07it/s]
Epoch 48 Iter 132: loss 0.19281. :  59%|█████████████████████████▎                 | 132/224 [01:03<00:44,  2.07it/s]
Epoch 48 Iter 133: loss 0.19382. :  59%|█████████████████████████▎                 | 132/224 [01:04<00:44,  2.07it/s]
Epoch 48 Iter 133: loss 0.19382. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 48 Iter 134: loss 0.16758. :  59%|█████████████████████████▌                 | 133/224 [01:04<00:44,  2.06it/s]
Epoch 48 Iter 134: loss 0.16758. :  60%|█████████████████████████▋                 | 134/224 [01:04<00:43,  2.06it/s]
Epoch 48 Iter 135: loss 0.17350. :  60%|█████████████████████████▋                 | 134/224 [01:05<00:43,  2.06it/s]
Epoch 48 Iter 135: loss 0.17350. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 136: loss 0.16836. :  60%|█████████████████████████▉                 | 135/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 136: loss 0.16836. :  61%|██████████████████████████                 | 136/224 [01:05<00:42,  2.07it/s]
Epoch 48 Iter 137: loss 0.16888. :  61%|██████████████████████████                 | 136/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 137: loss 0.16888. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 138: loss 0.17438. :  61%|██████████████████████████▎                | 137/224 [01:06<00:42,  2.07it/s]
Epoch 48 Iter 138: loss 0.17438. :  62%|██████████████████████████▍                | 138/224 [01:06<00:41,  2.06it/s]
Epoch 48 Iter 139: loss 0.19436. :  62%|██████████████████████████▍                | 138/224 [01:07<00:41,  2.06it/s]
Epoch 48 Iter 139: loss 0.19436. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 48 Iter 140: loss 0.17248. :  62%|██████████████████████████▋                | 139/224 [01:07<00:41,  2.07it/s]
Epoch 48 Iter 140: loss 0.17248. :  62%|██████████████████████████▉                | 140/224 [01:07<00:40,  2.08it/s]
Epoch 48 Iter 141: loss 0.17412. :  62%|██████████████████████████▉                | 140/224 [01:08<00:40,  2.08it/s]
Epoch 48 Iter 141: loss 0.17412. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 142: loss 0.17705. :  63%|███████████████████████████                | 141/224 [01:08<00:40,  2.07it/s]
Epoch 48 Iter 142: loss 0.17705. :  63%|███████████████████████████▎               | 142/224 [01:08<00:39,  2.08it/s]
Epoch 48 Iter 143: loss 0.18083. :  63%|███████████████████████████▎               | 142/224 [01:09<00:39,  2.08it/s]
Epoch 48 Iter 143: loss 0.18083. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 48 Iter 144: loss 0.18070. :  64%|███████████████████████████▍               | 143/224 [01:09<00:38,  2.08it/s]
Epoch 48 Iter 144: loss 0.18070. :  64%|███████████████████████████▋               | 144/224 [01:09<00:38,  2.08it/s]
Epoch 48 Iter 145: loss 0.18537. :  64%|███████████████████████████▋               | 144/224 [01:10<00:38,  2.08it/s]
Epoch 48 Iter 145: loss 0.18537. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 48 Iter 146: loss 0.20451. :  65%|███████████████████████████▊               | 145/224 [01:10<00:38,  2.07it/s]
Epoch 48 Iter 146: loss 0.20451. :  65%|████████████████████████████               | 146/224 [01:10<00:37,  2.06it/s]
Epoch 48 Iter 147: loss 0.16628. :  65%|████████████████████████████               | 146/224 [01:11<00:37,  2.06it/s]
Epoch 48 Iter 147: loss 0.16628. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 48 Iter 148: loss 0.16068. :  66%|████████████████████████████▏              | 147/224 [01:11<00:37,  2.06it/s]
Epoch 48 Iter 148: loss 0.16068. :  66%|████████████████████████████▍              | 148/224 [01:11<00:36,  2.06it/s]
Epoch 48 Iter 149: loss 0.16143. :  66%|████████████████████████████▍              | 148/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 149: loss 0.16143. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 150: loss 0.15644. :  67%|████████████████████████████▌              | 149/224 [01:12<00:36,  2.06it/s]
Epoch 48 Iter 150: loss 0.15644. :  67%|████████████████████████████▊              | 150/224 [01:12<00:36,  2.05it/s]
Epoch 48 Iter 151: loss 0.15528. :  67%|████████████████████████████▊              | 150/224 [01:13<00:36,  2.05it/s]
Epoch 48 Iter 151: loss 0.15528. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 48 Iter 152: loss 0.15614. :  67%|████████████████████████████▉              | 151/224 [01:13<00:35,  2.06it/s]
Epoch 48 Iter 152: loss 0.15614. :  68%|█████████████████████████████▏             | 152/224 [01:13<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.15624. :  68%|█████████████████████████████▏             | 152/224 [01:14<00:34,  2.06it/s]
Epoch 48 Iter 153: loss 0.15624. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.16655. :  68%|█████████████████████████████▎             | 153/224 [01:14<00:34,  2.07it/s]
Epoch 48 Iter 154: loss 0.16655. :  69%|█████████████████████████████▌             | 154/224 [01:14<00:33,  2.07it/s]
Epoch 48 Iter 155: loss 0.16153. :  69%|█████████████████████████████▌             | 154/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 155: loss 0.16153. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.18669. :  69%|█████████████████████████████▊             | 155/224 [01:15<00:33,  2.07it/s]
Epoch 48 Iter 156: loss 0.18669. :  70%|█████████████████████████████▉             | 156/224 [01:15<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.16585. :  70%|█████████████████████████████▉             | 156/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 157: loss 0.16585. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.16044. :  70%|██████████████████████████████▏            | 157/224 [01:16<00:32,  2.07it/s]
Epoch 48 Iter 158: loss 0.16044. :  71%|██████████████████████████████▎            | 158/224 [01:16<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.20484. :  71%|██████████████████████████████▎            | 158/224 [01:17<00:31,  2.07it/s]
Epoch 48 Iter 159: loss 0.20484. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 48 Iter 160: loss 0.17307. :  71%|██████████████████████████████▌            | 159/224 [01:17<00:31,  2.06it/s]
Epoch 48 Iter 160: loss 0.17307. :  71%|██████████████████████████████▋            | 160/224 [01:17<00:30,  2.07it/s]
Epoch 48 Iter 161: loss 0.15761. :  71%|██████████████████████████████▋            | 160/224 [01:18<00:30,  2.07it/s]
Epoch 48 Iter 161: loss 0.15761. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 48 Iter 162: loss 0.17114. :  72%|██████████████████████████████▉            | 161/224 [01:18<00:30,  2.06it/s]
Epoch 48 Iter 162: loss 0.17114. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 48 Iter 163: loss 0.18884. :  72%|███████████████████████████████            | 162/224 [01:18<00:30,  2.07it/s]
Epoch 48 Iter 163: loss 0.18884. :  73%|███████████████████████████████▎           | 163/224 [01:18<00:29,  2.06it/s]
Epoch 48 Iter 164: loss 0.15210. :  73%|███████████████████████████████▎           | 163/224 [01:19<00:29,  2.06it/s]
Epoch 48 Iter 164: loss 0.15210. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 48 Iter 165: loss 0.16562. :  73%|███████████████████████████████▍           | 164/224 [01:19<00:29,  2.07it/s]
Epoch 48 Iter 165: loss 0.16562. :  74%|███████████████████████████████▋           | 165/224 [01:19<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.18091. :  74%|███████████████████████████████▋           | 165/224 [01:20<00:28,  2.07it/s]
Epoch 48 Iter 166: loss 0.18091. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.16493. :  74%|███████████████████████████████▊           | 166/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 167: loss 0.16493. :  75%|████████████████████████████████           | 167/224 [01:20<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.16295. :  75%|████████████████████████████████           | 167/224 [01:21<00:27,  2.08it/s]
Epoch 48 Iter 168: loss 0.16295. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 48 Iter 169: loss 0.16726. :  75%|████████████████████████████████▎          | 168/224 [01:21<00:26,  2.08it/s]
Epoch 48 Iter 169: loss 0.16726. :  75%|████████████████████████████████▍          | 169/224 [01:21<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.19397. :  75%|████████████████████████████████▍          | 169/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 170: loss 0.19397. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.18879. :  76%|████████████████████████████████▋          | 170/224 [01:22<00:26,  2.07it/s]
Epoch 48 Iter 171: loss 0.18879. :  76%|████████████████████████████████▊          | 171/224 [01:22<00:25,  2.07it/s]
Epoch 48 Iter 172: loss 0.16811. :  76%|████████████████████████████████▊          | 171/224 [01:23<00:25,  2.07it/s]
Epoch 48 Iter 172: loss 0.16811. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 48 Iter 173: loss 0.18808. :  77%|█████████████████████████████████          | 172/224 [01:23<00:25,  2.05it/s]
Epoch 48 Iter 173: loss 0.18808. :  77%|█████████████████████████████████▏         | 173/224 [01:23<00:24,  2.06it/s]
Epoch 48 Iter 174: loss 0.19374. :  77%|█████████████████████████████████▏         | 173/224 [01:24<00:24,  2.06it/s]
Epoch 48 Iter 174: loss 0.19374. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.16432. :  78%|█████████████████████████████████▍         | 174/224 [01:24<00:24,  2.07it/s]
Epoch 48 Iter 175: loss 0.16432. :  78%|█████████████████████████████████▌         | 175/224 [01:24<00:23,  2.07it/s]
Epoch 48 Iter 176: loss 0.19495. :  78%|█████████████████████████████████▌         | 175/224 [01:25<00:23,  2.07it/s]
Epoch 48 Iter 176: loss 0.19495. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 48 Iter 177: loss 0.15707. :  79%|█████████████████████████████████▊         | 176/224 [01:25<00:23,  2.06it/s]
Epoch 48 Iter 177: loss 0.15707. :  79%|█████████████████████████████████▉         | 177/224 [01:25<00:22,  2.06it/s]
Epoch 48 Iter 178: loss 0.17758. :  79%|█████████████████████████████████▉         | 177/224 [01:26<00:22,  2.06it/s]
Epoch 48 Iter 178: loss 0.17758. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 48 Iter 179: loss 0.19559. :  79%|██████████████████████████████████▏        | 178/224 [01:26<00:22,  2.06it/s]
Epoch 48 Iter 179: loss 0.19559. :  80%|██████████████████████████████████▎        | 179/224 [01:26<00:21,  2.06it/s]
Epoch 48 Iter 180: loss 0.16422. :  80%|██████████████████████████████████▎        | 179/224 [01:27<00:21,  2.06it/s]
Epoch 48 Iter 180: loss 0.16422. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 48 Iter 181: loss 0.16927. :  80%|██████████████████████████████████▌        | 180/224 [01:27<00:21,  2.05it/s]
Epoch 48 Iter 181: loss 0.16927. :  81%|██████████████████████████████████▋        | 181/224 [01:27<00:21,  2.04it/s]
Epoch 48 Iter 182: loss 0.19975. :  81%|██████████████████████████████████▋        | 181/224 [01:28<00:21,  2.04it/s]
Epoch 48 Iter 182: loss 0.19975. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.16502. :  81%|██████████████████████████████████▉        | 182/224 [01:28<00:20,  2.05it/s]
Epoch 48 Iter 183: loss 0.16502. :  82%|███████████████████████████████████▏       | 183/224 [01:28<00:19,  2.06it/s]
Epoch 48 Iter 184: loss 0.17976. :  82%|███████████████████████████████████▏       | 183/224 [01:29<00:19,  2.06it/s]
Epoch 48 Iter 184: loss 0.17976. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.17408. :  82%|███████████████████████████████████▎       | 184/224 [01:29<00:19,  2.07it/s]
Epoch 48 Iter 185: loss 0.17408. :  83%|███████████████████████████████████▌       | 185/224 [01:29<00:18,  2.06it/s]
Epoch 48 Iter 186: loss 0.17280. :  83%|███████████████████████████████████▌       | 185/224 [01:30<00:18,  2.06it/s]
Epoch 48 Iter 186: loss 0.17280. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.17556. :  83%|███████████████████████████████████▋       | 186/224 [01:30<00:18,  2.07it/s]
Epoch 48 Iter 187: loss 0.17556. :  83%|███████████████████████████████████▉       | 187/224 [01:30<00:17,  2.07it/s]
Epoch 48 Iter 188: loss 0.16204. :  83%|███████████████████████████████████▉       | 187/224 [01:31<00:17,  2.07it/s]
Epoch 48 Iter 188: loss 0.16204. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.08it/s]
Epoch 48 Iter 189: loss 0.16322. :  84%|████████████████████████████████████       | 188/224 [01:31<00:17,  2.08it/s]
Epoch 48 Iter 189: loss 0.16322. :  84%|████████████████████████████████████▎      | 189/224 [01:31<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.16310. :  84%|████████████████████████████████████▎      | 189/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 190: loss 0.16310. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 191: loss 0.16675. :  85%|████████████████████████████████████▍      | 190/224 [01:32<00:16,  2.07it/s]
Epoch 48 Iter 191: loss 0.16675. :  85%|████████████████████████████████████▋      | 191/224 [01:32<00:15,  2.07it/s]
Epoch 48 Iter 192: loss 0.17178. :  85%|████████████████████████████████████▋      | 191/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 192: loss 0.17178. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 193: loss 0.19647. :  86%|████████████████████████████████████▊      | 192/224 [01:33<00:15,  2.07it/s]
Epoch 48 Iter 193: loss 0.19647. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 48 Iter 194: loss 0.19615. :  86%|█████████████████████████████████████      | 193/224 [01:33<00:14,  2.07it/s]
Epoch 48 Iter 194: loss 0.19615. :  87%|█████████████████████████████████████▏     | 194/224 [01:33<00:14,  2.06it/s]
Epoch 48 Iter 195: loss 0.17595. :  87%|█████████████████████████████████████▏     | 194/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 195: loss 0.17595. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 196: loss 0.18522. :  87%|█████████████████████████████████████▍     | 195/224 [01:34<00:14,  2.06it/s]
Epoch 48 Iter 196: loss 0.18522. :  88%|█████████████████████████████████████▋     | 196/224 [01:34<00:13,  2.06it/s]
Epoch 48 Iter 197: loss 0.19943. :  88%|█████████████████████████████████████▋     | 196/224 [01:35<00:13,  2.06it/s]
Epoch 48 Iter 197: loss 0.19943. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 198: loss 0.16938. :  88%|█████████████████████████████████████▊     | 197/224 [01:35<00:13,  2.05it/s]
Epoch 48 Iter 198: loss 0.16938. :  88%|██████████████████████████████████████     | 198/224 [01:35<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.19169. :  88%|██████████████████████████████████████     | 198/224 [01:36<00:12,  2.04it/s]
Epoch 48 Iter 199: loss 0.19169. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.17732. :  89%|██████████████████████████████████████▏    | 199/224 [01:36<00:12,  2.05it/s]
Epoch 48 Iter 200: loss 0.17732. :  89%|██████████████████████████████████████▍    | 200/224 [01:36<00:11,  2.06it/s]
Epoch 48 Iter 201: loss 0.16627. :  89%|██████████████████████████████████████▍    | 200/224 [01:37<00:11,  2.06it/s]
Epoch 48 Iter 201: loss 0.16627. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 48 Iter 202: loss 0.17277. :  90%|██████████████████████████████████████▌    | 201/224 [01:37<00:11,  2.07it/s]
Epoch 48 Iter 202: loss 0.17277. :  90%|██████████████████████████████████████▊    | 202/224 [01:37<00:10,  2.06it/s]
Epoch 48 Iter 203: loss 0.16837. :  90%|██████████████████████████████████████▊    | 202/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 203: loss 0.16837. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.17595. :  91%|██████████████████████████████████████▉    | 203/224 [01:38<00:10,  2.06it/s]
Epoch 48 Iter 204: loss 0.17595. :  91%|███████████████████████████████████████▏   | 204/224 [01:38<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.20741. :  91%|███████████████████████████████████████▏   | 204/224 [01:39<00:09,  2.07it/s]
Epoch 48 Iter 205: loss 0.20741. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 48 Iter 206: loss 0.16887. :  92%|███████████████████████████████████████▎   | 205/224 [01:39<00:09,  2.08it/s]
Epoch 48 Iter 206: loss 0.16887. :  92%|███████████████████████████████████████▌   | 206/224 [01:39<00:08,  2.07it/s]
Epoch 48 Iter 207: loss 0.17883. :  92%|███████████████████████████████████████▌   | 206/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 207: loss 0.17883. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 208: loss 0.18945. :  92%|███████████████████████████████████████▋   | 207/224 [01:40<00:08,  2.07it/s]
Epoch 48 Iter 208: loss 0.18945. :  93%|███████████████████████████████████████▉   | 208/224 [01:40<00:07,  2.07it/s]
Epoch 48 Iter 209: loss 0.18841. :  93%|███████████████████████████████████████▉   | 208/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 209: loss 0.18841. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 210: loss 0.17645. :  93%|████████████████████████████████████████   | 209/224 [01:41<00:07,  2.07it/s]
Epoch 48 Iter 210: loss 0.17645. :  94%|████████████████████████████████████████▎  | 210/224 [01:41<00:06,  2.08it/s]
Epoch 48 Iter 211: loss 0.21136. :  94%|████████████████████████████████████████▎  | 210/224 [01:42<00:06,  2.08it/s]
Epoch 48 Iter 211: loss 0.21136. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.17351. :  94%|████████████████████████████████████████▌  | 211/224 [01:42<00:06,  2.07it/s]
Epoch 48 Iter 212: loss 0.17351. :  95%|████████████████████████████████████████▋  | 212/224 [01:42<00:05,  2.06it/s]
Epoch 48 Iter 213: loss 0.17467. :  95%|████████████████████████████████████████▋  | 212/224 [01:43<00:05,  2.06it/s]
Epoch 48 Iter 213: loss 0.17467. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 48 Iter 214: loss 0.17967. :  95%|████████████████████████████████████████▉  | 213/224 [01:43<00:05,  2.07it/s]
Epoch 48 Iter 214: loss 0.17967. :  96%|█████████████████████████████████████████  | 214/224 [01:43<00:04,  2.07it/s]
Epoch 48 Iter 215: loss 0.15763. :  96%|█████████████████████████████████████████  | 214/224 [01:44<00:04,  2.07it/s]
Epoch 48 Iter 215: loss 0.15763. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 48 Iter 216: loss 0.17515. :  96%|█████████████████████████████████████████▎ | 215/224 [01:44<00:04,  2.06it/s]
Epoch 48 Iter 216: loss 0.17515. :  96%|█████████████████████████████████████████▍ | 216/224 [01:44<00:03,  2.06it/s]
Epoch 48 Iter 217: loss 0.17049. :  96%|█████████████████████████████████████████▍ | 216/224 [01:45<00:03,  2.06it/s]
Epoch 48 Iter 217: loss 0.17049. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 48 Iter 218: loss 0.16844. :  97%|█████████████████████████████████████████▋ | 217/224 [01:45<00:03,  2.07it/s]
Epoch 48 Iter 218: loss 0.16844. :  97%|█████████████████████████████████████████▊ | 218/224 [01:45<00:02,  2.07it/s]
Epoch 48 Iter 219: loss 0.17951. :  97%|█████████████████████████████████████████▊ | 218/224 [01:46<00:02,  2.07it/s]
Epoch 48 Iter 219: loss 0.17951. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 48 Iter 220: loss 0.15902. :  98%|██████████████████████████████████████████ | 219/224 [01:46<00:02,  2.07it/s]
Epoch 48 Iter 220: loss 0.15902. :  98%|██████████████████████████████████████████▏| 220/224 [01:46<00:01,  2.07it/s]
Epoch 48 Iter 221: loss 0.16644. :  98%|██████████████████████████████████████████▏| 220/224 [01:47<00:01,  2.07it/s]
Epoch 48 Iter 221: loss 0.16644. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 48 Iter 222: loss 0.17761. :  99%|██████████████████████████████████████████▍| 221/224 [01:47<00:01,  2.07it/s]
Epoch 48 Iter 222: loss 0.17761. :  99%|██████████████████████████████████████████▌| 222/224 [01:47<00:00,  2.09it/s]
Epoch 48 Iter 223: loss 0.16054. :  99%|██████████████████████████████████████████▌| 222/224 [01:48<00:00,  2.09it/s]
Epoch 48 Iter 223: loss 0.16054. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 48 Iter 224: loss 0.16626. : 100%|██████████████████████████████████████████▊| 223/224 [01:48<00:00,  2.09it/s]
Epoch 48 Iter 224: loss 0.16626. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.08it/s]
Epoch 48 Iter 224: loss 0.16626. : 100%|███████████████████████████████████████████| 224/224 [01:48<00:00,  2.06it/s]

  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.16370. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 49 Iter 1: loss 0.16370. :   0%|▏                                              | 1/224 [00:00<01:51,  2.00it/s]
Epoch 49 Iter 2: loss 0.18827. :   0%|▏                                              | 1/224 [00:00<01:51,  2.00it/s]
Epoch 49 Iter 2: loss 0.18827. :   1%|▍                                              | 2/224 [00:00<01:49,  2.03it/s]
Epoch 49 Iter 3: loss 0.17172. :   1%|▍                                              | 2/224 [00:01<01:49,  2.03it/s]
Epoch 49 Iter 3: loss 0.17172. :   1%|▋                                              | 3/224 [00:01<01:49,  2.03it/s]
Epoch 49 Iter 4: loss 0.20420. :   1%|▋                                              | 3/224 [00:01<01:49,  2.03it/s]
Epoch 49 Iter 4: loss 0.20420. :   2%|▊                                              | 4/224 [00:01<01:48,  2.03it/s]
Epoch 49 Iter 5: loss 0.16685. :   2%|▊                                              | 4/224 [00:02<01:48,  2.03it/s]
Epoch 49 Iter 5: loss 0.16685. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 49 Iter 6: loss 0.16630. :   2%|█                                              | 5/224 [00:02<01:47,  2.04it/s]
Epoch 49 Iter 6: loss 0.16630. :   3%|█▎                                             | 6/224 [00:02<01:46,  2.04it/s]
Epoch 49 Iter 7: loss 0.17025. :   3%|█▎                                             | 6/224 [00:03<01:46,  2.04it/s]
Epoch 49 Iter 7: loss 0.17025. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.05it/s]
Epoch 49 Iter 8: loss 0.17242. :   3%|█▍                                             | 7/224 [00:03<01:46,  2.05it/s]
Epoch 49 Iter 8: loss 0.17242. :   4%|█▋                                             | 8/224 [00:03<01:45,  2.05it/s]
Epoch 49 Iter 9: loss 0.17467. :   4%|█▋                                             | 8/224 [00:04<01:45,  2.05it/s]
Epoch 49 Iter 9: loss 0.17467. :   4%|█▉                                             | 9/224 [00:04<01:44,  2.06it/s]
Epoch 49 Iter 10: loss 0.17870. :   4%|█▊                                            | 9/224 [00:04<01:44,  2.06it/s]
Epoch 49 Iter 10: loss 0.17870. :   4%|██                                           | 10/224 [00:04<01:44,  2.04it/s]
Epoch 49 Iter 11: loss 0.17332. :   4%|██                                           | 10/224 [00:05<01:44,  2.04it/s]
Epoch 49 Iter 11: loss 0.17332. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 49 Iter 12: loss 0.16727. :   5%|██▏                                          | 11/224 [00:05<01:43,  2.06it/s]
Epoch 49 Iter 12: loss 0.16727. :   5%|██▍                                          | 12/224 [00:05<01:42,  2.07it/s]
Epoch 49 Iter 13: loss 0.18326. :   5%|██▍                                          | 12/224 [00:06<01:42,  2.07it/s]
Epoch 49 Iter 13: loss 0.18326. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 49 Iter 14: loss 0.17188. :   6%|██▌                                          | 13/224 [00:06<01:42,  2.06it/s]
Epoch 49 Iter 14: loss 0.17188. :   6%|██▊                                          | 14/224 [00:06<01:41,  2.06it/s]
Epoch 49 Iter 15: loss 0.18523. :   6%|██▊                                          | 14/224 [00:07<01:41,  2.06it/s]
Epoch 49 Iter 15: loss 0.18523. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 49 Iter 16: loss 0.18179. :   7%|███                                          | 15/224 [00:07<01:41,  2.07it/s]
Epoch 49 Iter 16: loss 0.18179. :   7%|███▏                                         | 16/224 [00:07<01:41,  2.06it/s]
Epoch 49 Iter 17: loss 0.18203. :   7%|███▏                                         | 16/224 [00:08<01:41,  2.06it/s]
Epoch 49 Iter 17: loss 0.18203. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 49 Iter 18: loss 0.17690. :   8%|███▍                                         | 17/224 [00:08<01:41,  2.04it/s]
Epoch 49 Iter 18: loss 0.17690. :   8%|███▌                                         | 18/224 [00:08<01:40,  2.06it/s]
Epoch 49 Iter 19: loss 0.17252. :   8%|███▌                                         | 18/224 [00:09<01:40,  2.06it/s]
Epoch 49 Iter 19: loss 0.17252. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 49 Iter 20: loss 0.20761. :   8%|███▊                                         | 19/224 [00:09<01:38,  2.07it/s]
Epoch 49 Iter 20: loss 0.20761. :   9%|████                                         | 20/224 [00:09<01:38,  2.07it/s]
Epoch 49 Iter 21: loss 0.16624. :   9%|████                                         | 20/224 [00:10<01:38,  2.07it/s]
Epoch 49 Iter 21: loss 0.16624. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 49 Iter 22: loss 0.17879. :   9%|████▏                                        | 21/224 [00:10<01:37,  2.07it/s]
Epoch 49 Iter 22: loss 0.17879. :  10%|████▍                                        | 22/224 [00:10<01:37,  2.07it/s]
Epoch 49 Iter 23: loss 0.16691. :  10%|████▍                                        | 22/224 [00:11<01:37,  2.07it/s]
Epoch 49 Iter 23: loss 0.16691. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 49 Iter 24: loss 0.15495. :  10%|████▌                                        | 23/224 [00:11<01:37,  2.06it/s]
Epoch 49 Iter 24: loss 0.15495. :  11%|████▊                                        | 24/224 [00:11<01:37,  2.05it/s]
Epoch 49 Iter 25: loss 0.16732. :  11%|████▊                                        | 24/224 [00:12<01:37,  2.05it/s]
Epoch 49 Iter 25: loss 0.16732. :  11%|█████                                        | 25/224 [00:12<01:36,  2.07it/s]
Epoch 49 Iter 26: loss 0.17881. :  11%|█████                                        | 25/224 [00:13<01:36,  2.07it/s]
Epoch 49 Iter 26: loss 0.17881. :  12%|█████▏                                       | 26/224 [00:13<02:09,  1.53it/s]
Epoch 49 Iter 27: loss 0.18006. :  12%|█████▏                                       | 26/224 [00:13<02:09,  1.53it/s]
Epoch 49 Iter 27: loss 0.18006. :  12%|█████▍                                       | 27/224 [00:13<01:58,  1.66it/s]
Epoch 49 Iter 28: loss 0.17933. :  12%|█████▍                                       | 27/224 [00:14<01:58,  1.66it/s]
Epoch 49 Iter 28: loss 0.17933. :  12%|█████▋                                       | 28/224 [00:14<01:51,  1.76it/s]
Epoch 49 Iter 29: loss 0.16965. :  12%|█████▋                                       | 28/224 [00:14<01:51,  1.76it/s]
Epoch 49 Iter 29: loss 0.16965. :  13%|█████▊                                       | 29/224 [00:14<01:46,  1.82it/s]
Epoch 49 Iter 30: loss 0.16621. :  13%|█████▊                                       | 29/224 [00:15<01:46,  1.82it/s]
Epoch 49 Iter 30: loss 0.16621. :  13%|██████                                       | 30/224 [00:15<01:45,  1.85it/s]
Epoch 49 Iter 31: loss 0.16179. :  13%|██████                                       | 30/224 [00:15<01:45,  1.85it/s]
Epoch 49 Iter 31: loss 0.16179. :  14%|██████▏                                      | 31/224 [00:15<01:45,  1.84it/s]
Epoch 49 Iter 32: loss 0.16512. :  14%|██████▏                                      | 31/224 [00:16<01:45,  1.84it/s]
Epoch 49 Iter 32: loss 0.16512. :  14%|██████▍                                      | 32/224 [00:16<01:40,  1.91it/s]
Epoch 49 Iter 33: loss 0.16463. :  14%|██████▍                                      | 32/224 [00:16<01:40,  1.91it/s]
Epoch 49 Iter 33: loss 0.16463. :  15%|██████▋                                      | 33/224 [00:16<01:37,  1.96it/s]
Epoch 49 Iter 34: loss 0.17777. :  15%|██████▋                                      | 33/224 [00:17<01:37,  1.96it/s]
Epoch 49 Iter 34: loss 0.17777. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.00it/s]
Epoch 49 Iter 35: loss 0.16678. :  15%|██████▊                                      | 34/224 [00:17<01:34,  2.00it/s]
Epoch 49 Iter 35: loss 0.16678. :  16%|███████                                      | 35/224 [00:17<01:33,  2.03it/s]
Epoch 49 Iter 36: loss 0.17135. :  16%|███████                                      | 35/224 [00:18<01:33,  2.03it/s]
Epoch 49 Iter 36: loss 0.17135. :  16%|███████▏                                     | 36/224 [00:18<01:32,  2.04it/s]
Epoch 49 Iter 37: loss 0.20082. :  16%|███████▏                                     | 36/224 [00:18<01:32,  2.04it/s]
Epoch 49 Iter 37: loss 0.20082. :  17%|███████▍                                     | 37/224 [00:18<01:29,  2.08it/s]
Epoch 49 Iter 38: loss 0.15585. :  17%|███████▍                                     | 37/224 [00:19<01:29,  2.08it/s]
Epoch 49 Iter 38: loss 0.15585. :  17%|███████▋                                     | 38/224 [00:19<01:28,  2.09it/s]
Epoch 49 Iter 39: loss 0.17734. :  17%|███████▋                                     | 38/224 [00:19<01:28,  2.09it/s]
Epoch 49 Iter 39: loss 0.17734. :  17%|███████▊                                     | 39/224 [00:19<01:26,  2.13it/s]
Epoch 49 Iter 40: loss 0.20510. :  17%|███████▊                                     | 39/224 [00:19<01:26,  2.13it/s]
Epoch 49 Iter 40: loss 0.20510. :  18%|████████                                     | 40/224 [00:19<01:26,  2.13it/s]
Epoch 49 Iter 41: loss 0.17593. :  18%|████████                                     | 40/224 [00:20<01:26,  2.13it/s]
Epoch 49 Iter 41: loss 0.17593. :  18%|████████▏                                    | 41/224 [00:20<01:25,  2.14it/s]
Epoch 49 Iter 42: loss 0.17808. :  18%|████████▏                                    | 41/224 [00:20<01:25,  2.14it/s]
Epoch 49 Iter 42: loss 0.17808. :  19%|████████▍                                    | 42/224 [00:20<01:25,  2.13it/s]
Epoch 49 Iter 43: loss 0.17874. :  19%|████████▍                                    | 42/224 [00:21<01:25,  2.13it/s]
Epoch 49 Iter 43: loss 0.17874. :  19%|████████▋                                    | 43/224 [00:21<01:23,  2.16it/s]
Epoch 49 Iter 44: loss 0.16280. :  19%|████████▋                                    | 43/224 [00:21<01:23,  2.16it/s]
Epoch 49 Iter 44: loss 0.16280. :  20%|████████▊                                    | 44/224 [00:21<01:22,  2.18it/s]
Epoch 49 Iter 45: loss 0.18189. :  20%|████████▊                                    | 44/224 [00:22<01:22,  2.18it/s]
Epoch 49 Iter 45: loss 0.18189. :  20%|█████████                                    | 45/224 [00:22<01:21,  2.18it/s]
Epoch 49 Iter 46: loss 0.16579. :  20%|█████████                                    | 45/224 [00:22<01:21,  2.18it/s]
Epoch 49 Iter 46: loss 0.16579. :  21%|█████████▏                                   | 46/224 [00:22<01:21,  2.19it/s]
Epoch 49 Iter 47: loss 0.17716. :  21%|█████████▏                                   | 46/224 [00:23<01:21,  2.19it/s]
Epoch 49 Iter 47: loss 0.17716. :  21%|█████████▍                                   | 47/224 [00:23<01:20,  2.19it/s]
Epoch 49 Iter 48: loss 0.17408. :  21%|█████████▍                                   | 47/224 [00:23<01:20,  2.19it/s]
Epoch 49 Iter 48: loss 0.17408. :  21%|█████████▋                                   | 48/224 [00:23<01:20,  2.20it/s]
Epoch 49 Iter 49: loss 0.16821. :  21%|█████████▋                                   | 48/224 [00:24<01:20,  2.20it/s]
Epoch 49 Iter 49: loss 0.16821. :  22%|█████████▊                                   | 49/224 [00:24<01:19,  2.19it/s]
Epoch 49 Iter 50: loss 0.20267. :  22%|█████████▊                                   | 49/224 [00:24<01:19,  2.19it/s]
Epoch 49 Iter 50: loss 0.20267. :  22%|██████████                                   | 50/224 [00:24<01:21,  2.15it/s]
Epoch 49 Iter 51: loss 0.16362. :  22%|██████████                                   | 50/224 [00:25<01:21,  2.15it/s]
Epoch 49 Iter 51: loss 0.16362. :  23%|██████████▏                                  | 51/224 [00:25<01:20,  2.15it/s]
Epoch 49 Iter 52: loss 0.17930. :  23%|██████████▏                                  | 51/224 [00:25<01:20,  2.15it/s]
Epoch 49 Iter 52: loss 0.17930. :  23%|██████████▍                                  | 52/224 [00:25<01:19,  2.17it/s]
Epoch 49 Iter 53: loss 0.16450. :  23%|██████████▍                                  | 52/224 [00:25<01:19,  2.17it/s]
Epoch 49 Iter 53: loss 0.16450. :  24%|██████████▋                                  | 53/224 [00:25<01:18,  2.17it/s]
Epoch 49 Iter 54: loss 0.15310. :  24%|██████████▋                                  | 53/224 [00:26<01:18,  2.17it/s]
Epoch 49 Iter 54: loss 0.15310. :  24%|██████████▊                                  | 54/224 [00:26<01:18,  2.17it/s]
Epoch 49 Iter 55: loss 0.16686. :  24%|██████████▊                                  | 54/224 [00:26<01:18,  2.17it/s]
Epoch 49 Iter 55: loss 0.16686. :  25%|███████████                                  | 55/224 [00:26<01:17,  2.19it/s]
Epoch 49 Iter 56: loss 0.16667. :  25%|███████████                                  | 55/224 [00:27<01:17,  2.19it/s]
Epoch 49 Iter 56: loss 0.16667. :  25%|███████████▎                                 | 56/224 [00:27<01:16,  2.18it/s]
Epoch 49 Iter 57: loss 0.16386. :  25%|███████████▎                                 | 56/224 [00:27<01:16,  2.18it/s]
Epoch 49 Iter 57: loss 0.16386. :  25%|███████████▍                                 | 57/224 [00:27<01:16,  2.19it/s]
Epoch 49 Iter 58: loss 0.16444. :  25%|███████████▍                                 | 57/224 [00:28<01:16,  2.19it/s]
Epoch 49 Iter 58: loss 0.16444. :  26%|███████████▋                                 | 58/224 [00:28<01:15,  2.19it/s]
Epoch 49 Iter 59: loss 0.19424. :  26%|███████████▋                                 | 58/224 [00:28<01:15,  2.19it/s]
Epoch 49 Iter 59: loss 0.19424. :  26%|███████████▊                                 | 59/224 [00:28<01:15,  2.20it/s]
Epoch 49 Iter 60: loss 0.15947. :  26%|███████████▊                                 | 59/224 [00:29<01:15,  2.20it/s]
Epoch 49 Iter 60: loss 0.15947. :  27%|████████████                                 | 60/224 [00:29<01:15,  2.18it/s]
Epoch 49 Iter 61: loss 0.18445. :  27%|████████████                                 | 60/224 [00:29<01:15,  2.18it/s]
Epoch 49 Iter 61: loss 0.18445. :  27%|████████████▎                                | 61/224 [00:29<01:14,  2.18it/s]
Epoch 49 Iter 62: loss 0.18345. :  27%|████████████▎                                | 61/224 [00:30<01:14,  2.18it/s]
Epoch 49 Iter 62: loss 0.18345. :  28%|████████████▍                                | 62/224 [00:30<01:14,  2.18it/s]
Epoch 49 Iter 63: loss 0.17564. :  28%|████████████▍                                | 62/224 [00:30<01:14,  2.18it/s]
Epoch 49 Iter 63: loss 0.17564. :  28%|████████████▋                                | 63/224 [00:30<01:13,  2.18it/s]
Epoch 49 Iter 64: loss 0.20787. :  28%|████████████▋                                | 63/224 [00:30<01:13,  2.18it/s]
Epoch 49 Iter 64: loss 0.20787. :  29%|████████████▊                                | 64/224 [00:30<01:13,  2.19it/s]
Epoch 49 Iter 65: loss 0.15634. :  29%|████████████▊                                | 64/224 [00:31<01:13,  2.19it/s]
Epoch 49 Iter 65: loss 0.15634. :  29%|█████████████                                | 65/224 [00:31<01:13,  2.17it/s]
Epoch 49 Iter 66: loss 0.16638. :  29%|█████████████                                | 65/224 [00:31<01:13,  2.17it/s]
Epoch 49 Iter 66: loss 0.16638. :  29%|█████████████▎                               | 66/224 [00:31<01:12,  2.19it/s]
Epoch 49 Iter 67: loss 0.16817. :  29%|█████████████▎                               | 66/224 [00:32<01:12,  2.19it/s]
Epoch 49 Iter 67: loss 0.16817. :  30%|█████████████▍                               | 67/224 [00:32<01:11,  2.18it/s]
Epoch 49 Iter 68: loss 0.17575. :  30%|█████████████▍                               | 67/224 [00:32<01:11,  2.18it/s]
Epoch 49 Iter 68: loss 0.17575. :  30%|█████████████▋                               | 68/224 [00:32<01:12,  2.16it/s]
Epoch 49 Iter 69: loss 0.15512. :  30%|█████████████▋                               | 68/224 [00:33<01:12,  2.16it/s]
Epoch 49 Iter 69: loss 0.15512. :  31%|█████████████▊                               | 69/224 [00:33<01:11,  2.17it/s]
Epoch 49 Iter 70: loss 0.16015. :  31%|█████████████▊                               | 69/224 [00:33<01:11,  2.17it/s]
Epoch 49 Iter 70: loss 0.16015. :  31%|██████████████                               | 70/224 [00:33<01:11,  2.16it/s]
Epoch 49 Iter 71: loss 0.15673. :  31%|██████████████                               | 70/224 [00:34<01:11,  2.16it/s]
Epoch 49 Iter 71: loss 0.15673. :  32%|██████████████▎                              | 71/224 [00:34<01:10,  2.17it/s]
Epoch 49 Iter 72: loss 0.16320. :  32%|██████████████▎                              | 71/224 [00:34<01:10,  2.17it/s]
Epoch 49 Iter 72: loss 0.16320. :  32%|██████████████▍                              | 72/224 [00:34<01:10,  2.16it/s]
Epoch 49 Iter 73: loss 0.17455. :  32%|██████████████▍                              | 72/224 [00:35<01:10,  2.16it/s]
Epoch 49 Iter 73: loss 0.17455. :  33%|██████████████▋                              | 73/224 [00:35<01:09,  2.17it/s]
Epoch 49 Iter 74: loss 0.16796. :  33%|██████████████▋                              | 73/224 [00:35<01:09,  2.17it/s]
Epoch 49 Iter 74: loss 0.16796. :  33%|██████████████▊                              | 74/224 [00:35<01:09,  2.16it/s]
Epoch 49 Iter 75: loss 0.17348. :  33%|██████████████▊                              | 74/224 [00:36<01:09,  2.16it/s]
Epoch 49 Iter 75: loss 0.17348. :  33%|███████████████                              | 75/224 [00:36<01:08,  2.18it/s]
Epoch 49 Iter 76: loss 0.18506. :  33%|███████████████                              | 75/224 [00:36<01:08,  2.18it/s]
Epoch 49 Iter 76: loss 0.18506. :  34%|███████████████▎                             | 76/224 [00:36<01:08,  2.17it/s]
Epoch 49 Iter 77: loss 0.17586. :  34%|███████████████▎                             | 76/224 [00:36<01:08,  2.17it/s]
Epoch 49 Iter 77: loss 0.17586. :  34%|███████████████▍                             | 77/224 [00:36<01:07,  2.18it/s]
Epoch 49 Iter 78: loss 0.16490. :  34%|███████████████▍                             | 77/224 [00:37<01:07,  2.18it/s]
Epoch 49 Iter 78: loss 0.16490. :  35%|███████████████▋                             | 78/224 [00:37<01:06,  2.19it/s]
Epoch 49 Iter 79: loss 0.17223. :  35%|███████████████▋                             | 78/224 [00:37<01:06,  2.19it/s]
Epoch 49 Iter 79: loss 0.17223. :  35%|███████████████▊                             | 79/224 [00:37<01:06,  2.18it/s]
Epoch 49 Iter 80: loss 0.18066. :  35%|███████████████▊                             | 79/224 [00:38<01:06,  2.18it/s]
Epoch 49 Iter 80: loss 0.18066. :  36%|████████████████                             | 80/224 [00:38<01:06,  2.18it/s]
Epoch 49 Iter 81: loss 0.16391. :  36%|████████████████                             | 80/224 [00:38<01:06,  2.18it/s]
Epoch 49 Iter 81: loss 0.16391. :  36%|████████████████▎                            | 81/224 [00:38<01:05,  2.17it/s]
Epoch 49 Iter 82: loss 0.18154. :  36%|████████████████▎                            | 81/224 [00:39<01:05,  2.17it/s]
Epoch 49 Iter 82: loss 0.18154. :  37%|████████████████▍                            | 82/224 [00:39<01:05,  2.17it/s]
Epoch 49 Iter 83: loss 0.16969. :  37%|████████████████▍                            | 82/224 [00:39<01:05,  2.17it/s]
Epoch 49 Iter 83: loss 0.16969. :  37%|████████████████▋                            | 83/224 [00:39<01:05,  2.15it/s]
Epoch 49 Iter 84: loss 0.19222. :  37%|████████████████▋                            | 83/224 [00:40<01:05,  2.15it/s]
Epoch 49 Iter 84: loss 0.19222. :  38%|████████████████▉                            | 84/224 [00:40<01:04,  2.17it/s]
Epoch 49 Iter 85: loss 0.16869. :  38%|████████████████▉                            | 84/224 [00:40<01:04,  2.17it/s]
Epoch 49 Iter 85: loss 0.16869. :  38%|█████████████████                            | 85/224 [00:40<01:03,  2.17it/s]
Epoch 49 Iter 86: loss 0.16646. :  38%|█████████████████                            | 85/224 [00:41<01:03,  2.17it/s]
Epoch 49 Iter 86: loss 0.16646. :  38%|█████████████████▎                           | 86/224 [00:41<01:03,  2.17it/s]
Epoch 49 Iter 87: loss 0.16407. :  38%|█████████████████▎                           | 86/224 [00:41<01:03,  2.17it/s]
Epoch 49 Iter 87: loss 0.16407. :  39%|█████████████████▍                           | 87/224 [00:41<01:02,  2.18it/s]
Epoch 49 Iter 88: loss 0.17680. :  39%|█████████████████▍                           | 87/224 [00:42<01:02,  2.18it/s]
Epoch 49 Iter 88: loss 0.17680. :  39%|█████████████████▋                           | 88/224 [00:42<01:02,  2.17it/s]
Epoch 49 Iter 89: loss 0.17717. :  39%|█████████████████▋                           | 88/224 [00:42<01:02,  2.17it/s]
Epoch 49 Iter 89: loss 0.17717. :  40%|█████████████████▉                           | 89/224 [00:42<01:02,  2.18it/s]
Epoch 49 Iter 90: loss 0.19216. :  40%|█████████████████▉                           | 89/224 [00:42<01:02,  2.18it/s]
Epoch 49 Iter 90: loss 0.19216. :  40%|██████████████████                           | 90/224 [00:42<01:02,  2.16it/s]
Epoch 49 Iter 91: loss 0.17268. :  40%|██████████████████                           | 90/224 [00:43<01:02,  2.16it/s]
Epoch 49 Iter 91: loss 0.17268. :  41%|██████████████████▎                          | 91/224 [00:43<01:01,  2.18it/s]
Epoch 49 Iter 92: loss 0.17464. :  41%|██████████████████▎                          | 91/224 [00:43<01:01,  2.18it/s]
Epoch 49 Iter 92: loss 0.17464. :  41%|██████████████████▍                          | 92/224 [00:43<01:00,  2.19it/s]
Epoch 49 Iter 93: loss 0.17703. :  41%|██████████████████▍                          | 92/224 [00:44<01:00,  2.19it/s]
Epoch 49 Iter 93: loss 0.17703. :  42%|██████████████████▋                          | 93/224 [00:44<01:00,  2.17it/s]
Epoch 49 Iter 94: loss 0.18407. :  42%|██████████████████▋                          | 93/224 [00:44<01:00,  2.17it/s]
Epoch 49 Iter 94: loss 0.18407. :  42%|██████████████████▉                          | 94/224 [00:44<00:59,  2.19it/s]
Epoch 49 Iter 95: loss 0.17587. :  42%|██████████████████▉                          | 94/224 [00:45<00:59,  2.19it/s]
Epoch 49 Iter 95: loss 0.17587. :  42%|███████████████████                          | 95/224 [00:45<00:59,  2.18it/s]
Epoch 49 Iter 96: loss 0.16105. :  42%|███████████████████                          | 95/224 [00:45<00:59,  2.18it/s]
Epoch 49 Iter 96: loss 0.16105. :  43%|███████████████████▎                         | 96/224 [00:45<00:58,  2.19it/s]
Epoch 49 Iter 97: loss 0.18937. :  43%|███████████████████▎                         | 96/224 [00:46<00:58,  2.19it/s]
Epoch 49 Iter 97: loss 0.18937. :  43%|███████████████████▍                         | 97/224 [00:46<00:58,  2.18it/s]
Epoch 49 Iter 98: loss 0.17847. :  43%|███████████████████▍                         | 97/224 [00:46<00:58,  2.18it/s]
Epoch 49 Iter 98: loss 0.17847. :  44%|███████████████████▋                         | 98/224 [00:46<00:57,  2.20it/s]
Epoch 49 Iter 99: loss 0.17679. :  44%|███████████████████▋                         | 98/224 [00:47<00:57,  2.20it/s]
Epoch 49 Iter 99: loss 0.17679. :  44%|███████████████████▉                         | 99/224 [00:47<00:56,  2.19it/s]
Epoch 49 Iter 100: loss 0.14378. :  44%|███████████████████▍                        | 99/224 [00:47<00:56,  2.19it/s]
Epoch 49 Iter 100: loss 0.14378. :  45%|███████████████████▏                       | 100/224 [00:47<00:56,  2.20it/s]
Epoch 49 Iter 101: loss 0.14941. :  45%|███████████████████▏                       | 100/224 [00:47<00:56,  2.20it/s]
Epoch 49 Iter 101: loss 0.14941. :  45%|███████████████████▍                       | 101/224 [00:47<00:55,  2.20it/s]
Epoch 49 Iter 102: loss 0.16908. :  45%|███████████████████▍                       | 101/224 [00:48<00:55,  2.20it/s]
Epoch 49 Iter 102: loss 0.16908. :  46%|███████████████████▌                       | 102/224 [00:48<00:56,  2.18it/s]
Epoch 49 Iter 103: loss 0.18196. :  46%|███████████████████▌                       | 102/224 [00:48<00:56,  2.18it/s]
Epoch 49 Iter 103: loss 0.18196. :  46%|███████████████████▊                       | 103/224 [00:48<00:55,  2.18it/s]
Epoch 49 Iter 104: loss 0.18212. :  46%|███████████████████▊                       | 103/224 [00:49<00:55,  2.18it/s]
Epoch 49 Iter 104: loss 0.18212. :  46%|███████████████████▉                       | 104/224 [00:49<00:55,  2.18it/s]
Epoch 49 Iter 105: loss 0.17758. :  46%|███████████████████▉                       | 104/224 [00:49<00:55,  2.18it/s]
Epoch 49 Iter 105: loss 0.17758. :  47%|████████████████████▏                      | 105/224 [00:49<00:54,  2.19it/s]
Epoch 49 Iter 106: loss 0.17359. :  47%|████████████████████▏                      | 105/224 [00:50<00:54,  2.19it/s]
Epoch 49 Iter 106: loss 0.17359. :  47%|████████████████████▎                      | 106/224 [00:50<00:53,  2.19it/s]
Epoch 49 Iter 107: loss 0.15604. :  47%|████████████████████▎                      | 106/224 [00:50<00:53,  2.19it/s]
Epoch 49 Iter 107: loss 0.15604. :  48%|████████████████████▌                      | 107/224 [00:50<00:53,  2.19it/s]
Epoch 49 Iter 108: loss 0.16610. :  48%|████████████████████▌                      | 107/224 [00:51<00:53,  2.19it/s]
Epoch 49 Iter 108: loss 0.16610. :  48%|████████████████████▋                      | 108/224 [00:51<00:52,  2.20it/s]
Epoch 49 Iter 109: loss 0.17097. :  48%|████████████████████▋                      | 108/224 [00:51<00:52,  2.20it/s]
Epoch 49 Iter 109: loss 0.17097. :  49%|████████████████████▉                      | 109/224 [00:51<00:52,  2.20it/s]
Epoch 49 Iter 110: loss 0.18170. :  49%|████████████████████▉                      | 109/224 [00:52<00:52,  2.20it/s]
Epoch 49 Iter 110: loss 0.18170. :  49%|█████████████████████                      | 110/224 [00:52<00:51,  2.20it/s]
Epoch 49 Iter 111: loss 0.17730. :  49%|█████████████████████                      | 110/224 [00:52<00:51,  2.20it/s]
Epoch 49 Iter 111: loss 0.17730. :  50%|█████████████████████▎                     | 111/224 [00:52<00:51,  2.20it/s]
Epoch 49 Iter 112: loss 0.16483. :  50%|█████████████████████▎                     | 111/224 [00:53<00:51,  2.20it/s]
Epoch 49 Iter 112: loss 0.16483. :  50%|█████████████████████▌                     | 112/224 [00:53<00:50,  2.21it/s]
Epoch 49 Iter 113: loss 0.18158. :  50%|█████████████████████▌                     | 112/224 [00:53<00:50,  2.21it/s]
Epoch 49 Iter 113: loss 0.18158. :  50%|█████████████████████▋                     | 113/224 [00:53<00:50,  2.19it/s]
Epoch 49 Iter 114: loss 0.16172. :  50%|█████████████████████▋                     | 113/224 [00:53<00:50,  2.19it/s]
Epoch 49 Iter 114: loss 0.16172. :  51%|█████████████████████▉                     | 114/224 [00:53<00:50,  2.19it/s]
Epoch 49 Iter 115: loss 0.17346. :  51%|█████████████████████▉                     | 114/224 [00:54<00:50,  2.19it/s]
Epoch 49 Iter 115: loss 0.17346. :  51%|██████████████████████                     | 115/224 [00:54<00:49,  2.19it/s]
Epoch 49 Iter 116: loss 0.16739. :  51%|██████████████████████                     | 115/224 [00:54<00:49,  2.19it/s]
Epoch 49 Iter 116: loss 0.16739. :  52%|██████████████████████▎                    | 116/224 [00:54<00:49,  2.18it/s]
Epoch 49 Iter 117: loss 0.16994. :  52%|██████████████████████▎                    | 116/224 [00:55<00:49,  2.18it/s]
Epoch 49 Iter 117: loss 0.16994. :  52%|██████████████████████▍                    | 117/224 [00:55<00:49,  2.18it/s]
Epoch 49 Iter 118: loss 0.16933. :  52%|██████████████████████▍                    | 117/224 [00:55<00:49,  2.18it/s]
Epoch 49 Iter 118: loss 0.16933. :  53%|██████████████████████▋                    | 118/224 [00:55<00:48,  2.19it/s]
Epoch 49 Iter 119: loss 0.14013. :  53%|██████████████████████▋                    | 118/224 [00:56<00:48,  2.19it/s]
Epoch 49 Iter 119: loss 0.14013. :  53%|██████████████████████▊                    | 119/224 [00:56<00:47,  2.20it/s]
Epoch 49 Iter 120: loss 0.18298. :  53%|██████████████████████▊                    | 119/224 [00:56<00:47,  2.20it/s]
Epoch 49 Iter 120: loss 0.18298. :  54%|███████████████████████                    | 120/224 [00:56<00:47,  2.19it/s]
Epoch 49 Iter 121: loss 0.17141. :  54%|███████████████████████                    | 120/224 [00:57<00:47,  2.19it/s]
Epoch 49 Iter 121: loss 0.17141. :  54%|███████████████████████▏                   | 121/224 [00:57<00:46,  2.20it/s]
Epoch 49 Iter 122: loss 0.16126. :  54%|███████████████████████▏                   | 121/224 [00:57<00:46,  2.20it/s]
Epoch 49 Iter 122: loss 0.16126. :  54%|███████████████████████▍                   | 122/224 [00:57<00:46,  2.19it/s]
Epoch 49 Iter 123: loss 0.16926. :  54%|███████████████████████▍                   | 122/224 [00:58<00:46,  2.19it/s]
Epoch 49 Iter 123: loss 0.16926. :  55%|███████████████████████▌                   | 123/224 [00:58<00:46,  2.19it/s]
Epoch 49 Iter 124: loss 0.16546. :  55%|███████████████████████▌                   | 123/224 [00:58<00:46,  2.19it/s]
Epoch 49 Iter 124: loss 0.16546. :  55%|███████████████████████▊                   | 124/224 [00:58<00:45,  2.19it/s]
Epoch 49 Iter 125: loss 0.19356. :  55%|███████████████████████▊                   | 124/224 [00:58<00:45,  2.19it/s]
Epoch 49 Iter 125: loss 0.19356. :  56%|███████████████████████▉                   | 125/224 [00:58<00:45,  2.17it/s]
Epoch 49 Iter 126: loss 0.18628. :  56%|███████████████████████▉                   | 125/224 [00:59<00:45,  2.17it/s]
Epoch 49 Iter 126: loss 0.18628. :  56%|████████████████████████▏                  | 126/224 [00:59<00:45,  2.17it/s]
Epoch 49 Iter 127: loss 0.16319. :  56%|████████████████████████▏                  | 126/224 [00:59<00:45,  2.17it/s]
Epoch 49 Iter 127: loss 0.16319. :  57%|████████████████████████▍                  | 127/224 [00:59<00:44,  2.18it/s]
Epoch 49 Iter 128: loss 0.18975. :  57%|████████████████████████▍                  | 127/224 [01:00<00:44,  2.18it/s]
Epoch 49 Iter 128: loss 0.18975. :  57%|████████████████████████▌                  | 128/224 [01:00<00:43,  2.19it/s]
Epoch 49 Iter 129: loss 0.17696. :  57%|████████████████████████▌                  | 128/224 [01:00<00:43,  2.19it/s]
Epoch 49 Iter 129: loss 0.17696. :  58%|████████████████████████▊                  | 129/224 [01:00<00:43,  2.18it/s]
Epoch 49 Iter 130: loss 0.20039. :  58%|████████████████████████▊                  | 129/224 [01:01<00:43,  2.18it/s]
Epoch 49 Iter 130: loss 0.20039. :  58%|████████████████████████▉                  | 130/224 [01:01<00:43,  2.18it/s]
Epoch 49 Iter 131: loss 0.17120. :  58%|████████████████████████▉                  | 130/224 [01:01<00:43,  2.18it/s]
Epoch 49 Iter 131: loss 0.17120. :  58%|█████████████████████████▏                 | 131/224 [01:01<00:42,  2.18it/s]
Epoch 49 Iter 132: loss 0.17684. :  58%|█████████████████████████▏                 | 131/224 [01:02<00:42,  2.18it/s]
Epoch 49 Iter 132: loss 0.17684. :  59%|█████████████████████████▎                 | 132/224 [01:02<00:41,  2.20it/s]
Epoch 49 Iter 133: loss 0.17102. :  59%|█████████████████████████▎                 | 132/224 [01:02<00:41,  2.20it/s]
Epoch 49 Iter 133: loss 0.17102. :  59%|█████████████████████████▌                 | 133/224 [01:02<00:41,  2.20it/s]
Epoch 49 Iter 134: loss 0.16589. :  59%|█████████████████████████▌                 | 133/224 [01:03<00:41,  2.20it/s]
Epoch 49 Iter 134: loss 0.16589. :  60%|█████████████████████████▋                 | 134/224 [01:03<00:41,  2.18it/s]
Epoch 49 Iter 135: loss 0.18299. :  60%|█████████████████████████▋                 | 134/224 [01:03<00:41,  2.18it/s]
Epoch 49 Iter 135: loss 0.18299. :  60%|█████████████████████████▉                 | 135/224 [01:03<00:40,  2.19it/s]
Epoch 49 Iter 136: loss 0.16655. :  60%|█████████████████████████▉                 | 135/224 [01:03<00:40,  2.19it/s]
Epoch 49 Iter 136: loss 0.16655. :  61%|██████████████████████████                 | 136/224 [01:03<00:40,  2.19it/s]
Epoch 49 Iter 137: loss 0.16547. :  61%|██████████████████████████                 | 136/224 [01:04<00:40,  2.19it/s]
Epoch 49 Iter 137: loss 0.16547. :  61%|██████████████████████████▎                | 137/224 [01:04<00:39,  2.19it/s]
Epoch 49 Iter 138: loss 0.18073. :  61%|██████████████████████████▎                | 137/224 [01:04<00:39,  2.19it/s]
Epoch 49 Iter 138: loss 0.18073. :  62%|██████████████████████████▍                | 138/224 [01:04<00:39,  2.20it/s]
Epoch 49 Iter 139: loss 0.17584. :  62%|██████████████████████████▍                | 138/224 [01:05<00:39,  2.20it/s]
Epoch 49 Iter 139: loss 0.17584. :  62%|██████████████████████████▋                | 139/224 [01:05<00:38,  2.19it/s]
Epoch 49 Iter 140: loss 0.15997. :  62%|██████████████████████████▋                | 139/224 [01:05<00:38,  2.19it/s]
Epoch 49 Iter 140: loss 0.15997. :  62%|██████████████████████████▉                | 140/224 [01:05<00:38,  2.20it/s]
Epoch 49 Iter 141: loss 0.18961. :  62%|██████████████████████████▉                | 140/224 [01:06<00:38,  2.20it/s]
Epoch 49 Iter 141: loss 0.18961. :  63%|███████████████████████████                | 141/224 [01:06<00:37,  2.21it/s]
Epoch 49 Iter 142: loss 0.16337. :  63%|███████████████████████████                | 141/224 [01:06<00:37,  2.21it/s]
Epoch 49 Iter 142: loss 0.16337. :  63%|███████████████████████████▎               | 142/224 [01:06<00:37,  2.20it/s]
Epoch 49 Iter 143: loss 0.17310. :  63%|███████████████████████████▎               | 142/224 [01:07<00:37,  2.20it/s]
Epoch 49 Iter 143: loss 0.17310. :  64%|███████████████████████████▍               | 143/224 [01:07<00:36,  2.20it/s]
Epoch 49 Iter 144: loss 0.17477. :  64%|███████████████████████████▍               | 143/224 [01:07<00:36,  2.20it/s]
Epoch 49 Iter 144: loss 0.17477. :  64%|███████████████████████████▋               | 144/224 [01:07<00:36,  2.20it/s]
Epoch 49 Iter 145: loss 0.16802. :  64%|███████████████████████████▋               | 144/224 [01:08<00:36,  2.20it/s]
Epoch 49 Iter 145: loss 0.16802. :  65%|███████████████████████████▊               | 145/224 [01:08<00:35,  2.20it/s]
Epoch 49 Iter 146: loss 0.19158. :  65%|███████████████████████████▊               | 145/224 [01:08<00:35,  2.20it/s]
Epoch 49 Iter 146: loss 0.19158. :  65%|████████████████████████████               | 146/224 [01:08<00:35,  2.20it/s]
Epoch 49 Iter 147: loss 0.19041. :  65%|████████████████████████████               | 146/224 [01:08<00:35,  2.20it/s]
Epoch 49 Iter 147: loss 0.19041. :  66%|████████████████████████████▏              | 147/224 [01:08<00:34,  2.21it/s]
Epoch 49 Iter 148: loss 0.17779. :  66%|████████████████████████████▏              | 147/224 [01:09<00:34,  2.21it/s]
Epoch 49 Iter 148: loss 0.17779. :  66%|████████████████████████████▍              | 148/224 [01:09<00:34,  2.20it/s]
Epoch 49 Iter 149: loss 0.17788. :  66%|████████████████████████████▍              | 148/224 [01:09<00:34,  2.20it/s]
Epoch 49 Iter 149: loss 0.17788. :  67%|████████████████████████████▌              | 149/224 [01:09<00:34,  2.19it/s]
Epoch 49 Iter 150: loss 0.17070. :  67%|████████████████████████████▌              | 149/224 [01:10<00:34,  2.19it/s]
Epoch 49 Iter 150: loss 0.17070. :  67%|████████████████████████████▊              | 150/224 [01:10<00:33,  2.20it/s]
Epoch 49 Iter 151: loss 0.16489. :  67%|████████████████████████████▊              | 150/224 [01:10<00:33,  2.20it/s]
Epoch 49 Iter 151: loss 0.16489. :  67%|████████████████████████████▉              | 151/224 [01:10<00:33,  2.19it/s]
Epoch 49 Iter 152: loss 0.17272. :  67%|████████████████████████████▉              | 151/224 [01:11<00:33,  2.19it/s]
Epoch 49 Iter 152: loss 0.17272. :  68%|█████████████████████████████▏             | 152/224 [01:11<00:32,  2.19it/s]
Epoch 49 Iter 153: loss 0.18730. :  68%|█████████████████████████████▏             | 152/224 [01:11<00:32,  2.19it/s]
Epoch 49 Iter 153: loss 0.18730. :  68%|█████████████████████████████▎             | 153/224 [01:11<00:32,  2.19it/s]
Epoch 49 Iter 154: loss 0.18121. :  68%|█████████████████████████████▎             | 153/224 [01:12<00:32,  2.19it/s]
Epoch 49 Iter 154: loss 0.18121. :  69%|█████████████████████████████▌             | 154/224 [01:12<00:31,  2.19it/s]
Epoch 49 Iter 155: loss 0.19397. :  69%|█████████████████████████████▌             | 154/224 [01:12<00:31,  2.19it/s]
Epoch 49 Iter 155: loss 0.19397. :  69%|█████████████████████████████▊             | 155/224 [01:12<00:31,  2.18it/s]
Epoch 49 Iter 156: loss 0.14545. :  69%|█████████████████████████████▊             | 155/224 [01:13<00:31,  2.18it/s]
Epoch 49 Iter 156: loss 0.14545. :  70%|█████████████████████████████▉             | 156/224 [01:13<00:31,  2.19it/s]
Epoch 49 Iter 157: loss 0.17005. :  70%|█████████████████████████████▉             | 156/224 [01:13<00:31,  2.19it/s]
Epoch 49 Iter 157: loss 0.17005. :  70%|██████████████████████████████▏            | 157/224 [01:13<00:30,  2.18it/s]
Epoch 49 Iter 158: loss 0.17827. :  70%|██████████████████████████████▏            | 157/224 [01:14<00:30,  2.18it/s]
Epoch 49 Iter 158: loss 0.17827. :  71%|██████████████████████████████▎            | 158/224 [01:14<00:30,  2.17it/s]
Epoch 49 Iter 159: loss 0.16260. :  71%|██████████████████████████████▎            | 158/224 [01:14<00:30,  2.17it/s]
Epoch 49 Iter 159: loss 0.16260. :  71%|██████████████████████████████▌            | 159/224 [01:14<00:29,  2.18it/s]
Epoch 49 Iter 160: loss 0.15972. :  71%|██████████████████████████████▌            | 159/224 [01:14<00:29,  2.18it/s]
Epoch 49 Iter 160: loss 0.15972. :  71%|██████████████████████████████▋            | 160/224 [01:14<00:29,  2.19it/s]
Epoch 49 Iter 161: loss 0.17322. :  71%|██████████████████████████████▋            | 160/224 [01:15<00:29,  2.19it/s]
Epoch 49 Iter 161: loss 0.17322. :  72%|██████████████████████████████▉            | 161/224 [01:15<00:28,  2.21it/s]
Epoch 49 Iter 162: loss 0.17544. :  72%|██████████████████████████████▉            | 161/224 [01:15<00:28,  2.21it/s]
Epoch 49 Iter 162: loss 0.17544. :  72%|███████████████████████████████            | 162/224 [01:15<00:28,  2.21it/s]
Epoch 49 Iter 163: loss 0.18770. :  72%|███████████████████████████████            | 162/224 [01:16<00:28,  2.21it/s]
Epoch 49 Iter 163: loss 0.18770. :  73%|███████████████████████████████▎           | 163/224 [01:16<00:27,  2.19it/s]
Epoch 49 Iter 164: loss 0.17961. :  73%|███████████████████████████████▎           | 163/224 [01:16<00:27,  2.19it/s]
Epoch 49 Iter 164: loss 0.17961. :  73%|███████████████████████████████▍           | 164/224 [01:16<00:27,  2.20it/s]
Epoch 49 Iter 165: loss 0.17112. :  73%|███████████████████████████████▍           | 164/224 [01:17<00:27,  2.20it/s]
Epoch 49 Iter 165: loss 0.17112. :  74%|███████████████████████████████▋           | 165/224 [01:17<00:26,  2.20it/s]
Epoch 49 Iter 166: loss 0.17331. :  74%|███████████████████████████████▋           | 165/224 [01:17<00:26,  2.20it/s]
Epoch 49 Iter 166: loss 0.17331. :  74%|███████████████████████████████▊           | 166/224 [01:17<00:26,  2.19it/s]
Epoch 49 Iter 167: loss 0.17085. :  74%|███████████████████████████████▊           | 166/224 [01:18<00:26,  2.19it/s]
Epoch 49 Iter 167: loss 0.17085. :  75%|████████████████████████████████           | 167/224 [01:18<00:26,  2.19it/s]
Epoch 49 Iter 168: loss 0.17390. :  75%|████████████████████████████████           | 167/224 [01:18<00:26,  2.19it/s]
Epoch 49 Iter 168: loss 0.17390. :  75%|████████████████████████████████▎          | 168/224 [01:18<00:25,  2.19it/s]
Epoch 49 Iter 169: loss 0.17687. :  75%|████████████████████████████████▎          | 168/224 [01:19<00:25,  2.19it/s]
Epoch 49 Iter 169: loss 0.17687. :  75%|████████████████████████████████▍          | 169/224 [01:19<00:25,  2.19it/s]
Epoch 49 Iter 170: loss 0.16283. :  75%|████████████████████████████████▍          | 169/224 [01:19<00:25,  2.19it/s]
Epoch 49 Iter 170: loss 0.16283. :  76%|████████████████████████████████▋          | 170/224 [01:19<00:24,  2.21it/s]
Epoch 49 Iter 171: loss 0.18147. :  76%|████████████████████████████████▋          | 170/224 [01:19<00:24,  2.21it/s]
Epoch 49 Iter 171: loss 0.18147. :  76%|████████████████████████████████▊          | 171/224 [01:19<00:24,  2.20it/s]
Epoch 49 Iter 172: loss 0.15670. :  76%|████████████████████████████████▊          | 171/224 [01:20<00:24,  2.20it/s]
Epoch 49 Iter 172: loss 0.15670. :  77%|█████████████████████████████████          | 172/224 [01:20<00:23,  2.19it/s]
Epoch 49 Iter 173: loss 0.17942. :  77%|█████████████████████████████████          | 172/224 [01:20<00:23,  2.19it/s]
Epoch 49 Iter 173: loss 0.17942. :  77%|█████████████████████████████████▏         | 173/224 [01:20<00:23,  2.20it/s]
Epoch 49 Iter 174: loss 0.15459. :  77%|█████████████████████████████████▏         | 173/224 [01:21<00:23,  2.20it/s]
Epoch 49 Iter 174: loss 0.15459. :  78%|█████████████████████████████████▍         | 174/224 [01:21<00:22,  2.20it/s]
Epoch 49 Iter 175: loss 0.16546. :  78%|█████████████████████████████████▍         | 174/224 [01:21<00:22,  2.20it/s]
Epoch 49 Iter 175: loss 0.16546. :  78%|█████████████████████████████████▌         | 175/224 [01:21<00:22,  2.18it/s]
Epoch 49 Iter 176: loss 0.17325. :  78%|█████████████████████████████████▌         | 175/224 [01:22<00:22,  2.18it/s]
Epoch 49 Iter 176: loss 0.17325. :  79%|█████████████████████████████████▊         | 176/224 [01:22<00:22,  2.18it/s]
Epoch 49 Iter 177: loss 0.16917. :  79%|█████████████████████████████████▊         | 176/224 [01:22<00:22,  2.18it/s]
Epoch 49 Iter 177: loss 0.16917. :  79%|█████████████████████████████████▉         | 177/224 [01:22<00:21,  2.18it/s]
Epoch 49 Iter 178: loss 0.19080. :  79%|█████████████████████████████████▉         | 177/224 [01:23<00:21,  2.18it/s]
Epoch 49 Iter 178: loss 0.19080. :  79%|██████████████████████████████████▏        | 178/224 [01:23<00:20,  2.19it/s]
Epoch 49 Iter 179: loss 0.17461. :  79%|██████████████████████████████████▏        | 178/224 [01:23<00:20,  2.19it/s]
Epoch 49 Iter 179: loss 0.17461. :  80%|██████████████████████████████████▎        | 179/224 [01:23<00:20,  2.20it/s]
Epoch 49 Iter 180: loss 0.17121. :  80%|██████████████████████████████████▎        | 179/224 [01:24<00:20,  2.20it/s]
Epoch 49 Iter 180: loss 0.17121. :  80%|██████████████████████████████████▌        | 180/224 [01:24<00:20,  2.17it/s]
Epoch 49 Iter 181: loss 0.16243. :  80%|██████████████████████████████████▌        | 180/224 [01:24<00:20,  2.17it/s]
Epoch 49 Iter 181: loss 0.16243. :  81%|██████████████████████████████████▋        | 181/224 [01:24<00:19,  2.17it/s]
Epoch 49 Iter 182: loss 0.17320. :  81%|██████████████████████████████████▋        | 181/224 [01:24<00:19,  2.17it/s]
Epoch 49 Iter 182: loss 0.17320. :  81%|██████████████████████████████████▉        | 182/224 [01:24<00:19,  2.18it/s]
Epoch 49 Iter 183: loss 0.15861. :  81%|██████████████████████████████████▉        | 182/224 [01:25<00:19,  2.18it/s]
Epoch 49 Iter 183: loss 0.15861. :  82%|███████████████████████████████████▏       | 183/224 [01:25<00:18,  2.18it/s]
Epoch 49 Iter 184: loss 0.18471. :  82%|███████████████████████████████████▏       | 183/224 [01:25<00:18,  2.18it/s]
Epoch 49 Iter 184: loss 0.18471. :  82%|███████████████████████████████████▎       | 184/224 [01:25<00:18,  2.19it/s]
Epoch 49 Iter 185: loss 0.18193. :  82%|███████████████████████████████████▎       | 184/224 [01:26<00:18,  2.19it/s]
Epoch 49 Iter 185: loss 0.18193. :  83%|███████████████████████████████████▌       | 185/224 [01:26<00:17,  2.18it/s]
Epoch 49 Iter 186: loss 0.17499. :  83%|███████████████████████████████████▌       | 185/224 [01:26<00:17,  2.18it/s]
Epoch 49 Iter 186: loss 0.17499. :  83%|███████████████████████████████████▋       | 186/224 [01:26<00:17,  2.17it/s]
Epoch 49 Iter 187: loss 0.16970. :  83%|███████████████████████████████████▋       | 186/224 [01:27<00:17,  2.17it/s]
Epoch 49 Iter 187: loss 0.16970. :  83%|███████████████████████████████████▉       | 187/224 [01:27<00:16,  2.18it/s]
Epoch 49 Iter 188: loss 0.19513. :  83%|███████████████████████████████████▉       | 187/224 [01:27<00:16,  2.18it/s]
Epoch 49 Iter 188: loss 0.19513. :  84%|████████████████████████████████████       | 188/224 [01:27<00:16,  2.20it/s]
Epoch 49 Iter 189: loss 0.17725. :  84%|████████████████████████████████████       | 188/224 [01:28<00:16,  2.20it/s]
Epoch 49 Iter 189: loss 0.17725. :  84%|████████████████████████████████████▎      | 189/224 [01:28<00:15,  2.19it/s]
Epoch 49 Iter 190: loss 0.17866. :  84%|████████████████████████████████████▎      | 189/224 [01:28<00:15,  2.19it/s]
Epoch 49 Iter 190: loss 0.17866. :  85%|████████████████████████████████████▍      | 190/224 [01:28<00:15,  2.17it/s]
Epoch 49 Iter 191: loss 0.18163. :  85%|████████████████████████████████████▍      | 190/224 [01:29<00:15,  2.17it/s]
Epoch 49 Iter 191: loss 0.18163. :  85%|████████████████████████████████████▋      | 191/224 [01:29<00:15,  2.17it/s]
Epoch 49 Iter 192: loss 0.15347. :  85%|████████████████████████████████████▋      | 191/224 [01:29<00:15,  2.17it/s]
Epoch 49 Iter 192: loss 0.15347. :  86%|████████████████████████████████████▊      | 192/224 [01:29<00:14,  2.18it/s]
Epoch 49 Iter 193: loss 0.19189. :  86%|████████████████████████████████████▊      | 192/224 [01:30<00:14,  2.18it/s]
Epoch 49 Iter 193: loss 0.19189. :  86%|█████████████████████████████████████      | 193/224 [01:30<00:14,  2.19it/s]
Epoch 49 Iter 194: loss 0.16580. :  86%|█████████████████████████████████████      | 193/224 [01:30<00:14,  2.19it/s]
Epoch 49 Iter 194: loss 0.16580. :  87%|█████████████████████████████████████▏     | 194/224 [01:30<00:13,  2.18it/s]
Epoch 49 Iter 195: loss 0.17682. :  87%|█████████████████████████████████████▏     | 194/224 [01:30<00:13,  2.18it/s]
Epoch 49 Iter 195: loss 0.17682. :  87%|█████████████████████████████████████▍     | 195/224 [01:30<00:13,  2.17it/s]
Epoch 49 Iter 196: loss 0.15912. :  87%|█████████████████████████████████████▍     | 195/224 [01:31<00:13,  2.17it/s]
Epoch 49 Iter 196: loss 0.15912. :  88%|█████████████████████████████████████▋     | 196/224 [01:31<00:12,  2.18it/s]
Epoch 49 Iter 197: loss 0.17397. :  88%|█████████████████████████████████████▋     | 196/224 [01:31<00:12,  2.18it/s]
Epoch 49 Iter 197: loss 0.17397. :  88%|█████████████████████████████████████▊     | 197/224 [01:31<00:12,  2.18it/s]
Epoch 49 Iter 198: loss 0.17508. :  88%|█████████████████████████████████████▊     | 197/224 [01:32<00:12,  2.18it/s]
Epoch 49 Iter 198: loss 0.17508. :  88%|██████████████████████████████████████     | 198/224 [01:32<00:11,  2.19it/s]
Epoch 49 Iter 199: loss 0.17419. :  88%|██████████████████████████████████████     | 198/224 [01:32<00:11,  2.19it/s]
Epoch 49 Iter 199: loss 0.17419. :  89%|██████████████████████████████████████▏    | 199/224 [01:32<00:11,  2.18it/s]
Epoch 49 Iter 200: loss 0.18497. :  89%|██████████████████████████████████████▏    | 199/224 [01:33<00:11,  2.18it/s]
Epoch 49 Iter 200: loss 0.18497. :  89%|██████████████████████████████████████▍    | 200/224 [01:33<00:11,  2.17it/s]
Epoch 49 Iter 201: loss 0.16876. :  89%|██████████████████████████████████████▍    | 200/224 [01:33<00:11,  2.17it/s]
Epoch 49 Iter 201: loss 0.16876. :  90%|██████████████████████████████████████▌    | 201/224 [01:33<00:10,  2.18it/s]
Epoch 49 Iter 202: loss 0.15517. :  90%|██████████████████████████████████████▌    | 201/224 [01:34<00:10,  2.18it/s]
Epoch 49 Iter 202: loss 0.15517. :  90%|██████████████████████████████████████▊    | 202/224 [01:34<00:10,  2.19it/s]
Epoch 49 Iter 203: loss 0.16019. :  90%|██████████████████████████████████████▊    | 202/224 [01:34<00:10,  2.19it/s]
Epoch 49 Iter 203: loss 0.16019. :  91%|██████████████████████████████████████▉    | 203/224 [01:34<00:09,  2.16it/s]
Epoch 49 Iter 204: loss 0.16486. :  91%|██████████████████████████████████████▉    | 203/224 [01:35<00:09,  2.16it/s]
Epoch 49 Iter 204: loss 0.16486. :  91%|███████████████████████████████████████▏   | 204/224 [01:35<00:09,  2.17it/s]
Epoch 49 Iter 205: loss 0.16578. :  91%|███████████████████████████████████████▏   | 204/224 [01:35<00:09,  2.17it/s]
Epoch 49 Iter 205: loss 0.16578. :  92%|███████████████████████████████████████▎   | 205/224 [01:35<00:08,  2.17it/s]
Epoch 49 Iter 206: loss 0.18884. :  92%|███████████████████████████████████████▎   | 205/224 [01:35<00:08,  2.17it/s]
Epoch 49 Iter 206: loss 0.18884. :  92%|███████████████████████████████████████▌   | 206/224 [01:35<00:08,  2.19it/s]
Epoch 49 Iter 207: loss 0.18444. :  92%|███████████████████████████████████████▌   | 206/224 [01:36<00:08,  2.19it/s]
Epoch 49 Iter 207: loss 0.18444. :  92%|███████████████████████████████████████▋   | 207/224 [01:36<00:07,  2.19it/s]
Epoch 49 Iter 208: loss 0.18383. :  92%|███████████████████████████████████████▋   | 207/224 [01:36<00:07,  2.19it/s]
Epoch 49 Iter 208: loss 0.18383. :  93%|███████████████████████████████████████▉   | 208/224 [01:36<00:07,  2.17it/s]
Epoch 49 Iter 209: loss 0.15937. :  93%|███████████████████████████████████████▉   | 208/224 [01:37<00:07,  2.17it/s]
Epoch 49 Iter 209: loss 0.15937. :  93%|████████████████████████████████████████   | 209/224 [01:37<00:06,  2.18it/s]
Epoch 49 Iter 210: loss 0.16940. :  93%|████████████████████████████████████████   | 209/224 [01:37<00:06,  2.18it/s]
Epoch 49 Iter 210: loss 0.16940. :  94%|████████████████████████████████████████▎  | 210/224 [01:37<00:06,  2.20it/s]
Epoch 49 Iter 211: loss 0.18034. :  94%|████████████████████████████████████████▎  | 210/224 [01:38<00:06,  2.20it/s]
Epoch 49 Iter 211: loss 0.18034. :  94%|████████████████████████████████████████▌  | 211/224 [01:38<00:05,  2.20it/s]
Epoch 49 Iter 212: loss 0.15461. :  94%|████████████████████████████████████████▌  | 211/224 [01:38<00:05,  2.20it/s]
Epoch 49 Iter 212: loss 0.15461. :  95%|████████████████████████████████████████▋  | 212/224 [01:38<00:05,  2.19it/s]
Epoch 49 Iter 213: loss 0.15642. :  95%|████████████████████████████████████████▋  | 212/224 [01:39<00:05,  2.19it/s]
Epoch 49 Iter 213: loss 0.15642. :  95%|████████████████████████████████████████▉  | 213/224 [01:39<00:05,  2.19it/s]
Epoch 49 Iter 214: loss 0.18380. :  95%|████████████████████████████████████████▉  | 213/224 [01:39<00:05,  2.19it/s]
Epoch 49 Iter 214: loss 0.18380. :  96%|█████████████████████████████████████████  | 214/224 [01:39<00:04,  2.18it/s]
Epoch 49 Iter 215: loss 0.17252. :  96%|█████████████████████████████████████████  | 214/224 [01:40<00:04,  2.18it/s]
Epoch 49 Iter 215: loss 0.17252. :  96%|█████████████████████████████████████████▎ | 215/224 [01:40<00:04,  2.17it/s]
Epoch 49 Iter 216: loss 0.18946. :  96%|█████████████████████████████████████████▎ | 215/224 [01:40<00:04,  2.17it/s]
Epoch 49 Iter 216: loss 0.18946. :  96%|█████████████████████████████████████████▍ | 216/224 [01:40<00:03,  2.17it/s]
Epoch 49 Iter 217: loss 0.17114. :  96%|█████████████████████████████████████████▍ | 216/224 [01:41<00:03,  2.17it/s]
Epoch 49 Iter 217: loss 0.17114. :  97%|█████████████████████████████████████████▋ | 217/224 [01:41<00:03,  2.13it/s]
Epoch 49 Iter 218: loss 0.18793. :  97%|█████████████████████████████████████████▋ | 217/224 [01:41<00:03,  2.13it/s]
Epoch 49 Iter 218: loss 0.18793. :  97%|█████████████████████████████████████████▊ | 218/224 [01:41<00:02,  2.14it/s]
Epoch 49 Iter 219: loss 0.16227. :  97%|█████████████████████████████████████████▊ | 218/224 [01:41<00:02,  2.14it/s]
Epoch 49 Iter 219: loss 0.16227. :  98%|██████████████████████████████████████████ | 219/224 [01:41<00:02,  2.15it/s]
Epoch 49 Iter 220: loss 0.16585. :  98%|██████████████████████████████████████████ | 219/224 [01:42<00:02,  2.15it/s]
Epoch 49 Iter 220: loss 0.16585. :  98%|██████████████████████████████████████████▏| 220/224 [01:42<00:01,  2.16it/s]
Epoch 49 Iter 221: loss 0.16648. :  98%|██████████████████████████████████████████▏| 220/224 [01:42<00:01,  2.16it/s]
Epoch 49 Iter 221: loss 0.16648. :  99%|██████████████████████████████████████████▍| 221/224 [01:42<00:01,  2.15it/s]
Epoch 49 Iter 222: loss 0.17961. :  99%|██████████████████████████████████████████▍| 221/224 [01:43<00:01,  2.15it/s]
Epoch 49 Iter 222: loss 0.17961. :  99%|██████████████████████████████████████████▌| 222/224 [01:43<00:00,  2.15it/s]
Epoch 49 Iter 223: loss 0.19305. :  99%|██████████████████████████████████████████▌| 222/224 [01:43<00:00,  2.15it/s]
Epoch 49 Iter 223: loss 0.19305. : 100%|██████████████████████████████████████████▊| 223/224 [01:43<00:00,  2.16it/s]
Epoch 49 Iter 224: loss 0.17739. : 100%|██████████████████████████████████████████▊| 223/224 [01:44<00:00,  2.16it/s]
Epoch 49 Iter 224: loss 0.17739. : 100%|███████████████████████████████████████████| 224/224 [01:44<00:00,  2.18it/s]
Epoch 49 Iter 224: loss 0.17739. : 100%|███████████████████████████████████████████| 224/224 [01:44<00:00,  2.15it/s]

    Train loss: 0.17353
    Valid loss: 0.17951
       Valid loss recons: 0.17314
       Valid loss KL-D:   63.67109
  0%|                                                                                        | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.18484. :   0%|                                                       | 0/224 [00:00<?, ?it/s]
Epoch 50 Iter 1: loss 0.18484. :   0%|▏                                              | 1/224 [00:00<01:41,  2.20it/s]
Epoch 50 Iter 2: loss 0.17248. :   0%|▏                                              | 1/224 [00:00<01:41,  2.20it/s]
Epoch 50 Iter 2: loss 0.17248. :   1%|▍                                              | 2/224 [00:00<01:40,  2.21it/s]
Epoch 50 Iter 3: loss 0.16818. :   1%|▍                                              | 2/224 [00:01<01:40,  2.21it/s]
Epoch 50 Iter 3: loss 0.16818. :   1%|▋                                              | 3/224 [00:01<01:44,  2.12it/s]
Epoch 50 Iter 4: loss 0.17683. :   1%|▋                                              | 3/224 [00:01<01:44,  2.12it/s]
Epoch 50 Iter 4: loss 0.17683. :   2%|▊                                              | 4/224 [00:01<01:42,  2.16it/s]
Epoch 50 Iter 5: loss 0.17311. :   2%|▊                                              | 4/224 [00:02<01:42,  2.16it/s]
Epoch 50 Iter 5: loss 0.17311. :   2%|█                                              | 5/224 [00:02<01:40,  2.18it/s]
Epoch 50 Iter 6: loss 0.15294. :   2%|█                                              | 5/224 [00:02<01:40,  2.18it/s]
Epoch 50 Iter 6: loss 0.15294. :   3%|█▎                                             | 6/224 [00:02<01:39,  2.19it/s]
Epoch 50 Iter 7: loss 0.17587. :   3%|█▎                                             | 6/224 [00:03<01:39,  2.19it/s]
Epoch 50 Iter 7: loss 0.17587. :   3%|█▍                                             | 7/224 [00:03<01:40,  2.16it/s]
Epoch 50 Iter 8: loss 0.17625. :   3%|█▍                                             | 7/224 [00:03<01:40,  2.16it/s]
Epoch 50 Iter 8: loss 0.17625. :   4%|█▋                                             | 8/224 [00:03<01:39,  2.18it/s]
Epoch 50 Iter 9: loss 0.18109. :   4%|█▋                                             | 8/224 [00:04<01:39,  2.18it/s]
Epoch 50 Iter 9: loss 0.18109. :   4%|█▉                                             | 9/224 [00:04<01:38,  2.19it/s]
Epoch 50 Iter 10: loss 0.17023. :   4%|█▊                                            | 9/224 [00:04<01:38,  2.19it/s]
Epoch 50 Iter 10: loss 0.17023. :   4%|██                                           | 10/224 [00:04<01:37,  2.19it/s]
Epoch 50 Iter 11: loss 0.19824. :   4%|██                                           | 10/224 [00:05<01:37,  2.19it/s]
Epoch 50 Iter 11: loss 0.19824. :   5%|██▏                                          | 11/224 [00:05<01:37,  2.19it/s]
Epoch 50 Iter 12: loss 0.16380. :   5%|██▏                                          | 11/224 [00:05<01:37,  2.19it/s]
Epoch 50 Iter 12: loss 0.16380. :   5%|██▍                                          | 12/224 [00:05<01:37,  2.17it/s]
Epoch 50 Iter 13: loss 0.16958. :   5%|██▍                                          | 12/224 [00:05<01:37,  2.17it/s]
Epoch 50 Iter 13: loss 0.16958. :   6%|██▌                                          | 13/224 [00:05<01:36,  2.18it/s]
Epoch 50 Iter 14: loss 0.16792. :   6%|██▌                                          | 13/224 [00:06<01:36,  2.18it/s]
Epoch 50 Iter 14: loss 0.16792. :   6%|██▊                                          | 14/224 [00:06<01:35,  2.19it/s]
Epoch 50 Iter 15: loss 0.17669. :   6%|██▊                                          | 14/224 [00:06<01:35,  2.19it/s]
Epoch 50 Iter 15: loss 0.17669. :   7%|███                                          | 15/224 [00:06<01:35,  2.19it/s]
Epoch 50 Iter 16: loss 0.18609. :   7%|███                                          | 15/224 [00:07<01:35,  2.19it/s]
Epoch 50 Iter 16: loss 0.18609. :   7%|███▏                                         | 16/224 [00:07<01:34,  2.19it/s]
Epoch 50 Iter 17: loss 0.16668. :   7%|███▏                                         | 16/224 [00:07<01:34,  2.19it/s]
Epoch 50 Iter 17: loss 0.16668. :   8%|███▍                                         | 17/224 [00:07<01:34,  2.18it/s]
Epoch 50 Iter 18: loss 0.20372. :   8%|███▍                                         | 17/224 [00:08<01:34,  2.18it/s]
Epoch 50 Iter 18: loss 0.20372. :   8%|███▌                                         | 18/224 [00:08<01:34,  2.19it/s]
Epoch 50 Iter 19: loss 0.18288. :   8%|███▌                                         | 18/224 [00:08<01:34,  2.19it/s]
Epoch 50 Iter 19: loss 0.18288. :   8%|███▊                                         | 19/224 [00:08<01:34,  2.17it/s]
Epoch 50 Iter 20: loss 0.14749. :   8%|███▊                                         | 19/224 [00:09<01:34,  2.17it/s]
Epoch 50 Iter 20: loss 0.14749. :   9%|████                                         | 20/224 [00:09<01:33,  2.18it/s]
Epoch 50 Iter 21: loss 0.19228. :   9%|████                                         | 20/224 [00:09<01:33,  2.18it/s]
Epoch 50 Iter 21: loss 0.19228. :   9%|████▏                                        | 21/224 [00:09<01:33,  2.16it/s]
Epoch 50 Iter 22: loss 0.16669. :   9%|████▏                                        | 21/224 [00:10<01:33,  2.16it/s]
Epoch 50 Iter 22: loss 0.16669. :  10%|████▍                                        | 22/224 [00:10<01:32,  2.17it/s]
Epoch 50 Iter 23: loss 0.16833. :  10%|████▍                                        | 22/224 [00:10<01:32,  2.17it/s]
Epoch 50 Iter 23: loss 0.16833. :  10%|████▌                                        | 23/224 [00:10<01:31,  2.19it/s]
Epoch 50 Iter 24: loss 0.16010. :  10%|████▌                                        | 23/224 [00:11<01:31,  2.19it/s]
Epoch 50 Iter 24: loss 0.16010. :  11%|████▊                                        | 24/224 [00:11<01:31,  2.19it/s]
Epoch 50 Iter 25: loss 0.16600. :  11%|████▊                                        | 24/224 [00:11<01:31,  2.19it/s]
Epoch 50 Iter 25: loss 0.16600. :  11%|█████                                        | 25/224 [00:11<01:31,  2.18it/s]
Epoch 50 Iter 26: loss 0.16803. :  11%|█████                                        | 25/224 [00:11<01:31,  2.18it/s]
Epoch 50 Iter 26: loss 0.16803. :  12%|█████▏                                       | 26/224 [00:11<01:30,  2.18it/s]
Epoch 50 Iter 27: loss 0.19074. :  12%|█████▏                                       | 26/224 [00:12<01:30,  2.18it/s]
Epoch 50 Iter 27: loss 0.19074. :  12%|█████▍                                       | 27/224 [00:12<01:30,  2.18it/s]
Epoch 50 Iter 28: loss 0.16353. :  12%|█████▍                                       | 27/224 [00:12<01:30,  2.18it/s]
Epoch 50 Iter 28: loss 0.16353. :  12%|█████▋                                       | 28/224 [00:12<01:29,  2.19it/s]
Epoch 50 Iter 29: loss 0.17059. :  12%|█████▋                                       | 28/224 [00:13<01:29,  2.19it/s]
Epoch 50 Iter 29: loss 0.17059. :  13%|█████▊                                       | 29/224 [00:13<01:29,  2.18it/s]
Epoch 50 Iter 30: loss 0.15994. :  13%|█████▊                                       | 29/224 [00:13<01:29,  2.18it/s]
Epoch 50 Iter 30: loss 0.15994. :  13%|██████                                       | 30/224 [00:13<01:30,  2.15it/s]
Epoch 50 Iter 31: loss 0.17011. :  13%|██████                                       | 30/224 [00:14<01:30,  2.15it/s]
Epoch 50 Iter 31: loss 0.17011. :  14%|██████▏                                      | 31/224 [00:14<01:29,  2.17it/s]
Epoch 50 Iter 32: loss 0.17340. :  14%|██████▏                                      | 31/224 [00:14<01:29,  2.17it/s]
Epoch 50 Iter 32: loss 0.17340. :  14%|██████▍                                      | 32/224 [00:14<01:28,  2.16it/s]
Epoch 50 Iter 33: loss 0.15921. :  14%|██████▍                                      | 32/224 [00:15<01:28,  2.16it/s]
Epoch 50 Iter 33: loss 0.15921. :  15%|██████▋                                      | 33/224 [00:15<01:28,  2.15it/s]
Epoch 50 Iter 34: loss 0.18402. :  15%|██████▋                                      | 33/224 [00:15<01:28,  2.15it/s]
Epoch 50 Iter 34: loss 0.18402. :  15%|██████▊                                      | 34/224 [00:15<01:28,  2.15it/s]
Epoch 50 Iter 35: loss 0.18289. :  15%|██████▊                                      | 34/224 [00:16<01:28,  2.15it/s]
Epoch 50 Iter 35: loss 0.18289. :  16%|███████                                      | 35/224 [00:16<01:27,  2.15it/s]
Epoch 50 Iter 36: loss 0.17236. :  16%|███████                                      | 35/224 [00:16<01:27,  2.15it/s]
Epoch 50 Iter 36: loss 0.17236. :  16%|███████▏                                     | 36/224 [00:16<01:26,  2.17it/s]
Epoch 50 Iter 37: loss 0.16850. :  16%|███████▏                                     | 36/224 [00:16<01:26,  2.17it/s]
Epoch 50 Iter 37: loss 0.16850. :  17%|███████▍                                     | 37/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 38: loss 0.17417. :  17%|███████▍                                     | 37/224 [00:17<01:25,  2.18it/s]
Epoch 50 Iter 38: loss 0.17417. :  17%|███████▋                                     | 38/224 [00:17<01:24,  2.19it/s]
Epoch 50 Iter 39: loss 0.18063. :  17%|███████▋                                     | 38/224 [00:17<01:24,  2.19it/s]
Epoch 50 Iter 39: loss 0.18063. :  17%|███████▊                                     | 39/224 [00:17<01:25,  2.17it/s]
Epoch 50 Iter 40: loss 0.17314. :  17%|███████▊                                     | 39/224 [00:18<01:25,  2.17it/s]
Epoch 50 Iter 40: loss 0.17314. :  18%|████████                                     | 40/224 [00:18<01:24,  2.19it/s]
Epoch 50 Iter 41: loss 0.17477. :  18%|████████                                     | 40/224 [00:18<01:24,  2.19it/s]
Epoch 50 Iter 41: loss 0.17477. :  18%|████████▏                                    | 41/224 [00:18<01:25,  2.14it/s]
Epoch 50 Iter 42: loss 0.17253. :  18%|████████▏                                    | 41/224 [00:19<01:25,  2.14it/s]
Epoch 50 Iter 42: loss 0.17253. :  19%|████████▍                                    | 42/224 [00:19<01:25,  2.14it/s]
Epoch 50 Iter 43: loss 0.16055. :  19%|████████▍                                    | 42/224 [00:19<01:25,  2.14it/s]
Epoch 50 Iter 43: loss 0.16055. :  19%|████████▋                                    | 43/224 [00:19<01:24,  2.14it/s]
Epoch 50 Iter 44: loss 0.18033. :  19%|████████▋                                    | 43/224 [00:20<01:24,  2.14it/s]
Epoch 50 Iter 44: loss 0.18033. :  20%|████████▊                                    | 44/224 [00:20<01:24,  2.13it/s]
Epoch 50 Iter 45: loss 0.16135. :  20%|████████▊                                    | 44/224 [00:20<01:24,  2.13it/s]
Epoch 50 Iter 45: loss 0.16135. :  20%|█████████                                    | 45/224 [00:20<01:23,  2.14it/s]
Epoch 50 Iter 46: loss 0.19517. :  20%|█████████                                    | 45/224 [00:21<01:23,  2.14it/s]
Epoch 50 Iter 46: loss 0.19517. :  21%|█████████▏                                   | 46/224 [00:21<01:23,  2.14it/s]
Epoch 50 Iter 47: loss 0.19729. :  21%|█████████▏                                   | 46/224 [00:21<01:23,  2.14it/s]
Epoch 50 Iter 47: loss 0.19729. :  21%|█████████▍                                   | 47/224 [00:21<01:21,  2.16it/s]
Epoch 50 Iter 48: loss 0.15667. :  21%|█████████▍                                   | 47/224 [00:22<01:21,  2.16it/s]
Epoch 50 Iter 48: loss 0.15667. :  21%|█████████▋                                   | 48/224 [00:22<01:21,  2.15it/s]
Epoch 50 Iter 49: loss 0.17745. :  21%|█████████▋                                   | 48/224 [00:22<01:21,  2.15it/s]
Epoch 50 Iter 49: loss 0.17745. :  22%|█████████▊                                   | 49/224 [00:22<01:21,  2.15it/s]
Epoch 50 Iter 50: loss 0.16696. :  22%|█████████▊                                   | 49/224 [00:23<01:21,  2.15it/s]
Epoch 50 Iter 50: loss 0.16696. :  22%|██████████                                   | 50/224 [00:23<01:19,  2.18it/s]
Epoch 50 Iter 51: loss 0.16433. :  22%|██████████                                   | 50/224 [00:23<01:19,  2.18it/s]
Epoch 50 Iter 51: loss 0.16433. :  23%|██████████▏                                  | 51/224 [00:23<01:19,  2.18it/s]
Epoch 50 Iter 52: loss 0.18621. :  23%|██████████▏                                  | 51/224 [00:23<01:19,  2.18it/s]
Epoch 50 Iter 52: loss 0.18621. :  23%|██████████▍                                  | 52/224 [00:23<01:18,  2.18it/s]
Epoch 50 Iter 53: loss 0.17246. :  23%|██████████▍                                  | 52/224 [00:24<01:18,  2.18it/s]
Epoch 50 Iter 53: loss 0.17246. :  24%|██████████▋                                  | 53/224 [00:24<01:18,  2.17it/s]
Epoch 50 Iter 54: loss 0.18105. :  24%|██████████▋                                  | 53/224 [00:24<01:18,  2.17it/s]
Epoch 50 Iter 54: loss 0.18105. :  24%|██████████▊                                  | 54/224 [00:24<01:17,  2.20it/s]
Epoch 50 Iter 55: loss 0.15782. :  24%|██████████▊                                  | 54/224 [00:25<01:17,  2.20it/s]
Epoch 50 Iter 55: loss 0.15782. :  25%|███████████                                  | 55/224 [00:25<01:16,  2.20it/s]
Epoch 50 Iter 56: loss 0.19319. :  25%|███████████                                  | 55/224 [00:25<01:16,  2.20it/s]
Epoch 50 Iter 56: loss 0.19319. :  25%|███████████▎                                 | 56/224 [00:25<01:16,  2.20it/s]
Epoch 50 Iter 57: loss 0.18920. :  25%|███████████▎                                 | 56/224 [00:26<01:16,  2.20it/s]
Epoch 50 Iter 57: loss 0.18920. :  25%|███████████▍                                 | 57/224 [00:26<01:16,  2.19it/s]
Epoch 50 Iter 58: loss 0.17392. :  25%|███████████▍                                 | 57/224 [00:26<01:16,  2.19it/s]
Epoch 50 Iter 58: loss 0.17392. :  26%|███████████▋                                 | 58/224 [00:26<01:15,  2.19it/s]
Epoch 50 Iter 59: loss 0.18035. :  26%|███████████▋                                 | 58/224 [00:27<01:15,  2.19it/s]
Epoch 50 Iter 59: loss 0.18035. :  26%|███████████▊                                 | 59/224 [00:27<01:15,  2.19it/s]
Epoch 50 Iter 60: loss 0.15922. :  26%|███████████▊                                 | 59/224 [00:27<01:15,  2.19it/s]
Epoch 50 Iter 60: loss 0.15922. :  27%|████████████                                 | 60/224 [00:27<01:14,  2.20it/s]
Epoch 50 Iter 61: loss 0.15287. :  27%|████████████                                 | 60/224 [00:28<01:14,  2.20it/s]
Epoch 50 Iter 61: loss 0.15287. :  27%|████████████▎                                | 61/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 62: loss 0.16008. :  27%|████████████▎                                | 61/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 62: loss 0.16008. :  28%|████████████▍                                | 62/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 63: loss 0.17279. :  28%|████████████▍                                | 62/224 [00:28<01:14,  2.19it/s]
Epoch 50 Iter 63: loss 0.17279. :  28%|████████████▋                                | 63/224 [00:28<01:13,  2.19it/s]
Epoch 50 Iter 64: loss 0.17697. :  28%|████████████▋                                | 63/224 [00:29<01:13,  2.19it/s]
Epoch 50 Iter 64: loss 0.17697. :  29%|████████████▊                                | 64/224 [00:29<01:12,  2.20it/s]
Epoch 50 Iter 65: loss 0.16375. :  29%|████████████▊                                | 64/224 [00:29<01:12,  2.20it/s]
Epoch 50 Iter 65: loss 0.16375. :  29%|█████████████                                | 65/224 [00:29<01:11,  2.22it/s]
Epoch 50 Iter 66: loss 0.16789. :  29%|█████████████                                | 65/224 [00:30<01:11,  2.22it/s]
Epoch 50 Iter 66: loss 0.16789. :  29%|█████████████▎                               | 66/224 [00:30<01:12,  2.19it/s]
Epoch 50 Iter 67: loss 0.15716. :  29%|█████████████▎                               | 66/224 [00:31<01:12,  2.19it/s]
Epoch 50 Iter 67: loss 0.15716. :  30%|█████████████▍                               | 67/224 [00:31<01:36,  1.63it/s]
Epoch 50 Iter 68: loss 0.16858. :  30%|█████████████▍                               | 67/224 [00:31<01:36,  1.63it/s]
Epoch 50 Iter 68: loss 0.16858. :  30%|█████████████▋                               | 68/224 [00:31<01:30,  1.72it/s]
Epoch 50 Iter 69: loss 0.15372. :  30%|█████████████▋                               | 68/224 [00:32<01:30,  1.72it/s]
Epoch 50 Iter 69: loss 0.15372. :  31%|█████████████▊                               | 69/224 [00:32<01:24,  1.83it/s]
Epoch 50 Iter 70: loss 0.16766. :  31%|█████████████▊                               | 69/224 [00:32<01:24,  1.83it/s]
Epoch 50 Iter 70: loss 0.16766. :  31%|██████████████                               | 70/224 [00:32<01:21,  1.88it/s]
Epoch 50 Iter 71: loss 0.19339. :  31%|██████████████                               | 70/224 [00:33<01:21,  1.88it/s]
Epoch 50 Iter 71: loss 0.19339. :  32%|██████████████▎                              | 71/224 [00:33<01:18,  1.95it/s]
Epoch 50 Iter 72: loss 0.17440. :  32%|██████████████▎                              | 71/224 [00:33<01:18,  1.95it/s]
Epoch 50 Iter 72: loss 0.17440. :  32%|██████████████▍                              | 72/224 [00:33<01:15,  2.02it/s]
Epoch 50 Iter 73: loss 0.16479. :  32%|██████████████▍                              | 72/224 [00:34<01:15,  2.02it/s]
Epoch 50 Iter 73: loss 0.16479. :  33%|██████████████▋                              | 73/224 [00:34<01:12,  2.07it/s]
Epoch 50 Iter 74: loss 0.17920. :  33%|██████████████▋                              | 73/224 [00:34<01:12,  2.07it/s]
Epoch 50 Iter 74: loss 0.17920. :  33%|██████████████▊                              | 74/224 [00:34<01:11,  2.11it/s]
Epoch 50 Iter 75: loss 0.18359. :  33%|██████████████▊                              | 74/224 [00:35<01:11,  2.11it/s]
Epoch 50 Iter 75: loss 0.18359. :  33%|███████████████                              | 75/224 [00:35<01:10,  2.11it/s]
Epoch 50 Iter 76: loss 0.17762. :  33%|███████████████                              | 75/224 [00:35<01:10,  2.11it/s]
Epoch 50 Iter 76: loss 0.17762. :  34%|███████████████▎                             | 76/224 [00:35<01:09,  2.14it/s]
Epoch 50 Iter 77: loss 0.16407. :  34%|███████████████▎                             | 76/224 [00:35<01:09,  2.14it/s]
Epoch 50 Iter 77: loss 0.16407. :  34%|███████████████▍                             | 77/224 [00:35<01:07,  2.17it/s]
Epoch 50 Iter 78: loss 0.16302. :  34%|███████████████▍                             | 77/224 [00:36<01:07,  2.17it/s]
Epoch 50 Iter 78: loss 0.16302. :  35%|███████████████▋                             | 78/224 [00:36<01:07,  2.17it/s]
Epoch 50 Iter 79: loss 0.17111. :  35%|███████████████▋                             | 78/224 [00:36<01:07,  2.17it/s]
Epoch 50 Iter 79: loss 0.17111. :  35%|███████████████▊                             | 79/224 [00:36<01:06,  2.19it/s]
Epoch 50 Iter 80: loss 0.18897. :  35%|███████████████▊                             | 79/224 [00:37<01:06,  2.19it/s]
Epoch 50 Iter 80: loss 0.18897. :  36%|████████████████                             | 80/224 [00:37<01:05,  2.20it/s]
Epoch 50 Iter 81: loss 0.16549. :  36%|████████████████                             | 80/224 [00:37<01:05,  2.20it/s]
Epoch 50 Iter 81: loss 0.16549. :  36%|████████████████▎                            | 81/224 [00:37<01:05,  2.18it/s]
Epoch 50 Iter 82: loss 0.19445. :  36%|████████████████▎                            | 81/224 [00:38<01:05,  2.18it/s]
Epoch 50 Iter 82: loss 0.19445. :  37%|████████████████▍                            | 82/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 83: loss 0.17965. :  37%|████████████████▍                            | 82/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 83: loss 0.17965. :  37%|████████████████▋                            | 83/224 [00:38<01:04,  2.19it/s]
Epoch 50 Iter 84: loss 0.18427. :  37%|████████████████▋                            | 83/224 [00:39<01:04,  2.19it/s]
Epoch 50 Iter 84: loss 0.18427. :  38%|████████████████▉                            | 84/224 [00:39<01:03,  2.19it/s]
Epoch 50 Iter 85: loss 0.16442. :  38%|████████████████▉                            | 84/224 [00:39<01:03,  2.19it/s]
Epoch 50 Iter 85: loss 0.16442. :  38%|█████████████████                            | 85/224 [00:39<01:03,  2.20it/s]
Epoch 50 Iter 86: loss 0.17718. :  38%|█████████████████                            | 85/224 [00:40<01:03,  2.20it/s]
Epoch 50 Iter 86: loss 0.17718. :  38%|█████████████████▎                           | 86/224 [00:40<01:02,  2.21it/s]
Epoch 50 Iter 87: loss 0.17450. :  38%|█████████████████▎                           | 86/224 [00:40<01:02,  2.21it/s]
Epoch 50 Iter 87: loss 0.17450. :  39%|█████████████████▍                           | 87/224 [00:40<01:01,  2.22it/s]
Epoch 50 Iter 88: loss 0.16218. :  39%|█████████████████▍                           | 87/224 [00:40<01:01,  2.22it/s]
Epoch 50 Iter 88: loss 0.16218. :  39%|█████████████████▋                           | 88/224 [00:40<01:01,  2.22it/s]
Epoch 50 Iter 89: loss 0.18548. :  39%|█████████████████▋                           | 88/224 [00:41<01:01,  2.22it/s]
Epoch 50 Iter 89: loss 0.18548. :  40%|█████████████████▉                           | 89/224 [00:41<01:00,  2.22it/s]
Epoch 50 Iter 90: loss 0.16621. :  40%|█████████████████▉                           | 89/224 [00:41<01:00,  2.22it/s]
Epoch 50 Iter 90: loss 0.16621. :  40%|██████████████████                           | 90/224 [00:41<01:00,  2.22it/s]
Epoch 50 Iter 91: loss 0.19464. :  40%|██████████████████                           | 90/224 [00:42<01:00,  2.22it/s]
Epoch 50 Iter 91: loss 0.19464. :  41%|██████████████████▎                          | 91/224 [00:42<00:59,  2.22it/s]
Epoch 50 Iter 92: loss 0.17494. :  41%|██████████████████▎                          | 91/224 [00:42<00:59,  2.22it/s]
Epoch 50 Iter 92: loss 0.17494. :  41%|██████████████████▍                          | 92/224 [00:42<00:59,  2.22it/s]
Epoch 50 Iter 93: loss 0.17858. :  41%|██████████████████▍                          | 92/224 [00:43<00:59,  2.22it/s]
Epoch 50 Iter 93: loss 0.17858. :  42%|██████████████████▋                          | 93/224 [00:43<00:59,  2.22it/s]
Epoch 50 Iter 94: loss 0.17242. :  42%|██████████████████▋                          | 93/224 [00:43<00:59,  2.22it/s]
Epoch 50 Iter 94: loss 0.17242. :  42%|██████████████████▉                          | 94/224 [00:43<00:58,  2.22it/s]
Epoch 50 Iter 95: loss 0.17856. :  42%|██████████████████▉                          | 94/224 [00:44<00:58,  2.22it/s]
Epoch 50 Iter 95: loss 0.17856. :  42%|███████████████████                          | 95/224 [00:44<00:58,  2.22it/s]
Epoch 50 Iter 96: loss 0.17772. :  42%|███████████████████                          | 95/224 [00:44<00:58,  2.22it/s]
Epoch 50 Iter 96: loss 0.17772. :  43%|███████████████████▎                         | 96/224 [00:44<00:57,  2.22it/s]
Epoch 50 Iter 97: loss 0.16495. :  43%|███████████████████▎                         | 96/224 [00:44<00:57,  2.22it/s]
Epoch 50 Iter 97: loss 0.16495. :  43%|███████████████████▍                         | 97/224 [00:44<00:56,  2.24it/s]
Epoch 50 Iter 98: loss 0.17321. :  43%|███████████████████▍                         | 97/224 [00:45<00:56,  2.24it/s]
Epoch 50 Iter 98: loss 0.17321. :  44%|███████████████████▋                         | 98/224 [00:45<00:56,  2.24it/s]
Epoch 50 Iter 99: loss 0.17503. :  44%|███████████████████▋                         | 98/224 [00:45<00:56,  2.24it/s]
Epoch 50 Iter 99: loss 0.17503. :  44%|███████████████████▉                         | 99/224 [00:45<00:55,  2.24it/s]
Epoch 50 Iter 100: loss 0.17790. :  44%|███████████████████▍                        | 99/224 [00:46<00:55,  2.24it/s]
Epoch 50 Iter 100: loss 0.17790. :  45%|███████████████████▏                       | 100/224 [00:46<00:55,  2.25it/s]
Epoch 50 Iter 101: loss 0.18754. :  45%|███████████████████▏                       | 100/224 [00:46<00:55,  2.25it/s]
Epoch 50 Iter 101: loss 0.18754. :  45%|███████████████████▍                       | 101/224 [00:46<00:54,  2.24it/s]
Epoch 50 Iter 102: loss 0.16246. :  45%|███████████████████▍                       | 101/224 [00:47<00:54,  2.24it/s]
Epoch 50 Iter 102: loss 0.16246. :  46%|███████████████████▌                       | 102/224 [00:47<00:54,  2.24it/s]
Epoch 50 Iter 103: loss 0.16897. :  46%|███████████████████▌                       | 102/224 [00:47<00:54,  2.24it/s]
Epoch 50 Iter 103: loss 0.16897. :  46%|███████████████████▊                       | 103/224 [00:47<00:54,  2.24it/s]
Epoch 50 Iter 104: loss 0.18034. :  46%|███████████████████▊                       | 103/224 [00:48<00:54,  2.24it/s]
Epoch 50 Iter 104: loss 0.18034. :  46%|███████████████████▉                       | 104/224 [00:48<00:53,  2.24it/s]
Epoch 50 Iter 105: loss 0.17794. :  46%|███████████████████▉                       | 104/224 [00:48<00:53,  2.24it/s]
Epoch 50 Iter 105: loss 0.17794. :  47%|████████████████████▏                      | 105/224 [00:48<00:53,  2.24it/s]
Epoch 50 Iter 106: loss 0.18384. :  47%|████████████████████▏                      | 105/224 [00:49<00:53,  2.24it/s]
Epoch 50 Iter 106: loss 0.18384. :  47%|████████████████████▎                      | 106/224 [00:49<00:53,  2.23it/s]
Epoch 50 Iter 107: loss 0.16525. :  47%|████████████████████▎                      | 106/224 [00:49<00:53,  2.23it/s]
Epoch 50 Iter 107: loss 0.16525. :  48%|████████████████████▌                      | 107/224 [00:49<00:52,  2.24it/s]
Epoch 50 Iter 108: loss 0.19783. :  48%|████████████████████▌                      | 107/224 [00:49<00:52,  2.24it/s]
Epoch 50 Iter 108: loss 0.19783. :  48%|████████████████████▋                      | 108/224 [00:49<00:52,  2.23it/s]
Epoch 50 Iter 109: loss 0.18230. :  48%|████████████████████▋                      | 108/224 [00:50<00:52,  2.23it/s]
Epoch 50 Iter 109: loss 0.18230. :  49%|████████████████████▉                      | 109/224 [00:50<00:51,  2.24it/s]
Epoch 50 Iter 110: loss 0.17599. :  49%|████████████████████▉                      | 109/224 [00:50<00:51,  2.24it/s]
Epoch 50 Iter 110: loss 0.17599. :  49%|█████████████████████                      | 110/224 [00:50<00:51,  2.23it/s]
Epoch 50 Iter 111: loss 0.16234. :  49%|█████████████████████                      | 110/224 [00:51<00:51,  2.23it/s]
Epoch 50 Iter 111: loss 0.16234. :  50%|█████████████████████▎                     | 111/224 [00:51<00:50,  2.23it/s]
Epoch 50 Iter 112: loss 0.17590. :  50%|█████████████████████▎                     | 111/224 [00:51<00:50,  2.23it/s]
Epoch 50 Iter 112: loss 0.17590. :  50%|█████████████████████▌                     | 112/224 [00:51<00:50,  2.23it/s]
Epoch 50 Iter 113: loss 0.16403. :  50%|█████████████████████▌                     | 112/224 [00:52<00:50,  2.23it/s]
Epoch 50 Iter 113: loss 0.16403. :  50%|█████████████████████▋                     | 113/224 [00:52<00:49,  2.23it/s]
Epoch 50 Iter 114: loss 0.16600. :  50%|█████████████████████▋                     | 113/224 [00:52<00:49,  2.23it/s]
Epoch 50 Iter 114: loss 0.16600. :  51%|█████████████████████▉                     | 114/224 [00:52<00:49,  2.23it/s]
Epoch 50 Iter 115: loss 0.14441. :  51%|█████████████████████▉                     | 114/224 [00:53<00:49,  2.23it/s]
Epoch 50 Iter 115: loss 0.14441. :  51%|██████████████████████                     | 115/224 [00:53<00:49,  2.22it/s]
Epoch 50 Iter 116: loss 0.16602. :  51%|██████████████████████                     | 115/224 [00:53<00:49,  2.22it/s]
Epoch 50 Iter 116: loss 0.16602. :  52%|██████████████████████▎                    | 116/224 [00:53<00:48,  2.22it/s]
Epoch 50 Iter 117: loss 0.17339. :  52%|██████████████████████▎                    | 116/224 [00:53<00:48,  2.22it/s]
Epoch 50 Iter 117: loss 0.17339. :  52%|██████████████████████▍                    | 117/224 [00:53<00:48,  2.22it/s]
Epoch 50 Iter 118: loss 0.16664. :  52%|██████████████████████▍                    | 117/224 [00:54<00:48,  2.22it/s]
Epoch 50 Iter 118: loss 0.16664. :  53%|██████████████████████▋                    | 118/224 [00:54<00:47,  2.23it/s]
Epoch 50 Iter 119: loss 0.17857. :  53%|██████████████████████▋                    | 118/224 [00:54<00:47,  2.23it/s]
Epoch 50 Iter 119: loss 0.17857. :  53%|██████████████████████▊                    | 119/224 [00:54<00:46,  2.24it/s]
Epoch 50 Iter 120: loss 0.16984. :  53%|██████████████████████▊                    | 119/224 [00:55<00:46,  2.24it/s]
Epoch 50 Iter 120: loss 0.16984. :  54%|███████████████████████                    | 120/224 [00:55<00:46,  2.24it/s]
Epoch 50 Iter 121: loss 0.15513. :  54%|███████████████████████                    | 120/224 [00:55<00:46,  2.24it/s]
Epoch 50 Iter 121: loss 0.15513. :  54%|███████████████████████▏                   | 121/224 [00:55<00:46,  2.24it/s]
Epoch 50 Iter 122: loss 0.15287. :  54%|███████████████████████▏                   | 121/224 [00:56<00:46,  2.24it/s]
Epoch 50 Iter 122: loss 0.15287. :  54%|███████████████████████▍                   | 122/224 [00:56<00:45,  2.23it/s]
Epoch 50 Iter 123: loss 0.18804. :  54%|███████████████████████▍                   | 122/224 [00:56<00:45,  2.23it/s]
Epoch 50 Iter 123: loss 0.18804. :  55%|███████████████████████▌                   | 123/224 [00:56<00:45,  2.24it/s]
Epoch 50 Iter 124: loss 0.17018. :  55%|███████████████████████▌                   | 123/224 [00:57<00:45,  2.24it/s]
Epoch 50 Iter 124: loss 0.17018. :  55%|███████████████████████▊                   | 124/224 [00:57<00:44,  2.23it/s]
Epoch 50 Iter 125: loss 0.19263. :  55%|███████████████████████▊                   | 124/224 [00:57<00:44,  2.23it/s]
Epoch 50 Iter 125: loss 0.19263. :  56%|███████████████████████▉                   | 125/224 [00:57<00:44,  2.22it/s]
Epoch 50 Iter 126: loss 0.16280. :  56%|███████████████████████▉                   | 125/224 [00:57<00:44,  2.22it/s]
Epoch 50 Iter 126: loss 0.16280. :  56%|████████████████████████▏                  | 126/224 [00:57<00:44,  2.23it/s]
Epoch 50 Iter 127: loss 0.19012. :  56%|████████████████████████▏                  | 126/224 [00:58<00:44,  2.23it/s]
Epoch 50 Iter 127: loss 0.19012. :  57%|████████████████████████▍                  | 127/224 [00:58<00:43,  2.23it/s]
Epoch 50 Iter 128: loss 0.19089. :  57%|████████████████████████▍                  | 127/224 [00:58<00:43,  2.23it/s]
Epoch 50 Iter 128: loss 0.19089. :  57%|████████████████████████▌                  | 128/224 [00:58<00:42,  2.24it/s]
Epoch 50 Iter 129: loss 0.15470. :  57%|████████████████████████▌                  | 128/224 [00:59<00:42,  2.24it/s]
Epoch 50 Iter 129: loss 0.15470. :  58%|████████████████████████▊                  | 129/224 [00:59<00:42,  2.22it/s]
Epoch 50 Iter 130: loss 0.18250. :  58%|████████████████████████▊                  | 129/224 [00:59<00:42,  2.22it/s]
Epoch 50 Iter 130: loss 0.18250. :  58%|████████████████████████▉                  | 130/224 [00:59<00:42,  2.22it/s]
Epoch 50 Iter 131: loss 0.15939. :  58%|████████████████████████▉                  | 130/224 [01:00<00:42,  2.22it/s]
Epoch 50 Iter 131: loss 0.15939. :  58%|█████████████████████████▏                 | 131/224 [01:00<00:41,  2.22it/s]
Epoch 50 Iter 132: loss 0.17363. :  58%|█████████████████████████▏                 | 131/224 [01:00<00:41,  2.22it/s]
Epoch 50 Iter 132: loss 0.17363. :  59%|█████████████████████████▎                 | 132/224 [01:00<00:41,  2.22it/s]
Epoch 50 Iter 133: loss 0.16604. :  59%|█████████████████████████▎                 | 132/224 [01:01<00:41,  2.22it/s]
Epoch 50 Iter 133: loss 0.16604. :  59%|█████████████████████████▌                 | 133/224 [01:01<00:41,  2.22it/s]
Epoch 50 Iter 134: loss 0.18077. :  59%|█████████████████████████▌                 | 133/224 [01:01<00:41,  2.22it/s]
Epoch 50 Iter 134: loss 0.18077. :  60%|█████████████████████████▋                 | 134/224 [01:01<00:40,  2.22it/s]
Epoch 50 Iter 135: loss 0.18360. :  60%|█████████████████████████▋                 | 134/224 [01:02<00:40,  2.22it/s]
Epoch 50 Iter 135: loss 0.18360. :  60%|█████████████████████████▉                 | 135/224 [01:02<00:40,  2.22it/s]
Epoch 50 Iter 136: loss 0.17887. :  60%|█████████████████████████▉                 | 135/224 [01:02<00:40,  2.22it/s]
Epoch 50 Iter 136: loss 0.17887. :  61%|██████████████████████████                 | 136/224 [01:02<00:39,  2.23it/s]
Epoch 50 Iter 137: loss 0.16608. :  61%|██████████████████████████                 | 136/224 [01:02<00:39,  2.23it/s]
Epoch 50 Iter 137: loss 0.16608. :  61%|██████████████████████████▎                | 137/224 [01:02<00:39,  2.23it/s]
Epoch 50 Iter 138: loss 0.16909. :  61%|██████████████████████████▎                | 137/224 [01:03<00:39,  2.23it/s]
Epoch 50 Iter 138: loss 0.16909. :  62%|██████████████████████████▍                | 138/224 [01:03<00:38,  2.23it/s]
Epoch 50 Iter 139: loss 0.17286. :  62%|██████████████████████████▍                | 138/224 [01:03<00:38,  2.23it/s]
Epoch 50 Iter 139: loss 0.17286. :  62%|██████████████████████████▋                | 139/224 [01:03<00:38,  2.22it/s]
Epoch 50 Iter 140: loss 0.17010. :  62%|██████████████████████████▋                | 139/224 [01:04<00:38,  2.22it/s]
Epoch 50 Iter 140: loss 0.17010. :  62%|██████████████████████████▉                | 140/224 [01:04<00:37,  2.21it/s]
Epoch 50 Iter 141: loss 0.17905. :  62%|██████████████████████████▉                | 140/224 [01:04<00:37,  2.21it/s]
Epoch 50 Iter 141: loss 0.17905. :  63%|███████████████████████████                | 141/224 [01:04<00:37,  2.23it/s]
Epoch 50 Iter 142: loss 0.18469. :  63%|███████████████████████████                | 141/224 [01:05<00:37,  2.23it/s]
Epoch 50 Iter 142: loss 0.18469. :  63%|███████████████████████████▎               | 142/224 [01:05<00:36,  2.23it/s]
Epoch 50 Iter 143: loss 0.18268. :  63%|███████████████████████████▎               | 142/224 [01:05<00:36,  2.23it/s]
Epoch 50 Iter 143: loss 0.18268. :  64%|███████████████████████████▍               | 143/224 [01:05<00:36,  2.22it/s]
Epoch 50 Iter 144: loss 0.16525. :  64%|███████████████████████████▍               | 143/224 [01:06<00:36,  2.22it/s]
Epoch 50 Iter 144: loss 0.16525. :  64%|███████████████████████████▋               | 144/224 [01:06<00:36,  2.22it/s]
Epoch 50 Iter 145: loss 0.16509. :  64%|███████████████████████████▋               | 144/224 [01:06<00:36,  2.22it/s]
Epoch 50 Iter 145: loss 0.16509. :  65%|███████████████████████████▊               | 145/224 [01:06<00:35,  2.22it/s]
Epoch 50 Iter 146: loss 0.18517. :  65%|███████████████████████████▊               | 145/224 [01:06<00:35,  2.22it/s]
Epoch 50 Iter 146: loss 0.18517. :  65%|████████████████████████████               | 146/224 [01:06<00:34,  2.23it/s]
Epoch 50 Iter 147: loss 0.17796. :  65%|████████████████████████████               | 146/224 [01:07<00:34,  2.23it/s]
Epoch 50 Iter 147: loss 0.17796. :  66%|████████████████████████████▏              | 147/224 [01:07<00:34,  2.22it/s]
Epoch 50 Iter 148: loss 0.18166. :  66%|████████████████████████████▏              | 147/224 [01:07<00:34,  2.22it/s]
Epoch 50 Iter 148: loss 0.18166. :  66%|████████████████████████████▍              | 148/224 [01:07<00:34,  2.23it/s]
Epoch 50 Iter 149: loss 0.19321. :  66%|████████████████████████████▍              | 148/224 [01:08<00:34,  2.23it/s]
Epoch 50 Iter 149: loss 0.19321. :  67%|████████████████████████████▌              | 149/224 [01:08<00:33,  2.23it/s]
Epoch 50 Iter 150: loss 0.18192. :  67%|████████████████████████████▌              | 149/224 [01:08<00:33,  2.23it/s]
Epoch 50 Iter 150: loss 0.18192. :  67%|████████████████████████████▊              | 150/224 [01:08<00:33,  2.21it/s]
Epoch 50 Iter 151: loss 0.16372. :  67%|████████████████████████████▊              | 150/224 [01:09<00:33,  2.21it/s]
Epoch 50 Iter 151: loss 0.16372. :  67%|████████████████████████████▉              | 151/224 [01:09<00:33,  2.19it/s]
Epoch 50 Iter 152: loss 0.16826. :  67%|████████████████████████████▉              | 151/224 [01:09<00:33,  2.19it/s]
Epoch 50 Iter 152: loss 0.16826. :  68%|█████████████████████████████▏             | 152/224 [01:09<00:32,  2.20it/s]
Epoch 50 Iter 153: loss 0.18693. :  68%|█████████████████████████████▏             | 152/224 [01:10<00:32,  2.20it/s]
Epoch 50 Iter 153: loss 0.18693. :  68%|█████████████████████████████▎             | 153/224 [01:10<00:32,  2.21it/s]
Epoch 50 Iter 154: loss 0.15940. :  68%|█████████████████████████████▎             | 153/224 [01:10<00:32,  2.21it/s]
Epoch 50 Iter 154: loss 0.15940. :  69%|█████████████████████████████▌             | 154/224 [01:10<00:31,  2.22it/s]
Epoch 50 Iter 155: loss 0.16976. :  69%|█████████████████████████████▌             | 154/224 [01:11<00:31,  2.22it/s]
Epoch 50 Iter 155: loss 0.16976. :  69%|█████████████████████████████▊             | 155/224 [01:11<00:30,  2.23it/s]
Epoch 50 Iter 156: loss 0.15958. :  69%|█████████████████████████████▊             | 155/224 [01:11<00:30,  2.23it/s]
Epoch 50 Iter 156: loss 0.15958. :  70%|█████████████████████████████▉             | 156/224 [01:11<00:30,  2.22it/s]
Epoch 50 Iter 157: loss 0.17311. :  70%|█████████████████████████████▉             | 156/224 [01:11<00:30,  2.22it/s]
Epoch 50 Iter 157: loss 0.17311. :  70%|██████████████████████████████▏            | 157/224 [01:11<00:30,  2.22it/s]
Epoch 50 Iter 158: loss 0.16552. :  70%|██████████████████████████████▏            | 157/224 [01:12<00:30,  2.22it/s]
Epoch 50 Iter 158: loss 0.16552. :  71%|██████████████████████████████▎            | 158/224 [01:12<00:29,  2.22it/s]
Epoch 50 Iter 159: loss 0.15314. :  71%|██████████████████████████████▎            | 158/224 [01:12<00:29,  2.22it/s]
Epoch 50 Iter 159: loss 0.15314. :  71%|██████████████████████████████▌            | 159/224 [01:12<00:29,  2.22it/s]
Epoch 50 Iter 160: loss 0.18215. :  71%|██████████████████████████████▌            | 159/224 [01:13<00:29,  2.22it/s]
Epoch 50 Iter 160: loss 0.18215. :  71%|██████████████████████████████▋            | 160/224 [01:13<00:28,  2.23it/s]
Epoch 50 Iter 161: loss 0.16974. :  71%|██████████████████████████████▋            | 160/224 [01:13<00:28,  2.23it/s]
Epoch 50 Iter 161: loss 0.16974. :  72%|██████████████████████████████▉            | 161/224 [01:13<00:28,  2.24it/s]
Epoch 50 Iter 162: loss 0.19019. :  72%|██████████████████████████████▉            | 161/224 [01:14<00:28,  2.24it/s]
Epoch 50 Iter 162: loss 0.19019. :  72%|███████████████████████████████            | 162/224 [01:14<00:27,  2.24it/s]
Epoch 50 Iter 163: loss 0.16657. :  72%|███████████████████████████████            | 162/224 [01:14<00:27,  2.24it/s]
Epoch 50 Iter 163: loss 0.16657. :  73%|███████████████████████████████▎           | 163/224 [01:14<00:27,  2.24it/s]
Epoch 50 Iter 164: loss 0.18425. :  73%|███████████████████████████████▎           | 163/224 [01:15<00:27,  2.24it/s]
Epoch 50 Iter 164: loss 0.18425. :  73%|███████████████████████████████▍           | 164/224 [01:15<00:26,  2.24it/s]
Epoch 50 Iter 165: loss 0.17902. :  73%|███████████████████████████████▍           | 164/224 [01:15<00:26,  2.24it/s]
Epoch 50 Iter 165: loss 0.17902. :  74%|███████████████████████████████▋           | 165/224 [01:15<00:26,  2.24it/s]
Epoch 50 Iter 166: loss 0.14680. :  74%|███████████████████████████████▋           | 165/224 [01:15<00:26,  2.24it/s]
Epoch 50 Iter 166: loss 0.14680. :  74%|███████████████████████████████▊           | 166/224 [01:15<00:25,  2.23it/s]
Epoch 50 Iter 167: loss 0.17451. :  74%|███████████████████████████████▊           | 166/224 [01:16<00:25,  2.23it/s]
Epoch 50 Iter 167: loss 0.17451. :  75%|████████████████████████████████           | 167/224 [01:16<00:25,  2.23it/s]
Epoch 50 Iter 168: loss 0.17419. :  75%|████████████████████████████████           | 167/224 [01:16<00:25,  2.23it/s]
Epoch 50 Iter 168: loss 0.17419. :  75%|████████████████████████████████▎          | 168/224 [01:16<00:25,  2.23it/s]
Epoch 50 Iter 169: loss 0.15526. :  75%|████████████████████████████████▎          | 168/224 [01:17<00:25,  2.23it/s]
Epoch 50 Iter 169: loss 0.15526. :  75%|████████████████████████████████▍          | 169/224 [01:17<00:24,  2.23it/s]
Epoch 50 Iter 170: loss 0.15516. :  75%|████████████████████████████████▍          | 169/224 [01:17<00:24,  2.23it/s]
Epoch 50 Iter 170: loss 0.15516. :  76%|████████████████████████████████▋          | 170/224 [01:17<00:24,  2.23it/s]
Epoch 50 Iter 171: loss 0.17551. :  76%|████████████████████████████████▋          | 170/224 [01:18<00:24,  2.23it/s]
Epoch 50 Iter 171: loss 0.17551. :  76%|████████████████████████████████▊          | 171/224 [01:18<00:23,  2.23it/s]
Epoch 50 Iter 172: loss 0.17448. :  76%|████████████████████████████████▊          | 171/224 [01:18<00:23,  2.23it/s]
Epoch 50 Iter 172: loss 0.17448. :  77%|█████████████████████████████████          | 172/224 [01:18<00:23,  2.24it/s]
Epoch 50 Iter 173: loss 0.18723. :  77%|█████████████████████████████████          | 172/224 [01:19<00:23,  2.24it/s]
Epoch 50 Iter 173: loss 0.18723. :  77%|█████████████████████████████████▏         | 173/224 [01:19<00:22,  2.22it/s]
Epoch 50 Iter 174: loss 0.16129. :  77%|█████████████████████████████████▏         | 173/224 [01:19<00:22,  2.22it/s]
Epoch 50 Iter 174: loss 0.16129. :  78%|█████████████████████████████████▍         | 174/224 [01:19<00:22,  2.23it/s]
Epoch 50 Iter 175: loss 0.16749. :  78%|█████████████████████████████████▍         | 174/224 [01:20<00:22,  2.23it/s]
Epoch 50 Iter 175: loss 0.16749. :  78%|█████████████████████████████████▌         | 175/224 [01:20<00:21,  2.23it/s]
Epoch 50 Iter 176: loss 0.18805. :  78%|█████████████████████████████████▌         | 175/224 [01:20<00:21,  2.23it/s]
Epoch 50 Iter 176: loss 0.18805. :  79%|█████████████████████████████████▊         | 176/224 [01:20<00:21,  2.23it/s]
Epoch 50 Iter 177: loss 0.16301. :  79%|█████████████████████████████████▊         | 176/224 [01:20<00:21,  2.23it/s]
Epoch 50 Iter 177: loss 0.16301. :  79%|█████████████████████████████████▉         | 177/224 [01:20<00:20,  2.24it/s]
Epoch 50 Iter 178: loss 0.17070. :  79%|█████████████████████████████████▉         | 177/224 [01:21<00:20,  2.24it/s]
Epoch 50 Iter 178: loss 0.17070. :  79%|██████████████████████████████████▏        | 178/224 [01:21<00:20,  2.25it/s]
Epoch 50 Iter 179: loss 0.16412. :  79%|██████████████████████████████████▏        | 178/224 [01:21<00:20,  2.25it/s]
Epoch 50 Iter 179: loss 0.16412. :  80%|██████████████████████████████████▎        | 179/224 [01:21<00:20,  2.24it/s]
Epoch 50 Iter 180: loss 0.18404. :  80%|██████████████████████████████████▎        | 179/224 [01:22<00:20,  2.24it/s]
Epoch 50 Iter 180: loss 0.18404. :  80%|██████████████████████████████████▌        | 180/224 [01:22<00:19,  2.23it/s]
Epoch 50 Iter 181: loss 0.16440. :  80%|██████████████████████████████████▌        | 180/224 [01:22<00:19,  2.23it/s]
Epoch 50 Iter 181: loss 0.16440. :  81%|██████████████████████████████████▋        | 181/224 [01:22<00:19,  2.24it/s]
Epoch 50 Iter 182: loss 0.18175. :  81%|██████████████████████████████████▋        | 181/224 [01:23<00:19,  2.24it/s]
Epoch 50 Iter 182: loss 0.18175. :  81%|██████████████████████████████████▉        | 182/224 [01:23<00:18,  2.25it/s]
Epoch 50 Iter 183: loss 0.17006. :  81%|██████████████████████████████████▉        | 182/224 [01:23<00:18,  2.25it/s]
Epoch 50 Iter 183: loss 0.17006. :  82%|███████████████████████████████████▏       | 183/224 [01:23<00:18,  2.25it/s]
Epoch 50 Iter 184: loss 0.17791. :  82%|███████████████████████████████████▏       | 183/224 [01:24<00:18,  2.25it/s]
Epoch 50 Iter 184: loss 0.17791. :  82%|███████████████████████████████████▎       | 184/224 [01:24<00:17,  2.25it/s]
Epoch 50 Iter 185: loss 0.16916. :  82%|███████████████████████████████████▎       | 184/224 [01:24<00:17,  2.25it/s]
Epoch 50 Iter 185: loss 0.16916. :  83%|███████████████████████████████████▌       | 185/224 [01:24<00:17,  2.25it/s]
Epoch 50 Iter 186: loss 0.17850. :  83%|███████████████████████████████████▌       | 185/224 [01:24<00:17,  2.25it/s]
Epoch 50 Iter 186: loss 0.17850. :  83%|███████████████████████████████████▋       | 186/224 [01:24<00:16,  2.24it/s]
Epoch 50 Iter 187: loss 0.17519. :  83%|███████████████████████████████████▋       | 186/224 [01:25<00:16,  2.24it/s]
Epoch 50 Iter 187: loss 0.17519. :  83%|███████████████████████████████████▉       | 187/224 [01:25<00:16,  2.24it/s]
Epoch 50 Iter 188: loss 0.16606. :  83%|███████████████████████████████████▉       | 187/224 [01:25<00:16,  2.24it/s]
Epoch 50 Iter 188: loss 0.16606. :  84%|████████████████████████████████████       | 188/224 [01:25<00:16,  2.24it/s]
Epoch 50 Iter 189: loss 0.17342. :  84%|████████████████████████████████████       | 188/224 [01:26<00:16,  2.24it/s]
Epoch 50 Iter 189: loss 0.17342. :  84%|████████████████████████████████████▎      | 189/224 [01:26<00:15,  2.24it/s]
Epoch 50 Iter 190: loss 0.18739. :  84%|████████████████████████████████████▎      | 189/224 [01:26<00:15,  2.24it/s]
Epoch 50 Iter 190: loss 0.18739. :  85%|████████████████████████████████████▍      | 190/224 [01:26<00:15,  2.24it/s]
Epoch 50 Iter 191: loss 0.17465. :  85%|████████████████████████████████████▍      | 190/224 [01:27<00:15,  2.24it/s]
Epoch 50 Iter 191: loss 0.17465. :  85%|████████████████████████████████████▋      | 191/224 [01:27<00:14,  2.23it/s]
Epoch 50 Iter 192: loss 0.17891. :  85%|████████████████████████████████████▋      | 191/224 [01:27<00:14,  2.23it/s]
Epoch 50 Iter 192: loss 0.17891. :  86%|████████████████████████████████████▊      | 192/224 [01:27<00:14,  2.23it/s]
Epoch 50 Iter 193: loss 0.16141. :  86%|████████████████████████████████████▊      | 192/224 [01:28<00:14,  2.23it/s]
Epoch 50 Iter 193: loss 0.16141. :  86%|█████████████████████████████████████      | 193/224 [01:28<00:13,  2.23it/s]
Epoch 50 Iter 194: loss 0.16812. :  86%|█████████████████████████████████████      | 193/224 [01:28<00:13,  2.23it/s]
Epoch 50 Iter 194: loss 0.16812. :  87%|█████████████████████████████████████▏     | 194/224 [01:28<00:13,  2.23it/s]
Epoch 50 Iter 195: loss 0.17379. :  87%|█████████████████████████████████████▏     | 194/224 [01:28<00:13,  2.23it/s]
Epoch 50 Iter 195: loss 0.17379. :  87%|█████████████████████████████████████▍     | 195/224 [01:28<00:12,  2.25it/s]
Epoch 50 Iter 196: loss 0.17942. :  87%|█████████████████████████████████████▍     | 195/224 [01:29<00:12,  2.25it/s]
Epoch 50 Iter 196: loss 0.17942. :  88%|█████████████████████████████████████▋     | 196/224 [01:29<00:12,  2.24it/s]
Epoch 50 Iter 197: loss 0.18927. :  88%|█████████████████████████████████████▋     | 196/224 [01:29<00:12,  2.24it/s]
Epoch 50 Iter 197: loss 0.18927. :  88%|█████████████████████████████████████▊     | 197/224 [01:29<00:12,  2.24it/s]
Epoch 50 Iter 198: loss 0.15307. :  88%|█████████████████████████████████████▊     | 197/224 [01:30<00:12,  2.24it/s]
Epoch 50 Iter 198: loss 0.15307. :  88%|██████████████████████████████████████     | 198/224 [01:30<00:11,  2.24it/s]
Epoch 50 Iter 199: loss 0.16295. :  88%|██████████████████████████████████████     | 198/224 [01:30<00:11,  2.24it/s]
Epoch 50 Iter 199: loss 0.16295. :  89%|██████████████████████████████████████▏    | 199/224 [01:30<00:11,  2.24it/s]
Epoch 50 Iter 200: loss 0.19308. :  89%|██████████████████████████████████████▏    | 199/224 [01:31<00:11,  2.24it/s]
Epoch 50 Iter 200: loss 0.19308. :  89%|██████████████████████████████████████▍    | 200/224 [01:31<00:10,  2.24it/s]
Epoch 50 Iter 201: loss 0.17078. :  89%|██████████████████████████████████████▍    | 200/224 [01:31<00:10,  2.24it/s]
Epoch 50 Iter 201: loss 0.17078. :  90%|██████████████████████████████████████▌    | 201/224 [01:31<00:10,  2.25it/s]
Epoch 50 Iter 202: loss 0.17566. :  90%|██████████████████████████████████████▌    | 201/224 [01:32<00:10,  2.25it/s]
Epoch 50 Iter 202: loss 0.17566. :  90%|██████████████████████████████████████▊    | 202/224 [01:32<00:09,  2.25it/s]
Epoch 50 Iter 203: loss 0.17336. :  90%|██████████████████████████████████████▊    | 202/224 [01:32<00:09,  2.25it/s]
Epoch 50 Iter 203: loss 0.17336. :  91%|██████████████████████████████████████▉    | 203/224 [01:32<00:09,  2.25it/s]
Epoch 50 Iter 204: loss 0.17224. :  91%|██████████████████████████████████████▉    | 203/224 [01:32<00:09,  2.25it/s]
Epoch 50 Iter 204: loss 0.17224. :  91%|███████████████████████████████████████▏   | 204/224 [01:32<00:08,  2.25it/s]
Epoch 50 Iter 205: loss 0.19875. :  91%|███████████████████████████████████████▏   | 204/224 [01:33<00:08,  2.25it/s]
Epoch 50 Iter 205: loss 0.19875. :  92%|███████████████████████████████████████▎   | 205/224 [01:33<00:08,  2.24it/s]
Epoch 50 Iter 206: loss 0.18293. :  92%|███████████████████████████████████████▎   | 205/224 [01:33<00:08,  2.24it/s]
Epoch 50 Iter 206: loss 0.18293. :  92%|███████████████████████████████████████▌   | 206/224 [01:33<00:08,  2.24it/s]
Epoch 50 Iter 207: loss 0.16153. :  92%|███████████████████████████████████████▌   | 206/224 [01:34<00:08,  2.24it/s]
Epoch 50 Iter 207: loss 0.16153. :  92%|███████████████████████████████████████▋   | 207/224 [01:34<00:07,  2.22it/s]
Epoch 50 Iter 208: loss 0.16219. :  92%|███████████████████████████████████████▋   | 207/224 [01:34<00:07,  2.22it/s]
Epoch 50 Iter 208: loss 0.16219. :  93%|███████████████████████████████████████▉   | 208/224 [01:34<00:07,  2.22it/s]
Epoch 50 Iter 209: loss 0.17316. :  93%|███████████████████████████████████████▉   | 208/224 [01:35<00:07,  2.22it/s]
Epoch 50 Iter 209: loss 0.17316. :  93%|████████████████████████████████████████   | 209/224 [01:35<00:06,  2.22it/s]
Epoch 50 Iter 210: loss 0.16417. :  93%|████████████████████████████████████████   | 209/224 [01:35<00:06,  2.22it/s]
Epoch 50 Iter 210: loss 0.16417. :  94%|████████████████████████████████████████▎  | 210/224 [01:35<00:06,  2.22it/s]
Epoch 50 Iter 211: loss 0.18509. :  94%|████████████████████████████████████████▎  | 210/224 [01:36<00:06,  2.22it/s]
Epoch 50 Iter 211: loss 0.18509. :  94%|████████████████████████████████████████▌  | 211/224 [01:36<00:05,  2.23it/s]
Epoch 50 Iter 212: loss 0.16878. :  94%|████████████████████████████████████████▌  | 211/224 [01:36<00:05,  2.23it/s]
Epoch 50 Iter 212: loss 0.16878. :  95%|████████████████████████████████████████▋  | 212/224 [01:36<00:05,  2.24it/s]
Epoch 50 Iter 213: loss 0.16854. :  95%|████████████████████████████████████████▋  | 212/224 [01:36<00:05,  2.24it/s]
Epoch 50 Iter 213: loss 0.16854. :  95%|████████████████████████████████████████▉  | 213/224 [01:36<00:04,  2.23it/s]
Epoch 50 Iter 214: loss 0.19180. :  95%|████████████████████████████████████████▉  | 213/224 [01:37<00:04,  2.23it/s]
Epoch 50 Iter 214: loss 0.19180. :  96%|█████████████████████████████████████████  | 214/224 [01:37<00:04,  2.23it/s]
Epoch 50 Iter 215: loss 0.15730. :  96%|█████████████████████████████████████████  | 214/224 [01:37<00:04,  2.23it/s]
Epoch 50 Iter 215: loss 0.15730. :  96%|█████████████████████████████████████████▎ | 215/224 [01:37<00:04,  2.23it/s]
Epoch 50 Iter 216: loss 0.18459. :  96%|█████████████████████████████████████████▎ | 215/224 [01:38<00:04,  2.23it/s]
Epoch 50 Iter 216: loss 0.18459. :  96%|█████████████████████████████████████████▍ | 216/224 [01:38<00:03,  2.24it/s]
Epoch 50 Iter 217: loss 0.17656. :  96%|█████████████████████████████████████████▍ | 216/224 [01:38<00:03,  2.24it/s]
Epoch 50 Iter 217: loss 0.17656. :  97%|█████████████████████████████████████████▋ | 217/224 [01:38<00:03,  2.23it/s]
Epoch 50 Iter 218: loss 0.18792. :  97%|█████████████████████████████████████████▋ | 217/224 [01:39<00:03,  2.23it/s]
Epoch 50 Iter 218: loss 0.18792. :  97%|█████████████████████████████████████████▊ | 218/224 [01:39<00:02,  2.24it/s]
Epoch 50 Iter 219: loss 0.17763. :  97%|█████████████████████████████████████████▊ | 218/224 [01:39<00:02,  2.24it/s]
Epoch 50 Iter 219: loss 0.17763. :  98%|██████████████████████████████████████████ | 219/224 [01:39<00:02,  2.23it/s]
Epoch 50 Iter 220: loss 0.15297. :  98%|██████████████████████████████████████████ | 219/224 [01:40<00:02,  2.23it/s]
Epoch 50 Iter 220: loss 0.15297. :  98%|██████████████████████████████████████████▏| 220/224 [01:40<00:01,  2.23it/s]
Epoch 50 Iter 221: loss 0.16376. :  98%|██████████████████████████████████████████▏| 220/224 [01:40<00:01,  2.23it/s]
Epoch 50 Iter 221: loss 0.16376. :  99%|██████████████████████████████████████████▍| 221/224 [01:40<00:01,  2.22it/s]
Epoch 50 Iter 222: loss 0.17731. :  99%|██████████████████████████████████████████▍| 221/224 [01:41<00:01,  2.22it/s]
Epoch 50 Iter 222: loss 0.17731. :  99%|██████████████████████████████████████████▌| 222/224 [01:41<00:00,  2.21it/s]
Epoch 50 Iter 223: loss 0.18661. :  99%|██████████████████████████████████████████▌| 222/224 [01:41<00:00,  2.21it/s]
Epoch 50 Iter 223: loss 0.18661. : 100%|██████████████████████████████████████████▊| 223/224 [01:41<00:00,  2.22it/s]
Epoch 50 Iter 224: loss 0.17768. : 100%|██████████████████████████████████████████▊| 223/224 [01:41<00:00,  2.22it/s]
Epoch 50 Iter 224: loss 0.17768. : 100%|███████████████████████████████████████████| 224/224 [01:41<00:00,  2.24it/s]
Epoch 50 Iter 224: loss 0.17768. : 100%|███████████████████████████████████████████| 224/224 [01:41<00:00,  2.20it/s]
    Train loss: 0.17345
    Valid loss: 0.17973
       Valid loss recons: 0.17325
       Valid loss KL-D:   64.77007
Training completed

Images vs recons¶

In [5]:
img_vs_recons(model, test_loader, device)
No description has been provided for this image

Inference¶

In [6]:
plot_recons(inference(configs,model))
No description has been provided for this image

Latent space visualization¶

In [7]:
vis_latent(test_loader, model, test_dataset)
No description has been provided for this image

Interpolation¶

In [5]:
plot_reconstructed(model, xrange=(-50, 50), yrange=(-50, 50), N=15)
No description has been provided for this image

$Analysis$¶

Although the recons are not maybe the best we can get, the impact of KLD-divegence can obviously be seen the the reconstructed images in tensorboard. Using lambda-kld = 0.0, 1e-4, we could get the best recons, with lambda-kld = 1e-2 showing the poorest performance among others. As mentioned earlier, larger lambda-kld values enforces the network towards learning Guassian distribution, rather that meaningful features.

Extra Point:¶

  • The ccvae.py network is our extended ConvVAE for Image generation conditioned on a given class. The AFHQ dataset has 3 classes: 'cat', 'dog', and 'wildlife'.

  • Unlike before, during training and inference in this network, we also utilize $labels$ as one-hot encoded vectors being concatinated with the encoded image and fed into the linear layers for mu and sigma. Also, when the decoder wants to generate new samples from latent space, it also needs the given class lable. This is the main difference between the conditioned network and the previous pipeline. Encoding labels will potentially guide the network to learn and generate more reliable generations, as it can also be visualized in the related tensorboard results under the "CCVAE1_KLD_0.0001" name.